2023-10-08T08:21:02.366 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T08:21:02.366 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746 --owner scheduled_pdonnell@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/default mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/orig.config.yaml 2023-10-08T08:21:02.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T08:21:02.530 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746 branch: wip-batrick-testing-20231007.154158 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/default mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsstress}} email: pdonnell@redhat.com first_in_suite: false job_id: '7417746' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231007.154158 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de kclient: mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231007.154158 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8022 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de sleep_before_teardown: 0 subset: 128/256 suite: fs suite_branch: wip-batrick-testing-20231007.154158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_20:01:29 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T08:21:02.530 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa; will attempt to use it 2023-10-08T08:21:02.531 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks 2023-10-08T08:21:02.531 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T08:21:02.533 INFO:teuthology.task.internal:Checking packages... 2023-10-08T08:21:02.553 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de' 2023-10-08T08:21:02.554 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T08:21:02.554 INFO:teuthology.packaging:ref: None 2023-10-08T08:21:02.554 INFO:teuthology.packaging:tag: None 2023-10-08T08:21:02.554 INFO:teuthology.packaging:branch: wip-batrick-testing-20231007.154158 2023-10-08T08:21:02.554 INFO:teuthology.packaging:sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:21:02.554 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231007.154158 2023-10-08T08:21:02.690 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6639.g7b3143ba 2023-10-08T08:21:02.690 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T08:21:02.699 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T08:21:02.699 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T08:21:02.740 INFO:teuthology.task.internal:Saving configuration 2023-10-08T08:21:02.761 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T08:21:02.766 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T08:21:02.792 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 08:15:57.894549', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T08:21:02.815 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 08:15:57.896573', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T08:21:02.837 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 08:15:57.898378', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T08:21:02.837 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T08:21:02.842 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-08T08:21:02.842 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-08T08:21:02.842 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-08T08:21:02.842 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T08:21:02.945 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f95fa145b80>, signals=[15]) 2023-10-08T08:21:02.945 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T08:21:02.954 INFO:teuthology.task.internal:Opening connections... 2023-10-08T08:21:02.954 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:21:02.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T08:21:03.025 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2023-10-08T08:21:03.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T08:21:03.092 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2023-10-08T08:21:03.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T08:21:03.159 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T08:21:03.164 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-10-08T08:21:03.184 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-10-08T08:21:03.185 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-10-08T08:21:03.244 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T08:21:03.244 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T08:21:03.244 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel" 2023-10-08T08:21:03.244 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora" 2023-10-08T08:21:03.244 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.6" 2023-10-08T08:21:03.244 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-10-08T08:21:03.244 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T08:21:03.244 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-10-08T08:21:03.244 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T08:21:03.245 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T08:21:03.245 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T08:21:03.245 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T08:21:03.245 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:21:03.245 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T08:21:03.245 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T08:21:03.245 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T08:21:03.245 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T08:21:03.246 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-10-08T08:21:03.274 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-10-08T08:21:03.294 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-10-08T08:21:03.294 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-10-08T08:21:03.353 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T08:21:03.353 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T08:21:03.353 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel" 2023-10-08T08:21:03.353 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.6" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T08:21:03.354 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T08:21:03.355 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-10-08T08:21:03.373 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-10-08T08:21:03.392 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-10-08T08:21:03.392 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-10-08T08:21:03.449 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T08:21:03.449 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T08:21:03.449 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-10-08T08:21:03.449 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-10-08T08:21:03.449 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2023-10-08T08:21:03.449 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-10-08T08:21:03.449 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T08:21:03.449 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-10-08T08:21:03.450 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T08:21:03.450 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T08:21:03.450 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T08:21:03.450 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T08:21:03.450 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:21:03.450 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T08:21:03.450 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T08:21:03.450 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T08:21:03.450 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T08:21:03.451 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-10-08T08:21:03.473 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T08:21:03.484 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T08:21:03.488 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T08:21:03.488 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2023-10-08T08:21:03.490 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2023-10-08T08:21:03.493 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2023-10-08T08:21:03.509 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T08:21:03.515 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T08:21:03.515 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2023-10-08T08:21:03.550 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2023-10-08T08:21:03.552 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2023-10-08T08:21:03.586 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T08:21:03.656 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T08:21:03.670 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T08:21:03.670 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-10-08T08:21:03.671 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-10-08T08:21:03.671 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T08:21:03.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:21:03.689 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2023-10-08T08:21:03.747 INFO:teuthology.orchestra.run.smithi070.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T08:21:03.748 INFO:teuthology.task.kernel:Running kernel on smithi070: 4.18.0-372.9.1.el8.x86_64 2023-10-08T08:21:03.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2023-10-08T08:21:05.047 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-10-08T08:21:05.047 INFO:teuthology.orchestra.run.smithi070.stdout:Unable to read consumer identity 2023-10-08T08:21:06.655 INFO:teuthology.orchestra.run.smithi070.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-10-08T08:21:07.364 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-08T08:21:10.797 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 581 kB/s | 24 kB 00:00 2023-10-08T08:21:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T08:21:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2023-10-08T08:21:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2023-10-08T08:21:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2023-10-08T08:21:11.647 DEBUG:teuthology.orchestra.run.smithi070:> echo no | sudo yum reinstall kernel || true 2023-10-08T08:21:11.976 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-10-08T08:21:11.976 INFO:teuthology.orchestra.run.smithi070.stdout:Unable to read consumer identity 2023-10-08T08:21:12.249 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 08:21:10 AM UTC. 2023-10-08T08:21:12.289 INFO:teuthology.orchestra.run.smithi070.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T08:21:12.331 INFO:teuthology.orchestra.run.smithi070.stderr:Error: No packages marked for reinstall. 2023-10-08T08:21:12.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum reinstall -y kernel || true 2023-10-08T08:21:12.705 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-10-08T08:21:12.705 INFO:teuthology.orchestra.run.smithi070.stdout:Unable to read consumer identity 2023-10-08T08:21:12.963 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 08:21:10 AM UTC. 2023-10-08T08:21:13.003 INFO:teuthology.orchestra.run.smithi070.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T08:21:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:Error: No packages marked for reinstall. 2023-10-08T08:21:13.084 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T08:21:13.164 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T08:21:13.164 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T08:21:13.164 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T08:21:13.164 DEBUG:teuthology.parallel:result is None 2023-10-08T08:21:13.164 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T08:21:13.171 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T08:21:13.172 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T08:21:13.174 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T08:21:13.176 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T08:21:13.196 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T08:21:13.202 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T08:21:13.210 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T08:21:13.210 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T08:21:13.230 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T08:21:13.235 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T08:21:13.277 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T08:21:13.284 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T08:21:13.284 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T08:21:13.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:21:13.317 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T08:21:13.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:21:13.336 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T08:21:13.339 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T08:21:13.360 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T08:21:13.388 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T08:21:13.392 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T08:21:13.404 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T08:21:13.407 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T08:21:13.420 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T08:21:13.442 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T08:21:13.444 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T08:21:13.450 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T08:21:13.451 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T08:21:13.453 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T08:21:13.455 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T08:21:13.484 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T08:21:13.493 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T08:21:13.493 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T08:21:13.519 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T08:21:13.523 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T08:21:13.541 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T08:21:13.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T08:21:13.665 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T08:21:13.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T08:21:13.790 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:21:13.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T08:21:13.856 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T08:21:13.900 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T08:21:13.950 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T08:21:14.035 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T08:21:14.076 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:21:14.076 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T08:21:14.143 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T08:21:14.191 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T08:21:14.257 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T08:21:14.303 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T08:21:14.347 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:21:14.347 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T08:21:14.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2023-10-08T08:21:14.419 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2023-10-08T08:21:14.421 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2023-10-08T08:21:14.477 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T08:21:14.481 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T08:21:14.562 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T08:21:14.910 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T08:21:14.918 INFO:teuthology.task.internal:Starting timer... 2023-10-08T08:21:14.918 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T08:21:14.927 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T08:21:14.935 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T08:21:14.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2023-10-08T08:21:15.002 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2023-10-08T08:21:15.003 DEBUG:teuthology.orchestra.run.smithi105:> sudo service auditd rotate 2023-10-08T08:21:15.061 INFO:teuthology.orchestra.run.smithi105.stdout:Rotating logs: 2023-10-08T08:21:15.063 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2023-10-08T08:21:15.125 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2023-10-08T08:21:15.127 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T08:21:15.127 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2023-10-08T08:21:15.153 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2023-10-08T08:21:15.153 DEBUG:teuthology.orchestra.run.smithi105:> /usr/sbin/getenforce 2023-10-08T08:21:15.192 INFO:teuthology.orchestra.run.smithi105.stdout:Permissive 2023-10-08T08:21:15.193 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2023-10-08T08:21:15.220 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2023-10-08T08:21:15.220 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi105.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2023-10-08T08:21:15.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T08:21:15.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:21:15.249 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T08:21:15.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:21:15.279 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T08:21:15.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:21:15.307 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T08:21:15.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2023-10-08T08:21:15.333 DEBUG:teuthology.orchestra.run.smithi105:> sudo /usr/sbin/setenforce permissive 2023-10-08T08:21:15.361 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2023-10-08T08:21:15.391 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T08:21:15.401 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-08T08:21:15.401 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T08:21:15.416 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T08:21:15.417 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi105.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T08:30:47.316 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2023-10-08T08:30:47.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-10-08T08:30:47.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T08:30:47.427 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-10-08T08:30:47.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-10-08T08:30:47.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-08T08:30:47.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T08:30:47.566 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-10-08T08:30:47.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-08T08:30:47.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-08T08:30:47.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T08:30:47.706 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-10-08T08:30:47.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-08T08:30:47.777 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T08:30:47.790 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T08:30:47.791 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T08:30:47.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T08:30:47.795 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T08:30:47.795 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T08:30:47.799 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T08:30:47.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T08:30:47.828 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T08:30:47.831 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T08:30:47.844 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T08:30:47.845 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T08:30:47.850 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T08:30:47.865 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T08:30:47.916 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: ntpd: command not found 2023-10-08T08:30:47.918 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2023-10-08T08:30:47.929 INFO:teuthology.orchestra.run.smithi105.stdout:506 Cannot talk to daemon 2023-10-08T08:30:47.930 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2023-10-08T08:30:47.931 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2023-10-08T08:30:47.943 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T08:30:47.943 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2023-10-08T08:30:47.946 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T08:30:47.957 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T08:30:47.958 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T08:30:47.961 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T08:30:47.972 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T08:30:48.029 INFO:teuthology.orchestra.run.smithi105.stderr:bash: ntpq: command not found 2023-10-08T08:30:48.032 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T08:30:48.033 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2023-10-08T08:30:48.033 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.033 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.033 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.033 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.035 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2023-10-08T08:30:48.036 INFO:teuthology.orchestra.run.smithi070.stderr:bash: ntpq: command not found 2023-10-08T08:30:48.039 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T08:30:48.039 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2023-10-08T08:30:48.039 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.039 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.039 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.039 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.041 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T08:30:48.041 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2023-10-08T08:30:48.041 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.041 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.041 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.041 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:30:48.041 INFO:teuthology.run_tasks:Running task pexec... 2023-10-08T08:30:48.055 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-08T08:30:48.055 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:30:48.055 DEBUG:teuthology.orchestra.run.smithi070:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T08:30:48.056 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi105.front.sepia.ceph.com 2023-10-08T08:30:48.056 DEBUG:teuthology.orchestra.run.smithi105:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T08:30:48.056 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi191.front.sepia.ceph.com 2023-10-08T08:30:48.056 DEBUG:teuthology.orchestra.run.smithi191:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T08:30:48.445 INFO:teuthology.orchestra.run.smithi105.stdout:Updating Subscription Management repositories. 2023-10-08T08:30:48.450 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-10-08T08:30:48.453 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-10-08T08:30:50.113 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:02:04 ago on Sun 08 Oct 2023 08:28:45 AM UTC. 2023-10-08T08:30:50.243 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:51 ago on Sun 08 Oct 2023 08:28:58 AM UTC. 2023-10-08T08:30:50.254 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 0:01:50 ago on Sun 08 Oct 2023 08:28:59 AM UTC. 2023-10-08T08:30:51.836 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2023-10-08T08:30:51.837 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2023-10-08T08:30:51.838 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2023-10-08T08:30:51.838 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2023-10-08T08:30:51.838 INFO:teuthology.orchestra.run.smithi070.stdout:Resetting modules: 2023-10-08T08:30:51.838 INFO:teuthology.orchestra.run.smithi070.stdout: container-tools 2023-10-08T08:30:51.838 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:30:51.838 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2023-10-08T08:30:51.838 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2023-10-08T08:30:51.838 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:30:51.960 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2023-10-08T08:30:51.961 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2023-10-08T08:30:51.961 INFO:teuthology.orchestra.run.smithi105.stdout: Package Architecture Version Repository Size 2023-10-08T08:30:51.961 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2023-10-08T08:30:51.961 INFO:teuthology.orchestra.run.smithi105.stdout:Resetting modules: 2023-10-08T08:30:51.961 INFO:teuthology.orchestra.run.smithi105.stdout: container-tools 2023-10-08T08:30:51.961 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:30:51.961 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2023-10-08T08:30:51.961 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2023-10-08T08:30:51.962 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:30:51.971 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-10-08T08:30:51.972 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2023-10-08T08:30:51.972 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2023-10-08T08:30:51.972 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2023-10-08T08:30:51.972 INFO:teuthology.orchestra.run.smithi191.stdout:Resetting modules: 2023-10-08T08:30:51.972 INFO:teuthology.orchestra.run.smithi191.stdout: container-tools 2023-10-08T08:30:51.972 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:30:51.972 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2023-10-08T08:30:51.972 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2023-10-08T08:30:51.973 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:30:52.786 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:02:07 ago on Sun 08 Oct 2023 08:28:45 AM UTC. 2023-10-08T08:30:52.928 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:54 ago on Sun 08 Oct 2023 08:28:58 AM UTC. 2023-10-08T08:30:52.941 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 0:01:53 ago on Sun 08 Oct 2023 08:28:59 AM UTC. 2023-10-08T08:31:01.599 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-10-08T08:31:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2023-10-08T08:31:02.068 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-10-08T08:31:02.427 INFO:teuthology.orchestra.run.smithi105.stdout:Updating Subscription Management repositories. 2023-10-08T08:31:02.860 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2023-10-08T08:31:03.316 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-10-08T08:31:03.400 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:04 ago on Sun 08 Oct 2023 08:28:58 AM UTC. 2023-10-08T08:31:04.020 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 0:02:04 ago on Sun 08 Oct 2023 08:28:59 AM UTC. 2023-10-08T08:31:04.898 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:02:19 ago on Sun 08 Oct 2023 08:28:45 AM UTC. 2023-10-08T08:31:05.270 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-10-08T08:31:05.363 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================================================ 2023-10-08T08:31:05.363 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2023-10-08T08:31:05.363 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================================================ 2023-10-08T08:31:05.363 INFO:teuthology.orchestra.run.smithi191.stdout:Installing group/module packages: 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T08:31:05.364 INFO:teuthology.orchestra.run.smithi191.stdout:Installing module profiles: 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout: container-tools/common 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout:Enabling module streams: 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout: container-tools rhel8 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================================================ 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout:Install 10 Packages 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 18 M 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 65 M 2023-10-08T08:31:05.365 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2023-10-08T08:31:05.617 INFO:teuthology.orchestra.run.smithi191.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 371 kB/s | 94 kB 00:00 2023-10-08T08:31:05.642 INFO:teuthology.orchestra.run.smithi191.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 89 kB/s | 25 kB 00:00 2023-10-08T08:31:05.668 INFO:teuthology.orchestra.run.smithi191.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 134 kB/s | 41 kB 00:00 2023-10-08T08:31:05.708 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2023-10-08T08:31:05.776 INFO:teuthology.orchestra.run.smithi191.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 311 kB/s | 49 kB 00:00 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================================================ 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout: Package Arch Version Repository Size 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================================================ 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout:Installing group/module packages: 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T08:31:05.802 INFO:teuthology.orchestra.run.smithi105.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout:Installing module profiles: 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout: container-tools/common 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout:Enabling module streams: 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout: container-tools rhel8 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================================================ 2023-10-08T08:31:05.803 INFO:teuthology.orchestra.run.smithi105.stdout:Install 10 Packages 2023-10-08T08:31:05.804 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:31:05.804 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 18 M 2023-10-08T08:31:05.804 INFO:teuthology.orchestra.run.smithi105.stdout:Installed size: 65 M 2023-10-08T08:31:05.804 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2023-10-08T08:31:05.945 INFO:teuthology.orchestra.run.smithi105.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 289 kB/s | 41 kB 00:00 2023-10-08T08:31:05.952 INFO:teuthology.orchestra.run.smithi191.stdout:(5/10): buildah-1.26.2-1.module+el8.6.0+16771+2 28 MB/s | 8.0 MB 00:00 2023-10-08T08:31:05.962 INFO:teuthology.orchestra.run.smithi105.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 157 kB/s | 25 kB 00:00 2023-10-08T08:31:05.977 INFO:teuthology.orchestra.run.smithi191.stdout:(6/10): cockpit-podman-49.1-1.module+el8.6.0+16 1.5 MB/s | 524 kB 00:00 2023-10-08T08:31:06.055 INFO:teuthology.orchestra.run.smithi105.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 375 kB/s | 94 kB 00:00 2023-10-08T08:31:06.069 INFO:teuthology.orchestra.run.smithi191.stdout:(7/10): python3-podman-4.0.1-1.module+el8.6.0+1 511 kB/s | 149 kB 00:00 2023-10-08T08:31:06.088 INFO:teuthology.orchestra.run.smithi105.stdout:(4/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.1 MB/s | 524 kB 00:00 2023-10-08T08:31:06.136 INFO:teuthology.orchestra.run.smithi191.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.1 MB/s | 213 kB 00:00 2023-10-08T08:31:06.146 INFO:teuthology.orchestra.run.smithi105.stdout:(5/10): udica-0.2.6-4.module+el8.6.0+16771+28df 246 kB/s | 49 kB 00:00 2023-10-08T08:31:06.238 INFO:teuthology.orchestra.run.smithi105.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 994 kB/s | 149 kB 00:00 2023-10-08T08:31:06.339 INFO:teuthology.orchestra.run.smithi105.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 28 MB/s | 8.0 MB 00:00 2023-10-08T08:31:06.364 INFO:teuthology.orchestra.run.smithi105.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 980 kB/s | 213 kB 00:00 2023-10-08T08:31:06.395 INFO:teuthology.orchestra.run.smithi191.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 17 MB/s | 7.0 MB 00:00 2023-10-08T08:31:06.486 INFO:teuthology.orchestra.run.smithi191.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 5.3 MB/s | 2.2 MB 00:00 2023-10-08T08:31:06.487 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2023-10-08T08:31:06.487 INFO:teuthology.orchestra.run.smithi191.stdout:Total 16 MB/s | 18 MB 00:01 2023-10-08T08:31:06.539 INFO:teuthology.orchestra.run.smithi105.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 23 MB/s | 7.0 MB 00:00 2023-10-08T08:31:06.597 INFO:teuthology.orchestra.run.smithi105.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 8.5 MB/s | 2.2 MB 00:00 2023-10-08T08:31:06.598 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2023-10-08T08:31:06.598 INFO:teuthology.orchestra.run.smithi105.stdout:Total 23 MB/s | 18 MB 00:00 2023-10-08T08:31:06.688 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2023-10-08T08:31:06.707 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2023-10-08T08:31:06.707 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2023-10-08T08:31:06.753 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2023-10-08T08:31:06.796 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2023-10-08T08:31:06.815 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2023-10-08T08:31:06.815 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2023-10-08T08:31:06.847 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================================================ 2023-10-08T08:31:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================================================ 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout:Installing group/module packages: 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2023-10-08T08:31:06.848 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout:Installing module profiles: 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: container-tools/common 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling module streams: 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: container-tools rhel8 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2023-10-08T08:31:06.849 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================================================ 2023-10-08T08:31:06.850 INFO:teuthology.orchestra.run.smithi070.stdout:Install 10 Packages 2023-10-08T08:31:06.850 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:31:06.850 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 18 M 2023-10-08T08:31:06.851 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 65 M 2023-10-08T08:31:06.851 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2023-10-08T08:31:06.892 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2023-10-08T08:31:06.895 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2023-10-08T08:31:06.996 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2023-10-08T08:31:07.000 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2023-10-08T08:31:07.001 INFO:teuthology.orchestra.run.smithi070.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 270 kB/s | 41 kB 00:00 2023-10-08T08:31:07.027 INFO:teuthology.orchestra.run.smithi070.stdout:(2/10): python3-pyxdg-0.25-16.el8.noarch.rpm 531 kB/s | 94 kB 00:00 2023-10-08T08:31:07.093 INFO:teuthology.orchestra.run.smithi070.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 102 kB/s | 25 kB 00:00 2023-10-08T08:31:07.152 INFO:teuthology.orchestra.run.smithi070.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 327 kB/s | 49 kB 00:00 2023-10-08T08:31:07.227 INFO:teuthology.orchestra.run.smithi070.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.6 MB/s | 524 kB 00:00 2023-10-08T08:31:07.294 INFO:teuthology.orchestra.run.smithi070.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.0 MB/s | 149 kB 00:00 2023-10-08T08:31:07.378 INFO:teuthology.orchestra.run.smithi070.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.4 MB/s | 213 kB 00:00 2023-10-08T08:31:07.404 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2023-10-08T08:31:07.486 INFO:teuthology.orchestra.run.smithi070.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 20 MB/s | 8.0 MB 00:00 2023-10-08T08:31:07.489 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2023-10-08T08:31:07.545 INFO:teuthology.orchestra.run.smithi070.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 13 MB/s | 2.2 MB 00:00 2023-10-08T08:31:07.584 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T08:31:07.645 INFO:teuthology.orchestra.run.smithi070.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 20 MB/s | 7.0 MB 00:00 2023-10-08T08:31:07.646 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2023-10-08T08:31:07.646 INFO:teuthology.orchestra.run.smithi070.stdout:Total 23 MB/s | 18 MB 00:00 2023-10-08T08:31:07.663 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T08:31:07.762 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T08:31:07.828 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T08:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2023-10-08T08:31:07.863 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2023-10-08T08:31:07.863 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2023-10-08T08:31:07.940 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T08:31:08.005 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T08:31:08.045 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2023-10-08T08:31:08.049 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2023-10-08T08:31:08.122 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T08:31:08.201 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T08:31:08.499 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T08:31:08.548 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T08:31:08.586 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2023-10-08T08:31:08.809 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T08:31:08.989 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T08:31:09.184 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T08:31:09.253 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T08:31:09.302 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T08:31:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T08:31:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T08:31:10.137 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T08:31:10.169 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T08:31:10.351 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T08:31:10.375 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T08:31:10.544 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T08:31:10.544 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T08:31:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T08:31:10.704 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T08:31:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T08:31:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T08:31:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T08:31:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T08:31:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T08:31:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T08:31:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T08:31:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T08:31:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T08:31:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T08:31:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T08:31:10.990 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T08:31:10.990 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T08:31:10.990 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T08:31:10.991 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T08:31:10.991 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T08:31:10.991 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T08:31:10.991 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T08:31:10.991 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T08:31:10.991 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T08:31:10.991 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T08:31:11.454 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T08:31:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T08:31:11.871 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T08:31:12.073 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T08:31:12.137 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T08:31:12.137 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:13 ago on Sun 08 Oct 2023 08:28:58 AM UTC. 2023-10-08T08:31:12.145 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T08:31:12.146 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 0:02:12 ago on Sun 08 Oct 2023 08:28:59 AM UTC. 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T08:31:12.340 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T08:31:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T08:31:13.441 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:02:27 ago on Sun 08 Oct 2023 08:28:45 AM UTC. 2023-10-08T08:31:20.325 INFO:teuthology.orchestra.run.smithi070.stdout:Installed products updated. 2023-10-08T08:31:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:31:20.515 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2023-10-08T08:31:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T08:31:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T08:31:20.515 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T08:31:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T08:31:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T08:31:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T08:31:20.516 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:31:20.516 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2023-10-08T08:31:20.673 DEBUG:teuthology.parallel:result is None 2023-10-08T08:31:23.885 INFO:teuthology.orchestra.run.smithi191.stdout:Installed products updated. 2023-10-08T08:31:24.076 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:31:24.076 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2023-10-08T08:31:24.076 INFO:teuthology.orchestra.run.smithi191.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:24.076 INFO:teuthology.orchestra.run.smithi191.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T08:31:24.076 INFO:teuthology.orchestra.run.smithi191.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:24.076 INFO:teuthology.orchestra.run.smithi191.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T08:31:24.076 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T08:31:24.076 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T08:31:24.076 INFO:teuthology.orchestra.run.smithi191.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:24.077 INFO:teuthology.orchestra.run.smithi191.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:24.077 INFO:teuthology.orchestra.run.smithi191.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T08:31:24.077 INFO:teuthology.orchestra.run.smithi191.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T08:31:24.077 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:31:24.077 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-10-08T08:31:24.152 INFO:teuthology.orchestra.run.smithi105.stdout:Installed products updated. 2023-10-08T08:31:24.240 DEBUG:teuthology.parallel:result is None 2023-10-08T08:31:24.358 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:31:24.358 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2023-10-08T08:31:24.358 INFO:teuthology.orchestra.run.smithi105.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:24.358 INFO:teuthology.orchestra.run.smithi105.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T08:31:24.358 INFO:teuthology.orchestra.run.smithi105.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:24.358 INFO:teuthology.orchestra.run.smithi105.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T08:31:24.358 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T08:31:24.359 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T08:31:24.359 INFO:teuthology.orchestra.run.smithi105.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:24.359 INFO:teuthology.orchestra.run.smithi105.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T08:31:24.359 INFO:teuthology.orchestra.run.smithi105.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T08:31:24.359 INFO:teuthology.orchestra.run.smithi105.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T08:31:24.359 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:31:24.359 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2023-10-08T08:31:24.499 DEBUG:teuthology.parallel:result is None 2023-10-08T08:31:24.499 INFO:teuthology.run_tasks:Running task install... 2023-10-08T08:31:24.513 DEBUG:teuthology.task.install:project ceph 2023-10-08T08:31:24.514 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}} 2023-10-08T08:31:24.514 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'} 2023-10-08T08:31:24.514 INFO:teuthology.task.install:Using flavor: default 2023-10-08T08:31:24.521 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T08:31:24.521 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T08:31:24.521 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T08:31:24.522 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:31:24.525 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T08:31:24.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:31:24.527 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T08:31:24.527 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:31:24.670 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T08:31:24.670 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T08:31:24.739 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T08:31:24.739 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T08:31:24.748 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T08:31:24.748 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T08:31:24.928 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T08:31:24.929 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:31:24.929 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T08:31:24.957 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T08:31:24.958 DEBUG:teuthology.orchestra.run.smithi105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T08:31:25.012 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T08:31:25.012 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:31:25.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T08:31:25.026 DEBUG:teuthology.orchestra.run.smithi105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T08:31:25.045 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T08:31:25.045 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T08:31:25.093 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T08:31:25.094 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:31:25.094 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T08:31:25.105 DEBUG:teuthology.orchestra.run.smithi105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T08:31:25.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T08:31:25.124 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T08:31:25.124 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T08:31:25.170 INFO:teuthology.orchestra.run.smithi105.stdout:check_obsoletes = 1 2023-10-08T08:31:25.172 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum clean all 2023-10-08T08:31:25.193 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T08:31:25.198 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T08:31:25.267 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2023-10-08T08:31:25.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2023-10-08T08:31:25.274 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T08:31:25.342 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2023-10-08T08:31:25.343 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2023-10-08T08:31:25.543 INFO:teuthology.orchestra.run.smithi105.stdout:Updating Subscription Management repositories. 2023-10-08T08:31:25.643 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-10-08T08:31:25.715 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-10-08T08:31:26.499 INFO:teuthology.orchestra.run.smithi105.stdout:44 files removed 2023-10-08T08:31:26.551 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T08:31:26.742 INFO:teuthology.orchestra.run.smithi191.stdout:44 files removed 2023-10-08T08:31:26.792 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T08:31:26.839 INFO:teuthology.orchestra.run.smithi070.stdout:44 files removed 2023-10-08T08:31:26.884 INFO:teuthology.orchestra.run.smithi105.stdout:Updating Subscription Management repositories. 2023-10-08T08:31:26.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T08:31:27.124 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-10-08T08:31:27.223 INFO:teuthology.orchestra.run.smithi070.stdout:Updating Subscription Management repositories. 2023-10-08T08:31:28.165 INFO:teuthology.orchestra.run.smithi105.stdout:ceph packages for x86_64 224 kB/s | 81 kB 00:00 2023-10-08T08:31:28.424 INFO:teuthology.orchestra.run.smithi105.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2023-10-08T08:31:28.488 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 265 kB/s | 81 kB 00:00 2023-10-08T08:31:28.603 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 291 kB/s | 81 kB 00:00 2023-10-08T08:31:28.733 INFO:teuthology.orchestra.run.smithi105.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2023-10-08T08:31:28.855 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-10-08T08:31:28.884 INFO:teuthology.orchestra.run.smithi105.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-08T08:31:28.904 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-10-08T08:31:29.189 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 4.8 kB/s | 1.5 kB 00:00 2023-10-08T08:31:29.254 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2023-10-08T08:31:29.339 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-08T08:31:29.405 INFO:teuthology.orchestra.run.smithi070.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-08T08:31:30.082 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-08T08:31:30.600 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-08T08:31:33.151 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 3.7 MB/s | 16 MB 00:04 2023-10-08T08:31:33.549 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 599 kB/s | 24 kB 00:00 2023-10-08T08:31:34.081 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 511 kB/s | 24 kB 00:00 2023-10-08T08:31:34.851 INFO:teuthology.orchestra.run.smithi191.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 MB/s | 53 MB 00:01 2023-10-08T08:31:35.257 INFO:teuthology.orchestra.run.smithi070.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 53 MB 00:01 2023-10-08T08:31:36.626 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 367 kB/s | 24 kB 00:00 2023-10-08T08:31:37.753 INFO:teuthology.orchestra.run.smithi105.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 MB/s | 47 MB 00:01 2023-10-08T08:31:43.421 INFO:teuthology.orchestra.run.smithi191.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 MB/s | 47 MB 00:01 2023-10-08T08:31:43.675 INFO:teuthology.orchestra.run.smithi070.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 MB/s | 47 MB 00:01 2023-10-08T08:31:46.163 INFO:teuthology.orchestra.run.smithi105.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 MB/s | 53 MB 00:01 2023-10-08T08:31:54.359 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T08:31:54.359 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T08:31:54.374 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T08:31:54.375 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T08:31:54.376 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T08:31:54.377 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T08:31:54.379 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T08:31:54.382 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T08:31:54.384 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T08:31:54.518 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-10-08T08:31:54.530 INFO:teuthology.orchestra.run.smithi191.stdout:=========================================================================================================================== 2023-10-08T08:31:54.530 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2023-10-08T08:31:54.530 INFO:teuthology.orchestra.run.smithi191.stdout:=========================================================================================================================== 2023-10-08T08:31:54.530 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2023-10-08T08:31:54.530 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T08:31:54.531 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T08:31:54.531 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T08:31:54.531 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T08:31:54.531 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T08:31:54.531 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T08:31:54.531 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T08:31:54.532 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T08:31:54.532 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T08:31:54.532 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T08:31:54.532 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T08:31:54.532 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T08:31:54.532 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T08:31:54.532 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T08:31:54.532 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T08:31:54.533 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T08:31:54.533 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T08:31:54.533 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T08:31:54.533 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T08:31:54.533 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T08:31:54.533 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T08:31:54.533 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T08:31:54.534 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T08:31:54.534 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T08:31:54.534 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T08:31:54.534 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T08:31:54.534 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T08:31:54.534 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T08:31:54.534 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T08:31:54.534 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T08:31:54.535 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T08:31:54.535 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T08:31:54.535 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T08:31:54.535 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T08:31:54.535 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T08:31:54.535 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T08:31:54.535 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T08:31:54.536 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2023-10-08T08:31:54.536 INFO:teuthology.orchestra.run.smithi191.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T08:31:54.536 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T08:31:54.536 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T08:31:54.536 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2023-10-08T08:31:54.536 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T08:31:54.536 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T08:31:54.537 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T08:31:54.537 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T08:31:54.537 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T08:31:54.537 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T08:31:54.537 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T08:31:54.537 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T08:31:54.537 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T08:31:54.537 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T08:31:54.538 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T08:31:54.538 INFO:teuthology.orchestra.run.smithi191.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T08:31:54.538 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T08:31:54.538 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T08:31:54.538 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T08:31:54.538 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T08:31:54.538 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T08:31:54.538 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T08:31:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T08:31:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T08:31:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T08:31:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T08:31:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T08:31:54.539 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T08:31:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T08:31:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T08:31:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T08:31:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T08:31:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T08:31:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T08:31:54.540 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T08:31:54.541 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T08:31:54.541 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T08:31:54.541 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T08:31:54.541 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T08:31:54.541 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T08:31:54.541 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T08:31:54.541 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T08:31:54.542 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T08:31:54.542 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T08:31:54.542 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T08:31:54.542 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T08:31:54.542 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T08:31:54.542 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T08:31:54.542 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T08:31:54.543 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T08:31:54.544 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T08:31:54.544 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T08:31:54.544 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T08:31:54.544 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T08:31:54.544 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T08:31:54.544 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T08:31:54.544 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T08:31:54.545 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T08:31:54.545 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T08:31:54.545 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T08:31:54.545 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T08:31:54.545 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T08:31:54.545 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T08:31:54.545 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T08:31:54.546 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T08:31:54.546 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T08:31:54.546 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T08:31:54.546 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T08:31:54.546 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T08:31:54.546 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T08:31:54.547 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T08:31:54.547 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T08:31:54.547 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T08:31:54.547 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T08:31:54.547 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T08:31:54.548 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T08:31:54.548 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T08:31:54.548 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T08:31:54.548 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T08:31:54.548 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T08:31:54.548 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T08:31:54.548 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T08:31:54.549 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T08:31:54.549 INFO:teuthology.orchestra.run.smithi191.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T08:31:54.549 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T08:31:54.549 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T08:31:54.549 INFO:teuthology.orchestra.run.smithi191.stdout:Enabling module streams: 2023-10-08T08:31:54.549 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql 10 2023-10-08T08:31:54.549 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:31:54.550 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2023-10-08T08:31:54.550 INFO:teuthology.orchestra.run.smithi191.stdout:=========================================================================================================================== 2023-10-08T08:31:54.550 INFO:teuthology.orchestra.run.smithi191.stdout:Install 128 Packages 2023-10-08T08:31:54.550 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 3 Packages 2023-10-08T08:31:54.550 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:31:54.552 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T08:31:54.552 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T08:31:54.552 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 209 M 2023-10-08T08:31:54.552 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2023-10-08T08:31:54.562 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T08:31:54.563 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T08:31:54.565 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T08:31:54.566 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T08:31:54.568 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T08:31:54.571 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T08:31:54.573 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T08:31:54.704 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2023-10-08T08:31:54.716 INFO:teuthology.orchestra.run.smithi070.stdout:=========================================================================================================================== 2023-10-08T08:31:54.716 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2023-10-08T08:31:54.716 INFO:teuthology.orchestra.run.smithi070.stdout:=========================================================================================================================== 2023-10-08T08:31:54.716 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T08:31:54.717 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T08:31:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T08:31:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T08:31:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T08:31:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T08:31:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T08:31:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T08:31:54.718 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T08:31:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T08:31:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T08:31:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T08:31:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T08:31:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T08:31:54.719 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T08:31:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T08:31:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T08:31:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T08:31:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T08:31:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T08:31:54.720 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T08:31:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T08:31:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T08:31:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T08:31:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T08:31:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T08:31:54.721 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T08:31:54.722 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T08:31:54.722 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T08:31:54.723 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T08:31:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T08:31:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T08:31:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T08:31:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T08:31:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T08:31:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T08:31:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T08:31:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T08:31:54.724 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T08:31:54.725 INFO:teuthology.orchestra.run.smithi070.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T08:31:54.726 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T08:31:54.727 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T08:31:54.728 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T08:31:54.729 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T08:31:54.730 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling module streams: 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql 10 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2023-10-08T08:31:54.731 INFO:teuthology.orchestra.run.smithi070.stdout:=========================================================================================================================== 2023-10-08T08:31:54.732 INFO:teuthology.orchestra.run.smithi070.stdout:Install 128 Packages 2023-10-08T08:31:54.732 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 3 Packages 2023-10-08T08:31:54.732 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:31:54.732 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 209 M 2023-10-08T08:31:54.732 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2023-10-08T08:31:54.966 INFO:teuthology.orchestra.run.smithi070.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 36 kB/s | 6.4 kB 00:00 2023-10-08T08:31:55.027 INFO:teuthology.orchestra.run.smithi191.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 49 kB/s | 6.4 kB 00:00 2023-10-08T08:31:55.283 INFO:teuthology.orchestra.run.smithi070.stdout:(2/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 11 MB/s | 5.4 MB 00:00 2023-10-08T08:31:55.333 INFO:teuthology.orchestra.run.smithi070.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 3.3 MB/s | 167 kB 00:00 2023-10-08T08:31:55.500 INFO:teuthology.orchestra.run.smithi070.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 14 MB/s | 2.3 MB 00:00 2023-10-08T08:31:55.552 INFO:teuthology.orchestra.run.smithi191.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.7 MB/s | 918 kB 00:00 2023-10-08T08:31:55.617 INFO:teuthology.orchestra.run.smithi070.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 14 MB/s | 1.6 MB 00:00 2023-10-08T08:31:55.644 INFO:teuthology.orchestra.run.smithi191.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 1.8 MB/s | 167 kB 00:00 2023-10-08T08:31:55.659 INFO:teuthology.orchestra.run.smithi070.stdout:(6/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.3 MB/s | 918 kB 00:00 2023-10-08T08:31:55.926 INFO:teuthology.orchestra.run.smithi070.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 15 MB/s | 4.6 MB 00:00 2023-10-08T08:31:56.636 INFO:teuthology.orchestra.run.smithi191.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 2.3 MB/s | 2.3 MB 00:00 2023-10-08T08:31:56.851 INFO:teuthology.orchestra.run.smithi070.stdout:(8/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el8 15 MB/s | 14 MB 00:00 2023-10-08T08:31:56.910 INFO:teuthology.orchestra.run.smithi070.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 418 kB/s | 24 kB 00:00 2023-10-08T08:31:56.962 INFO:teuthology.orchestra.run.smithi191.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 5.0 MB/s | 1.6 MB 00:00 2023-10-08T08:31:57.261 INFO:teuthology.orchestra.run.smithi105.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T08:31:57.261 INFO:teuthology.orchestra.run.smithi105.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T08:31:57.276 INFO:teuthology.orchestra.run.smithi105.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T08:31:57.278 INFO:teuthology.orchestra.run.smithi105.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T08:31:57.278 INFO:teuthology.orchestra.run.smithi105.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T08:31:57.279 INFO:teuthology.orchestra.run.smithi105.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T08:31:57.281 INFO:teuthology.orchestra.run.smithi105.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T08:31:57.284 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T08:31:57.285 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T08:31:57.418 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2023-10-08T08:31:57.432 INFO:teuthology.orchestra.run.smithi105.stdout:=========================================================================================================================== 2023-10-08T08:31:57.432 INFO:teuthology.orchestra.run.smithi105.stdout: Package Arch Version Repository Size 2023-10-08T08:31:57.432 INFO:teuthology.orchestra.run.smithi105.stdout:=========================================================================================================================== 2023-10-08T08:31:57.432 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2023-10-08T08:31:57.432 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T08:31:57.432 INFO:teuthology.orchestra.run.smithi105.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T08:31:57.432 INFO:teuthology.orchestra.run.smithi105.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T08:31:57.433 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T08:31:57.434 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T08:31:57.435 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrading: 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T08:31:57.436 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T08:31:57.437 INFO:teuthology.orchestra.run.smithi105.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T08:31:57.438 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T08:31:57.439 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T08:31:57.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T08:31:57.441 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T08:31:57.441 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T08:31:57.441 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T08:31:57.441 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T08:31:57.441 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T08:31:57.441 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T08:31:57.441 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T08:31:57.441 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T08:31:57.441 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T08:31:57.443 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T08:31:57.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T08:31:57.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T08:31:57.446 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T08:31:57.447 INFO:teuthology.orchestra.run.smithi105.stdout:Enabling module streams: 2023-10-08T08:31:57.447 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql 10 2023-10-08T08:31:57.447 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:31:57.447 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2023-10-08T08:31:57.447 INFO:teuthology.orchestra.run.smithi105.stdout:=========================================================================================================================== 2023-10-08T08:31:57.447 INFO:teuthology.orchestra.run.smithi105.stdout:Install 128 Packages 2023-10-08T08:31:57.447 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrade 3 Packages 2023-10-08T08:31:57.447 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:31:57.448 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 209 M 2023-10-08T08:31:57.448 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2023-10-08T08:31:57.763 INFO:teuthology.orchestra.run.smithi105.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-10-08T08:31:58.062 INFO:teuthology.orchestra.run.smithi191.stdout:(6/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-10-08T08:31:58.354 INFO:teuthology.orchestra.run.smithi191.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 3.3 MB/s | 4.6 MB 00:01 2023-10-08T08:31:58.530 INFO:teuthology.orchestra.run.smithi105.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.2 MB/s | 918 kB 00:00 2023-10-08T08:31:58.690 INFO:teuthology.orchestra.run.smithi105.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 1.0 MB/s | 167 kB 00:00 2023-10-08T08:31:58.854 INFO:teuthology.orchestra.run.smithi191.stdout:(8/131): ceph-common-18.0.0-6639.g7b3143ba.el8. 5.7 MB/s | 23 MB 00:03 2023-10-08T08:31:58.946 INFO:teuthology.orchestra.run.smithi191.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 266 kB/s | 24 kB 00:00 2023-10-08T08:31:59.556 INFO:teuthology.orchestra.run.smithi105.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 2.7 MB/s | 2.3 MB 00:00 2023-10-08T08:32:00.052 INFO:teuthology.orchestra.run.smithi105.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 3.3 MB/s | 1.6 MB 00:00 2023-10-08T08:32:00.348 INFO:teuthology.orchestra.run.smithi105.stdout:(6/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 1.9 MB/s | 5.4 MB 00:02 2023-10-08T08:32:01.090 INFO:teuthology.orchestra.run.smithi105.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 4.5 MB/s | 4.6 MB 00:01 2023-10-08T08:32:03.062 INFO:teuthology.orchestra.run.smithi191.stdout:(10/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 2.9 MB/s | 14 MB 00:04 2023-10-08T08:32:03.229 INFO:teuthology.orchestra.run.smithi191.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 1.5 MB/s | 261 kB 00:00 2023-10-08T08:32:03.321 INFO:teuthology.orchestra.run.smithi191.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 339 kB/s | 31 kB 00:00 2023-10-08T08:32:03.582 INFO:teuthology.orchestra.run.smithi105.stdout:(8/131): ceph-common-18.0.0-6639.g7b3143ba.el8. 3.7 MB/s | 23 MB 00:06 2023-10-08T08:32:03.605 INFO:teuthology.orchestra.run.smithi191.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 2.9 MB/s | 840 kB 00:00 2023-10-08T08:32:03.682 INFO:teuthology.orchestra.run.smithi105.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 243 kB/s | 24 kB 00:00 2023-10-08T08:32:03.720 INFO:teuthology.orchestra.run.smithi191.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 1.6 MB/s | 184 kB 00:00 2023-10-08T08:32:03.797 INFO:teuthology.orchestra.run.smithi191.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 1.8 MB/s | 139 kB 00:00 2023-10-08T08:32:03.825 INFO:teuthology.orchestra.run.smithi105.stdout:(10/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 5.1 MB/s | 14 MB 00:02 2023-10-08T08:32:03.899 INFO:teuthology.orchestra.run.smithi105.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 3.4 MB/s | 261 kB 00:00 2023-10-08T08:32:03.931 INFO:teuthology.orchestra.run.smithi191.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 3.8 MB/s | 518 kB 00:00 2023-10-08T08:32:03.966 INFO:teuthology.orchestra.run.smithi105.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 466 kB/s | 31 kB 00:00 2023-10-08T08:32:04.124 INFO:teuthology.orchestra.run.smithi105.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 5.2 MB/s | 840 kB 00:00 2023-10-08T08:32:04.200 INFO:teuthology.orchestra.run.smithi105.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 2.4 MB/s | 184 kB 00:00 2023-10-08T08:32:04.242 INFO:teuthology.orchestra.run.smithi070.stdout:(10/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 6.7 MB/s | 49 MB 00:07 2023-10-08T08:32:04.275 INFO:teuthology.orchestra.run.smithi105.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 1.8 MB/s | 139 kB 00:00 2023-10-08T08:32:04.392 INFO:teuthology.orchestra.run.smithi070.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 1.7 MB/s | 261 kB 00:00 2023-10-08T08:32:04.467 INFO:teuthology.orchestra.run.smithi105.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 2.6 MB/s | 518 kB 00:00 2023-10-08T08:32:04.476 INFO:teuthology.orchestra.run.smithi070.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 373 kB/s | 31 kB 00:00 2023-10-08T08:32:04.826 INFO:teuthology.orchestra.run.smithi070.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 2.3 MB/s | 840 kB 00:00 2023-10-08T08:32:04.902 INFO:teuthology.orchestra.run.smithi070.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 2.4 MB/s | 184 kB 00:00 2023-10-08T08:32:04.985 INFO:teuthology.orchestra.run.smithi070.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 1.6 MB/s | 139 kB 00:00 2023-10-08T08:32:05.194 INFO:teuthology.orchestra.run.smithi070.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 2.4 MB/s | 518 kB 00:00 2023-10-08T08:32:05.617 INFO:teuthology.orchestra.run.smithi105.stdout:(17/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 6.0 MB/s | 6.9 MB 00:01 2023-10-08T08:32:05.692 INFO:teuthology.orchestra.run.smithi105.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 598 kB/s | 45 kB 00:00 2023-10-08T08:32:05.776 INFO:teuthology.orchestra.run.smithi105.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 1.5 MB/s | 125 kB 00:00 2023-10-08T08:32:05.859 INFO:teuthology.orchestra.run.smithi105.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 2.3 MB/s | 197 kB 00:00 2023-10-08T08:32:05.943 INFO:teuthology.orchestra.run.smithi105.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 4.3 MB/s | 371 kB 00:00 2023-10-08T08:32:06.010 INFO:teuthology.orchestra.run.smithi105.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 5.4 MB/s | 365 kB 00:00 2023-10-08T08:32:06.069 INFO:teuthology.orchestra.run.smithi105.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.8 MB/s | 107 kB 00:00 2023-10-08T08:32:06.119 INFO:teuthology.orchestra.run.smithi105.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-08T08:32:06.119 INFO:teuthology.orchestra.run.smithi070.stdout:(17/131): ceph-common-18.0.0-6639.g7b3143ba.el8 2.0 MB/s | 23 MB 00:11 2023-10-08T08:32:06.172 INFO:teuthology.orchestra.run.smithi191.stdout:(17/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 3.1 MB/s | 6.9 MB 00:02 2023-10-08T08:32:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 490 kB/s | 45 kB 00:00 2023-10-08T08:32:06.264 INFO:teuthology.orchestra.run.smithi191.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 490 kB/s | 45 kB 00:00 2023-10-08T08:32:06.395 INFO:teuthology.orchestra.run.smithi070.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 685 kB/s | 125 kB 00:00 2023-10-08T08:32:06.406 INFO:teuthology.orchestra.run.smithi191.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 888 kB/s | 125 kB 00:00 2023-10-08T08:32:06.578 INFO:teuthology.orchestra.run.smithi070.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 1.0 MB/s | 197 kB 00:00 2023-10-08T08:32:06.598 INFO:teuthology.orchestra.run.smithi191.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 1.0 MB/s | 197 kB 00:00 2023-10-08T08:32:06.653 INFO:teuthology.orchestra.run.smithi105.stdout:(25/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 6.7 MB/s | 3.6 MB 00:00 2023-10-08T08:32:06.740 INFO:teuthology.orchestra.run.smithi191.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 2.6 MB/s | 371 kB 00:00 2023-10-08T08:32:06.744 INFO:teuthology.orchestra.run.smithi105.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 1.9 MB/s | 179 kB 00:00 2023-10-08T08:32:06.828 INFO:teuthology.orchestra.run.smithi070.stdout:(21/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 4.2 MB/s | 6.9 MB 00:01 2023-10-08T08:32:06.832 INFO:teuthology.orchestra.run.smithi191.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 3.9 MB/s | 365 kB 00:00 2023-10-08T08:32:06.853 INFO:teuthology.orchestra.run.smithi070.stdout:(22/131): python3-rados-18.0.0-6639.g7b3143ba.e 1.3 MB/s | 371 kB 00:00 2023-10-08T08:32:06.907 INFO:teuthology.orchestra.run.smithi191.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.4 MB/s | 107 kB 00:00 2023-10-08T08:32:06.912 INFO:teuthology.orchestra.run.smithi070.stdout:(23/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 4.3 MB/s | 365 kB 00:00 2023-10-08T08:32:06.936 INFO:teuthology.orchestra.run.smithi105.stdout:(27/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 2.7 MB/s | 18 MB 00:06 2023-10-08T08:32:06.937 INFO:teuthology.orchestra.run.smithi070.stdout:(24/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.2 MB/s | 107 kB 00:00 2023-10-08T08:32:06.962 INFO:teuthology.orchestra.run.smithi105.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6639.g 106 kB/s | 23 kB 00:00 2023-10-08T08:32:06.991 INFO:teuthology.orchestra.run.smithi191.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.1 MB/s | 94 kB 00:00 2023-10-08T08:32:07.004 INFO:teuthology.orchestra.run.smithi105.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.9 MB/s | 132 kB 00:00 2023-10-08T08:32:07.004 INFO:teuthology.orchestra.run.smithi070.stdout:(25/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.0 MB/s | 94 kB 00:00 2023-10-08T08:32:07.096 INFO:teuthology.orchestra.run.smithi070.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 1.9 MB/s | 179 kB 00:00 2023-10-08T08:32:07.163 INFO:teuthology.orchestra.run.smithi070.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 346 kB/s | 23 kB 00:00 2023-10-08T08:32:07.216 INFO:teuthology.orchestra.run.smithi191.stdout:(25/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 2.0 MB/s | 18 MB 00:09 2023-10-08T08:32:07.229 INFO:teuthology.orchestra.run.smithi105.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 6.6 MB/s | 1.8 MB 00:00 2023-10-08T08:32:07.230 INFO:teuthology.orchestra.run.smithi070.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.9 MB/s | 132 kB 00:00 2023-10-08T08:32:07.304 INFO:teuthology.orchestra.run.smithi105.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 3.2 MB/s | 242 kB 00:00 2023-10-08T08:32:07.358 INFO:teuthology.orchestra.run.smithi191.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 1.2 MB/s | 179 kB 00:00 2023-10-08T08:32:07.380 INFO:teuthology.orchestra.run.smithi105.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 630 kB/s | 47 kB 00:00 2023-10-08T08:32:07.450 INFO:teuthology.orchestra.run.smithi191.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 252 kB/s | 23 kB 00:00 2023-10-08T08:32:07.455 INFO:teuthology.orchestra.run.smithi105.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 193 kB/s | 15 kB 00:00 2023-10-08T08:32:07.538 INFO:teuthology.orchestra.run.smithi105.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 3.1 MB/s | 261 kB 00:00 2023-10-08T08:32:07.542 INFO:teuthology.orchestra.run.smithi191.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.4 MB/s | 132 kB 00:00 2023-10-08T08:32:07.614 INFO:teuthology.orchestra.run.smithi105.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 2.5 MB/s | 190 kB 00:00 2023-10-08T08:32:07.655 INFO:teuthology.orchestra.run.smithi070.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 4.1 MB/s | 1.8 MB 00:00 2023-10-08T08:32:07.689 INFO:teuthology.orchestra.run.smithi105.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 241 kB/s | 18 kB 00:00 2023-10-08T08:32:07.848 INFO:teuthology.orchestra.run.smithi105.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.9 MB/s | 306 kB 00:00 2023-10-08T08:32:07.890 INFO:teuthology.orchestra.run.smithi105.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-10-08T08:32:07.933 INFO:teuthology.orchestra.run.smithi105.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-10-08T08:32:07.993 INFO:teuthology.orchestra.run.smithi191.stdout:(29/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 3.6 MB/s | 3.6 MB 00:01 2023-10-08T08:32:08.015 INFO:teuthology.orchestra.run.smithi105.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.6 MB/s | 476 kB 00:00 2023-10-08T08:32:08.066 INFO:teuthology.orchestra.run.smithi105.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 870 kB/s | 44 kB 00:00 2023-10-08T08:32:08.116 INFO:teuthology.orchestra.run.smithi105.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-10-08T08:32:08.166 INFO:teuthology.orchestra.run.smithi105.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 662 kB/s | 33 kB 00:00 2023-10-08T08:32:08.217 INFO:teuthology.orchestra.run.smithi105.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-10-08T08:32:08.267 INFO:teuthology.orchestra.run.smithi105.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-10-08T08:32:08.326 INFO:teuthology.orchestra.run.smithi105.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 6.4 MB/s | 384 kB 00:00 2023-10-08T08:32:08.368 INFO:teuthology.orchestra.run.smithi191.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 2.1 MB/s | 1.8 MB 00:00 2023-10-08T08:32:08.384 INFO:teuthology.orchestra.run.smithi105.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-08T08:32:08.435 INFO:teuthology.orchestra.run.smithi105.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-10-08T08:32:08.485 INFO:teuthology.orchestra.run.smithi105.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2023-10-08T08:32:08.518 INFO:teuthology.orchestra.run.smithi191.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 1.6 MB/s | 242 kB 00:00 2023-10-08T08:32:08.523 INFO:teuthology.orchestra.run.smithi070.stdout:(30/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 2.3 MB/s | 3.6 MB 00:01 2023-10-08T08:32:08.568 INFO:teuthology.orchestra.run.smithi105.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 14 MB/s | 1.2 MB 00:00 2023-10-08T08:32:08.610 INFO:teuthology.orchestra.run.smithi105.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-10-08T08:32:08.656 INFO:teuthology.orchestra.run.smithi070.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 1.8 MB/s | 242 kB 00:00 2023-10-08T08:32:08.661 INFO:teuthology.orchestra.run.smithi105.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.2 MB/s | 59 kB 00:00 2023-10-08T08:32:08.703 INFO:teuthology.orchestra.run.smithi105.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-10-08T08:32:08.761 INFO:teuthology.orchestra.run.smithi105.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-10-08T08:32:08.795 INFO:teuthology.orchestra.run.smithi105.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 467 kB/s | 16 kB 00:00 2023-10-08T08:32:08.837 INFO:teuthology.orchestra.run.smithi105.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 811 kB/s | 34 kB 00:00 2023-10-08T08:32:08.865 INFO:teuthology.orchestra.run.smithi070.stdout:(32/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 1.4 MB/s | 18 MB 00:13 2023-10-08T08:32:08.890 INFO:teuthology.orchestra.run.smithi070.stdout:(33/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 203 kB/s | 47 kB 00:00 2023-10-08T08:32:08.904 INFO:teuthology.orchestra.run.smithi105.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-10-08T08:32:08.949 INFO:teuthology.orchestra.run.smithi070.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6639.g7 175 kB/s | 15 kB 00:00 2023-10-08T08:32:08.971 INFO:teuthology.orchestra.run.smithi105.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 967 kB/s | 64 kB 00:00 2023-10-08T08:32:08.993 INFO:teuthology.orchestra.run.smithi191.stdout:(32/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 4.9 MB/s | 49 MB 00:10 2023-10-08T08:32:09.019 INFO:teuthology.orchestra.run.smithi191.stdout:(33/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 95 kB/s | 47 kB 00:00 2023-10-08T08:32:09.021 INFO:teuthology.orchestra.run.smithi105.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2023-10-08T08:32:09.044 INFO:teuthology.orchestra.run.smithi191.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6639.g7 291 kB/s | 15 kB 00:00 2023-10-08T08:32:09.058 INFO:teuthology.orchestra.run.smithi070.stdout:(35/131): ceph-mgr-diskprediction-local-18.0.0- 5.3 MB/s | 7.4 MB 00:01 2023-10-08T08:32:09.080 INFO:teuthology.orchestra.run.smithi105.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2023-10-08T08:32:09.082 INFO:teuthology.orchestra.run.smithi070.stdout:(36/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 1.3 MB/s | 261 kB 00:00 2023-10-08T08:32:09.099 INFO:teuthology.orchestra.run.smithi070.stdout:(37/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 435 kB/s | 18 kB 00:00 2023-10-08T08:32:09.125 INFO:teuthology.orchestra.run.smithi070.stdout:(38/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 1.1 MB/s | 190 kB 00:00 2023-10-08T08:32:09.127 INFO:teuthology.orchestra.run.smithi191.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 2.2 MB/s | 190 kB 00:00 2023-10-08T08:32:09.130 INFO:teuthology.orchestra.run.smithi105.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 587 kB/s | 29 kB 00:00 2023-10-08T08:32:09.170 INFO:teuthology.orchestra.run.smithi191.stdout:(36/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 1.7 MB/s | 261 kB 00:00 2023-10-08T08:32:09.195 INFO:teuthology.orchestra.run.smithi191.stdout:(37/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 271 kB/s | 18 kB 00:00 2023-10-08T08:32:09.223 INFO:teuthology.orchestra.run.smithi105.stdout:(62/131): ceph-mgr-diskprediction-local-18.0.0- 3.3 MB/s | 7.4 MB 00:02 2023-10-08T08:32:09.248 INFO:teuthology.orchestra.run.smithi105.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-10-08T08:32:09.315 INFO:teuthology.orchestra.run.smithi105.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-10-08T08:32:09.356 INFO:teuthology.orchestra.run.smithi105.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-10-08T08:32:09.390 INFO:teuthology.orchestra.run.smithi105.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 2.5 MB/s | 85 kB 00:00 2023-10-08T08:32:09.404 INFO:teuthology.orchestra.run.smithi070.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 194 kB/s | 59 kB 00:00 2023-10-08T08:32:09.416 INFO:teuthology.orchestra.run.smithi105.stdout:(67/131): python3-waitress-1.4.3-1.el8.noarch.r 1.3 MB/s | 255 kB 00:00 2023-10-08T08:32:09.434 INFO:teuthology.orchestra.run.smithi070.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 243 kB/s | 75 kB 00:00 2023-10-08T08:32:09.437 INFO:teuthology.orchestra.run.smithi191.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 5.1 MB/s | 7.4 MB 00:01 2023-10-08T08:32:09.440 INFO:teuthology.orchestra.run.smithi105.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-10-08T08:32:09.466 INFO:teuthology.orchestra.run.smithi105.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-08T08:32:09.470 INFO:teuthology.orchestra.run.smithi191.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 214 kB/s | 59 kB 00:00 2023-10-08T08:32:09.517 INFO:teuthology.orchestra.run.smithi070.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 705 kB/s | 306 kB 00:00 2023-10-08T08:32:09.533 INFO:teuthology.orchestra.run.smithi105.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-10-08T08:32:09.534 INFO:teuthology.orchestra.run.smithi070.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 434 kB/s | 44 kB 00:00 2023-10-08T08:32:09.587 INFO:teuthology.orchestra.run.smithi191.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 734 kB/s | 306 kB 00:00 2023-10-08T08:32:09.609 INFO:teuthology.orchestra.run.smithi070.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-10-08T08:32:09.626 INFO:teuthology.orchestra.run.smithi070.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 360 kB/s | 33 kB 00:00 2023-10-08T08:32:09.652 INFO:teuthology.orchestra.run.smithi070.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2023-10-08T08:32:09.663 INFO:teuthology.orchestra.run.smithi191.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 583 kB/s | 44 kB 00:00 2023-10-08T08:32:09.677 INFO:teuthology.orchestra.run.smithi070.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 243 kB/s | 16 kB 00:00 2023-10-08T08:32:09.696 INFO:teuthology.orchestra.run.smithi191.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-08T08:32:09.722 INFO:teuthology.orchestra.run.smithi191.stdout:(43/131): libunwind-1.3.1-3.el8.x86_64.rpm 264 kB/s | 75 kB 00:00 2023-10-08T08:32:09.747 INFO:teuthology.orchestra.run.smithi191.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-10-08T08:32:09.753 INFO:teuthology.orchestra.run.smithi070.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2023-10-08T08:32:09.772 INFO:teuthology.orchestra.run.smithi191.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 437 kB/s | 33 kB 00:00 2023-10-08T08:32:09.777 INFO:teuthology.orchestra.run.smithi070.stdout:(48/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-08T08:32:09.797 INFO:teuthology.orchestra.run.smithi191.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-10-08T08:32:09.803 INFO:teuthology.orchestra.run.smithi070.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 647 kB/s | 81 kB 00:00 2023-10-08T08:32:09.817 INFO:teuthology.orchestra.run.smithi105.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 388 kB/s | 110 kB 00:00 2023-10-08T08:32:09.828 INFO:teuthology.orchestra.run.smithi070.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-10-08T08:32:09.839 INFO:teuthology.orchestra.run.smithi191.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-10-08T08:32:09.873 INFO:teuthology.orchestra.run.smithi191.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2023-10-08T08:32:09.881 INFO:teuthology.orchestra.run.smithi070.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 170 kB/s | 18 kB 00:00 2023-10-08T08:32:09.898 INFO:teuthology.orchestra.run.smithi191.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 808 kB/s | 81 kB 00:00 2023-10-08T08:32:09.912 INFO:teuthology.orchestra.run.smithi070.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 583 kB/s | 49 kB 00:00 2023-10-08T08:32:09.915 INFO:teuthology.orchestra.run.smithi191.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-10-08T08:32:09.941 INFO:teuthology.orchestra.run.smithi191.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 261 kB/s | 18 kB 00:00 2023-10-08T08:32:09.959 INFO:teuthology.orchestra.run.smithi105.stdout:(72/131): python3-scipy-1.0.0-21.module+el8.5.0 28 MB/s | 14 MB 00:00 2023-10-08T08:32:09.962 INFO:teuthology.orchestra.run.smithi070.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 7.3 MB/s | 1.2 MB 00:00 2023-10-08T08:32:09.984 INFO:teuthology.orchestra.run.smithi105.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 325 kB/s | 54 kB 00:00 2023-10-08T08:32:09.987 INFO:teuthology.orchestra.run.smithi070.stdout:(54/131): python3-more-itertools-7.2.0-3.el8.no 555 kB/s | 59 kB 00:00 2023-10-08T08:32:09.999 INFO:teuthology.orchestra.run.smithi191.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 583 kB/s | 49 kB 00:00 2023-10-08T08:32:10.013 INFO:teuthology.orchestra.run.smithi070.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 600 kB/s | 60 kB 00:00 2023-10-08T08:32:10.016 INFO:teuthology.orchestra.run.smithi191.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 782 kB/s | 59 kB 00:00 2023-10-08T08:32:10.034 INFO:teuthology.orchestra.run.smithi105.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-10-08T08:32:10.038 INFO:teuthology.orchestra.run.smithi070.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-10-08T08:32:10.063 INFO:teuthology.orchestra.run.smithi070.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2023-10-08T08:32:10.068 INFO:teuthology.orchestra.run.smithi105.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2023-10-08T08:32:10.089 INFO:teuthology.orchestra.run.smithi070.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 445 kB/s | 34 kB 00:00 2023-10-08T08:32:10.100 INFO:teuthology.orchestra.run.smithi191.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2023-10-08T08:32:10.116 INFO:teuthology.orchestra.run.smithi191.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 515 kB/s | 60 kB 00:00 2023-10-08T08:32:10.139 INFO:teuthology.orchestra.run.smithi070.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-10-08T08:32:10.142 INFO:teuthology.orchestra.run.smithi191.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-10-08T08:32:10.165 INFO:teuthology.orchestra.run.smithi070.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-10-08T08:32:10.176 INFO:teuthology.orchestra.run.smithi191.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2023-10-08T08:32:10.176 INFO:teuthology.orchestra.run.smithi105.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 274 kB/s | 39 kB 00:00 2023-10-08T08:32:10.190 INFO:teuthology.orchestra.run.smithi070.stdout:(61/131): python3-rsa-4.9-2.el8.noarch.rpm 510 kB/s | 64 kB 00:00 2023-10-08T08:32:10.195 INFO:teuthology.orchestra.run.smithi191.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 444 kB/s | 34 kB 00:00 2023-10-08T08:32:10.215 INFO:teuthology.orchestra.run.smithi070.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-10-08T08:32:10.227 INFO:teuthology.orchestra.run.smithi105.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2023-10-08T08:32:10.240 INFO:teuthology.orchestra.run.smithi070.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2023-10-08T08:32:10.265 INFO:teuthology.orchestra.run.smithi070.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2023-10-08T08:32:10.298 INFO:teuthology.orchestra.run.smithi191.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.2 MB/s | 196 kB 00:00 2023-10-08T08:32:10.315 INFO:teuthology.orchestra.run.smithi070.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-10-08T08:32:10.335 INFO:teuthology.orchestra.run.smithi191.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 132 kB/s | 19 kB 00:00 2023-10-08T08:32:10.356 INFO:teuthology.orchestra.run.smithi105.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 2.9 MB/s | 538 kB 00:00 2023-10-08T08:32:10.357 INFO:teuthology.orchestra.run.smithi070.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 666 kB/s | 61 kB 00:00 2023-10-08T08:32:10.360 INFO:teuthology.orchestra.run.smithi191.stdout:(61/131): python3-rsa-4.9-2.el8.noarch.rpm 348 kB/s | 64 kB 00:00 2023-10-08T08:32:10.383 INFO:teuthology.orchestra.run.smithi070.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-10-08T08:32:10.385 INFO:teuthology.orchestra.run.smithi191.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 275 kB/s | 24 kB 00:00 2023-10-08T08:32:10.403 INFO:teuthology.orchestra.run.smithi105.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 894 kB/s | 157 kB 00:00 2023-10-08T08:32:10.408 INFO:teuthology.orchestra.run.smithi070.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 925 kB/s | 85 kB 00:00 2023-10-08T08:32:10.419 INFO:teuthology.orchestra.run.smithi191.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 349 kB/s | 29 kB 00:00 2023-10-08T08:32:10.434 INFO:teuthology.orchestra.run.smithi070.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 303 kB/s | 23 kB 00:00 2023-10-08T08:32:10.445 INFO:teuthology.orchestra.run.smithi191.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 329 kB/s | 27 kB 00:00 2023-10-08T08:32:10.459 INFO:teuthology.orchestra.run.smithi070.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-08T08:32:10.478 INFO:teuthology.orchestra.run.smithi191.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.7 MB/s | 255 kB 00:00 2023-10-08T08:32:10.511 INFO:teuthology.orchestra.run.smithi105.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-08T08:32:10.520 INFO:teuthology.orchestra.run.smithi191.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 815 kB/s | 61 kB 00:00 2023-10-08T08:32:10.545 INFO:teuthology.orchestra.run.smithi105.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 4.9 MB/s | 713 kB 00:00 2023-10-08T08:32:10.553 INFO:teuthology.orchestra.run.smithi191.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-08T08:32:10.584 INFO:teuthology.orchestra.run.smithi070.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 312 kB/s | 47 kB 00:00 2023-10-08T08:32:10.596 INFO:teuthology.orchestra.run.smithi191.stdout:(68/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.4 MB/s | 251 kB 00:00 2023-10-08T08:32:10.621 INFO:teuthology.orchestra.run.smithi191.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2023-10-08T08:32:10.626 INFO:teuthology.orchestra.run.smithi070.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 7.1 MB/s | 1.7 MB 00:00 2023-10-08T08:32:10.646 INFO:teuthology.orchestra.run.smithi191.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-08T08:32:10.651 INFO:teuthology.orchestra.run.smithi070.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.0 MB/s | 200 kB 00:00 2023-10-08T08:32:10.693 INFO:teuthology.orchestra.run.smithi070.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 392 kB/s | 43 kB 00:00 2023-10-08T08:32:10.712 INFO:teuthology.orchestra.run.smithi105.stdout:(82/131): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-10-08T08:32:10.737 INFO:teuthology.orchestra.run.smithi105.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 138 kB/s | 27 kB 00:00 2023-10-08T08:32:10.763 INFO:teuthology.orchestra.run.smithi191.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 8.3 MB/s | 1.7 MB 00:00 2023-10-08T08:32:10.777 INFO:teuthology.orchestra.run.smithi070.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 402 kB/s | 48 kB 00:00 2023-10-08T08:32:10.788 INFO:teuthology.orchestra.run.smithi191.stdout:(72/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 280 kB/s | 47 kB 00:00 2023-10-08T08:32:10.821 INFO:teuthology.orchestra.run.smithi070.stdout:(76/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.1 MB/s | 220 kB 00:00 2023-10-08T08:32:10.822 INFO:teuthology.orchestra.run.smithi191.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.1 MB/s | 200 kB 00:00 2023-10-08T08:32:10.888 INFO:teuthology.orchestra.run.smithi105.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-10-08T08:32:10.889 INFO:teuthology.orchestra.run.smithi191.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 339 kB/s | 43 kB 00:00 2023-10-08T08:32:10.912 INFO:teuthology.orchestra.run.smithi105.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 250 kB/s | 44 kB 00:00 2023-10-08T08:32:10.923 INFO:teuthology.orchestra.run.smithi191.stdout:(75/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-10-08T08:32:10.927 INFO:teuthology.orchestra.run.smithi070.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 372 kB/s | 87 kB 00:00 2023-10-08T08:32:10.961 INFO:teuthology.orchestra.run.smithi070.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 232 kB/s | 43 kB 00:00 2023-10-08T08:32:11.003 INFO:teuthology.orchestra.run.smithi070.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 599 kB/s | 109 kB 00:00 2023-10-08T08:32:11.006 INFO:teuthology.orchestra.run.smithi191.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 745 kB/s | 87 kB 00:00 2023-10-08T08:32:11.028 INFO:teuthology.orchestra.run.smithi070.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-10-08T08:32:11.040 INFO:teuthology.orchestra.run.smithi191.stdout:(77/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 221 kB/s | 48 kB 00:00 2023-10-08T08:32:11.063 INFO:teuthology.orchestra.run.smithi105.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.0 MB/s | 457 kB 00:00 2023-10-08T08:32:11.132 INFO:teuthology.orchestra.run.smithi191.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 204 kB/s | 43 kB 00:00 2023-10-08T08:32:11.154 INFO:teuthology.orchestra.run.smithi070.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 124 kB/s | 19 kB 00:00 2023-10-08T08:32:11.157 INFO:teuthology.orchestra.run.smithi191.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-10-08T08:32:11.213 INFO:teuthology.orchestra.run.smithi105.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2023-10-08T08:32:11.229 INFO:teuthology.orchestra.run.smithi070.stdout:(82/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.0 MB/s | 560 kB 00:00 2023-10-08T08:32:11.238 INFO:teuthology.orchestra.run.smithi105.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.3 MB/s | 225 kB 00:00 2023-10-08T08:32:11.274 INFO:teuthology.orchestra.run.smithi191.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.9 MB/s | 560 kB 00:00 2023-10-08T08:32:11.299 INFO:teuthology.orchestra.run.smithi191.stdout:(81/131): python3-pycparser-2.14-14.el8.noarch. 372 kB/s | 109 kB 00:00 2023-10-08T08:32:11.320 INFO:teuthology.orchestra.run.smithi070.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 530 kB/s | 155 kB 00:00 2023-10-08T08:32:11.349 INFO:teuthology.orchestra.run.smithi191.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 97 kB/s | 19 kB 00:00 2023-10-08T08:32:11.371 INFO:teuthology.orchestra.run.smithi070.stdout:(84/131): python3-cryptography-3.2.1-5.el8.x86_ 2.5 MB/s | 559 kB 00:00 2023-10-08T08:32:11.433 INFO:teuthology.orchestra.run.smithi191.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 976 kB/s | 155 kB 00:00 2023-10-08T08:32:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:(85/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 82 kB/s | 18 kB 00:00 2023-10-08T08:32:11.467 INFO:teuthology.orchestra.run.smithi191.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 153 kB/s | 18 kB 00:00 2023-10-08T08:32:11.500 INFO:teuthology.orchestra.run.smithi191.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 3.6 MB/s | 559 kB 00:00 2023-10-08T08:32:11.513 INFO:teuthology.orchestra.run.smithi070.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2023-10-08T08:32:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2023-10-08T08:32:11.568 INFO:teuthology.orchestra.run.smithi191.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-10-08T08:32:11.597 INFO:teuthology.orchestra.run.smithi070.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 15 MB/s | 2.3 MB 00:00 2023-10-08T08:32:11.601 INFO:teuthology.orchestra.run.smithi191.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.7 MB/s | 238 kB 00:00 2023-10-08T08:32:11.647 INFO:teuthology.orchestra.run.smithi070.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 706 kB/s | 83 kB 00:00 2023-10-08T08:32:11.673 INFO:teuthology.orchestra.run.smithi070.stdout:(90/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 453 kB/s | 72 kB 00:00 2023-10-08T08:32:11.698 INFO:teuthology.orchestra.run.smithi070.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 594 kB/s | 60 kB 00:00 2023-10-08T08:32:11.701 INFO:teuthology.orchestra.run.smithi191.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 12 MB/s | 2.3 MB 00:00 2023-10-08T08:32:11.727 INFO:teuthology.orchestra.run.smithi191.stdout:(89/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 455 kB/s | 72 kB 00:00 2023-10-08T08:32:11.739 INFO:teuthology.orchestra.run.smithi105.stdout:(89/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 6.1 MB/s | 49 MB 00:08 2023-10-08T08:32:11.752 INFO:teuthology.orchestra.run.smithi191.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 549 kB/s | 83 kB 00:00 2023-10-08T08:32:11.764 INFO:teuthology.orchestra.run.smithi105.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 116 kB/s | 64 kB 00:00 2023-10-08T08:32:11.798 INFO:teuthology.orchestra.run.smithi105.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 226 kB/s | 126 kB 00:00 2023-10-08T08:32:11.802 INFO:teuthology.orchestra.run.smithi191.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 596 kB/s | 60 kB 00:00 2023-10-08T08:32:11.807 INFO:teuthology.orchestra.run.smithi070.stdout:(92/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 618 kB/s | 98 kB 00:00 2023-10-08T08:32:11.832 INFO:teuthology.orchestra.run.smithi070.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 289 kB/s | 39 kB 00:00 2023-10-08T08:32:11.857 INFO:teuthology.orchestra.run.smithi070.stdout:(94/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 313 kB/s | 58 kB 00:00 2023-10-08T08:32:11.869 INFO:teuthology.orchestra.run.smithi191.stdout:(92/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 690 kB/s | 98 kB 00:00 2023-10-08T08:32:11.886 INFO:teuthology.orchestra.run.smithi191.stdout:(93/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 431 kB/s | 58 kB 00:00 2023-10-08T08:32:11.898 INFO:teuthology.orchestra.run.smithi105.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2023-10-08T08:32:11.911 INFO:teuthology.orchestra.run.smithi191.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 355 kB/s | 39 kB 00:00 2023-10-08T08:32:11.948 INFO:teuthology.orchestra.run.smithi105.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2023-10-08T08:32:11.949 INFO:teuthology.orchestra.run.smithi070.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.4 MB/s | 171 kB 00:00 2023-10-08T08:32:11.973 INFO:teuthology.orchestra.run.smithi105.stdout:(94/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 509 kB/s | 103 kB 00:00 2023-10-08T08:32:11.984 INFO:teuthology.orchestra.run.smithi070.stdout:(96/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 3.6 MB/s | 644 kB 00:00 2023-10-08T08:32:12.008 INFO:teuthology.orchestra.run.smithi070.stdout:(97/131): NetworkManager-initscripts-updown-1.3 915 kB/s | 138 kB 00:00 2023-10-08T08:32:12.028 INFO:teuthology.orchestra.run.smithi191.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 644 kB 00:00 2023-10-08T08:32:12.054 INFO:teuthology.orchestra.run.smithi191.stdout:(96/131): NetworkManager-initscripts-updown-1.3 970 kB/s | 138 kB 00:00 2023-10-08T08:32:12.079 INFO:teuthology.orchestra.run.smithi191.stdout:(97/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 889 kB/s | 171 kB 00:00 2023-10-08T08:32:12.132 INFO:teuthology.orchestra.run.smithi105.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 21 MB/s | 4.9 MB 00:00 2023-10-08T08:32:12.157 INFO:teuthology.orchestra.run.smithi105.stdout:(96/131): libpq-13.5-1.el8.x86_64.rpm 947 kB/s | 198 kB 00:00 2023-10-08T08:32:12.166 INFO:teuthology.orchestra.run.smithi070.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 342 kB/s | 54 kB 00:00 2023-10-08T08:32:12.192 INFO:teuthology.orchestra.run.smithi070.stdout:(99/131): python3-pyasn1-modules-0.3.7-6.el8.no 527 kB/s | 110 kB 00:00 2023-10-08T08:32:12.196 INFO:teuthology.orchestra.run.smithi191.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 776 kB/s | 110 kB 00:00 2023-10-08T08:32:12.251 INFO:teuthology.orchestra.run.smithi105.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-08T08:32:12.283 INFO:teuthology.orchestra.run.smithi105.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2023-10-08T08:32:12.284 INFO:teuthology.orchestra.run.smithi070.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2023-10-08T08:32:12.300 INFO:teuthology.orchestra.run.smithi105.stdout:(99/131): jq-1.6-3.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-10-08T08:32:12.338 INFO:teuthology.orchestra.run.smithi191.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-10-08T08:32:12.363 INFO:teuthology.orchestra.run.smithi191.stdout:(100/131): python3-pytz-2017.2-9.el8.noarch.rpm 191 kB/s | 54 kB 00:00 2023-10-08T08:32:12.425 INFO:teuthology.orchestra.run.smithi070.stdout:(101/131): python3-scipy-1.0.0-21.module+el8.5. 29 MB/s | 14 MB 00:00 2023-10-08T08:32:12.433 INFO:teuthology.orchestra.run.smithi105.stdout:(100/131): postgresql-server-10.21-2.module+el8 28 MB/s | 5.1 MB 00:00 2023-10-08T08:32:12.451 INFO:teuthology.orchestra.run.smithi070.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 233 kB/s | 39 kB 00:00 2023-10-08T08:32:12.475 INFO:teuthology.orchestra.run.smithi105.stdout:(101/131): postgresql-contrib-10.21-2.module+el 4.1 MB/s | 808 kB 00:00 2023-10-08T08:32:12.476 INFO:teuthology.orchestra.run.smithi070.stdout:(103/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 MB/s | 323 kB 00:00 2023-10-08T08:32:12.517 INFO:teuthology.orchestra.run.smithi105.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 6.9 MB/s | 1.5 MB 00:00 2023-10-08T08:32:12.551 INFO:teuthology.orchestra.run.smithi105.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 400 kB/s | 47 kB 00:00 2023-10-08T08:32:12.560 INFO:teuthology.orchestra.run.smithi070.stdout:(104/131): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2023-10-08T08:32:12.601 INFO:teuthology.orchestra.run.smithi105.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.6 MB/s | 200 kB 00:00 2023-10-08T08:32:12.618 INFO:teuthology.orchestra.run.smithi105.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 424 kB/s | 43 kB 00:00 2023-10-08T08:32:12.621 INFO:teuthology.orchestra.run.smithi191.stdout:(101/131): python3-scipy-1.0.0-21.module+el8.5. 23 MB/s | 14 MB 00:00 2023-10-08T08:32:12.635 INFO:teuthology.orchestra.run.smithi070.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 989 kB/s | 157 kB 00:00 2023-10-08T08:32:12.647 INFO:teuthology.orchestra.run.smithi191.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 137 kB/s | 39 kB 00:00 2023-10-08T08:32:12.668 INFO:teuthology.orchestra.run.smithi070.stdout:(106/131): python3-jinja2-2.10.1-3.el8.noarch.r 2.4 MB/s | 538 kB 00:00 2023-10-08T08:32:12.672 INFO:teuthology.orchestra.run.smithi191.stdout:(103/131): socat-1.7.4.1-1.el8.x86_64.rpm 967 kB/s | 323 kB 00:00 2023-10-08T08:32:12.676 INFO:teuthology.orchestra.run.smithi105.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 639 kB/s | 48 kB 00:00 2023-10-08T08:32:12.727 INFO:teuthology.orchestra.run.smithi105.stdout:(107/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-10-08T08:32:12.752 INFO:teuthology.orchestra.run.smithi105.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 650 kB/s | 87 kB 00:00 2023-10-08T08:32:12.764 INFO:teuthology.orchestra.run.smithi191.stdout:(104/131): bison-3.0.4-10.el8.x86_64.rpm 4.8 MB/s | 688 kB 00:00 2023-10-08T08:32:12.789 INFO:teuthology.orchestra.run.smithi191.stdout:(105/131): python3-jinja2-2.10.1-3.el8.noarch.r 3.7 MB/s | 538 kB 00:00 2023-10-08T08:32:12.794 INFO:teuthology.orchestra.run.smithi070.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 801 kB/s | 187 kB 00:00 2023-10-08T08:32:12.802 INFO:teuthology.orchestra.run.smithi105.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 340 kB/s | 43 kB 00:00 2023-10-08T08:32:12.815 INFO:teuthology.orchestra.run.smithi191.stdout:(106/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-10-08T08:32:12.853 INFO:teuthology.orchestra.run.smithi070.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 3.2 MB/s | 713 kB 00:00 2023-10-08T08:32:12.911 INFO:teuthology.orchestra.run.smithi105.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 593 kB/s | 109 kB 00:00 2023-10-08T08:32:12.915 INFO:teuthology.orchestra.run.smithi191.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-08T08:32:12.936 INFO:teuthology.orchestra.run.smithi070.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-10-08T08:32:12.937 INFO:teuthology.orchestra.run.smithi105.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2023-10-08T08:32:12.948 INFO:teuthology.orchestra.run.smithi191.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 4.4 MB/s | 713 kB 00:00 2023-10-08T08:32:12.963 INFO:teuthology.orchestra.run.smithi070.stdout:(110/131): python3-jsonpatch-1.21-2.el8.noarch. 159 kB/s | 27 kB 00:00 2023-10-08T08:32:12.970 INFO:teuthology.orchestra.run.smithi105.stdout:(112/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-08T08:32:13.028 INFO:teuthology.orchestra.run.smithi070.stdout:(111/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-10-08T08:32:13.049 INFO:teuthology.orchestra.run.smithi191.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-08T08:32:13.053 INFO:teuthology.orchestra.run.smithi105.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.3 MB/s | 155 kB 00:00 2023-10-08T08:32:13.082 INFO:teuthology.orchestra.run.smithi191.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-10-08T08:32:13.087 INFO:teuthology.orchestra.run.smithi105.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 4.7 MB/s | 559 kB 00:00 2023-10-08T08:32:13.145 INFO:teuthology.orchestra.run.smithi070.stdout:(112/131): python3-numpy-1.14.3-10.el8.x86_64.r 20 MB/s | 3.7 MB 00:00 2023-10-08T08:32:13.149 INFO:teuthology.orchestra.run.smithi191.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 439 kB/s | 44 kB 00:00 2023-10-08T08:32:13.187 INFO:teuthology.orchestra.run.smithi105.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 134 kB/s | 18 kB 00:00 2023-10-08T08:32:13.192 INFO:teuthology.orchestra.run.smithi070.stdout:(113/131): python3-prettytable-0.7.2-14.el8.noa 172 kB/s | 44 kB 00:00 2023-10-08T08:32:13.212 INFO:teuthology.orchestra.run.smithi105.stdout:(116/131): libaio-devel-0.3.112-1.el8.x86_64.rp 62 kB/s | 19 kB 00:00 2023-10-08T08:32:13.229 INFO:teuthology.orchestra.run.smithi070.stdout:(114/131): python3-werkzeug-0.12.2-4.el8.noarch 2.2 MB/s | 457 kB 00:00 2023-10-08T08:32:13.246 INFO:teuthology.orchestra.run.smithi105.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-10-08T08:32:13.254 INFO:teuthology.orchestra.run.smithi070.stdout:(115/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.0 MB/s | 225 kB 00:00 2023-10-08T08:32:13.274 INFO:teuthology.orchestra.run.smithi191.stdout:(112/131): python3-jsonpatch-1.21-2.el8.noarch. 74 kB/s | 27 kB 00:00 2023-10-08T08:32:13.304 INFO:teuthology.orchestra.run.smithi070.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 573 kB/s | 64 kB 00:00 2023-10-08T08:32:13.308 INFO:teuthology.orchestra.run.smithi191.stdout:(113/131): python3-werkzeug-0.12.2-4.el8.noarch 2.8 MB/s | 457 kB 00:00 2023-10-08T08:32:13.313 INFO:teuthology.orchestra.run.smithi105.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.8 MB/s | 238 kB 00:00 2023-10-08T08:32:13.330 INFO:teuthology.orchestra.run.smithi070.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.2 MB/s | 126 kB 00:00 2023-10-08T08:32:13.400 INFO:teuthology.orchestra.run.smithi191.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2023-10-08T08:32:13.434 INFO:teuthology.orchestra.run.smithi191.stdout:(115/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.4 MB/s | 225 kB 00:00 2023-10-08T08:32:13.441 INFO:teuthology.orchestra.run.smithi105.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 10 MB/s | 2.3 MB 00:00 2023-10-08T08:32:13.459 INFO:teuthology.orchestra.run.smithi191.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 424 kB/s | 64 kB 00:00 2023-10-08T08:32:13.464 INFO:teuthology.orchestra.run.smithi105.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 551 kB/s | 83 kB 00:00 2023-10-08T08:32:13.506 INFO:teuthology.orchestra.run.smithi105.stdout:(121/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 279 kB/s | 72 kB 00:00 2023-10-08T08:32:13.526 INFO:teuthology.orchestra.run.smithi191.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.0 MB/s | 126 kB 00:00 2023-10-08T08:32:13.556 INFO:teuthology.orchestra.run.smithi105.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 511 kB/s | 60 kB 00:00 2023-10-08T08:32:13.676 INFO:teuthology.orchestra.run.smithi191.stdout:(118/131): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2023-10-08T08:32:13.702 INFO:teuthology.orchestra.run.smithi191.stdout:(119/131): python3-jsonpointer-1.10-11.el8.noar 75 kB/s | 20 kB 00:00 2023-10-08T08:32:13.715 INFO:teuthology.orchestra.run.smithi070.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 252 kB/s | 103 kB 00:00 2023-10-08T08:32:13.723 INFO:teuthology.orchestra.run.smithi105.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 379 kB/s | 98 kB 00:00 2023-10-08T08:32:13.757 INFO:teuthology.orchestra.run.smithi105.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 193 kB/s | 39 kB 00:00 2023-10-08T08:32:13.769 INFO:teuthology.orchestra.run.smithi191.stdout:(120/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 335 kB/s | 103 kB 00:00 2023-10-08T08:32:13.798 INFO:teuthology.orchestra.run.smithi105.stdout:(125/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 197 kB/s | 58 kB 00:00 2023-10-08T08:32:13.811 INFO:teuthology.orchestra.run.smithi191.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2023-10-08T08:32:13.822 INFO:teuthology.orchestra.run.smithi070.stdout:(119/131): python3-jsonpointer-1.10-11.el8.noar 35 kB/s | 20 kB 00:00 2023-10-08T08:32:13.856 INFO:teuthology.orchestra.run.smithi070.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 1.3 MB/s | 709 kB 00:00 2023-10-08T08:32:13.890 INFO:teuthology.orchestra.run.smithi105.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.3 MB/s | 171 kB 00:00 2023-10-08T08:32:13.932 INFO:teuthology.orchestra.run.smithi105.stdout:(127/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.0 MB/s | 644 kB 00:00 2023-10-08T08:32:13.937 INFO:teuthology.orchestra.run.smithi191.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2023-10-08T08:32:13.965 INFO:teuthology.orchestra.run.smithi070.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-10-08T08:32:13.991 INFO:teuthology.orchestra.run.smithi105.stdout:(128/131): NetworkManager-initscripts-updown-1. 716 kB/s | 138 kB 00:00 2023-10-08T08:32:14.003 INFO:teuthology.orchestra.run.smithi191.stdout:(123/131): openblas-threads-0.3.15-3.el8.x86_64 15 MB/s | 4.9 MB 00:00 2023-10-08T08:32:14.037 INFO:teuthology.orchestra.run.smithi191.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-10-08T08:32:14.057 INFO:teuthology.orchestra.run.smithi070.stdout:(122/131): openblas-threads-0.3.15-3.el8.x86_64 14 MB/s | 4.9 MB 00:00 2023-10-08T08:32:14.120 INFO:teuthology.orchestra.run.smithi191.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-10-08T08:32:14.140 INFO:teuthology.orchestra.run.smithi070.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-08T08:32:14.157 INFO:teuthology.orchestra.run.smithi070.stdout:(124/131): jq-1.6-3.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2023-10-08T08:32:14.158 INFO:teuthology.orchestra.run.smithi105.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.7 MB/s | 798 kB 00:00 2023-10-08T08:32:14.190 INFO:teuthology.orchestra.run.smithi070.stdout:(125/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-10-08T08:32:14.204 INFO:teuthology.orchestra.run.smithi191.stdout:(126/131): postgresql-contrib-10.21-2.module+el 4.7 MB/s | 808 kB 00:00 2023-10-08T08:32:14.257 INFO:teuthology.orchestra.run.smithi070.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.9 MB/s | 808 kB 00:00 2023-10-08T08:32:14.275 INFO:teuthology.orchestra.run.smithi105.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 9.8 MB/s | 3.7 MB 00:00 2023-10-08T08:32:14.279 INFO:teuthology.orchestra.run.smithi191.stdout:(127/131): postgresql-server-10.21-2.module+el8 18 MB/s | 5.1 MB 00:00 2023-10-08T08:32:14.329 INFO:teuthology.orchestra.run.smithi191.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 7.2 MB/s | 1.5 MB 00:00 2023-10-08T08:32:14.333 INFO:teuthology.orchestra.run.smithi070.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-10-08T08:32:14.408 INFO:teuthology.orchestra.run.smithi070.stdout:(128/131): postgresql-server-10.21-2.module+el8 19 MB/s | 5.1 MB 00:00 2023-10-08T08:32:14.496 INFO:teuthology.orchestra.run.smithi191.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.7 MB/s | 798 kB 00:00 2023-10-08T08:32:14.517 INFO:teuthology.orchestra.run.smithi070.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 7.2 MB/s | 798 kB 00:00 2023-10-08T08:32:14.763 INFO:teuthology.orchestra.run.smithi191.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 6.7 MB/s | 3.7 MB 00:00 2023-10-08T08:32:14.800 INFO:teuthology.orchestra.run.smithi105.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 4.3 MB/s | 3.7 MB 00:00 2023-10-08T08:32:14.803 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2023-10-08T08:32:14.803 INFO:teuthology.orchestra.run.smithi105.stdout:Total 12 MB/s | 209 MB 00:17 2023-10-08T08:32:14.833 INFO:teuthology.orchestra.run.smithi070.stdout:(130/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 7.4 MB/s | 3.7 MB 00:00 2023-10-08T08:32:15.296 INFO:teuthology.orchestra.run.smithi191.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 3.6 MB/s | 3.7 MB 00:01 2023-10-08T08:32:15.300 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2023-10-08T08:32:15.300 INFO:teuthology.orchestra.run.smithi191.stdout:Total 10 MB/s | 209 MB 00:20 2023-10-08T08:32:15.492 INFO:teuthology.orchestra.run.smithi070.stdout:(131/131): librados2-18.0.0-6639.g7b3143ba.el8. 3.0 MB/s | 3.7 MB 00:01 2023-10-08T08:32:15.495 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2023-10-08T08:32:15.496 INFO:teuthology.orchestra.run.smithi070.stdout:Total 10 MB/s | 209 MB 00:20 2023-10-08T08:32:15.646 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2023-10-08T08:32:15.766 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2023-10-08T08:32:15.766 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2023-10-08T08:32:16.118 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2023-10-08T08:32:16.237 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2023-10-08T08:32:16.237 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2023-10-08T08:32:16.315 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2023-10-08T08:32:16.434 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2023-10-08T08:32:16.434 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2023-10-08T08:32:16.894 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2023-10-08T08:32:16.898 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2023-10-08T08:32:17.361 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2023-10-08T08:32:17.365 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2023-10-08T08:32:17.555 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2023-10-08T08:32:17.559 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2023-10-08T08:32:21.642 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2023-10-08T08:32:21.820 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T08:32:22.020 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T08:32:22.152 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2023-10-08T08:32:22.238 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-08T08:32:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T08:32:22.431 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T08:32:22.541 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T08:32:22.568 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T08:32:22.745 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T08:32:22.773 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T08:32:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2023-10-08T08:32:22.863 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T08:32:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T08:32:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T08:32:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T08:32:23.162 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T08:32:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T08:32:23.389 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T08:32:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T08:32:23.488 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T08:32:23.635 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T08:32:23.694 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T08:32:23.797 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T08:32:23.981 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T08:32:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T08:32:24.084 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T08:32:24.113 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T08:32:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T08:32:24.289 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T08:32:24.326 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T08:32:24.392 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T08:32:24.418 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T08:32:24.598 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T08:32:24.619 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T08:32:24.718 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T08:32:24.738 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T08:32:24.809 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T08:32:24.891 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T08:32:24.943 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T08:32:25.033 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T08:32:25.061 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-08T08:32:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T08:32:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T08:32:25.280 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T08:32:25.354 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T08:32:25.418 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T08:32:25.488 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T08:32:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T08:32:25.663 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T08:32:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-08T08:32:25.805 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T08:32:25.872 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T08:32:25.913 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T08:32:25.942 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T08:32:26.077 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T08:32:26.162 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T08:32:26.227 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T08:32:26.247 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T08:32:26.332 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T08:32:26.335 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T08:32:26.463 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T08:32:26.494 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T08:32:26.562 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T08:32:26.607 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T08:32:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T08:32:26.763 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T08:32:26.778 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T08:32:26.918 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T08:32:26.989 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-08T08:32:27.039 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T08:32:27.180 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-08T08:32:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T08:32:27.320 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T08:32:27.346 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-08T08:32:27.383 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T08:32:27.468 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T08:32:27.555 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T08:32:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-08T08:32:27.604 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T08:32:27.756 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-08T08:32:27.785 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T08:32:27.966 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-08T08:32:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T08:32:28.150 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T08:32:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T08:32:28.338 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T08:32:28.397 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T08:32:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T08:32:28.568 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T08:32:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T08:32:29.101 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T08:32:29.147 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T08:32:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T08:32:29.310 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T08:32:29.353 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-08T08:32:29.565 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-08T08:32:29.825 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-08T08:32:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T08:32:29.985 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T08:32:30.011 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-08T08:32:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T08:32:30.220 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-08T08:32:30.225 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-08T08:32:30.406 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-08T08:32:30.457 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T08:32:30.637 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T08:32:30.644 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T08:32:30.736 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T08:32:30.775 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T08:32:30.799 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T08:32:30.963 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T08:32:31.032 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-08T08:32:31.180 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T08:32:31.232 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-08T08:32:31.368 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T08:32:31.510 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T08:32:31.669 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T08:32:31.689 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T08:32:31.853 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T08:32:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T08:32:32.103 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-08T08:32:32.325 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T08:32:32.366 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-08T08:32:32.635 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-08T08:32:32.838 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T08:32:33.119 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T08:32:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T08:32:34.110 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-08T08:32:34.441 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-08T08:32:34.612 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T08:32:34.677 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-08T08:32:34.902 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-08T08:32:34.947 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-08T08:32:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T08:32:35.110 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-08T08:32:35.149 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T08:32:35.261 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T08:32:35.331 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T08:32:35.439 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-08T08:32:35.439 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T08:32:35.527 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T08:32:35.599 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T08:32:35.708 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T08:32:35.749 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-08T08:32:35.818 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-08T08:32:35.853 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-08T08:32:35.887 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-08T08:32:36.022 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-08T08:32:36.030 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-08T08:32:36.042 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T08:32:36.108 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T08:32:36.232 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-08T08:32:36.261 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T08:32:36.313 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-08T08:32:36.382 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-08T08:32:36.443 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T08:32:36.570 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-08T08:32:36.584 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-08T08:32:36.663 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T08:32:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T08:32:36.765 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-08T08:32:36.787 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T08:32:36.814 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T08:32:36.956 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-08T08:32:37.021 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-08T08:32:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-08T08:32:37.119 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-08T08:32:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-08T08:32:37.299 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T08:32:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T08:32:37.365 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-08T08:32:37.382 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-08T08:32:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-08T08:32:37.568 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-08T08:32:37.597 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-08T08:32:37.719 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-08T08:32:37.799 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-08T08:32:37.802 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-08T08:32:37.853 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-08T08:32:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T08:32:38.025 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-08T08:32:38.054 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-08T08:32:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T08:32:38.252 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-08T08:32:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-08T08:32:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-08T08:32:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-08T08:32:38.536 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-08T08:32:38.614 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-08T08:32:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-08T08:32:38.752 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-08T08:32:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-08T08:32:38.902 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-08T08:32:38.958 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-08T08:32:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-08T08:32:39.103 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-08T08:32:39.132 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-08T08:32:39.168 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-08T08:32:39.291 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-08T08:32:39.311 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-08T08:32:39.377 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-08T08:32:39.521 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-08T08:32:39.592 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-08T08:32:39.599 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-08T08:32:39.850 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-08T08:32:39.873 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-08T08:32:39.974 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-08T08:32:40.074 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-08T08:32:40.117 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-08T08:32:40.260 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-08T08:32:40.292 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-08T08:32:40.335 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-08T08:32:40.494 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-08T08:32:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-08T08:32:40.542 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-08T08:32:40.629 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-08T08:32:40.645 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-08T08:32:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-08T08:32:40.828 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T08:32:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-08T08:32:40.883 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T08:32:41.019 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-08T08:32:41.107 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-08T08:32:41.141 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-08T08:32:41.310 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-08T08:32:41.323 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-08T08:32:41.389 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-08T08:32:41.470 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T08:32:41.537 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T08:32:41.555 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-08T08:32:41.629 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-08T08:32:41.758 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-08T08:32:41.765 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-08T08:32:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-08T08:32:41.929 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-08T08:32:42.007 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T08:32:42.044 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-08T08:32:42.102 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T08:32:42.185 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T08:32:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-08T08:32:42.280 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T08:32:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-08T08:32:42.450 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T08:32:42.528 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T08:32:42.656 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T08:32:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-08T08:32:42.785 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T08:32:42.795 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T08:32:42.932 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T08:32:42.976 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T08:32:43.014 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-08T08:32:43.072 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T08:32:43.157 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T08:32:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-08T08:32:43.269 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T08:32:43.343 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T08:32:43.464 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T08:32:43.500 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T08:32:43.524 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-08T08:32:43.630 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T08:32:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T08:32:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T08:32:43.789 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T08:32:43.804 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T08:32:43.933 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T08:32:43.959 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T08:32:44.026 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T08:32:44.191 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T08:32:44.205 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T08:32:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T08:32:44.404 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T08:32:44.424 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T08:32:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T08:32:44.617 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T08:32:44.626 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T08:32:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T08:32:44.799 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T08:32:44.814 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T08:32:44.861 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T08:32:44.973 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T08:32:44.989 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T08:32:45.069 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T08:32:45.192 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T08:32:45.264 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T08:32:45.292 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T08:32:45.510 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T08:32:45.650 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T08:32:45.850 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T08:32:45.987 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T08:32:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T08:32:46.274 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T08:32:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T08:32:46.519 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T08:32:46.586 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T08:32:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T08:32:46.757 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T08:32:46.856 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T08:32:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T08:32:47.058 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T08:32:47.136 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T08:32:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T08:32:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T08:32:47.402 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T08:32:47.429 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T08:32:47.563 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T08:32:47.587 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T08:32:47.690 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T08:32:47.916 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T08:32:48.381 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T08:32:48.556 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T08:32:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T08:32:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T08:32:48.708 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T08:32:48.790 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T08:32:48.894 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T08:32:48.966 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T08:32:48.978 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T08:32:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T08:32:49.279 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T08:32:49.606 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T08:32:49.888 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T08:32:50.107 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T08:32:50.887 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T08:32:51.095 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T08:32:51.153 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T08:32:51.321 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T08:32:52.497 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T08:32:52.714 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T08:32:52.905 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T08:32:53.169 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T08:32:53.316 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T08:32:53.574 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T08:32:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T08:32:53.758 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T08:32:53.764 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T08:32:54.020 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T08:32:54.100 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T08:32:54.252 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T08:32:55.046 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T08:32:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T08:32:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T08:32:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T08:32:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T08:32:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T08:33:12.815 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T08:33:12.815 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /sys 2023-10-08T08:33:12.815 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /proc 2023-10-08T08:33:12.815 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /dev 2023-10-08T08:33:12.816 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /run 2023-10-08T08:33:12.816 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /mnt 2023-10-08T08:33:12.816 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /var/tmp 2023-10-08T08:33:12.816 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /home 2023-10-08T08:33:12.816 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /tmp 2023-10-08T08:33:12.816 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /dev 2023-10-08T08:33:12.816 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:33:12.853 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T08:33:12.853 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2023-10-08T08:33:12.854 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2023-10-08T08:33:12.854 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-10-08T08:33:12.854 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /run 2023-10-08T08:33:12.854 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2023-10-08T08:33:12.854 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2023-10-08T08:33:12.854 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2023-10-08T08:33:12.854 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2023-10-08T08:33:12.854 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-10-08T08:33:12.854 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:33:13.166 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T08:33:13.194 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T08:33:14.754 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T08:33:14.783 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T08:33:14.937 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T08:33:14.959 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T08:33:15.156 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T08:33:15.180 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T08:33:15.335 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T08:33:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T08:33:15.808 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T08:33:15.827 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T08:33:15.969 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T08:33:15.982 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T08:33:15.985 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T08:33:15.999 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T08:33:16.065 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T08:33:16.066 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2023-10-08T08:33:16.066 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2023-10-08T08:33:16.066 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /dev 2023-10-08T08:33:16.066 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /run 2023-10-08T08:33:16.066 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2023-10-08T08:33:16.066 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2023-10-08T08:33:16.066 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2023-10-08T08:33:16.066 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2023-10-08T08:33:16.067 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /dev 2023-10-08T08:33:16.067 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:33:16.432 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T08:33:17.670 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T08:33:17.673 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T08:33:17.864 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T08:33:17.878 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T08:33:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T08:33:17.991 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T08:33:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T08:33:18.172 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T08:33:18.184 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T08:33:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T08:33:18.349 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T08:33:18.359 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T08:33:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T08:33:18.572 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T08:33:18.580 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T08:33:18.589 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T08:33:18.861 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T08:33:18.883 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T08:33:19.060 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T08:33:19.248 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T08:33:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T08:33:19.818 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T08:33:19.842 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T08:33:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T08:33:20.057 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T08:33:20.099 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T08:33:20.148 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T08:33:20.436 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T08:33:20.500 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T08:33:20.683 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T08:33:20.709 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T08:33:20.718 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T08:33:20.744 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T08:33:20.876 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T08:33:20.887 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T08:33:20.898 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T08:33:20.909 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T08:33:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T08:33:21.248 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T08:33:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T08:33:21.546 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T08:33:21.739 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T08:33:21.961 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T08:33:22.204 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T08:33:22.227 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T08:33:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T08:33:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T08:33:22.416 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T08:33:22.435 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T08:33:22.469 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T08:33:22.550 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T08:33:22.593 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T08:33:22.631 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T08:33:22.674 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T08:33:22.758 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T08:33:22.840 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T08:33:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T08:33:23.207 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T08:33:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T08:33:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T08:33:23.390 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T08:33:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T08:33:23.578 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T08:33:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T08:33:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T08:33:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T08:33:24.363 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T08:33:24.374 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T08:33:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T08:33:25.984 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T08:33:26.018 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T08:33:26.171 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T08:33:26.216 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T08:33:26.413 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T08:33:26.790 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T08:33:26.930 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T08:33:27.932 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T08:33:28.034 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T08:33:28.329 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T08:33:28.488 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T08:33:28.679 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T08:33:28.773 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T08:33:29.094 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-08T08:33:29.268 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 117/134 2023-10-08T08:33:29.540 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-08T08:33:29.561 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-08T08:33:29.674 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T08:33:29.864 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T08:33:29.867 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-08T08:33:30.041 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 119/134 2023-10-08T08:33:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-08T08:33:30.226 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T08:33:30.245 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T08:33:30.408 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T08:33:30.426 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T08:33:30.573 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T08:33:31.582 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T08:33:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T08:33:32.663 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T08:33:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-08T08:33:32.780 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T08:33:32.924 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T08:33:32.942 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T08:33:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 117/134 2023-10-08T08:33:33.063 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T08:33:33.081 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T08:33:33.082 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T08:33:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-08T08:33:33.252 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T08:33:33.361 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T08:33:33.365 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T08:33:33.513 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T08:33:33.551 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T08:33:33.696 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T08:33:33.797 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T08:33:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-08T08:33:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T08:33:34.060 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T08:33:34.107 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T08:33:34.137 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T08:33:34.231 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T08:33:34.297 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T08:33:34.305 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T08:33:34.315 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T08:33:34.489 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-08T08:33:34.507 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T08:33:34.519 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T08:33:34.666 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T08:33:34.673 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T08:33:34.704 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T08:33:34.796 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T08:33:34.834 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-08T08:33:34.834 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T08:33:34.988 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T08:33:35.001 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T08:33:35.001 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T08:33:35.010 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T08:33:35.010 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T08:33:35.216 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T08:33:35.216 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T08:33:35.254 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T08:33:35.452 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T08:33:35.472 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T08:33:35.662 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T08:33:35.977 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T08:33:35.977 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T08:33:35.977 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T08:33:35.977 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T08:33:35.977 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T08:33:35.977 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T08:33:35.977 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T08:33:35.977 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T08:33:35.977 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T08:33:35.978 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T08:33:35.979 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T08:33:35.980 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T08:33:35.981 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T08:33:35.982 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-08T08:33:35.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-08T08:33:35.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-08T08:33:35.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-08T08:33:35.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-08T08:33:35.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-08T08:33:35.988 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-08T08:33:35.988 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-08T08:33:35.988 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T08:33:35.988 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T08:33:35.988 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T08:33:35.988 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T08:33:35.988 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T08:33:36.163 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T08:33:36.163 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T08:33:36.163 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T08:33:36.164 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T08:33:36.165 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T08:33:36.178 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T08:33:36.178 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T08:33:36.178 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T08:33:36.178 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T08:33:36.178 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T08:33:36.178 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T08:33:36.179 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T08:33:36.179 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T08:33:36.179 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T08:33:36.179 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T08:33:36.179 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T08:33:36.179 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T08:33:36.179 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T08:33:36.180 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T08:33:36.180 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T08:33:36.180 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T08:33:36.180 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T08:33:36.180 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T08:33:36.180 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T08:33:36.181 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T08:33:36.182 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-08T08:33:36.183 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-08T08:33:36.184 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-08T08:33:36.184 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-08T08:33:36.184 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-08T08:33:36.184 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-08T08:33:36.184 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-08T08:33:36.184 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-08T08:33:36.184 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-08T08:33:36.184 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-08T08:33:36.185 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-08T08:33:36.186 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T08:33:36.187 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T08:33:36.188 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T08:33:36.400 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T08:33:36.661 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T08:33:36.679 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T08:33:36.942 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T08:33:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T08:33:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T08:33:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T08:33:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T08:33:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T08:33:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T08:33:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T08:33:38.492 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T08:33:38.492 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:56 ago on Sun 08 Oct 2023 08:31:42 AM UTC. 2023-10-08T08:33:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T08:33:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T08:33:38.646 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T08:33:38.646 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 0:01:53 ago on Sun 08 Oct 2023 08:31:45 AM UTC. 2023-10-08T08:33:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-08T08:33:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T08:33:39.005 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T08:33:39.005 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T08:33:39.291 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T08:33:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T08:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T08:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T08:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T08:33:40.048 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T08:33:40.049 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T08:33:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T08:33:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T08:33:40.061 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T08:33:40.062 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-08T08:33:40.063 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-08T08:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-08T08:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-08T08:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-08T08:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-08T08:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-08T08:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-08T08:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-08T08:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-08T08:33:40.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-08T08:33:40.065 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-08T08:33:40.066 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-08T08:33:40.067 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T08:33:40.068 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T08:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T08:33:40.069 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T08:33:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T08:33:42.557 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:02:00 ago on Sun 08 Oct 2023 08:31:42 AM UTC. 2023-10-08T08:33:47.930 INFO:teuthology.orchestra.run.smithi105.stdout:Installed products updated. 2023-10-08T08:33:48.142 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:33:48.142 INFO:teuthology.orchestra.run.smithi105.stdout:Upgraded: 2023-10-08T08:33:48.142 INFO:teuthology.orchestra.run.smithi105.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T08:33:48.142 INFO:teuthology.orchestra.run.smithi105.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.142 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.143 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.144 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: jq-1.6-3.el8.x86_64 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T08:33:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T08:33:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T08:33:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T08:33:48.149 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T08:33:48.150 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.151 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T08:33:48.152 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T08:33:48.153 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.153 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.153 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:48.153 INFO:teuthology.orchestra.run.smithi105.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T08:33:48.153 INFO:teuthology.orchestra.run.smithi105.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T08:33:48.153 INFO:teuthology.orchestra.run.smithi105.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T08:33:48.153 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T08:33:48.153 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T08:33:48.154 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T08:33:48.154 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-08T08:33:48.154 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2023-10-08T08:33:48.623 DEBUG:teuthology.parallel:result is None 2023-10-08T08:33:49.203 INFO:teuthology.orchestra.run.smithi191.stdout:Installed products updated. 2023-10-08T08:33:49.414 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:33:49.414 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2023-10-08T08:33:49.414 INFO:teuthology.orchestra.run.smithi191.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T08:33:49.414 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.414 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.414 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2023-10-08T08:33:49.414 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T08:33:49.414 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.415 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.416 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: jq-1.6-3.el8.x86_64 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T08:33:49.417 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T08:33:49.418 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T08:33:49.419 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.420 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T08:33:49.421 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T08:33:49.422 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T08:33:49.423 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T08:33:49.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T08:33:49.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T08:33:49.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T08:33:49.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T08:33:49.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T08:33:49.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T08:33:49.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T08:33:49.424 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T08:33:49.425 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T08:33:49.426 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T08:33:49.426 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:33:49.426 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-10-08T08:33:49.605 DEBUG:teuthology.parallel:result is None 2023-10-08T08:33:50.471 INFO:teuthology.orchestra.run.smithi070.stdout:Installed products updated. 2023-10-08T08:33:50.686 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:33:50.686 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2023-10-08T08:33:50.686 INFO:teuthology.orchestra.run.smithi070.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T08:33:50.686 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.687 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.688 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T08:33:50.689 INFO:teuthology.orchestra.run.smithi070.stdout: jq-1.6-3.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T08:33:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T08:33:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T08:33:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T08:33:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T08:33:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T08:33:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T08:33:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T08:33:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T08:33:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T08:33:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T08:33:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T08:33:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T08:33:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T08:33:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T08:33:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T08:33:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T08:33:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T08:33:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T08:33:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T08:33:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T08:33:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T08:33:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T08:33:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T08:33:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:33:50.700 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2023-10-08T08:33:52.244 DEBUG:teuthology.parallel:result is None 2023-10-08T08:33:52.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:33:52.464 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T08:33:52.492 INFO:teuthology.orchestra.run.smithi070.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T08:33:52.492 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T08:33:52.493 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T08:33:52.493 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:33:52.636 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T08:33:52.664 INFO:teuthology.orchestra.run.smithi105.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T08:33:52.665 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T08:33:52.665 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T08:33:52.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:33:52.808 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T08:33:52.836 INFO:teuthology.orchestra.run.smithi191.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T08:33:52.836 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T08:33:52.836 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T08:33:52.836 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T08:33:52.836 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:33:52.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T08:33:52.884 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:33:52.884 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T08:33:52.934 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:33:52.934 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T08:33:52.981 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T08:33:52.981 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:33:52.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T08:33:53.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T08:33:53.082 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:33:53.082 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T08:33:53.114 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T08:33:53.183 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:33:53.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T08:33:53.215 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T08:33:53.286 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T08:33:53.286 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:33:53.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T08:33:53.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T08:33:53.386 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:33:53.386 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T08:33:53.418 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T08:33:53.489 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:33:53.489 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T08:33:53.520 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T08:33:53.591 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T08:33:53.591 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:33:53.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T08:33:53.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T08:33:53.691 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:33:53.691 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T08:33:53.723 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T08:33:53.795 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:33:53.795 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T08:33:53.827 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T08:33:53.898 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-08T08:33:53.982 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'} 2023-10-08T08:33:53.982 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:33:53.983 INFO:tasks.cephadm:Cluster fsid is 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:33:53.983 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-08T08:33:53.983 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.70', 'mon.b': '172.21.15.105', 'mon.c': '172.21.15.191'} 2023-10-08T08:33:53.983 INFO:tasks.cephadm:First mon is mon.a on smithi070 2023-10-08T08:33:53.983 INFO:tasks.cephadm:First mgr is x 2023-10-08T08:33:53.984 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-08T08:33:53.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname $(hostname -s) 2023-10-08T08:33:54.015 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname $(hostname -s) 2023-10-08T08:33:54.048 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname $(hostname -s) 2023-10-08T08:33:54.080 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-08T08:33:54.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:33:54.232 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73096/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6639-g7b3143ba', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6639.g7b3143ba'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-07 17:16:01.199993', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20231007.154158', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-10-08T08:33:54.549 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-batrick-testing-20231007.154158, sha1 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:33:54.549 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm 2023-10-08T08:33:54.549 DEBUG:teuthology.orchestra.run.smithi070:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T08:33:55.984 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 08:33 /home/ubuntu/cephtest/cephadm 2023-10-08T08:33:55.984 DEBUG:teuthology.orchestra.run.smithi105:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T08:33:57.183 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 08:33 /home/ubuntu/cephtest/cephadm 2023-10-08T08:33:57.184 DEBUG:teuthology.orchestra.run.smithi191:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T08:33:59.119 INFO:teuthology.orchestra.run.smithi191.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 08:33 /home/ubuntu/cephtest/cephadm 2023-10-08T08:33:59.120 DEBUG:teuthology.orchestra.run.smithi070:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T08:33:59.142 DEBUG:teuthology.orchestra.run.smithi105:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T08:33:59.164 DEBUG:teuthology.orchestra.run.smithi191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T08:33:59.203 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de on all hosts... 2023-10-08T08:33:59.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T08:33:59.206 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T08:33:59.208 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T08:34:02.374 INFO:teuthology.orchestra.run.smithi191.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T08:34:02.538 INFO:teuthology.orchestra.run.smithi105.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T08:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T08:34:28.518 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2023-10-08T08:34:28.518 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T08:34:28.518 INFO:teuthology.orchestra.run.smithi105.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T08:34:28.518 INFO:teuthology.orchestra.run.smithi105.stdout: "repo_digests": [ 2023-10-08T08:34:28.518 INFO:teuthology.orchestra.run.smithi105.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T08:34:28.519 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2023-10-08T08:34:28.519 INFO:teuthology.orchestra.run.smithi105.stdout:} 2023-10-08T08:34:31.445 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:34:31.446 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T08:34:31.446 INFO:teuthology.orchestra.run.smithi070.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T08:34:31.446 INFO:teuthology.orchestra.run.smithi070.stdout: "repo_digests": [ 2023-10-08T08:34:31.446 INFO:teuthology.orchestra.run.smithi070.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T08:34:31.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:34:31.446 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:34:31.968 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-08T08:34:31.968 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T08:34:31.968 INFO:teuthology.orchestra.run.smithi191.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T08:34:31.968 INFO:teuthology.orchestra.run.smithi191.stdout: "repo_digests": [ 2023-10-08T08:34:31.968 INFO:teuthology.orchestra.run.smithi191.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T08:34:31.968 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2023-10-08T08:34:31.968 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-08T08:34:31.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph 2023-10-08T08:34:32.021 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph 2023-10-08T08:34:32.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph 2023-10-08T08:34:32.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /etc/ceph 2023-10-08T08:34:32.114 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /etc/ceph 2023-10-08T08:34:32.145 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /etc/ceph 2023-10-08T08:34:32.171 INFO:tasks.cephadm:Writing seed config... 2023-10-08T08:34:32.172 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-08T08:34:32.173 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-08T08:34:32.174 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-10-08T08:34:32.175 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:34:32.175 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-08T08:34:32.192 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6a2c3394-65b5-11ee-8db5-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2023-10-08T08:34:32.193 DEBUG:teuthology.orchestra.run.smithi070:mon.a> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.a.service 2023-10-08T08:34:32.235 DEBUG:teuthology.orchestra.run.smithi070:mgr.x> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.x.service 2023-10-08T08:34:32.261 INFO:journalctl@ceph.mon.a.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:34:32.262 INFO:tasks.cephadm:Bootstrapping... 2023-10-08T08:34:32.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de -v bootstrap --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.70 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-08T08:34:32.288 INFO:journalctl@ceph.mgr.x.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:34:32.426 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2023-10-08T08:34:32.426 INFO:teuthology.orchestra.run.smithi070.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', '-v', 'bootstrap', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.70', '--skip-admin-label'] 2023-10-08T08:34:32.572 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 4.1.1 2023-10-08T08:34:32.572 INFO:teuthology.orchestra.run.smithi070.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-08T08:34:32.573 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying podman|docker is present... 2023-10-08T08:34:32.718 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 4.1.1 2023-10-08T08:34:32.718 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying lvm2 is present... 2023-10-08T08:34:32.718 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying time synchronization is in place... 2023-10-08T08:34:32.725 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T08:34:32.725 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T08:34:32.731 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T08:34:32.731 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2023-10-08T08:34:32.737 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2023-10-08T08:34:32.743 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2023-10-08T08:34:32.743 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2023-10-08T08:34:32.743 INFO:teuthology.orchestra.run.smithi070.stdout:Repeating the final host check... 2023-10-08T08:34:32.884 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 4.1.1 2023-10-08T08:34:32.884 INFO:teuthology.orchestra.run.smithi070.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-08T08:34:32.884 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl is present 2023-10-08T08:34:32.884 INFO:teuthology.orchestra.run.smithi070.stdout:lvcreate is present 2023-10-08T08:34:32.890 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T08:34:32.890 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T08:34:32.896 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T08:34:32.896 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2023-10-08T08:34:32.902 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2023-10-08T08:34:32.908 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2023-10-08T08:34:32.908 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2023-10-08T08:34:32.908 INFO:teuthology.orchestra.run.smithi070.stdout:Host looks OK 2023-10-08T08:34:32.908 INFO:teuthology.orchestra.run.smithi070.stdout:Cluster fsid: 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:34:32.908 INFO:teuthology.orchestra.run.smithi070.stdout:Acquiring lock 139893486557672 on /run/cephadm/6a2c3394-65b5-11ee-8db5-212e2dc638e7.lock 2023-10-08T08:34:32.908 INFO:teuthology.orchestra.run.smithi070.stdout:Lock 139893486557672 acquired on /run/cephadm/6a2c3394-65b5-11ee-8db5-212e2dc638e7.lock 2023-10-08T08:34:32.909 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 3300 ... 2023-10-08T08:34:32.909 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 6789 ... 2023-10-08T08:34:32.909 INFO:teuthology.orchestra.run.smithi070.stdout:Base mon IP(s) is [172.21.15.70:3300, 172.21.15.70:6789], mon addrv is [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2023-10-08T08:34:32.913 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-10-08T08:34:32.913 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.70 metric 100 2023-10-08T08:34:32.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-08T08:34:32.915 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-10-08T08:34:32.916 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-10-08T08:34:32.918 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-08T08:34:32.918 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-08T08:34:32.918 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T08:34:32.918 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-10-08T08:34:32.918 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 fe80::5cfd:8641:c68e:a723/64 scope link noprefixroute 2023-10-08T08:34:32.918 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T08:34:32.919 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2023-10-08T08:34:32.919 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2023-10-08T08:34:32.919 INFO:teuthology.orchestra.run.smithi070.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-08T08:34:32.919 INFO:teuthology.orchestra.run.smithi070.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-08T08:34:32.920 INFO:teuthology.orchestra.run.smithi070.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T08:34:33.363 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T08:34:33.363 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T08:34:33.363 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Getting image source signatures 2023-10-08T08:34:33.363 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:1016a809630cb60ade9603521911a0725a35bac1f67b6518836ae2dd33bb1dad 2023-10-08T08:34:33.363 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:be9ed931e0f930233626f1c4d225977fbcc33e056e1a8fc67c7f63553d9455a2 2023-10-08T08:34:33.363 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying config sha256:09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T08:34:33.363 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-08T08:34:33.363 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Storing signatures 2023-10-08T08:34:34.215 INFO:teuthology.orchestra.run.smithi070.stdout:ceph: stdout ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T08:34:34.215 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph version: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T08:34:34.215 INFO:teuthology.orchestra.run.smithi070.stdout:Extracting ceph user uid/gid from container image... 2023-10-08T08:34:34.964 INFO:teuthology.orchestra.run.smithi070.stdout:stat: stdout 167 167 2023-10-08T08:34:34.964 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial keys... 2023-10-08T08:34:35.716 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQCbaSJlTPOYExAAsmNjoHN7HSPx9XKuSRfDlg== 2023-10-08T08:34:36.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQCcaSJlDuDoAhAA2CaZp8M6cJiTrm8H6od5Mw== 2023-10-08T08:34:37.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQCcaSJlJsMVLRAA/npHeuiIZfF7DXOvAzc0sQ== 2023-10-08T08:34:37.108 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial monmap... 2023-10-08T08:34:37.858 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T08:34:37.858 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-08T08:34:37.859 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:34:37.859 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T08:34:37.859 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool for a [v2:172.21.15.70:3300,v1:172.21.15.70:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T08:34:37.859 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = pacific 2023-10-08T08:34:37.859 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: set fsid to 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:34:37.859 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T08:34:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:34:37.859 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mon... 2023-10-08T08:34:38.612 INFO:teuthology.orchestra.run.smithi070.stdout:create mon.a on 2023-10-08T08:34:38.726 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-08T08:34:38.811 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-08T08:34:38.920 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7.target. 2023-10-08T08:34:38.920 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7.target. 2023-10-08T08:34:39.083 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T08:34:39.083 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.a.service: Unit ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.a.service not loaded. 2023-10-08T08:34:39.166 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7.target.wants/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@.service. 2023-10-08T08:34:39.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:39 smithi070 systemd[1]: Starting Ceph mon.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:34:39.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:39 smithi070 podman[98964]: 2023-10-08T08:34:39.699 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:39 smithi070 bash[98964]: c72598ad8a243966e4fd33ed74f714e8a10d12acf7b6c928dd05d3ac2995b750 2023-10-08T08:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T08:34:39.770 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2023-10-08T08:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T08:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2023-10-08T08:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2023-10-08T08:34:39.777 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T08:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon to start... 2023-10-08T08:34:39.778 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon... 2023-10-08T08:34:39.968 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:39 smithi070 ceph-mon[99004]: mkfs 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:34:39.968 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:39 smithi070 ceph-mon[99004]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T08:34:39.968 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:39 smithi070 systemd[1]: Started Ceph mon.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:34:40.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout cluster: 2023-10-08T08:34:40.624 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout id: 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:34:40.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-08T08:34:40.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:34:40.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout services: 2023-10-08T08:34:40.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.592137s) 2023-10-08T08:34:40.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-08T08:34:40.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-08T08:34:40.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:34:40.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout data: 2023-10-08T08:34:40.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-08T08:34:40.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-08T08:34:40.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-08T08:34:40.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pgs: 2023-10-08T08:34:40.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:34:40.626 INFO:teuthology.orchestra.run.smithi070.stdout:mon is available 2023-10-08T08:34:40.626 INFO:teuthology.orchestra.run.smithi070.stdout:Assimilating anything we can from ceph.conf... 2023-10-08T08:34:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:40 smithi070 ceph-mon[99004]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T08:34:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:40 smithi070 ceph-mon[99004]: monmap e1: 1 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0]} removed_ranks: {} 2023-10-08T08:34:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:40 smithi070 ceph-mon[99004]: fsmap 2023-10-08T08:34:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:40 smithi070 ceph-mon[99004]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T08:34:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:40 smithi070 ceph-mon[99004]: mgrmap e1: no daemons active 2023-10-08T08:34:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:40 smithi070 ceph-mon[99004]: from='client.? 172.21.15.70:0/1766112015' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-08T08:34:41.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:34:41.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T08:34:41.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:34:41.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2023-10-08T08:34:41.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T08:34:41.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T08:34:41.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T08:34:41.570 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T08:34:41.570 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:34:41.570 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T08:34:41.570 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T08:34:41.570 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:34:41.570 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T08:34:41.571 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T08:34:41.571 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T08:34:41.571 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T08:34:41.571 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T08:34:41.571 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T08:34:41.571 INFO:teuthology.orchestra.run.smithi070.stdout:Generating new minimal ceph.conf... 2023-10-08T08:34:41.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:41 smithi070 ceph-mon[99004]: from='client.? 172.21.15.70:0/4278384992' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T08:34:41.806 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:41 smithi070 ceph-mon[99004]: from='client.? 172.21.15.70:0/4278384992' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-08T08:34:42.505 INFO:teuthology.orchestra.run.smithi070.stdout:Restarting the monitor... 2023-10-08T08:34:42.851 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:42 smithi070 systemd[1]: Stopping Ceph mon.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:34:42.851 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:42 smithi070 ceph-mon[99004]: from='client.? 172.21.15.70:0/3371754579' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:34:43.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:42 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a[98980]: 2023-10-08T08:34:42.848+0000 7fa74e452700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:34:43.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:42 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a[98980]: 2023-10-08T08:34:42.848+0000 7fa74e452700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-08T08:34:43.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 bash[99333]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a 2023-10-08T08:34:43.766 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-08T08:34:43.766 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 systemd[1]: Stopped Ceph mon.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:34:43.766 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 systemd[1]: Starting Ceph mon.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:34:43.979 INFO:teuthology.orchestra.run.smithi070.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-08T08:34:44.044 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 podman[99473]: 2023-10-08T08:34:44.044 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T08:34:44.044 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: pidfile_write: ignore empty --pid-file 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 bash[99473]: d56d3f038ba9b4a25662fa3d303492bc49021650dfdc5d351c404139dbe644b9 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: load: jerasure load: lrc 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: RocksDB version: 7.9.2 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Git sha 0 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: DB SUMMARY 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: DB Session ID: MK21UW8ZMT5GDCYRW23P 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: CURRENT file: CURRENT 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-08T08:34:44.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88662 ; 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.error_if_exists: 0 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.create_if_missing: 0 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.paranoid_checks: 1 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.env: 0x5580ed3e2da0 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.info_log: 0x5580ede0b640 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T08:34:44.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.statistics: (nil) 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.use_fsync: 0 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_log_file_size: 0 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.allow_fallocate: 1 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.use_direct_reads: 0 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T08:34:44.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.db_log_dir: 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.wal_dir: 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.write_buffer_manager: 0x5580eddc3360 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T08:34:44.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.unordered_write: 0 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T08:34:44.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.row_cache: None 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.wal_filter: None 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.two_write_queues: 0 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.wal_compression: 0 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.atomic_flush: 0 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T08:34:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.log_readahead_size: 0 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_background_jobs: 2 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_background_compactions: -1 2023-10-08T08:34:44.051 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_subcompactions: 1 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_open_files: -1 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T08:34:44.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_background_flushes: -1 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Compression algorithms supported: 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: kZSTD supported: 0 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: kXpressCompression supported: 0 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: kZlibCompression supported: 1 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: kSnappyCompression supported: 1 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: kLZ4Compression supported: 1 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: kBZip2Compression supported: 0 2023-10-08T08:34:44.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.merge_operator: 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_filter: None 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5580ede0b740) 2023-10-08T08:34:44.054 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks: 1 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_top_level_index_and_filter: 1 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_type: 0 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_index_type: 0 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_shortening: 1 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: checksum: 4 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: no_block_cache: 0 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache: 0x5580ede611f0 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_name: BinnedLRUCache 2023-10-08T08:34:44.055 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_options: 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: capacity : 536870912 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_shard_bits : 4 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: strict_capacity_limit : 0 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: high_pri_pool_ratio: 0.000 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_compressed: (nil) 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: persistent_cache: (nil) 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size: 4096 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size_deviation: 10 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_restart_interval: 16 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_block_restart_interval: 1 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: metadata_block_size: 4096 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: partition_filters: 0 2023-10-08T08:34:44.056 INFO:journalctl@ceph.mon.a.smithi070.stdout: use_delta_encoding: 1 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: filter_policy: bloomfilter 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: whole_key_filtering: 1 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: verify_compression: 0 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: read_amp_bytes_per_bit: 0 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: format_version: 5 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_index_compression: 1 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_align: 0 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: max_auto_readahead_size: 262144 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: prepopulate_block_cache: 0 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: initial_auto_readahead_size: 8192 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T08:34:44.057 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression: NoCompression 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.num_levels: 7 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T08:34:44.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T08:34:44.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T08:34:44.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T08:34:44.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T08:34:44.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T08:34:44.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T08:34:44.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T08:34:44.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T08:34:44.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T08:34:44.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T08:34:44.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T08:34:44.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T08:34:44.062 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.table_properties_collectors: 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.inplace_update_support: 0 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.bloom_locality: 0 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.max_successive_merges: 0 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T08:34:44.063 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.ttl: 2592000 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.enable_blob_files: false 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.min_blob_size: 0 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T08:34:44.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T08:34:44.065 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T08:34:44.065 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T08:34:44.065 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-08T08:34:44.065 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e6057d62-fb0c-483c-b8a4-05967834c92a 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696754083970916, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696754083971901, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 84902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 270, "table_properties": {"data_size": 83076, "index_size": 236, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11100, "raw_average_key_size": 48, "raw_value_size": 76800, "raw_average_value_size": 335, "num_data_blocks": 10, "num_entries": 229, "num_filter_entries": 229, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696754083, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e6057d62-fb0c-483c-b8a4-05967834c92a", "db_session_id": "MK21UW8ZMT5GDCYRW23P", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696754083971978, "job": 1, "event": "recovery_finished"} 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5580edefe000 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: DB pointer 0x5580edeea000 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T08:34:44.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** DB Stats ** 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T08:34:44.067 INFO:journalctl@ceph.mon.a.smithi070.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: L0 2/0 84.75 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: Sum 2/0 84.75 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 129.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T08:34:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative compaction: 0.00 GB write, 27.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval compaction: 0.00 GB write, 27.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache BinnedLRUCache@0x5580ede611f0#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2023-10-08T08:34:44.069 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: starting mon.a rank 0 at public addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] at bind addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: mon.a@-1(???) e1 preinit fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: mon.a@-1(???).mds e1 new map 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: mon.a@-1(???).mds e1 print_map 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout: e1 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout: legacy client fscid: -1 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout: No filesystems configured 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T08:34:44.070 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T08:34:44.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T08:34:44.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T08:34:44.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 ceph-mon[99513]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-08T08:34:44.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:43 smithi070 systemd[1]: Started Ceph mon.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:34:44.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:44 smithi070 ceph-mon[99513]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T08:34:44.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:44 smithi070 ceph-mon[99513]: monmap e1: 1 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0]} removed_ranks: {} 2023-10-08T08:34:44.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:44 smithi070 ceph-mon[99513]: fsmap 2023-10-08T08:34:44.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:44 smithi070 ceph-mon[99513]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T08:34:44.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:44 smithi070 ceph-mon[99513]: mgrmap e1: no daemons active 2023-10-08T08:34:46.431 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-08T08:34:46.472 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-08T08:34:46.473 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mgr... 2023-10-08T08:34:46.473 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-08T08:34:46.473 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-08T08:34:46.676 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T08:34:46.676 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.x.service: Unit ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.x.service not loaded. 2023-10-08T08:34:46.765 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7.target.wants/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@.service. 2023-10-08T08:34:46.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:46 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/781222187' entity='client.admin' 2023-10-08T08:34:46.971 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:46 smithi070 systemd[1]: Starting Ceph mgr.x for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:34:47.331 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:47 smithi070 podman[99741]: 2023-10-08T08:34:47.369 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T08:34:47.369 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2023-10-08T08:34:47.378 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T08:34:47.378 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2023-10-08T08:34:47.378 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2023-10-08T08:34:47.378 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T08:34:47.387 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T08:34:47.388 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2023-10-08T08:34:47.396 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T08:34:47.396 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2023-10-08T08:34:47.396 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2023-10-08T08:34:47.396 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-08T08:34:47.396 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr to start... 2023-10-08T08:34:47.396 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr... 2023-10-08T08:34:47.640 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:47 smithi070 bash[99741]: 8f39cc3ff62ce772f40a9820db7997164b1e6517d045b438fe17d6a28817d819 2023-10-08T08:34:47.641 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:47 smithi070 systemd[1]: Started Ceph mgr.x for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:34:47.641 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:47.470+0000 7fc3afa76200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T08:34:47.641 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:47.549+0000 7fc3afa76200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T08:34:47.641 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:47.639+0000 7fc3afa76200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T08:34:47.923 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:47.743+0000 7fc3afa76200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T08:34:48.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:48 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2072575456' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T08:34:48.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:47.922+0000 7fc3afa76200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T08:34:48.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:34:48.355 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2023-10-08T08:34:48.355 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:34:48.355 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T08:34:48.355 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T08:34:48.355 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T08:34:48.356 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:48.357 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:48.358 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:48.359 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T08:34:48.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:48.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T08:34:39.696653+0000", 2023-10-08T08:34:48.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T08:34:48.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:48.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T08:34:48.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2023-10-08T08:34:48.360 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (1/15)... 2023-10-08T08:34:48.620 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:48.303+0000 7fc3afa76200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T08:34:48.620 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:48.435+0000 7fc3afa76200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T08:34:48.620 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:48.524+0000 7fc3afa76200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T08:34:49.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:48.619+0000 7fc3afa76200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T08:34:49.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:49 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:49.034+0000 7fc3afa76200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T08:34:49.970 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:49 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:49.691+0000 7fc3afa76200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T08:34:49.971 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:49 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:49.772+0000 7fc3afa76200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T08:34:50.834 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:50.543+0000 7fc3afa76200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:34:50.835 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:50.640+0000 7fc3afa76200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T08:34:51.137 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:50 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1117472625' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T08:34:51.138 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:50.833+0000 7fc3afa76200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:34:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:34:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2023-10-08T08:34:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:34:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T08:34:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T08:34:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T08:34:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T08:34:51.300 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T08:34:51.301 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T08:34:51.302 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:51.302 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T08:34:51.302 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:51.302 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T08:34:51.302 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T08:34:51.302 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T08:34:51.302 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T08:34:51.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T08:34:51.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T08:34:51.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:51.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T08:34:51.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T08:34:51.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T08:34:51.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T08:34:51.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T08:34:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T08:34:39.696653+0000", 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T08:34:51.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:51.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T08:34:51.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2023-10-08T08:34:51.309 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (2/15)... 2023-10-08T08:34:51.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:51 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:51.134+0000 7fc3afa76200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T08:34:51.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:51 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:51.364+0000 7fc3afa76200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T08:34:51.774 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:51 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:51.511+0000 7fc3afa76200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T08:34:52.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:51 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:51.773+0000 7fc3afa76200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T08:34:52.720 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:52 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:52.466+0000 7fc3afa76200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T08:34:52.720 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:52 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:52.596+0000 7fc3afa76200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T08:34:53.119 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:52 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:52.788+0000 7fc3afa76200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T08:34:53.119 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:52 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:52.900+0000 7fc3afa76200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T08:34:53.471 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:53 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:53.118+0000 7fc3afa76200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T08:34:54.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:53 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3597175704' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T08:34:54.221 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:34:54.019+0000 7fc3afa76200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T08:34:54.345 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:34:54.345 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2023-10-08T08:34:54.345 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:34:54.345 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T08:34:54.345 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2023-10-08T08:34:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T08:34:54.347 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T08:34:54.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T08:34:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T08:34:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T08:34:39.696653+0000", 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2023-10-08T08:34:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (3/15)... 2023-10-08T08:34:55.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: Activating manager daemon x 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: mgrmap e2: x(active, starting, since 0.00281794s) 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: Manager daemon x is now available 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T08:34:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' 2023-10-08T08:34:55.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' 2023-10-08T08:34:55.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:54 smithi070 ceph-mon[99513]: from='mgr.14100 172.21.15.70:0/4072129463' entity='mgr.x' 2023-10-08T08:34:56.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:56 smithi070 ceph-mon[99513]: mgrmap e3: x(active, since 1.00672s) 2023-10-08T08:34:58.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:58 smithi070 ceph-mon[99513]: mgrmap e4: x(active, since 3s) 2023-10-08T08:35:00.312 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:34:59 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2540945021' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2023-10-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T08:35:02.316 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T08:35:02.316 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:35:02.316 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2023-10-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2023-10-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T08:35:02.320 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T08:35:02.320 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T08:35:02.320 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T08:35:02.320 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:35:02.320 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T08:35:02.320 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2023-10-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T08:34:39.696653+0000", 2023-10-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2023-10-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2023-10-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stdout:mgr is available 2023-10-08T08:35:05.403 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:04 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1576005031' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T08:35:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:35:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T08:35:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:35:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T08:35:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T08:35:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T08:35:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T08:35:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:35:05.667 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T08:35:05.668 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T08:35:05.668 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2023-10-08T08:35:05.668 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T08:35:05.668 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T08:35:05.668 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T08:35:05.668 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T08:35:05.668 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T08:35:05.668 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T08:35:05.668 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling cephadm module... 2023-10-08T08:35:06.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:06 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3478615660' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-08T08:35:06.722 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:06 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: ignoring --setuser ceph since I am not root 2023-10-08T08:35:06.722 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:06 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: ignoring --setgroup ceph since I am not root 2023-10-08T08:35:06.722 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:06 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:06.602+0000 7f5835e15200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T08:35:06.722 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:06 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:06.683+0000 7f5835e15200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T08:35:07.026 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:06 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:06.774+0000 7f5835e15200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T08:35:07.027 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:06 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:06.883+0000 7f5835e15200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T08:35:07.437 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:07 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:07.060+0000 7f5835e15200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T08:35:07.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:07 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3478615660' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-08T08:35:07.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:07 smithi070 ceph-mon[99513]: mgrmap e5: x(active, since 12s) 2023-10-08T08:35:07.711 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:07 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:07.436+0000 7f5835e15200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T08:35:07.711 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:07 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:07.569+0000 7f5835e15200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T08:35:07.711 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:07 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:07.664+0000 7f5835e15200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T08:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2023-10-08T08:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-08T08:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T08:35:07.968 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T08:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T08:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2023-10-08T08:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2023-10-08T08:35:07.969 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 5... 2023-10-08T08:35:07.970 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:07 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:07.762+0000 7f5835e15200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T08:35:08.439 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:08 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:08.198+0000 7f5835e15200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T08:35:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:08 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2700429562' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T08:35:09.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:08 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:08.863+0000 7f5835e15200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T08:35:09.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:08 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:08.945+0000 7f5835e15200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T08:35:09.970 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:09 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:09.709+0000 7f5835e15200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:35:09.970 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:09 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:09.799+0000 7f5835e15200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T08:35:10.248 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:09 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:09.971+0000 7f5835e15200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:35:10.618 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:10 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:10.247+0000 7f5835e15200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T08:35:10.618 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:10 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:10.471+0000 7f5835e15200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T08:35:10.881 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:10 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:10.617+0000 7f5835e15200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T08:35:11.221 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:10 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:10.880+0000 7f5835e15200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T08:35:11.898 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:11 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:11.577+0000 7f5835e15200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T08:35:11.899 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:11 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:11.706+0000 7f5835e15200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T08:35:12.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:11 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:11.897+0000 7f5835e15200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T08:35:12.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:12 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:12.011+0000 7f5835e15200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T08:35:12.720 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:12 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:12.227+0000 7f5835e15200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T08:35:13.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:13.080+0000 7f5835e15200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: Active manager daemon x restarted 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: Activating manager daemon x 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: osdmap e2: 0 total, 0 up, 0 in 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: mgrmap e6: x(active, starting, since 0.00331796s) 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: Manager daemon x is now available 2023-10-08T08:35:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:13.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:13.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:13.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:13.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:13 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:14.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2023-10-08T08:35:14.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-08T08:35:14.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T08:35:14.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2023-10-08T08:35:14.421 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 5 is available 2023-10-08T08:35:14.421 INFO:teuthology.orchestra.run.smithi070.stdout:Setting orchestrator backend to cephadm... 2023-10-08T08:35:14.457 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:14 smithi070 ceph-mon[99513]: Found migration_current of "None". Setting to last migration. 2023-10-08T08:35:14.458 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:14 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T08:35:14.458 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:14 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T08:35:14.458 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:14 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:14.458 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:14 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:14.458 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:14 smithi070 ceph-mon[99513]: mgrmap e7: x(active, since 1.00522s) 2023-10-08T08:35:15.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:15 smithi070 ceph-mon[99513]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-08T08:35:15.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:15 smithi070 ceph-mon[99513]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-08T08:35:15.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:15 smithi070 ceph-mon[99513]: [08/Oct/2023:08:35:14] ENGINE Bus STARTING 2023-10-08T08:35:15.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:15 smithi070 ceph-mon[99513]: [08/Oct/2023:08:35:14] ENGINE Serving on https://172.21.15.70:7150 2023-10-08T08:35:15.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:15 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:15.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:15 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:15.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:15 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:16.405 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:16 smithi070 ceph-mon[99513]: [08/Oct/2023:08:35:14] ENGINE Serving on http://172.21.15.70:8765 2023-10-08T08:35:16.405 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:16 smithi070 ceph-mon[99513]: [08/Oct/2023:08:35:14] ENGINE Bus STARTED 2023-10-08T08:35:16.405 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:16 smithi070 ceph-mon[99513]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:16.405 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:16 smithi070 ceph-mon[99513]: mgrmap e8: x(active, since 2s) 2023-10-08T08:35:16.801 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-08T08:35:16.802 INFO:teuthology.orchestra.run.smithi070.stdout:Generating ssh key... 2023-10-08T08:35:17.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-mon[99513]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:18.110 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: Generating public/private rsa key pair. 2023-10-08T08:35:18.111 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: Your identification has been saved in /tmp/tmpui4ed6_b/key. 2023-10-08T08:35:18.111 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: Your public key has been saved in /tmp/tmpui4ed6_b/key.pub. 2023-10-08T08:35:18.111 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: The key fingerprint is: 2023-10-08T08:35:18.111 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: SHA256:wCpQbQ7/tjWs11F+56Gm6wUuczonxPL87ZdQ8tcaz04 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:35:18.111 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: The key's randomart image is: 2023-10-08T08:35:18.111 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: +---[RSA 3072]----+ 2023-10-08T08:35:18.111 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: | .. | 2023-10-08T08:35:18.111 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: | .. o. | 2023-10-08T08:35:18.112 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: |. = o | 2023-10-08T08:35:18.112 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: | . o. . .. . | 2023-10-08T08:35:18.112 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: | . .. .S + + .| 2023-10-08T08:35:18.112 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: | . o.+oo o.oo+| 2023-10-08T08:35:18.112 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: | . +== + ooBE| 2023-10-08T08:35:18.112 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: | o .=*.oo.++| 2023-10-08T08:35:18.112 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: | . .*==o...| 2023-10-08T08:35:18.112 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: +----[SHA256]-----+ 2023-10-08T08:35:19.155 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:18 smithi070 ceph-mon[99513]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:19.155 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:18 smithi070 ceph-mon[99513]: Generating ssh key... 2023-10-08T08:35:19.155 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:18 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:19.155 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:18 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:19.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeBD0aiZrD1+xs/ErbRhmJ0vOXBIKk0zQF0g0lz/Y+AtgUN2HNMEWxdVMPCx/xGcpvjUJ2ELiuxnr6ZqaTzpl+ZZC12xDKGsX7qH+IZ+sy34CkMhpd9cSQwzn8SvZjO2fQvyZGlRMDzXlRELcnXhWd4i09SwK+qlUa0ayY7vfIZR5idAnKcLTFcvbHht2S81DRdVeCqrPJQG1PPrMHpNkktTEe2CvILtZODU0rKWgZWkLFw9ubGsCnNHEn9HziO3/4+6W4cHQNu+zYkT7+6Prkm1yvJlUu2JFPa7+FigreSG1t4AkV58Bv0tW0vyhVr+3hIwqC+EmEYfrwXN13hDNU+fG4y0tqH8RUlb6BiCmm0ki2BDioYn3c3Wb+W2yMvczGKBsSy2mPwaijzBhrUq1iHqNaLt9xs9ueZJZk4Amk14GXdVBnbLlOna7+27meIV/Fuw8Jonyx4rBJ7DEwHeeTYz3jDqmL2iQV98XVJqex3ugMj1y8+c9aKOfYQvpDkck= ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:35:19.189 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-08T08:35:19.189 INFO:teuthology.orchestra.run.smithi070.stdout:Adding key to root@localhost authorized_keys... 2023-10-08T08:35:19.190 INFO:teuthology.orchestra.run.smithi070.stdout:Adding host smithi070... 2023-10-08T08:35:20.143 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:19 smithi070 ceph-mon[99513]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:21.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:20 smithi070 ceph-mon[99513]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:21.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:20 smithi070 ceph-mon[99513]: Deploying cephadm binary to smithi070 2023-10-08T08:35:22.637 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Added host 'smithi070' with addr '172.21.15.70' 2023-10-08T08:35:22.637 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mon service... 2023-10-08T08:35:23.571 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:23 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:23.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:23 smithi070 ceph-mon[99513]: Added host smithi070 2023-10-08T08:35:23.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:23 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:23.880 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-08T08:35:23.881 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mgr service... 2023-10-08T08:35:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:24 smithi070 ceph-mon[99513]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:24 smithi070 ceph-mon[99513]: Saving service mon spec with placement count:5 2023-10-08T08:35:24.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:24 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:25.232 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-08T08:35:25.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:25 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:25.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:25 smithi070 ceph-mon[99513]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:25.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:25 smithi070 ceph-mon[99513]: Saving service mgr spec with placement count:2 2023-10-08T08:35:25.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:25 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:25.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:25 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:27.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:26 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3888593900' entity='client.admin' 2023-10-08T08:35:27.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:26 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:27.662 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling the dashboard module... 2023-10-08T08:35:28.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:28 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1543581049' entity='client.admin' 2023-10-08T08:35:28.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:28 smithi070 ceph-mon[99513]: from='mgr.14120 172.21.15.70:0/2494965200' entity='mgr.x' 2023-10-08T08:35:29.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:29 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/263335483' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-08T08:35:29.496 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: ignoring --setuser ceph since I am not root 2023-10-08T08:35:29.496 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: ignoring --setgroup ceph since I am not root 2023-10-08T08:35:29.496 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:29.413+0000 7f4df045e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T08:35:29.496 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:29.494+0000 7f4df045e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T08:35:29.846 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:29.586+0000 7f4df045e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T08:35:29.846 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:29.694+0000 7f4df045e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T08:35:30.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:29.873+0000 7f4df045e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T08:35:30.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:30 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/263335483' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-08T08:35:30.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:30 smithi070 ceph-mon[99513]: mgrmap e9: x(active, since 16s) 2023-10-08T08:35:30.490 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:30 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:30.259+0000 7f4df045e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T08:35:30.491 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:30 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:30.393+0000 7f4df045e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T08:35:30.790 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:30 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:30.489+0000 7f4df045e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T08:35:30.790 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:30 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:30.587+0000 7f4df045e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T08:35:30.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2023-10-08T08:35:30.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-08T08:35:30.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T08:35:30.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T08:35:30.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T08:35:30.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2023-10-08T08:35:30.856 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2023-10-08T08:35:30.856 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 9... 2023-10-08T08:35:31.062 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:31 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:31.020+0000 7f4df045e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T08:35:31.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:31 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/975827442' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T08:35:31.970 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:31 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:31.696+0000 7f4df045e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T08:35:31.970 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:31 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:31.779+0000 7f4df045e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T08:35:32.817 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:32.547+0000 7f4df045e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:35:32.817 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:32.640+0000 7f4df045e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T08:35:33.101 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:32.816+0000 7f4df045e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:35:33.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:33.100+0000 7f4df045e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T08:35:33.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:33.325+0000 7f4df045e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T08:35:33.741 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:33.474+0000 7f4df045e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T08:35:34.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:33.740+0000 7f4df045e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T08:35:34.720 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:34.445+0000 7f4df045e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T08:35:34.720 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:34.578+0000 7f4df045e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T08:35:35.114 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:34.775+0000 7f4df045e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T08:35:35.114 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:34.889+0000 7f4df045e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T08:35:35.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:35.113+0000 7f4df045e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T08:35:36.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:35:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:35:35.973+0000 7f4df045e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: Active manager daemon x restarted 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: Activating manager daemon x 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: osdmap e3: 0 total, 0 up, 0 in 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: mgrmap e10: x(active, starting, since 0.00310405s) 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T08:35:36.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: Manager daemon x is now available 2023-10-08T08:35:36.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:36.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:36 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:37.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:37 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T08:35:37.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:37 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T08:35:37.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:37 smithi070 ceph-mon[99513]: mgrmap e11: x(active, since 1.00559s) 2023-10-08T08:35:37.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2023-10-08T08:35:37.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-08T08:35:37.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T08:35:37.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2023-10-08T08:35:37.909 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 9 is available 2023-10-08T08:35:37.909 INFO:teuthology.orchestra.run.smithi070.stdout:Generating a dashboard self-signed certificate... 2023-10-08T08:35:38.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:38 smithi070 ceph-mon[99513]: [08/Oct/2023:08:35:37] ENGINE Bus STARTING 2023-10-08T08:35:38.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:38 smithi070 ceph-mon[99513]: [08/Oct/2023:08:35:37] ENGINE Serving on http://172.21.15.70:8765 2023-10-08T08:35:38.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:38 smithi070 ceph-mon[99513]: [08/Oct/2023:08:35:37] ENGINE Serving on https://172.21.15.70:7150 2023-10-08T08:35:38.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:38 smithi070 ceph-mon[99513]: [08/Oct/2023:08:35:37] ENGINE Bus STARTED 2023-10-08T08:35:38.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-08T08:35:38.951 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial admin user... 2023-10-08T08:35:39.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:39 smithi070 ceph-mon[99513]: mgrmap e12: x(active, since 2s) 2023-10-08T08:35:39.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:39 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:39.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:39 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:39.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:39 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:40 smithi070 ceph-mon[99513]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:40 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:40 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:40.391 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Ir6CnTRKlAY5Bdt6QTsXduYhs/1dJqQYXDyQnd4Ir8WSnWQAIY5ra", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1696754139, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-08T08:35:40.391 INFO:teuthology.orchestra.run.smithi070.stdout:Fetching dashboard port number... 2023-10-08T08:35:41.461 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:41 smithi070 ceph-mon[99513]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:41.735 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 8443 2023-10-08T08:35:41.744 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T08:35:41.744 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2023-10-08T08:35:41.751 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T08:35:41.751 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2023-10-08T08:35:41.751 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2023-10-08T08:35:41.751 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-08T08:35:41.752 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph Dashboard is now available at: 2023-10-08T08:35:41.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:41.753 INFO:teuthology.orchestra.run.smithi070.stdout: URL: https://smithi070.front.sepia.ceph.com:8443/ 2023-10-08T08:35:41.753 INFO:teuthology.orchestra.run.smithi070.stdout: User: admin 2023-10-08T08:35:41.753 INFO:teuthology.orchestra.run.smithi070.stdout: Password: 8j6ztpyguy 2023-10-08T08:35:41.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:41.753 INFO:teuthology.orchestra.run.smithi070.stdout:Saving cluster configuration to /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config directory 2023-10-08T08:35:41.754 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling autotune for osd_memory_target 2023-10-08T08:35:42.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:42 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/355827601' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-08T08:35:43.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:43 smithi070 ceph-mon[99513]: mgrmap e13: x(active, since 6s) 2023-10-08T08:35:43.935 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-08T08:35:43.935 INFO:teuthology.orchestra.run.smithi070.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-08T08:35:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:43.935 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout:Or, if you are only running a single cluster on this host: 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: ceph telemetry on 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout:For more information see: 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-08T08:35:43.936 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:43.937 INFO:teuthology.orchestra.run.smithi070.stdout:Bootstrap complete. 2023-10-08T08:35:43.970 INFO:tasks.cephadm:Fetching config... 2023-10-08T08:35:43.970 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:35:43.970 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-08T08:35:43.987 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-08T08:35:43.987 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:35:43.987 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-08T08:35:44.045 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-08T08:35:44.046 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:35:44.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-08T08:35:44.115 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-08T08:35:44.115 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:35:44.115 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-08T08:35:44.171 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-08T08:35:44.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeBD0aiZrD1+xs/ErbRhmJ0vOXBIKk0zQF0g0lz/Y+AtgUN2HNMEWxdVMPCx/xGcpvjUJ2ELiuxnr6ZqaTzpl+ZZC12xDKGsX7qH+IZ+sy34CkMhpd9cSQwzn8SvZjO2fQvyZGlRMDzXlRELcnXhWd4i09SwK+qlUa0ayY7vfIZR5idAnKcLTFcvbHht2S81DRdVeCqrPJQG1PPrMHpNkktTEe2CvILtZODU0rKWgZWkLFw9ubGsCnNHEn9HziO3/4+6W4cHQNu+zYkT7+6Prkm1yvJlUu2JFPa7+FigreSG1t4AkV58Bv0tW0vyhVr+3hIwqC+EmEYfrwXN13hDNU+fG4y0tqH8RUlb6BiCmm0ki2BDioYn3c3Wb+W2yMvczGKBsSy2mPwaijzBhrUq1iHqNaLt9xs9ueZJZk4Amk14GXdVBnbLlOna7+27meIV/Fuw8Jonyx4rBJ7DEwHeeTYz3jDqmL2iQV98XVJqex3ugMj1y8+c9aKOfYQvpDkck= ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T08:35:44.250 INFO:teuthology.orchestra.run.smithi070.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeBD0aiZrD1+xs/ErbRhmJ0vOXBIKk0zQF0g0lz/Y+AtgUN2HNMEWxdVMPCx/xGcpvjUJ2ELiuxnr6ZqaTzpl+ZZC12xDKGsX7qH+IZ+sy34CkMhpd9cSQwzn8SvZjO2fQvyZGlRMDzXlRELcnXhWd4i09SwK+qlUa0ayY7vfIZR5idAnKcLTFcvbHht2S81DRdVeCqrPJQG1PPrMHpNkktTEe2CvILtZODU0rKWgZWkLFw9ubGsCnNHEn9HziO3/4+6W4cHQNu+zYkT7+6Prkm1yvJlUu2JFPa7+FigreSG1t4AkV58Bv0tW0vyhVr+3hIwqC+EmEYfrwXN13hDNU+fG4y0tqH8RUlb6BiCmm0ki2BDioYn3c3Wb+W2yMvczGKBsSy2mPwaijzBhrUq1iHqNaLt9xs9ueZJZk4Amk14GXdVBnbLlOna7+27meIV/Fuw8Jonyx4rBJ7DEwHeeTYz3jDqmL2iQV98XVJqex3ugMj1y8+c9aKOfYQvpDkck= ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:35:44.265 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeBD0aiZrD1+xs/ErbRhmJ0vOXBIKk0zQF0g0lz/Y+AtgUN2HNMEWxdVMPCx/xGcpvjUJ2ELiuxnr6ZqaTzpl+ZZC12xDKGsX7qH+IZ+sy34CkMhpd9cSQwzn8SvZjO2fQvyZGlRMDzXlRELcnXhWd4i09SwK+qlUa0ayY7vfIZR5idAnKcLTFcvbHht2S81DRdVeCqrPJQG1PPrMHpNkktTEe2CvILtZODU0rKWgZWkLFw9ubGsCnNHEn9HziO3/4+6W4cHQNu+zYkT7+6Prkm1yvJlUu2JFPa7+FigreSG1t4AkV58Bv0tW0vyhVr+3hIwqC+EmEYfrwXN13hDNU+fG4y0tqH8RUlb6BiCmm0ki2BDioYn3c3Wb+W2yMvczGKBsSy2mPwaijzBhrUq1iHqNaLt9xs9ueZJZk4Amk14GXdVBnbLlOna7+27meIV/Fuw8Jonyx4rBJ7DEwHeeTYz3jDqmL2iQV98XVJqex3ugMj1y8+c9aKOfYQvpDkck= ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T08:35:44.312 INFO:teuthology.orchestra.run.smithi105.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeBD0aiZrD1+xs/ErbRhmJ0vOXBIKk0zQF0g0lz/Y+AtgUN2HNMEWxdVMPCx/xGcpvjUJ2ELiuxnr6ZqaTzpl+ZZC12xDKGsX7qH+IZ+sy34CkMhpd9cSQwzn8SvZjO2fQvyZGlRMDzXlRELcnXhWd4i09SwK+qlUa0ayY7vfIZR5idAnKcLTFcvbHht2S81DRdVeCqrPJQG1PPrMHpNkktTEe2CvILtZODU0rKWgZWkLFw9ubGsCnNHEn9HziO3/4+6W4cHQNu+zYkT7+6Prkm1yvJlUu2JFPa7+FigreSG1t4AkV58Bv0tW0vyhVr+3hIwqC+EmEYfrwXN13hDNU+fG4y0tqH8RUlb6BiCmm0ki2BDioYn3c3Wb+W2yMvczGKBsSy2mPwaijzBhrUq1iHqNaLt9xs9ueZJZk4Amk14GXdVBnbLlOna7+27meIV/Fuw8Jonyx4rBJ7DEwHeeTYz3jDqmL2iQV98XVJqex3ugMj1y8+c9aKOfYQvpDkck= ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:35:44.325 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeBD0aiZrD1+xs/ErbRhmJ0vOXBIKk0zQF0g0lz/Y+AtgUN2HNMEWxdVMPCx/xGcpvjUJ2ELiuxnr6ZqaTzpl+ZZC12xDKGsX7qH+IZ+sy34CkMhpd9cSQwzn8SvZjO2fQvyZGlRMDzXlRELcnXhWd4i09SwK+qlUa0ayY7vfIZR5idAnKcLTFcvbHht2S81DRdVeCqrPJQG1PPrMHpNkktTEe2CvILtZODU0rKWgZWkLFw9ubGsCnNHEn9HziO3/4+6W4cHQNu+zYkT7+6Prkm1yvJlUu2JFPa7+FigreSG1t4AkV58Bv0tW0vyhVr+3hIwqC+EmEYfrwXN13hDNU+fG4y0tqH8RUlb6BiCmm0ki2BDioYn3c3Wb+W2yMvczGKBsSy2mPwaijzBhrUq1iHqNaLt9xs9ueZJZk4Amk14GXdVBnbLlOna7+27meIV/Fuw8Jonyx4rBJ7DEwHeeTYz3jDqmL2iQV98XVJqex3ugMj1y8+c9aKOfYQvpDkck= ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T08:35:44.372 INFO:teuthology.orchestra.run.smithi191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeBD0aiZrD1+xs/ErbRhmJ0vOXBIKk0zQF0g0lz/Y+AtgUN2HNMEWxdVMPCx/xGcpvjUJ2ELiuxnr6ZqaTzpl+ZZC12xDKGsX7qH+IZ+sy34CkMhpd9cSQwzn8SvZjO2fQvyZGlRMDzXlRELcnXhWd4i09SwK+qlUa0ayY7vfIZR5idAnKcLTFcvbHht2S81DRdVeCqrPJQG1PPrMHpNkktTEe2CvILtZODU0rKWgZWkLFw9ubGsCnNHEn9HziO3/4+6W4cHQNu+zYkT7+6Prkm1yvJlUu2JFPa7+FigreSG1t4AkV58Bv0tW0vyhVr+3hIwqC+EmEYfrwXN13hDNU+fG4y0tqH8RUlb6BiCmm0ki2BDioYn3c3Wb+W2yMvczGKBsSy2mPwaijzBhrUq1iHqNaLt9xs9ueZJZk4Amk14GXdVBnbLlOna7+27meIV/Fuw8Jonyx4rBJ7DEwHeeTYz3jDqmL2iQV98XVJqex3ugMj1y8+c9aKOfYQvpDkck= ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:35:44.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-08T08:35:44.565 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:44 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1420589663' entity='client.admin' 2023-10-08T08:35:44.952 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:35:47.255 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-08T08:35:47.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-08T08:35:47.888 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:35:48.091 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:47 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/225663972' entity='client.admin' 2023-10-08T08:35:48.091 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:47 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:48.091 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:47 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:48.091 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:47 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:35:48.091 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:47 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:48.091 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:47 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:48.091 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:47 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:49.735 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi105 2023-10-08T08:35:49.735 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:35:49.735 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/etc/ceph/ceph.conf 2023-10-08T08:35:49.755 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:35:49.755 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:35:49.815 INFO:tasks.cephadm:Adding host smithi105 to orchestrator... 2023-10-08T08:35:49.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi105 2023-10-08T08:35:50.393 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:35:50.591 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:50 smithi070 ceph-mon[99513]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:50.591 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:50 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:50.591 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:50 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:50.591 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:50 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:35:50.592 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:50 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:35:50.592 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:50 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:50.592 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:50 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:50.592 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:50 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:51.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:51 smithi070 ceph-mon[99513]: Updating smithi070:/etc/ceph/ceph.conf 2023-10-08T08:35:51.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:51 smithi070 ceph-mon[99513]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:35:51.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:51 smithi070 ceph-mon[99513]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:35:51.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:51 smithi070 ceph-mon[99513]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:35:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:52 smithi070 ceph-mon[99513]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi105", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:35:53.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:53 smithi070 ceph-mon[99513]: Deploying cephadm binary to smithi105 2023-10-08T08:35:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi105' with addr '172.21.15.105' 2023-10-08T08:35:54.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T08:35:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:35:55.438 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:55 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:55.439 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:55 smithi070 ceph-mon[99513]: Added host smithi105 2023-10-08T08:35:55.439 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:55 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:35:55.439 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:55 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:56 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:35:56.584 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.105", "hostname": "smithi105", "labels": [], "status": ""}] 2023-10-08T08:35:57.060 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi191 2023-10-08T08:35:57.060 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:35:57.060 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.conf 2023-10-08T08:35:57.081 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:35:57.081 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:35:57.140 INFO:tasks.cephadm:Adding host smithi191 to orchestrator... 2023-10-08T08:35:57.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi191 2023-10-08T08:35:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:35:57.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:57 smithi070 ceph-mon[99513]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:35:57.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:57 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:35:58.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:58 smithi070 ceph-mon[99513]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:35:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:35:59 smithi070 ceph-mon[99513]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:00.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:00 smithi070 ceph-mon[99513]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:36:00.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:00 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:00.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:00 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:00.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:00 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:00.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:00 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:00.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:00 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:00.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:00 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:00.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:00 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:01.513 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi191' with addr '172.21.15.191' 2023-10-08T08:36:01.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:01 smithi070 ceph-mon[99513]: Updating smithi105:/etc/ceph/ceph.conf 2023-10-08T08:36:01.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:01 smithi070 ceph-mon[99513]: Deploying cephadm binary to smithi191 2023-10-08T08:36:01.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:01 smithi070 ceph-mon[99513]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:01.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:01 smithi070 ceph-mon[99513]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:01.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:01 smithi070 ceph-mon[99513]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:01.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T08:36:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:02.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:02 smithi070 ceph-mon[99513]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:02.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:02 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:02.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:02 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:02.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:02 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:02.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:02 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:02.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:02 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:02.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:02 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:03.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:03 smithi070 ceph-mon[99513]: Added host smithi191 2023-10-08T08:36:03.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:03 smithi070 ceph-mon[99513]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:03.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:03 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:03.848 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:36:03.848 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.105", "hostname": "smithi105", "labels": [], "status": ""}, {"addr": "172.21.15.191", "hostname": "smithi191", "labels": [], "status": ""}] 2023-10-08T08:36:04.173 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-08T08:36:04.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd crush tunables default 2023-10-08T08:36:04.731 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:05.173 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:04 smithi070 ceph-mon[99513]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:36:05.173 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:04 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:05.174 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:04 smithi070 ceph-mon[99513]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:07.053 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2023-10-08T08:36:07.412 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:07 smithi070 ceph-mon[99513]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:07.412 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:07 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/92575849' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T08:36:07.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:07 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:07.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:07 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:07.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:07 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:07.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:07 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:07.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:07 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:07.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:07 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:07.413 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:07 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:07.474 INFO:tasks.cephadm:Adding mon.a on smithi070 2023-10-08T08:36:07.474 INFO:tasks.cephadm:Adding mon.b on smithi105 2023-10-08T08:36:07.474 INFO:tasks.cephadm:Adding mon.c on smithi191 2023-10-08T08:36:07.475 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch apply mon '3;smithi070:172.21.15.70=a;smithi105:172.21.15.105=b;smithi191:172.21.15.191=c' 2023-10-08T08:36:07.965 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:08.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:08 smithi070 ceph-mon[99513]: Updating smithi191:/etc/ceph/ceph.conf 2023-10-08T08:36:08.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:08 smithi070 ceph-mon[99513]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:08.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:08 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/92575849' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T08:36:08.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:08 smithi070 ceph-mon[99513]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:08.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:08 smithi070 ceph-mon[99513]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:08.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:08 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:08.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:08 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:08.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:08 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:09.405 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mon update... 2023-10-08T08:36:09.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:09 smithi070 ceph-mon[99513]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:09.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:09 smithi070 ceph-mon[99513]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:09.846 DEBUG:teuthology.orchestra.run.smithi105:mon.b> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.b.service 2023-10-08T08:36:09.848 DEBUG:teuthology.orchestra.run.smithi191:mon.c> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.c.service 2023-10-08T08:36:09.850 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T08:36:09.850 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T08:36:09.881 INFO:journalctl@ceph.mon.c.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:36:09.883 INFO:journalctl@ceph.mon.b.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:36:10.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi105:172.21.15.105=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:36:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi105:172.21.15.105=b;smithi191:172.21.15.191=c;count:3 2023-10-08T08:36:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: Deploying daemon mon.c on smithi191 2023-10-08T08:36:10.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:10 smithi070 ceph-mon[99513]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:10.931 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:12.369 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 systemd[1]: Starting Ceph mon.c for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:36:12.870 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:36:12.870 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","modified":"2023-10-08T08:34:37.471567Z","created":"2023-10-08T08:34:37.471567Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-08T08:36:12.872 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2023-10-08T08:36:13.002 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 podman[104176]: 2023-10-08T08:36:13.002 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T08:36:13.002 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: pidfile_write: ignore empty --pid-file 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: load: jerasure load: lrc 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: RocksDB version: 7.9.2 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Git sha 0 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: DB SUMMARY 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: DB Session ID: 9JCZ06GT4T2ZL78IPXE7 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: CURRENT file: CURRENT 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T08:36:13.003 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.error_if_exists: 0 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.create_if_missing: 0 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.paranoid_checks: 1 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.env: 0x5612daa83da0 2023-10-08T08:36:13.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.info_log: 0x5612dcb2d640 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.statistics: (nil) 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.use_fsync: 0 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_log_file_size: 0 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.allow_fallocate: 1 2023-10-08T08:36:13.005 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T08:36:13.006 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T08:36:13.006 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.use_direct_reads: 0 2023-10-08T08:36:13.006 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T08:36:13.006 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T08:36:13.006 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.db_log_dir: 2023-10-08T08:36:13.006 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.wal_dir: 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.write_buffer_manager: 0x5612dcae5360 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T08:36:13.008 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.unordered_write: 0 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.row_cache: None 2023-10-08T08:36:13.009 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.wal_filter: None 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.two_write_queues: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.wal_compression: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.atomic_flush: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.log_readahead_size: 0 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T08:36:13.010 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_background_jobs: 2 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_background_compactions: -1 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_subcompactions: 1 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T08:36:13.011 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_open_files: -1 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_background_flushes: -1 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Compression algorithms supported: 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T08:36:13.012 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: kZSTD supported: 0 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: kXpressCompression supported: 0 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: kZlibCompression supported: 1 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: kSnappyCompression supported: 1 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: kLZ4Compression supported: 1 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: kBZip2Compression supported: 0 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.merge_operator: 2023-10-08T08:36:13.013 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_filter: None 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5612dcb2d740) 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout: cache_index_and_filter_blocks: 1 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout: pin_top_level_index_and_filter: 1 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout: index_type: 0 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout: data_block_index_type: 0 2023-10-08T08:36:13.014 INFO:journalctl@ceph.mon.c.smithi191.stdout: index_shortening: 1 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: checksum: 4 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: no_block_cache: 0 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_cache: 0x5612dcb831f0 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_cache_name: BinnedLRUCache 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_cache_options: 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: capacity : 536870912 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: num_shard_bits : 4 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: strict_capacity_limit : 0 2023-10-08T08:36:13.015 INFO:journalctl@ceph.mon.c.smithi191.stdout: high_pri_pool_ratio: 0.000 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_cache_compressed: (nil) 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: persistent_cache: (nil) 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_size: 4096 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_size_deviation: 10 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_restart_interval: 16 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: index_block_restart_interval: 1 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: metadata_block_size: 4096 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: partition_filters: 0 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: use_delta_encoding: 1 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: filter_policy: bloomfilter 2023-10-08T08:36:13.016 INFO:journalctl@ceph.mon.c.smithi191.stdout: whole_key_filtering: 1 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout: verify_compression: 0 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout: read_amp_bytes_per_bit: 0 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout: format_version: 5 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout: enable_index_compression: 1 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_align: 0 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout: max_auto_readahead_size: 262144 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout: prepopulate_block_cache: 0 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout: initial_auto_readahead_size: 8192 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T08:36:13.017 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T08:36:13.018 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T08:36:13.018 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression: NoCompression 2023-10-08T08:36:13.018 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T08:36:13.018 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T08:36:13.018 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T08:36:13.018 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.num_levels: 7 2023-10-08T08:36:13.018 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T08:36:13.018 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T08:36:13.019 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T08:36:13.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T08:36:13.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T08:36:13.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T08:36:13.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T08:36:13.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T08:36:13.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T08:36:13.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T08:36:13.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T08:36:13.020 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T08:36:13.021 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T08:36:13.022 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T08:36:13.022 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T08:36:13.022 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T08:36:13.022 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T08:36:13.022 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T08:36:13.022 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T08:36:13.022 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T08:36:13.022 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T08:36:13.022 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T08:36:13.023 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.table_properties_collectors: 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.inplace_update_support: 0 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.bloom_locality: 0 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.max_successive_merges: 0 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T08:36:13.024 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T08:36:13.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T08:36:13.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.ttl: 2592000 2023-10-08T08:36:13.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T08:36:13.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T08:36:13.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T08:36:13.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.enable_blob_files: false 2023-10-08T08:36:13.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.min_blob_size: 0 2023-10-08T08:36:13.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T08:36:13.025 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 93ee0bbd-ada8-4668-9d76-cd485c204264 2023-10-08T08:36:13.026 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696754172958403, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T08:36:13.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T08:36:13.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696754172959009, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696754172, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "93ee0bbd-ada8-4668-9d76-cd485c204264", "db_session_id": "9JCZ06GT4T2ZL78IPXE7", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T08:36:13.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696754172959120, "job": 1, "event": "recovery_finished"} 2023-10-08T08:36:13.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T08:36:13.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T08:36:13.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5612dcc20000 2023-10-08T08:36:13.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: DB pointer 0x5612dcc0c000 2023-10-08T08:36:13.027 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout: ** DB Stats ** 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T08:36:13.028 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: ** Compaction Stats [default] ** 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: ** Compaction Stats [default] ** 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T08:36:13.029 INFO:journalctl@ceph.mon.c.smithi191.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T08:36:13.030 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2023-10-08T08:36:13.030 INFO:journalctl@ceph.mon.c.smithi191.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T08:36:13.030 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2023-10-08T08:36:13.030 INFO:journalctl@ceph.mon.c.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T08:36:13.030 INFO:journalctl@ceph.mon.c.smithi191.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T08:36:13.030 INFO:journalctl@ceph.mon.c.smithi191.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T08:36:13.030 INFO:journalctl@ceph.mon.c.smithi191.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T08:36:13.031 INFO:journalctl@ceph.mon.c.smithi191.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T08:36:13.031 INFO:journalctl@ceph.mon.c.smithi191.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T08:36:13.031 INFO:journalctl@ceph.mon.c.smithi191.stdout: Cumulative compaction: 0.00 GB write, 0.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T08:36:13.031 INFO:journalctl@ceph.mon.c.smithi191.stdout: Interval compaction: 0.00 GB write, 0.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T08:36:13.031 INFO:journalctl@ceph.mon.c.smithi191.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T08:36:13.031 INFO:journalctl@ceph.mon.c.smithi191.stdout: Block cache BinnedLRUCache@0x5612dcb831f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-10-08T08:36:13.031 INFO:journalctl@ceph.mon.c.smithi191.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T08:36:13.031 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2023-10-08T08:36:13.031 INFO:journalctl@ceph.mon.c.smithi191.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: using public_addr v2:172.21.15.191:0/0 -> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: starting mon.c rank -1 at public addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] at bind addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(???) e0 preinit fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).mds e1 new map 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout: e1 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout: legacy client fscid: -1 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout: No filesystems configured 2023-10-08T08:36:13.032 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:36:13.033 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Updating smithi105:/etc/ceph/ceph.conf 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Deploying cephadm binary to smithi191 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Added host smithi191 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:36:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/92575849' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Updating smithi191:/etc/ceph/ceph.conf 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/92575849' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi105:172.21.15.105=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi105:172.21.15.105=b;smithi191:172.21.15.191=c;count:3 2023-10-08T08:36:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: Deploying daemon mon.c on smithi191 2023-10-08T08:36:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:12 smithi191 ceph-mon[104220]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T08:36:13.268 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:13 smithi191 bash[104176]: 029a1ca63d3ef16696dd1f666ec0c4c5e4e8d5bd113bdd58c7787c5c32df9819 2023-10-08T08:36:13.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:13 smithi191 systemd[1]: Started Ceph mon.c for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:36:14.356 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T08:36:14.357 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T08:36:14.927 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:36:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:36:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: mon.a calling monitor election 2023-10-08T08:36:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: mon.c calling monitor election 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: monmap e2: 2 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: fsmap 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: mgrmap e13: x(active, since 42s) 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: overall HEALTH_OK 2023-10-08T08:36:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:18.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:18.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:18.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:18.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:18 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: mon.a calling monitor election 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: mon.c calling monitor election 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: monmap e2: 2 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: fsmap 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: mgrmap e13: x(active, since 42s) 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: overall HEALTH_OK 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:18.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:18 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:19.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:19 smithi070 ceph-mon[99513]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:19 smithi070 ceph-mon[99513]: Deploying daemon mon.b on smithi105 2023-10-08T08:36:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:19 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:19.532 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:36:19.533 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","modified":"2023-10-08T08:36:12.985744Z","created":"2023-10-08T08:34:37.471567Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T08:36:19.535 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2023-10-08T08:36:19.553 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:19 smithi191 ceph-mon[104220]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:19.554 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:19 smithi191 ceph-mon[104220]: Deploying daemon mon.b on smithi105 2023-10-08T08:36:19.554 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:19 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:20.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:20 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/1908907987' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T08:36:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:20 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/1908907987' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T08:36:20.913 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:20 smithi105 systemd[1]: Starting Ceph mon.b for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:36:20.982 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T08:36:20.982 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T08:36:21.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:20 smithi105 podman[103759]: 2023-10-08T08:36:21.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 bash[103759]: a49747bf2ca691ccf8339baeea2c10e2e36e6fda1330ad266456f1a819302731 2023-10-08T08:36:21.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T08:36:21.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T08:36:21.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pidfile_write: ignore empty --pid-file 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: load: jerasure load: lrc 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: RocksDB version: 7.9.2 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Git sha 0 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: DB SUMMARY 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: DB Session ID: TUW974GPDKYYP1Y0ZKV7 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: CURRENT file: CURRENT 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-08T08:36:21.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.error_if_exists: 0 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.create_if_missing: 0 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.paranoid_checks: 1 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.env: 0x561a0250eda0 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.info_log: 0x561a034ab640 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T08:36:21.273 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.statistics: (nil) 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.use_fsync: 0 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_log_file_size: 0 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.allow_fallocate: 1 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.use_direct_reads: 0 2023-10-08T08:36:21.274 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T08:36:21.275 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T08:36:21.275 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.db_log_dir: 2023-10-08T08:36:21.276 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.wal_dir: 2023-10-08T08:36:21.276 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.write_buffer_manager: 0x561a03463360 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T08:36:21.277 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.unordered_write: 0 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T08:36:21.278 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.row_cache: None 2023-10-08T08:36:21.279 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.wal_filter: None 2023-10-08T08:36:21.279 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T08:36:21.279 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T08:36:21.279 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.two_write_queues: 0 2023-10-08T08:36:21.279 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T08:36:21.279 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.wal_compression: 0 2023-10-08T08:36:21.279 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.atomic_flush: 0 2023-10-08T08:36:21.279 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T08:36:21.280 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T08:36:21.280 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T08:36:21.280 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.log_readahead_size: 0 2023-10-08T08:36:21.280 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T08:36:21.280 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T08:36:21.280 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T08:36:21.280 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T08:36:21.280 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T08:36:21.280 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_background_jobs: 2 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_background_compactions: -1 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_subcompactions: 1 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T08:36:21.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T08:36:21.282 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_open_files: -1 2023-10-08T08:36:21.282 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T08:36:21.282 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T08:36:21.282 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T08:36:21.282 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T08:36:21.282 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_background_flushes: -1 2023-10-08T08:36:21.282 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Compression algorithms supported: 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: kZSTD supported: 0 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: kXpressCompression supported: 0 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: kZlibCompression supported: 1 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: kSnappyCompression supported: 1 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: kLZ4Compression supported: 1 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: kBZip2Compression supported: 0 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T08:36:21.283 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.merge_operator: 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_filter: None 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561a034ab740) 2023-10-08T08:36:21.284 INFO:journalctl@ceph.mon.b.smithi105.stdout: cache_index_and_filter_blocks: 1 2023-10-08T08:36:21.285 INFO:journalctl@ceph.mon.b.smithi105.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T08:36:21.285 INFO:journalctl@ceph.mon.b.smithi105.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T08:36:21.285 INFO:journalctl@ceph.mon.b.smithi105.stdout: pin_top_level_index_and_filter: 1 2023-10-08T08:36:21.285 INFO:journalctl@ceph.mon.b.smithi105.stdout: index_type: 0 2023-10-08T08:36:21.285 INFO:journalctl@ceph.mon.b.smithi105.stdout: data_block_index_type: 0 2023-10-08T08:36:21.285 INFO:journalctl@ceph.mon.b.smithi105.stdout: index_shortening: 1 2023-10-08T08:36:21.285 INFO:journalctl@ceph.mon.b.smithi105.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T08:36:21.285 INFO:journalctl@ceph.mon.b.smithi105.stdout: checksum: 4 2023-10-08T08:36:21.285 INFO:journalctl@ceph.mon.b.smithi105.stdout: no_block_cache: 0 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_cache: 0x561a035011f0 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_cache_name: BinnedLRUCache 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_cache_options: 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: capacity : 536870912 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: num_shard_bits : 4 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: strict_capacity_limit : 0 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: high_pri_pool_ratio: 0.000 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_cache_compressed: (nil) 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: persistent_cache: (nil) 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_size: 4096 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_size_deviation: 10 2023-10-08T08:36:21.286 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_restart_interval: 16 2023-10-08T08:36:21.287 INFO:journalctl@ceph.mon.b.smithi105.stdout: index_block_restart_interval: 1 2023-10-08T08:36:21.287 INFO:journalctl@ceph.mon.b.smithi105.stdout: metadata_block_size: 4096 2023-10-08T08:36:21.287 INFO:journalctl@ceph.mon.b.smithi105.stdout: partition_filters: 0 2023-10-08T08:36:21.287 INFO:journalctl@ceph.mon.b.smithi105.stdout: use_delta_encoding: 1 2023-10-08T08:36:21.287 INFO:journalctl@ceph.mon.b.smithi105.stdout: filter_policy: bloomfilter 2023-10-08T08:36:21.287 INFO:journalctl@ceph.mon.b.smithi105.stdout: whole_key_filtering: 1 2023-10-08T08:36:21.287 INFO:journalctl@ceph.mon.b.smithi105.stdout: verify_compression: 0 2023-10-08T08:36:21.287 INFO:journalctl@ceph.mon.b.smithi105.stdout: read_amp_bytes_per_bit: 0 2023-10-08T08:36:21.287 INFO:journalctl@ceph.mon.b.smithi105.stdout: format_version: 5 2023-10-08T08:36:21.288 INFO:journalctl@ceph.mon.b.smithi105.stdout: enable_index_compression: 1 2023-10-08T08:36:21.288 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_align: 0 2023-10-08T08:36:21.288 INFO:journalctl@ceph.mon.b.smithi105.stdout: max_auto_readahead_size: 262144 2023-10-08T08:36:21.288 INFO:journalctl@ceph.mon.b.smithi105.stdout: prepopulate_block_cache: 0 2023-10-08T08:36:21.288 INFO:journalctl@ceph.mon.b.smithi105.stdout: initial_auto_readahead_size: 8192 2023-10-08T08:36:21.288 INFO:journalctl@ceph.mon.b.smithi105.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T08:36:21.288 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T08:36:21.288 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression: NoCompression 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.num_levels: 7 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T08:36:21.289 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T08:36:21.290 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T08:36:21.290 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T08:36:21.290 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T08:36:21.290 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T08:36:21.290 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T08:36:21.290 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T08:36:21.290 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T08:36:21.290 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T08:36:21.290 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T08:36:21.291 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T08:36:21.291 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T08:36:21.291 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T08:36:21.291 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T08:36:21.291 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T08:36:21.291 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T08:36:21.291 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T08:36:21.291 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T08:36:21.291 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T08:36:21.292 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T08:36:21.292 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T08:36:21.292 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T08:36:21.292 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T08:36:21.292 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T08:36:21.292 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T08:36:21.292 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T08:36:21.292 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T08:36:21.293 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T08:36:21.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T08:36:21.295 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T08:36:21.295 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T08:36:21.295 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.table_properties_collectors: 2023-10-08T08:36:21.295 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.inplace_update_support: 0 2023-10-08T08:36:21.295 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T08:36:21.295 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T08:36:21.295 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T08:36:21.295 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T08:36:21.296 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.bloom_locality: 0 2023-10-08T08:36:21.296 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.max_successive_merges: 0 2023-10-08T08:36:21.296 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T08:36:21.296 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T08:36:21.296 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T08:36:21.296 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T08:36:21.296 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.ttl: 2592000 2023-10-08T08:36:21.296 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T08:36:21.296 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T08:36:21.297 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T08:36:21.297 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.enable_blob_files: false 2023-10-08T08:36:21.297 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.min_blob_size: 0 2023-10-08T08:36:21.297 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T08:36:21.297 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T08:36:21.297 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T08:36:21.297 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T08:36:21.297 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T08:36:21.297 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T08:36:21.298 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T08:36:21.298 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T08:36:21.298 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T08:36:21.298 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T08:36:21.298 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bf65bd49-5fb7-4dcf-b400-dc5a95883659 2023-10-08T08:36:21.298 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696754181109350, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T08:36:21.299 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T08:36:21.299 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696754181109781, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696754181, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bf65bd49-5fb7-4dcf-b400-dc5a95883659", "db_session_id": "TUW974GPDKYYP1Y0ZKV7", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T08:36:21.299 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696754181109848, "job": 1, "event": "recovery_finished"} 2023-10-08T08:36:21.299 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T08:36:21.299 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T08:36:21.299 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561a0359e000 2023-10-08T08:36:21.299 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: DB pointer 0x561a0358a000 2023-10-08T08:36:21.300 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T08:36:21.300 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T08:36:21.300 INFO:journalctl@ceph.mon.b.smithi105.stdout: ** DB Stats ** 2023-10-08T08:36:21.300 INFO:journalctl@ceph.mon.b.smithi105.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T08:36:21.300 INFO:journalctl@ceph.mon.b.smithi105.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T08:36:21.300 INFO:journalctl@ceph.mon.b.smithi105.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T08:36:21.301 INFO:journalctl@ceph.mon.b.smithi105.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T08:36:21.301 INFO:journalctl@ceph.mon.b.smithi105.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T08:36:21.301 INFO:journalctl@ceph.mon.b.smithi105.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T08:36:21.301 INFO:journalctl@ceph.mon.b.smithi105.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T08:36:21.301 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2023-10-08T08:36:21.301 INFO:journalctl@ceph.mon.b.smithi105.stdout: ** Compaction Stats [default] ** 2023-10-08T08:36:21.301 INFO:journalctl@ceph.mon.b.smithi105.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T08:36:21.301 INFO:journalctl@ceph.mon.b.smithi105.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T08:36:21.302 INFO:journalctl@ceph.mon.b.smithi105.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T08:36:21.302 INFO:journalctl@ceph.mon.b.smithi105.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T08:36:21.302 INFO:journalctl@ceph.mon.b.smithi105.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T08:36:21.302 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2023-10-08T08:36:21.302 INFO:journalctl@ceph.mon.b.smithi105.stdout: ** Compaction Stats [default] ** 2023-10-08T08:36:21.302 INFO:journalctl@ceph.mon.b.smithi105.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T08:36:21.302 INFO:journalctl@ceph.mon.b.smithi105.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T08:36:21.302 INFO:journalctl@ceph.mon.b.smithi105.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T08:36:21.302 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2023-10-08T08:36:21.303 INFO:journalctl@ceph.mon.b.smithi105.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T08:36:21.303 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2023-10-08T08:36:21.303 INFO:journalctl@ceph.mon.b.smithi105.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T08:36:21.303 INFO:journalctl@ceph.mon.b.smithi105.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T08:36:21.303 INFO:journalctl@ceph.mon.b.smithi105.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T08:36:21.303 INFO:journalctl@ceph.mon.b.smithi105.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T08:36:21.303 INFO:journalctl@ceph.mon.b.smithi105.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T08:36:21.303 INFO:journalctl@ceph.mon.b.smithi105.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T08:36:21.303 INFO:journalctl@ceph.mon.b.smithi105.stdout: Cumulative compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T08:36:21.304 INFO:journalctl@ceph.mon.b.smithi105.stdout: Interval compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T08:36:21.304 INFO:journalctl@ceph.mon.b.smithi105.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T08:36:21.304 INFO:journalctl@ceph.mon.b.smithi105.stdout: Block cache BinnedLRUCache@0x561a035011f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-10-08T08:36:21.304 INFO:journalctl@ceph.mon.b.smithi105.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T08:36:21.304 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2023-10-08T08:36:21.304 INFO:journalctl@ceph.mon.b.smithi105.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T08:36:21.304 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-08T08:36:21.304 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 systemd[1]: Started Ceph mon.b for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:36:21.304 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: using public_addr v2:172.21.15.105:0/0 -> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] 2023-10-08T08:36:21.305 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: starting mon.b rank -1 at public addrs [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] at bind addrs [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:36:21.305 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(???) e0 preinit fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:36:21.305 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).mds e1 new map 2023-10-08T08:36:21.305 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-08T08:36:21.305 INFO:journalctl@ceph.mon.b.smithi105.stdout: e1 2023-10-08T08:36:21.305 INFO:journalctl@ceph.mon.b.smithi105.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T08:36:21.305 INFO:journalctl@ceph.mon.b.smithi105.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T08:36:21.305 INFO:journalctl@ceph.mon.b.smithi105.stdout: legacy client fscid: -1 2023-10-08T08:36:21.305 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2023-10-08T08:36:21.306 INFO:journalctl@ceph.mon.b.smithi105.stdout: No filesystems configured 2023-10-08T08:36:21.306 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T08:36:21.306 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T08:36:21.306 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T08:36:21.306 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T08:36:21.306 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T08:36:21.306 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T08:36:21.306 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T08:36:21.306 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:21.307 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Updating smithi105:/etc/ceph/ceph.conf 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Deploying cephadm binary to smithi191 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.308 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Added host smithi191 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/92575849' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Updating smithi191:/etc/ceph/ceph.conf 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/92575849' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.310 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.311 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.311 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:21.311 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.311 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi105:172.21.15.105=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:36:21.311 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi105:172.21.15.105=b;smithi191:172.21.15.191=c;count:3 2023-10-08T08:36:21.311 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.311 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:21.311 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Deploying daemon mon.c on smithi191 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.a calling monitor election 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.312 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:21.313 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.c calling monitor election 2023-10-08T08:36:21.313 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:21.313 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.313 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:21.313 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:21.313 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T08:36:21.313 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: monmap e2: 2 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} 2023-10-08T08:36:21.313 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: fsmap 2023-10-08T08:36:21.313 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:21.314 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mgrmap e13: x(active, since 42s) 2023-10-08T08:36:21.314 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: overall HEALTH_OK 2023-10-08T08:36:21.314 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.314 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.314 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:21.314 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:21.314 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:21.314 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.314 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: Deploying daemon mon.b on smithi105 2023-10-08T08:36:21.315 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:21.315 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/1908907987' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T08:36:21.315 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.315 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:21 smithi105 ceph-mon[103798]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T08:36:21.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:21 smithi191 ceph-mon[104220]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:21 smithi070 ceph-mon[99513]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:21.550 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:36:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:36:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: mon.c calling monitor election 2023-10-08T08:36:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: mon.a calling monitor election 2023-10-08T08:36:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: monmap e3: 3 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0],b=[v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: fsmap 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: mgrmap e13: x(active, since 50s) 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T08:36:26.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T08:36:26.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T08:36:26.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: mon.b (rank 2) addr [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] is down (out of quorum) 2023-10-08T08:36:26.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:26.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:26.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:26 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:26.663 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-08T08:36:26.663 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":3,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","modified":"2023-10-08T08:36:21.140230Z","created":"2023-10-08T08:34:37.471567Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T08:36:26.666 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 3 2023-10-08T08:36:26.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:36:26.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: mon.c calling monitor election 2023-10-08T08:36:26.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: mon.a calling monitor election 2023-10-08T08:36:26.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:26.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:26.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:26.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:26.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T08:36:26.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: monmap e3: 3 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0],b=[v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} 2023-10-08T08:36:26.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: fsmap 2023-10-08T08:36:26.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:26.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: mgrmap e13: x(active, since 50s) 2023-10-08T08:36:26.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T08:36:26.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T08:36:26.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T08:36:26.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: mon.b (rank 2) addr [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] is down (out of quorum) 2023-10-08T08:36:26.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:26.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:26.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:26 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:27.123 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-08T08:36:27.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-08T08:36:27.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:27 smithi070 ceph-mon[99513]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:27.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:27 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:27.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:27 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:27.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:27 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/1272630338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T08:36:27.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:27 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:27.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:27 smithi191 ceph-mon[104220]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:27.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:27 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:27.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:27 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:27.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:27 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/1272630338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T08:36:27.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:27 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:27.700 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:28.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: mon.c calling monitor election 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: mon.a calling monitor election 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: monmap e3: 3 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0],b=[v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: fsmap 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: mgrmap e13: x(active, since 50s) 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: mon.b (rank 2) addr [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] is down (out of quorum) 2023-10-08T08:36:28.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:28.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:28.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:28.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:28.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:28.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:28.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/1272630338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T08:36:28.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:28 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:29.074 INFO:teuthology.orchestra.run.smithi070.stdout:# minimal ceph.conf for 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:36:29.074 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2023-10-08T08:36:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:36:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: mon_host = [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: mon.b calling monitor election 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: Updating smithi070:/etc/ceph/ceph.conf 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: Updating smithi105:/etc/ceph/ceph.conf 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: Updating smithi191:/etc/ceph/ceph.conf 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: mon.b calling monitor election 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: mon.c calling monitor election 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: mon.a calling monitor election 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T08:36:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: monmap e3: 3 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0],b=[v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: fsmap 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: mgrmap e13: x(active, since 52s) 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: Cluster is now healthy 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: overall HEALTH_OK 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:29.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:29 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1780663276' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:29.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: mon.b calling monitor election 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: Updating smithi070:/etc/ceph/ceph.conf 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: Updating smithi105:/etc/ceph/ceph.conf 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: Updating smithi191:/etc/ceph/ceph.conf 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: mon.b calling monitor election 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: mon.c calling monitor election 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: mon.a calling monitor election 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: monmap e3: 3 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0],b=[v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} 2023-10-08T08:36:29.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: fsmap 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: mgrmap e13: x(active, since 52s) 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: Cluster is now healthy 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: overall HEALTH_OK 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:29.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:29.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:29.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:29 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1780663276' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:29.490 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-08T08:36:29.490 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:36:29.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T08:36:29.521 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:36:29.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: mon.b calling monitor election 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: Updating smithi070:/etc/ceph/ceph.conf 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: Updating smithi105:/etc/ceph/ceph.conf 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: Updating smithi191:/etc/ceph/ceph.conf 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: mon.b calling monitor election 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: mon.c calling monitor election 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: mon.a calling monitor election 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T08:36:29.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: monmap e3: 3 mons at {a=[v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0],b=[v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: fsmap 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: mgrmap e13: x(active, since 52s) 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: Cluster is now healthy 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: overall HEALTH_OK 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:29.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:29.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:29.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:29.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:29 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1780663276' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:29.590 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:36:29.590 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T08:36:29.621 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:36:29.621 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:29.688 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:36:29.688 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T08:36:29.724 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:36:29.724 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:29.795 INFO:tasks.cephadm:enabling module snap_schedule 2023-10-08T08:36:29.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T08:36:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:30.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:30 smithi070 ceph-mon[99513]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:30.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:30 smithi070 ceph-mon[99513]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:30.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:30 smithi070 ceph-mon[99513]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:30.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:30 smithi070 ceph-mon[99513]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T08:36:30.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:30 smithi070 ceph-mon[99513]: Reconfiguring daemon mon.a on smithi070 2023-10-08T08:36:30.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:30 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:30 smithi105 ceph-mon[103798]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:30 smithi105 ceph-mon[103798]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:30.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:30 smithi105 ceph-mon[103798]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:30.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:30 smithi105 ceph-mon[103798]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T08:36:30.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:30 smithi105 ceph-mon[103798]: Reconfiguring daemon mon.a on smithi070 2023-10-08T08:36:30.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:30 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:30 smithi191 ceph-mon[104220]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:30 smithi191 ceph-mon[104220]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:30 smithi191 ceph-mon[104220]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:30 smithi191 ceph-mon[104220]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T08:36:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:30 smithi191 ceph-mon[104220]: Reconfiguring daemon mon.a on smithi070 2023-10-08T08:36:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:30 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:31.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:31 smithi070 ceph-mon[99513]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:31 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:31 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:31 smithi070 ceph-mon[99513]: Reconfiguring mon.b (monmap changed)... 2023-10-08T08:36:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:31 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:31 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:31 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:31 smithi070 ceph-mon[99513]: Reconfiguring daemon mon.b on smithi105 2023-10-08T08:36:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:31 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:31.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:31 smithi105 ceph-mon[103798]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:31 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:31 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:31 smithi105 ceph-mon[103798]: Reconfiguring mon.b (monmap changed)... 2023-10-08T08:36:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:31 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:31 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:31 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:31 smithi105 ceph-mon[103798]: Reconfiguring daemon mon.b on smithi105 2023-10-08T08:36:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:31 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:31.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:31 smithi191 ceph-mon[104220]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:31.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:31 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:31.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:31 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:31 smithi191 ceph-mon[104220]: Reconfiguring mon.b (monmap changed)... 2023-10-08T08:36:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:31 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:31 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:31 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:31 smithi191 ceph-mon[104220]: Reconfiguring daemon mon.b on smithi105 2023-10-08T08:36:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:31 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:32 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:32 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:32 smithi191 ceph-mon[104220]: Reconfiguring mon.c (monmap changed)... 2023-10-08T08:36:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:32 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:32 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:32 smithi191 ceph-mon[104220]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:32 smithi191 ceph-mon[104220]: Reconfiguring daemon mon.c on smithi191 2023-10-08T08:36:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:32 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1304223090' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T08:36:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:32 smithi191 ceph-mon[104220]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:32.602 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: ignoring --setuser ceph since I am not root 2023-10-08T08:36:32.602 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: ignoring --setgroup ceph since I am not root 2023-10-08T08:36:32.602 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:32.520+0000 7f514cbb0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T08:36:32.602 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:32.601+0000 7f514cbb0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T08:36:32.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:32.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:32.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-mon[99513]: Reconfiguring mon.c (monmap changed)... 2023-10-08T08:36:32.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:32.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:32.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-mon[99513]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:32.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-mon[99513]: Reconfiguring daemon mon.c on smithi191 2023-10-08T08:36:32.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1304223090' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T08:36:32.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-mon[99513]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:32.697 INFO:tasks.cephadm:Adding mgr.x on smithi070 2023-10-08T08:36:32.697 INFO:tasks.cephadm:Adding mgr.y on smithi105 2023-10-08T08:36:32.697 INFO:tasks.cephadm:Adding mgr.z on smithi191 2023-10-08T08:36:32.697 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch apply mgr '3;smithi070=x;smithi105=y;smithi191=z' 2023-10-08T08:36:32.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:32 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:32.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:32 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' 2023-10-08T08:36:32.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:32 smithi105 ceph-mon[103798]: Reconfiguring mon.c (monmap changed)... 2023-10-08T08:36:32.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:32 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:32.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:32 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:32.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:32 smithi105 ceph-mon[103798]: from='mgr.14152 172.21.15.70:0/745202728' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:32.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:32 smithi105 ceph-mon[103798]: Reconfiguring daemon mon.c on smithi191 2023-10-08T08:36:32.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:32 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1304223090' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T08:36:32.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:32 smithi105 ceph-mon[103798]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:36:32.960 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:32.693+0000 7f514cbb0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T08:36:32.960 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:32.790+0000 7f514cbb0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T08:36:32.960 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:32.959+0000 7f514cbb0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T08:36:33.250 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:36:33.634 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:33 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1304223090' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T08:36:33.635 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:33 smithi070 ceph-mon[99513]: mgrmap e14: x(active, since 56s) 2023-10-08T08:36:33.635 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:33.319+0000 7f514cbb0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T08:36:33.635 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:33.451+0000 7f514cbb0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T08:36:33.635 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:33.539+0000 7f514cbb0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T08:36:33.638 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:33 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1304223090' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T08:36:33.638 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:33 smithi191 ceph-mon[104220]: mgrmap e14: x(active, since 56s) 2023-10-08T08:36:33.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:33 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1304223090' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T08:36:33.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:33 smithi105 ceph-mon[103798]: mgrmap e14: x(active, since 56s) 2023-10-08T08:36:34.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:33.633+0000 7f514cbb0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T08:36:34.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:34.052+0000 7f514cbb0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T08:36:34.970 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:34.700+0000 7f514cbb0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T08:36:34.970 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:34.782+0000 7f514cbb0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T08:36:35.819 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:35.549+0000 7f514cbb0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:36:35.819 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:35.641+0000 7f514cbb0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T08:36:36.104 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:35.818+0000 7f514cbb0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:36:36.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:36.103+0000 7f514cbb0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T08:36:36.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:36.328+0000 7f514cbb0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T08:36:36.745 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:36.477+0000 7f514cbb0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T08:36:37.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:36.744+0000 7f514cbb0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T08:36:37.720 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:37.446+0000 7f514cbb0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T08:36:37.721 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:37.577+0000 7f514cbb0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T08:36:38.110 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:37.775+0000 7f514cbb0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T08:36:38.110 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:37.890+0000 7f514cbb0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T08:36:38.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:38 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:38.109+0000 7f514cbb0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T08:36:39.220 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:36:38 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:36:38.966+0000 7f514cbb0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T08:36:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: Active manager daemon x restarted 2023-10-08T08:36:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: Activating manager daemon x 2023-10-08T08:36:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T08:36:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: mgrmap e15: x(active, starting, since 0.004192s) 2023-10-08T08:36:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:36:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T08:36:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T08:36:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T08:36:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T08:36:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: Manager daemon x is now available 2023-10-08T08:36:39.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:39.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:39.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: Active manager daemon x restarted 2023-10-08T08:36:39.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: Activating manager daemon x 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: mgrmap e15: x(active, starting, since 0.004192s) 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T08:36:39.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: Manager daemon x is now available 2023-10-08T08:36:39.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:39.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:39.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: Active manager daemon x restarted 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: Activating manager daemon x 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: mgrmap e15: x(active, starting, since 0.004192s) 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: Manager daemon x is now available 2023-10-08T08:36:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:39.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:40.004 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mgr update... 2023-10-08T08:36:40.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T08:36:40.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T08:36:40.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:40 smithi191 ceph-mon[104220]: mgrmap e16: x(active, since 1.01814s) 2023-10-08T08:36:40.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:40.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T08:36:40.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T08:36:40.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:40 smithi070 ceph-mon[99513]: mgrmap e16: x(active, since 1.01814s) 2023-10-08T08:36:40.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:40.519 DEBUG:teuthology.orchestra.run.smithi105:mgr.y> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.y.service 2023-10-08T08:36:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T08:36:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T08:36:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:40 smithi105 ceph-mon[103798]: mgrmap e16: x(active, since 1.01814s) 2023-10-08T08:36:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:40.522 DEBUG:teuthology.orchestra.run.smithi191:mgr.z> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.z.service 2023-10-08T08:36:40.525 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2023-10-08T08:36:40.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set client client_mount_timeout 600 2023-10-08T08:36:40.528 INFO:tasks.cephadm:setting config [client] debug_client = 20 2023-10-08T08:36:40.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set client debug_client 20 2023-10-08T08:36:40.551 INFO:journalctl@ceph.mgr.y.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:36:40.556 INFO:journalctl@ceph.mgr.z.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:36:40.570 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2023-10-08T08:36:40.571 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set client debug_ms 1 2023-10-08T08:36:40.614 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2023-10-08T08:36:40.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set client rados_mon_op_timeout 900 2023-10-08T08:36:40.656 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2023-10-08T08:36:40.657 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set client rados_osd_op_timeout 900 2023-10-08T08:36:40.700 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2023-10-08T08:36:40.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds 20 2023-10-08T08:36:40.742 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2023-10-08T08:36:40.743 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds_balancer 20 2023-10-08T08:36:40.785 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2023-10-08T08:36:40.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_ms 1 2023-10-08T08:36:40.829 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-08T08:36:40.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_fragment_size_max 10000 2023-10-08T08:36:40.874 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2023-10-08T08:36:40.875 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_merge_size 5 2023-10-08T08:36:40.946 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2023-10-08T08:36:40.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_bits 3 2023-10-08T08:36:40.992 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2023-10-08T08:36:40.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_size 100 2023-10-08T08:36:41.051 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2023-10-08T08:36:41.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_frag True 2023-10-08T08:36:41.096 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2023-10-08T08:36:41.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_scatterstat True 2023-10-08T08:36:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: [08/Oct/2023:08:36:39] ENGINE Bus STARTING 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: [08/Oct/2023:08:36:39] ENGINE Serving on http://172.21.15.70:8765 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: [08/Oct/2023:08:36:39] ENGINE Serving on https://172.21.15.70:7150 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: [08/Oct/2023:08:36:39] ENGINE Bus STARTED 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi105=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: Saving service mgr spec with placement smithi070=x;smithi105=y;smithi191=z;count:3 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:41 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.140 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2023-10-08T08:36:41.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_op_complaint_time 180 2023-10-08T08:36:41.184 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2023-10-08T08:36:41.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_verify_scatter True 2023-10-08T08:36:41.206 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:41.212 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2023-10-08T08:36:41.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds osd_op_complaint_time 180 2023-10-08T08:36:41.280 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2023-10-08T08:36:41.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_mon_op_timeout 900 2023-10-08T08:36:41.299 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:41.299 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2023-10-08T08:36:41.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_osd_op_timeout 900 2023-10-08T08:36:41.323 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:41.326 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2023-10-08T08:36:41.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mgr debug_cephsqlite 20 2023-10-08T08:36:41.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: [08/Oct/2023:08:36:39] ENGINE Bus STARTING 2023-10-08T08:36:41.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: [08/Oct/2023:08:36:39] ENGINE Serving on http://172.21.15.70:8765 2023-10-08T08:36:41.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: [08/Oct/2023:08:36:39] ENGINE Serving on https://172.21.15.70:7150 2023-10-08T08:36:41.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: [08/Oct/2023:08:36:39] ENGINE Bus STARTED 2023-10-08T08:36:41.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi105=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:36:41.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: Saving service mgr spec with placement smithi070=x;smithi105=y;smithi191=z;count:3 2023-10-08T08:36:41.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:41 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.371 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2023-10-08T08:36:41.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T08:36:41.460 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2023-10-08T08:36:41.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T08:36:41.512 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2023-10-08T08:36:41.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set mon mon_op_complaint_time 120 2023-10-08T08:36:41.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: [08/Oct/2023:08:36:39] ENGINE Bus STARTING 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: [08/Oct/2023:08:36:39] ENGINE Serving on http://172.21.15.70:8765 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: [08/Oct/2023:08:36:39] ENGINE Serving on https://172.21.15.70:7150 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: [08/Oct/2023:08:36:39] ENGINE Bus STARTED 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi105=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: Saving service mgr spec with placement smithi070=x;smithi105=y;smithi191=z;count:3 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:41 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:41.601 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2023-10-08T08:36:41.602 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config set osd osd_op_complaint_time 180 2023-10-08T08:36:41.646 DEBUG:tasks.cephadm:set 24 configs 2023-10-08T08:36:41.646 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi070') 2023-10-08T08:36:42.194 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:42.772 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:42.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:42.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:42.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:42.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:42.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:42.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:42 smithi070 ceph-mon[99513]: mgrmap e17: x(active, since 2s) 2023-10-08T08:36:43.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:43.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:43.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:42 smithi105 ceph-mon[103798]: mgrmap e17: x(active, since 2s) 2023-10-08T08:36:43.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:43.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:43.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:42 smithi191 ceph-mon[104220]: mgrmap e17: x(active, since 2s) 2023-10-08T08:36:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:43.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: Updating smithi070:/etc/ceph/ceph.conf 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: Updating smithi105:/etc/ceph/ceph.conf 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: Updating smithi191:/etc/ceph/ceph.conf 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:43.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:43 smithi070 ceph-mon[99513]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:44.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:44.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:44.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:44.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: Updating smithi070:/etc/ceph/ceph.conf 2023-10-08T08:36:44.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: Updating smithi105:/etc/ceph/ceph.conf 2023-10-08T08:36:44.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: Updating smithi191:/etc/ceph/ceph.conf 2023-10-08T08:36:44.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:44.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:44.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:44.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:44.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:44.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:43 smithi105 ceph-mon[103798]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:44.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: Updating smithi070:/etc/ceph/ceph.conf 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: Updating smithi105:/etc/ceph/ceph.conf 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: Updating smithi191:/etc/ceph/ceph.conf 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:44.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:43 smithi191 ceph-mon[104220]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2023-10-08T08:36:44.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:44.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:44.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:44.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:44.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T08:36:44.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T08:36:44.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T08:36:44.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:44.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: Deploying daemon mgr.z on smithi191 2023-10-08T08:36:44.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:44 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2435246010' entity='client.admin' 2023-10-08T08:36:45.063 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T08:36:45.064 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T08:36:45.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:45.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: Deploying daemon mgr.z on smithi191 2023-10-08T08:36:45.065 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:44 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2435246010' entity='client.admin' 2023-10-08T08:36:45.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: Updating smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: Updating smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: Updating smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:45.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T08:36:45.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T08:36:45.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T08:36:45.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:45.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: Deploying daemon mgr.z on smithi191 2023-10-08T08:36:45.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:44 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2435246010' entity='client.admin' 2023-10-08T08:36:45.345 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:45 smithi191 systemd[1]: Starting Ceph mgr.z for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:36:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 -- 172.21.15.70:0/2592851429 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2b54038b40 msgr2=0x7f2b5403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 --2- 172.21.15.70:0/2592851429 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2b54038b40 0x7f2b5403b000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0098a0 tx=0x7f2b5c005b90 comp rx=0 tx=0).stop 2023-10-08T08:36:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 -- 172.21.15.70:0/2592851429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b6c1000a0 msgr2=0x7f2b6c195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 --2- 172.21.15.70:0/2592851429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b6c1000a0 0x7f2b6c195720 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000b540 tx=0x7f2b6000b900 comp rx=0 tx=0).stop 2023-10-08T08:36:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 -- 172.21.15.70:0/2592851429 shutdown_connections 2023-10-08T08:36:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 --2- 172.21.15.70:0/2592851429 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2b54038b40 0x7f2b5403b000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 --2- 172.21.15.70:0/2592851429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b6c105730 0x7f2b6c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:45.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 --2- 172.21.15.70:0/2592851429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6c0ff6e0 0x7f2b6c1951e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 --2- 172.21.15.70:0/2592851429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b6c1000a0 0x7f2b6c195720 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 -- 172.21.15.70:0/2592851429 >> 172.21.15.70:0/2592851429 conn(0x7f2b6c0766f0 msgr2=0x7f2b6c0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 -- 172.21.15.70:0/2592851429 shutdown_connections 2023-10-08T08:36:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:45.419+0000 7f2b70fce700 1 -- 172.21.15.70:0/2592851429 wait complete. 2023-10-08T08:36:45.774 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:45.781 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:45.835 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:45 smithi191 podman[107233]: 2023-10-08T08:36:46.094 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:45 smithi191 bash[107233]: a80e5e0a988787728a52fb4ec442088720a23f628158d56dd7f110c7306ea96c 2023-10-08T08:36:46.094 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:45 smithi191 ceph-mgr[107272]: -- 172.21.15.191:0/4194126105 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5621688e71e0 con 0x5621688bcc00 2023-10-08T08:36:46.095 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:45 smithi191 systemd[1]: Started Ceph mgr.z for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:36:46.095 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:45 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:45.963+0000 7f6aba839200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T08:36:46.095 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:46.041+0000 7f6aba839200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T08:36:46.367 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:46.390 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:46.130+0000 7f6aba839200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T08:36:46.390 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:46.222+0000 7f6aba839200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T08:36:46.390 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:46.389+0000 7f6aba839200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T08:36:46.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.390+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2338067439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 msgr2=0x7f1e28100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.390+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2338067439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 0x7f1e28100720 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009990 tx=0x7f1e1c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.390+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2338067439 shutdown_connections 2023-10-08T08:36:46.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.390+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2338067439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e28100c60 0x7f1e2810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.390+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2338067439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e28104720 0x7f1e28104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.390+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2338067439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 0x7f1e28100720 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.390+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2338067439 >> 172.21.15.70:0/2338067439 conn(0x7f1e28074a10 msgr2=0x7f1e28074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:46.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.390+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2338067439 shutdown_connections 2023-10-08T08:36:46.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.390+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2338067439 wait complete. 2023-10-08T08:36:46.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2d13a700 1 Processor -- start 2023-10-08T08:36:46.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2d13a700 1 -- start start 2023-10-08T08:36:46.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2d13a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 0x7f1e281961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:46.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2d13a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e28100c60 0x7f1e28196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:46.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2d13a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e28104720 0x7f1e2819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:46.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2d13a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2819b0f0 con 0x7f1e281002a0 2023-10-08T08:36:46.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2d13a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2819b260 con 0x7f1e28104720 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2d13a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2819b420 con 0x7f1e28100c60 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e26d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 0x7f1e281961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e26d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 0x7f1e281961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47824/0 (socket says 172.21.15.70:47824) 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e26d9d700 1 -- 172.21.15.70:0/2631164322 learned_addr learned my addr 172.21.15.70:0/2631164322 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2659c700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e28100c60 0x7f1e28196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e2759e700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e28104720 0x7f1e2819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e26d9d700 1 -- 172.21.15.70:0/2631164322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e28100c60 msgr2=0x7f1e28196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e26d9d700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e28100c60 0x7f1e28196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e26d9d700 1 -- 172.21.15.70:0/2631164322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e28104720 msgr2=0x7f1e2819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e26d9d700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e28104720 0x7f1e2819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.391+0000 7f1e26d9d700 1 -- 172.21.15.70:0/2631164322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0095f0 con 0x7f1e281002a0 2023-10-08T08:36:46.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.392+0000 7f1e26d9d700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 0x7f1e281961f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000ef10 tx=0x7f1e2000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:46.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.392+0000 7f1e0ffff700 1 -- 172.21.15.70:0/2631164322 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000ca70 con 0x7f1e281002a0 2023-10-08T08:36:46.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.392+0000 7f1e0ffff700 1 -- 172.21.15.70:0/2631164322 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(23 keys) v1 ==== 1012+0+0 (secure 0 0 0) 0x7f1e2000f040 con 0x7f1e281002a0 2023-10-08T08:36:46.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.392+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2819b6a0 con 0x7f1e281002a0 2023-10-08T08:36:46.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.392+0000 7f1e0ffff700 1 -- 172.21.15.70:0/2631164322 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20007e20 con 0x7f1e281002a0 2023-10-08T08:36:46.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.392+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2810d050 con 0x7f1e281002a0 2023-10-08T08:36:46.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.393+0000 7f1e0ffff700 1 -- 172.21.15.70:0/2631164322 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f1e20014480 con 0x7f1e281002a0 2023-10-08T08:36:46.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.393+0000 7f1e0ffff700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1e10038b40 0x7f1e1003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:46.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.393+0000 7f1e0ffff700 1 -- 172.21.15.70:0/2631164322 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f1e2004b880 con 0x7f1e281002a0 2023-10-08T08:36:46.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.395+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e28107ca0 con 0x7f1e281002a0 2023-10-08T08:36:46.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.395+0000 7f1e2659c700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1e10038b40 0x7f1e1003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:46.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.395+0000 7f1e2659c700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1e10038b40 0x7f1e1003b000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00b2e0 tx=0x7f1e1c005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:46.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.400+0000 7f1e0ffff700 1 -- 172.21.15.70:0/2631164322 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1e2001e460 con 0x7f1e281002a0 2023-10-08T08:36:46.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.618+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) v1 -- 0x7f1e28067d10 con 0x7f1e281002a0 2023-10-08T08:36:46.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.621+0000 7f1e0ffff700 1 -- 172.21.15.70:0/2631164322 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1e28067d10 con 0x7f1e281002a0 2023-10-08T08:36:46.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.621+0000 7f1e0ffff700 1 -- 172.21.15.70:0/2631164322 <== mon.0 v2:172.21.15.70:3300/0 8 ==== config(24 keys) v1 ==== 1043+0+0 (secure 0 0 0) 0x7f1e20010f00 con 0x7f1e281002a0 2023-10-08T08:36:46.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1e10038b40 msgr2=0x7f1e1003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1e10038b40 0x7f1e1003b000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00b2e0 tx=0x7f1e1c005fd0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 msgr2=0x7f1e281961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 0x7f1e281961f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000ef10 tx=0x7f1e2000c3a0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 shutdown_connections 2023-10-08T08:36:46.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1e10038b40 0x7f1e1003b000 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e28104720 0x7f1e2819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e281002a0 0x7f1e281961f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 --2- 172.21.15.70:0/2631164322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e28100c60 0x7f1e28196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 >> 172.21.15.70:0/2631164322 conn(0x7f1e28074a10 msgr2=0x7f1e280fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:46.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 shutdown_connections 2023-10-08T08:36:46.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.623+0000 7f1e2d13a700 1 -- 172.21.15.70:0/2631164322 wait complete. 2023-10-08T08:36:46.640 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:46.682 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:46.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:46 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2592851429' entity='client.admin' 2023-10-08T08:36:46.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:46.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:46.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:46.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T08:36:46.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T08:36:46.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T08:36:46.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:46.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:46 smithi070 ceph-mon[99513]: Deploying daemon mgr.y on smithi105 2023-10-08T08:36:46.720 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:46 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2592851429' entity='client.admin' 2023-10-08T08:36:46.720 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:46.721 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:46.721 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:46.721 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T08:36:46.721 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T08:36:46.721 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T08:36:46.721 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:46.721 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:46 smithi105 ceph-mon[103798]: Deploying daemon mgr.y on smithi105 2023-10-08T08:36:46.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2592851429' entity='client.admin' 2023-10-08T08:36:46.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:46.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:46.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:46.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T08:36:46.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T08:36:46.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T08:36:46.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:46.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-mon[104220]: Deploying daemon mgr.y on smithi105 2023-10-08T08:36:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.775+0000 7f0aa74be700 1 -- 172.21.15.70:0/3135346396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0106750 msgr2=0x7f0aa0106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.775+0000 7f0aa74be700 1 --2- 172.21.15.70:0/3135346396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0106750 0x7f0aa0106b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800b0a0 tx=0x7f0a9800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.775+0000 7f0aa74be700 1 -- 172.21.15.70:0/3135346396 shutdown_connections 2023-10-08T08:36:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.775+0000 7f0aa74be700 1 --2- 172.21.15.70:0/3135346396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aa0101110 0x7f0aa010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.775+0000 7f0aa74be700 1 --2- 172.21.15.70:0/3135346396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0106750 0x7f0aa0106b30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.775+0000 7f0aa74be700 1 --2- 172.21.15.70:0/3135346396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aa0100750 0x7f0aa0100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.775+0000 7f0aa74be700 1 -- 172.21.15.70:0/3135346396 >> 172.21.15.70:0/3135346396 conn(0x7f0aa00fc200 msgr2=0x7f0aa00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.775+0000 7f0aa74be700 1 -- 172.21.15.70:0/3135346396 shutdown_connections 2023-10-08T08:36:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.775+0000 7f0aa74be700 1 -- 172.21.15.70:0/3135346396 wait complete. 2023-10-08T08:36:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa74be700 1 Processor -- start 2023-10-08T08:36:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa74be700 1 -- start start 2023-10-08T08:36:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa74be700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0100750 0x7f0aa019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa74be700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aa0101110 0x7f0aa019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa74be700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aa0106750 0x7f0aa0196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa74be700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa01970c0 con 0x7f0aa0100750 2023-10-08T08:36:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa74be700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0197230 con 0x7f0aa0101110 2023-10-08T08:36:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa74be700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa01973f0 con 0x7f0aa0106750 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa525a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0100750 0x7f0aa019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa525a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0100750 0x7f0aa019c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47838/0 (socket says 172.21.15.70:47838) 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa525a700 1 -- 172.21.15.70:0/1402158829 learned_addr learned my addr 172.21.15.70:0/1402158829 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa4a59700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aa0101110 0x7f0aa019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa5a5b700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aa0106750 0x7f0aa0196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa525a700 1 -- 172.21.15.70:0/1402158829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aa0106750 msgr2=0x7f0aa0196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa525a700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aa0106750 0x7f0aa0196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa525a700 1 -- 172.21.15.70:0/1402158829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aa0101110 msgr2=0x7f0aa019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa525a700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aa0101110 0x7f0aa019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa525a700 1 -- 172.21.15.70:0/1402158829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98009d00 con 0x7f0aa0100750 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0aa525a700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0100750 0x7f0aa019c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a98006070 tx=0x7f0a98004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.776+0000 7f0a9e7fc700 1 -- 172.21.15.70:0/1402158829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800e040 con 0x7f0aa0100750 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.777+0000 7f0a9e7fc700 1 -- 172.21.15.70:0/1402158829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(24 keys) v1 ==== 1043+0+0 (secure 0 0 0) 0x7f0a98004e80 con 0x7f0aa0100750 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.777+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa0197670 con 0x7f0aa0100750 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.777+0000 7f0a9e7fc700 1 -- 172.21.15.70:0/1402158829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98004460 con 0x7f0aa0100750 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.777+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa01a3910 con 0x7f0aa0100750 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.777+0000 7f0a9e7fc700 1 -- 172.21.15.70:0/1402158829 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f0a980045c0 con 0x7f0aa0100750 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.777+0000 7f0a9e7fc700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a88038b40 0x7f0a8803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.778+0000 7f0a9e7fc700 1 -- 172.21.15.70:0/1402158829 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f0a9804c1c0 con 0x7f0aa0100750 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.778+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa0108d50 con 0x7f0aa0100750 2023-10-08T08:36:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.778+0000 7f0aa4a59700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a88038b40 0x7f0a8803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:46.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.778+0000 7f0aa4a59700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a88038b40 0x7f0a8803b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0197c20 tx=0x7f0a9400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.783+0000 7f0a9e7fc700 1 -- 172.21.15.70:0/1402158829 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0a9801b450 con 0x7f0aa0100750 2023-10-08T08:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:46.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.989+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f0aa004e4c0 con 0x7f0aa0100750 2023-10-08T08:36:46.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.992+0000 7f0a9e7fc700 1 -- 172.21.15.70:0/1402158829 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0a9801a3b0 con 0x7f0aa0100750 2023-10-08T08:36:46.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.993+0000 7f0a9e7fc700 1 -- 172.21.15.70:0/1402158829 <== mon.0 v2:172.21.15.70:3300/0 8 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a9801b450 con 0x7f0aa0100750 2023-10-08T08:36:46.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a88038b40 msgr2=0x7f0a8803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a88038b40 0x7f0a8803b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0197c20 tx=0x7f0a9400b410 comp rx=0 tx=0).stop 2023-10-08T08:36:46.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0100750 msgr2=0x7f0aa019c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:46.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0100750 0x7f0aa019c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a98006070 tx=0x7f0a98004a50 comp rx=0 tx=0).stop 2023-10-08T08:36:46.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 shutdown_connections 2023-10-08T08:36:46.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a88038b40 0x7f0a8803b000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aa0106750 0x7f0aa0196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aa0100750 0x7f0aa019c920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 --2- 172.21.15.70:0/1402158829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aa0101110 0x7f0aa019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:46.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 >> 172.21.15.70:0/1402158829 conn(0x7f0aa00fc200 msgr2=0x7f0aa00fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:46.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 shutdown_connections 2023-10-08T08:36:46.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:46.994+0000 7f0aa74be700 1 -- 172.21.15.70:0/1402158829 wait complete. 2023-10-08T08:36:47.063 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:46.751+0000 7f6aba839200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T08:36:47.063 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:46.880+0000 7f6aba839200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T08:36:47.063 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:46.968+0000 7f6aba839200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T08:36:47.063 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:47 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:47.062+0000 7f6aba839200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T08:36:47.626 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:47 smithi105 systemd[1]: Starting Ceph mgr.y for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:36:47.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.640+0000 7f62ecae6700 1 -- 172.21.15.70:0/2424224999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 msgr2=0x7f62e8106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:47.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.640+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2424224999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 0x7f62e8106ba0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009990 tx=0x7f62d8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.640+0000 7f62ecae6700 1 -- 172.21.15.70:0/2424224999 shutdown_connections 2023-10-08T08:36:47.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.640+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2424224999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8068b30 0x7f62e810d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.640+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2424224999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 0x7f62e8106ba0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.640+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2424224999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e8068190 0x7f62e80685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.640+0000 7f62ecae6700 1 -- 172.21.15.70:0/2424224999 >> 172.21.15.70:0/2424224999 conn(0x7f62e8075790 msgr2=0x7f62e8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:47.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.640+0000 7f62ecae6700 1 -- 172.21.15.70:0/2424224999 shutdown_connections 2023-10-08T08:36:47.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.640+0000 7f62ecae6700 1 -- 172.21.15.70:0/2424224999 wait complete. 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62ecae6700 1 Processor -- start 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62ecae6700 1 -- start start 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62ecae6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8068190 0x7f62e80ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62ecae6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e8068b30 0x7f62e80ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62ecae6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 0x7f62e81002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62ecae6700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e81a4ef0 con 0x7f62e81067c0 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62ecae6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e81a5060 con 0x7f62e8068190 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62ecae6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e81a5220 con 0x7f62e8068b30 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e6d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 0x7f62e81002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:47.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e6d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 0x7f62e81002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47856/0 (socket says 172.21.15.70:47856) 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e6d9d700 1 -- 172.21.15.70:0/2476933088 learned_addr learned my addr 172.21.15.70:0/2476933088 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e5d9b700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e8068b30 0x7f62e80ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e659c700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8068190 0x7f62e80ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e6d9d700 1 -- 172.21.15.70:0/2476933088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e8068b30 msgr2=0x7f62e80ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e6d9d700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e8068b30 0x7f62e80ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e6d9d700 1 -- 172.21.15.70:0/2476933088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8068190 msgr2=0x7f62e80ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e6d9d700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8068190 0x7f62e80ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e6d9d700 1 -- 172.21.15.70:0/2476933088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80095f0 con 0x7f62e81067c0 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.641+0000 7f62e6d9d700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 0x7f62e81002a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f62e000ef30 tx=0x7f62e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:47.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.642+0000 7f62d77fe700 1 -- 172.21.15.70:0/2476933088 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0018070 con 0x7f62e81067c0 2023-10-08T08:36:47.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.642+0000 7f62d77fe700 1 -- 172.21.15.70:0/2476933088 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62e000f040 con 0x7f62e81067c0 2023-10-08T08:36:47.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.642+0000 7f62d77fe700 1 -- 172.21.15.70:0/2476933088 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000ccb0 con 0x7f62e81067c0 2023-10-08T08:36:47.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.642+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e81a54a0 con 0x7f62e81067c0 2023-10-08T08:36:47.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.642+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e81a5950 con 0x7f62e81067c0 2023-10-08T08:36:47.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.643+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e8108d70 con 0x7f62e81067c0 2023-10-08T08:36:47.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.643+0000 7f62d77fe700 1 -- 172.21.15.70:0/2476933088 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f62e0003a00 con 0x7f62e81067c0 2023-10-08T08:36:47.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.643+0000 7f62d77fe700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f62d0038b40 0x7f62d003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:47.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.643+0000 7f62d77fe700 1 -- 172.21.15.70:0/2476933088 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f62e004b070 con 0x7f62e81067c0 2023-10-08T08:36:47.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.643+0000 7f62e659c700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f62d0038b40 0x7f62d003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:47.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.643+0000 7f62e659c700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f62d0038b40 0x7f62d003b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62d800b2e0 tx=0x7f62d8005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:47.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.648+0000 7f62d77fe700 1 -- 172.21.15.70:0/2476933088 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f62e0004ad0 con 0x7f62e81067c0 2023-10-08T08:36:47.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:47 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2631164322' entity='client.admin' 2023-10-08T08:36:47.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:47 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1402158829' entity='client.admin' 2023-10-08T08:36:47.845 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:47 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:47.478+0000 7f6aba839200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T08:36:47.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.858+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f62e8100d70 con 0x7f62e81067c0 2023-10-08T08:36:47.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.861+0000 7f62d77fe700 1 -- 172.21.15.70:0/2476933088 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f62e0004ad0 con 0x7f62e81067c0 2023-10-08T08:36:47.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.862+0000 7f62d77fe700 1 -- 172.21.15.70:0/2476933088 <== mon.0 v2:172.21.15.70:3300/0 8 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62e0013ef0 con 0x7f62e81067c0 2023-10-08T08:36:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f62d0038b40 msgr2=0x7f62d003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f62d0038b40 0x7f62d003b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62d800b2e0 tx=0x7f62d8005fd0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 msgr2=0x7f62e81002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 0x7f62e81002a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f62e000ef30 tx=0x7f62e000c3a0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 shutdown_connections 2023-10-08T08:36:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f62d0038b40 0x7f62d003b000 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62e81067c0 0x7f62e81002a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8068190 0x7f62e80ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 --2- 172.21.15.70:0/2476933088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e8068b30 0x7f62e80ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 >> 172.21.15.70:0/2476933088 conn(0x7f62e8075790 msgr2=0x7f62e80fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 shutdown_connections 2023-10-08T08:36:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:47.864+0000 7f62ecae6700 1 -- 172.21.15.70:0/2476933088 wait complete. 2023-10-08T08:36:47.888 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:47 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2631164322' entity='client.admin' 2023-10-08T08:36:47.888 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:47 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1402158829' entity='client.admin' 2023-10-08T08:36:47.960 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:47 smithi105 podman[106130]: 2023-10-08T08:36:47.961 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:47 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2631164322' entity='client.admin' 2023-10-08T08:36:47.961 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:47 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1402158829' entity='client.admin' 2023-10-08T08:36:47.964 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:47.967 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:48.264 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:47 smithi105 ceph-mgr[106170]: -- 172.21.15.105:0/4255116223 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557aab6cd1e0 con 0x557aab6a2800 2023-10-08T08:36:48.264 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:47 smithi105 bash[106130]: 200683b90f8a78e3d571aeb79b5d1b5ffef509112676a50f3d3ecd63fa673abb 2023-10-08T08:36:48.265 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:47 smithi105 systemd[1]: Started Ceph mgr.y for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:36:48.265 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:48.088+0000 7fd24df47200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T08:36:48.265 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:48.172+0000 7fd24df47200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T08:36:48.265 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:48.263+0000 7fd24df47200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T08:36:48.520 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:48.364+0000 7fd24df47200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T08:36:48.594 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:48 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:48.142+0000 7f6aba839200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T08:36:48.595 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:48 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:48.225+0000 7f6aba839200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T08:36:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.060+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/2052668688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a44067900 msgr2=0x7f6a44103e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.060+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/2052668688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a44067900 0x7f6a44103e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009990 tx=0x7f6a40009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.060+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/2052668688 shutdown_connections 2023-10-08T08:36:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.060+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/2052668688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a440ff190 0x7f6a440ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.060+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/2052668688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a44067900 0x7f6a44103e70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.060+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/2052668688 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a44067d70 0x7f6a441043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.060+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/2052668688 >> 172.21.15.70:0/2052668688 conn(0x7f6a44074a10 msgr2=0x7f6a44074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.060+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/2052668688 shutdown_connections 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.060+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/2052668688 wait complete. 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.061+0000 7f6a4c6bd700 1 Processor -- start 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.061+0000 7f6a4c6bd700 1 -- start start 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.061+0000 7f6a4c6bd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a44067900 0x7f6a44198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.061+0000 7f6a4c6bd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a44067d70 0x7f6a44199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.061+0000 7f6a4c6bd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a440ff190 0x7f6a4419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.061+0000 7f6a4c6bd700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4419ddd0 con 0x7f6a440ff190 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.061+0000 7f6a4c6bd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4419df40 con 0x7f6a44067900 2023-10-08T08:36:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.061+0000 7f6a4c6bd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4419e100 con 0x7f6a44067d70 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4ac5a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a440ff190 0x7f6a4419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4a459700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a44067900 0x7f6a44198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4ac5a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a440ff190 0x7f6a4419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47870/0 (socket says 172.21.15.70:47870) 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4ac5a700 1 -- 172.21.15.70:0/3913282581 learned_addr learned my addr 172.21.15.70:0/3913282581 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a49c58700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a44067d70 0x7f6a44199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4ac5a700 1 -- 172.21.15.70:0/3913282581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a44067d70 msgr2=0x7f6a44199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4ac5a700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a44067d70 0x7f6a44199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4ac5a700 1 -- 172.21.15.70:0/3913282581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a44067900 msgr2=0x7f6a44198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4ac5a700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a44067900 0x7f6a44198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4ac5a700 1 -- 172.21.15.70:0/3913282581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009520 con 0x7f6a440ff190 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4ac5a700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a440ff190 0x7f6a4419d7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00ef30 tx=0x7f6a3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a3b7fe700 1 -- 172.21.15.70:0/3913282581 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c018070 con 0x7f6a440ff190 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a400095f0 con 0x7f6a440ff190 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a3b7fe700 1 -- 172.21.15.70:0/3913282581 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a3c00f040 con 0x7f6a440ff190 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a3b7fe700 1 -- 172.21.15.70:0/3913282581 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00cd00 con 0x7f6a440ff190 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.062+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a441a5a70 con 0x7f6a440ff190 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.063+0000 7f6a3b7fe700 1 -- 172.21.15.70:0/3913282581 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7f6a3c004000 con 0x7f6a440ff190 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.063+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a441005b0 con 0x7f6a440ff190 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.064+0000 7f6a3b7fe700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6a30038b40 0x7f6a3003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:48.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.064+0000 7f6a3b7fe700 1 -- 172.21.15.70:0/3913282581 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6a3c04b080 con 0x7f6a440ff190 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.065+0000 7f6a4a459700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6a30038b40 0x7f6a3003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.065+0000 7f6a4a459700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6a30038b40 0x7f6a3003b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000b2e0 tx=0x7f6a40005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.069+0000 7f6a3b7fe700 1 -- 172.21.15.70:0/3913282581 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6a3c005020 con 0x7f6a440ff190 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.272+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f6a4404e4c0 con 0x7f6a440ff190 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.275+0000 7f6a3b7fe700 1 -- 172.21.15.70:0/3913282581 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) v1 ==== 108+0+0 (secure 0 0 0) 0x7f6a3c01cbb0 con 0x7f6a440ff190 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6a30038b40 msgr2=0x7f6a3003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6a30038b40 0x7f6a3003b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000b2e0 tx=0x7f6a40005fd0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a440ff190 msgr2=0x7f6a4419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a440ff190 0x7f6a4419d7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00ef30 tx=0x7f6a3c00c3a0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 shutdown_connections 2023-10-08T08:36:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6a30038b40 0x7f6a3003b000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a440ff190 0x7f6a4419d7c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a44067900 0x7f6a44198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 --2- 172.21.15.70:0/3913282581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a44067d70 0x7f6a44199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 >> 172.21.15.70:0/3913282581 conn(0x7f6a44074a10 msgr2=0x7f6a440fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 shutdown_connections 2023-10-08T08:36:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:48.277+0000 7f6a4c6bd700 1 -- 172.21.15.70:0/3913282581 wait complete. 2023-10-08T08:36:48.862 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:48.546+0000 7fd24df47200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T08:36:49.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:48 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2476933088' entity='client.admin' 2023-10-08T08:36:49.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:49.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:48 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3913282581' entity='client.admin' 2023-10-08T08:36:49.127 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:49.033+0000 7f6aba839200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:36:49.127 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:48 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2476933088' entity='client.admin' 2023-10-08T08:36:49.127 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.127 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.127 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.127 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.128 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:49.128 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:48 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3913282581' entity='client.admin' 2023-10-08T08:36:49.168 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:48.935+0000 7fd24df47200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T08:36:49.168 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:49.069+0000 7fd24df47200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T08:36:49.168 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2476933088' entity='client.admin' 2023-10-08T08:36:49.168 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.168 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.168 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.168 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:49.168 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:49.169 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:48 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3913282581' entity='client.admin' 2023-10-08T08:36:49.187 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi070') 2023-10-08T08:36:49.187 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi070') 2023-10-08T08:36:49.187 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi070') 2023-10-08T08:36:49.188 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi070') 2023-10-08T08:36:49.457 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:49.521 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:49.167+0000 7fd24df47200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T08:36:49.521 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:49.265+0000 7fd24df47200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T08:36:49.591 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:49.594 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:49.125+0000 7f6aba839200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T08:36:49.594 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:49.315+0000 7f6aba839200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:36:49.651 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:49.994 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:49.610+0000 7f6aba839200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T08:36:49.994 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:49.844+0000 7f6aba839200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T08:36:50.020 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:49.718+0000 7fd24df47200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T08:36:50.258 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:49.993+0000 7f6aba839200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T08:36:50.258 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.258 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:50.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:50.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T08:36:50.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T08:36:50.259 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:50.361 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.361 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.361 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.361 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:50.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:50.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T08:36:50.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T08:36:50.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:50.386 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T08:36:50.387 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:50.515 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:50.594 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:50.257+0000 7f6aba839200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T08:36:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:50.681 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:50.725 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:50.770 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:50.385+0000 7fd24df47200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T08:36:50.770 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:50 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:50.466+0000 7fd24df47200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T08:36:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.802+0000 7fb2323fb700 1 -- 172.21.15.70:0/1048517382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 msgr2=0x7fb22c0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.802+0000 7fb2323fb700 1 --2- 172.21.15.70:0/1048517382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 0x7fb22c0685f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb220009990 tx=0x7fb220009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.802+0000 7fb2323fb700 1 -- 172.21.15.70:0/1048517382 shutdown_connections 2023-10-08T08:36:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.802+0000 7fb2323fb700 1 --2- 172.21.15.70:0/1048517382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb22c068b30 0x7fb22c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.802+0000 7fb2323fb700 1 --2- 172.21.15.70:0/1048517382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb22c1067a0 0x7fb22c106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.802+0000 7fb2323fb700 1 --2- 172.21.15.70:0/1048517382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 0x7fb22c0685f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.802+0000 7fb2323fb700 1 -- 172.21.15.70:0/1048517382 >> 172.21.15.70:0/1048517382 conn(0x7fb22c075790 msgr2=0x7fb22c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.802+0000 7fb2323fb700 1 -- 172.21.15.70:0/1048517382 shutdown_connections 2023-10-08T08:36:50.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.802+0000 7fb2323fb700 1 -- 172.21.15.70:0/1048517382 wait complete. 2023-10-08T08:36:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb2323fb700 1 Processor -- start 2023-10-08T08:36:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb2323fb700 1 -- start start 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb2323fb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 0x7fb22c19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb2323fb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb22c068b30 0x7fb22c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb2323fb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb22c1067a0 0x7fb22c196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb2323fb700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c197230 con 0x7fb22c068190 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb2323fb700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c1973a0 con 0x7fb22c1067a0 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb2323fb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c197560 con 0x7fb22c068b30 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 0x7fb22c19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 0x7fb22c19c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47880/0 (socket says 172.21.15.70:47880) 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb22bfff700 1 -- 172.21.15.70:0/3740899530 learned_addr learned my addr 172.21.15.70:0/3740899530 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb22b7fe700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb22c068b30 0x7fb22c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.803+0000 7fb230998700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb22c1067a0 0x7fb22c196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb22bfff700 1 -- 172.21.15.70:0/3740899530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb22c068b30 msgr2=0x7fb22c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb22bfff700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb22c068b30 0x7fb22c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb22bfff700 1 -- 172.21.15.70:0/3740899530 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb22c1067a0 msgr2=0x7fb22c196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb22bfff700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb22c1067a0 0x7fb22c196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb22bfff700 1 -- 172.21.15.70:0/3740899530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200095f0 con 0x7fb22c068190 2023-10-08T08:36:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb22b7fe700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb22c068b30 0x7fb22c19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:36:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb22bfff700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 0x7fb22c19c9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00d980 tx=0x7fb21c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb2297fa700 1 -- 172.21.15.70:0/3740899530 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c004220 con 0x7fb22c068190 2023-10-08T08:36:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb2297fa700 1 -- 172.21.15.70:0/3740899530 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb21c007640 con 0x7fb22c068190 2023-10-08T08:36:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb2297fa700 1 -- 172.21.15.70:0/3740899530 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c005690 con 0x7fb22c068190 2023-10-08T08:36:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c1977e0 con 0x7fb22c068190 2023-10-08T08:36:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.804+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c0ff920 con 0x7fb22c068190 2023-10-08T08:36:50.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.805+0000 7fb2297fa700 1 -- 172.21.15.70:0/3740899530 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) v1 ==== 45652+0+0 (secure 0 0 0) 0x7fb21c00f690 con 0x7fb22c068190 2023-10-08T08:36:50.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.805+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c108d50 con 0x7fb22c068190 2023-10-08T08:36:50.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.805+0000 7fb2297fa700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb214038b40 0x7fb21403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:50.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.805+0000 7fb2297fa700 1 -- 172.21.15.70:0/3740899530 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb21c04b210 con 0x7fb22c068190 2023-10-08T08:36:50.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.805+0000 7fb22b7fe700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb214038b40 0x7fb21403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:50.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.806+0000 7fb22b7fe700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb214038b40 0x7fb21403b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb22c1981f0 tx=0x7fb220005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:50.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:50.810+0000 7fb2297fa700 1 -- 172.21.15.70:0/3740899530 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb21c022760 con 0x7fb22c068190 2023-10-08T08:36:51.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.004+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7fb22c197f60 con 0x7fb22c068190 2023-10-08T08:36:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.007+0000 7fb2297fa700 1 -- 172.21.15.70:0/3740899530 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v16)=0 v16) v1 ==== 117+0+0 (secure 0 0 0) 0x7fb21c00e3b0 con 0x7fb22c068190 2023-10-08T08:36:51.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb214038b40 msgr2=0x7fb21403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:51.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb214038b40 0x7fb21403b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb22c1981f0 tx=0x7fb220005fd0 comp rx=0 tx=0).stop 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 msgr2=0x7fb22c19c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 0x7fb22c19c9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00d980 tx=0x7fb21c00dc90 comp rx=0 tx=0).stop 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 shutdown_connections 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb214038b40 0x7fb21403b000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb22c1067a0 0x7fb22c196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb22c068190 0x7fb22c19c9d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 --2- 172.21.15.70:0/3740899530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb22c068b30 0x7fb22c19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 >> 172.21.15.70:0/3740899530 conn(0x7fb22c075790 msgr2=0x7fb22c0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 shutdown_connections 2023-10-08T08:36:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:51.009+0000 7fb2323fb700 1 -- 172.21.15.70:0/3740899530 wait complete. 2023-10-08T08:36:51.280 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:50 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:50.955+0000 7f6aba839200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T08:36:51.280 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:51.087+0000 7f6aba839200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T08:36:51.280 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:51 smithi191 ceph-mon[104220]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T08:36:51.280 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:51 smithi191 ceph-mon[104220]: Reconfiguring daemon mgr.x on smithi070 2023-10-08T08:36:51.280 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:51 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3740899530' entity='client.admin' 2023-10-08T08:36:51.326 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:51.233+0000 7fd24df47200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:36:51.326 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:51 smithi105 ceph-mon[103798]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T08:36:51.326 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:51 smithi105 ceph-mon[103798]: Reconfiguring daemon mgr.x on smithi070 2023-10-08T08:36:51.326 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:51 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3740899530' entity='client.admin' 2023-10-08T08:36:51.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:51 smithi070 ceph-mon[99513]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T08:36:51.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:51 smithi070 ceph-mon[99513]: Reconfiguring daemon mgr.x on smithi070 2023-10-08T08:36:51.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:51 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3740899530' entity='client.admin' 2023-10-08T08:36:51.594 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:51.279+0000 7f6aba839200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T08:36:51.595 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:51.391+0000 7f6aba839200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T08:36:51.770 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:51.325+0000 7fd24df47200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T08:36:51.770 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:51.496+0000 7fd24df47200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T08:36:52.094 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:51.608+0000 7f6aba839200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T08:36:52.146 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:51.775+0000 7fd24df47200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T08:36:52.146 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:51.997+0000 7fd24df47200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T08:36:52.146 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:52.145+0000 7fd24df47200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T08:36:52.752 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:52.770 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:52.406+0000 7fd24df47200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T08:36:52.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:52 smithi105 ceph-mon[103798]: Standby manager daemon z started 2023-10-08T08:36:52.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:52 smithi105 ceph-mon[103798]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T08:36:52.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:52 smithi105 ceph-mon[103798]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T08:36:52.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:52 smithi105 ceph-mon[103798]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T08:36:52.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:52 smithi105 ceph-mon[103798]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T08:36:52.790 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2771926019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01056b0 msgr2=0x7f23f0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2771926019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01056b0 0x7f23f0105a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009990 tx=0x7f23e0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2771926019 shutdown_connections 2023-10-08T08:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2771926019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23f0100110 0x7f23f010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2771926019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f01056b0 0x7f23f0105a90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2771926019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f00ff750 0x7f23f00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2771926019 >> 172.21.15.70:0/2771926019 conn(0x7f23f0075790 msgr2=0x7f23f0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2771926019 shutdown_connections 2023-10-08T08:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2771926019 wait complete. 2023-10-08T08:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.833+0000 7f23f5bfb700 1 Processor -- start 2023-10-08T08:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23f5bfb700 1 -- start start 2023-10-08T08:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23f5bfb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f00ff750 0x7f23f0197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23f5bfb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f0100110 0x7f23f0198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23f5bfb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23f01056b0 0x7f23f0198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23f5bfb700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f01a2db0 con 0x7f23f00ff750 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23f5bfb700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f01a2f20 con 0x7f23f01056b0 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23f5bfb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f01a30e0 con 0x7f23f0100110 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ef7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f00ff750 0x7f23f0197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ef7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f00ff750 0x7f23f0197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47894/0 (socket says 172.21.15.70:47894) 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ef7fe700 1 -- 172.21.15.70:0/2905998415 learned_addr learned my addr 172.21.15.70:0/2905998415 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23eeffd700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f0100110 0x7f23f0198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23effff700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23f01056b0 0x7f23f0198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ef7fe700 1 -- 172.21.15.70:0/2905998415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f0100110 msgr2=0x7f23f0198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ef7fe700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f0100110 0x7f23f0198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ef7fe700 1 -- 172.21.15.70:0/2905998415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23f01056b0 msgr2=0x7f23f0198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ef7fe700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23f01056b0 0x7f23f0198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ef7fe700 1 -- 172.21.15.70:0/2905998415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e00095f0 con 0x7f23f00ff750 2023-10-08T08:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ef7fe700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f00ff750 0x7f23f0197af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23e00095c0 tx=0x7f23e000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ecff9700 1 -- 172.21.15.70:0/2905998415 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e001d070 con 0x7f23f00ff750 2023-10-08T08:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23ecff9700 1 -- 172.21.15.70:0/2905998415 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23e0005050 con 0x7f23f00ff750 2023-10-08T08:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.834+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f01a3360 con 0x7f23f00ff750 2023-10-08T08:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.835+0000 7f23ecff9700 1 -- 172.21.15.70:0/2905998415 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0004a70 con 0x7f23f00ff750 2023-10-08T08:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.835+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f01a3770 con 0x7f23f00ff750 2023-10-08T08:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.836+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f0107cb0 con 0x7f23f00ff750 2023-10-08T08:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.836+0000 7f23ecff9700 1 -- 172.21.15.70:0/2905998415 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) v1 ==== 90808+0+0 (secure 0 0 0) 0x7f23e00051c0 con 0x7f23f00ff750 2023-10-08T08:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.836+0000 7f23ecff9700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23d806cfc0 0x7f23d806f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.836+0000 7f23ecff9700 1 -- 172.21.15.70:0/2905998415 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f23e008c130 con 0x7f23f00ff750 2023-10-08T08:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.837+0000 7f23eeffd700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23d806cfc0 0x7f23d806f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.837+0000 7f23eeffd700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23d806cfc0 0x7f23d806f480 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f23f00689b0 tx=0x7f23e400a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:52.841+0000 7f23ecff9700 1 -- 172.21.15.70:0/2905998415 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f23e00574b0 con 0x7f23f00ff750 2023-10-08T08:36:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:52 smithi191 ceph-mon[104220]: Standby manager daemon z started 2023-10-08T08:36:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:52 smithi191 ceph-mon[104220]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T08:36:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:52 smithi191 ceph-mon[104220]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T08:36:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:52 smithi191 ceph-mon[104220]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T08:36:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:52 smithi191 ceph-mon[104220]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T08:36:52.845 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:36:52 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z[107248]: 2023-10-08T08:36:52.481+0000 7f6aba839200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T08:36:52.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:52 smithi070 ceph-mon[99513]: Standby manager daemon z started 2023-10-08T08:36:52.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:52 smithi070 ceph-mon[99513]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T08:36:52.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:52 smithi070 ceph-mon[99513]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T08:36:52.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:52 smithi070 ceph-mon[99513]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T08:36:52.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:52 smithi070 ceph-mon[99513]: from='mgr.? 172.21.15.191:0/1252984166' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T08:36:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.046+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7f23f0100df0 con 0x7f23f00ff750 2023-10-08T08:36:53.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.049+0000 7f23ecff9700 1 -- 172.21.15.70:0/2905998415 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v17)=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f23e0004cb0 con 0x7f23f00ff750 2023-10-08T08:36:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.051+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23d806cfc0 msgr2=0x7f23d806f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.051+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23d806cfc0 0x7f23d806f480 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f23f00689b0 tx=0x7f23e400a300 comp rx=0 tx=0).stop 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.051+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f00ff750 msgr2=0x7f23f0197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.051+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f00ff750 0x7f23f0197af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23e00095c0 tx=0x7f23e000f690 comp rx=0 tx=0).stop 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.052+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 shutdown_connections 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.052+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23d806cfc0 0x7f23d806f480 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.052+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23f01056b0 0x7f23f0198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.052+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23f00ff750 0x7f23f0197af0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.052+0000 7f23f5bfb700 1 --2- 172.21.15.70:0/2905998415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f0100110 0x7f23f0198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.052+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 >> 172.21.15.70:0/2905998415 conn(0x7f23f0075790 msgr2=0x7f23f00fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.052+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 shutdown_connections 2023-10-08T08:36:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:53.052+0000 7f23f5bfb700 1 -- 172.21.15.70:0/2905998415 wait complete. 2023-10-08T08:36:53.437 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:53.111+0000 7fd24df47200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T08:36:53.437 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:53.242+0000 7fd24df47200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T08:36:53.769 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:53.436+0000 7fd24df47200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T08:36:53.769 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:53.549+0000 7fd24df47200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T08:36:53.769 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:53 smithi105 ceph-mon[103798]: mgrmap e18: x(active, since 13s), standbys: z 2023-10-08T08:36:53.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T08:36:53.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:53 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2905998415' entity='client.admin' 2023-10-08T08:36:53.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:53 smithi191 ceph-mon[104220]: mgrmap e18: x(active, since 13s), standbys: z 2023-10-08T08:36:53.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T08:36:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:53 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2905998415' entity='client.admin' 2023-10-08T08:36:53.900 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:53 smithi070 ceph-mon[99513]: mgrmap e18: x(active, since 13s), standbys: z 2023-10-08T08:36:53.900 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T08:36:53.900 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:53 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2905998415' entity='client.admin' 2023-10-08T08:36:53.970 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi070') 2023-10-08T08:36:53.970 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi070') 2023-10-08T08:36:53.970 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi070') 2023-10-08T08:36:54.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 -- 172.21.15.70:0/4288782100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 msgr2=0x7f7ecc10c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:54.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/4288782100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 0x7f7ecc10c560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400b0a0 tx=0x7f7ec400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 -- 172.21.15.70:0/4288782100 shutdown_connections 2023-10-08T08:36:54.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/4288782100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 0x7f7ecc10c560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/4288782100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc105690 0x7f7ecc105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/4288782100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ecc0ff6e0 0x7f7ecc0ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 -- 172.21.15.70:0/4288782100 >> 172.21.15.70:0/4288782100 conn(0x7f7ecc0766c0 msgr2=0x7f7ecc076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:54.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 -- 172.21.15.70:0/4288782100 shutdown_connections 2023-10-08T08:36:54.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 -- 172.21.15.70:0/4288782100 wait complete. 2023-10-08T08:36:54.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 Processor -- start 2023-10-08T08:36:54.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.309+0000 7f7ed27ab700 1 -- start start 2023-10-08T08:36:54.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ed27ab700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ecc0ff6e0 0x7f7ecc198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:54.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ed27ab700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 0x7f7ecc199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:54.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ed27ab700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc105690 0x7f7ecc19d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ed27ab700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc19de20 con 0x7f7ecc1000a0 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ed27ab700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc19df90 con 0x7f7ecc0ff6e0 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ed27ab700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc19e150 con 0x7f7ecc105690 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 0x7f7ecc199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 0x7f7ecc199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47908/0 (socket says 172.21.15.70:47908) 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecb7fe700 1 -- 172.21.15.70:0/3723477657 learned_addr learned my addr 172.21.15.70:0/3723477657 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecbfff700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ecc0ff6e0 0x7f7ecc198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ed0d48700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc105690 0x7f7ecc19d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecb7fe700 1 -- 172.21.15.70:0/3723477657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc105690 msgr2=0x7f7ecc19d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecb7fe700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc105690 0x7f7ecc19d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecb7fe700 1 -- 172.21.15.70:0/3723477657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ecc0ff6e0 msgr2=0x7f7ecc198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecb7fe700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ecc0ff6e0 0x7f7ecc198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecb7fe700 1 -- 172.21.15.70:0/3723477657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4009d00 con 0x7f7ecc1000a0 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.310+0000 7f7ecb7fe700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 0x7f7ecc199460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00d980 tx=0x7f7ebc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.311+0000 7f7ec97fa700 1 -- 172.21.15.70:0/3723477657 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc004220 con 0x7f7ecc1000a0 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.311+0000 7f7ec97fa700 1 -- 172.21.15.70:0/3723477657 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ebc007640 con 0x7f7ecc1000a0 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.311+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc19e430 con 0x7f7ecc1000a0 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.311+0000 7f7ec97fa700 1 -- 172.21.15.70:0/3723477657 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc005690 con 0x7f7ecc1000a0 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.311+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc1a5c90 con 0x7f7ecc1000a0 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.312+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc100dd0 con 0x7f7ecc1000a0 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.312+0000 7f7ec97fa700 1 -- 172.21.15.70:0/3723477657 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) v1 ==== 90808+0+0 (secure 0 0 0) 0x7f7ebc004750 con 0x7f7ecc1000a0 2023-10-08T08:36:54.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.312+0000 7f7ec97fa700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7eb406cfc0 0x7f7eb406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:54.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.313+0000 7f7ecbfff700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7eb406cfc0 0x7f7eb406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:54.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.313+0000 7f7ec97fa700 1 -- 172.21.15.70:0/3723477657 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f7ebc08b070 con 0x7f7ecc1000a0 2023-10-08T08:36:54.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.313+0000 7f7ecbfff700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7eb406cfc0 0x7f7eb406f480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0005950 tx=0x7f7ec000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:54.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.317+0000 7f7ec97fa700 1 -- 172.21.15.70:0/3723477657 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ebc0563f0 con 0x7f7ecc1000a0 2023-10-08T08:36:54.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.534+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f7ecc19a230 con 0x7f7ecc1000a0 2023-10-08T08:36:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.537+0000 7f7ec97fa700 1 -- 172.21.15.70:0/3723477657 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7f7ebc059a10 con 0x7f7ecc1000a0 2023-10-08T08:36:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7eb406cfc0 msgr2=0x7f7eb406f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7eb406cfc0 0x7f7eb406f480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0005950 tx=0x7f7ec000b410 comp rx=0 tx=0).stop 2023-10-08T08:36:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 msgr2=0x7f7ecc199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 0x7f7ecc199460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00d980 tx=0x7f7ebc00dc90 comp rx=0 tx=0).stop 2023-10-08T08:36:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 shutdown_connections 2023-10-08T08:36:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7eb406cfc0 0x7f7eb406f480 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc105690 0x7f7ecc19d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ecc0ff6e0 0x7f7ecc198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 --2- 172.21.15.70:0/3723477657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1000a0 0x7f7ecc199460 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 >> 172.21.15.70:0/3723477657 conn(0x7f7ecc0766c0 msgr2=0x7f7ecc0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 shutdown_connections 2023-10-08T08:36:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:54.540+0000 7f7ed27ab700 1 -- 172.21.15.70:0/3723477657 wait complete. 2023-10-08T08:36:55.020 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:53.768+0000 7fd24df47200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T08:36:55.020 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:36:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y[106146]: 2023-10-08T08:36:54.620+0000 7fd24df47200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T08:36:55.100 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:55.100 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:55.100 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: Reconfiguring mon.c (monmap changed)... 2023-10-08T08:36:55.100 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:55.100 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:55.100 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:55.100 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: Reconfiguring daemon mon.c on smithi191 2023-10-08T08:36:55.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3723477657' entity='client.admin' 2023-10-08T08:36:55.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: Standby manager daemon y started 2023-10-08T08:36:55.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T08:36:55.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T08:36:55.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T08:36:55.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:55 smithi070 ceph-mon[99513]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T08:36:55.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:55.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:55.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: Reconfiguring mon.c (monmap changed)... 2023-10-08T08:36:55.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:55.129 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:55.130 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:55.130 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: Reconfiguring daemon mon.c on smithi191 2023-10-08T08:36:55.130 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3723477657' entity='client.admin' 2023-10-08T08:36:55.130 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: Standby manager daemon y started 2023-10-08T08:36:55.130 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T08:36:55.130 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T08:36:55.130 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T08:36:55.130 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:55 smithi191 ceph-mon[104220]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: Reconfiguring mon.c (monmap changed)... 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: Reconfiguring daemon mon.c on smithi191 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3723477657' entity='client.admin' 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: Standby manager daemon y started 2023-10-08T08:36:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T08:36:55.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T08:36:55.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T08:36:55.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:55 smithi105 ceph-mon[103798]: from='mgr.? 172.21.15.105:0/8386417' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T08:36:56.469 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:56.469 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:56.469 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:56.469 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:56.469 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:56.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:56.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:56 smithi070 ceph-mon[99513]: mgrmap e19: x(active, since 16s), standbys: z, y 2023-10-08T08:36:56.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T08:36:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:56 smithi105 ceph-mon[103798]: mgrmap e19: x(active, since 16s), standbys: z, y 2023-10-08T08:36:56.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T08:36:56.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:56.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:56.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:36:56.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:36:56.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:36:56.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:36:56.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:56 smithi191 ceph-mon[104220]: mgrmap e19: x(active, since 16s), standbys: z, y 2023-10-08T08:36:56.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T08:36:56.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.041+0000 7f23e96e4700 1 -- 172.21.15.70:0/732941014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 msgr2=0x7f23e40ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:56.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.041+0000 7f23e96e4700 1 --2- 172.21.15.70:0/732941014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 0x7f23e40ff760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f23d80099c0 tx=0x7f23d8009cd0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.041+0000 7f23e96e4700 1 -- 172.21.15.70:0/732941014 shutdown_connections 2023-10-08T08:36:56.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.041+0000 7f23e96e4700 1 --2- 172.21.15.70:0/732941014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4105ba0 0x7f23e410d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.041+0000 7f23e96e4700 1 --2- 172.21.15.70:0/732941014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 0x7f23e40ff760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.041+0000 7f23e96e4700 1 --2- 172.21.15.70:0/732941014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40ffd30 0x7f23e4105470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.041+0000 7f23e96e4700 1 -- 172.21.15.70:0/732941014 >> 172.21.15.70:0/732941014 conn(0x7f23e4074950 msgr2=0x7f23e4074d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.041+0000 7f23e96e4700 1 -- 172.21.15.70:0/732941014 shutdown_connections 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.041+0000 7f23e96e4700 1 -- 172.21.15.70:0/732941014 wait complete. 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.042+0000 7f23e96e4700 1 Processor -- start 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.042+0000 7f23e96e4700 1 -- start start 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.042+0000 7f23e96e4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 0x7f23e419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.042+0000 7f23e96e4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40ffd30 0x7f23e419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e96e4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4105ba0 0x7f23e41969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e96e4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4197050 con 0x7f23e40ff380 2023-10-08T08:36:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e96e4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e41971c0 con 0x7f23e4105ba0 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e96e4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4197380 con 0x7f23e40ffd30 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e2ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 0x7f23e419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e2ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 0x7f23e419c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47918/0 (socket says 172.21.15.70:47918) 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e2ffd700 1 -- 172.21.15.70:0/4052691784 learned_addr learned my addr 172.21.15.70:0/4052691784 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e27fc700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40ffd30 0x7f23e419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e37fe700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4105ba0 0x7f23e41969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e2ffd700 1 -- 172.21.15.70:0/4052691784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40ffd30 msgr2=0x7f23e419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e2ffd700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40ffd30 0x7f23e419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e2ffd700 1 -- 172.21.15.70:0/4052691784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4105ba0 msgr2=0x7f23e41969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e2ffd700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4105ba0 0x7f23e41969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e2ffd700 1 -- 172.21.15.70:0/4052691784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80095f0 con 0x7f23e40ff380 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e27fc700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40ffd30 0x7f23e419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e2ffd700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 0x7f23e419c860 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f23d800b580 tx=0x7f23d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23cbfff700 1 -- 172.21.15.70:0/4052691784 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d801d070 con 0x7f23e40ff380 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e4197600 con 0x7f23e40ff380 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23cbfff700 1 -- 172.21.15.70:0/4052691784 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23d8004cf0 con 0x7f23e40ff380 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23cbfff700 1 -- 172.21.15.70:0/4052691784 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8005280 con 0x7f23e40ff380 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.043+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e41a3850 con 0x7f23e40ff380 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.044+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e4108d80 con 0x7f23e40ff380 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.045+0000 7f23cbfff700 1 -- 172.21.15.70:0/4052691784 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f23d800f7f0 con 0x7f23e40ff380 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.046+0000 7f23cbfff700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a1440 0x7f23cc0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.046+0000 7f23e27fc700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a1440 0x7f23cc0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.046+0000 7f23cbfff700 1 -- 172.21.15.70:0/4052691784 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f23d80cc230 con 0x7f23e40ff380 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.046+0000 7f23e27fc700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a1440 0x7f23cc0a3900 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f23d4005950 tx=0x7f23d40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.050+0000 7f23cbfff700 1 -- 172.21.15.70:0/4052691784 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f23d805c100 con 0x7f23e40ff380 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.252+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f23e4068860 con 0x7f23e40ff380 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.256+0000 7f23cbfff700 1 -- 172.21.15.70:0/4052691784 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v19)=0 v19) v1 ==== 127+0+0 (secure 0 0 0) 0x7f23d8097480 con 0x7f23e40ff380 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.258+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a1440 msgr2=0x7f23cc0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.258+0000 7f23e96e4700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a1440 0x7f23cc0a3900 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f23d4005950 tx=0x7f23d40058e0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.258+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 msgr2=0x7f23e419c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.258+0000 7f23e96e4700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 0x7f23e419c860 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f23d800b580 tx=0x7f23d80047c0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.259+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 shutdown_connections 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.259+0000 7f23e96e4700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a1440 0x7f23cc0a3900 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.259+0000 7f23e96e4700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4105ba0 0x7f23e41969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.259+0000 7f23e96e4700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e40ff380 0x7f23e419c860 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.259+0000 7f23e96e4700 1 --2- 172.21.15.70:0/4052691784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40ffd30 0x7f23e419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.259+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 >> 172.21.15.70:0/4052691784 conn(0x7f23e4074950 msgr2=0x7f23e4104ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.259+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 shutdown_connections 2023-10-08T08:36:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:56.259+0000 7f23e96e4700 1 -- 172.21.15.70:0/4052691784 wait complete. 2023-10-08T08:36:57.361 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:57 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4052691784' entity='client.admin' 2023-10-08T08:36:57.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:57 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4052691784' entity='client.admin' 2023-10-08T08:36:57.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:57 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4052691784' entity='client.admin' 2023-10-08T08:36:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 -- 172.21.15.70:0/2022737004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3350068b30 msgr2=0x7f335010d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 --2- 172.21.15.70:0/2022737004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3350068b30 0x7f335010d6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3348009990 tx=0x7f3348009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 -- 172.21.15.70:0/2022737004 shutdown_connections 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 --2- 172.21.15.70:0/2022737004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3350068b30 0x7f335010d6a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 --2- 172.21.15.70:0/2022737004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33501067d0 0x7f3350106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 --2- 172.21.15.70:0/2022737004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3350068190 0x7f33500685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 -- 172.21.15.70:0/2022737004 >> 172.21.15.70:0/2022737004 conn(0x7f3350075790 msgr2=0x7f3350075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 -- 172.21.15.70:0/2022737004 shutdown_connections 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 -- 172.21.15.70:0/2022737004 wait complete. 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.804+0000 7f3355354700 1 Processor -- start 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f3355354700 1 -- start start 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f3355354700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3350068190 0x7f335019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f3355354700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3350068b30 0x7f335019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f3355354700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33501067d0 0x7f3350196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f3355354700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350197070 con 0x7f33501067d0 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f3355354700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33501971e0 con 0x7f3350068190 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f3355354700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33501973a0 con 0x7f3350068b30 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33501067d0 0x7f3350196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33501067d0 0x7f3350196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47934/0 (socket says 172.21.15.70:47934) 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334f7fe700 1 -- 172.21.15.70:0/2243608678 learned_addr learned my addr 172.21.15.70:0/2243608678 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334e7fc700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3350068b30 0x7f335019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334effd700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3350068190 0x7f335019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334f7fe700 1 -- 172.21.15.70:0/2243608678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3350068b30 msgr2=0x7f335019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334f7fe700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3350068b30 0x7f335019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334f7fe700 1 -- 172.21.15.70:0/2243608678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3350068190 msgr2=0x7f335019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334f7fe700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3350068190 0x7f335019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334f7fe700 1 -- 172.21.15.70:0/2243608678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480095f0 con 0x7f33501067d0 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.805+0000 7f334f7fe700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33501067d0 0x7f3350196a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3348005b40 tx=0x7f334800f6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.806+0000 7f3347fff700 1 -- 172.21.15.70:0/2243608678 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334801d070 con 0x7f33501067d0 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.806+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3350197620 con 0x7f33501067d0 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.806+0000 7f3347fff700 1 -- 172.21.15.70:0/2243608678 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3348022470 con 0x7f33501067d0 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.806+0000 7f3347fff700 1 -- 172.21.15.70:0/2243608678 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348017650 con 0x7f33501067d0 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.806+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33501a3870 con 0x7f33501067d0 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.807+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3350108d80 con 0x7f33501067d0 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.808+0000 7f3347fff700 1 -- 172.21.15.70:0/2243608678 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f33480225e0 con 0x7f33501067d0 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.808+0000 7f3347fff700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f333c0a1440 0x7f333c0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.809+0000 7f3347fff700 1 -- 172.21.15.70:0/2243608678 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f33480cc520 con 0x7f33501067d0 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.809+0000 7f334effd700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f333c0a1440 0x7f333c0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.810+0000 7f334effd700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f333c0a1440 0x7f333c0a3900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3340007fd0 tx=0x7f334000c040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:57.812+0000 7f3347fff700 1 -- 172.21.15.70:0/2243608678 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3348097810 con 0x7f33501067d0 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.022+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7f335004e530 con 0x7f33501067d0 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.026+0000 7f3347fff700 1 -- 172.21.15.70:0/2243608678 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f335004e530 con 0x7f33501067d0 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.028+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f333c0a1440 msgr2=0x7f333c0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.028+0000 7f3355354700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f333c0a1440 0x7f333c0a3900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3340007fd0 tx=0x7f334000c040 comp rx=0 tx=0).stop 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.028+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33501067d0 msgr2=0x7f3350196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.028+0000 7f3355354700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33501067d0 0x7f3350196a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3348005b40 tx=0x7f334800f6e0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.028+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 shutdown_connections 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.029+0000 7f3355354700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f333c0a1440 0x7f333c0a3900 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.029+0000 7f3355354700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33501067d0 0x7f3350196a10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.029+0000 7f3355354700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3350068190 0x7f335019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.029+0000 7f3355354700 1 --2- 172.21.15.70:0/2243608678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3350068b30 0x7f335019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.029+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 >> 172.21.15.70:0/2243608678 conn(0x7f3350075790 msgr2=0x7f33500fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:58.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.029+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 shutdown_connections 2023-10-08T08:36:58.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.029+0000 7f3355354700 1 -- 172.21.15.70:0/2243608678 wait complete. 2023-10-08T08:36:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.357+0000 7fb5c6f16700 1 -- 172.21.15.70:0/3464546345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c00ff750 msgr2=0x7fb5c00ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.357+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/3464546345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c00ff750 0x7fb5c00ffbd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009990 tx=0x7fb5ac009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.357+0000 7fb5c6f16700 1 -- 172.21.15.70:0/3464546345 shutdown_connections 2023-10-08T08:36:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.357+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/3464546345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5c0100110 0x7fb5c010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.357+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/3464546345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c01056b0 0x7fb5c0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.357+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/3464546345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c00ff750 0x7fb5c00ffbd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.357+0000 7fb5c6f16700 1 -- 172.21.15.70:0/3464546345 >> 172.21.15.70:0/3464546345 conn(0x7fb5c0075790 msgr2=0x7fb5c0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.357+0000 7fb5c6f16700 1 -- 172.21.15.70:0/3464546345 shutdown_connections 2023-10-08T08:36:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.357+0000 7fb5c6f16700 1 -- 172.21.15.70:0/3464546345 wait complete. 2023-10-08T08:36:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c6f16700 1 Processor -- start 2023-10-08T08:36:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c6f16700 1 -- start start 2023-10-08T08:36:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c6f16700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c00ff750 0x7fb5c0195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c6f16700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c0100110 0x7fb5c01960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c6f16700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5c01056b0 0x7fb5c019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c6f16700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c019a9c0 con 0x7fb5c0100110 2023-10-08T08:36:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c6f16700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c019ab30 con 0x7fb5c00ff750 2023-10-08T08:36:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c6f16700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c019acf0 con 0x7fb5c01056b0 2023-10-08T08:36:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c0100110 0x7fb5c01960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c0100110 0x7fb5c01960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47946/0 (socket says 172.21.15.70:47946) 2023-10-08T08:36:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bffff700 1 -- 172.21.15.70:0/2541900351 learned_addr learned my addr 172.21.15.70:0/2541900351 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c54b3700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5c01056b0 0x7fb5c019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c4cb2700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c00ff750 0x7fb5c0195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bffff700 1 -- 172.21.15.70:0/2541900351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5c01056b0 msgr2=0x7fb5c019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bffff700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5c01056b0 0x7fb5c019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bffff700 1 -- 172.21.15.70:0/2541900351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c00ff750 msgr2=0x7fb5c0195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bffff700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c00ff750 0x7fb5c0195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bffff700 1 -- 172.21.15.70:0/2541900351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0095f0 con 0x7fb5c0100110 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c54b3700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5c01056b0 0x7fb5c019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5c4cb2700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c00ff750 0x7fb5c0195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bffff700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c0100110 0x7fb5c01960c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac000c00 tx=0x7fb5ac005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.358+0000 7fb5bdffb700 1 -- 172.21.15.70:0/2541900351 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac01d070 con 0x7fb5c0100110 2023-10-08T08:36:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.359+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c019af70 con 0x7fb5c0100110 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.359+0000 7fb5bdffb700 1 -- 172.21.15.70:0/2541900351 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5ac022470 con 0x7fb5c0100110 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.359+0000 7fb5bdffb700 1 -- 172.21.15.70:0/2541900351 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac017650 con 0x7fb5c0100110 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.359+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c01a2850 con 0x7fb5c0100110 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.360+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c0107cd0 con 0x7fb5c0100110 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.361+0000 7fb5bdffb700 1 -- 172.21.15.70:0/2541900351 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fb5ac0225e0 con 0x7fb5c0100110 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.361+0000 7fb5bdffb700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb5b00a1440 0x7fb5b00a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.361+0000 7fb5c4cb2700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb5b00a1440 0x7fb5b00a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.361+0000 7fb5bdffb700 1 -- 172.21.15.70:0/2541900351 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb5ac0cca10 con 0x7fb5c0100110 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.362+0000 7fb5c4cb2700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb5b00a1440 0x7fb5b00a3900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4005e10 tx=0x7fb5b4005d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.365+0000 7fb5bdffb700 1 -- 172.21.15.70:0/2541900351 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb5ac097d00 con 0x7fb5c0100110 2023-10-08T08:36:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.579+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7fb5c004e4c0 con 0x7fb5c0100110 2023-10-08T08:36:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.582+0000 7fb5bdffb700 1 -- 172.21.15.70:0/2541900351 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v21)=0 v21) v1 ==== 116+0+0 (secure 0 0 0) 0x7fb5ac0270b0 con 0x7fb5c0100110 2023-10-08T08:36:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb5b00a1440 msgr2=0x7fb5b00a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb5b00a1440 0x7fb5b00a3900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4005e10 tx=0x7fb5b4005d20 comp rx=0 tx=0).stop 2023-10-08T08:36:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c0100110 msgr2=0x7fb5c01960c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c0100110 0x7fb5c01960c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac000c00 tx=0x7fb5ac005ef0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 shutdown_connections 2023-10-08T08:36:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb5b00a1440 0x7fb5b00a3900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5c01056b0 0x7fb5c019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5c00ff750 0x7fb5c0195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 --2- 172.21.15.70:0/2541900351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5c0100110 0x7fb5c01960c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:58.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 >> 172.21.15.70:0/2541900351 conn(0x7fb5c0075790 msgr2=0x7fb5c00fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:58.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 shutdown_connections 2023-10-08T08:36:58.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.585+0000 7fb5c6f16700 1 -- 172.21.15.70:0/2541900351 wait complete. 2023-10-08T08:36:59.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 -- 172.21.15.70:0/380595234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c068190 msgr2=0x7f9d4c0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 --2- 172.21.15.70:0/380595234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c068190 0x7f9d4c0685f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009990 tx=0x7f9d40009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 -- 172.21.15.70:0/380595234 shutdown_connections 2023-10-08T08:36:59.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 --2- 172.21.15.70:0/380595234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c068b30 0x7f9d4c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 --2- 172.21.15.70:0/380595234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4c1067a0 0x7f9d4c106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 --2- 172.21.15.70:0/380595234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c068190 0x7f9d4c0685f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 -- 172.21.15.70:0/380595234 >> 172.21.15.70:0/380595234 conn(0x7f9d4c075790 msgr2=0x7f9d4c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:59.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 -- 172.21.15.70:0/380595234 shutdown_connections 2023-10-08T08:36:59.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 -- 172.21.15.70:0/380595234 wait complete. 2023-10-08T08:36:59.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.909+0000 7f9d51120700 1 Processor -- start 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d51120700 1 -- start start 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d51120700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4c068190 0x7f9d4c0ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d51120700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c068b30 0x7f9d4c0ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d51120700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c1067a0 0x7f9d4c1002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d51120700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1017e0 con 0x7f9d4c1067a0 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d51120700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1a95d0 con 0x7f9d4c068190 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d51120700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1a9790 con 0x7f9d4c068b30 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4b59e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c1067a0 0x7f9d4c1002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4b59e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c1067a0 0x7f9d4c1002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47976/0 (socket says 172.21.15.70:47976) 2023-10-08T08:36:59.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4b59e700 1 -- 172.21.15.70:0/3004135366 learned_addr learned my addr 172.21.15.70:0/3004135366 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:59.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4ad9d700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4c068190 0x7f9d4c0ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4a59c700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c068b30 0x7f9d4c0ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4b59e700 1 -- 172.21.15.70:0/3004135366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c068b30 msgr2=0x7f9d4c0ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4b59e700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c068b30 0x7f9d4c0ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4b59e700 1 -- 172.21.15.70:0/3004135366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4c068190 msgr2=0x7f9d4c0ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4b59e700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4c068190 0x7f9d4c0ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.910+0000 7f9d4b59e700 1 -- 172.21.15.70:0/3004135366 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d400095f0 con 0x7f9d4c1067a0 2023-10-08T08:36:59.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.911+0000 7f9d4b59e700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c1067a0 0x7f9d4c1002a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9d44007ee0 tx=0x7f9d4400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.911+0000 7f9d33fff700 1 -- 172.21.15.70:0/3004135366 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44017070 con 0x7f9d4c1067a0 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.911+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c1a9a70 con 0x7f9d4c1067a0 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.911+0000 7f9d33fff700 1 -- 172.21.15.70:0/3004135366 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d4400f040 con 0x7f9d4c1067a0 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.911+0000 7f9d33fff700 1 -- 172.21.15.70:0/3004135366 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44005610 con 0x7f9d4c1067a0 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.911+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c1a9f40 con 0x7f9d4c1067a0 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.912+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c108d50 con 0x7f9d4c1067a0 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.914+0000 7f9d33fff700 1 -- 172.21.15.70:0/3004135366 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f9d44004c40 con 0x7f9d4c1067a0 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.914+0000 7f9d33fff700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9d340a1440 0x7f9d340a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.915+0000 7f9d4ad9d700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9d340a1440 0x7f9d340a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.915+0000 7f9d33fff700 1 -- 172.21.15.70:0/3004135366 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f9d440cae00 con 0x7f9d4c1067a0 2023-10-08T08:36:59.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.915+0000 7f9d4ad9d700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9d340a1440 0x7f9d340a3900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c005950 tx=0x7f9d3c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.918+0000 7f9d33fff700 1 -- 172.21.15.70:0/3004135366 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9d44096060 con 0x7f9d4c1067a0 2023-10-08T08:36:59.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.132+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f9d4c101ee0 con 0x7f9d4c1067a0 2023-10-08T08:36:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.136+0000 7f9d33fff700 1 -- 172.21.15.70:0/3004135366 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) v1 ==== 120+0+0 (secure 0 0 0) 0x7f9d44099680 con 0x7f9d4c1067a0 2023-10-08T08:36:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9d340a1440 msgr2=0x7f9d340a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9d340a1440 0x7f9d340a3900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c005950 tx=0x7f9d3c00b410 comp rx=0 tx=0).stop 2023-10-08T08:36:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c1067a0 msgr2=0x7f9d4c1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c1067a0 0x7f9d4c1002a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9d44007ee0 tx=0x7f9d4400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 shutdown_connections 2023-10-08T08:36:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9d340a1440 0x7f9d340a3900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d4c1067a0 0x7f9d4c1002a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d4c068190 0x7f9d4c0ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 --2- 172.21.15.70:0/3004135366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d4c068b30 0x7f9d4c0ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 >> 172.21.15.70:0/3004135366 conn(0x7f9d4c075790 msgr2=0x7f9d4c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:59.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 shutdown_connections 2023-10-08T08:36:59.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.139+0000 7f9d51120700 1 -- 172.21.15.70:0/3004135366 wait complete. 2023-10-08T08:36:59.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.142+0000 7f7ad9166700 1 -- 172.21.15.70:0/2581235136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 msgr2=0x7f7ad40ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.142+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2581235136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 0x7f7ad40ffbd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009990 tx=0x7f7ac8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.142+0000 7f7ad9166700 1 -- 172.21.15.70:0/2581235136 shutdown_connections 2023-10-08T08:36:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.142+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2581235136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad4100110 0x7f7ad410c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.142+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2581235136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ad4105690 0x7f7ad4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.142+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2581235136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 0x7f7ad40ffbd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.142+0000 7f7ad9166700 1 -- 172.21.15.70:0/2581235136 >> 172.21.15.70:0/2581235136 conn(0x7f7ad40757d0 msgr2=0x7f7ad4075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.142+0000 7f7ad9166700 1 -- 172.21.15.70:0/2581235136 shutdown_connections 2023-10-08T08:36:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.142+0000 7f7ad9166700 1 -- 172.21.15.70:0/2581235136 wait complete. 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.143+0000 7f7ad9166700 1 Processor -- start 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.143+0000 7f7ad9166700 1 -- start start 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad9166700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 0x7f7ad41958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad9166700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ad4100110 0x7f7ad4195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad9166700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad4105690 0x7f7ad4196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad9166700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41a4ff0 con 0x7f7ad40ff750 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad9166700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41a5130 con 0x7f7ad4100110 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad9166700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41a52f0 con 0x7f7ad4105690 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad2d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 0x7f7ad41958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad2d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 0x7f7ad41958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47986/0 (socket says 172.21.15.70:47986) 2023-10-08T08:36:59.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad2d9d700 1 -- 172.21.15.70:0/2811449428 learned_addr learned my addr 172.21.15.70:0/2811449428 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad359e700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad4105690 0x7f7ad4196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad259c700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ad4100110 0x7f7ad4195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad2d9d700 1 -- 172.21.15.70:0/2811449428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad4105690 msgr2=0x7f7ad4196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad2d9d700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad4105690 0x7f7ad4196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad2d9d700 1 -- 172.21.15.70:0/2811449428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ad4100110 msgr2=0x7f7ad4195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad2d9d700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ad4100110 0x7f7ad4195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad2d9d700 1 -- 172.21.15.70:0/2811449428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80095f0 con 0x7f7ad40ff750 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad2d9d700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 0x7f7ad41958a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400d950 tx=0x7f7ac400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7abbfff700 1 -- 172.21.15.70:0/2811449428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4009940 con 0x7f7ad40ff750 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7abbfff700 1 -- 172.21.15.70:0/2811449428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ac4010460 con 0x7f7ad40ff750 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.144+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad41a55d0 con 0x7f7ad40ff750 2023-10-08T08:36:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.145+0000 7f7abbfff700 1 -- 172.21.15.70:0/2811449428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400f620 con 0x7f7ad40ff750 2023-10-08T08:36:59.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.145+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad41a5b20 con 0x7f7ad40ff750 2023-10-08T08:36:59.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.145+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad4107c20 con 0x7f7ad40ff750 2023-10-08T08:36:59.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.147+0000 7f7abbfff700 1 -- 172.21.15.70:0/2811449428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f7ac40108d0 con 0x7f7ad40ff750 2023-10-08T08:36:59.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.148+0000 7f7abbfff700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7abc0a14c0 0x7f7abc0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.148+0000 7f7ad259c700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7abc0a14c0 0x7f7abc0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.148+0000 7f7abbfff700 1 -- 172.21.15.70:0/2811449428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f7ac40caeb0 con 0x7f7ad40ff750 2023-10-08T08:36:59.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.148+0000 7f7ad259c700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7abc0a14c0 0x7f7abc0a3980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800b5c0 tx=0x7f7ac801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.152+0000 7f7abbfff700 1 -- 172.21.15.70:0/2811449428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ac4096110 con 0x7f7ad40ff750 2023-10-08T08:36:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.197+0000 7f3a72780700 1 -- 172.21.15.70:0/4278722447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068190 msgr2=0x7f3a6c0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.197+0000 7f3a72780700 1 --2- 172.21.15.70:0/4278722447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068190 0x7f3a6c0685f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009990 tx=0x7f3a60009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.197+0000 7f3a72780700 1 -- 172.21.15.70:0/4278722447 shutdown_connections 2023-10-08T08:36:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.197+0000 7f3a72780700 1 --2- 172.21.15.70:0/4278722447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c068b30 0x7f3a6c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.197+0000 7f3a72780700 1 --2- 172.21.15.70:0/4278722447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a6c1067a0 0x7f3a6c106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.197+0000 7f3a72780700 1 --2- 172.21.15.70:0/4278722447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068190 0x7f3a6c0685f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.197+0000 7f3a72780700 1 -- 172.21.15.70:0/4278722447 >> 172.21.15.70:0/4278722447 conn(0x7f3a6c075790 msgr2=0x7f3a6c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.197+0000 7f3a72780700 1 -- 172.21.15.70:0/4278722447 shutdown_connections 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.197+0000 7f3a72780700 1 -- 172.21.15.70:0/4278722447 wait complete. 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a72780700 1 Processor -- start 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a72780700 1 -- start start 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a72780700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c068190 0x7f3a6c19c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a72780700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068b30 0x7f3a6c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a72780700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a6c1067a0 0x7f3a6c196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a72780700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c197090 con 0x7f3a6c068b30 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a72780700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c1971d0 con 0x7f3a6c068190 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a72780700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c197390 con 0x7f3a6c1067a0 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a6b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068b30 0x7f3a6c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a6b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068b30 0x7f3a6c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48002/0 (socket says 172.21.15.70:48002) 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.198+0000 7f3a6b7fe700 1 -- 172.21.15.70:0/1507002485 learned_addr learned my addr 172.21.15.70:0/1507002485 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a6bfff700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c068190 0x7f3a6c19c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a70d1d700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a6c1067a0 0x7f3a6c196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a6b7fe700 1 -- 172.21.15.70:0/1507002485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a6c1067a0 msgr2=0x7f3a6c196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a6b7fe700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a6c1067a0 0x7f3a6c196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a6b7fe700 1 -- 172.21.15.70:0/1507002485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c068190 msgr2=0x7f3a6c19c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a6b7fe700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c068190 0x7f3a6c19c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a6b7fe700 1 -- 172.21.15.70:0/1507002485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a600095f0 con 0x7f3a6c068b30 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a70d1d700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a6c1067a0 0x7f3a6c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a6b7fe700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068b30 0x7f3a6c19cd60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009fd0 tx=0x7f3a6000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a697fa700 1 -- 172.21.15.70:0/1507002485 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6001d070 con 0x7f3a6c068b30 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a697fa700 1 -- 172.21.15.70:0/1507002485 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a60005510 con 0x7f3a6c068b30 2023-10-08T08:36:59.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c197610 con 0x7f3a6c068b30 2023-10-08T08:36:59.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a697fa700 1 -- 172.21.15.70:0/1507002485 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60004a90 con 0x7f3a6c068b30 2023-10-08T08:36:59.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.199+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c1a38c0 con 0x7f3a6c068b30 2023-10-08T08:36:59.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.200+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c108d50 con 0x7f3a6c068b30 2023-10-08T08:36:59.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.201+0000 7f3a697fa700 1 -- 172.21.15.70:0/1507002485 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f3a60004c70 con 0x7f3a6c068b30 2023-10-08T08:36:59.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.201+0000 7f3a697fa700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a540a1440 0x7f3a540a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.202+0000 7f3a697fa700 1 -- 172.21.15.70:0/1507002485 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f3a600cbe40 con 0x7f3a6c068b30 2023-10-08T08:36:59.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.202+0000 7f3a6bfff700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a540a1440 0x7f3a540a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.202+0000 7f3a6bfff700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a540a1440 0x7f3a540a3900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c105b20 tx=0x7f3a5c0073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.206+0000 7f3a697fa700 1 -- 172.21.15.70:0/1507002485 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a60097130 con 0x7f3a6c068b30 2023-10-08T08:36:59.253 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:59 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2243608678' entity='client.admin' 2023-10-08T08:36:59.254 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:59 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2541900351' entity='client.admin' 2023-10-08T08:36:59.254 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:36:59 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/786631344' entity='client.admin' 2023-10-08T08:36:59.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:59 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2243608678' entity='client.admin' 2023-10-08T08:36:59.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:59 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2541900351' entity='client.admin' 2023-10-08T08:36:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:36:59 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/786631344' entity='client.admin' 2023-10-08T08:36:59.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.795+0000 7f0b47141700 1 -- 172.21.15.70:0/4046787979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40068190 msgr2=0x7f0b400685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.795+0000 7f0b47141700 1 --2- 172.21.15.70:0/4046787979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40068190 0x7f0b400685f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009990 tx=0x7f0b2c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.795+0000 7f0b47141700 1 -- 172.21.15.70:0/4046787979 shutdown_connections 2023-10-08T08:36:59.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.795+0000 7f0b47141700 1 --2- 172.21.15.70:0/4046787979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b40068b30 0x7f0b4010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.795+0000 7f0b47141700 1 --2- 172.21.15.70:0/4046787979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b401067a0 0x7f0b40106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.795+0000 7f0b47141700 1 --2- 172.21.15.70:0/4046787979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b40068190 0x7f0b400685f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.795+0000 7f0b47141700 1 -- 172.21.15.70:0/4046787979 >> 172.21.15.70:0/4046787979 conn(0x7f0b40075790 msgr2=0x7f0b40075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:59.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.795+0000 7f0b47141700 1 -- 172.21.15.70:0/4046787979 shutdown_connections 2023-10-08T08:36:59.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.795+0000 7f0b47141700 1 -- 172.21.15.70:0/4046787979 wait complete. 2023-10-08T08:36:59.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.796+0000 7f0b47141700 1 Processor -- start 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.796+0000 7f0b47141700 1 -- start start 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.796+0000 7f0b47141700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b40068190 0x7f0b400ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b47141700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b40068b30 0x7f0b400ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b47141700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b401067a0 0x7f0b401002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b47141700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b401a5020 con 0x7f0b401067a0 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b47141700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b401a5190 con 0x7f0b40068b30 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b47141700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b401a5350 con 0x7f0b40068190 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b456de700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b401067a0 0x7f0b401002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b456de700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b401067a0 0x7f0b401002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47962/0 (socket says 172.21.15.70:47962) 2023-10-08T08:36:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b456de700 1 -- 172.21.15.70:0/786631344 learned_addr learned my addr 172.21.15.70:0/786631344 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b44edd700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b40068190 0x7f0b400ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b3ffff700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b40068b30 0x7f0b400ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b456de700 1 -- 172.21.15.70:0/786631344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b40068190 msgr2=0x7f0b400ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b456de700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b40068190 0x7f0b400ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b456de700 1 -- 172.21.15.70:0/786631344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b40068b30 msgr2=0x7f0b400ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b456de700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b40068b30 0x7f0b400ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b456de700 1 -- 172.21.15.70:0/786631344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c0095f0 con 0x7f0b401067a0 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b456de700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b401067a0 0x7f0b401002a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0b38007ee0 tx=0x7f0b3800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b3dffb700 1 -- 172.21.15.70:0/786631344 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38017070 con 0x7f0b401067a0 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b3dffb700 1 -- 172.21.15.70:0/786631344 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b3800f040 con 0x7f0b401067a0 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b401a5630 con 0x7f0b401067a0 2023-10-08T08:36:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.797+0000 7f0b3dffb700 1 -- 172.21.15.70:0/786631344 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38005740 con 0x7f0b401067a0 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.798+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b401a5b80 con 0x7f0b401067a0 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.799+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b40108d50 con 0x7f0b401067a0 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.799+0000 7f0b3dffb700 1 -- 172.21.15.70:0/786631344 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f0b3800dc60 con 0x7f0b401067a0 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.800+0000 7f0b3dffb700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b300a14c0 0x7f0b300a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.800+0000 7f0b44edd700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b300a14c0 0x7f0b300a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.800+0000 7f0b3dffb700 1 -- 172.21.15.70:0/786631344 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f0b380ca8c0 con 0x7f0b401067a0 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.801+0000 7f0b44edd700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b300a14c0 0x7f0b300a3980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005950 tx=0x7f0b3400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:58.805+0000 7f0b3dffb700 1 -- 172.21.15.70:0/786631344 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0b38095b20 con 0x7f0b401067a0 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.013+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7f0b40100d00 con 0x7f0b401067a0 2023-10-08T08:36:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.017+0000 7f0b3dffb700 1 -- 172.21.15.70:0/786631344 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) v1 ==== 106+0+0 (secure 0 0 0) 0x7f0b38099140 con 0x7f0b401067a0 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b300a14c0 msgr2=0x7f0b300a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b300a14c0 0x7f0b300a3980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005950 tx=0x7f0b3400b410 comp rx=0 tx=0).stop 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b401067a0 msgr2=0x7f0b401002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b401067a0 0x7f0b401002a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0b38007ee0 tx=0x7f0b3800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 shutdown_connections 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b300a14c0 0x7f0b300a3980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b401067a0 0x7f0b401002a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b40068190 0x7f0b400ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 --2- 172.21.15.70:0/786631344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b40068b30 0x7f0b400ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 >> 172.21.15.70:0/786631344 conn(0x7f0b40075790 msgr2=0x7f0b400fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 shutdown_connections 2023-10-08T08:36:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.019+0000 7f0b47141700 1 -- 172.21.15.70:0/786631344 wait complete. 2023-10-08T08:36:59.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.385+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f7ad4100dd0 con 0x7f7ad40ff750 2023-10-08T08:36:59.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.388+0000 7f7abbfff700 1 -- 172.21.15.70:0/2811449428 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7ac40160b0 con 0x7f7ad40ff750 2023-10-08T08:36:59.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7abc0a14c0 msgr2=0x7f7abc0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7abc0a14c0 0x7f7abc0a3980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800b5c0 tx=0x7f7ac801a040 comp rx=0 tx=0).stop 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 msgr2=0x7f7ad41958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 0x7f7ad41958a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400d950 tx=0x7f7ac400dc60 comp rx=0 tx=0).stop 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 shutdown_connections 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7abc0a14c0 0x7f7abc0a3980 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800b5c0 tx=0x7f7ac801a040 comp rx=0 tx=0).stop 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad4105690 0x7f7ad4196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad40ff750 0x7f7ad41958a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 --2- 172.21.15.70:0/2811449428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ad4100110 0x7f7ad4195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.390+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 >> 172.21.15.70:0/2811449428 conn(0x7f7ad40757d0 msgr2=0x7f7ad40fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.391+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 shutdown_connections 2023-10-08T08:36:59.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.391+0000 7f7ad9166700 1 -- 172.21.15.70:0/2811449428 wait complete. 2023-10-08T08:36:59.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.430+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f3a6c197f10 con 0x7f3a6c068b30 2023-10-08T08:36:59.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.434+0000 7f3a697fa700 1 -- 172.21.15.70:0/1507002485 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v25)=0 v25) v1 ==== 119+0+0 (secure 0 0 0) 0x7f3a6009a750 con 0x7f3a6c068b30 2023-10-08T08:36:59.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a540a1440 msgr2=0x7f3a540a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a540a1440 0x7f3a540a3900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c105b20 tx=0x7f3a5c0073d0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068b30 msgr2=0x7f3a6c19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068b30 0x7f3a6c19cd60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009fd0 tx=0x7f3a6000f670 comp rx=0 tx=0).stop 2023-10-08T08:36:59.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 shutdown_connections 2023-10-08T08:36:59.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a540a1440 0x7f3a540a3900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a6c1067a0 0x7f3a6c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6c068190 0x7f3a6c19c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 --2- 172.21.15.70:0/1507002485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c068b30 0x7f3a6c19cd60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 >> 172.21.15.70:0/1507002485 conn(0x7f3a6c075790 msgr2=0x7f3a6c0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:59.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 shutdown_connections 2023-10-08T08:36:59.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.437+0000 7f3a72780700 1 -- 172.21.15.70:0/1507002485 wait complete. 2023-10-08T08:36:59.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:59 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2243608678' entity='client.admin' 2023-10-08T08:36:59.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:59 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2541900351' entity='client.admin' 2023-10-08T08:36:59.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:36:59 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/786631344' entity='client.admin' 2023-10-08T08:36:59.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 -- 172.21.15.70:0/158183309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 msgr2=0x7f7308104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 --2- 172.21.15.70:0/158183309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 0x7f7308104990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f730000b0a0 tx=0x7f730000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 -- 172.21.15.70:0/158183309 shutdown_connections 2023-10-08T08:36:59.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 --2- 172.21.15.70:0/158183309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73081000a0 0x7f730810c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 --2- 172.21.15.70:0/158183309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 0x7f7308104990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 --2- 172.21.15.70:0/158183309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73080ff6e0 0x7f73080ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 -- 172.21.15.70:0/158183309 >> 172.21.15.70:0/158183309 conn(0x7f73080766c0 msgr2=0x7f7308076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:36:59.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 -- 172.21.15.70:0/158183309 shutdown_connections 2023-10-08T08:36:59.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 -- 172.21.15.70:0/158183309 wait complete. 2023-10-08T08:36:59.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 Processor -- start 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.990+0000 7f730f8e0700 1 -- start start 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730f8e0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73080ff6e0 0x7f7308197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730f8e0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73081000a0 0x7f73081980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730f8e0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 0x7f73081a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730f8e0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73081989b0 con 0x7f73081045b0 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730f8e0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73081a3170 con 0x7f73081000a0 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730f8e0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73081a32b0 con 0x7f73080ff6e0 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730de7d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 0x7f73081a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730de7d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 0x7f73081a2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48032/0 (socket says 172.21.15.70:48032) 2023-10-08T08:36:59.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730de7d700 1 -- 172.21.15.70:0/874490083 learned_addr learned my addr 172.21.15.70:0/874490083 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730d67c700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73080ff6e0 0x7f7308197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730ce7b700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73081000a0 0x7f73081980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730de7d700 1 -- 172.21.15.70:0/874490083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73080ff6e0 msgr2=0x7f7308197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730de7d700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73080ff6e0 0x7f7308197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730de7d700 1 -- 172.21.15.70:0/874490083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73081000a0 msgr2=0x7f73081980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730de7d700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73081000a0 0x7f73081980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730de7d700 1 -- 172.21.15.70:0/874490083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7300009d00 con 0x7f73081045b0 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730de7d700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 0x7f73081a2c30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72f800d980 tx=0x7f72f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f73067fc700 1 -- 172.21.15.70:0/874490083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8004a30 con 0x7f73081045b0 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f73067fc700 1 -- 172.21.15.70:0/874490083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72f800b5c0 con 0x7f73081045b0 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73081a3530 con 0x7f73081045b0 2023-10-08T08:36:59.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f73067fc700 1 -- 172.21.15.70:0/874490083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8009b50 con 0x7f73081045b0 2023-10-08T08:36:59.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.991+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73081a39e0 con 0x7f73081045b0 2023-10-08T08:36:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.992+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7308107c20 con 0x7f73081045b0 2023-10-08T08:36:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.994+0000 7f73067fc700 1 -- 172.21.15.70:0/874490083 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f72f8009cb0 con 0x7f73081045b0 2023-10-08T08:36:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.994+0000 7f73067fc700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72f00a1440 0x7f72f00a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:36:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.994+0000 7f730d67c700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72f00a1440 0x7f72f00a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:36:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.994+0000 7f73067fc700 1 -- 172.21.15.70:0/874490083 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f72f80cb310 con 0x7f73081045b0 2023-10-08T08:36:59.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.995+0000 7f730d67c700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72f00a1440 0x7f72f00a3900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7300009fd0 tx=0x7f730000b720 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:36:59.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.998+0000 7f73067fc700 1 -- 172.21.15.70:0/874490083 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f72f8096570 con 0x7f73081045b0 2023-10-08T08:37:00.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.204+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7f73080690c0 con 0x7f73081045b0 2023-10-08T08:37:00.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.209+0000 7f73067fc700 1 -- 172.21.15.70:0/874490083 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v27)=0 v27) v1 ==== 121+0+0 (secure 0 0 0) 0x7f72f8017070 con 0x7f73081045b0 2023-10-08T08:37:00.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.211+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72f00a1440 msgr2=0x7f72f00a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:00.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.211+0000 7f730f8e0700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72f00a1440 0x7f72f00a3900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7300009fd0 tx=0x7f730000b720 comp rx=0 tx=0).stop 2023-10-08T08:37:00.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.211+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 msgr2=0x7f73081a2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:00.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.211+0000 7f730f8e0700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 0x7f73081a2c30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72f800d980 tx=0x7f72f800dc90 comp rx=0 tx=0).stop 2023-10-08T08:37:00.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.212+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 shutdown_connections 2023-10-08T08:37:00.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.212+0000 7f730f8e0700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72f00a1440 0x7f72f00a3900 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.212+0000 7f730f8e0700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73081045b0 0x7f73081a2c30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.212+0000 7f730f8e0700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73080ff6e0 0x7f7308197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.212+0000 7f730f8e0700 1 --2- 172.21.15.70:0/874490083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73081000a0 0x7f73081980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.212+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 >> 172.21.15.70:0/874490083 conn(0x7f73080766c0 msgr2=0x7f73080fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:00.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.212+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 shutdown_connections 2023-10-08T08:37:00.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:00.212+0000 7f730f8e0700 1 -- 172.21.15.70:0/874490083 wait complete. 2023-10-08T08:37:00.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.606+0000 7fbc62231700 1 -- 172.21.15.70:0/185760416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 msgr2=0x7fbc5c0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:00.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.606+0000 7fbc62231700 1 --2- 172.21.15.70:0/185760416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 0x7fbc5c0ffbd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009990 tx=0x7fbc50009ca0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.606+0000 7fbc62231700 1 -- 172.21.15.70:0/185760416 shutdown_connections 2023-10-08T08:37:00.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.606+0000 7fbc62231700 1 --2- 172.21.15.70:0/185760416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc5c100110 0x7fbc5c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.606+0000 7fbc62231700 1 --2- 172.21.15.70:0/185760416 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c1056b0 0x7fbc5c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.606+0000 7fbc62231700 1 --2- 172.21.15.70:0/185760416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 0x7fbc5c0ffbd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.606+0000 7fbc62231700 1 -- 172.21.15.70:0/185760416 >> 172.21.15.70:0/185760416 conn(0x7fbc5c075790 msgr2=0x7fbc5c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:00.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.606+0000 7fbc62231700 1 -- 172.21.15.70:0/185760416 shutdown_connections 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.606+0000 7fbc62231700 1 -- 172.21.15.70:0/185760416 wait complete. 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.607+0000 7fbc62231700 1 Processor -- start 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.607+0000 7fbc62231700 1 -- start start 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc62231700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 0x7fbc5c19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc62231700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc5c100110 0x7fbc5c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc62231700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c1056b0 0x7fbc5c195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc62231700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c196130 con 0x7fbc5c0ff750 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc62231700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c1962a0 con 0x7fbc5c100110 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc62231700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c196460 con 0x7fbc5c1056b0 2023-10-08T08:37:00.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 0x7fbc5c19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:00.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 0x7fbc5c19b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48014/0 (socket says 172.21.15.70:48014) 2023-10-08T08:37:00.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5b7fe700 1 -- 172.21.15.70:0/926679305 learned_addr learned my addr 172.21.15.70:0/926679305 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:37:00.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5affd700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc5c100110 0x7fbc5c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:00.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5bfff700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c1056b0 0x7fbc5c195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:00.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5b7fe700 1 -- 172.21.15.70:0/926679305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c1056b0 msgr2=0x7fbc5c195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:00.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5b7fe700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c1056b0 0x7fbc5c195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5b7fe700 1 -- 172.21.15.70:0/926679305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc5c100110 msgr2=0x7fbc5c19bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:00.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5b7fe700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc5c100110 0x7fbc5c19bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5b7fe700 1 -- 172.21.15.70:0/926679305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500095f0 con 0x7fbc5c0ff750 2023-10-08T08:37:00.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5bfff700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c1056b0 0x7fbc5c195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:37:00.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5affd700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc5c100110 0x7fbc5c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:37:00.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc5b7fe700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 0x7fbc5c19b880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00d9e0 tx=0x7fbc4c00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:00.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc58ff9700 1 -- 172.21.15.70:0/926679305 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00ecd0 con 0x7fbc5c0ff750 2023-10-08T08:37:00.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.608+0000 7fbc58ff9700 1 -- 172.21.15.70:0/926679305 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc4c00ee30 con 0x7fbc5c0ff750 2023-10-08T08:37:00.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.609+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c1966e0 con 0x7fbc5c0ff750 2023-10-08T08:37:00.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.609+0000 7fbc58ff9700 1 -- 172.21.15.70:0/926679305 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c014800 con 0x7fbc5c0ff750 2023-10-08T08:37:00.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.609+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c0683b0 con 0x7fbc5c0ff750 2023-10-08T08:37:00.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.609+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c100df0 con 0x7fbc5c0ff750 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.611+0000 7fbc58ff9700 1 -- 172.21.15.70:0/926679305 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fbc4c016b20 con 0x7fbc5c0ff750 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.612+0000 7fbc58ff9700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbc440a14c0 0x7fbc440a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.612+0000 7fbc58ff9700 1 -- 172.21.15.70:0/926679305 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fbc4c0cc960 con 0x7fbc5c0ff750 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.612+0000 7fbc5affd700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbc440a14c0 0x7fbc440a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.613+0000 7fbc5affd700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbc440a14c0 0x7fbc440a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc50000c00 tx=0x7fbc50005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.617+0000 7fbc58ff9700 1 -- 172.21.15.70:0/926679305 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbc4c051100 con 0x7fbc5c0ff750 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.815+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fbc5c10f6a0 con 0x7fbc5c0ff750 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.818+0000 7fbc58ff9700 1 -- 172.21.15.70:0/926679305 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v26)=0 v26) v1 ==== 133+0+0 (secure 0 0 0) 0x7fbc4c097c50 con 0x7fbc5c0ff750 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbc440a14c0 msgr2=0x7fbc440a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbc440a14c0 0x7fbc440a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc50000c00 tx=0x7fbc50005fb0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 msgr2=0x7fbc5c19b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:00.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 0x7fbc5c19b880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00d9e0 tx=0x7fbc4c00dda0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 shutdown_connections 2023-10-08T08:37:00.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbc440a14c0 0x7fbc440a3980 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c1056b0 0x7fbc5c195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c0ff750 0x7fbc5c19b880 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 --2- 172.21.15.70:0/926679305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc5c100110 0x7fbc5c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:00.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 >> 172.21.15.70:0/926679305 conn(0x7fbc5c075790 msgr2=0x7fbc5c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:00.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 shutdown_connections 2023-10-08T08:37:00.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:36:59.821+0000 7fbc62231700 1 -- 172.21.15.70:0/926679305 wait complete. 2023-10-08T08:37:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:00 smithi070 ceph-mon[99513]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:00 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3004135366' entity='client.admin' 2023-10-08T08:37:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:00 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2811449428' entity='client.admin' 2023-10-08T08:37:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:00 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1507002485' entity='client.admin' 2023-10-08T08:37:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:00 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/926679305' entity='client.admin' 2023-10-08T08:37:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:00 smithi105 ceph-mon[103798]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:00 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3004135366' entity='client.admin' 2023-10-08T08:37:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:00 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2811449428' entity='client.admin' 2023-10-08T08:37:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:00 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1507002485' entity='client.admin' 2023-10-08T08:37:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:00 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/926679305' entity='client.admin' 2023-10-08T08:37:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:00 smithi191 ceph-mon[104220]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:00 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3004135366' entity='client.admin' 2023-10-08T08:37:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:00 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2811449428' entity='client.admin' 2023-10-08T08:37:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:00 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1507002485' entity='client.admin' 2023-10-08T08:37:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:00 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/926679305' entity='client.admin' 2023-10-08T08:37:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:00.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:00.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:00.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:01.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:01 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/874490083' entity='client.admin' 2023-10-08T08:37:01.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:01 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/874490083' entity='client.admin' 2023-10-08T08:37:01.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:01 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/874490083' entity='client.admin' 2023-10-08T08:37:01.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.873+0000 7f253382c700 1 -- 172.21.15.70:0/589651772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c068190 msgr2=0x7f252c0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:01.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.874+0000 7f253382c700 1 --2- 172.21.15.70:0/589651772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c068190 0x7f252c0685f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f251c009990 tx=0x7f251c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:37:01.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.874+0000 7f253382c700 1 -- 172.21.15.70:0/589651772 shutdown_connections 2023-10-08T08:37:01.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.874+0000 7f253382c700 1 --2- 172.21.15.70:0/589651772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f252c068b30 0x7f252c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:01.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.874+0000 7f253382c700 1 --2- 172.21.15.70:0/589651772 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f252c1067a0 0x7f252c106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:01.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.874+0000 7f253382c700 1 --2- 172.21.15.70:0/589651772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c068190 0x7f252c0685f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:01.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.874+0000 7f253382c700 1 -- 172.21.15.70:0/589651772 >> 172.21.15.70:0/589651772 conn(0x7f252c075790 msgr2=0x7f252c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:01.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.874+0000 7f253382c700 1 -- 172.21.15.70:0/589651772 shutdown_connections 2023-10-08T08:37:01.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.874+0000 7f253382c700 1 -- 172.21.15.70:0/589651772 wait complete. 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f253382c700 1 Processor -- start 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f253382c700 1 -- start start 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f253382c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f252c068190 0x7f252c19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f253382c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f252c068b30 0x7f252c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f253382c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c1067a0 0x7f252c196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f253382c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c197170 con 0x7f252c1067a0 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f253382c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c1972e0 con 0x7f252c068b30 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f253382c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c1974a0 con 0x7f252c068190 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f2531dc9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c1067a0 0x7f252c196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f2531dc9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c1067a0 0x7f252c196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48058/0 (socket says 172.21.15.70:48058) 2023-10-08T08:37:01.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f2531dc9700 1 -- 172.21.15.70:0/3551340164 learned_addr learned my addr 172.21.15.70:0/3551340164 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f25315c8700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f252c068190 0x7f252c19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.875+0000 7f2530dc7700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f252c068b30 0x7f252c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f2531dc9700 1 -- 172.21.15.70:0/3551340164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f252c068190 msgr2=0x7f252c19c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f2531dc9700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f252c068190 0x7f252c19c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f2531dc9700 1 -- 172.21.15.70:0/3551340164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f252c068b30 msgr2=0x7f252c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f2531dc9700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f252c068b30 0x7f252c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f2531dc9700 1 -- 172.21.15.70:0/3551340164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0095f0 con 0x7f252c1067a0 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f2531dc9700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c1067a0 0x7f252c196b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f252400ef30 tx=0x7f252400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f25227fc700 1 -- 172.21.15.70:0/3551340164 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524018070 con 0x7f252c1067a0 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c197720 con 0x7f252c1067a0 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f25227fc700 1 -- 172.21.15.70:0/3551340164 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f252400f040 con 0x7f252c1067a0 2023-10-08T08:37:01.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f25227fc700 1 -- 172.21.15.70:0/3551340164 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524003dc0 con 0x7f252c1067a0 2023-10-08T08:37:01.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.876+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c1a3920 con 0x7f252c1067a0 2023-10-08T08:37:01.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.877+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c108dc0 con 0x7f252c1067a0 2023-10-08T08:37:01.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.878+0000 7f25227fc700 1 -- 172.21.15.70:0/3551340164 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f252400caa0 con 0x7f252c1067a0 2023-10-08T08:37:01.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.879+0000 7f25227fc700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25180a1440 0x7f25180a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:01.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.879+0000 7f25315c8700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25180a1440 0x7f25180a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:01.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.879+0000 7f25227fc700 1 -- 172.21.15.70:0/3551340164 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f25240cb790 con 0x7f252c1067a0 2023-10-08T08:37:01.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.879+0000 7f25315c8700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25180a1440 0x7f25180a3900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f252800dad0 tx=0x7f252800d4b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.887+0000 7f25227fc700 1 -- 172.21.15.70:0/3551340164 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2524096a80 con 0x7f252c1067a0 2023-10-08T08:37:02.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.999+0000 7f8452c39700 1 -- 172.21.15.70:0/3585870547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c068ab0 msgr2=0x7f844c10cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.999+0000 7f8452c39700 1 --2- 172.21.15.70:0/3585870547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c068ab0 0x7f844c10cdc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8438009990 tx=0x7f8438009ca0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.999+0000 7f8452c39700 1 -- 172.21.15.70:0/3585870547 shutdown_connections 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.999+0000 7f8452c39700 1 --2- 172.21.15.70:0/3585870547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f844c10d300 0x7f844c10f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.999+0000 7f8452c39700 1 --2- 172.21.15.70:0/3585870547 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c068190 0x7f844c068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.999+0000 7f8452c39700 1 --2- 172.21.15.70:0/3585870547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c068ab0 0x7f844c10cdc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.999+0000 7f8452c39700 1 -- 172.21.15.70:0/3585870547 >> 172.21.15.70:0/3585870547 conn(0x7f844c075790 msgr2=0x7f844c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.999+0000 7f8452c39700 1 -- 172.21.15.70:0/3585870547 shutdown_connections 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.999+0000 7f8452c39700 1 -- 172.21.15.70:0/3585870547 wait complete. 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.000+0000 7f8452c39700 1 Processor -- start 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.000+0000 7f8452c39700 1 -- start start 2023-10-08T08:37:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.000+0000 7f8452c39700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f844c068190 0x7f844c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.000+0000 7f8452c39700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c068ab0 0x7f844c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.000+0000 7f8452c39700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c10d300 0x7f844c19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.000+0000 7f8452c39700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c19dd40 con 0x7f844c10d300 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.000+0000 7f8452c39700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c19deb0 con 0x7f844c068190 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.000+0000 7f8452c39700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c19e070 con 0x7f844c068ab0 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84511d6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c10d300 0x7f844c19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84511d6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c10d300 0x7f844c19d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48072/0 (socket says 172.21.15.70:48072) 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84511d6700 1 -- 172.21.15.70:0/954669008 learned_addr learned my addr 172.21.15.70:0/954669008 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f844bfff700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c068ab0 0x7f844c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84509d5700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f844c068190 0x7f844c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:02.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84511d6700 1 -- 172.21.15.70:0/954669008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c068ab0 msgr2=0x7f844c199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84511d6700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c068ab0 0x7f844c199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84511d6700 1 -- 172.21.15.70:0/954669008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f844c068190 msgr2=0x7f844c198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84511d6700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f844c068190 0x7f844c198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84511d6700 1 -- 172.21.15.70:0/954669008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380095f0 con 0x7f844c10d300 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f84511d6700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c10d300 0x7f844c19d730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f844400ada0 tx=0x7f844400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f8449ffb700 1 -- 172.21.15.70:0/954669008 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844400f070 con 0x7f844c10d300 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c19e350 con 0x7f844c10d300 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f8449ffb700 1 -- 172.21.15.70:0/954669008 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8444007b00 con 0x7f844c10d300 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f8449ffb700 1 -- 172.21.15.70:0/954669008 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444005280 con 0x7f844c10d300 2023-10-08T08:37:02.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.001+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c1a5bb0 con 0x7f844c10d300 2023-10-08T08:37:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.002+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c108520 con 0x7f844c10d300 2023-10-08T08:37:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.003+0000 7f8449ffb700 1 -- 172.21.15.70:0/954669008 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f844400c8d0 con 0x7f844c10d300 2023-10-08T08:37:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.004+0000 7f8449ffb700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f843c0a1440 0x7f843c0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.004+0000 7f84509d5700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f843c0a1440 0x7f843c0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.004+0000 7f8449ffb700 1 -- 172.21.15.70:0/954669008 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f84440ca590 con 0x7f844c10d300 2023-10-08T08:37:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.004+0000 7f84509d5700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f843c0a1440 0x7f843c0a3900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8440007be0 tx=0x7f84400073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:02.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.009+0000 7f8449ffb700 1 -- 172.21.15.70:0/954669008 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8444095880 con 0x7f844c10d300 2023-10-08T08:37:02.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.094+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f252c101ee0 con 0x7f252c1067a0 2023-10-08T08:37:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.097+0000 7f25227fc700 1 -- 172.21.15.70:0/3551340164 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v29)=0 v29) v1 ==== 121+0+0 (secure 0 0 0) 0x7f252409a0a0 con 0x7f252c1067a0 2023-10-08T08:37:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.099+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25180a1440 msgr2=0x7f25180a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.099+0000 7f253382c700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25180a1440 0x7f25180a3900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f252800dad0 tx=0x7f252800d4b0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.099+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c1067a0 msgr2=0x7f252c196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.099+0000 7f253382c700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c1067a0 0x7f252c196b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f252400ef30 tx=0x7f252400c450 comp rx=0 tx=0).stop 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.099+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 shutdown_connections 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.099+0000 7f253382c700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25180a1440 0x7f25180a3900 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.100+0000 7f253382c700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f252c1067a0 0x7f252c196b10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.100+0000 7f253382c700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f252c068190 0x7f252c19c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.100+0000 7f253382c700 1 --2- 172.21.15.70:0/3551340164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f252c068b30 0x7f252c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.100+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 >> 172.21.15.70:0/3551340164 conn(0x7f252c075790 msgr2=0x7f252c0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.100+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 shutdown_connections 2023-10-08T08:37:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.100+0000 7f253382c700 1 -- 172.21.15.70:0/3551340164 wait complete. 2023-10-08T08:37:02.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.215+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7f844c0ffd30 con 0x7f844c10d300 2023-10-08T08:37:02.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.222+0000 7f8449ffb700 1 -- 172.21.15.70:0/954669008 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v30)=0 v30) v1 ==== 116+0+0 (secure 0 0 0) 0x7f8444098ea0 con 0x7f844c10d300 2023-10-08T08:37:02.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f843c0a1440 msgr2=0x7f843c0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f843c0a1440 0x7f843c0a3900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8440007be0 tx=0x7f84400073d0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c10d300 msgr2=0x7f844c19d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c10d300 0x7f844c19d730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f844400ada0 tx=0x7f844400c330 comp rx=0 tx=0).stop 2023-10-08T08:37:02.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 shutdown_connections 2023-10-08T08:37:02.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f843c0a1440 0x7f843c0a3900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f844c10d300 0x7f844c19d730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f844c068190 0x7f844c198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 --2- 172.21.15.70:0/954669008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c068ab0 0x7f844c199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 >> 172.21.15.70:0/954669008 conn(0x7f844c075790 msgr2=0x7f844c10e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:02.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 shutdown_connections 2023-10-08T08:37:02.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.224+0000 7f8452c39700 1 -- 172.21.15.70:0/954669008 wait complete. 2023-10-08T08:37:02.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:02 smithi070 ceph-mon[99513]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:02 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2055227715' entity='client.admin' 2023-10-08T08:37:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:02 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3551340164' entity='client.admin' 2023-10-08T08:37:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:02 smithi105 ceph-mon[103798]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:02 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2055227715' entity='client.admin' 2023-10-08T08:37:02.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:02 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3551340164' entity='client.admin' 2023-10-08T08:37:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:02 smithi191 ceph-mon[104220]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:02 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2055227715' entity='client.admin' 2023-10-08T08:37:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:02 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3551340164' entity='client.admin' 2023-10-08T08:37:02.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.682+0000 7f564d873700 1 -- 172.21.15.70:0/96239927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 msgr2=0x7f5648103aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.682+0000 7f564d873700 1 --2- 172.21.15.70:0/96239927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 0x7f5648103aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5638009990 tx=0x7f5638009ca0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.682+0000 7f564d873700 1 -- 172.21.15.70:0/96239927 shutdown_connections 2023-10-08T08:37:02.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.682+0000 7f564d873700 1 --2- 172.21.15.70:0/96239927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5648104180 0x7f564810bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.682+0000 7f564d873700 1 --2- 172.21.15.70:0/96239927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56480ff0f0 0x7f56480ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.682+0000 7f564d873700 1 --2- 172.21.15.70:0/96239927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 0x7f5648103aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.682+0000 7f564d873700 1 -- 172.21.15.70:0/96239927 >> 172.21.15.70:0/96239927 conn(0x7f5648075cf0 msgr2=0x7f56480fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.682+0000 7f564d873700 1 -- 172.21.15.70:0/96239927 shutdown_connections 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.682+0000 7f564d873700 1 -- 172.21.15.70:0/96239927 wait complete. 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f564d873700 1 Processor -- start 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f564d873700 1 -- start start 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f564d873700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56480ff0f0 0x7f564819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f564d873700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 0x7f564819bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f564d873700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5648104180 0x7f5648195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f564d873700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648195fb0 con 0x7f56480ffaa0 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f564d873700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648196120 con 0x7f5648104180 2023-10-08T08:37:02.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f564d873700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56481962e0 con 0x7f56480ff0f0 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f56467fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 0x7f564819bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f56467fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 0x7f564819bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48084/0 (socket says 172.21.15.70:48084) 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f56467fc700 1 -- 172.21.15.70:0/533464102 learned_addr learned my addr 172.21.15.70:0/533464102 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f5646ffd700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56480ff0f0 0x7f564819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f56477fe700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5648104180 0x7f5648195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f56467fc700 1 -- 172.21.15.70:0/533464102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56480ff0f0 msgr2=0x7f564819b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f56467fc700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56480ff0f0 0x7f564819b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f56467fc700 1 -- 172.21.15.70:0/533464102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5648104180 msgr2=0x7f5648195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.683+0000 7f56467fc700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5648104180 0x7f5648195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.684+0000 7f56467fc700 1 -- 172.21.15.70:0/533464102 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56380095f0 con 0x7f56480ffaa0 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.684+0000 7f56477fe700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5648104180 0x7f5648195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:37:02.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.684+0000 7f56467fc700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 0x7f564819bd50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f563800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.684+0000 7f564c871700 1 -- 172.21.15.70:0/533464102 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563801d070 con 0x7f56480ffaa0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.684+0000 7f564c871700 1 -- 172.21.15.70:0/533464102 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5638022470 con 0x7f56480ffaa0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.684+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5648196560 con 0x7f56480ffaa0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.684+0000 7f564c871700 1 -- 172.21.15.70:0/533464102 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638017650 con 0x7f56480ffaa0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.684+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56481a2800 con 0x7f56480ffaa0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.685+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56481074a0 con 0x7f56480ffaa0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.686+0000 7f564c871700 1 -- 172.21.15.70:0/533464102 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f56380225e0 con 0x7f56480ffaa0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.686+0000 7f564c871700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f56300a1440 0x7f56300a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.687+0000 7f5646ffd700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f56300a1440 0x7f56300a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.687+0000 7f564c871700 1 -- 172.21.15.70:0/533464102 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f56380cc150 con 0x7f56480ffaa0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.687+0000 7f5646ffd700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f56300a1440 0x7f56300a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f563c007be0 tx=0x7f563c0073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:02.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.691+0000 7f564c871700 1 -- 172.21.15.70:0/533464102 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5638097440 con 0x7f56480ffaa0 2023-10-08T08:37:02.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.888+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f5648100580 con 0x7f56480ffaa0 2023-10-08T08:37:02.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.892+0000 7f564c871700 1 -- 172.21.15.70:0/533464102 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v31)=0 v31) v1 ==== 115+0+0 (secure 0 0 0) 0x7f563809aa60 con 0x7f56480ffaa0 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.894+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f56300a1440 msgr2=0x7f56300a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.894+0000 7f564d873700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f56300a1440 0x7f56300a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f563c007be0 tx=0x7f563c0073d0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.894+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 msgr2=0x7f564819bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.894+0000 7f564d873700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 0x7f564819bd50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f563800f670 comp rx=0 tx=0).stop 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.895+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 shutdown_connections 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.895+0000 7f564d873700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f56300a1440 0x7f56300a3900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.895+0000 7f564d873700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5648104180 0x7f5648195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.895+0000 7f564d873700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56480ff0f0 0x7f564819b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.895+0000 7f564d873700 1 --2- 172.21.15.70:0/533464102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56480ffaa0 0x7f564819bd50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.895+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 >> 172.21.15.70:0/533464102 conn(0x7f5648075cf0 msgr2=0x7f56480fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.895+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 shutdown_connections 2023-10-08T08:37:02.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:02.895+0000 7f564d873700 1 -- 172.21.15.70:0/533464102 wait complete. 2023-10-08T08:37:03.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.709+0000 7f68bc3df700 1 -- 172.21.15.70:0/4044602835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41000a0 msgr2=0x7f68b410c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.709+0000 7f68bc3df700 1 --2- 172.21.15.70:0/4044602835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41000a0 0x7f68b410c540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00b0a0 tx=0x7f68ac00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.709+0000 7f68bc3df700 1 -- 172.21.15.70:0/4044602835 shutdown_connections 2023-10-08T08:37:03.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.709+0000 7f68bc3df700 1 --2- 172.21.15.70:0/4044602835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41000a0 0x7f68b410c540 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.709+0000 7f68bc3df700 1 --2- 172.21.15.70:0/4044602835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b41045b0 0x7f68b4104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.709+0000 7f68bc3df700 1 --2- 172.21.15.70:0/4044602835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68b40ff6e0 0x7f68b40ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.709+0000 7f68bc3df700 1 -- 172.21.15.70:0/4044602835 >> 172.21.15.70:0/4044602835 conn(0x7f68b40766c0 msgr2=0x7f68b4076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:03.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.709+0000 7f68bc3df700 1 -- 172.21.15.70:0/4044602835 shutdown_connections 2023-10-08T08:37:03.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.709+0000 7f68bc3df700 1 -- 172.21.15.70:0/4044602835 wait complete. 2023-10-08T08:37:03.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68bc3df700 1 Processor -- start 2023-10-08T08:37:03.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68bc3df700 1 -- start start 2023-10-08T08:37:03.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68bc3df700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68b40ff6e0 0x7f68b4197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:03.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68bc3df700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b41000a0 0x7f68b41980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:03.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68bc3df700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41045b0 0x7f68b41a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:03.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68bc3df700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b4198970 con 0x7f68b41045b0 2023-10-08T08:37:03.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68bc3df700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b41a3130 con 0x7f68b41000a0 2023-10-08T08:37:03.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68bc3df700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b41a3270 con 0x7f68b40ff6e0 2023-10-08T08:37:03.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68ba97c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41045b0 0x7f68b41a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:03.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68ba97c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41045b0 0x7f68b41a2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48046/0 (socket says 172.21.15.70:48046) 2023-10-08T08:37:03.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68ba97c700 1 -- 172.21.15.70:0/2055227715 learned_addr learned my addr 172.21.15.70:0/2055227715 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:37:03.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68b997a700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b41000a0 0x7f68b41980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:03.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68ba17b700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68b40ff6e0 0x7f68b4197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:03.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.710+0000 7f68ba97c700 1 -- 172.21.15.70:0/2055227715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68b40ff6e0 msgr2=0x7f68b4197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68ba97c700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68b40ff6e0 0x7f68b4197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68ba97c700 1 -- 172.21.15.70:0/2055227715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b41000a0 msgr2=0x7f68b41980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68ba97c700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b41000a0 0x7f68b41980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68ba97c700 1 -- 172.21.15.70:0/2055227715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac009d00 con 0x7f68b41045b0 2023-10-08T08:37:03.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68ba97c700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41045b0 0x7f68b41a2bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00b070 tx=0x7f68ac007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:03.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68ab7fe700 1 -- 172.21.15.70:0/2055227715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00e040 con 0x7f68b41045b0 2023-10-08T08:37:03.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68ab7fe700 1 -- 172.21.15.70:0/2055227715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68ac00be40 con 0x7f68b41045b0 2023-10-08T08:37:03.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68ab7fe700 1 -- 172.21.15.70:0/2055227715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0052a0 con 0x7f68b41045b0 2023-10-08T08:37:03.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b41a3490 con 0x7f68b41045b0 2023-10-08T08:37:03.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.711+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b41a3990 con 0x7f68b41045b0 2023-10-08T08:37:03.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.712+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b4107c20 con 0x7f68b41045b0 2023-10-08T08:37:03.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.713+0000 7f68ab7fe700 1 -- 172.21.15.70:0/2055227715 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f68ac01d470 con 0x7f68b41045b0 2023-10-08T08:37:03.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.714+0000 7f68ab7fe700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68a00a14c0 0x7f68a00a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:03.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.714+0000 7f68ba17b700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68a00a14c0 0x7f68a00a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:03.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.714+0000 7f68ab7fe700 1 -- 172.21.15.70:0/2055227715 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f68ac0ccd80 con 0x7f68b41045b0 2023-10-08T08:37:03.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.714+0000 7f68ba17b700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68a00a14c0 0x7f68a00a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009be0 tx=0x7f68b0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:03.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.717+0000 7f68ab7fe700 1 -- 172.21.15.70:0/2055227715 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f68ac098070 con 0x7f68b41045b0 2023-10-08T08:37:03.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.925+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f68b40690a0 con 0x7f68b41045b0 2023-10-08T08:37:03.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.929+0000 7f68ab7fe700 1 -- 172.21.15.70:0/2055227715 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) v1 ==== 121+0+0 (secure 0 0 0) 0x7f68ac09b690 con 0x7f68b41045b0 2023-10-08T08:37:03.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68a00a14c0 msgr2=0x7f68a00a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68a00a14c0 0x7f68a00a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009be0 tx=0x7f68b0009260 comp rx=0 tx=0).stop 2023-10-08T08:37:03.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41045b0 msgr2=0x7f68b41a2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41045b0 0x7f68b41a2bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00b070 tx=0x7f68ac007930 comp rx=0 tx=0).stop 2023-10-08T08:37:03.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 shutdown_connections 2023-10-08T08:37:03.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68a00a14c0 0x7f68a00a3980 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b41045b0 0x7f68b41a2bf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68b40ff6e0 0x7f68b4197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 --2- 172.21.15.70:0/2055227715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b41000a0 0x7f68b41980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 >> 172.21.15.70:0/2055227715 conn(0x7f68b40766c0 msgr2=0x7f68b40fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:03.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 shutdown_connections 2023-10-08T08:37:03.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:01.931+0000 7f68bc3df700 1 -- 172.21.15.70:0/2055227715 wait complete. 2023-10-08T08:37:03.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:03 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/954669008' entity='client.admin' 2023-10-08T08:37:03.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:03 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/533464102' entity='client.admin' 2023-10-08T08:37:03.554 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:03 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/954669008' entity='client.admin' 2023-10-08T08:37:03.555 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:03 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/533464102' entity='client.admin' 2023-10-08T08:37:03.555 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi070') 2023-10-08T08:37:03.556 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi070') 2023-10-08T08:37:03.556 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi070') 2023-10-08T08:37:03.556 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi070') 2023-10-08T08:37:03.556 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi070') 2023-10-08T08:37:03.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:03 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/954669008' entity='client.admin' 2023-10-08T08:37:03.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:03 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/533464102' entity='client.admin' 2023-10-08T08:37:03.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.176+0000 7f60b5614700 1 -- 172.21.15.70:0/3278836281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 msgr2=0x7f60b0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.176+0000 7f60b5614700 1 --2- 172.21.15.70:0/3278836281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 0x7f60b0105a90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009990 tx=0x7f60a4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.176+0000 7f60b5614700 1 -- 172.21.15.70:0/3278836281 shutdown_connections 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.177+0000 7f60b5614700 1 --2- 172.21.15.70:0/3278836281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60b0100110 0x7f60b010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.177+0000 7f60b5614700 1 --2- 172.21.15.70:0/3278836281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 0x7f60b0105a90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.177+0000 7f60b5614700 1 --2- 172.21.15.70:0/3278836281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60b00ff750 0x7f60b00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.177+0000 7f60b5614700 1 -- 172.21.15.70:0/3278836281 >> 172.21.15.70:0/3278836281 conn(0x7f60b0075790 msgr2=0x7f60b0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.177+0000 7f60b5614700 1 -- 172.21.15.70:0/3278836281 shutdown_connections 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.177+0000 7f60b5614700 1 -- 172.21.15.70:0/3278836281 wait complete. 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.177+0000 7f60b5614700 1 Processor -- start 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.177+0000 7f60b5614700 1 -- start start 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60b5614700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60b00ff750 0x7f60b0197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:03.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60b5614700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60b0100110 0x7f60b0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60b5614700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 0x7f60b01a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60b5614700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b0198810 con 0x7f60b01056b0 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60b5614700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01a2fd0 con 0x7f60b00ff750 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60b5614700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01a3110 con 0x7f60b0100110 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60af7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 0x7f60b01a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60af7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 0x7f60b01a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48100/0 (socket says 172.21.15.70:48100) 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60af7fe700 1 -- 172.21.15.70:0/4238523450 learned_addr learned my addr 172.21.15.70:0/4238523450 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60ae7fc700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60b0100110 0x7f60b0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60aeffd700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60b00ff750 0x7f60b0197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60af7fe700 1 -- 172.21.15.70:0/4238523450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60b0100110 msgr2=0x7f60b0197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60af7fe700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60b0100110 0x7f60b0197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60af7fe700 1 -- 172.21.15.70:0/4238523450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60b00ff750 msgr2=0x7f60b0197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60af7fe700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60b00ff750 0x7f60b0197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60af7fe700 1 -- 172.21.15.70:0/4238523450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40095f0 con 0x7f60b01056b0 2023-10-08T08:37:03.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60af7fe700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 0x7f60b01a2a90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f60a8007d70 tx=0x7f60a800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:03.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f6097fff700 1 -- 172.21.15.70:0/4238523450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a800ad40 con 0x7f60b01056b0 2023-10-08T08:37:03.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f6097fff700 1 -- 172.21.15.70:0/4238523450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60a80128e0 con 0x7f60b01056b0 2023-10-08T08:37:03.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b01a3390 con 0x7f60b01056b0 2023-10-08T08:37:03.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f6097fff700 1 -- 172.21.15.70:0/4238523450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80116b0 con 0x7f60b01056b0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.178+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b01a3840 con 0x7f60b01056b0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.179+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b0107cb0 con 0x7f60b01056b0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.180+0000 7f6097fff700 1 -- 172.21.15.70:0/4238523450 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f60a8012420 con 0x7f60b01056b0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.181+0000 7f6097fff700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60980a1440 0x7f60980a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.181+0000 7f60aeffd700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60980a1440 0x7f60980a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.181+0000 7f6097fff700 1 -- 172.21.15.70:0/4238523450 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f60a80cb710 con 0x7f60b01056b0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.181+0000 7f60aeffd700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60980a1440 0x7f60980a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60a4005850 tx=0x7f60a401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.185+0000 7f6097fff700 1 -- 172.21.15.70:0/4238523450 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f60a8096970 con 0x7f60b01056b0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.394+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) v1 -- 0x7f60b0100df0 con 0x7f60b01056b0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.397+0000 7f6097fff700 1 -- 172.21.15.70:0/4238523450 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v32)=0 v32) v1 ==== 115+0+0 (secure 0 0 0) 0x7f60a8099f90 con 0x7f60b01056b0 2023-10-08T08:37:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60980a1440 msgr2=0x7f60980a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60980a1440 0x7f60980a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60a4005850 tx=0x7f60a401a040 comp rx=0 tx=0).stop 2023-10-08T08:37:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 msgr2=0x7f60b01a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 0x7f60b01a2a90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f60a8007d70 tx=0x7f60a800a340 comp rx=0 tx=0).stop 2023-10-08T08:37:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 shutdown_connections 2023-10-08T08:37:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60980a1440 0x7f60980a3900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60b01056b0 0x7f60b01a2a90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60b00ff750 0x7f60b0197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 --2- 172.21.15.70:0/4238523450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60b0100110 0x7f60b0197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 >> 172.21.15.70:0/4238523450 conn(0x7f60b0075790 msgr2=0x7f60b00fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:03.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 shutdown_connections 2023-10-08T08:37:03.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:03.400+0000 7f60b5614700 1 -- 172.21.15.70:0/4238523450 wait complete. 2023-10-08T08:37:04.297 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.297 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.297 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.297 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.297 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.297 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.298 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.386+0000 7f2edec65700 1 -- 172.21.15.70:0/1899845644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ff130 msgr2=0x7f2ed80ff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:04.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.386+0000 7f2edec65700 1 --2- 172.21.15.70:0/1899845644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ff130 0x7f2ed80ff5b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40099c0 tx=0x7f2ec4009cd0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.386+0000 7f2edec65700 1 -- 172.21.15.70:0/1899845644 shutdown_connections 2023-10-08T08:37:04.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.386+0000 7f2edec65700 1 --2- 172.21.15.70:0/1899845644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ed80ffaf0 0x7f2ed810bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.386+0000 7f2edec65700 1 --2- 172.21.15.70:0/1899845644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8103e60 0x7f2ed8104240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.386+0000 7f2edec65700 1 --2- 172.21.15.70:0/1899845644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ff130 0x7f2ed80ff5b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.386+0000 7f2edec65700 1 -- 172.21.15.70:0/1899845644 >> 172.21.15.70:0/1899845644 conn(0x7f2ed8074a50 msgr2=0x7f2ed8074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:04.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.386+0000 7f2edec65700 1 -- 172.21.15.70:0/1899845644 shutdown_connections 2023-10-08T08:37:04.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.386+0000 7f2edec65700 1 -- 172.21.15.70:0/1899845644 wait complete. 2023-10-08T08:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.387+0000 7f2edec65700 1 Processor -- start 2023-10-08T08:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.387+0000 7f2edec65700 1 -- start start 2023-10-08T08:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.387+0000 7f2edec65700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ed80ff130 0x7f2ed819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.387+0000 7f2edec65700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ffaf0 0x7f2ed819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.387+0000 7f2edec65700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8103e60 0x7f2ed8194830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.387+0000 7f2edec65700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8194ea0 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.387+0000 7f2edec65700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8195010 con 0x7f2ed8103e60 2023-10-08T08:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.387+0000 7f2edec65700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81951d0 con 0x7f2ed80ff130 2023-10-08T08:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ffaf0 0x7f2ed819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ffaf0 0x7f2ed819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48110/0 (socket says 172.21.15.70:48110) 2023-10-08T08:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed7fff700 1 -- 172.21.15.70:0/3626314829 learned_addr learned my addr 172.21.15.70:0/3626314829 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2edd202700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8103e60 0x7f2ed8194830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2edca01700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ed80ff130 0x7f2ed819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed7fff700 1 -- 172.21.15.70:0/3626314829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ed80ff130 msgr2=0x7f2ed819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed7fff700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ed80ff130 0x7f2ed819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed7fff700 1 -- 172.21.15.70:0/3626314829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8103e60 msgr2=0x7f2ed8194830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed7fff700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8103e60 0x7f2ed8194830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed7fff700 1 -- 172.21.15.70:0/3626314829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec40095f0 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed7fff700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ffaf0 0x7f2ed819ac30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009990 tx=0x7f2ec4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed5ffb700 1 -- 172.21.15.70:0/3626314829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec401f070 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed5ffb700 1 -- 172.21.15.70:0/3626314829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ec4019cd0 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2ed5ffb700 1 -- 172.21.15.70:0/3626314829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4005290 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed8195450 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.388+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed81a16e0 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.390+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8107450 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.390+0000 7f2ed5ffb700 1 -- 172.21.15.70:0/3626314829 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f2ec40047e0 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.391+0000 7f2ed5ffb700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2ec80a14c0 0x7f2ec80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.391+0000 7f2edca01700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2ec80a14c0 0x7f2ec80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.391+0000 7f2ed5ffb700 1 -- 172.21.15.70:0/3626314829 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f2ec40cdff0 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.391+0000 7f2edca01700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2ec80a14c0 0x7f2ec80a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8077210 tx=0x7f2ecc00b510 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.395+0000 7f2ed5ffb700 1 -- 172.21.15.70:0/3626314829 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2ec40992e0 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.587+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f2ed804e4c0 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.590+0000 7f2ed5ffb700 1 -- 172.21.15.70:0/3626314829 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v33)=0 v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2ec409c900 con 0x7f2ed80ffaf0 2023-10-08T08:37:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2ec80a14c0 msgr2=0x7f2ec80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2ec80a14c0 0x7f2ec80a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8077210 tx=0x7f2ecc00b510 comp rx=0 tx=0).stop 2023-10-08T08:37:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ffaf0 msgr2=0x7f2ed819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ffaf0 0x7f2ed819ac30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009990 tx=0x7f2ec4004730 comp rx=0 tx=0).stop 2023-10-08T08:37:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 shutdown_connections 2023-10-08T08:37:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2ec80a14c0 0x7f2ec80a3980 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8103e60 0x7f2ed8194830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ed80ff130 0x7f2ed819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 --2- 172.21.15.70:0/3626314829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80ffaf0 0x7f2ed819ac30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 >> 172.21.15.70:0/3626314829 conn(0x7f2ed8074a50 msgr2=0x7f2ed80fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 shutdown_connections 2023-10-08T08:37:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:04.593+0000 7f2edec65700 1 -- 172.21.15.70:0/3626314829 wait complete. 2023-10-08T08:37:04.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:04 smithi070 ceph-mon[99513]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:04.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:04 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4238523450' entity='client.admin' 2023-10-08T08:37:04.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:04 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:04.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:04 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:04.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:04 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:04.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:04 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:04.660 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:04 smithi105 ceph-mon[103798]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:04.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:04 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4238523450' entity='client.admin' 2023-10-08T08:37:04.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:04 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:04.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:04 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:04.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:04 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:04.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:04 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:04.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:04 smithi191 ceph-mon[104220]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:04.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:04 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4238523450' entity='client.admin' 2023-10-08T08:37:04.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:04 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:04.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:04 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:04.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:04 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:04.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:04 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:04.924 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.924 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6a2c3394-65b5-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi070') 2023-10-08T08:37:04.925 INFO:tasks.cephadm:Deploying OSDs... 2023-10-08T08:37:04.925 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:37:04.926 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T08:37:04.943 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T08:37:04.943 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2023-10-08T08:37:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T08:37:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:05.001 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 386893 Links: 1 2023-10-08T08:37:05.001 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:05.001 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:05.001 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-10-08 08:35:46.705085396 +0000 2023-10-08T08:37:05.001 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-10-08 08:29:58.852451110 +0000 2023-10-08T08:37:05.001 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-10-08 08:29:58.852451110 +0000 2023-10-08T08:37:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-10-08T08:37:05.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T08:37:05.070 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-10-08T08:37:05.070 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-10-08T08:37:05.070 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 9.61e-05 s, 5.3 MB/s 2023-10-08T08:37:05.071 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T08:37:05.129 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2023-10-08T08:37:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T08:37:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:05.186 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 393350 Links: 1 2023-10-08T08:37:05.186 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:05.186 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:05.186 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-10-08 08:35:46.760083753 +0000 2023-10-08T08:37:05.186 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-10-08 08:29:59.357435956 +0000 2023-10-08T08:37:05.186 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-10-08 08:29:59.357435956 +0000 2023-10-08T08:37:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-10-08T08:37:05.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T08:37:05.251 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-10-08T08:37:05.251 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-10-08T08:37:05.251 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000110102 s, 4.7 MB/s 2023-10-08T08:37:05.252 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T08:37:05.311 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2023-10-08T08:37:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T08:37:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:05.369 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 393421 Links: 1 2023-10-08T08:37:05.369 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:05.369 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:05.369 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-10-08 08:35:46.815082110 +0000 2023-10-08T08:37:05.369 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-10-08 08:29:59.867420650 +0000 2023-10-08T08:37:05.369 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-10-08 08:29:59.867420650 +0000 2023-10-08T08:37:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-10-08T08:37:05.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T08:37:05.433 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-10-08T08:37:05.434 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-10-08T08:37:05.434 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000116862 s, 4.4 MB/s 2023-10-08T08:37:05.436 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T08:37:05.493 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2023-10-08T08:37:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T08:37:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:05.551 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 394751 Links: 1 2023-10-08T08:37:05.551 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:05.551 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:05.551 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-10-08 08:35:46.867080556 +0000 2023-10-08T08:37:05.551 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-10-08 08:30:00.370405556 +0000 2023-10-08T08:37:05.552 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-10-08 08:30:00.370405556 +0000 2023-10-08T08:37:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-10-08T08:37:05.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T08:37:05.617 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-10-08T08:37:05.617 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-10-08T08:37:05.617 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000105499 s, 4.9 MB/s 2023-10-08T08:37:05.618 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T08:37:05.676 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-08T08:37:05.676 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T08:37:05.699 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T08:37:05.699 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2023-10-08T08:37:05.759 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T08:37:05.760 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:05.760 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 389526 Links: 1 2023-10-08T08:37:05.760 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:05.760 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:05.760 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-08 08:36:47.360617927 +0000 2023-10-08T08:37:05.760 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-08 08:30:16.658076970 +0000 2023-10-08T08:37:05.760 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-08 08:30:16.658076970 +0000 2023-10-08T08:37:05.760 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-08T08:37:05.761 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T08:37:05.833 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-08T08:37:05.833 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-08T08:37:05.833 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000285848 s, 1.8 MB/s 2023-10-08T08:37:05.834 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T08:37:05.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:05 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3626314829' entity='client.admin' 2023-10-08T08:37:05.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:05 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:05.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:05 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:05.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:05 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:05.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:05 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:05.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:05 smithi191 ceph-mon[104220]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:05.895 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2023-10-08T08:37:05.954 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T08:37:05.954 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:05.954 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 388758 Links: 1 2023-10-08T08:37:05.954 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:05.954 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:05.954 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-08 08:36:47.361617907 +0000 2023-10-08T08:37:05.954 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-08 08:30:17.170066944 +0000 2023-10-08T08:37:05.954 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-08 08:30:17.170066944 +0000 2023-10-08T08:37:05.955 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-08T08:37:05.955 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T08:37:05.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:05 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3626314829' entity='client.admin' 2023-10-08T08:37:05.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:05 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:05.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:05 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:05.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:05 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:05.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:05 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:05.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:05 smithi070 ceph-mon[99513]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:06.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:05 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3626314829' entity='client.admin' 2023-10-08T08:37:06.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:05 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:06.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:05 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:06.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:05 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:06.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:05 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:06.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:05 smithi105 ceph-mon[103798]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:06.022 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-08T08:37:06.022 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-08T08:37:06.023 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000257554 s, 2.0 MB/s 2023-10-08T08:37:06.023 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T08:37:06.081 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2023-10-08T08:37:06.139 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T08:37:06.140 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:06.140 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 392871 Links: 1 2023-10-08T08:37:06.140 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:06.140 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:06.140 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-08 08:36:47.361617907 +0000 2023-10-08T08:37:06.140 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-08 08:30:17.690056761 +0000 2023-10-08T08:37:06.140 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-08 08:30:17.690056761 +0000 2023-10-08T08:37:06.140 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-08T08:37:06.140 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T08:37:06.205 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-08T08:37:06.206 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-08T08:37:06.206 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000205854 s, 2.5 MB/s 2023-10-08T08:37:06.207 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T08:37:06.265 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2023-10-08T08:37:06.324 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T08:37:06.324 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:06.324 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 393937 Links: 1 2023-10-08T08:37:06.324 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:06.324 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:06.324 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-08 08:36:47.361617907 +0000 2023-10-08T08:37:06.324 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-08 08:30:18.202046734 +0000 2023-10-08T08:37:06.324 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-08 08:30:18.202046734 +0000 2023-10-08T08:37:06.324 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-08T08:37:06.325 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T08:37:06.390 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-08T08:37:06.390 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-08T08:37:06.390 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000195494 s, 2.6 MB/s 2023-10-08T08:37:06.391 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T08:37:06.449 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-08T08:37:06.449 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T08:37:06.470 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T08:37:06.470 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2023-10-08T08:37:06.530 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T08:37:06.530 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:06.530 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 393265 Links: 1 2023-10-08T08:37:06.530 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:06.530 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:06.530 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-08 08:36:45.236618544 +0000 2023-10-08T08:37:06.531 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-08 08:30:17.316754805 +0000 2023-10-08T08:37:06.531 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-08 08:30:17.316754805 +0000 2023-10-08T08:37:06.531 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-08T08:37:06.531 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T08:37:06.603 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-08T08:37:06.603 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-08T08:37:06.603 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000356132 s, 1.4 MB/s 2023-10-08T08:37:06.604 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T08:37:06.666 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2023-10-08T08:37:06.725 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T08:37:06.725 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:06.725 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 395296 Links: 1 2023-10-08T08:37:06.725 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:06.725 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:06.725 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-08 08:36:45.236618544 +0000 2023-10-08T08:37:06.725 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-08 08:30:17.824745571 +0000 2023-10-08T08:37:06.725 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-08 08:30:17.824745571 +0000 2023-10-08T08:37:06.725 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-08T08:37:06.726 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T08:37:06.793 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-08T08:37:06.793 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-08T08:37:06.793 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000219772 s, 2.3 MB/s 2023-10-08T08:37:06.794 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T08:37:06.853 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2023-10-08T08:37:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T08:37:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:06.913 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 395329 Links: 1 2023-10-08T08:37:06.913 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:06.913 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:06.913 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-08 08:36:45.236618544 +0000 2023-10-08T08:37:06.913 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-08 08:30:18.331736355 +0000 2023-10-08T08:37:06.913 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-08 08:30:18.331736355 +0000 2023-10-08T08:37:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-08T08:37:06.914 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T08:37:06.980 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-08T08:37:06.981 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-08T08:37:06.981 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000243014 s, 2.1 MB/s 2023-10-08T08:37:06.982 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T08:37:07.041 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2023-10-08T08:37:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T08:37:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T08:37:07.099 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 395402 Links: 1 2023-10-08T08:37:07.099 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:37:07.099 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T08:37:07.099 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-08 08:36:45.236618544 +0000 2023-10-08T08:37:07.099 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-08 08:30:18.840727103 +0000 2023-10-08T08:37:07.099 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-08 08:30:18.840727103 +0000 2023-10-08T08:37:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-08T08:37:07.100 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T08:37:07.165 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-08T08:37:07.165 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-08T08:37:07.165 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000232493 s, 2.2 MB/s 2023-10-08T08:37:07.166 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T08:37:07.224 INFO:tasks.cephadm:Deploying osd.0 on smithi070 with /dev/vg_nvme/lv_4... 2023-10-08T08:37:07.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T08:37:07.797 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:37:08.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:08 smithi191 ceph-mon[104220]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:08.384 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:08 smithi070 ceph-mon[99513]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:08 smithi105 ceph-mon[103798]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T08:37:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T08:37:09.405 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2023-10-08T08:37:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2023-10-08T08:37:09.405 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00842801 s, 1.2 GB/s 2023-10-08T08:37:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2023-10-08T08:37:09.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi070:vg_nvme/lv_4 2023-10-08T08:37:10.314 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:37:10.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:10 smithi191 ceph-mon[104220]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:10.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:10 smithi070 ceph-mon[99513]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:10.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:10 smithi105 ceph-mon[103798]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:11.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 -- 172.21.15.70:0/690817726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 msgr2=0x7fb22410c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:11.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 --2- 172.21.15.70:0/690817726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 0x7fb22410c540 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00b0a0 tx=0x7fb21c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:37:11.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 -- 172.21.15.70:0/690817726 shutdown_connections 2023-10-08T08:37:11.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 --2- 172.21.15.70:0/690817726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 0x7fb22410c540 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:11.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 --2- 172.21.15.70:0/690817726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2241045b0 0x7fb224104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 --2- 172.21.15.70:0/690817726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240ff6e0 0x7fb2240ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 -- 172.21.15.70:0/690817726 >> 172.21.15.70:0/690817726 conn(0x7fb2240766c0 msgr2=0x7fb224076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 -- 172.21.15.70:0/690817726 shutdown_connections 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 -- 172.21.15.70:0/690817726 wait complete. 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 Processor -- start 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.562+0000 7fb22ab10700 1 -- start start 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb22ab10700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240ff6e0 0x7fb22419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb22ab10700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 0x7fb22419bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb22ab10700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2241045b0 0x7fb224195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb22ab10700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb224196240 con 0x7fb2241000a0 2023-10-08T08:37:11.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb22ab10700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2241963b0 con 0x7fb2240ff6e0 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb22ab10700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb224196570 con 0x7fb2241045b0 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb223fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 0x7fb22419bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb223fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 0x7fb22419bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48124/0 (socket says 172.21.15.70:48124) 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb223fff700 1 -- 172.21.15.70:0/514909550 learned_addr learned my addr 172.21.15.70:0/514909550 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb2290ad700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2241045b0 0x7fb224195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb2288ac700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240ff6e0 0x7fb22419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb223fff700 1 -- 172.21.15.70:0/514909550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2241045b0 msgr2=0x7fb224195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb223fff700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2241045b0 0x7fb224195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb223fff700 1 -- 172.21.15.70:0/514909550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240ff6e0 msgr2=0x7fb22419b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb223fff700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240ff6e0 0x7fb22419b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb223fff700 1 -- 172.21.15.70:0/514909550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c009d00 con 0x7fb2241000a0 2023-10-08T08:37:11.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb223fff700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 0x7fb22419bf20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb21000c9b0 tx=0x7fb21000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:11.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb221ffb700 1 -- 172.21.15.70:0/514909550 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210007b00 con 0x7fb2241000a0 2023-10-08T08:37:11.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb221ffb700 1 -- 172.21.15.70:0/514909550 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb210007c60 con 0x7fb2241000a0 2023-10-08T08:37:11.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb224196850 con 0x7fb2241000a0 2023-10-08T08:37:11.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.563+0000 7fb221ffb700 1 -- 172.21.15.70:0/514909550 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210018660 con 0x7fb2241000a0 2023-10-08T08:37:11.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.564+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2241a2960 con 0x7fb2241000a0 2023-10-08T08:37:11.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.565+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224107c20 con 0x7fb2241000a0 2023-10-08T08:37:11.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.566+0000 7fb221ffb700 1 -- 172.21.15.70:0/514909550 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7fb21000f450 con 0x7fb2241000a0 2023-10-08T08:37:11.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.566+0000 7fb221ffb700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2140a1440 0x7fb2140a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:11.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.566+0000 7fb2288ac700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2140a1440 0x7fb2140a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:11.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.566+0000 7fb221ffb700 1 -- 172.21.15.70:0/514909550 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb2100cb0d0 con 0x7fb2241000a0 2023-10-08T08:37:11.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.567+0000 7fb2288ac700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2140a1440 0x7fb2140a3900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb218005950 tx=0x7fb2180058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:11.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.570+0000 7fb221ffb700 1 -- 172.21.15.70:0/514909550 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb210096330 con 0x7fb2241000a0 2023-10-08T08:37:11.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:11.768+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb224196f70 con 0x7fb2140a1440 2023-10-08T08:37:12.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:12 smithi191 ceph-mon[104220]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:12.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:37:12.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:37:12.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:12.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:12 smithi070 ceph-mon[99513]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:37:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:37:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:12 smithi105 ceph-mon[103798]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:37:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:37:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:13.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:13 smithi070 ceph-mon[99513]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:37:13.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:13 smithi191 ceph-mon[104220]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:37:13.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:13 smithi105 ceph-mon[103798]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:37:14.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:14 smithi191 ceph-mon[104220]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:14.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:14 smithi070 ceph-mon[99513]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:14.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:14 smithi105 ceph-mon[103798]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:15.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:15 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1060856149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8cad845-82ee-41e7-ac3e-d24a2ee07b70"}]: dispatch 2023-10-08T08:37:15.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:15 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1060856149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8cad845-82ee-41e7-ac3e-d24a2ee07b70"}]': finished 2023-10-08T08:37:15.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:15 smithi191 ceph-mon[104220]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T08:37:15.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:15.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:15 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4032443386' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:37:15.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:15 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1060856149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8cad845-82ee-41e7-ac3e-d24a2ee07b70"}]: dispatch 2023-10-08T08:37:15.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:15 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1060856149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8cad845-82ee-41e7-ac3e-d24a2ee07b70"}]': finished 2023-10-08T08:37:15.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:15 smithi070 ceph-mon[99513]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T08:37:15.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:15.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:15 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4032443386' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:37:15.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:15 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1060856149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8cad845-82ee-41e7-ac3e-d24a2ee07b70"}]: dispatch 2023-10-08T08:37:15.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:15 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1060856149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8cad845-82ee-41e7-ac3e-d24a2ee07b70"}]': finished 2023-10-08T08:37:15.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:15 smithi105 ceph-mon[103798]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T08:37:15.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:15.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:15 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4032443386' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:37:16.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:16 smithi070 ceph-mon[99513]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:16.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:16 smithi105 ceph-mon[103798]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:16.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:16 smithi191 ceph-mon[104220]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:18.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:18 smithi070 ceph-mon[99513]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:18 smithi105 ceph-mon[103798]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:18 smithi191 ceph-mon[104220]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:20 smithi070 ceph-mon[99513]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:20 smithi105 ceph-mon[103798]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:20 smithi191 ceph-mon[104220]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:21.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:21 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T08:37:21.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:21 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:21.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:21 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T08:37:21.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:21 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:21.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:21 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T08:37:21.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:21 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:22.349 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:22 smithi070 ceph-mon[99513]: Deploying daemon osd.0 on smithi070 2023-10-08T08:37:22.350 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:22 smithi070 ceph-mon[99513]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:22.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:22 smithi105 ceph-mon[103798]: Deploying daemon osd.0 on smithi070 2023-10-08T08:37:22.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:22 smithi105 ceph-mon[103798]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:22 smithi191 ceph-mon[104220]: Deploying daemon osd.0 on smithi070 2023-10-08T08:37:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:22 smithi191 ceph-mon[104220]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:24.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:24 smithi070 ceph-mon[99513]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:24 smithi105 ceph-mon[103798]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:24 smithi191 ceph-mon[104220]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:26.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:26 smithi070 ceph-mon[99513]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:26.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:26 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:26.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:26 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:26.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:26 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:26.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:26 smithi191 ceph-mon[104220]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:26.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:26 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:26.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:26 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:26.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:26 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:26 smithi105 ceph-mon[103798]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:26 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:26 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:26 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.817+0000 7fb221ffb700 1 -- 172.21.15.70:0/514909550 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb224196f70 con 0x7fb2140a1440 2023-10-08T08:37:27.818 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 0 on host 'smithi070' 2023-10-08T08:37:27.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2140a1440 msgr2=0x7fb2140a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:27.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2140a1440 0x7fb2140a3900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb218005950 tx=0x7fb2180058e0 comp rx=0 tx=0).stop 2023-10-08T08:37:27.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 msgr2=0x7fb22419bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:27.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 0x7fb22419bf20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb21000c9b0 tx=0x7fb21000ccc0 comp rx=0 tx=0).stop 2023-10-08T08:37:27.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 shutdown_connections 2023-10-08T08:37:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2140a1440 0x7fb2140a3900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2241045b0 0x7fb224195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240ff6e0 0x7fb22419b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 --2- 172.21.15.70:0/514909550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2241000a0 0x7fb22419bf20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 >> 172.21.15.70:0/514909550 conn(0x7fb2240766c0 msgr2=0x7fb2240fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 shutdown_connections 2023-10-08T08:37:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:37:27.819+0000 7fb22ab10700 1 -- 172.21.15.70:0/514909550 wait complete. 2023-10-08T08:37:27.988 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:27 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:27.988 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:27 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:27.988 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:27 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:27.988 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:27 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:27.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:27 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:27.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:27 smithi070 ceph-mon[99513]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:27.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:27 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:27.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:27 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:27.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:27 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:28.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:27 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:27 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:27 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:28.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:27 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:28.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:27 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:27 smithi105 ceph-mon[103798]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:28.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:27 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:27 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:27 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:28.287 DEBUG:teuthology.orchestra.run.smithi070:osd.0> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.0.service 2023-10-08T08:37:28.289 INFO:tasks.cephadm:Deploying osd.1 on smithi105 with /dev/vg_nvme/lv_4... 2023-10-08T08:37:28.289 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T08:37:28.320 INFO:journalctl@ceph.osd.0.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:37:28.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:27 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:27 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:27 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:28.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:27 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:28.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:27 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:27 smithi191 ceph-mon[104220]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:28.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:27 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:27 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:28.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:27 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:28.856 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:37:29.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:28 smithi070 ceph-mon[99513]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T08:37:29.110 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:37:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-0[125553]: 2023-10-08T08:37:28.888+0000 7f6c79846640 -1 osd.0 0 log_to_monitors true 2023-10-08T08:37:29.275 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:28 smithi105 ceph-mon[103798]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T08:37:29.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:28 smithi191 ceph-mon[104220]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T08:37:29.962 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:37:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-0[125553]: 2023-10-08T08:37:29.956+0000 7f6c6eebd700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T08:37:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:29 smithi070 ceph-mon[99513]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T08:37:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:29 smithi070 ceph-mon[99513]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T08:37:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:29 smithi070 ceph-mon[99513]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:37:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:29 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:29 smithi070 ceph-mon[99513]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:30.220 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:37:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-0[125553]: 2023-10-08T08:37:29.960+0000 7f6c66caa700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:37:30.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:29 smithi105 ceph-mon[103798]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T08:37:30.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:29 smithi105 ceph-mon[103798]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T08:37:30.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:29 smithi105 ceph-mon[103798]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:37:30.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:29 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:30.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:29 smithi105 ceph-mon[103798]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:30.296 INFO:teuthology.orchestra.run.smithi105.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T08:37:30.296 INFO:teuthology.orchestra.run.smithi105.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T08:37:30.296 INFO:teuthology.orchestra.run.smithi105.stderr: stderr: 10+0 records in 2023-10-08T08:37:30.296 INFO:teuthology.orchestra.run.smithi105.stderr:10+0 records out 2023-10-08T08:37:30.296 INFO:teuthology.orchestra.run.smithi105.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127505 s, 822 MB/s 2023-10-08T08:37:30.296 INFO:teuthology.orchestra.run.smithi105.stderr:--> Zapping successful for: 2023-10-08T08:37:30.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:29 smithi191 ceph-mon[104220]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T08:37:30.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:29 smithi191 ceph-mon[104220]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T08:37:30.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:29 smithi191 ceph-mon[104220]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:37:30.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:29 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:30.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:29 smithi191 ceph-mon[104220]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:30.710 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi105:vg_nvme/lv_4 2023-10-08T08:37:31.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:30 smithi070 ceph-mon[99513]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:37:31.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:30 smithi070 ceph-mon[99513]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T08:37:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:31.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:31.267 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:37:31.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:30 smithi105 ceph-mon[103798]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:37:31.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:30 smithi105 ceph-mon[103798]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T08:37:31.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:31.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:31.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:30 smithi191 ceph-mon[104220]: from='osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:37:31.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:30 smithi191 ceph-mon[104220]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T08:37:31.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:31.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:32.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] boot 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi070 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi070 to 17168M 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:32.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:32.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.260 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:37:32.260 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:37:32.260 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] boot 2023-10-08T08:37:32.260 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T08:37:32.261 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:32.261 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:32.261 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi070 2023-10-08T08:37:32.261 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.261 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.261 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:37:32.261 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi070 to 17168M 2023-10-08T08:37:32.262 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.262 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:32.262 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:32.262 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: osd.0 [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] boot 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi070 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:37:32.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi070 to 17168M 2023-10-08T08:37:32.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:32.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:32.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:32.453 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.447+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2557356385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f241056b0 msgr2=0x7f0f24105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:32.453 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.447+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2557356385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f241056b0 0x7f0f24105a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00b0a0 tx=0x7f0f1c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:37:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.447+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2557356385 shutdown_connections 2023-10-08T08:37:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.447+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2557356385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f24100110 0x7f0f2410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.447+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2557356385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f241056b0 0x7f0f24105a90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.447+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2557356385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f240ff750 0x7f0f240ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.447+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2557356385 >> 172.21.15.105:0/2557356385 conn(0x7f0f24075790 msgr2=0x7f0f24075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.447+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2557356385 shutdown_connections 2023-10-08T08:37:32.455 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.447+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2557356385 wait complete. 2023-10-08T08:37:32.455 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f2ac27700 1 Processor -- start 2023-10-08T08:37:32.455 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f2ac27700 1 -- start start 2023-10-08T08:37:32.455 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f2ac27700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f240ff750 0x7f0f2410cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:32.455 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f2ac27700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f24100110 0x7f0f2410d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:32.455 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f2ac27700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f241056b0 0x7f0f2410d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:32.455 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f2ac27700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241a5160 con 0x7f0f241056b0 2023-10-08T08:37:32.456 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f2ac27700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241a52d0 con 0x7f0f240ff750 2023-10-08T08:37:32.456 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f2ac27700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241a5490 con 0x7f0f24100110 2023-10-08T08:37:32.456 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f289c3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f240ff750 0x7f0f2410cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:32.456 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f289c3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f240ff750 0x7f0f2410cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40536/0 (socket says 172.21.15.105:40536) 2023-10-08T08:37:32.456 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f289c3700 1 -- 172.21.15.105:0/2841793626 learned_addr learned my addr 172.21.15.105:0/2841793626 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-08T08:37:32.456 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f23fff700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f24100110 0x7f0f2410d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:32.457 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f289c3700 1 -- 172.21.15.105:0/2841793626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f24100110 msgr2=0x7f0f2410d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:32.457 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f289c3700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f24100110 0x7f0f2410d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:32.457 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f289c3700 1 -- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f241056b0 msgr2=0x7f0f2410d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:32.457 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f291c4700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f241056b0 0x7f0f2410d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:32.457 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f289c3700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f241056b0 0x7f0f2410d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:32.457 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f289c3700 1 -- 172.21.15.105:0/2841793626 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c009d00 con 0x7f0f240ff750 2023-10-08T08:37:32.457 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f23fff700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f24100110 0x7f0f2410d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:37:32.458 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f289c3700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f240ff750 0x7f0f2410cf50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c006070 tx=0x7f0f1c007670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:32.458 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.448+0000 7f0f21ffb700 1 -- 172.21.15.105:0/2841793626 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c00e040 con 0x7f0f240ff750 2023-10-08T08:37:32.458 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.449+0000 7f0f21ffb700 1 -- 172.21.15.105:0/2841793626 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f1c003c00 con 0x7f0f240ff750 2023-10-08T08:37:32.458 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.449+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f241a5710 con 0x7f0f240ff750 2023-10-08T08:37:32.458 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.449+0000 7f0f21ffb700 1 -- 172.21.15.105:0/2841793626 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c01c6f0 con 0x7f0f240ff750 2023-10-08T08:37:32.458 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.449+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f241a5b80 con 0x7f0f240ff750 2023-10-08T08:37:32.459 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.450+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f24107c40 con 0x7f0f240ff750 2023-10-08T08:37:32.459 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.451+0000 7f0f21ffb700 1 -- 172.21.15.105:0/2841793626 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f0f1c005590 con 0x7f0f240ff750 2023-10-08T08:37:32.459 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.451+0000 7f0f21ffb700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0f100a14c0 0x7f0f100a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:32.459 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.451+0000 7f0f21ffb700 1 -- 172.21.15.105:0/2841793626 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f0f1c0cc240 con 0x7f0f240ff750 2023-10-08T08:37:32.459 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.451+0000 7f0f23fff700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0f100a14c0 0x7f0f100a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:32.460 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.452+0000 7f0f23fff700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0f100a14c0 0x7f0f100a3980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c005fd0 tx=0x7f0f0c005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:32.460 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.457+0000 7f0f21ffb700 1 -- 172.21.15.105:0/2841793626 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0f1c0972d0 con 0x7f0f240ff750 2023-10-08T08:37:32.655 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:32.653+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f2410e3e0 con 0x7f0f100a14c0 2023-10-08T08:37:33.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:33 smithi191 ceph-mon[104220]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T08:37:33.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:37:33.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:37:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:33.450 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:33 smithi105 ceph-mon[103798]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T08:37:33.451 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:37:33.451 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:37:33.451 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:33.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:33 smithi070 ceph-mon[99513]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T08:37:33.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:37:33.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:37:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:34.322 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:34 smithi105 ceph-mon[103798]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:37:34.322 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:34 smithi105 ceph-mon[103798]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:34.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:34 smithi191 ceph-mon[104220]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:37:34.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:34 smithi191 ceph-mon[104220]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:34.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:34 smithi070 ceph-mon[99513]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:37:34.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:34 smithi070 ceph-mon[99513]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:35.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:35 smithi191 ceph-mon[104220]: from='client.? 172.21.15.105:0/553210892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b37cb8-fe51-4f85-9ffc-5519bc4556c4"}]: dispatch 2023-10-08T08:37:35.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:35 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b37cb8-fe51-4f85-9ffc-5519bc4556c4"}]: dispatch 2023-10-08T08:37:35.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:35 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3b37cb8-fe51-4f85-9ffc-5519bc4556c4"}]': finished 2023-10-08T08:37:35.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:35 smithi191 ceph-mon[104220]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T08:37:35.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:35 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:35.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:35 smithi070 ceph-mon[99513]: from='client.? 172.21.15.105:0/553210892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b37cb8-fe51-4f85-9ffc-5519bc4556c4"}]: dispatch 2023-10-08T08:37:35.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:35 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b37cb8-fe51-4f85-9ffc-5519bc4556c4"}]: dispatch 2023-10-08T08:37:35.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:35 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3b37cb8-fe51-4f85-9ffc-5519bc4556c4"}]': finished 2023-10-08T08:37:35.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:35 smithi070 ceph-mon[99513]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T08:37:35.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:35 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:35.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:35 smithi105 ceph-mon[103798]: from='client.? 172.21.15.105:0/553210892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b37cb8-fe51-4f85-9ffc-5519bc4556c4"}]: dispatch 2023-10-08T08:37:35.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:35 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b37cb8-fe51-4f85-9ffc-5519bc4556c4"}]: dispatch 2023-10-08T08:37:35.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:35 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3b37cb8-fe51-4f85-9ffc-5519bc4556c4"}]': finished 2023-10-08T08:37:35.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:35 smithi105 ceph-mon[103798]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T08:37:35.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:35 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:36.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:36 smithi191 ceph-mon[104220]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:36.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:36 smithi191 ceph-mon[104220]: from='client.? 172.21.15.105:0/2857359967' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:37:36.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:36 smithi070 ceph-mon[99513]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:36.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:36 smithi070 ceph-mon[99513]: from='client.? 172.21.15.105:0/2857359967' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:37:36.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:36 smithi105 ceph-mon[103798]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:36.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:36 smithi105 ceph-mon[103798]: from='client.? 172.21.15.105:0/2857359967' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:37:38.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:38 smithi191 ceph-mon[104220]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:38.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:38 smithi070 ceph-mon[99513]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:38 smithi105 ceph-mon[103798]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:40.177 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:40 smithi105 ceph-mon[103798]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:40.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:40 smithi191 ceph-mon[104220]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:40.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:40 smithi070 ceph-mon[99513]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:42.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:42 smithi105 ceph-mon[103798]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:42.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T08:37:42.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:42.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:42 smithi191 ceph-mon[104220]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:42.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T08:37:42.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:42.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:42 smithi070 ceph-mon[99513]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:42.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T08:37:42.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:43.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:43 smithi191 ceph-mon[104220]: Deploying daemon osd.1 on smithi105 2023-10-08T08:37:43.436 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:43 smithi105 ceph-mon[103798]: Deploying daemon osd.1 on smithi105 2023-10-08T08:37:43.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:43 smithi070 ceph-mon[99513]: Deploying daemon osd.1 on smithi105 2023-10-08T08:37:44.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:44 smithi105 ceph-mon[103798]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:44.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:44 smithi191 ceph-mon[104220]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:44.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:44 smithi070 ceph-mon[99513]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:46.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:46 smithi105 ceph-mon[103798]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:46.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:46.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:46.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:46.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:46 smithi191 ceph-mon[104220]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:46.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:46.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:46.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:46.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:46 smithi070 ceph-mon[99513]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:46.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:46.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:46.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:48.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:48 smithi105 ceph-mon[103798]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:48.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:48 smithi191 ceph-mon[104220]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:48.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:48 smithi070 ceph-mon[99513]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:48.665 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.664+0000 7f0f21ffb700 1 -- 172.21.15.105:0/2841793626 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0f2410e3e0 con 0x7f0f100a14c0 2023-10-08T08:37:48.665 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 1 on host 'smithi105' 2023-10-08T08:37:48.668 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0f100a14c0 msgr2=0x7f0f100a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:48.668 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0f100a14c0 0x7f0f100a3980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c005fd0 tx=0x7f0f0c005dc0 comp rx=0 tx=0).stop 2023-10-08T08:37:48.668 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f240ff750 msgr2=0x7f0f2410cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:48.668 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f240ff750 0x7f0f2410cf50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c006070 tx=0x7f0f1c007670 comp rx=0 tx=0).stop 2023-10-08T08:37:48.669 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 shutdown_connections 2023-10-08T08:37:48.669 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0f100a14c0 0x7f0f100a3980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:48.669 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f241056b0 0x7f0f2410d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:48.669 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f240ff750 0x7f0f2410cf50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:48.669 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 --2- 172.21.15.105:0/2841793626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f24100110 0x7f0f2410d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:48.669 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.667+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 >> 172.21.15.105:0/2841793626 conn(0x7f0f24075790 msgr2=0x7f0f240fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:48.669 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.668+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 shutdown_connections 2023-10-08T08:37:48.669 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:37:48.668+0000 7f0f2ac27700 1 -- 172.21.15.105:0/2841793626 wait complete. 2023-10-08T08:37:49.171 DEBUG:teuthology.orchestra.run.smithi105:osd.1> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.1.service 2023-10-08T08:37:49.173 INFO:tasks.cephadm:Deploying osd.2 on smithi191 with /dev/vg_nvme/lv_4... 2023-10-08T08:37:49.173 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T08:37:49.205 INFO:journalctl@ceph.osd.1.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:37:49.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:49.738 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:37:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:50 smithi191 ceph-mon[104220]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:50 smithi191 ceph-mon[104220]: from='osd.1 [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T08:37:50.225 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:50 smithi191 ceph-mon[104220]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T08:37:50.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:50 smithi105 ceph-mon[103798]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:50.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:50 smithi105 ceph-mon[103798]: from='osd.1 [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T08:37:50.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:50 smithi105 ceph-mon[103798]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T08:37:50.271 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:37:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-1[109984]: 2023-10-08T08:37:49.936+0000 7fc9147dc640 -1 osd.1 0 log_to_monitors true 2023-10-08T08:37:50.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:50 smithi070 ceph-mon[99513]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:50.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:50 smithi070 ceph-mon[99513]: from='osd.1 [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T08:37:50.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:50 smithi070 ceph-mon[99513]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T08:37:51.230 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T08:37:51.231 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T08:37:51.231 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2023-10-08T08:37:51.231 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2023-10-08T08:37:51.231 INFO:teuthology.orchestra.run.smithi191.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111604 s, 940 MB/s 2023-10-08T08:37:51.231 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2023-10-08T08:37:51.591 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi191:vg_nvme/lv_4 2023-10-08T08:37:51.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:51 smithi191 ceph-mon[104220]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T08:37:51.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:51 smithi191 ceph-mon[104220]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T08:37:51.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:51 smithi191 ceph-mon[104220]: from='osd.1 [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:37:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:51 smithi191 ceph-mon[104220]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:37:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:51 smithi191 ceph-mon[104220]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:51.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:51 smithi070 ceph-mon[99513]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T08:37:51.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:51 smithi070 ceph-mon[99513]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T08:37:51.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:51.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:51 smithi070 ceph-mon[99513]: from='osd.1 [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:37:51.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:51 smithi070 ceph-mon[99513]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:37:51.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:51 smithi070 ceph-mon[99513]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:52.020 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:37:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-1[109984]: 2023-10-08T08:37:51.648+0000 7fc909e53700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T08:37:52.021 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:37:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-1[109984]: 2023-10-08T08:37:51.652+0000 7fc904445700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:37:52.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:51 smithi105 ceph-mon[103798]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T08:37:52.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:51 smithi105 ceph-mon[103798]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T08:37:52.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:52.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:51 smithi105 ceph-mon[103798]: from='osd.1 [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:37:52.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:51 smithi105 ceph-mon[103798]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:37:52.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:51 smithi105 ceph-mon[103798]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T08:37:52.148 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:37:52.933 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:37:52.933 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T08:37:52.933 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:52.933 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:52.933 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi105 2023-10-08T08:37:52.933 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:52.933 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:52.933 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:37:52.933 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi105 to 17168M 2023-10-08T08:37:52.934 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:52.934 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:52.934 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:52.934 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:52.934 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:52.934 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:52.934 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:52.934 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:52 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:52.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi105 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi105 to 17168M 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:52.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:52.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:52.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:52.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:52.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:52.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:52.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:52 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:53.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:37:53.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T08:37:53.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:53.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:53.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi105 2023-10-08T08:37:53.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:53.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:53.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:37:53.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi105 to 17168M 2023-10-08T08:37:53.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:53.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:53.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:53.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:53.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:37:53.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:53.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:37:53.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:52 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:37:53.474 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.471+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/4169684226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04100e70 msgr2=0x7f5c041043b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:53.474 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.471+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/4169684226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04100e70 0x7f5c041043b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009990 tx=0x7f5c00009ca0 comp rx=0 tx=0).stop 2023-10-08T08:37:53.474 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/4169684226 shutdown_connections 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/4169684226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c04104ae0 0x7f5c0410c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/4169684226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c041004c0 0x7f5c041008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/4169684226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04100e70 0x7f5c041043b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/4169684226 >> 172.21.15.191:0/4169684226 conn(0x7f5c04074aa0 msgr2=0x7f5c04074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/4169684226 shutdown_connections 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/4169684226 wait complete. 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 Processor -- start 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 -- start start 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c041004c0 0x7f5c04198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c04100e70 0x7f5c041993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04104ae0 0x7f5c0419d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:53.475 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0419dd60 con 0x7f5c04100e70 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0419ded0 con 0x7f5c041004c0 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.472+0000 7f5c0b8e8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0419e090 con 0x7f5c04104ae0 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09e85700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04104ae0 0x7f5c0419d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09e85700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04104ae0 0x7f5c0419d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:55792/0 (socket says 172.21.15.191:55792) 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09e85700 1 -- 172.21.15.191:0/2181535125 learned_addr learned my addr 172.21.15.191:0/2181535125 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c08e83700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c04100e70 0x7f5c041993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09684700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c041004c0 0x7f5c04198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09e85700 1 -- 172.21.15.191:0/2181535125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c041004c0 msgr2=0x7f5c04198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09e85700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c041004c0 0x7f5c04198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09e85700 1 -- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c04100e70 msgr2=0x7f5c041993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09e85700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c04100e70 0x7f5c041993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09e85700 1 -- 172.21.15.191:0/2181535125 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000095f0 con 0x7f5c04104ae0 2023-10-08T08:37:53.476 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c09e85700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04104ae0 0x7f5c0419d750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc007ee0 tx=0x7f5bfc00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:53.477 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5bfa7fc700 1 -- 172.21.15.191:0/2181535125 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00ddd0 con 0x7f5c04104ae0 2023-10-08T08:37:53.477 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0419e370 con 0x7f5c04104ae0 2023-10-08T08:37:53.477 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5bfa7fc700 1 -- 172.21.15.191:0/2181535125 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bfc00f040 con 0x7f5c04104ae0 2023-10-08T08:37:53.477 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5bfa7fc700 1 -- 172.21.15.191:0/2181535125 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc015400 con 0x7f5c04104ae0 2023-10-08T08:37:53.477 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.473+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c041a5bd0 con 0x7f5c04104ae0 2023-10-08T08:37:53.478 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.474+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c04102b20 con 0x7f5c04104ae0 2023-10-08T08:37:53.478 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.475+0000 7f5bfa7fc700 1 -- 172.21.15.191:0/2181535125 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f5bfc004020 con 0x7f5c04104ae0 2023-10-08T08:37:53.478 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.476+0000 7f5bfa7fc700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5bf00a1440 0x7f5bf00a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:37:53.478 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.476+0000 7f5bfa7fc700 1 -- 172.21.15.191:0/2181535125 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2524+0+0 (secure 0 0 0) 0x7f5bfc0caed0 con 0x7f5c04104ae0 2023-10-08T08:37:53.478 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.476+0000 7f5c09684700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5bf00a1440 0x7f5bf00a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:37:53.478 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.476+0000 7f5c09684700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5bf00a1440 0x7f5bf00a3900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4005950 tx=0x7f5bf40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:37:53.481 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.480+0000 7f5bfa7fc700 1 -- 172.21.15.191:0/2181535125 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5bfc04f100 con 0x7f5c04104ae0 2023-10-08T08:37:53.676 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:37:53.675+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c0419a170 con 0x7f5bf00a1440 2023-10-08T08:37:53.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:53 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:37:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:53 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:37:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:53 smithi070 ceph-mon[99513]: osd.1 [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] boot 2023-10-08T08:37:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:53 smithi070 ceph-mon[99513]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T08:37:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:53 smithi070 ceph-mon[99513]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:37:54.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:53 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:37:54.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:53 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:37:54.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:53 smithi105 ceph-mon[103798]: osd.1 [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] boot 2023-10-08T08:37:54.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:53 smithi105 ceph-mon[103798]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T08:37:54.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:54.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:53 smithi105 ceph-mon[103798]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:37:54.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:53 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:37:54.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:53 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:37:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:53 smithi191 ceph-mon[104220]: osd.1 [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] boot 2023-10-08T08:37:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:53 smithi191 ceph-mon[104220]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T08:37:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T08:37:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:53 smithi191 ceph-mon[104220]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:37:54.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:54 smithi191 ceph-mon[104220]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T08:37:54.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:54 smithi191 ceph-mon[104220]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:37:54.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:54 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:37:54.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:54 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:37:54.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:54 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:54.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:54 smithi070 ceph-mon[99513]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T08:37:54.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:54 smithi070 ceph-mon[99513]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:37:54.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:54 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:37:54.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:54 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:37:54.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:54 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:55.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:54 smithi105 ceph-mon[103798]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T08:37:55.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:54 smithi105 ceph-mon[103798]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:37:55.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:54 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:37:55.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:54 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:37:55.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:54 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:37:55.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:55 smithi070 ceph-mon[99513]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:37:56.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:55 smithi105 ceph-mon[103798]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:37:56.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:55 smithi191 ceph-mon[104220]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:37:56.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:56 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/3078307693' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f582afa9-c586-4006-b266-e0bbb3976b53"}]: dispatch 2023-10-08T08:37:56.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:56 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f582afa9-c586-4006-b266-e0bbb3976b53"}]: dispatch 2023-10-08T08:37:56.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:56 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f582afa9-c586-4006-b266-e0bbb3976b53"}]': finished 2023-10-08T08:37:56.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:56 smithi070 ceph-mon[99513]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T08:37:56.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:37:56.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:56 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/3209973195' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:37:57.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:56 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/3078307693' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f582afa9-c586-4006-b266-e0bbb3976b53"}]: dispatch 2023-10-08T08:37:57.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:56 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f582afa9-c586-4006-b266-e0bbb3976b53"}]: dispatch 2023-10-08T08:37:57.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:56 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f582afa9-c586-4006-b266-e0bbb3976b53"}]': finished 2023-10-08T08:37:57.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:56 smithi105 ceph-mon[103798]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T08:37:57.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:37:57.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:56 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/3209973195' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:37:57.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:56 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/3078307693' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f582afa9-c586-4006-b266-e0bbb3976b53"}]: dispatch 2023-10-08T08:37:57.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:56 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f582afa9-c586-4006-b266-e0bbb3976b53"}]: dispatch 2023-10-08T08:37:57.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:56 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f582afa9-c586-4006-b266-e0bbb3976b53"}]': finished 2023-10-08T08:37:57.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:56 smithi191 ceph-mon[104220]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T08:37:57.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:37:57.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:56 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/3209973195' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:37:57.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:37:57 smithi070 ceph-mon[99513]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:37:58.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:37:57 smithi105 ceph-mon[103798]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:37:58.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:37:57 smithi191 ceph-mon[104220]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:00.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:00 smithi191 ceph-mon[104220]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:00 smithi070 ceph-mon[99513]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:00 smithi105 ceph-mon[103798]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:02.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:02 smithi191 ceph-mon[104220]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:02.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:02 smithi070 ceph-mon[99513]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:02 smithi105 ceph-mon[103798]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:03.311 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:03 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T08:38:03.311 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:03 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:03.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:03 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T08:38:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:03 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:03.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:03 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T08:38:03.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:03 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:04.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:04 smithi191 ceph-mon[104220]: Deploying daemon osd.2 on smithi191 2023-10-08T08:38:04.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:04 smithi191 ceph-mon[104220]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:04 smithi070 ceph-mon[99513]: Deploying daemon osd.2 on smithi191 2023-10-08T08:38:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:04 smithi070 ceph-mon[99513]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:04 smithi105 ceph-mon[103798]: Deploying daemon osd.2 on smithi191 2023-10-08T08:38:04.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:04 smithi105 ceph-mon[103798]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:06.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:06 smithi191 ceph-mon[104220]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:06.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:06 smithi070 ceph-mon[99513]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:06.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:06 smithi105 ceph-mon[103798]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:08.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:07 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:08.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:07 smithi105 ceph-mon[103798]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:08.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:07 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:08.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:07 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:08.305 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:07 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:08.305 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:07 smithi191 ceph-mon[104220]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:08.305 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:07 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:08.305 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:07 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:08.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:07 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:08.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:07 smithi070 ceph-mon[99513]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:08.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:07 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:08.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:07 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:09.785 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.783+0000 7f5bfa7fc700 1 -- 172.21.15.191:0/2181535125 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5c0419a170 con 0x7f5bf00a1440 2023-10-08T08:38:09.785 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 2 on host 'smithi191' 2023-10-08T08:38:09.787 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5bf00a1440 msgr2=0x7f5bf00a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5bf00a1440 0x7f5bf00a3900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4005950 tx=0x7f5bf40058e0 comp rx=0 tx=0).stop 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04104ae0 msgr2=0x7f5c0419d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04104ae0 0x7f5c0419d750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc007ee0 tx=0x7f5bfc00d3b0 comp rx=0 tx=0).stop 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 shutdown_connections 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5bf00a1440 0x7f5bf00a3900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c04104ae0 0x7f5c0419d750 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c041004c0 0x7f5c04198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 --2- 172.21.15.191:0/2181535125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c04100e70 0x7f5c041993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 >> 172.21.15.191:0/2181535125 conn(0x7f5c04074aa0 msgr2=0x7f5c0410aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:38:09.788 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 shutdown_connections 2023-10-08T08:38:09.789 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:09.786+0000 7f5c0b8e8700 1 -- 172.21.15.191:0/2181535125 wait complete. 2023-10-08T08:38:10.139 DEBUG:teuthology.orchestra.run.smithi191:osd.2> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.2.service 2023-10-08T08:38:10.141 INFO:tasks.cephadm:Deploying osd.3 on smithi070 with /dev/vg_nvme/lv_3... 2023-10-08T08:38:10.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T08:38:10.171 INFO:journalctl@ceph.osd.2.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:38:10.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:10 smithi070 ceph-mon[99513]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:10.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:10 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:10 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:10 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:10.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:10 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:10.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:10 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:10 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:10 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:10 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:10.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:10 smithi105 ceph-mon[103798]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:10 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:10 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:10 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:10 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:10 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:10 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:10 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:10 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-mon[104220]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:10.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:10.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:10.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:10.710 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:38:11.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:11 smithi070 ceph-mon[99513]: from='osd.2 [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T08:38:11.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:11 smithi070 ceph-mon[99513]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T08:38:11.345 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:10 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-2[111440]: 2023-10-08T08:38:10.941+0000 7f0120d35640 -1 osd.2 0 log_to_monitors true 2023-10-08T08:38:11.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:11 smithi191 ceph-mon[104220]: from='osd.2 [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T08:38:11.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:11 smithi191 ceph-mon[104220]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T08:38:11.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:11 smithi105 ceph-mon[103798]: from='osd.2 [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T08:38:11.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:11 smithi105 ceph-mon[103798]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T08:38:12.327 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T08:38:12.327 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T08:38:12.328 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2023-10-08T08:38:12.328 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2023-10-08T08:38:12.328 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00829883 s, 1.3 GB/s 2023-10-08T08:38:12.328 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2023-10-08T08:38:12.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:12 smithi191 ceph-mon[104220]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:12.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:12 smithi191 ceph-mon[104220]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T08:38:12.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:12 smithi191 ceph-mon[104220]: from='osd.2 [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:38:12.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:12 smithi191 ceph-mon[104220]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T08:38:12.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:12.447 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:12 smithi191 ceph-mon[104220]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:38:12.448 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:12 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-2[111440]: 2023-10-08T08:38:12.141+0000 7f01163ac700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T08:38:12.448 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:12 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-2[111440]: 2023-10-08T08:38:12.145+0000 7f010e199700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:38:12.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:12 smithi070 ceph-mon[99513]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:12.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:12 smithi070 ceph-mon[99513]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T08:38:12.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:12 smithi070 ceph-mon[99513]: from='osd.2 [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:38:12.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:12 smithi070 ceph-mon[99513]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T08:38:12.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:12 smithi070 ceph-mon[99513]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:38:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:12 smithi105 ceph-mon[103798]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:12 smithi105 ceph-mon[103798]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T08:38:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:12 smithi105 ceph-mon[103798]: from='osd.2 [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:38:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:12 smithi105 ceph-mon[103798]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T08:38:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:12 smithi105 ceph-mon[103798]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:38:12.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi070:vg_nvme/lv_3 2023-10-08T08:38:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:38:13.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:38:13.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T08:38:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:13.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:38:13.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T08:38:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:14.409 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:14 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:38:14.409 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:14 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:38:14.409 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:14 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi191 2023-10-08T08:38:14.410 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:14 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi191 to 17168M 2023-10-08T08:38:14.410 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:14 smithi070 ceph-mon[99513]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:14.410 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:14.410 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:14 smithi070 ceph-mon[99513]: osd.2 [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] boot 2023-10-08T08:38:14.410 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:14 smithi070 ceph-mon[99513]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T08:38:14.410 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:14.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:14 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:38:14.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:14 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:38:14.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:14 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi191 2023-10-08T08:38:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:14 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi191 to 17168M 2023-10-08T08:38:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:14 smithi105 ceph-mon[103798]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:14 smithi105 ceph-mon[103798]: osd.2 [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] boot 2023-10-08T08:38:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:14 smithi105 ceph-mon[103798]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T08:38:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:14 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:38:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:14 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:38:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:14 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi191 2023-10-08T08:38:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:14 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi191 to 17168M 2023-10-08T08:38:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:14 smithi191 ceph-mon[104220]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T08:38:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:14 smithi191 ceph-mon[104220]: osd.2 [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] boot 2023-10-08T08:38:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:14 smithi191 ceph-mon[104220]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T08:38:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T08:38:14.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.598+0000 7f340720b700 1 -- 172.21.15.70:0/1143883559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 msgr2=0x7f3400105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:14.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.598+0000 7f340720b700 1 --2- 172.21.15.70:0/1143883559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 0x7f3400105a80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009990 tx=0x7f33f4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:38:14.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.598+0000 7f340720b700 1 -- 172.21.15.70:0/1143883559 shutdown_connections 2023-10-08T08:38:14.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.598+0000 7f340720b700 1 --2- 172.21.15.70:0/1143883559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3400101200 0x7f340010d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:14.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.598+0000 7f340720b700 1 --2- 172.21.15.70:0/1143883559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 0x7f3400105a80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:14.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.598+0000 7f340720b700 1 --2- 172.21.15.70:0/1143883559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3400100840 0x7f3400100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:14.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.598+0000 7f340720b700 1 -- 172.21.15.70:0/1143883559 >> 172.21.15.70:0/1143883559 conn(0x7f3400077950 msgr2=0x7f3400077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:38:14.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.598+0000 7f340720b700 1 -- 172.21.15.70:0/1143883559 shutdown_connections 2023-10-08T08:38:14.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.598+0000 7f340720b700 1 -- 172.21.15.70:0/1143883559 wait complete. 2023-10-08T08:38:14.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f340720b700 1 Processor -- start 2023-10-08T08:38:14.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f340720b700 1 -- start start 2023-10-08T08:38:14.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f340720b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3400100840 0x7f3400198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:14.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f340720b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3400101200 0x7f34001993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:14.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f340720b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 0x7f340019d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f340720b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340019ddb0 con 0x7f34001056a0 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f340720b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340019df20 con 0x7f3400100840 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f340720b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340019e0e0 con 0x7f3400101200 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f34057a8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 0x7f340019d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f34057a8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 0x7f340019d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48202/0 (socket says 172.21.15.70:48202) 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f34057a8700 1 -- 172.21.15.70:0/1900480805 learned_addr learned my addr 172.21.15.70:0/1900480805 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f3404fa7700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3400100840 0x7f3400198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f33fffff700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3400101200 0x7f34001993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f34057a8700 1 -- 172.21.15.70:0/1900480805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3400101200 msgr2=0x7f34001993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f34057a8700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3400101200 0x7f34001993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f34057a8700 1 -- 172.21.15.70:0/1900480805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3400100840 msgr2=0x7f3400198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f34057a8700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3400100840 0x7f3400198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:14.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f34057a8700 1 -- 172.21.15.70:0/1900480805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40095f0 con 0x7f34001056a0 2023-10-08T08:38:14.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.599+0000 7f34057a8700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 0x7f340019d7a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33f800ef30 tx=0x7f33f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:38:14.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.600+0000 7f33fdffb700 1 -- 172.21.15.70:0/1900480805 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8018070 con 0x7f34001056a0 2023-10-08T08:38:14.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.600+0000 7f33fdffb700 1 -- 172.21.15.70:0/1900480805 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33f800f040 con 0x7f34001056a0 2023-10-08T08:38:14.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.600+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340019e360 con 0x7f34001056a0 2023-10-08T08:38:14.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.600+0000 7f33fdffb700 1 -- 172.21.15.70:0/1900480805 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f800cd00 con 0x7f34001056a0 2023-10-08T08:38:14.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.600+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34001a5c20 con 0x7f34001056a0 2023-10-08T08:38:14.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.601+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3400101ec0 con 0x7f34001056a0 2023-10-08T08:38:14.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.602+0000 7f33fdffb700 1 -- 172.21.15.70:0/1900480805 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) v1 ==== 135964+0+0 (secure 0 0 0) 0x7f33f8003a00 con 0x7f34001056a0 2023-10-08T08:38:14.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.602+0000 7f33fdffb700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f33f00a1440 0x7f33f00a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:14.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.603+0000 7f3404fa7700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f33f00a1440 0x7f33f00a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:14.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.603+0000 7f33fdffb700 1 -- 172.21.15.70:0/1900480805 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3066+0+0 (secure 0 0 0) 0x7f33f80cb320 con 0x7f34001056a0 2023-10-08T08:38:14.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.603+0000 7f3404fa7700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f33f00a1440 0x7f33f00a3900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33f400b2e0 tx=0x7f33f4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:38:14.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.607+0000 7f33fdffb700 1 -- 172.21.15.70:0/1900480805 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f33f8095ed0 con 0x7f34001056a0 2023-10-08T08:38:14.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:14.804+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3400110700 con 0x7f33f00a1440 2023-10-08T08:38:15.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:15 smithi070 ceph-mon[99513]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T08:38:15.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:15 smithi070 ceph-mon[99513]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:38:15.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:38:15.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:38:15.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:15.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:15 smithi070 ceph-mon[99513]: pgmap v56: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:15.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T08:38:16.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:15 smithi105 ceph-mon[103798]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T08:38:16.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:15 smithi105 ceph-mon[103798]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:38:16.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:38:16.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:38:16.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:16.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:15 smithi105 ceph-mon[103798]: pgmap v56: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:16.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T08:38:16.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:15 smithi191 ceph-mon[104220]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T08:38:16.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:15 smithi191 ceph-mon[104220]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:38:16.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:38:16.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:38:16.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:16.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:15 smithi191 ceph-mon[104220]: pgmap v56: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:16.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T08:38:17.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T08:38:17.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:16 smithi105 ceph-mon[103798]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T08:38:17.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T08:38:17.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T08:38:17.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:16 smithi191 ceph-mon[104220]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T08:38:17.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T08:38:17.117 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T08:38:17.117 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:16 smithi070 ceph-mon[99513]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T08:38:17.117 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T08:38:17.378 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:38:17 smithi070 sudo[132000]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T08:38:17.379 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:38:17 smithi070 sudo[132000]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:17.379 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:38:17 smithi070 sudo[132000]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:17.379 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:38:17 smithi070 sudo[132000]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:17.720 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:38:17 smithi070 sudo[132009]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T08:38:17.720 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:38:17 smithi070 sudo[132009]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:17.721 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:38:17 smithi070 sudo[132009]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:17.721 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:38:17 smithi070 sudo[132009]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:17.898 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:38:17 smithi105 sudo[115580]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T08:38:17.898 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:38:17 smithi105 sudo[115580]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:17.898 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:38:17 smithi105 sudo[115580]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:17.898 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:38:17 smithi105 sudo[115580]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:17.898 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T08:38:17.899 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:17 smithi105 ceph-mon[103798]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T08:38:17.899 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:17 smithi105 ceph-mon[103798]: pgmap v59: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:17.899 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:17 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3390554352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4bbfa87-a5af-4322-bc0e-f5f97d3fe053"}]: dispatch 2023-10-08T08:38:17.899 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:17 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3390554352' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4bbfa87-a5af-4322-bc0e-f5f97d3fe053"}]': finished 2023-10-08T08:38:17.899 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:17 smithi105 ceph-mon[103798]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T08:38:17.899 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:17.899 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:18.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T08:38:18.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:17 smithi191 ceph-mon[104220]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T08:38:18.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:17 smithi191 ceph-mon[104220]: pgmap v59: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:18.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:17 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3390554352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4bbfa87-a5af-4322-bc0e-f5f97d3fe053"}]: dispatch 2023-10-08T08:38:18.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:17 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3390554352' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4bbfa87-a5af-4322-bc0e-f5f97d3fe053"}]': finished 2023-10-08T08:38:18.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:17 smithi191 ceph-mon[104220]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T08:38:18.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:18.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T08:38:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:17 smithi070 ceph-mon[99513]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T08:38:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:17 smithi070 ceph-mon[99513]: pgmap v59: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:17 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3390554352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4bbfa87-a5af-4322-bc0e-f5f97d3fe053"}]: dispatch 2023-10-08T08:38:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:17 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3390554352' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4bbfa87-a5af-4322-bc0e-f5f97d3fe053"}]': finished 2023-10-08T08:38:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:17 smithi070 ceph-mon[99513]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T08:38:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:18.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:18.270 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:38:17 smithi105 sudo[115583]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T08:38:18.270 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:38:17 smithi105 sudo[115583]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:18.271 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:38:17 smithi105 sudo[115583]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:18.271 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:38:17 smithi105 sudo[115583]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:18.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:18.412+0000 7f33fdffb700 1 -- 172.21.15.70:0/1900480805 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f33f8003cb0 con 0x7f34001056a0 2023-10-08T08:38:18.420 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:18 smithi191 sudo[116228]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T08:38:18.420 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:18 smithi191 sudo[116228]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:18.421 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:18 smithi191 sudo[116228]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:18.421 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:18 smithi191 sudo[116228]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:18.844 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:18 smithi191 sudo[116231]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T08:38:18.844 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:18 smithi191 sudo[116231]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:18.845 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:18 smithi191 sudo[116231]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:18.845 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:38:18 smithi191 sudo[116231]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:18.948 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 sudo[132461]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T08:38:18.948 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 sudo[132461]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:18.948 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 sudo[132461]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:18.948 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 sudo[132461]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:19.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:18 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/422814634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:38:19.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:19.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:18 smithi191 ceph-mon[104220]: mgrmap e20: x(active, since 99s), standbys: z, y 2023-10-08T08:38:19.212 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:19.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:18 smithi191 ceph-mon[104220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T08:38:19.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:18 smithi191 ceph-mon[104220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T08:38:19.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 sudo[116234]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T08:38:19.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 sudo[116234]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:19.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 sudo[116234]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:19.213 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 sudo[116234]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:19.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 sudo[132466]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T08:38:19.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 sudo[132466]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:19.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 sudo[132466]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:19.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 sudo[132466]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:19.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/422814634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:38:19.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:19.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 ceph-mon[99513]: mgrmap e20: x(active, since 99s), standbys: z, y 2023-10-08T08:38:19.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:19.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 ceph-mon[99513]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T08:38:19.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:18 smithi070 ceph-mon[99513]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T08:38:19.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:18 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/422814634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:38:19.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:19.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:18 smithi105 ceph-mon[103798]: mgrmap e20: x(active, since 99s), standbys: z, y 2023-10-08T08:38:19.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:19.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:18 smithi105 ceph-mon[103798]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T08:38:19.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:18 smithi105 ceph-mon[103798]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T08:38:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 sudo[116237]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T08:38:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 sudo[116237]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:19.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 sudo[116237]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:19.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 sudo[116237]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:19.948 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 sudo[115586]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T08:38:19.948 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 sudo[115586]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:19.948 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 sudo[115586]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:19.948 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 sudo[115586]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:20.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:38:20.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:38:20.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:38:20.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:19 smithi070 ceph-mon[99513]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 sudo[115589]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 sudo[115589]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 sudo[115589]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 sudo[115589]: pam_unix(sudo:session): session closed for user root 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:38:20.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:38:20.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:20.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T08:38:20.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T08:38:20.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:38:20.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:38:20.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:38:20.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:19 smithi105 ceph-mon[103798]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T08:38:20.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T08:38:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T08:38:20.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T08:38:20.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:19 smithi191 ceph-mon[104220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T08:38:22.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:22 smithi191 ceph-mon[104220]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:22.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:22 smithi070 ceph-mon[99513]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:22.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:22 smithi105 ceph-mon[103798]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:24.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:24 smithi070 ceph-mon[99513]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 326 KiB/s wr, 22 op/s 2023-10-08T08:38:24.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:24 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T08:38:24.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:24 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:24.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:24 smithi191 ceph-mon[104220]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 326 KiB/s wr, 22 op/s 2023-10-08T08:38:24.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:24 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T08:38:24.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:24 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:24 smithi105 ceph-mon[103798]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 326 KiB/s wr, 22 op/s 2023-10-08T08:38:24.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:24 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T08:38:24.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:24 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:25.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:25 smithi191 ceph-mon[104220]: Deploying daemon osd.3 on smithi070 2023-10-08T08:38:25.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:25 smithi070 ceph-mon[99513]: Deploying daemon osd.3 on smithi070 2023-10-08T08:38:25.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:25 smithi105 ceph-mon[103798]: Deploying daemon osd.3 on smithi070 2023-10-08T08:38:26.168 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:26 smithi070 ceph-mon[99513]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 218 KiB/s wr, 15 op/s 2023-10-08T08:38:26.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:26 smithi191 ceph-mon[104220]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 218 KiB/s wr, 15 op/s 2023-10-08T08:38:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:26 smithi105 ceph-mon[103798]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 218 KiB/s wr, 15 op/s 2023-10-08T08:38:28.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:28 smithi191 ceph-mon[104220]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-10-08T08:38:28.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:28 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:28.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:28 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:28.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:28 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:28.429 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:28 smithi070 ceph-mon[99513]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-10-08T08:38:28.429 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:28 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:28.429 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:28 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:28.429 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:28 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:28.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:28 smithi105 ceph-mon[103798]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-10-08T08:38:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:28 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:28 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:28 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:30.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:30 smithi070 ceph-mon[99513]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-10-08T08:38:30.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:30 smithi191 ceph-mon[104220]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-10-08T08:38:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:30 smithi105 ceph-mon[103798]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-10-08T08:38:30.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.802+0000 7f33fdffb700 1 -- 172.21.15.70:0/1900480805 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3400110700 con 0x7f33f00a1440 2023-10-08T08:38:30.806 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 3 on host 'smithi070' 2023-10-08T08:38:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f33f00a1440 msgr2=0x7f33f00a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f33f00a1440 0x7f33f00a3900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33f400b2e0 tx=0x7f33f4005960 comp rx=0 tx=0).stop 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 msgr2=0x7f340019d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 0x7f340019d7a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33f800ef30 tx=0x7f33f800c3a0 comp rx=0 tx=0).stop 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 shutdown_connections 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f33f00a1440 0x7f33f00a3900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34001056a0 0x7f340019d7a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3400100840 0x7f3400198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 --2- 172.21.15.70:0/1900480805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3400101200 0x7f34001993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 >> 172.21.15.70:0/1900480805 conn(0x7f3400077950 msgr2=0x7f34000fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 shutdown_connections 2023-10-08T08:38:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:38:30.804+0000 7f340720b700 1 -- 172.21.15.70:0/1900480805 wait complete. 2023-10-08T08:38:31.216 DEBUG:teuthology.orchestra.run.smithi070:osd.3> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.3.service 2023-10-08T08:38:31.218 INFO:tasks.cephadm:Deploying osd.4 on smithi105 with /dev/vg_nvme/lv_3... 2023-10-08T08:38:31.219 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T08:38:31.254 INFO:journalctl@ceph.osd.3.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:38:31.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:31.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:31.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:31.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:31.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:31.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:31.792 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:38:32.023 INFO:journalctl@ceph.osd.3.smithi070.stdout:Oct 08 08:38:31 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-3[134233]: 2023-10-08T08:38:31.937+0000 7f15b13f9640 -1 osd.3 0 log_to_monitors true 2023-10-08T08:38:32.293 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:32 smithi070 ceph-mon[99513]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-08T08:38:32.293 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:32 smithi070 ceph-mon[99513]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T08:38:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:32 smithi105 ceph-mon[103798]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-08T08:38:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:32 smithi105 ceph-mon[103798]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T08:38:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:32 smithi191 ceph-mon[104220]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-10-08T08:38:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:32 smithi191 ceph-mon[104220]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T08:38:33.155 INFO:teuthology.orchestra.run.smithi105.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T08:38:33.155 INFO:teuthology.orchestra.run.smithi105.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T08:38:33.155 INFO:teuthology.orchestra.run.smithi105.stderr: stderr: 10+0 records in 2023-10-08T08:38:33.155 INFO:teuthology.orchestra.run.smithi105.stderr:10+0 records out 2023-10-08T08:38:33.156 INFO:teuthology.orchestra.run.smithi105.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011293 s, 929 MB/s 2023-10-08T08:38:33.156 INFO:teuthology.orchestra.run.smithi105.stderr:--> Zapping successful for: 2023-10-08T08:38:33.535 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi105:vg_nvme/lv_3 2023-10-08T08:38:34.090 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:38:34.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:33 smithi191 ceph-mon[104220]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T08:38:34.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:33 smithi191 ceph-mon[104220]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T08:38:34.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:33 smithi191 ceph-mon[104220]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:38:34.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:34.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:33 smithi191 ceph-mon[104220]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:34.220 INFO:journalctl@ceph.osd.3.smithi070.stdout:Oct 08 08:38:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-3[134233]: 2023-10-08T08:38:33.802+0000 7f15a6a70700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T08:38:34.221 INFO:journalctl@ceph.osd.3.smithi070.stdout:Oct 08 08:38:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-3[134233]: 2023-10-08T08:38:33.806+0000 7f15a0861700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:38:34.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:33 smithi070 ceph-mon[99513]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T08:38:34.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:33 smithi070 ceph-mon[99513]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T08:38:34.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:33 smithi070 ceph-mon[99513]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:38:34.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:34.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:33 smithi070 ceph-mon[99513]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:34.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:33 smithi105 ceph-mon[103798]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T08:38:34.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:33 smithi105 ceph-mon[103798]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T08:38:34.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:33 smithi105 ceph-mon[103798]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:38:34.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:34.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:33 smithi105 ceph-mon[103798]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T08:38:35.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:38:35.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T08:38:35.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:35.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:35.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi070 2023-10-08T08:38:35.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:35.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:35.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi070 to 8584M 2023-10-08T08:38:35.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:35.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:35.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] boot 2023-10-08T08:38:35.023 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T08:38:35.023 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:35.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi070 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi070 to 8584M 2023-10-08T08:38:35.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:35.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:35.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] boot 2023-10-08T08:38:35.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T08:38:35.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:35.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi070 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi070 to 8584M 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:35.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:35.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:35.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: osd.3 [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] boot 2023-10-08T08:38:35.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T08:38:35.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T08:38:35.244 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.241+0000 7f656c1dc700 1 -- 172.21.15.105:0/2806165845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65640ffb30 msgr2=0x7f656410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:35.244 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.241+0000 7f656c1dc700 1 --2- 172.21.15.105:0/2806165845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65640ffb30 0x7f656410d5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6554009990 tx=0x7f6554009ca0 comp rx=0 tx=0).stop 2023-10-08T08:38:35.244 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.241+0000 7f656c1dc700 1 -- 172.21.15.105:0/2806165845 shutdown_connections 2023-10-08T08:38:35.244 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.241+0000 7f656c1dc700 1 --2- 172.21.15.105:0/2806165845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65640ffb30 0x7f656410d5c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:35.244 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.241+0000 7f656c1dc700 1 --2- 172.21.15.105:0/2806165845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65641058d0 0x7f6564105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:35.244 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.241+0000 7f656c1dc700 1 --2- 172.21.15.105:0/2806165845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65640ff190 0x7f65640ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:35.244 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.241+0000 7f656c1dc700 1 -- 172.21.15.105:0/2806165845 >> 172.21.15.105:0/2806165845 conn(0x7f6564074a10 msgr2=0x7f6564074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:38:35.244 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.241+0000 7f656c1dc700 1 -- 172.21.15.105:0/2806165845 shutdown_connections 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.241+0000 7f656c1dc700 1 -- 172.21.15.105:0/2806165845 wait complete. 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656c1dc700 1 Processor -- start 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656c1dc700 1 -- start start 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656c1dc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65640ff190 0x7f6564100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656c1dc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65640ffb30 0x7f65641008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656c1dc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65641058d0 0x7f6564100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656c1dc700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65641a4f30 con 0x7f65640ffb30 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656c1dc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65641a50a0 con 0x7f65641058d0 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656c1dc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65641a5260 con 0x7f65640ff190 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656a779700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65641058d0 0x7f6564100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656a779700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65641058d0 0x7f6564100df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40614/0 (socket says 172.21.15.105:40614) 2023-10-08T08:38:35.245 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656a779700 1 -- 172.21.15.105:0/1906685128 learned_addr learned my addr 172.21.15.105:0/1906685128 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f6569777700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65640ffb30 0x7f65641008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f6569f78700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65640ff190 0x7f6564100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656a779700 1 -- 172.21.15.105:0/1906685128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65640ff190 msgr2=0x7f6564100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656a779700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65640ff190 0x7f6564100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656a779700 1 -- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65640ffb30 msgr2=0x7f65641008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656a779700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65640ffb30 0x7f65641008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f656a779700 1 -- 172.21.15.105:0/1906685128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65540095f0 con 0x7f65641058d0 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.242+0000 7f6569f78700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65640ff190 0x7f6564100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.243+0000 7f656a779700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65641058d0 0x7f6564100df0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f655400c010 tx=0x7f6554005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.243+0000 7f6562ffd700 1 -- 172.21.15.105:0/1906685128 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655401d070 con 0x7f65641058d0 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.243+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65641a54e0 con 0x7f65641058d0 2023-10-08T08:38:35.246 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.243+0000 7f6562ffd700 1 -- 172.21.15.105:0/1906685128 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6554005030 con 0x7f65641058d0 2023-10-08T08:38:35.247 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.243+0000 7f6562ffd700 1 -- 172.21.15.105:0/1906685128 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554004b30 con 0x7f65641058d0 2023-10-08T08:38:35.247 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.243+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65641a58f0 con 0x7f65641058d0 2023-10-08T08:38:35.247 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.244+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6564108d30 con 0x7f65641058d0 2023-10-08T08:38:35.248 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.245+0000 7f6562ffd700 1 -- 172.21.15.105:0/1906685128 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f65540051a0 con 0x7f65641058d0 2023-10-08T08:38:35.248 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.245+0000 7f6562ffd700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f654c0a14d0 0x7f654c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:35.248 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.245+0000 7f6562ffd700 1 -- 172.21.15.105:0/1906685128 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3913+0+0 (secure 0 0 0) 0x7f65540ccd80 con 0x7f65641058d0 2023-10-08T08:38:35.248 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.246+0000 7f6569f78700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f654c0a14d0 0x7f654c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:35.248 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.246+0000 7f6569f78700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f654c0a14d0 0x7f654c0a3990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6564068160 tx=0x7f655c009040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:38:35.250 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.249+0000 7f6562ffd700 1 -- 172.21.15.105:0/1906685128 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f65540975a0 con 0x7f65641058d0 2023-10-08T08:38:35.445 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:35.445+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6564101850 con 0x7f654c0a14d0 2023-10-08T08:38:36.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:35 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:38:36.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:35 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:38:36.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:35 smithi191 ceph-mon[104220]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:36.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:35 smithi191 ceph-mon[104220]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T08:38:36.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:35 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:38:36.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:35 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:38:36.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:35 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:36.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:35 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:38:36.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:35 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:38:36.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:35 smithi070 ceph-mon[99513]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:36.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:35 smithi070 ceph-mon[99513]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T08:38:36.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:35 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:38:36.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:35 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:38:36.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:35 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:36.242 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:35 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:38:36.242 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:35 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:38:36.242 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:35 smithi105 ceph-mon[103798]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:36.242 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:35 smithi105 ceph-mon[103798]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T08:38:36.242 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:35 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:38:36.242 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:35 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:38:36.242 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:35 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:37.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:37 smithi105 ceph-mon[103798]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:38:37.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:37 smithi105 ceph-mon[103798]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T08:38:37.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:37 smithi191 ceph-mon[104220]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:38:37.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:37 smithi191 ceph-mon[104220]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T08:38:37.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:37 smithi070 ceph-mon[99513]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:38:37.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:37 smithi070 ceph-mon[99513]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T08:38:38.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:38 smithi191 ceph-mon[104220]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:38.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:38 smithi191 ceph-mon[104220]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T08:38:38.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:38 smithi191 ceph-mon[104220]: from='client.? 172.21.15.105:0/3422204390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75c81f9-f784-47dd-8db2-cc0c3da2ea42"}]: dispatch 2023-10-08T08:38:38.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:38 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75c81f9-f784-47dd-8db2-cc0c3da2ea42"}]: dispatch 2023-10-08T08:38:38.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:38 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e75c81f9-f784-47dd-8db2-cc0c3da2ea42"}]': finished 2023-10-08T08:38:38.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:38 smithi191 ceph-mon[104220]: osdmap e30: 5 total, 4 up, 5 in 2023-10-08T08:38:38.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:38.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:38 smithi070 ceph-mon[99513]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:38.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:38 smithi070 ceph-mon[99513]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T08:38:38.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:38 smithi070 ceph-mon[99513]: from='client.? 172.21.15.105:0/3422204390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75c81f9-f784-47dd-8db2-cc0c3da2ea42"}]: dispatch 2023-10-08T08:38:38.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:38 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75c81f9-f784-47dd-8db2-cc0c3da2ea42"}]: dispatch 2023-10-08T08:38:38.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:38 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e75c81f9-f784-47dd-8db2-cc0c3da2ea42"}]': finished 2023-10-08T08:38:38.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:38 smithi070 ceph-mon[99513]: osdmap e30: 5 total, 4 up, 5 in 2023-10-08T08:38:38.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:38 smithi105 ceph-mon[103798]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:38 smithi105 ceph-mon[103798]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T08:38:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:38 smithi105 ceph-mon[103798]: from='client.? 172.21.15.105:0/3422204390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75c81f9-f784-47dd-8db2-cc0c3da2ea42"}]: dispatch 2023-10-08T08:38:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:38 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e75c81f9-f784-47dd-8db2-cc0c3da2ea42"}]: dispatch 2023-10-08T08:38:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:38 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e75c81f9-f784-47dd-8db2-cc0c3da2ea42"}]': finished 2023-10-08T08:38:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:38 smithi105 ceph-mon[103798]: osdmap e30: 5 total, 4 up, 5 in 2023-10-08T08:38:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:39.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:39 smithi191 ceph-mon[104220]: from='client.? 172.21.15.105:0/3502057479' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:38:39.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:39 smithi070 ceph-mon[99513]: from='client.? 172.21.15.105:0/3502057479' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:38:39.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:39 smithi105 ceph-mon[103798]: from='client.? 172.21.15.105:0/3502057479' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:38:40.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:40 smithi191 ceph-mon[104220]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T08:38:40.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:40 smithi070 ceph-mon[99513]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T08:38:40.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:40 smithi105 ceph-mon[103798]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T08:38:42.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:42 smithi191 ceph-mon[104220]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:38:42.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:42 smithi070 ceph-mon[99513]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:38:42.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:42 smithi105 ceph-mon[103798]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:38:44.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:44 smithi105 ceph-mon[103798]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-08T08:38:44.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T08:38:44.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:44.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:44 smithi191 ceph-mon[104220]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-08T08:38:44.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T08:38:44.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:44.608 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:44 smithi070 ceph-mon[99513]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-08T08:38:44.608 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T08:38:44.608 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:45.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:45 smithi105 ceph-mon[103798]: Deploying daemon osd.4 on smithi105 2023-10-08T08:38:45.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:45 smithi191 ceph-mon[104220]: Deploying daemon osd.4 on smithi105 2023-10-08T08:38:45.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:45 smithi070 ceph-mon[99513]: Deploying daemon osd.4 on smithi105 2023-10-08T08:38:46.096 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:46 smithi105 ceph-mon[103798]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T08:38:46.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:46 smithi191 ceph-mon[104220]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T08:38:46.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:46 smithi070 ceph-mon[99513]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T08:38:48.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:48 smithi105 ceph-mon[103798]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T08:38:48.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:48 smithi191 ceph-mon[104220]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T08:38:48.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:48 smithi070 ceph-mon[99513]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T08:38:49.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:49.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:49.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:49.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:49.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:49.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:49.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:49.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:49.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:50.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:50 smithi105 ceph-mon[103798]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:50.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:50 smithi070 ceph-mon[99513]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:50 smithi191 ceph-mon[104220]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:50.754 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.753+0000 7f6562ffd700 1 -- 172.21.15.105:0/1906685128 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6564101850 con 0x7f654c0a14d0 2023-10-08T08:38:50.754 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 4 on host 'smithi105' 2023-10-08T08:38:50.757 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.755+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f654c0a14d0 msgr2=0x7f654c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:50.757 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.755+0000 7f656c1dc700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f654c0a14d0 0x7f654c0a3990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6564068160 tx=0x7f655c009040 comp rx=0 tx=0).stop 2023-10-08T08:38:50.757 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65641058d0 msgr2=0x7f6564100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:50.758 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65641058d0 0x7f6564100df0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f655400c010 tx=0x7f6554005f10 comp rx=0 tx=0).stop 2023-10-08T08:38:50.758 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 shutdown_connections 2023-10-08T08:38:50.758 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f654c0a14d0 0x7f654c0a3990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:50.758 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65641058d0 0x7f6564100df0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:50.758 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65640ff190 0x7f6564100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:50.758 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 --2- 172.21.15.105:0/1906685128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65640ffb30 0x7f65641008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:50.759 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 >> 172.21.15.105:0/1906685128 conn(0x7f6564074a10 msgr2=0x7f65640fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:38:50.759 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 shutdown_connections 2023-10-08T08:38:50.759 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:38:50.756+0000 7f656c1dc700 1 -- 172.21.15.105:0/1906685128 wait complete. 2023-10-08T08:38:51.163 DEBUG:teuthology.orchestra.run.smithi105:osd.4> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.4.service 2023-10-08T08:38:51.166 INFO:tasks.cephadm:Deploying osd.5 on smithi191 with /dev/vg_nvme/lv_3... 2023-10-08T08:38:51.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T08:38:51.197 INFO:journalctl@ceph.osd.4.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:38:51.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:51.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:51.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:51.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:51.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:51.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:51.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:51.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:51.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:51.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:38:51.733 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:38:52.222 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:52 smithi191 ceph-mon[104220]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:52.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:52 smithi191 ceph-mon[104220]: from='osd.4 [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T08:38:52.223 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:52 smithi191 ceph-mon[104220]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T08:38:52.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:52 smithi105 ceph-mon[103798]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:52.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:52 smithi105 ceph-mon[103798]: from='osd.4 [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T08:38:52.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:52 smithi105 ceph-mon[103798]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T08:38:52.271 INFO:journalctl@ceph.osd.4.smithi105.stdout:Oct 08 08:38:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-4[118657]: 2023-10-08T08:38:52.103+0000 7f83b8251640 -1 osd.4 0 log_to_monitors true 2023-10-08T08:38:52.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:52 smithi070 ceph-mon[99513]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:52.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:52 smithi070 ceph-mon[99513]: from='osd.4 [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T08:38:52.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:52 smithi070 ceph-mon[99513]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T08:38:53.200 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T08:38:53.200 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T08:38:53.200 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2023-10-08T08:38:53.200 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2023-10-08T08:38:53.200 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109845 s, 955 MB/s 2023-10-08T08:38:53.200 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2023-10-08T08:38:53.576 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi191:vg_nvme/lv_3 2023-10-08T08:38:53.745 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T08:38:53.746 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T08:38:53.746 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:53.746 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='osd.4 [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:38:53.746 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:38:53.746 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:53.746 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:53.746 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:53.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:53.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:53.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:53.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:53.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:54.021 INFO:journalctl@ceph.osd.4.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-4[118657]: 2023-10-08T08:38:53.750+0000 7f83ad8c8700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T08:38:54.021 INFO:journalctl@ceph.osd.4.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-4[118657]: 2023-10-08T08:38:53.758+0000 7f83a7eba700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:38:54.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T08:38:54.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T08:38:54.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:54.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='osd.4 [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:38:54.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:38:54.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:54.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:54.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:54.023 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:54.023 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:54.023 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:54.023 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:54.023 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:54.023 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:54.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:54.147 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:38:54.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='osd.4 [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:38:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:54.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:54.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:38:54.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:38:55.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:54 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi105 2023-10-08T08:38:55.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:54 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi105 to 8584M 2023-10-08T08:38:55.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:54 smithi105 ceph-mon[103798]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:38:55.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:54 smithi105 ceph-mon[103798]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T08:38:55.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:54 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:55.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:54 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:55.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:54 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi105 2023-10-08T08:38:55.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:54 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi105 to 8584M 2023-10-08T08:38:55.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:54 smithi191 ceph-mon[104220]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:38:55.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:54 smithi191 ceph-mon[104220]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T08:38:55.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:54 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:55.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:54 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:55.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:54 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi105 2023-10-08T08:38:55.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:54 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi105 to 8584M 2023-10-08T08:38:55.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:54 smithi070 ceph-mon[99513]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:38:55.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:54 smithi070 ceph-mon[99513]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T08:38:55.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:54 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:55.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:54 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:55.354 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.350+0000 7f17d4f57700 1 -- 172.21.15.191:0/900733211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 msgr2=0x7f17d00ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:55.354 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.350+0000 7f17d4f57700 1 --2- 172.21.15.191:0/900733211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 0x7f17d00ffbd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009990 tx=0x7f17c0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:38:55.354 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.350+0000 7f17d4f57700 1 -- 172.21.15.191:0/900733211 shutdown_connections 2023-10-08T08:38:55.354 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.350+0000 7f17d4f57700 1 --2- 172.21.15.191:0/900733211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d0100110 0x7f17d010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:55.354 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.350+0000 7f17d4f57700 1 --2- 172.21.15.191:0/900733211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17d01056b0 0x7f17d0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:55.354 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.350+0000 7f17d4f57700 1 --2- 172.21.15.191:0/900733211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 0x7f17d00ffbd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:55.354 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.350+0000 7f17d4f57700 1 -- 172.21.15.191:0/900733211 >> 172.21.15.191:0/900733211 conn(0x7f17d0075790 msgr2=0x7f17d0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:38:55.354 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.350+0000 7f17d4f57700 1 -- 172.21.15.191:0/900733211 shutdown_connections 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.350+0000 7f17d4f57700 1 -- 172.21.15.191:0/900733211 wait complete. 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17d4f57700 1 Processor -- start 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17d4f57700 1 -- start start 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17d4f57700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 0x7f17d0197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17d4f57700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d0100110 0x7f17d0197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17d4f57700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17d01056b0 0x7f17d01a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17d4f57700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0198800 con 0x7f17d0100110 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17d4f57700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d01a2fc0 con 0x7f17d01056b0 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17d4f57700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d01a3100 con 0x7f17d00ff750 2023-10-08T08:38:55.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17ce59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 0x7f17d0197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17ce59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 0x7f17d0197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:55870/0 (socket says 172.21.15.191:55870) 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17ce59c700 1 -- 172.21.15.191:0/1761333005 learned_addr learned my addr 172.21.15.191:0/1761333005 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17cdd9b700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d0100110 0x7f17d0197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17ced9d700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17d01056b0 0x7f17d01a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.351+0000 7f17ce59c700 1 -- 172.21.15.191:0/1761333005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17d01056b0 msgr2=0x7f17d01a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17ce59c700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17d01056b0 0x7f17d01a2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17ce59c700 1 -- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d0100110 msgr2=0x7f17d0197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17ce59c700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d0100110 0x7f17d0197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17ce59c700 1 -- 172.21.15.191:0/1761333005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c00095f0 con 0x7f17d00ff750 2023-10-08T08:38:55.356 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17cdd9b700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d0100110 0x7f17d0197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:38:55.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17ce59c700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 0x7f17d0197a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c920 tx=0x7f17c400cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:38:55.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17bf7fe700 1 -- 172.21.15.191:0/1761333005 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4007b00 con 0x7f17d00ff750 2023-10-08T08:38:55.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17bf7fe700 1 -- 172.21.15.191:0/1761333005 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17c4004cf0 con 0x7f17d00ff750 2023-10-08T08:38:55.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17bf7fe700 1 -- 172.21.15.191:0/1761333005 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4005610 con 0x7f17d00ff750 2023-10-08T08:38:55.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d01a3380 con 0x7f17d00ff750 2023-10-08T08:38:55.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.352+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d01a3830 con 0x7f17d00ff750 2023-10-08T08:38:55.358 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.353+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d0107cb0 con 0x7f17d00ff750 2023-10-08T08:38:55.358 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.354+0000 7f17bf7fe700 1 -- 172.21.15.191:0/1761333005 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f17c4004750 con 0x7f17d00ff750 2023-10-08T08:38:55.358 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.354+0000 7f17bf7fe700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17b80a14d0 0x7f17b80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:38:55.358 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.355+0000 7f17bf7fe700 1 -- 172.21.15.191:0/1761333005 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4316+0+0 (secure 0 0 0) 0x7f17c40cbd30 con 0x7f17d00ff750 2023-10-08T08:38:55.359 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.355+0000 7f17cdd9b700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17b80a14d0 0x7f17b80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:38:55.359 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.355+0000 7f17cdd9b700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17b80a14d0 0x7f17b80a3990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17c0006010 tx=0x7f17c001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:38:55.360 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.359+0000 7f17bf7fe700 1 -- 172.21.15.191:0/1761333005 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f17c4096330 con 0x7f17d00ff750 2023-10-08T08:38:55.555 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:38:55.554+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f17d0068750 con 0x7f17b80a14d0 2023-10-08T08:38:56.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:38:56.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:38:56.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:56.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: osd.4 [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] boot 2023-10-08T08:38:56.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: osdmap e33: 5 total, 5 up, 5 in 2023-10-08T08:38:56.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:56.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:56.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:38:56.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:38:56.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:56.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:38:56.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:38:56.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:56.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: osd.4 [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] boot 2023-10-08T08:38:56.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: osdmap e33: 5 total, 5 up, 5 in 2023-10-08T08:38:56.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:56.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:56.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:38:56.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:38:56.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:56.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:38:56.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:38:56.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:56.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: osd.4 [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] boot 2023-10-08T08:38:56.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: osdmap e33: 5 total, 5 up, 5 in 2023-10-08T08:38:56.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T08:38:56.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T08:38:56.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:38:56.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:38:56.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:38:57.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:56 smithi105 ceph-mon[103798]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:38:57.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:56 smithi105 ceph-mon[103798]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T08:38:57.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:56 smithi191 ceph-mon[104220]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:38:57.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:56 smithi191 ceph-mon[104220]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T08:38:57.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:56 smithi070 ceph-mon[99513]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:38:57.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:56 smithi070 ceph-mon[99513]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T08:38:58.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:57 smithi105 ceph-mon[103798]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:38:58.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:57 smithi191 ceph-mon[104220]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:38:58.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:57 smithi070 ceph-mon[99513]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:38:59.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:58 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/2273681599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e"}]: dispatch 2023-10-08T08:38:59.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:58 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e"}]: dispatch 2023-10-08T08:38:59.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:58 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e"}]': finished 2023-10-08T08:38:59.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:58 smithi105 ceph-mon[103798]: osdmap e35: 6 total, 5 up, 6 in 2023-10-08T08:38:59.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:38:59.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:38:58 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/3421487000' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:38:59.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:58 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/2273681599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e"}]: dispatch 2023-10-08T08:38:59.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:58 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e"}]: dispatch 2023-10-08T08:38:59.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:58 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e"}]': finished 2023-10-08T08:38:59.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:58 smithi191 ceph-mon[104220]: osdmap e35: 6 total, 5 up, 6 in 2023-10-08T08:38:59.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:38:59.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:38:58 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/3421487000' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:38:59.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:58 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/2273681599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e"}]: dispatch 2023-10-08T08:38:59.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:58 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e"}]: dispatch 2023-10-08T08:38:59.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:58 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e"}]': finished 2023-10-08T08:38:59.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:58 smithi070 ceph-mon[99513]: osdmap e35: 6 total, 5 up, 6 in 2023-10-08T08:38:59.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:38:59.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:38:58 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/3421487000' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:39:00.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:00 smithi191 ceph-mon[104220]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:00 smithi070 ceph-mon[99513]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:00 smithi105 ceph-mon[103798]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:02.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:02 smithi191 ceph-mon[104220]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:02.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:02 smithi070 ceph-mon[99513]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:02 smithi105 ceph-mon[103798]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:04.226 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:04 smithi191 ceph-mon[104220]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:04 smithi070 ceph-mon[99513]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:04 smithi105 ceph-mon[103798]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:05.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:05 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T08:39:05.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:05 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:05.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:05 smithi191 ceph-mon[104220]: Deploying daemon osd.5 on smithi191 2023-10-08T08:39:05.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:05 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T08:39:05.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:05 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:05.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:05 smithi070 ceph-mon[99513]: Deploying daemon osd.5 on smithi191 2023-10-08T08:39:05.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:05 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T08:39:05.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:05 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:05.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:05 smithi105 ceph-mon[103798]: Deploying daemon osd.5 on smithi191 2023-10-08T08:39:06.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:06 smithi191 ceph-mon[104220]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:06.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:06 smithi070 ceph-mon[99513]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:06.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:06 smithi105 ceph-mon[103798]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:08.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:08 smithi191 ceph-mon[104220]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:08.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:08 smithi070 ceph-mon[99513]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:08 smithi105 ceph-mon[103798]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:09.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:09 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:09.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:09 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:09.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:09 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:09.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:09 smithi191 ceph-mon[104220]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:09.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:09 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:09.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:09 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:09.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:09 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:09.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:09 smithi070 ceph-mon[99513]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:10.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:09 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:10.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:09 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:10.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:09 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:10.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:09 smithi105 ceph-mon[103798]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:11.313 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.312+0000 7f17bf7fe700 1 -- 172.21.15.191:0/1761333005 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f17d0068750 con 0x7f17b80a14d0 2023-10-08T08:39:11.313 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 5 on host 'smithi191' 2023-10-08T08:39:11.315 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17b80a14d0 msgr2=0x7f17b80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:11.315 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17b80a14d0 0x7f17b80a3990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17c0006010 tx=0x7f17c001a040 comp rx=0 tx=0).stop 2023-10-08T08:39:11.315 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 msgr2=0x7f17d0197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:11.316 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 0x7f17d0197a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c920 tx=0x7f17c400cce0 comp rx=0 tx=0).stop 2023-10-08T08:39:11.316 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 shutdown_connections 2023-10-08T08:39:11.316 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17b80a14d0 0x7f17b80a3990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:11.316 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17d01056b0 0x7f17d01a2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:11.316 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17d00ff750 0x7f17d0197a00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:11.316 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 --2- 172.21.15.191:0/1761333005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17d0100110 0x7f17d0197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:11.316 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 >> 172.21.15.191:0/1761333005 conn(0x7f17d0075790 msgr2=0x7f17d00fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:39:11.316 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 shutdown_connections 2023-10-08T08:39:11.316 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:11.314+0000 7f17d4f57700 1 -- 172.21.15.191:0/1761333005 wait complete. 2023-10-08T08:39:11.734 DEBUG:teuthology.orchestra.run.smithi191:osd.5> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.5.service 2023-10-08T08:39:11.736 INFO:tasks.cephadm:Deploying osd.6 on smithi070 with /dev/vg_nvme/lv_2... 2023-10-08T08:39:11.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T08:39:11.767 INFO:journalctl@ceph.osd.5.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:39:12.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:12.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:12.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:11 smithi105 ceph-mon[103798]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:12.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:12.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:12.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:12.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:11 smithi191 ceph-mon[104220]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:12.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:12.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:12.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:12.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:11 smithi070 ceph-mon[99513]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:12.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:12.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:39:12.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:12 smithi191 ceph-mon[104220]: from='osd.5 [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T08:39:12.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:12 smithi191 ceph-mon[104220]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T08:39:12.845 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:39:12 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:39:12.615+0000 7f2c65078640 -1 osd.5 0 log_to_monitors true 2023-10-08T08:39:13.096 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:12 smithi070 ceph-mon[99513]: from='osd.5 [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T08:39:13.096 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:12 smithi070 ceph-mon[99513]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T08:39:13.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:12 smithi105 ceph-mon[103798]: from='osd.5 [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T08:39:13.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:12 smithi105 ceph-mon[103798]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T08:39:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T08:39:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T08:39:13.857 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2023-10-08T08:39:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2023-10-08T08:39:13.858 INFO:teuthology.orchestra.run.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00840835 s, 1.2 GB/s 2023-10-08T08:39:13.858 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 2023-10-08T08:39:13.858 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2023-10-08T08:39:14.095 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:39:13 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:39:13.797+0000 7f2c5a6ef700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T08:39:14.095 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:39:13 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:39:13.805+0000 7f2c554e2700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:39:14.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:13 smithi191 ceph-mon[104220]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T08:39:14.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:13 smithi191 ceph-mon[104220]: from='osd.5 [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:39:14.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:13 smithi191 ceph-mon[104220]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T08:39:14.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:14.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:13 smithi191 ceph-mon[104220]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:39:14.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:13 smithi191 ceph-mon[104220]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:14.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:13 smithi070 ceph-mon[99513]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T08:39:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:13 smithi070 ceph-mon[99513]: from='osd.5 [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:39:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:13 smithi070 ceph-mon[99513]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T08:39:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:13 smithi070 ceph-mon[99513]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:39:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:13 smithi070 ceph-mon[99513]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:14.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi070:vg_nvme/lv_2 2023-10-08T08:39:14.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:13 smithi105 ceph-mon[103798]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T08:39:14.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:13 smithi105 ceph-mon[103798]: from='osd.5 [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:39:14.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:13 smithi105 ceph-mon[103798]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T08:39:14.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:14.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:13 smithi105 ceph-mon[103798]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:39:14.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:13 smithi105 ceph-mon[103798]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T08:39:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:39:15.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:39:15.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T08:39:15.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:15.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:15.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: osd.5 [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] boot 2023-10-08T08:39:15.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: osdmap e38: 6 total, 6 up, 6 in 2023-10-08T08:39:15.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:15.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi191 2023-10-08T08:39:15.055 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.055 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.055 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:15.055 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:15.055 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi191 to 8584M 2023-10-08T08:39:15.055 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.055 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:15.055 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:15.056 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:39:15.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: osd.5 [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] boot 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: osdmap e38: 6 total, 6 up, 6 in 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi191 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:15.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:15.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi191 to 8584M 2023-10-08T08:39:15.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:15.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:15.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:39:15.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: osd.5 [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] boot 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: osdmap e38: 6 total, 6 up, 6 in 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi191 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:15.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi191 to 8584M 2023-10-08T08:39:15.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:15.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:15.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:15.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.009+0000 7f115d5c7700 1 -- 172.21.15.70:0/128493035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 msgr2=0x7f11581002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.009+0000 7f115d5c7700 1 --2- 172.21.15.70:0/128493035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 0x7f11581002d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1148009990 tx=0x7f1148009ca0 comp rx=0 tx=0).stop 2023-10-08T08:39:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.009+0000 7f115d5c7700 1 -- 172.21.15.70:0/128493035 shutdown_connections 2023-10-08T08:39:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.009+0000 7f115d5c7700 1 --2- 172.21.15.70:0/128493035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1158100810 0x7f115810c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.009+0000 7f115d5c7700 1 --2- 172.21.15.70:0/128493035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11581056c0 0x7f1158105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.009+0000 7f115d5c7700 1 --2- 172.21.15.70:0/128493035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 0x7f11581002d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.009+0000 7f115d5c7700 1 -- 172.21.15.70:0/128493035 >> 172.21.15.70:0/128493035 conn(0x7f1158075cf0 msgr2=0x7f11580fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:39:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.009+0000 7f115d5c7700 1 -- 172.21.15.70:0/128493035 shutdown_connections 2023-10-08T08:39:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.009+0000 7f115d5c7700 1 -- 172.21.15.70:0/128493035 wait complete. 2023-10-08T08:39:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.010+0000 7f115d5c7700 1 Processor -- start 2023-10-08T08:39:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.010+0000 7f115d5c7700 1 -- start start 2023-10-08T08:39:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.010+0000 7f115d5c7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 0x7f115819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.010+0000 7f115d5c7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1158100810 0x7f115819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.010+0000 7f115d5c7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11581056c0 0x7f1158196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.010+0000 7f115d5c7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158197100 con 0x7f11580ffe50 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.010+0000 7f115d5c7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158197270 con 0x7f1158100810 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.010+0000 7f115d5c7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158197430 con 0x7f11581056c0 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.010+0000 7f1156ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 0x7f115819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f1156ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 0x7f115819c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48330/0 (socket says 172.21.15.70:48330) 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f1156ffd700 1 -- 172.21.15.70:0/2766224148 learned_addr learned my addr 172.21.15.70:0/2766224148 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f11567fc700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1158100810 0x7f115819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f1156ffd700 1 -- 172.21.15.70:0/2766224148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11581056c0 msgr2=0x7f1158196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f1156ffd700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11581056c0 0x7f1158196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f1156ffd700 1 -- 172.21.15.70:0/2766224148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1158100810 msgr2=0x7f115819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f1156ffd700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1158100810 0x7f115819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f1156ffd700 1 -- 172.21.15.70:0/2766224148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11480095f0 con 0x7f11580ffe50 2023-10-08T08:39:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f1156ffd700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 0x7f115819c910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c920 tx=0x7f114c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:39:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f113ffff700 1 -- 172.21.15.70:0/2766224148 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c007b00 con 0x7f11580ffe50 2023-10-08T08:39:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1158197710 con 0x7f11580ffe50 2023-10-08T08:39:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f113ffff700 1 -- 172.21.15.70:0/2766224148 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f114c00ce70 con 0x7f11580ffe50 2023-10-08T08:39:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f113ffff700 1 -- 172.21.15.70:0/2766224148 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c005460 con 0x7f11580ffe50 2023-10-08T08:39:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.011+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11581a3900 con 0x7f11580ffe50 2023-10-08T08:39:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.012+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1158100e60 con 0x7f11580ffe50 2023-10-08T08:39:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.013+0000 7f113ffff700 1 -- 172.21.15.70:0/2766224148 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f114c0055c0 con 0x7f11580ffe50 2023-10-08T08:39:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.014+0000 7f113ffff700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f11400a14d0 0x7f11400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.014+0000 7f11567fc700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f11400a14d0 0x7f11400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.014+0000 7f113ffff700 1 -- 172.21.15.70:0/2766224148 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4777+0+0 (secure 0 0 0) 0x7f114c0cbfa0 con 0x7f11580ffe50 2023-10-08T08:39:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.015+0000 7f11567fc700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f11400a14d0 0x7f11400a3990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f114800b5c0 tx=0x7f1148005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:39:16.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.018+0000 7f113ffff700 1 -- 172.21.15.70:0/2766224148 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f114c0963d0 con 0x7f11580ffe50 2023-10-08T08:39:16.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:16.216+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f115810f6b0 con 0x7f11400a14d0 2023-10-08T08:39:16.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:16 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:39:16.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:16 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:39:16.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:16 smithi070 ceph-mon[99513]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:16.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:16 smithi070 ceph-mon[99513]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T08:39:16.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:16 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:39:16.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:16 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:39:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:16 smithi191 ceph-mon[104220]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:16 smithi191 ceph-mon[104220]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T08:39:16.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:16 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:39:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:16 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:39:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:16 smithi105 ceph-mon[103798]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:16 smithi105 ceph-mon[103798]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T08:39:17.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:17 smithi070 ceph-mon[99513]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T08:39:17.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:17 smithi070 ceph-mon[99513]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:39:17.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:39:17.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:39:17.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:17.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:17 smithi191 ceph-mon[104220]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T08:39:17.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:17 smithi191 ceph-mon[104220]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:39:17.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:39:17.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:39:17.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:17.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:17 smithi105 ceph-mon[103798]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T08:39:17.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:17 smithi105 ceph-mon[103798]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:39:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:39:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:39:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:18 smithi070 ceph-mon[99513]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:18.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:18 smithi070 ceph-mon[99513]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T08:39:18.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:18 smithi191 ceph-mon[104220]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:18.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:18 smithi191 ceph-mon[104220]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T08:39:18.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:18 smithi105 ceph-mon[103798]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:18 smithi105 ceph-mon[103798]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T08:39:19.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:19 smithi191 ceph-mon[104220]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T08:39:19.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:19 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2153146802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61e4df7-535c-4870-9f56-828ead178a58"}]: dispatch 2023-10-08T08:39:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:19 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2153146802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a61e4df7-535c-4870-9f56-828ead178a58"}]': finished 2023-10-08T08:39:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:19 smithi191 ceph-mon[104220]: osdmap e43: 7 total, 6 up, 7 in 2023-10-08T08:39:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:19 smithi070 ceph-mon[99513]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T08:39:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:19 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2153146802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61e4df7-535c-4870-9f56-828ead178a58"}]: dispatch 2023-10-08T08:39:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:19 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2153146802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a61e4df7-535c-4870-9f56-828ead178a58"}]': finished 2023-10-08T08:39:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:19 smithi070 ceph-mon[99513]: osdmap e43: 7 total, 6 up, 7 in 2023-10-08T08:39:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:19.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:19 smithi105 ceph-mon[103798]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T08:39:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:19 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2153146802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61e4df7-535c-4870-9f56-828ead178a58"}]: dispatch 2023-10-08T08:39:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:19 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2153146802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a61e4df7-535c-4870-9f56-828ead178a58"}]': finished 2023-10-08T08:39:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:19 smithi105 ceph-mon[103798]: osdmap e43: 7 total, 6 up, 7 in 2023-10-08T08:39:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:20.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:20 smithi191 ceph-mon[104220]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-08T08:39:20.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:20 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3408707599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:39:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:20 smithi070 ceph-mon[99513]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-08T08:39:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:20 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3408707599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:39:20.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:20 smithi105 ceph-mon[103798]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-08T08:39:20.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:20 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3408707599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:39:22.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:22 smithi191 ceph-mon[104220]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T08:39:22.419 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:22 smithi070 ceph-mon[99513]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T08:39:22.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:22 smithi105 ceph-mon[103798]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T08:39:24.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:24 smithi191 ceph-mon[104220]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:39:24.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:24 smithi070 ceph-mon[99513]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:39:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:24 smithi105 ceph-mon[103798]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:39:26.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:26 smithi070 ceph-mon[99513]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T08:39:26.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:26 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T08:39:26.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:26 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:26.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:26 smithi070 ceph-mon[99513]: Deploying daemon osd.6 on smithi070 2023-10-08T08:39:26.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:26 smithi191 ceph-mon[104220]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T08:39:26.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:26 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T08:39:26.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:26 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:26.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:26 smithi191 ceph-mon[104220]: Deploying daemon osd.6 on smithi070 2023-10-08T08:39:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:26 smithi105 ceph-mon[103798]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T08:39:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:26 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T08:39:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:26 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:26 smithi105 ceph-mon[103798]: Deploying daemon osd.6 on smithi070 2023-10-08T08:39:28.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:28 smithi191 ceph-mon[104220]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:28.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:28 smithi070 ceph-mon[99513]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:28.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:28 smithi105 ceph-mon[103798]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:30.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:30 smithi191 ceph-mon[104220]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:30.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:30.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:30.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:30.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:30 smithi070 ceph-mon[99513]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:30.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:30.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:30.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:30 smithi105 ceph-mon[103798]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:30.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:30.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:30.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:32.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:32 smithi191 ceph-mon[104220]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:32.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:32 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:32.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:32 smithi070 ceph-mon[99513]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:32.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:32 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:32.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.514+0000 7f113ffff700 1 -- 172.21.15.70:0/2766224148 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f115810f6b0 con 0x7f11400a14d0 2023-10-08T08:39:32.515 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 6 on host 'smithi070' 2023-10-08T08:39:32.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f11400a14d0 msgr2=0x7f11400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:32.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f11400a14d0 0x7f11400a3990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f114800b5c0 tx=0x7f1148005960 comp rx=0 tx=0).stop 2023-10-08T08:39:32.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 msgr2=0x7f115819c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:32.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 0x7f115819c910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c920 tx=0x7f114c00cc30 comp rx=0 tx=0).stop 2023-10-08T08:39:32.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 shutdown_connections 2023-10-08T08:39:32.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f11400a14d0 0x7f11400a3990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:32.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11581056c0 0x7f1158196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:32.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11580ffe50 0x7f115819c910 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:32.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 --2- 172.21.15.70:0/2766224148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1158100810 0x7f115819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:32.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 >> 172.21.15.70:0/2766224148 conn(0x7f1158075cf0 msgr2=0x7f11580ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:39:32.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 shutdown_connections 2023-10-08T08:39:32.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:39:32.516+0000 7f115d5c7700 1 -- 172.21.15.70:0/2766224148 wait complete. 2023-10-08T08:39:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:32 smithi105 ceph-mon[103798]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:32 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.023 DEBUG:teuthology.orchestra.run.smithi070:osd.6> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.6.service 2023-10-08T08:39:33.025 INFO:tasks.cephadm:Deploying osd.7 on smithi105 with /dev/vg_nvme/lv_2... 2023-10-08T08:39:33.025 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T08:39:33.053 INFO:journalctl@ceph.osd.6.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:39:33.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:33.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:33.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:33 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:33.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:33.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:33.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:33 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:33 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:33.612 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:39:33.720 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:39:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:39:33.619+0000 7f2ef84bf640 -1 osd.6 0 log_to_monitors true 2023-10-08T08:39:34.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:34 smithi191 ceph-mon[104220]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:34.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:34 smithi191 ceph-mon[104220]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T08:39:34.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:34 smithi070 ceph-mon[99513]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:34.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:34 smithi070 ceph-mon[99513]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T08:39:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:34 smithi105 ceph-mon[103798]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:34 smithi105 ceph-mon[103798]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T08:39:35.086 INFO:teuthology.orchestra.run.smithi105.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T08:39:35.087 INFO:teuthology.orchestra.run.smithi105.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T08:39:35.087 INFO:teuthology.orchestra.run.smithi105.stderr: stderr: 10+0 records in 2023-10-08T08:39:35.087 INFO:teuthology.orchestra.run.smithi105.stderr:10+0 records out 2023-10-08T08:39:35.087 INFO:teuthology.orchestra.run.smithi105.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0148672 s, 705 MB/s 2023-10-08T08:39:35.087 INFO:teuthology.orchestra.run.smithi105.stderr:--> Zapping successful for: 2023-10-08T08:39:35.467 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi105:vg_nvme/lv_2 2023-10-08T08:39:35.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:35 smithi105 ceph-mon[103798]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T08:39:35.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:35 smithi105 ceph-mon[103798]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T08:39:35.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:35 smithi105 ceph-mon[103798]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:39:35.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:35 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:35.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:35 smithi105 ceph-mon[103798]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:35.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:35 smithi191 ceph-mon[104220]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T08:39:35.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:35 smithi191 ceph-mon[104220]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T08:39:35.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:35 smithi191 ceph-mon[104220]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:39:35.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:35 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:35.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:35 smithi191 ceph-mon[104220]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:35.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:39:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:39:35.481+0000 7f2eee337700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T08:39:35.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:39:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:39:35.492+0000 7f2ee8128700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:39:35.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:35 smithi070 ceph-mon[99513]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T08:39:35.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:35 smithi070 ceph-mon[99513]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T08:39:35.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:35 smithi070 ceph-mon[99513]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:39:35.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:35 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:35.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:35 smithi070 ceph-mon[99513]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:36.025 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:39:36.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi070 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi070 to 5722M 2023-10-08T08:39:36.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:36.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:36.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi070 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:36.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi070 to 5722M 2023-10-08T08:39:36.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:36.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:36.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi070 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi070 to 5722M 2023-10-08T08:39:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:36.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:36.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:36.972 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:37.203 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.200+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/3710097244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 msgr2=0x7f6fcc0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:37.203 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.200+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/3710097244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 0x7f6fcc0685f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8009990 tx=0x7f6fb8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:39:37.203 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.200+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/3710097244 shutdown_connections 2023-10-08T08:39:37.203 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.200+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/3710097244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fcc068b30 0x7f6fcc10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:37.203 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.200+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/3710097244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fcc1067a0 0x7f6fcc106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:37.203 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.200+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/3710097244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 0x7f6fcc0685f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:37.203 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.200+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/3710097244 >> 172.21.15.105:0/3710097244 conn(0x7f6fcc075790 msgr2=0x7f6fcc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:39:37.203 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.200+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/3710097244 shutdown_connections 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.200+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/3710097244 wait complete. 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd2c9a700 1 Processor -- start 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd2c9a700 1 -- start start 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd2c9a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 0x7f6fcc19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd2c9a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fcc068b30 0x7f6fcc19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd2c9a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fcc1067a0 0x7f6fcc196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd2c9a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc1970f0 con 0x7f6fcc1067a0 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd2c9a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc197260 con 0x7f6fcc068190 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd2c9a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc197420 con 0x7f6fcc068b30 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd0a36700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 0x7f6fcc19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:37.204 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd0a36700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 0x7f6fcc19c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40720/0 (socket says 172.21.15.105:40720) 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd0a36700 1 -- 172.21.15.105:0/725505128 learned_addr learned my addr 172.21.15.105:0/725505128 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fcbfff700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fcc068b30 0x7f6fcc19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd0a36700 1 -- 172.21.15.105:0/725505128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fcc068b30 msgr2=0x7f6fcc19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd0a36700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fcc068b30 0x7f6fcc19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd0a36700 1 -- 172.21.15.105:0/725505128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fcc1067a0 msgr2=0x7f6fcc196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd0a36700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fcc1067a0 0x7f6fcc196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.201+0000 7f6fd0a36700 1 -- 172.21.15.105:0/725505128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80095f0 con 0x7f6fcc068190 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.202+0000 7f6fd0a36700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 0x7f6fcc19c950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000d950 tx=0x7f6fc000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.202+0000 7f6fc9ffb700 1 -- 172.21.15.105:0/725505128 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0009940 con 0x7f6fcc068190 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.202+0000 7f6fc9ffb700 1 -- 172.21.15.105:0/725505128 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fc0010460 con 0x7f6fcc068190 2023-10-08T08:39:37.205 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.202+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc197700 con 0x7f6fcc068190 2023-10-08T08:39:37.206 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.202+0000 7f6fc9ffb700 1 -- 172.21.15.105:0/725505128 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000f620 con 0x7f6fcc068190 2023-10-08T08:39:37.206 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.202+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc1a3940 con 0x7f6fcc068190 2023-10-08T08:39:37.206 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.203+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc108d50 con 0x7f6fcc068190 2023-10-08T08:39:37.207 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.204+0000 7f6fc9ffb700 1 -- 172.21.15.105:0/725505128 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6fc00108d0 con 0x7f6fcc068190 2023-10-08T08:39:37.207 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.204+0000 7f6fc9ffb700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6fbc0a14d0 0x7f6fbc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:37.207 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.204+0000 7f6fc9ffb700 1 -- 172.21.15.105:0/725505128 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5180+0+0 (secure 0 0 0) 0x7f6fc00cbf90 con 0x7f6fcc068190 2023-10-08T08:39:37.207 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.205+0000 7f6fcbfff700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6fbc0a14d0 0x7f6fbc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:37.207 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.205+0000 7f6fcbfff700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6fbc0a14d0 0x7f6fbc0a3990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800b5c0 tx=0x7f6fb8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:39:37.209 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.209+0000 7f6fc9ffb700 1 -- 172.21.15.105:0/725505128 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6fc00ff100 con 0x7f6fcc068190 2023-10-08T08:39:37.407 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:37.406+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fcc197f50 con 0x7f6fbc0a14d0 2023-10-08T08:39:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:39:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:39:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] boot 2023-10-08T08:39:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: osdmap e46: 7 total, 7 up, 7 in 2023-10-08T08:39:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:39:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:39:37.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:39:37.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:37 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:37.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:39:37.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:39:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] boot 2023-10-08T08:39:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: osdmap e46: 7 total, 7 up, 7 in 2023-10-08T08:39:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:39:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:39:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:39:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:37 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:37.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: osd.6 [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] boot 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: osdmap e46: 7 total, 7 up, 7 in 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:39:37.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:37 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:38.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:38 smithi105 ceph-mon[103798]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T08:39:38.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:38 smithi191 ceph-mon[104220]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T08:39:38.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:38 smithi070 ceph-mon[99513]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T08:39:40.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:40 smithi191 ceph-mon[104220]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:40.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:40 smithi191 ceph-mon[104220]: from='client.? 172.21.15.105:0/111182508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acd9b422-1496-46dd-b947-fc8f8bab8398"}]: dispatch 2023-10-08T08:39:40.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:40 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acd9b422-1496-46dd-b947-fc8f8bab8398"}]: dispatch 2023-10-08T08:39:40.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:40 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acd9b422-1496-46dd-b947-fc8f8bab8398"}]': finished 2023-10-08T08:39:40.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:40 smithi191 ceph-mon[104220]: osdmap e48: 8 total, 7 up, 8 in 2023-10-08T08:39:40.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:40.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:40 smithi070 ceph-mon[99513]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:40.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:40 smithi070 ceph-mon[99513]: from='client.? 172.21.15.105:0/111182508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acd9b422-1496-46dd-b947-fc8f8bab8398"}]: dispatch 2023-10-08T08:39:40.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:40 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acd9b422-1496-46dd-b947-fc8f8bab8398"}]: dispatch 2023-10-08T08:39:40.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:40 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acd9b422-1496-46dd-b947-fc8f8bab8398"}]': finished 2023-10-08T08:39:40.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:40 smithi070 ceph-mon[99513]: osdmap e48: 8 total, 7 up, 8 in 2023-10-08T08:39:40.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:40 smithi105 ceph-mon[103798]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:40 smithi105 ceph-mon[103798]: from='client.? 172.21.15.105:0/111182508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acd9b422-1496-46dd-b947-fc8f8bab8398"}]: dispatch 2023-10-08T08:39:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:40 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acd9b422-1496-46dd-b947-fc8f8bab8398"}]: dispatch 2023-10-08T08:39:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:40 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acd9b422-1496-46dd-b947-fc8f8bab8398"}]': finished 2023-10-08T08:39:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:40 smithi105 ceph-mon[103798]: osdmap e48: 8 total, 7 up, 8 in 2023-10-08T08:39:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:41.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:41 smithi191 ceph-mon[104220]: from='client.? 172.21.15.105:0/2812273043' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:39:41.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:41 smithi070 ceph-mon[99513]: from='client.? 172.21.15.105:0/2812273043' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:39:41.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:41 smithi105 ceph-mon[103798]: from='client.? 172.21.15.105:0/2812273043' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:39:42.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:42 smithi191 ceph-mon[104220]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:42.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:42 smithi070 ceph-mon[99513]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:42.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:42 smithi105 ceph-mon[103798]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:44.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:44 smithi191 ceph-mon[104220]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:44.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:44 smithi070 ceph-mon[99513]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:44.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:44 smithi105 ceph-mon[103798]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:46.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:46 smithi191 ceph-mon[104220]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:46.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:46 smithi070 ceph-mon[99513]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:46.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:46 smithi105 ceph-mon[103798]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:47.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:47 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T08:39:47.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:47 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:47.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:47 smithi105 ceph-mon[103798]: Deploying daemon osd.7 on smithi105 2023-10-08T08:39:47.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:47 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T08:39:47.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:47 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:47.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:47 smithi191 ceph-mon[104220]: Deploying daemon osd.7 on smithi105 2023-10-08T08:39:47.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:47 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T08:39:47.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:47 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:47.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:47 smithi070 ceph-mon[99513]: Deploying daemon osd.7 on smithi105 2023-10-08T08:39:48.133 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:48 smithi105 ceph-mon[103798]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:48.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:48 smithi191 ceph-mon[104220]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:48.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:48 smithi070 ceph-mon[99513]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:50.199 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:50 smithi105 ceph-mon[103798]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:50.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:50 smithi191 ceph-mon[104220]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:50.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:50 smithi070 ceph-mon[99513]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:51.360 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:51.360 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:51.360 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:51.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:51.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:51.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:51.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:51.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:51.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:52.510 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:52 smithi105 ceph-mon[103798]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:52 smithi191 ceph-mon[104220]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:52 smithi070 ceph-mon[99513]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:52.766 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 7 on host 'smithi105' 2023-10-08T08:39:52.767 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.765+0000 7f6fc9ffb700 1 -- 172.21.15.105:0/725505128 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6fcc197f50 con 0x7f6fbc0a14d0 2023-10-08T08:39:52.768 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6fbc0a14d0 msgr2=0x7f6fbc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:52.769 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6fbc0a14d0 0x7f6fbc0a3990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800b5c0 tx=0x7f6fb8005960 comp rx=0 tx=0).stop 2023-10-08T08:39:52.769 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 msgr2=0x7f6fcc19c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:52.769 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 0x7f6fcc19c950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000d950 tx=0x7f6fc000dc60 comp rx=0 tx=0).stop 2023-10-08T08:39:52.769 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 shutdown_connections 2023-10-08T08:39:52.769 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6fbc0a14d0 0x7f6fbc0a3990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:52.770 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6fcc1067a0 0x7f6fcc196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:52.770 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fcc068190 0x7f6fcc19c950 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:52.770 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 --2- 172.21.15.105:0/725505128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fcc068b30 0x7f6fcc19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:52.770 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 >> 172.21.15.105:0/725505128 conn(0x7f6fcc075790 msgr2=0x7f6fcc0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:39:52.770 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 shutdown_connections 2023-10-08T08:39:52.770 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:39:52.768+0000 7f6fd2c9a700 1 -- 172.21.15.105:0/725505128 wait complete. 2023-10-08T08:39:53.215 DEBUG:teuthology.orchestra.run.smithi105:osd.7> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.7.service 2023-10-08T08:39:53.217 INFO:tasks.cephadm:Deploying osd.8 on smithi191 with /dev/vg_nvme/lv_2... 2023-10-08T08:39:53.217 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T08:39:53.248 INFO:journalctl@ceph.osd.7.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:39:53.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:53 smithi105 ceph-mon[103798]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:53.787 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:39:53.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:53 smithi191 ceph-mon[104220]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:53.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:53 smithi070 ceph-mon[99513]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:54.521 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:39:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:39:54.171+0000 7f5314664640 -1 osd.7 0 log_to_monitors true 2023-10-08T08:39:55.237 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T08:39:55.237 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T08:39:55.237 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2023-10-08T08:39:55.237 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2023-10-08T08:39:55.237 INFO:teuthology.orchestra.run.smithi191.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0150679 s, 696 MB/s 2023-10-08T08:39:55.237 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2023-10-08T08:39:55.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:55 smithi191 ceph-mon[104220]: from='osd.7 [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T08:39:55.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:55 smithi191 ceph-mon[104220]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T08:39:55.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:55 smithi070 ceph-mon[99513]: from='osd.7 [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T08:39:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:55 smithi070 ceph-mon[99513]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T08:39:55.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:55 smithi105 ceph-mon[103798]: from='osd.7 [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T08:39:55.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:55 smithi105 ceph-mon[103798]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T08:39:55.629 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi191:vg_nvme/lv_2 2023-10-08T08:39:56.053 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:56.053 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T08:39:56.053 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T08:39:56.053 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='osd.7 [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:39:56.053 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:56.054 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.187 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:39:56.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:39:56.051+0000 7f5309cdb700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T08:39:56.271 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:39:56.059+0000 7f5301ac8700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:39:56.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:56.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T08:39:56.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T08:39:56.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='osd.7 [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:39:56.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:56.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:39:56.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:56.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:56.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:56.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:56.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:56.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='osd.7 [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:39:56.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:56.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:56.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:56.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:57.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi105 2023-10-08T08:39:57.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi105 to 5722M 2023-10-08T08:39:57.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:39:57.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T08:39:57.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:57.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:57.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:57.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:57.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:57.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:57 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:57.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.384+0000 7efddd77f700 1 -- 172.21.15.191:0/178094206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81008a0 msgr2=0x7efdd8100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:57.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.384+0000 7efddd77f700 1 --2- 172.21.15.191:0/178094206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81008a0 0x7efdd8100d20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009990 tx=0x7efdc8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:39:57.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.384+0000 7efddd77f700 1 -- 172.21.15.191:0/178094206 shutdown_connections 2023-10-08T08:39:57.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.384+0000 7efddd77f700 1 --2- 172.21.15.191:0/178094206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdd8101260 0x7efdd810d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:57.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.384+0000 7efddd77f700 1 --2- 172.21.15.191:0/178094206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd81056a0 0x7efdd8105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:57.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.384+0000 7efddd77f700 1 --2- 172.21.15.191:0/178094206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81008a0 0x7efdd8100d20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:57.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.384+0000 7efddd77f700 1 -- 172.21.15.191:0/178094206 >> 172.21.15.191:0/178094206 conn(0x7efdd8077950 msgr2=0x7efdd8077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:39:57.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.384+0000 7efddd77f700 1 -- 172.21.15.191:0/178094206 shutdown_connections 2023-10-08T08:39:57.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.384+0000 7efddd77f700 1 -- 172.21.15.191:0/178094206 wait complete. 2023-10-08T08:39:57.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efddd77f700 1 Processor -- start 2023-10-08T08:39:57.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efddd77f700 1 -- start start 2023-10-08T08:39:57.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efddd77f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdd81008a0 0x7efdd8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:57.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efddd77f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd8101260 0x7efdd8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:57.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efddd77f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81056a0 0x7efdd8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:57.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efddd77f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd81a5050 con 0x7efdd8101260 2023-10-08T08:39:57.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efddd77f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd81a51c0 con 0x7efdd81008a0 2023-10-08T08:39:57.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efddd77f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd81a5380 con 0x7efdd81056a0 2023-10-08T08:39:57.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd77fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81056a0 0x7efdd8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd77fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81056a0 0x7efdd8073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:55988/0 (socket says 172.21.15.191:55988) 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd77fe700 1 -- 172.21.15.191:0/799007132 learned_addr learned my addr 172.21.15.191:0/799007132 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd67fc700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd8101260 0x7efdd8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd6ffd700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdd81008a0 0x7efdd8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd77fe700 1 -- 172.21.15.191:0/799007132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdd81008a0 msgr2=0x7efdd8072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd77fe700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdd81008a0 0x7efdd8072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd77fe700 1 -- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd8101260 msgr2=0x7efdd8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd77fe700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd8101260 0x7efdd8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.385+0000 7efdd77fe700 1 -- 172.21.15.191:0/799007132 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc80095f0 con 0x7efdd81056a0 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.386+0000 7efdd77fe700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81056a0 0x7efdd8073570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdd000ada0 tx=0x7efdd000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.386+0000 7efdbffff700 1 -- 172.21.15.191:0/799007132 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000f070 con 0x7efdd81056a0 2023-10-08T08:39:57.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.386+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd81a5660 con 0x7efdd81056a0 2023-10-08T08:39:57.390 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.386+0000 7efdbffff700 1 -- 172.21.15.191:0/799007132 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efdd0007b30 con 0x7efdd81056a0 2023-10-08T08:39:57.390 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.386+0000 7efdbffff700 1 -- 172.21.15.191:0/799007132 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0005280 con 0x7efdd81056a0 2023-10-08T08:39:57.390 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.386+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd81a5ae0 con 0x7efdd81056a0 2023-10-08T08:39:57.390 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.387+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd8108d10 con 0x7efdd81056a0 2023-10-08T08:39:57.391 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.388+0000 7efdbffff700 1 -- 172.21.15.191:0/799007132 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7efdd000a090 con 0x7efdd81056a0 2023-10-08T08:39:57.391 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.388+0000 7efdbffff700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efdc00a14d0 0x7efdc00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:39:57.391 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.389+0000 7efdbffff700 1 -- 172.21.15.191:0/799007132 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5645+0+0 (secure 0 0 0) 0x7efdd00cbe10 con 0x7efdd81056a0 2023-10-08T08:39:57.391 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.389+0000 7efdd6ffd700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efdc00a14d0 0x7efdc00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:39:57.391 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.389+0000 7efdd6ffd700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efdc00a14d0 0x7efdc00a3990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efdcc005950 tx=0x7efdcc00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:39:57.393 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.392+0000 7efdbffff700 1 -- 172.21.15.191:0/799007132 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efdd0099a00 con 0x7efdd81056a0 2023-10-08T08:39:57.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi105 2023-10-08T08:39:57.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi105 to 5722M 2023-10-08T08:39:57.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:39:57.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T08:39:57.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:57.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:57.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:57.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:57.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:57.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:57 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:57.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi105 2023-10-08T08:39:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi105 to 5722M 2023-10-08T08:39:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:39:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T08:39:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:39:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:39:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:57 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:39:57.589 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:39:57.588+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7efdd8073fd0 con 0x7efdc00a14d0 2023-10-08T08:39:58.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:39:58.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:39:58.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: osd.7 [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] boot 2023-10-08T08:39:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: osdmap e51: 8 total, 8 up, 8 in 2023-10-08T08:39:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:39:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:39:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:58.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:39:58.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:39:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: osd.7 [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] boot 2023-10-08T08:39:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: osdmap e51: 8 total, 8 up, 8 in 2023-10-08T08:39:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:39:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:39:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:39:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:39:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T08:39:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:58.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: osd.7 [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] boot 2023-10-08T08:39:58.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: osdmap e51: 8 total, 8 up, 8 in 2023-10-08T08:39:58.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T08:39:58.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:39:58.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:39:58.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:39:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:59 smithi191 ceph-mon[104220]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:39:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:39:59 smithi191 ceph-mon[104220]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T08:39:59.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:59 smithi070 ceph-mon[99513]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:39:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:39:59 smithi070 ceph-mon[99513]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T08:39:59.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:59 smithi105 ceph-mon[103798]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:39:59.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:39:59 smithi105 ceph-mon[103798]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T08:40:00.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:00 smithi191 ceph-mon[104220]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:00.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:00 smithi191 ceph-mon[104220]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T08:40:00.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:00 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/3798648009' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fffb4528-d810-483d-a63b-744ae1ab17fd"}]: dispatch 2023-10-08T08:40:00.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:00 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fffb4528-d810-483d-a63b-744ae1ab17fd"}]: dispatch 2023-10-08T08:40:00.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:00 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fffb4528-d810-483d-a63b-744ae1ab17fd"}]': finished 2023-10-08T08:40:00.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:00 smithi191 ceph-mon[104220]: osdmap e54: 9 total, 8 up, 9 in 2023-10-08T08:40:00.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:00.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:00 smithi191 ceph-mon[104220]: overall HEALTH_OK 2023-10-08T08:40:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:00 smithi070 ceph-mon[99513]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:00 smithi070 ceph-mon[99513]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T08:40:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:00 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/3798648009' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fffb4528-d810-483d-a63b-744ae1ab17fd"}]: dispatch 2023-10-08T08:40:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:00 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fffb4528-d810-483d-a63b-744ae1ab17fd"}]: dispatch 2023-10-08T08:40:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:00 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fffb4528-d810-483d-a63b-744ae1ab17fd"}]': finished 2023-10-08T08:40:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:00 smithi070 ceph-mon[99513]: osdmap e54: 9 total, 8 up, 9 in 2023-10-08T08:40:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:00 smithi070 ceph-mon[99513]: overall HEALTH_OK 2023-10-08T08:40:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:00 smithi105 ceph-mon[103798]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:00 smithi105 ceph-mon[103798]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T08:40:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:00 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/3798648009' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fffb4528-d810-483d-a63b-744ae1ab17fd"}]: dispatch 2023-10-08T08:40:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:00 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fffb4528-d810-483d-a63b-744ae1ab17fd"}]: dispatch 2023-10-08T08:40:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:00 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fffb4528-d810-483d-a63b-744ae1ab17fd"}]': finished 2023-10-08T08:40:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:00 smithi105 ceph-mon[103798]: osdmap e54: 9 total, 8 up, 9 in 2023-10-08T08:40:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:00 smithi105 ceph-mon[103798]: overall HEALTH_OK 2023-10-08T08:40:01.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:01 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/2727675004' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:40:01.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:01 smithi191 ceph-mon[104220]: osdmap e55: 9 total, 8 up, 9 in 2023-10-08T08:40:01.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:01 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:01.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:01 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/2727675004' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:40:01.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:01 smithi070 ceph-mon[99513]: osdmap e55: 9 total, 8 up, 9 in 2023-10-08T08:40:01.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:01 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:01.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:01 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/2727675004' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:40:01.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:01 smithi105 ceph-mon[103798]: osdmap e55: 9 total, 8 up, 9 in 2023-10-08T08:40:01.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:01 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:02.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:02 smithi191 ceph-mon[104220]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:02.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:02 smithi070 ceph-mon[99513]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:02 smithi105 ceph-mon[103798]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:04.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:04 smithi191 ceph-mon[104220]: pgmap v145: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:04 smithi070 ceph-mon[99513]: pgmap v145: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:04 smithi105 ceph-mon[103798]: pgmap v145: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:06.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:06 smithi191 ceph-mon[104220]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:06.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:06 smithi070 ceph-mon[99513]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:06.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:06 smithi105 ceph-mon[103798]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:07.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:07 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T08:40:07.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:07 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:07.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:07 smithi191 ceph-mon[104220]: Deploying daemon osd.8 on smithi191 2023-10-08T08:40:07.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:07 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T08:40:07.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:07 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:07.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:07 smithi070 ceph-mon[99513]: Deploying daemon osd.8 on smithi191 2023-10-08T08:40:07.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:07 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T08:40:07.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:07 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:07.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:07 smithi105 ceph-mon[103798]: Deploying daemon osd.8 on smithi191 2023-10-08T08:40:08.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:08 smithi191 ceph-mon[104220]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:08.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:08 smithi070 ceph-mon[99513]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:08 smithi105 ceph-mon[103798]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:10.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:10 smithi191 ceph-mon[104220]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:10.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:10 smithi070 ceph-mon[99513]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:10.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:10 smithi105 ceph-mon[103798]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:11.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:11.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:11.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:11 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:11.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:11 smithi191 ceph-mon[104220]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:11.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:11.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:11.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:11 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:11.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:11 smithi070 ceph-mon[99513]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:12.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:12.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:12.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:11 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:12.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:11 smithi105 ceph-mon[103798]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:13.446 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.445+0000 7efdbffff700 1 -- 172.21.15.191:0/799007132 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efdd8073fd0 con 0x7efdc00a14d0 2023-10-08T08:40:13.449 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 8 on host 'smithi191' 2023-10-08T08:40:13.450 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efdc00a14d0 msgr2=0x7efdc00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:13.450 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efdc00a14d0 0x7efdc00a3990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efdcc005950 tx=0x7efdcc00b410 comp rx=0 tx=0).stop 2023-10-08T08:40:13.450 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81056a0 msgr2=0x7efdd8073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:13.450 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81056a0 0x7efdd8073570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdd000ada0 tx=0x7efdd000c330 comp rx=0 tx=0).stop 2023-10-08T08:40:13.451 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 shutdown_connections 2023-10-08T08:40:13.451 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efdc00a14d0 0x7efdc00a3990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:13.451 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd81056a0 0x7efdd8073570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:13.451 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdd81008a0 0x7efdd8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:13.451 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 --2- 172.21.15.191:0/799007132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd8101260 0x7efdd8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:13.451 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 >> 172.21.15.191:0/799007132 conn(0x7efdd8077950 msgr2=0x7efdd80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:40:13.451 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 shutdown_connections 2023-10-08T08:40:13.451 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:13.447+0000 7efddd77f700 1 -- 172.21.15.191:0/799007132 wait complete. 2023-10-08T08:40:13.874 DEBUG:teuthology.orchestra.run.smithi191:osd.8> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.8.service 2023-10-08T08:40:13.876 INFO:tasks.cephadm:Deploying osd.9 on smithi070 with /dev/vg_nvme/lv_1... 2023-10-08T08:40:13.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T08:40:13.908 INFO:journalctl@ceph.osd.8.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:40:14.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:14 smithi070 ceph-mon[99513]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:14.395 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-mon[104220]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:14.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:14.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:14.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:14.451 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:40:14.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:14 smithi105 ceph-mon[103798]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:14.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:14.690 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:40:14 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:40:14.567+0000 7fbeb12f9640 -1 osd.8 0 log_to_monitors true 2023-10-08T08:40:15.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:15 smithi070 ceph-mon[99513]: from='osd.8 [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T08:40:15.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:15 smithi070 ceph-mon[99513]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T08:40:15.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:15 smithi105 ceph-mon[103798]: from='osd.8 [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T08:40:15.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:15 smithi105 ceph-mon[103798]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T08:40:15.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:15 smithi191 ceph-mon[104220]: from='osd.8 [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T08:40:15.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:15 smithi191 ceph-mon[104220]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T08:40:15.930 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T08:40:15.930 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T08:40:15.930 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2023-10-08T08:40:15.930 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2023-10-08T08:40:15.930 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00831376 s, 1.3 GB/s 2023-10-08T08:40:15.931 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2023-10-08T08:40:16.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:16 smithi070 ceph-mon[99513]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:16.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:16 smithi070 ceph-mon[99513]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T08:40:16.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:16 smithi070 ceph-mon[99513]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T08:40:16.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:16.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:16 smithi070 ceph-mon[99513]: from='osd.8 [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:40:16.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:16 smithi070 ceph-mon[99513]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:40:16.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:40:16 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:40:16.147+0000 7fbea6970700 -1 osd.8 0 waiting for initial osdmap 2023-10-08T08:40:16.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:40:16 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:40:16.159+0000 7fbea0761700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:40:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:16 smithi191 ceph-mon[104220]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:16 smithi191 ceph-mon[104220]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T08:40:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:16 smithi191 ceph-mon[104220]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T08:40:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:16 smithi191 ceph-mon[104220]: from='osd.8 [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:40:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:16 smithi191 ceph-mon[104220]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:40:16.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi070:vg_nvme/lv_1 2023-10-08T08:40:16.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:16 smithi105 ceph-mon[103798]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:16.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:16 smithi105 ceph-mon[103798]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T08:40:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:16 smithi105 ceph-mon[103798]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T08:40:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:16 smithi105 ceph-mon[103798]: from='osd.8 [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:40:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:16 smithi105 ceph-mon[103798]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:40:16.972 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:40:17.405 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:40:17.405 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi191 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi191 to 5722M 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:17.407 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:17.407 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi191 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi191 to 5722M 2023-10-08T08:40:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:17.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:17.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi191 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi191 to 5722M 2023-10-08T08:40:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:17.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:17.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:17.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:18.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.289+0000 7fcc230c8700 1 -- 172.21.15.70:0/996840406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c1056c0 msgr2=0x7fcc1c105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:18.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.289+0000 7fcc230c8700 1 --2- 172.21.15.70:0/996840406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c1056c0 0x7fcc1c105aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009990 tx=0x7fcc10009ca0 comp rx=0 tx=0).stop 2023-10-08T08:40:18.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.289+0000 7fcc230c8700 1 -- 172.21.15.70:0/996840406 shutdown_connections 2023-10-08T08:40:18.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.289+0000 7fcc230c8700 1 --2- 172.21.15.70:0/996840406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c100810 0x7fcc1c10c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:18.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.289+0000 7fcc230c8700 1 --2- 172.21.15.70:0/996840406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c1056c0 0x7fcc1c105aa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:18.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.289+0000 7fcc230c8700 1 --2- 172.21.15.70:0/996840406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc1c0ffe50 0x7fcc1c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:18.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.289+0000 7fcc230c8700 1 -- 172.21.15.70:0/996840406 >> 172.21.15.70:0/996840406 conn(0x7fcc1c075cf0 msgr2=0x7fcc1c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:40:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 -- 172.21.15.70:0/996840406 shutdown_connections 2023-10-08T08:40:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 -- 172.21.15.70:0/996840406 wait complete. 2023-10-08T08:40:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 Processor -- start 2023-10-08T08:40:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 -- start start 2023-10-08T08:40:18.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc1c0ffe50 0x7fcc1c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:18.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c100810 0x7fcc1c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c1056c0 0x7fcc1c1a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1987e0 con 0x7fcc1c100810 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1a3010 con 0x7fcc1c0ffe50 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc230c8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1a3150 con 0x7fcc1c1056c0 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc1bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c100810 0x7fcc1c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.290+0000 7fcc1bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c100810 0x7fcc1c197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48472/0 (socket says 172.21.15.70:48472) 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc1bfff700 1 -- 172.21.15.70:0/3905366309 learned_addr learned my addr 172.21.15.70:0/3905366309 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc20e64700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc1c0ffe50 0x7fcc1c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc1bfff700 1 -- 172.21.15.70:0/3905366309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c1056c0 msgr2=0x7fcc1c1a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc21665700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c1056c0 0x7fcc1c1a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc1bfff700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c1056c0 0x7fcc1c1a2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc1bfff700 1 -- 172.21.15.70:0/3905366309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc1c0ffe50 msgr2=0x7fcc1c197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc1bfff700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc1c0ffe50 0x7fcc1c197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc1bfff700 1 -- 172.21.15.70:0/3905366309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc100095f0 con 0x7fcc1c100810 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc1bfff700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c100810 0x7fcc1c197f90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800d980 tx=0x7fcc0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc19ffb700 1 -- 172.21.15.70:0/3905366309 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08009b40 con 0x7fcc1c100810 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc19ffb700 1 -- 172.21.15.70:0/3905366309 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc0800b6e0 con 0x7fcc1c100810 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c1a33b0 con 0x7fcc1c100810 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc19ffb700 1 -- 172.21.15.70:0/3905366309 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0800f620 con 0x7fcc1c100810 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.291+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c1a38b0 con 0x7fcc1c100810 2023-10-08T08:40:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.292+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c107cc0 con 0x7fcc1c100810 2023-10-08T08:40:18.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.293+0000 7fcc19ffb700 1 -- 172.21.15.70:0/3905366309 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fcc08010460 con 0x7fcc1c100810 2023-10-08T08:40:18.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.294+0000 7fcc19ffb700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:18.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.294+0000 7fcc20e64700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:18.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.294+0000 7fcc19ffb700 1 -- 172.21.15.70:0/3905366309 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcc080cc7d0 con 0x7fcc1c100810 2023-10-08T08:40:18.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.294+0000 7fcc20e64700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000b5c0 tx=0x7fcc10005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:40:18.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.299+0000 7fcc19ffb700 1 -- 172.21.15.70:0/3905366309 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcc08096650 con 0x7fcc1c100810 2023-10-08T08:40:18.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:18 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:40:18.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:18 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:40:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:18 smithi070 ceph-mon[99513]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:18 smithi070 ceph-mon[99513]: osd.8 [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] boot 2023-10-08T08:40:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:18 smithi070 ceph-mon[99513]: osdmap e58: 9 total, 9 up, 9 in 2023-10-08T08:40:18.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:18.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:18.496+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc1c0ff2e0 con 0x7fcc0c0a1550 2023-10-08T08:40:18.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:18 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:40:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:18 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:40:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:18 smithi105 ceph-mon[103798]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:18 smithi105 ceph-mon[103798]: osd.8 [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] boot 2023-10-08T08:40:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:18 smithi105 ceph-mon[103798]: osdmap e58: 9 total, 9 up, 9 in 2023-10-08T08:40:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:18 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:40:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:18 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:40:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:18 smithi191 ceph-mon[104220]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T08:40:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:18 smithi191 ceph-mon[104220]: osd.8 [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] boot 2023-10-08T08:40:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:18 smithi191 ceph-mon[104220]: osdmap e58: 9 total, 9 up, 9 in 2023-10-08T08:40:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T08:40:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:19 smithi070 ceph-mon[99513]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T08:40:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:40:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:40:19.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:19.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:19 smithi105 ceph-mon[103798]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T08:40:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:40:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:40:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:19 smithi191 ceph-mon[104220]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T08:40:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:40:19.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:40:19.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:20 smithi070 ceph-mon[99513]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:40:20.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:20 smithi070 ceph-mon[99513]: pgmap v157: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:20.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:20 smithi070 ceph-mon[99513]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T08:40:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:20 smithi105 ceph-mon[103798]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:40:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:20 smithi105 ceph-mon[103798]: pgmap v157: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:20 smithi105 ceph-mon[103798]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T08:40:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:20 smithi191 ceph-mon[104220]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:40:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:20 smithi191 ceph-mon[104220]: pgmap v157: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:20 smithi191 ceph-mon[104220]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T08:40:21.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:21 smithi070 ceph-mon[99513]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T08:40:21.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:21 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2536639878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ff2f169-52f3-4b84-91ac-ae5b97b27bab"}]: dispatch 2023-10-08T08:40:21.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:21 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2536639878' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ff2f169-52f3-4b84-91ac-ae5b97b27bab"}]': finished 2023-10-08T08:40:21.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:21 smithi070 ceph-mon[99513]: osdmap e62: 10 total, 9 up, 10 in 2023-10-08T08:40:21.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:21 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:21.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:21 smithi105 ceph-mon[103798]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T08:40:21.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:21 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2536639878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ff2f169-52f3-4b84-91ac-ae5b97b27bab"}]: dispatch 2023-10-08T08:40:21.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:21 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2536639878' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ff2f169-52f3-4b84-91ac-ae5b97b27bab"}]': finished 2023-10-08T08:40:21.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:21 smithi105 ceph-mon[103798]: osdmap e62: 10 total, 9 up, 10 in 2023-10-08T08:40:21.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:21 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:21.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:21 smithi191 ceph-mon[104220]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T08:40:21.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:21 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2536639878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ff2f169-52f3-4b84-91ac-ae5b97b27bab"}]: dispatch 2023-10-08T08:40:21.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:21 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2536639878' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ff2f169-52f3-4b84-91ac-ae5b97b27bab"}]': finished 2023-10-08T08:40:21.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:21 smithi191 ceph-mon[104220]: osdmap e62: 10 total, 9 up, 10 in 2023-10-08T08:40:21.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:21 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:22.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:22 smithi070 ceph-mon[99513]: pgmap v161: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:22.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:22 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1712280236' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:40:22.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:22 smithi105 ceph-mon[103798]: pgmap v161: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:22.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:22 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1712280236' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:40:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:22 smithi191 ceph-mon[104220]: pgmap v161: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:22 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1712280236' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:40:24.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:24 smithi070 ceph-mon[99513]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:24 smithi105 ceph-mon[103798]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:24 smithi191 ceph-mon[104220]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:26.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:26 smithi070 ceph-mon[99513]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:40:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:26 smithi105 ceph-mon[103798]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:40:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:26 smithi191 ceph-mon[104220]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:40:28.439 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:28 smithi070 ceph-mon[99513]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-08T08:40:28.440 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:28 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T08:40:28.440 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:28 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:28.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:28 smithi105 ceph-mon[103798]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-08T08:40:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:28 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T08:40:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:28 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:28 smithi191 ceph-mon[104220]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-08T08:40:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:28 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T08:40:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:28 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:29 smithi070 ceph-mon[99513]: Deploying daemon osd.9 on smithi070 2023-10-08T08:40:29.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:29 smithi105 ceph-mon[103798]: Deploying daemon osd.9 on smithi070 2023-10-08T08:40:29.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:29 smithi191 ceph-mon[104220]: Deploying daemon osd.9 on smithi070 2023-10-08T08:40:30.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:30 smithi070 ceph-mon[99513]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-10-08T08:40:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:30 smithi105 ceph-mon[103798]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-10-08T08:40:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:30 smithi191 ceph-mon[104220]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-10-08T08:40:32.411 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:32 smithi070 ceph-mon[99513]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T08:40:32.421 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:32 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:32.421 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:32 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:32.421 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:32 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:32 smithi105 ceph-mon[103798]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T08:40:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:32 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:32.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:32 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:32.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:32 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:32 smithi191 ceph-mon[104220]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T08:40:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:32 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:32 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:32.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:32 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:34.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:34 smithi070 ceph-mon[99513]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T08:40:34.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:34 smithi105 ceph-mon[103798]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T08:40:34.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:34 smithi191 ceph-mon[104220]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T08:40:34.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.844+0000 7fcc19ffb700 1 -- 172.21.15.70:0/3905366309 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcc1c0ff2e0 con 0x7fcc0c0a1550 2023-10-08T08:40:34.845 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 9 on host 'smithi070' 2023-10-08T08:40:34.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcc0c0a1550 msgr2=0x7fcc0c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:34.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000b5c0 tx=0x7fcc10005960 comp rx=0 tx=0).stop 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c100810 msgr2=0x7fcc1c197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c100810 0x7fcc1c197f90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800d980 tx=0x7fcc0800dc90 comp rx=0 tx=0).stop 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 shutdown_connections 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcc0c0a1550 0x7fcc0c0a3a10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc1c1056c0 0x7fcc1c1a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc1c0ffe50 0x7fcc1c197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 --2- 172.21.15.70:0/3905366309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc1c100810 0x7fcc1c197f90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.846+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 >> 172.21.15.70:0/3905366309 conn(0x7fcc1c075cf0 msgr2=0x7fcc1c1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.847+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 shutdown_connections 2023-10-08T08:40:34.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:40:34.847+0000 7fcc230c8700 1 -- 172.21.15.70:0/3905366309 wait complete. 2023-10-08T08:40:35.257 DEBUG:teuthology.orchestra.run.smithi070:osd.9> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.9.service 2023-10-08T08:40:35.259 INFO:tasks.cephadm:Deploying osd.10 on smithi105 with /dev/vg_nvme/lv_1... 2023-10-08T08:40:35.260 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T08:40:35.289 INFO:journalctl@ceph.osd.9.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:40:35.836 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:40:36.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:35 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:35 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:35 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:35 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:35 smithi070 ceph-mon[99513]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T08:40:36.046 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:40:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:40:35.941+0000 7fe2ea149640 -1 osd.9 0 log_to_monitors true 2023-10-08T08:40:36.084 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:35 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.084 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:35 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.084 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:35 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.085 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:35 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.085 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:35 smithi105 ceph-mon[103798]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T08:40:36.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:35 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:35 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:35 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:35 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:36.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:35 smithi191 ceph-mon[104220]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T08:40:36.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:36 smithi070 ceph-mon[99513]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T08:40:37.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:36 smithi191 ceph-mon[104220]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T08:40:37.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:36 smithi105 ceph-mon[103798]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T08:40:37.324 INFO:teuthology.orchestra.run.smithi105.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T08:40:37.325 INFO:teuthology.orchestra.run.smithi105.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T08:40:37.325 INFO:teuthology.orchestra.run.smithi105.stderr: stderr: 10+0 records in 2023-10-08T08:40:37.325 INFO:teuthology.orchestra.run.smithi105.stderr:10+0 records out 2023-10-08T08:40:37.325 INFO:teuthology.orchestra.run.smithi105.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111476 s, 941 MB/s 2023-10-08T08:40:37.325 INFO:teuthology.orchestra.run.smithi105.stderr:--> Zapping successful for: 2023-10-08T08:40:37.693 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi105:vg_nvme/lv_1 2023-10-08T08:40:38.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:37 smithi105 ceph-mon[103798]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T08:40:38.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:37 smithi105 ceph-mon[103798]: osdmap e63: 10 total, 9 up, 10 in 2023-10-08T08:40:38.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:37 smithi105 ceph-mon[103798]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:40:38.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:37 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:38.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:37 smithi105 ceph-mon[103798]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:38.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:37 smithi191 ceph-mon[104220]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T08:40:38.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:37 smithi191 ceph-mon[104220]: osdmap e63: 10 total, 9 up, 10 in 2023-10-08T08:40:38.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:37 smithi191 ceph-mon[104220]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:40:38.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:37 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:38.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:37 smithi191 ceph-mon[104220]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:38.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:40:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:40:37.833+0000 7fe2df7c0700 -1 osd.9 0 waiting for initial osdmap 2023-10-08T08:40:38.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:40:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:40:37.848+0000 7fe2d7dae700 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:40:38.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:37 smithi070 ceph-mon[99513]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T08:40:38.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:37 smithi070 ceph-mon[99513]: osdmap e63: 10 total, 9 up, 10 in 2023-10-08T08:40:38.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:37 smithi070 ceph-mon[99513]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2023-10-08T08:40:38.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:37 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:38.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:37 smithi070 ceph-mon[99513]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:38.252 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi070 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi070 to 4292M 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:39.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi070 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi070 to 4292M 2023-10-08T08:40:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:39.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2023-10-08T08:40:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T08:40:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi070 2023-10-08T08:40:39.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:39.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi070 to 4292M 2023-10-08T08:40:39.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:39.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:39.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:39.224 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:39.224 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:39.224 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:39.372 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.370+0000 7f9eb431f700 1 -- 172.21.15.105:0/1333248286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac1002a0 msgr2=0x7f9eac100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.370+0000 7f9eb431f700 1 --2- 172.21.15.105:0/1333248286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac1002a0 0x7f9eac100720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009990 tx=0x7f9ea8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.370+0000 7f9eb431f700 1 -- 172.21.15.105:0/1333248286 shutdown_connections 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.370+0000 7f9eb431f700 1 --2- 172.21.15.105:0/1333248286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eac100c60 0x7f9eac10c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.370+0000 7f9eb431f700 1 --2- 172.21.15.105:0/1333248286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9eac104720 0x7f9eac104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.370+0000 7f9eb431f700 1 --2- 172.21.15.105:0/1333248286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac1002a0 0x7f9eac100720 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.370+0000 7f9eb431f700 1 -- 172.21.15.105:0/1333248286 >> 172.21.15.105:0/1333248286 conn(0x7f9eac074a10 msgr2=0x7f9eac074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.370+0000 7f9eb431f700 1 -- 172.21.15.105:0/1333248286 shutdown_connections 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.370+0000 7f9eb431f700 1 -- 172.21.15.105:0/1333248286 wait complete. 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb431f700 1 Processor -- start 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb431f700 1 -- start start 2023-10-08T08:40:39.373 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb431f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9eac1002a0 0x7f9eac195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb431f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eac100c60 0x7f9eac195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb431f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac104720 0x7f9eac19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb431f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac19a920 con 0x7f9eac100c60 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb431f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac19aa90 con 0x7f9eac104720 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb431f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac19ac50 con 0x7f9eac1002a0 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb28bc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac104720 0x7f9eac19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb20bb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9eac1002a0 0x7f9eac195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb28bc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac104720 0x7f9eac19a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40870/0 (socket says 172.21.15.105:40870) 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb28bc700 1 -- 172.21.15.105:0/3841971343 learned_addr learned my addr 172.21.15.105:0/3841971343 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb18ba700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eac100c60 0x7f9eac195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb28bc700 1 -- 172.21.15.105:0/3841971343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9eac1002a0 msgr2=0x7f9eac195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:39.374 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb28bc700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9eac1002a0 0x7f9eac195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:39.375 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb28bc700 1 -- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eac100c60 msgr2=0x7f9eac195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:39.375 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb28bc700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eac100c60 0x7f9eac195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:39.375 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.371+0000 7f9eb28bc700 1 -- 172.21.15.105:0/3841971343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80095f0 con 0x7f9eac104720 2023-10-08T08:40:39.375 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.372+0000 7f9eb28bc700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac104720 0x7f9eac19a350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4007d70 tx=0x7f9ea400a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:40:39.375 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.372+0000 7f9ea37fe700 1 -- 172.21.15.105:0/3841971343 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400ad40 con 0x7f9eac104720 2023-10-08T08:40:39.375 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.372+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac19af30 con 0x7f9eac104720 2023-10-08T08:40:39.375 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.372+0000 7f9ea37fe700 1 -- 172.21.15.105:0/3841971343 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ea40128e0 con 0x7f9eac104720 2023-10-08T08:40:39.375 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.372+0000 7f9ea37fe700 1 -- 172.21.15.105:0/3841971343 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea40116b0 con 0x7f9eac104720 2023-10-08T08:40:39.376 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.372+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac1a27d0 con 0x7f9eac104720 2023-10-08T08:40:39.376 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.373+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac107c60 con 0x7f9eac104720 2023-10-08T08:40:39.376 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.374+0000 7f9ea37fe700 1 -- 172.21.15.105:0/3841971343 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f9ea4012420 con 0x7f9eac104720 2023-10-08T08:40:39.377 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.374+0000 7f9ea37fe700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9e980a14d0 0x7f9e980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:39.377 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.374+0000 7f9ea37fe700 1 -- 172.21.15.105:0/3841971343 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6476+0+0 (secure 0 0 0) 0x7f9ea40ccce0 con 0x7f9eac104720 2023-10-08T08:40:39.377 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.375+0000 7f9eb20bb700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9e980a14d0 0x7f9e980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:39.377 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.375+0000 7f9eb20bb700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9e980a14d0 0x7f9e980a3990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c005950 tx=0x7f9e9c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:40:39.379 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.378+0000 7f9ea37fe700 1 -- 172.21.15.105:0/3841971343 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ea4096a70 con 0x7f9eac104720 2023-10-08T08:40:39.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:39.576+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9eac196d40 con 0x7f9e980a14d0 2023-10-08T08:40:40.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:40:40.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:40:40.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:40.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] boot 2023-10-08T08:40:40.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: osdmap e65: 10 total, 10 up, 10 in 2023-10-08T08:40:40.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:40.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:40.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:40:40.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:40:40.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:40.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:40:40.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:40:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] boot 2023-10-08T08:40:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: osdmap e65: 10 total, 10 up, 10 in 2023-10-08T08:40:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:40:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:40:40.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:40.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:40:40.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:40:40.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:40.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: osd.9 [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] boot 2023-10-08T08:40:40.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: osdmap e65: 10 total, 10 up, 10 in 2023-10-08T08:40:40.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T08:40:40.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T08:40:40.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:40:40.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:40:40.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:41.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:40 smithi105 ceph-mon[103798]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:40:41.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:40 smithi105 ceph-mon[103798]: osdmap e66: 10 total, 10 up, 10 in 2023-10-08T08:40:41.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:40 smithi070 ceph-mon[99513]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:40:41.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:40 smithi070 ceph-mon[99513]: osdmap e66: 10 total, 10 up, 10 in 2023-10-08T08:40:41.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:40 smithi191 ceph-mon[104220]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:40:41.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:40 smithi191 ceph-mon[104220]: osdmap e66: 10 total, 10 up, 10 in 2023-10-08T08:40:42.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:41 smithi070 ceph-mon[99513]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:42.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:41 smithi105 ceph-mon[103798]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:42.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:41 smithi191 ceph-mon[104220]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:43.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:42 smithi070 ceph-mon[99513]: from='client.? 172.21.15.105:0/1604024546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a718b26-f154-454f-8756-acebf09a6e05"}]: dispatch 2023-10-08T08:40:43.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:42 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a718b26-f154-454f-8756-acebf09a6e05"}]: dispatch 2023-10-08T08:40:43.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:42 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a718b26-f154-454f-8756-acebf09a6e05"}]': finished 2023-10-08T08:40:43.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:42 smithi070 ceph-mon[99513]: osdmap e67: 11 total, 10 up, 11 in 2023-10-08T08:40:43.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:43.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:42 smithi070 ceph-mon[99513]: from='client.? 172.21.15.105:0/1583995304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:40:43.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:42 smithi105 ceph-mon[103798]: from='client.? 172.21.15.105:0/1604024546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a718b26-f154-454f-8756-acebf09a6e05"}]: dispatch 2023-10-08T08:40:43.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:42 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a718b26-f154-454f-8756-acebf09a6e05"}]: dispatch 2023-10-08T08:40:43.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:42 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a718b26-f154-454f-8756-acebf09a6e05"}]': finished 2023-10-08T08:40:43.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:42 smithi105 ceph-mon[103798]: osdmap e67: 11 total, 10 up, 11 in 2023-10-08T08:40:43.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:43.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:42 smithi105 ceph-mon[103798]: from='client.? 172.21.15.105:0/1583995304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:40:43.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:42 smithi191 ceph-mon[104220]: from='client.? 172.21.15.105:0/1604024546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a718b26-f154-454f-8756-acebf09a6e05"}]: dispatch 2023-10-08T08:40:43.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:42 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a718b26-f154-454f-8756-acebf09a6e05"}]: dispatch 2023-10-08T08:40:43.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:42 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a718b26-f154-454f-8756-acebf09a6e05"}]': finished 2023-10-08T08:40:43.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:42 smithi191 ceph-mon[104220]: osdmap e67: 11 total, 10 up, 11 in 2023-10-08T08:40:43.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:43.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:42 smithi191 ceph-mon[104220]: from='client.? 172.21.15.105:0/1583995304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:40:44.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:43 smithi070 ceph-mon[99513]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:44.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:43 smithi105 ceph-mon[103798]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:44.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:43 smithi191 ceph-mon[104220]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:46.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:46 smithi105 ceph-mon[103798]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:46.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:46 smithi191 ceph-mon[104220]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:46.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:46 smithi070 ceph-mon[99513]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:48.255 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:48 smithi105 ceph-mon[103798]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:48.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:48 smithi191 ceph-mon[104220]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:48.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:48 smithi070 ceph-mon[99513]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:49.194 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T08:40:49.194 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:49.195 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:49 smithi105 ceph-mon[103798]: Deploying daemon osd.10 on smithi105 2023-10-08T08:40:49.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T08:40:49.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:49.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:49 smithi191 ceph-mon[104220]: Deploying daemon osd.10 on smithi105 2023-10-08T08:40:49.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T08:40:49.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:49.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:49 smithi070 ceph-mon[99513]: Deploying daemon osd.10 on smithi105 2023-10-08T08:40:50.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:50 smithi191 ceph-mon[104220]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:50.395 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:50 smithi105 ceph-mon[103798]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:50.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:50 smithi070 ceph-mon[99513]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:52.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:52 smithi191 ceph-mon[104220]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:52.431 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:52 smithi105 ceph-mon[103798]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:52.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:52 smithi070 ceph-mon[99513]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:53.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:53.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:53.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:53.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:53 smithi105 ceph-mon[103798]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:53.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:53 smithi191 ceph-mon[104220]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:53.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:40:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:53 smithi070 ceph-mon[99513]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:55.184 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.182+0000 7f9ea37fe700 1 -- 172.21.15.105:0/3841971343 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f9eac196d40 con 0x7f9e980a14d0 2023-10-08T08:40:55.184 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 10 on host 'smithi105' 2023-10-08T08:40:55.186 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9e980a14d0 msgr2=0x7f9e980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:55.186 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9e980a14d0 0x7f9e980a3990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c005950 tx=0x7f9e9c00b410 comp rx=0 tx=0).stop 2023-10-08T08:40:55.186 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac104720 msgr2=0x7f9eac19a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:55.187 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac104720 0x7f9eac19a350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4007d70 tx=0x7f9ea400a340 comp rx=0 tx=0).stop 2023-10-08T08:40:55.187 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 shutdown_connections 2023-10-08T08:40:55.187 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9e980a14d0 0x7f9e980a3990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:55.187 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9eac104720 0x7f9eac19a350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:55.187 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9eac1002a0 0x7f9eac195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:55.187 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 --2- 172.21.15.105:0/3841971343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eac100c60 0x7f9eac195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:55.187 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.184+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 >> 172.21.15.105:0/3841971343 conn(0x7f9eac074a10 msgr2=0x7f9eac0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:40:55.187 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.185+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 shutdown_connections 2023-10-08T08:40:55.187 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-08T08:40:55.185+0000 7f9eb431f700 1 -- 172.21.15.105:0/3841971343 wait complete. 2023-10-08T08:40:55.647 DEBUG:teuthology.orchestra.run.smithi105:osd.10> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.10.service 2023-10-08T08:40:55.649 INFO:tasks.cephadm:Deploying osd.11 on smithi191 with /dev/vg_nvme/lv_1... 2023-10-08T08:40:55.649 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T08:40:55.678 INFO:journalctl@ceph.osd.10.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:40:56.216 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:40:56.397 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:56 smithi191 ceph-mon[104220]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:56.398 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.398 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.398 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.398 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:56 smithi070 ceph-mon[99513]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:56 smithi105 ceph-mon[103798]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:56.807 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:40:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:40:56.548+0000 7fc628be7640 -1 osd.10 0 log_to_monitors true 2023-10-08T08:40:57.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:57 smithi070 ceph-mon[99513]: from='osd.10 [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T08:40:57.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:57 smithi070 ceph-mon[99513]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T08:40:57.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:57 smithi105 ceph-mon[103798]: from='osd.10 [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T08:40:57.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:57 smithi105 ceph-mon[103798]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T08:40:57.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:57 smithi191 ceph-mon[104220]: from='osd.10 [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T08:40:57.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:57 smithi191 ceph-mon[104220]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T08:40:57.613 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T08:40:57.613 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T08:40:57.614 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2023-10-08T08:40:57.614 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2023-10-08T08:40:57.614 INFO:teuthology.orchestra.run.smithi191.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111853 s, 937 MB/s 2023-10-08T08:40:57.614 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2023-10-08T08:40:57.958 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi191:vg_nvme/lv_1 2023-10-08T08:40:58.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:58 smithi191 ceph-mon[104220]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:58.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:58 smithi191 ceph-mon[104220]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T08:40:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:58 smithi191 ceph-mon[104220]: from='osd.10 [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:40:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:58 smithi191 ceph-mon[104220]: osdmap e68: 11 total, 10 up, 11 in 2023-10-08T08:40:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:58 smithi191 ceph-mon[104220]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:40:58.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:58 smithi070 ceph-mon[99513]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:58 smithi070 ceph-mon[99513]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T08:40:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:58 smithi070 ceph-mon[99513]: from='osd.10 [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:40:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:58 smithi070 ceph-mon[99513]: osdmap e68: 11 total, 10 up, 11 in 2023-10-08T08:40:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:58.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:58 smithi070 ceph-mon[99513]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:40:58.520 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:40:58.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:40:58 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:40:58.151+0000 7fc61e25e700 -1 osd.10 0 waiting for initial osdmap 2023-10-08T08:40:58.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:40:58 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:40:58.164+0000 7fc619051700 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:40:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:58 smithi105 ceph-mon[103798]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:40:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:58 smithi105 ceph-mon[103798]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T08:40:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:58 smithi105 ceph-mon[103798]: from='osd.10 [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:40:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:58 smithi105 ceph-mon[103798]: osdmap e68: 11 total, 10 up, 11 in 2023-10-08T08:40:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:58 smithi105 ceph-mon[103798]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2023-10-08T08:40:59.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:59.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:59.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: osd.10 [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] boot 2023-10-08T08:40:59.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: osdmap e70: 11 total, 11 up, 11 in 2023-10-08T08:40:59.272 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:40:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:59.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:59.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: osd.10 [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] boot 2023-10-08T08:40:59.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: osdmap e70: 11 total, 11 up, 11 in 2023-10-08T08:40:59.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:40:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:59.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:40:59.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:40:59.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:40:59.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: osd.10 [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] boot 2023-10-08T08:40:59.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: osdmap e70: 11 total, 11 up, 11 in 2023-10-08T08:40:59.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:40:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T08:40:59.693 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.691+0000 7f0a536f5700 1 -- 172.21.15.191:0/3552172309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ff150 msgr2=0x7f0a4c0ff5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:59.693 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.691+0000 7f0a536f5700 1 --2- 172.21.15.191:0/3552172309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ff150 0x7f0a4c0ff5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009990 tx=0x7f0a48009ca0 comp rx=0 tx=0).stop 2023-10-08T08:40:59.693 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.691+0000 7f0a536f5700 1 -- 172.21.15.191:0/3552172309 shutdown_connections 2023-10-08T08:40:59.693 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.691+0000 7f0a536f5700 1 --2- 172.21.15.191:0/3552172309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a4c0ffb10 0x7f0a4c10d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:59.693 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.691+0000 7f0a536f5700 1 --2- 172.21.15.191:0/3552172309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4c105840 0x7f0a4c105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.691+0000 7f0a536f5700 1 --2- 172.21.15.191:0/3552172309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ff150 0x7f0a4c0ff5d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.691+0000 7f0a536f5700 1 -- 172.21.15.191:0/3552172309 >> 172.21.15.191:0/3552172309 conn(0x7f0a4c074aa0 msgr2=0x7f0a4c074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.691+0000 7f0a536f5700 1 -- 172.21.15.191:0/3552172309 shutdown_connections 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.691+0000 7f0a536f5700 1 -- 172.21.15.191:0/3552172309 wait complete. 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a536f5700 1 Processor -- start 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a536f5700 1 -- start start 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a536f5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a4c0ff150 0x7f0a4c19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a536f5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ffb10 0x7f0a4c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a536f5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4c105840 0x7f0a4c196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a536f5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c197060 con 0x7f0a4c0ff150 2023-10-08T08:40:59.694 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a536f5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c1971d0 con 0x7f0a4c105840 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a536f5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c197390 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a50c90700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ffb10 0x7f0a4c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a50c90700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ffb10 0x7f0a4c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:56134/0 (socket says 172.21.15.191:56134) 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a50c90700 1 -- 172.21.15.191:0/2172821473 learned_addr learned my addr 172.21.15.191:0/2172821473 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a51c92700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4c105840 0x7f0a4c196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a51491700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a4c0ff150 0x7f0a4c19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a50c90700 1 -- 172.21.15.191:0/2172821473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4c105840 msgr2=0x7f0a4c196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a50c90700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4c105840 0x7f0a4c196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a50c90700 1 -- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a4c0ff150 msgr2=0x7f0a4c19c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a50c90700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a4c0ff150 0x7f0a4c19c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.692+0000 7f0a50c90700 1 -- 172.21.15.191:0/2172821473 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a480095f0 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.693+0000 7f0a50c90700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ffb10 0x7f0a4c19ce00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a480098e0 tx=0x7f0a4800f720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:40:59.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.693+0000 7f0a427fc700 1 -- 172.21.15.191:0/2172821473 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4801d070 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.696 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.693+0000 7f0a427fc700 1 -- 172.21.15.191:0/2172821473 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a4800fb90 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.696 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.693+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c197610 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.696 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.693+0000 7f0a427fc700 1 -- 172.21.15.191:0/2172821473 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48017650 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.696 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.693+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c1a38b0 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.697 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.694+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c108db0 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.697 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.695+0000 7f0a427fc700 1 -- 172.21.15.191:0/2172821473 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0a4800fd00 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.697 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.695+0000 7f0a427fc700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a380a14d0 0x7f0a380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:40:59.697 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.695+0000 7f0a427fc700 1 -- 172.21.15.191:0/2172821473 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6942+0+0 (secure 0 0 0) 0x7f0a480cddb0 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.697 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.696+0000 7f0a51491700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a380a14d0 0x7f0a380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:40:59.697 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.696+0000 7f0a51491700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a380a14d0 0x7f0a380a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c005950 tx=0x7f0a3c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:40:59.699 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.699+0000 7f0a427fc700 1 -- 172.21.15.191:0/2172821473 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0a48097a00 con 0x7f0a4c0ffb10 2023-10-08T08:40:59.899 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:40:59.899+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a4c04e530 con 0x7f0a380a14d0 2023-10-08T08:41:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi105 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi105 to 4292M 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:41:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:41:00.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:00.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:00 smithi070 ceph-mon[99513]: osdmap e71: 11 total, 11 up, 11 in 2023-10-08T08:41:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi105 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi105 to 4292M 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:41:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:00.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:00 smithi105 ceph-mon[103798]: osdmap e71: 11 total, 11 up, 11 in 2023-10-08T08:41:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi105 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi105 to 4292M 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T08:41:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T08:41:00.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:00.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:00 smithi191 ceph-mon[104220]: osdmap e71: 11 total, 11 up, 11 in 2023-10-08T08:41:01.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:01 smithi191 ceph-mon[104220]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:41:01.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:01 smithi191 ceph-mon[104220]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T08:41:01.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:01 smithi070 ceph-mon[99513]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:41:01.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:01 smithi070 ceph-mon[99513]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T08:41:01.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:01 smithi105 ceph-mon[103798]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:41:01.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:01 smithi105 ceph-mon[103798]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T08:41:02.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:02 smithi070 ceph-mon[99513]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:02 smithi105 ceph-mon[103798]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:02 smithi191 ceph-mon[104220]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:03.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:03 smithi070 ceph-mon[99513]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T08:41:03.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:03 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/4276820182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2d38075-48f4-4e3d-9886-8b1fcf7162dd"}]: dispatch 2023-10-08T08:41:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:03 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2d38075-48f4-4e3d-9886-8b1fcf7162dd"}]: dispatch 2023-10-08T08:41:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:03 smithi070 ceph-mon[99513]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2d38075-48f4-4e3d-9886-8b1fcf7162dd"}]': finished 2023-10-08T08:41:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:03 smithi070 ceph-mon[99513]: osdmap e74: 12 total, 11 up, 12 in 2023-10-08T08:41:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:03 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:03 smithi070 ceph-mon[99513]: from='client.? 172.21.15.191:0/574736947' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:41:03.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:03 smithi105 ceph-mon[103798]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T08:41:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:03 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/4276820182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2d38075-48f4-4e3d-9886-8b1fcf7162dd"}]: dispatch 2023-10-08T08:41:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:03 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2d38075-48f4-4e3d-9886-8b1fcf7162dd"}]: dispatch 2023-10-08T08:41:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:03 smithi105 ceph-mon[103798]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2d38075-48f4-4e3d-9886-8b1fcf7162dd"}]': finished 2023-10-08T08:41:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:03 smithi105 ceph-mon[103798]: osdmap e74: 12 total, 11 up, 12 in 2023-10-08T08:41:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:03 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:03 smithi105 ceph-mon[103798]: from='client.? 172.21.15.191:0/574736947' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:41:03.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:03 smithi191 ceph-mon[104220]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T08:41:03.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:03 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/4276820182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2d38075-48f4-4e3d-9886-8b1fcf7162dd"}]: dispatch 2023-10-08T08:41:03.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:03 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b2d38075-48f4-4e3d-9886-8b1fcf7162dd"}]: dispatch 2023-10-08T08:41:03.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:03 smithi191 ceph-mon[104220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2d38075-48f4-4e3d-9886-8b1fcf7162dd"}]': finished 2023-10-08T08:41:03.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:03 smithi191 ceph-mon[104220]: osdmap e74: 12 total, 11 up, 12 in 2023-10-08T08:41:03.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:03 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:03.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:03 smithi191 ceph-mon[104220]: from='client.? 172.21.15.191:0/574736947' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T08:41:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:04 smithi070 ceph-mon[99513]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:04 smithi105 ceph-mon[103798]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:04 smithi191 ceph-mon[104220]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:06.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:06 smithi105 ceph-mon[103798]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T08:41:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:06 smithi191 ceph-mon[104220]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T08:41:06.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:06 smithi070 ceph-mon[99513]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T08:41:08.499 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:08 smithi191 ceph-mon[104220]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:41:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:08 smithi105 ceph-mon[103798]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:41:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:08 smithi070 ceph-mon[99513]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T08:41:09.431 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:09 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T08:41:09.431 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:09 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:09.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:09 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T08:41:09.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:09 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:09.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:09 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T08:41:09.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:09 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:10.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:10 smithi105 ceph-mon[103798]: Deploying daemon osd.11 on smithi191 2023-10-08T08:41:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:10 smithi105 ceph-mon[103798]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T08:41:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:10 smithi191 ceph-mon[104220]: Deploying daemon osd.11 on smithi191 2023-10-08T08:41:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:10 smithi191 ceph-mon[104220]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T08:41:10.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:10 smithi070 ceph-mon[99513]: Deploying daemon osd.11 on smithi191 2023-10-08T08:41:10.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:10 smithi070 ceph-mon[99513]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T08:41:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:12 smithi105 ceph-mon[103798]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-10-08T08:41:12.562 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:12 smithi191 ceph-mon[104220]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-10-08T08:41:12.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:12 smithi070 ceph-mon[99513]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2023-10-08T08:41:13.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:13.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:13.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:13.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:13 smithi191 ceph-mon[104220]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-10-08T08:41:13.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:13.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:13.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:13.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:13 smithi070 ceph-mon[99513]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-10-08T08:41:14.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:14.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:14.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:14.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:13 smithi105 ceph-mon[103798]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-10-08T08:41:15.557 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 11 on host 'smithi191' 2023-10-08T08:41:15.557 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.555+0000 7f0a427fc700 1 -- 172.21.15.191:0/2172821473 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f0a4c04e530 con 0x7f0a380a14d0 2023-10-08T08:41:15.559 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a380a14d0 msgr2=0x7f0a380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a380a14d0 0x7f0a380a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c005950 tx=0x7f0a3c0058e0 comp rx=0 tx=0).stop 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ffb10 msgr2=0x7f0a4c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ffb10 0x7f0a4c19ce00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a480098e0 tx=0x7f0a4800f720 comp rx=0 tx=0).stop 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 shutdown_connections 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0a380a14d0 0x7f0a380a3990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4c105840 0x7f0a4c196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a4c0ff150 0x7f0a4c19c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 --2- 172.21.15.191:0/2172821473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a4c0ffb10 0x7f0a4c19ce00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 >> 172.21.15.191:0/2172821473 conn(0x7f0a4c074aa0 msgr2=0x7f0a4c0fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 shutdown_connections 2023-10-08T08:41:15.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:15.558+0000 7f0a536f5700 1 -- 172.21.15.191:0/2172821473 wait complete. 2023-10-08T08:41:15.896 DEBUG:teuthology.orchestra.run.smithi191:osd.11> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.11.service 2023-10-08T08:41:15.899 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-08T08:41:15.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T08:41:15.934 INFO:journalctl@ceph.osd.11.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:41:16.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:16 smithi070 ceph-mon[99513]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T08:41:16.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:16 smithi191 ceph-mon[104220]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T08:41:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.472 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:41:16.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:16 smithi105 ceph-mon[103798]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T08:41:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:16.754 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:41:16 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:41:16.688+0000 7f39301f2640 -1 osd.11 0 log_to_monitors true 2023-10-08T08:41:17.292 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:17 smithi191 ceph-mon[104220]: from='osd.11 [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T08:41:17.292 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:17 smithi191 ceph-mon[104220]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T08:41:17.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:17 smithi070 ceph-mon[99513]: from='osd.11 [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T08:41:17.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:17 smithi070 ceph-mon[99513]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T08:41:17.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:17 smithi105 ceph-mon[103798]: from='osd.11 [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T08:41:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:17 smithi105 ceph-mon[103798]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T08:41:17.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.775+0000 7f3447649700 1 -- 172.21.15.70:0/3311868750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401008a0 msgr2=0x7f3440100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:17.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.775+0000 7f3447649700 1 --2- 172.21.15.70:0/3311868750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401008a0 0x7f3440100d20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3430009990 tx=0x7f3430009ca0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.775+0000 7f3447649700 1 -- 172.21.15.70:0/3311868750 shutdown_connections 2023-10-08T08:41:17.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.775+0000 7f3447649700 1 --2- 172.21.15.70:0/3311868750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3440101260 0x7f344010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.775+0000 7f3447649700 1 --2- 172.21.15.70:0/3311868750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34401057c0 0x7f3440105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.775+0000 7f3447649700 1 --2- 172.21.15.70:0/3311868750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401008a0 0x7f3440100d20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.775+0000 7f3447649700 1 -- 172.21.15.70:0/3311868750 >> 172.21.15.70:0/3311868750 conn(0x7f34400779e0 msgr2=0x7f3440077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:17.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.775+0000 7f3447649700 1 -- 172.21.15.70:0/3311868750 shutdown_connections 2023-10-08T08:41:17.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.775+0000 7f3447649700 1 -- 172.21.15.70:0/3311868750 wait complete. 2023-10-08T08:41:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3447649700 1 Processor -- start 2023-10-08T08:41:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3447649700 1 -- start start 2023-10-08T08:41:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3447649700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34401008a0 0x7f344019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3447649700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3440101260 0x7f344019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3447649700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401057c0 0x7f3440196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3447649700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440197140 con 0x7f34401057c0 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3447649700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34401972b0 con 0x7f34401008a0 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3447649700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440197470 con 0x7f3440101260 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3445be6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401057c0 0x7f3440196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3444be4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3440101260 0x7f344019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3445be6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401057c0 0x7f3440196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48628/0 (socket says 172.21.15.70:48628) 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f3445be6700 1 -- 172.21.15.70:0/1287960642 learned_addr learned my addr 172.21.15.70:0/1287960642 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.776+0000 7f34453e5700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34401008a0 0x7f344019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f3445be6700 1 -- 172.21.15.70:0/1287960642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3440101260 msgr2=0x7f344019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f3445be6700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3440101260 0x7f344019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f3445be6700 1 -- 172.21.15.70:0/1287960642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34401008a0 msgr2=0x7f344019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f3445be6700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34401008a0 0x7f344019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f3445be6700 1 -- 172.21.15.70:0/1287960642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300095f0 con 0x7f34401057c0 2023-10-08T08:41:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f3445be6700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401057c0 0x7f3440196ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f343800efc0 tx=0x7f343800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f34367fc700 1 -- 172.21.15.70:0/1287960642 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438018070 con 0x7f34401057c0 2023-10-08T08:41:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34401976f0 con 0x7f34401057c0 2023-10-08T08:41:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f34367fc700 1 -- 172.21.15.70:0/1287960642 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f343800f040 con 0x7f34401057c0 2023-10-08T08:41:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f34367fc700 1 -- 172.21.15.70:0/1287960642 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343800cc10 con 0x7f34401057c0 2023-10-08T08:41:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.777+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34401a3980 con 0x7f34401057c0 2023-10-08T08:41:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.778+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3440108da0 con 0x7f34401057c0 2023-10-08T08:41:17.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.779+0000 7f34367fc700 1 -- 172.21.15.70:0/1287960642 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f343800cd70 con 0x7f34401057c0 2023-10-08T08:41:17.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.780+0000 7f34367fc700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f342c0a14d0 0x7f342c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:17.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.780+0000 7f34453e5700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f342c0a14d0 0x7f342c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:17.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.780+0000 7f34367fc700 1 -- 172.21.15.70:0/1287960642 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7046+0+0 (secure 0 0 0) 0x7f34380ccc00 con 0x7f34401057c0 2023-10-08T08:41:17.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.780+0000 7f34453e5700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f342c0a14d0 0x7f342c0a3990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3440101930 tx=0x7f343c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:17.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.783+0000 7f34367fc700 1 -- 172.21.15.70:0/1287960642 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f34380967e0 con 0x7f34401057c0 2023-10-08T08:41:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.974+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f3440101f30 con 0x7f34401057c0 2023-10-08T08:41:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.975+0000 7f34367fc700 1 -- 172.21.15.70:0/1287960642 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) v1 ==== 74+0+133 (secure 0 0 0) 0x7f3438099e00 con 0x7f34401057c0 2023-10-08T08:41:17.976 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:17.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f342c0a14d0 msgr2=0x7f342c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:17.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f342c0a14d0 0x7f342c0a3990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3440101930 tx=0x7f343c00b410 comp rx=0 tx=0).stop 2023-10-08T08:41:17.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401057c0 msgr2=0x7f3440196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:17.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401057c0 0x7f3440196ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f343800efc0 tx=0x7f343800c3a0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 shutdown_connections 2023-10-08T08:41:17.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f342c0a14d0 0x7f342c0a3990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34401057c0 0x7f3440196ad0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34401008a0 0x7f344019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 --2- 172.21.15.70:0/1287960642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3440101260 0x7f344019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:17.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 >> 172.21.15.70:0/1287960642 conn(0x7f34400779e0 msgr2=0x7f34400fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:17.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 shutdown_connections 2023-10-08T08:41:17.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:17.977+0000 7f3447649700 1 -- 172.21.15.70:0/1287960642 wait complete. 2023-10-08T08:41:18.345 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:41:18 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:41:18.075+0000 7f3925869700 -1 osd.11 0 waiting for initial osdmap 2023-10-08T08:41:18.345 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:41:18 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:41:18.090+0000 7f391fe5b700 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T08:41:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:18 smithi191 ceph-mon[104220]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:18 smithi191 ceph-mon[104220]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T08:41:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:18 smithi191 ceph-mon[104220]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T08:41:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:18 smithi191 ceph-mon[104220]: from='osd.11 [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:41:18.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:18 smithi191 ceph-mon[104220]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:41:18.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:18 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1287960642' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T08:41:18.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:18 smithi070 ceph-mon[99513]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:18.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:18 smithi070 ceph-mon[99513]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T08:41:18.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:18 smithi070 ceph-mon[99513]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T08:41:18.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:18.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:18 smithi070 ceph-mon[99513]: from='osd.11 [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:41:18.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:18 smithi070 ceph-mon[99513]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:41:18.370 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:18 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1287960642' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T08:41:18.414 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1696754459,"num_in_osds":12,"osd_in_since":1696754462,"num_remapped_pgs":0} 2023-10-08T08:41:18.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:18 smithi105 ceph-mon[103798]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:18 smithi105 ceph-mon[103798]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T08:41:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:18 smithi105 ceph-mon[103798]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T08:41:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:18 smithi105 ceph-mon[103798]: from='osd.11 [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:41:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:18 smithi105 ceph-mon[103798]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2023-10-08T08:41:18.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:18 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1287960642' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T08:41:19.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:41:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T08:41:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:19.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:19.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:19.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:19.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:19.347 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T08:41:19.444 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:41:19.444 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T08:41:19.444 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:19.444 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:19.444 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.444 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.445 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.445 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.445 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.445 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.445 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.445 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:19.445 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:19.445 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.445 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:19.446 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:19.446 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:19.446 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2023-10-08T08:41:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T08:41:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:19.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:41:20.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:20 smithi070 ceph-mon[99513]: purged_snaps scrub starts 2023-10-08T08:41:20.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:20 smithi070 ceph-mon[99513]: purged_snaps scrub ok 2023-10-08T08:41:20.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:20 smithi070 ceph-mon[99513]: Detected new or changed devices on smithi191 2023-10-08T08:41:20.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:20 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi191 to 4292M 2023-10-08T08:41:20.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:20 smithi070 ceph-mon[99513]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:20.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:20 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:20.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:20 smithi070 ceph-mon[99513]: osd.11 [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] boot 2023-10-08T08:41:20.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:20 smithi070 ceph-mon[99513]: osdmap e77: 12 total, 12 up, 12 in 2023-10-08T08:41:20.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:20 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:20.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:20 smithi191 ceph-mon[104220]: purged_snaps scrub starts 2023-10-08T08:41:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:20 smithi191 ceph-mon[104220]: purged_snaps scrub ok 2023-10-08T08:41:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:20 smithi191 ceph-mon[104220]: Detected new or changed devices on smithi191 2023-10-08T08:41:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:20 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi191 to 4292M 2023-10-08T08:41:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:20 smithi191 ceph-mon[104220]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:20 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:20 smithi191 ceph-mon[104220]: osd.11 [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] boot 2023-10-08T08:41:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:20 smithi191 ceph-mon[104220]: osdmap e77: 12 total, 12 up, 12 in 2023-10-08T08:41:20.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:20 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:20 smithi105 ceph-mon[103798]: purged_snaps scrub starts 2023-10-08T08:41:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:20 smithi105 ceph-mon[103798]: purged_snaps scrub ok 2023-10-08T08:41:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:20 smithi105 ceph-mon[103798]: Detected new or changed devices on smithi191 2023-10-08T08:41:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:20 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi191 to 4292M 2023-10-08T08:41:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:20 smithi105 ceph-mon[103798]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T08:41:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:20 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:20 smithi105 ceph-mon[103798]: osd.11 [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] boot 2023-10-08T08:41:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:20 smithi105 ceph-mon[103798]: osdmap e77: 12 total, 12 up, 12 in 2023-10-08T08:41:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:20 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T08:41:21.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.211+0000 7fdbb943b700 1 -- 172.21.15.70:0/3393202422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 msgr2=0x7fdbb4105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:21.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.211+0000 7fdbb943b700 1 --2- 172.21.15.70:0/3393202422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 0x7fdbb4105a70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009990 tx=0x7fdba8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.211+0000 7fdbb943b700 1 -- 172.21.15.70:0/3393202422 shutdown_connections 2023-10-08T08:41:21.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.211+0000 7fdbb943b700 1 --2- 172.21.15.70:0/3393202422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb4100110 0x7fdbb410c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.211+0000 7fdbb943b700 1 --2- 172.21.15.70:0/3393202422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 0x7fdbb4105a70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.211+0000 7fdbb943b700 1 --2- 172.21.15.70:0/3393202422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb40ff750 0x7fdbb40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.211+0000 7fdbb943b700 1 -- 172.21.15.70:0/3393202422 >> 172.21.15.70:0/3393202422 conn(0x7fdbb40757d0 msgr2=0x7fdbb4075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:21.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.211+0000 7fdbb943b700 1 -- 172.21.15.70:0/3393202422 shutdown_connections 2023-10-08T08:41:21.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.211+0000 7fdbb943b700 1 -- 172.21.15.70:0/3393202422 wait complete. 2023-10-08T08:41:21.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb943b700 1 Processor -- start 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb943b700 1 -- start start 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb943b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb40ff750 0x7fdbb419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb943b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb4100110 0x7fdbb419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb943b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 0x7fdbb41959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb943b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb4196040 con 0x7fdbb4105690 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb943b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb41961b0 con 0x7fdbb4100110 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb943b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb4196370 con 0x7fdbb40ff750 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 0x7fdbb41959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 0x7fdbb41959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48644/0 (socket says 172.21.15.70:48644) 2023-10-08T08:41:21.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb37fe700 1 -- 172.21.15.70:0/2226121413 learned_addr learned my addr 172.21.15.70:0/2226121413 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb2ffd700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb40ff750 0x7fdbb419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb27fc700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb4100110 0x7fdbb419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb37fe700 1 -- 172.21.15.70:0/2226121413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb40ff750 msgr2=0x7fdbb419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.212+0000 7fdbb37fe700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb40ff750 0x7fdbb419b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.213+0000 7fdbb37fe700 1 -- 172.21.15.70:0/2226121413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb4100110 msgr2=0x7fdbb419bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.213+0000 7fdbb37fe700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb4100110 0x7fdbb419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.213+0000 7fdbb37fe700 1 -- 172.21.15.70:0/2226121413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80095f0 con 0x7fdbb4105690 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.213+0000 7fdbb37fe700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 0x7fdbb41959e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00b970 tx=0x7fdbac00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.213+0000 7fdb9bfff700 1 -- 172.21.15.70:0/2226121413 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac00c9b0 con 0x7fdbb4105690 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.213+0000 7fdb9bfff700 1 -- 172.21.15.70:0/2226121413 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbac014440 con 0x7fdbb4105690 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.213+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb4196650 con 0x7fdbb4105690 2023-10-08T08:41:21.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.213+0000 7fdb9bfff700 1 -- 172.21.15.70:0/2226121413 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0075d0 con 0x7fdbb4105690 2023-10-08T08:41:21.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.213+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb41a2890 con 0x7fdbb4105690 2023-10-08T08:41:21.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.214+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb4107c40 con 0x7fdbb4105690 2023-10-08T08:41:21.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.215+0000 7fdb9bfff700 1 -- 172.21.15.70:0/2226121413 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fdbac0145b0 con 0x7fdbb4105690 2023-10-08T08:41:21.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.215+0000 7fdb9bfff700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:21.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.215+0000 7fdbb2ffd700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:21.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.216+0000 7fdb9bfff700 1 -- 172.21.15.70:0/2226121413 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fdbac006e40 con 0x7fdbb4105690 2023-10-08T08:41:21.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.216+0000 7fdbb2ffd700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdba8003730 tx=0x7fdba80036c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:21.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.220+0000 7fdb9bfff700 1 -- 172.21.15.70:0/2226121413 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdbac04f100 con 0x7fdbb4105690 2023-10-08T08:41:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.412+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fdbb4196ea0 con 0x7fdbb4105690 2023-10-08T08:41:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.412+0000 7fdb9bfff700 1 -- 172.21.15.70:0/2226121413 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) v1 ==== 74+0+133 (secure 0 0 0) 0x7fdbac095b70 con 0x7fdbb4105690 2023-10-08T08:41:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:21.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 msgr2=0x7fdb9c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:21.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdba8003730 tx=0x7fdba80036c0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 msgr2=0x7fdbb41959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:21.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 0x7fdbb41959e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00b970 tx=0x7fdbac00bd30 comp rx=0 tx=0).stop 2023-10-08T08:41:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 shutdown_connections 2023-10-08T08:41:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb4105690 0x7fdbb41959e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb40ff750 0x7fdbb419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 --2- 172.21.15.70:0/2226121413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb4100110 0x7fdbb419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 >> 172.21.15.70:0/2226121413 conn(0x7fdbb40757d0 msgr2=0x7fdbb40fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 shutdown_connections 2023-10-08T08:41:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:21.414+0000 7fdbb943b700 1 -- 172.21.15.70:0/2226121413 wait complete. 2023-10-08T08:41:21.819 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1696754479,"num_in_osds":12,"osd_in_since":1696754462,"num_remapped_pgs":0} 2023-10-08T08:41:21.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T08:41:21.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:21 smithi070 ceph-mon[99513]: osdmap e78: 12 total, 12 up, 12 in 2023-10-08T08:41:21.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:21 smithi070 ceph-mon[99513]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:21.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:21 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2226121413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T08:41:22.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:21 smithi105 ceph-mon[103798]: osdmap e78: 12 total, 12 up, 12 in 2023-10-08T08:41:22.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:21 smithi105 ceph-mon[103798]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:22.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:21 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2226121413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T08:41:22.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:21 smithi191 ceph-mon[104220]: osdmap e78: 12 total, 12 up, 12 in 2023-10-08T08:41:22.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:21 smithi191 ceph-mon[104220]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:22.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:21 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2226121413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T08:41:22.417 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:41:23.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.652+0000 7f778823b700 1 -- 172.21.15.70:0/2138494101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7780105730 msgr2=0x7f7780105b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:23.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.652+0000 7f778823b700 1 --2- 172.21.15.70:0/2138494101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7780105730 0x7f7780105b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77700099c0 tx=0x7f7770009cd0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.652+0000 7f778823b700 1 -- 172.21.15.70:0/2138494101 shutdown_connections 2023-10-08T08:41:23.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.652+0000 7f778823b700 1 --2- 172.21.15.70:0/2138494101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77801000a0 0x7f778010c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.652+0000 7f778823b700 1 --2- 172.21.15.70:0/2138494101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7780105730 0x7f7780105b10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.652+0000 7f778823b700 1 --2- 172.21.15.70:0/2138494101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77800ff6e0 0x7f77800ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.652+0000 7f778823b700 1 -- 172.21.15.70:0/2138494101 >> 172.21.15.70:0/2138494101 conn(0x7f77800766f0 msgr2=0x7f7780076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:23.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.652+0000 7f778823b700 1 -- 172.21.15.70:0/2138494101 shutdown_connections 2023-10-08T08:41:23.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.653+0000 7f778823b700 1 -- 172.21.15.70:0/2138494101 wait complete. 2023-10-08T08:41:23.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.653+0000 7f778823b700 1 Processor -- start 2023-10-08T08:41:23.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.653+0000 7f778823b700 1 -- start start 2023-10-08T08:41:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.653+0000 7f778823b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77800ff6e0 0x7f778019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.653+0000 7f778823b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77801000a0 0x7f778019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.653+0000 7f778823b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7780105730 0x7f77801969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.653+0000 7f778823b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7780197010 con 0x7f77800ff6e0 2023-10-08T08:41:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.653+0000 7f778823b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7780197180 con 0x7f7780105730 2023-10-08T08:41:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.653+0000 7f778823b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7780197340 con 0x7f77801000a0 2023-10-08T08:41:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7785fd7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77800ff6e0 0x7f778019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7785fd7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77800ff6e0 0x7f778019c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48656/0 (socket says 172.21.15.70:48656) 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7785fd7700 1 -- 172.21.15.70:0/1331028450 learned_addr learned my addr 172.21.15.70:0/1331028450 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f77857d6700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77801000a0 0x7f778019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7785fd7700 1 -- 172.21.15.70:0/1331028450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77801000a0 msgr2=0x7f778019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7785fd7700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77801000a0 0x7f778019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f77867d8700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7780105730 0x7f77801969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7785fd7700 1 -- 172.21.15.70:0/1331028450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7780105730 msgr2=0x7f77801969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7785fd7700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7780105730 0x7f77801969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7785fd7700 1 -- 172.21.15.70:0/1331028450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700095f0 con 0x7f77800ff6e0 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f77867d8700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7780105730 0x7f77801969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:41:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7785fd7700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77800ff6e0 0x7f778019c870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f777000b580 tx=0x7f7770003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7776ffd700 1 -- 172.21.15.70:0/1331028450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777001d070 con 0x7f77800ff6e0 2023-10-08T08:41:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7776ffd700 1 -- 172.21.15.70:0/1331028450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f777000fda0 con 0x7f77800ff6e0 2023-10-08T08:41:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77801975c0 con 0x7f77800ff6e0 2023-10-08T08:41:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f7776ffd700 1 -- 172.21.15.70:0/1331028450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700037c0 con 0x7f77800ff6e0 2023-10-08T08:41:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.654+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77801a3860 con 0x7f77800ff6e0 2023-10-08T08:41:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.655+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7780108c80 con 0x7f77800ff6e0 2023-10-08T08:41:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.656+0000 7f7776ffd700 1 -- 172.21.15.70:0/1331028450 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7770022700 con 0x7f77800ff6e0 2023-10-08T08:41:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.657+0000 7f7776ffd700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f776c0a1550 0x7f776c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.657+0000 7f77857d6700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f776c0a1550 0x7f776c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.657+0000 7f7776ffd700 1 -- 172.21.15.70:0/1331028450 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f77700ce1f0 con 0x7f77800ff6e0 2023-10-08T08:41:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.657+0000 7f77857d6700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f776c0a1550 0x7f776c0a3a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7780197b70 tx=0x7f777c005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.661+0000 7f7776ffd700 1 -- 172.21.15.70:0/1331028450 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7770097cb0 con 0x7f77800ff6e0 2023-10-08T08:41:23.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.852+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7780100e00 con 0x7f77800ff6e0 2023-10-08T08:41:23.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.853+0000 7f7776ffd700 1 -- 172.21.15.70:0/1331028450 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18739 (secure 0 0 0) 0x7f777009b2d0 con 0x7f77800ff6e0 2023-10-08T08:41:23.855 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:23.856 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":78,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:41:20.696287+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:41:23.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f776c0a1550 msgr2=0x7f776c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:23.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f776c0a1550 0x7f776c0a3a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7780197b70 tx=0x7f777c005d50 comp rx=0 tx=0).stop 2023-10-08T08:41:23.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77800ff6e0 msgr2=0x7f778019c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:23.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77800ff6e0 0x7f778019c870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f777000b580 tx=0x7f7770003710 comp rx=0 tx=0).stop 2023-10-08T08:41:23.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 shutdown_connections 2023-10-08T08:41:23.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f776c0a1550 0x7f776c0a3a10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7780105730 0x7f77801969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77800ff6e0 0x7f778019c870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 --2- 172.21.15.70:0/1331028450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77801000a0 0x7f778019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:23.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 >> 172.21.15.70:0/1331028450 conn(0x7f77800766f0 msgr2=0x7f7780069100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:23.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 shutdown_connections 2023-10-08T08:41:23.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:23.855+0000 7f778823b700 1 -- 172.21.15.70:0/1331028450 wait complete. 2023-10-08T08:41:24.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:24 smithi070 ceph-mon[99513]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:24.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:24 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1331028450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:41:24.261 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T08:41:24.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-08T08:41:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:24 smithi105 ceph-mon[103798]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:24 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1331028450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:41:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:24 smithi191 ceph-mon[104220]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:24 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1331028450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:41:24.816 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:41:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.075+0000 7f32bc3ca700 1 -- 172.21.15.70:0/1735146088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b4100110 msgr2=0x7f32b410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.075+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/1735146088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b4100110 0x7f32b410c580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00b0a0 tx=0x7f32ac00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 -- 172.21.15.70:0/1735146088 shutdown_connections 2023-10-08T08:41:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/1735146088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b4100110 0x7f32b410c580 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/1735146088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32b41056b0 0x7f32b4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/1735146088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b40ff750 0x7f32b40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 -- 172.21.15.70:0/1735146088 >> 172.21.15.70:0/1735146088 conn(0x7f32b4075790 msgr2=0x7f32b4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 -- 172.21.15.70:0/1735146088 shutdown_connections 2023-10-08T08:41:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 -- 172.21.15.70:0/1735146088 wait complete. 2023-10-08T08:41:26.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 Processor -- start 2023-10-08T08:41:26.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 -- start start 2023-10-08T08:41:26.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b40ff750 0x7f32b410ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32b4100110 0x7f32b410d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b41056b0 0x7f32b410d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b41a5210 con 0x7f32b40ff750 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b41a5380 con 0x7f32b41056b0 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32bc3ca700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b41a5540 con 0x7f32b4100110 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.076+0000 7f32ba166700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b40ff750 0x7f32b410ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ba166700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b40ff750 0x7f32b410ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48666/0 (socket says 172.21.15.70:48666) 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ba166700 1 -- 172.21.15.70:0/3365177600 learned_addr learned my addr 172.21.15.70:0/3365177600 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32b9965700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32b4100110 0x7f32b410d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ba967700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b41056b0 0x7f32b410d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ba166700 1 -- 172.21.15.70:0/3365177600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32b4100110 msgr2=0x7f32b410d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:26.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ba166700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32b4100110 0x7f32b410d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ba166700 1 -- 172.21.15.70:0/3365177600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b41056b0 msgr2=0x7f32b410d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ba166700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b41056b0 0x7f32b410d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ba166700 1 -- 172.21.15.70:0/3365177600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac009d00 con 0x7f32b40ff750 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ba166700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b40ff750 0x7f32b410ce10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f32a400b530 tx=0x7f32a400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ab7fe700 1 -- 172.21.15.70:0/3365177600 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4011830 con 0x7f32b40ff750 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ab7fe700 1 -- 172.21.15.70:0/3365177600 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32a4011e50 con 0x7f32b40ff750 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b41a5820 con 0x7f32b40ff750 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32ab7fe700 1 -- 172.21.15.70:0/3365177600 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400f2e0 con 0x7f32b40ff750 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.077+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b41a5d70 con 0x7f32b40ff750 2023-10-08T08:41:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.078+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b4107cd0 con 0x7f32b40ff750 2023-10-08T08:41:26.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.079+0000 7f32ab7fe700 1 -- 172.21.15.70:0/3365177600 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f32a4010580 con 0x7f32b40ff750 2023-10-08T08:41:26.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.080+0000 7f32ab7fe700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f32a00a1550 0x7f32a00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:26.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.080+0000 7f32b9965700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f32a00a1550 0x7f32a00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:26.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.080+0000 7f32ab7fe700 1 -- 172.21.15.70:0/3365177600 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f32a40cc9b0 con 0x7f32b40ff750 2023-10-08T08:41:26.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.080+0000 7f32b9965700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f32a00a1550 0x7f32a00a3a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f32b0006fd0 tx=0x7f32b0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:26.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.084+0000 7f32ab7fe700 1 -- 172.21.15.70:0/3365177600 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f32a40963e0 con 0x7f32b40ff750 2023-10-08T08:41:26.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:26 smithi070 ceph-mon[99513]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:26.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.273+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32b410e2f0 con 0x7f32b40ff750 2023-10-08T08:41:26.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.273+0000 7f32ab7fe700 1 -- 172.21.15.70:0/3365177600 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32a4015020 con 0x7f32b40ff750 2023-10-08T08:41:26.274 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:41:26.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.275+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f32a00a1550 msgr2=0x7f32a00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:26.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.275+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f32a00a1550 0x7f32a00a3a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f32b0006fd0 tx=0x7f32b0008040 comp rx=0 tx=0).stop 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.275+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b40ff750 msgr2=0x7f32b410ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.275+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b40ff750 0x7f32b410ce10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f32a400b530 tx=0x7f32a400b8f0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.276+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 shutdown_connections 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.276+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f32a00a1550 0x7f32a00a3a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.276+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b41056b0 0x7f32b410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.276+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32b40ff750 0x7f32b410ce10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.276+0000 7f32bc3ca700 1 --2- 172.21.15.70:0/3365177600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32b4100110 0x7f32b410d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.276+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 >> 172.21.15.70:0/3365177600 conn(0x7f32b4075790 msgr2=0x7f32b40fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.276+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 shutdown_connections 2023-10-08T08:41:26.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:26.276+0000 7f32bc3ca700 1 -- 172.21.15.70:0/3365177600 wait complete. 2023-10-08T08:41:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:26 smithi105 ceph-mon[103798]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:26 smithi191 ceph-mon[104220]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:26.672 INFO:tasks.cephadm:Adding mds.a on smithi070 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.d on smithi070 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.g on smithi070 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.j on smithi070 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.b on smithi105 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.e on smithi105 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.h on smithi105 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.k on smithi105 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.c on smithi191 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.f on smithi191 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.i on smithi191 2023-10-08T08:41:26.673 INFO:tasks.cephadm:Adding mds.l on smithi191 2023-10-08T08:41:26.674 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph orch apply mds all '12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l' 2023-10-08T08:41:27.245 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:41:27.450 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:27 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3365177600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:41:27.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:27 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3365177600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:41:27.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:27 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3365177600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:41:28.437 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 -- 172.21.15.191:0/4252736240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 msgr2=0x7f5b3c0ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:28.437 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 --2- 172.21.15.191:0/4252736240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 0x7f5b3c0ff380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009990 tx=0x7f5b2c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.437 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 -- 172.21.15.191:0/4252736240 shutdown_connections 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 --2- 172.21.15.191:0/4252736240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b3c105b70 0x7f5b3c10d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 --2- 172.21.15.191:0/4252736240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 0x7f5b3c0ff380 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 --2- 172.21.15.191:0/4252736240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c0ff950 0x7f5b3c105490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 -- 172.21.15.191:0/4252736240 >> 172.21.15.191:0/4252736240 conn(0x7f5b3c075cf0 msgr2=0x7f5b3c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 -- 172.21.15.191:0/4252736240 shutdown_connections 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 -- 172.21.15.191:0/4252736240 wait complete. 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.434+0000 7f5b41969700 1 Processor -- start 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b41969700 1 -- start start 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b41969700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 0x7f5b3c0fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b41969700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b3c0ff950 0x7f5b3c100460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b41969700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c105b70 0x7f5b3c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:28.438 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b41969700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c1a5040 con 0x7f5b3c0ff950 2023-10-08T08:41:28.439 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b41969700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c1a51b0 con 0x7f5b3c105b70 2023-10-08T08:41:28.439 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b41969700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c1a5370 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.439 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3affd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 0x7f5b3c0fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:28.439 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3affd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 0x7f5b3c0fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:56258/0 (socket says 172.21.15.191:56258) 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3affd700 1 -- 172.21.15.191:0/3893973839 learned_addr learned my addr 172.21.15.191:0/3893973839 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3a7fc700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b3c0ff950 0x7f5b3c100460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3b7fe700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c105b70 0x7f5b3c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3affd700 1 -- 172.21.15.191:0/3893973839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c105b70 msgr2=0x7f5b3c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3affd700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c105b70 0x7f5b3c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3affd700 1 -- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b3c0ff950 msgr2=0x7f5b3c100460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3affd700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b3c0ff950 0x7f5b3c100460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3affd700 1 -- 172.21.15.191:0/3893973839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0095f0 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3b7fe700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c105b70 0x7f5b3c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.435+0000 7f5b3affd700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 0x7f5b3c0fff20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0098e0 tx=0x7f5b2c00f720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:28.440 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.436+0000 7f5b40967700 1 -- 172.21.15.191:0/3893973839 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c01d070 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.441 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.436+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c1a55f0 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.441 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.436+0000 7f5b40967700 1 -- 172.21.15.191:0/3893973839 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b2c00fb90 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.441 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.436+0000 7f5b40967700 1 -- 172.21.15.191:0/3893973839 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c017650 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.441 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.436+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c1a5a10 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.442 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.437+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c108e00 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.442 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.438+0000 7f5b40967700 1 -- 172.21.15.191:0/3893973839 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5b2c00fd00 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.442 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.438+0000 7f5b40967700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5b240a14d0 0x7f5b240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:28.442 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.438+0000 7f5b40967700 1 -- 172.21.15.191:0/3893973839 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f5b2c0cdab0 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.442 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.439+0000 7f5b3a7fc700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5b240a14d0 0x7f5b240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:28.442 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.439+0000 7f5b3a7fc700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5b240a14d0 0x7f5b240a3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b30005950 tx=0x7f5b300058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:28.444 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.443+0000 7f5b40967700 1 -- 172.21.15.191:0/3893973839 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5b2c097570 con 0x7f5b3c0fefa0 2023-10-08T08:41:28.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:28 smithi070 ceph-mon[99513]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:28 smithi105 ceph-mon[103798]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:28 smithi191 ceph-mon[104220]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:28.640 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.639+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b3c110790 con 0x7f5b240a14d0 2023-10-08T08:41:28.649 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.648+0000 7f5b40967700 1 -- 172.21.15.191:0/3893973839 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f5b3c110790 con 0x7f5b240a14d0 2023-10-08T08:41:28.649 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mds.all update... 2023-10-08T08:41:28.651 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5b240a14d0 msgr2=0x7f5b240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:28.651 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5b240a14d0 0x7f5b240a3990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b30005950 tx=0x7f5b300058e0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 msgr2=0x7f5b3c0fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 0x7f5b3c0fff20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0098e0 tx=0x7f5b2c00f720 comp rx=0 tx=0).stop 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 shutdown_connections 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5b240a14d0 0x7f5b240a3990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c105b70 0x7f5b3c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b3c0fefa0 0x7f5b3c0fff20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 --2- 172.21.15.191:0/3893973839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b3c0ff950 0x7f5b3c100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 >> 172.21.15.191:0/3893973839 conn(0x7f5b3c075cf0 msgr2=0x7f5b3c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 shutdown_connections 2023-10-08T08:41:28.652 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-08T08:41:28.650+0000 7f5b41969700 1 -- 172.21.15.191:0/3893973839 wait complete. 2023-10-08T08:41:28.989 DEBUG:teuthology.orchestra.run.smithi070:mds.a> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.a.service 2023-10-08T08:41:28.992 DEBUG:teuthology.orchestra.run.smithi070:mds.d> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.d.service 2023-10-08T08:41:29.029 INFO:journalctl@ceph.mds.a.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:41:29.030 DEBUG:teuthology.orchestra.run.smithi070:mds.g> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.g.service 2023-10-08T08:41:29.060 INFO:journalctl@ceph.mds.d.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:41:29.061 DEBUG:teuthology.orchestra.run.smithi070:mds.j> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.j.service 2023-10-08T08:41:29.089 INFO:journalctl@ceph.mds.g.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:41:29.089 DEBUG:teuthology.orchestra.run.smithi105:mds.b> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.b.service 2023-10-08T08:41:29.092 DEBUG:teuthology.orchestra.run.smithi105:mds.e> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service 2023-10-08T08:41:29.116 INFO:journalctl@ceph.mds.j.smithi070.stdout:-- Logs begin at Sun 2023-10-08 08:20:10 UTC. -- 2023-10-08T08:41:29.130 INFO:journalctl@ceph.mds.b.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:41:29.133 DEBUG:teuthology.orchestra.run.smithi105:mds.h> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.h.service 2023-10-08T08:41:29.160 INFO:journalctl@ceph.mds.e.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:41:29.161 DEBUG:teuthology.orchestra.run.smithi105:mds.k> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.k.service 2023-10-08T08:41:29.188 INFO:journalctl@ceph.mds.h.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:41:29.189 DEBUG:teuthology.orchestra.run.smithi191:mds.c> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.c.service 2023-10-08T08:41:29.191 DEBUG:teuthology.orchestra.run.smithi191:mds.f> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.f.service 2023-10-08T08:41:29.215 INFO:journalctl@ceph.mds.k.smithi105.stdout:-- Logs begin at Sun 2023-10-08 08:20:08 UTC. -- 2023-10-08T08:41:29.219 INFO:journalctl@ceph.mds.c.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:41:29.220 DEBUG:teuthology.orchestra.run.smithi191:mds.i> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.i.service 2023-10-08T08:41:29.246 INFO:journalctl@ceph.mds.f.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:41:29.247 DEBUG:teuthology.orchestra.run.smithi191:mds.l> sudo journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.l.service 2023-10-08T08:41:29.272 INFO:journalctl@ceph.mds.i.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:41:29.273 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-08T08:41:29.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:41:29.298 INFO:journalctl@ceph.mds.l.smithi191.stdout:-- Logs begin at Sun 2023-10-08 08:20:35 UTC. -- 2023-10-08T08:41:29.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 -- 172.21.15.70:0/1776092394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc101850 msgr2=0x7f39fc101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 --2- 172.21.15.70:0/1776092394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc101850 0x7f39fc101c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009990 tx=0x7f39ec009ca0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 -- 172.21.15.70:0/1776092394 shutdown_connections 2023-10-08T08:41:29.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 --2- 172.21.15.70:0/1776092394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc10ac20 0x7f39fc10d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 --2- 172.21.15.70:0/1776092394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc101850 0x7f39fc101c30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 --2- 172.21.15.70:0/1776092394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39fc102170 0x7f39fc10a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 -- 172.21.15.70:0/1776092394 >> 172.21.15.70:0/1776092394 conn(0x7f39fc0fb030 msgr2=0x7f39fc0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:29.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 -- 172.21.15.70:0/1776092394 shutdown_connections 2023-10-08T08:41:29.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 -- 172.21.15.70:0/1776092394 wait complete. 2023-10-08T08:41:29.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 Processor -- start 2023-10-08T08:41:29.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.404+0000 7f3a025da700 1 -- start start 2023-10-08T08:41:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a025da700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39fc101850 0x7f39fc0ff4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a025da700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc102170 0x7f39fc0ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a025da700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc10ac20 0x7f39fc0fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a025da700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1a4ea0 con 0x7f39fc10ac20 2023-10-08T08:41:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a025da700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1a5010 con 0x7f39fc102170 2023-10-08T08:41:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a025da700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1a51d0 con 0x7f39fc101850 2023-10-08T08:41:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a00b77700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc10ac20 0x7f39fc0fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f39fbfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39fc101850 0x7f39fc0ff4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a00b77700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc10ac20 0x7f39fc0fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48680/0 (socket says 172.21.15.70:48680) 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a00b77700 1 -- 172.21.15.70:0/702829845 learned_addr learned my addr 172.21.15.70:0/702829845 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f39fb7fe700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc102170 0x7f39fc0ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a00b77700 1 -- 172.21.15.70:0/702829845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39fc101850 msgr2=0x7f39fc0ff4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a00b77700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39fc101850 0x7f39fc0ff4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a00b77700 1 -- 172.21.15.70:0/702829845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc102170 msgr2=0x7f39fc0ff9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a00b77700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc102170 0x7f39fc0ff9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a00b77700 1 -- 172.21.15.70:0/702829845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec0095f0 con 0x7f39fc10ac20 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a00b77700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc10ac20 0x7f39fc0fff20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f39f4007ee0 tx=0x7f39f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f39f97fa700 1 -- 172.21.15.70:0/702829845 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4017070 con 0x7f39fc10ac20 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f39f97fa700 1 -- 172.21.15.70:0/702829845 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39f400f040 con 0x7f39fc10ac20 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc1a54b0 con 0x7f39fc10ac20 2023-10-08T08:41:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f39f97fa700 1 -- 172.21.15.70:0/702829845 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4005580 con 0x7f39fc10ac20 2023-10-08T08:41:29.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.405+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc1a5970 con 0x7f39fc10ac20 2023-10-08T08:41:29.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.406+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39fc105da0 con 0x7f39fc10ac20 2023-10-08T08:41:29.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.407+0000 7f39f97fa700 1 -- 172.21.15.70:0/702829845 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f39f400db20 con 0x7f39fc10ac20 2023-10-08T08:41:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.408+0000 7f39f97fa700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39e40a1550 0x7f39e40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.408+0000 7f39fbfff700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39e40a1550 0x7f39e40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.408+0000 7f39f97fa700 1 -- 172.21.15.70:0/702829845 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f39f40cc790 con 0x7f39fc10ac20 2023-10-08T08:41:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.408+0000 7f39fbfff700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39e40a1550 0x7f39e40a3a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00b5c0 tx=0x7f39ec005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:29.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.411+0000 7f39f97fa700 1 -- 172.21.15.70:0/702829845 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f39f4096120 con 0x7f39fc10ac20 2023-10-08T08:41:29.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.607+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39fc0680b0 con 0x7f39fc10ac20 2023-10-08T08:41:29.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.608+0000 7f39f97fa700 1 -- 172.21.15.70:0/702829845 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18739 (secure 0 0 0) 0x7f39f4099740 con 0x7f39fc10ac20 2023-10-08T08:41:29.609 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:29.609 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":78,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:41:20.696287+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:41:29.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39e40a1550 msgr2=0x7f39e40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39e40a1550 0x7f39e40a3a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00b5c0 tx=0x7f39ec005960 comp rx=0 tx=0).stop 2023-10-08T08:41:29.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc10ac20 msgr2=0x7f39fc0fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc10ac20 0x7f39fc0fff20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f39f4007ee0 tx=0x7f39f400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 shutdown_connections 2023-10-08T08:41:29.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39e40a1550 0x7f39e40a3a10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39fc10ac20 0x7f39fc0fff20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39fc101850 0x7f39fc0ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 --2- 172.21.15.70:0/702829845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc102170 0x7f39fc0ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 >> 172.21.15.70:0/702829845 conn(0x7f39fc0fb030 msgr2=0x7f39fc0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:29.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 shutdown_connections 2023-10-08T08:41:29.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.610+0000 7f3a025da700 1 -- 172.21.15.70:0/702829845 wait complete. 2023-10-08T08:41:29.624 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T08:41:29.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:41:29.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/96119869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d80ff620 msgr2=0x7fd3d810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/96119869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d80ff620 0x7fd3d810d600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000b0d0 tx=0x7fd3d000b3e0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/96119869 shutdown_connections 2023-10-08T08:41:29.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/96119869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d80ff620 0x7fd3d810d600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/96119869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d8106720 0x7fd3d8106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/96119869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3d80fec60 0x7fd3d80ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/96119869 >> 172.21.15.70:0/96119869 conn(0x7fd3d8075c20 msgr2=0x7fd3d80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:29.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/96119869 shutdown_connections 2023-10-08T08:41:29.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/96119869 wait complete. 2023-10-08T08:41:29.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.749+0000 7fd3dd1bd700 1 Processor -- start 2023-10-08T08:41:29.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3dd1bd700 1 -- start start 2023-10-08T08:41:29.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3dd1bd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80fec60 0x7fd3d8196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:29.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3dd1bd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3d80ff620 0x7fd3d8197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:29.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3dd1bd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d8106720 0x7fd3d819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:29.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3dd1bd700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d819ab50 con 0x7fd3d8106720 2023-10-08T08:41:29.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3dd1bd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d819acc0 con 0x7fd3d80fec60 2023-10-08T08:41:29.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3dd1bd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d819ae80 con 0x7fd3d80ff620 2023-10-08T08:41:29.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d759e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d8106720 0x7fd3d819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d759e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d8106720 0x7fd3d819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48694/0 (socket says 172.21.15.70:48694) 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d759e700 1 -- 172.21.15.70:0/3832488420 learned_addr learned my addr 172.21.15.70:0/3832488420 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d659c700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3d80ff620 0x7fd3d8197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d6d9d700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80fec60 0x7fd3d8196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d759e700 1 -- 172.21.15.70:0/3832488420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3d80ff620 msgr2=0x7fd3d8197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d759e700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3d80ff620 0x7fd3d8197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d759e700 1 -- 172.21.15.70:0/3832488420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80fec60 msgr2=0x7fd3d8196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d759e700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80fec60 0x7fd3d8196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d759e700 1 -- 172.21.15.70:0/3832488420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009d00 con 0x7fd3d8106720 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.750+0000 7fd3d759e700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d8106720 0x7fd3d819a550 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000bcd0 tx=0x7fd3d000bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.751+0000 7fd3bffff700 1 -- 172.21.15.70:0/3832488420 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d000e040 con 0x7fd3d8106720 2023-10-08T08:41:29.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.751+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d819b100 con 0x7fd3d8106720 2023-10-08T08:41:29.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.751+0000 7fd3bffff700 1 -- 172.21.15.70:0/3832488420 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3d0005070 con 0x7fd3d8106720 2023-10-08T08:41:29.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.751+0000 7fd3bffff700 1 -- 172.21.15.70:0/3832488420 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d001b680 con 0x7fd3d8106720 2023-10-08T08:41:29.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.751+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d81a3ac0 con 0x7fd3d8106720 2023-10-08T08:41:29.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.752+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d8108ce0 con 0x7fd3d8106720 2023-10-08T08:41:29.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.753+0000 7fd3bffff700 1 -- 172.21.15.70:0/3832488420 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd3d0003a00 con 0x7fd3d8106720 2023-10-08T08:41:29.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.753+0000 7fd3bffff700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3c00a14d0 0x7fd3c00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:29.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.753+0000 7fd3d6d9d700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3c00a14d0 0x7fd3c00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:29.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.753+0000 7fd3bffff700 1 -- 172.21.15.70:0/3832488420 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fd3d00cd7a0 con 0x7fd3d8106720 2023-10-08T08:41:29.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.754+0000 7fd3d6d9d700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3c00a14d0 0x7fd3c00a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009bd0 tx=0x7fd3cc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:29.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.757+0000 7fd3bffff700 1 -- 172.21.15.70:0/3832488420 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd3d0097260 con 0x7fd3d8106720 2023-10-08T08:41:29.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:41:29.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: Deploying daemon mds.l on smithi191 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:29.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:29 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/702829845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:41:29.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.948+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3d8066ca0 con 0x7fd3d8106720 2023-10-08T08:41:29.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.948+0000 7fd3bffff700 1 -- 172.21.15.70:0/3832488420 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3d0003cb0 con 0x7fd3d8106720 2023-10-08T08:41:29.950 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:41:29.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3c00a14d0 msgr2=0x7fd3c00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3c00a14d0 0x7fd3c00a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009bd0 tx=0x7fd3cc009260 comp rx=0 tx=0).stop 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d8106720 msgr2=0x7fd3d819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d8106720 0x7fd3d819a550 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000bcd0 tx=0x7fd3d000bd00 comp rx=0 tx=0).stop 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 shutdown_connections 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3c00a14d0 0x7fd3c00a3990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3d8106720 0x7fd3d819a550 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80fec60 0x7fd3d8196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 --2- 172.21.15.70:0/3832488420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3d80ff620 0x7fd3d8197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.950+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 >> 172.21.15.70:0/3832488420 conn(0x7fd3d8075c20 msgr2=0x7fd3d80fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.951+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 shutdown_connections 2023-10-08T08:41:29.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:29.951+0000 7fd3dd1bd700 1 -- 172.21.15.70:0/3832488420 wait complete. 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:29.963 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: Deploying daemon mds.l on smithi191 2023-10-08T08:41:29.964 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:29.964 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:29 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/702829845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:41:29.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:30.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:30.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: Deploying daemon mds.l on smithi191 2023-10-08T08:41:30.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:30.022 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:29 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/702829845' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:41:30.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 -- 172.21.15.70:0/3685645342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00fff00 msgr2=0x7fc5d010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 --2- 172.21.15.70:0/3685645342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00fff00 0x7fc5d010c3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800b0d0 tx=0x7fc5c800b3e0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 -- 172.21.15.70:0/3685645342 shutdown_connections 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 --2- 172.21.15.70:0/3685645342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00fff00 0x7fc5d010c3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 --2- 172.21.15.70:0/3685645342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5d0105600 0x7fc5d01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 --2- 172.21.15.70:0/3685645342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5d00ff540 0x7fc5d00ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 -- 172.21.15.70:0/3685645342 >> 172.21.15.70:0/3685645342 conn(0x7fc5d00fb030 msgr2=0x7fc5d00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 -- 172.21.15.70:0/3685645342 shutdown_connections 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 -- 172.21.15.70:0/3685645342 wait complete. 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.085+0000 7fc5d780a700 1 Processor -- start 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d780a700 1 -- start start 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d780a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00ff540 0x7fc5d019c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:30.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d780a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5d00fff00 0x7fc5d019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d780a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5d0105600 0x7fc5d0196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d780a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01971d0 con 0x7fc5d00ff540 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d780a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0197340 con 0x7fc5d00fff00 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d780a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0197500 con 0x7fc5d0105600 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d55a6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00ff540 0x7fc5d019c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d55a6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00ff540 0x7fc5d019c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48702/0 (socket says 172.21.15.70:48702) 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d55a6700 1 -- 172.21.15.70:0/201199586 learned_addr learned my addr 172.21.15.70:0/201199586 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d5da7700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5d0105600 0x7fc5d0196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d4da5700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5d00fff00 0x7fc5d019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d55a6700 1 -- 172.21.15.70:0/201199586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5d0105600 msgr2=0x7fc5d0196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d55a6700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5d0105600 0x7fc5d0196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d55a6700 1 -- 172.21.15.70:0/201199586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5d00fff00 msgr2=0x7fc5d019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d55a6700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5d00fff00 0x7fc5d019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d55a6700 1 -- 172.21.15.70:0/201199586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8009d00 con 0x7fc5d00ff540 2023-10-08T08:41:30.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d55a6700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00ff540 0x7fc5d019c960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00c920 tx=0x7fc5cc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:30.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5c67fc700 1 -- 172.21.15.70:0/201199586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc004a30 con 0x7fc5d00ff540 2023-10-08T08:41:30.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d01977e0 con 0x7fc5d00ff540 2023-10-08T08:41:30.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5c67fc700 1 -- 172.21.15.70:0/201199586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5cc0054e0 con 0x7fc5d00ff540 2023-10-08T08:41:30.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5c67fc700 1 -- 172.21.15.70:0/201199586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc007c10 con 0x7fc5d00ff540 2023-10-08T08:41:30.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.086+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d01012c0 con 0x7fc5d00ff540 2023-10-08T08:41:30.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.087+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d0100c60 con 0x7fc5d00ff540 2023-10-08T08:41:30.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.088+0000 7fc5c67fc700 1 -- 172.21.15.70:0/201199586 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc5cc005000 con 0x7fc5d00ff540 2023-10-08T08:41:30.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.089+0000 7fc5c67fc700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc5bc0a14d0 0x7fc5bc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:30.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.089+0000 7fc5d4da5700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc5bc0a14d0 0x7fc5bc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:30.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.089+0000 7fc5c67fc700 1 -- 172.21.15.70:0/201199586 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc5cc0cc7f0 con 0x7fc5d00ff540 2023-10-08T08:41:30.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.089+0000 7fc5d4da5700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc5bc0a14d0 0x7fc5bc0a3990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0198170 tx=0x7fc5c0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:30.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.093+0000 7fc5c67fc700 1 -- 172.21.15.70:0/201199586 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc5cc096220 con 0x7fc5d00ff540 2023-10-08T08:41:30.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.329+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5d0067450 con 0x7fc5d00ff540 2023-10-08T08:41:30.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.330+0000 7fc5c67fc700 1 -- 172.21.15.70:0/201199586 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fc5cc01d230 con 0x7fc5d00ff540 2023-10-08T08:41:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:30.331 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.331+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc5bc0a14d0 msgr2=0x7fc5bc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.331+0000 7fc5d780a700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc5bc0a14d0 0x7fc5bc0a3990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0198170 tx=0x7fc5c0009260 comp rx=0 tx=0).stop 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00ff540 msgr2=0x7fc5d019c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00ff540 0x7fc5d019c960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00c920 tx=0x7fc5cc00cc30 comp rx=0 tx=0).stop 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 shutdown_connections 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc5bc0a14d0 0x7fc5bc0a3990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5d0105600 0x7fc5d0196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5d00ff540 0x7fc5d019c960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 --2- 172.21.15.70:0/201199586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5d00fff00 0x7fc5d019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:30.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 >> 172.21.15.70:0/201199586 conn(0x7fc5d00fb030 msgr2=0x7fc5d00fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:30.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 shutdown_connections 2023-10-08T08:41:30.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:30.332+0000 7fc5d780a700 1 -- 172.21.15.70:0/201199586 wait complete. 2023-10-08T08:41:30.334 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 1 2023-10-08T08:41:30.563 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:41:30 smithi191 systemd[1]: Starting Ceph mds.l for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:30.842 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:30 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3832488420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:41:30.842 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:30 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/201199586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:30.842 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:41:30 smithi191 podman[141849]: 2023-10-08T08:41:30.842 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:41:30 smithi191 ceph-mds[141889]: -- 172.21.15.191:0/3105495998 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d8dc4691e0 con 0x55d8dc43ec00 2023-10-08T08:41:30.842 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:41:30 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-l[141865]: starting mds.l at 2023-10-08T08:41:30.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:30 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3832488420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:41:30.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:30 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/201199586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:31.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:30 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3832488420' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:41:31.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:30 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/201199586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:31.094 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:41:30 smithi191 bash[141849]: 4ad3b79fbdd6e834c7f3d6fb2701f2c8a0817cff40161c0b3b98fae97aa3307c 2023-10-08T08:41:31.094 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:41:30 smithi191 systemd[1]: Started Ceph mds.l for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:32.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6832/2360801114,v1:172.21.15.191:6833/2360801114] up:boot 2023-10-08T08:41:32.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: fsmap 1 up:standby 2023-10-08T08:41:32.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T08:41:32.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:32.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:32.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:32.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:32.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:32.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:32.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: Deploying daemon mds.k on smithi105 2023-10-08T08:41:32.096 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:31 smithi191 ceph-mon[104220]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:32.100 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6832/2360801114,v1:172.21.15.191:6833/2360801114] up:boot 2023-10-08T08:41:32.100 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: fsmap 1 up:standby 2023-10-08T08:41:32.100 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T08:41:32.100 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:32.100 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:32.101 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:32.101 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:32.101 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:32.101 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:32.101 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: Deploying daemon mds.k on smithi105 2023-10-08T08:41:32.101 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:31 smithi105 ceph-mon[103798]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:32.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6832/2360801114,v1:172.21.15.191:6833/2360801114] up:boot 2023-10-08T08:41:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: fsmap 1 up:standby 2023-10-08T08:41:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T08:41:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:32.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:32.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:32.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: Deploying daemon mds.k on smithi105 2023-10-08T08:41:32.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:31 smithi070 ceph-mon[99513]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:32.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:32.422 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:41:32 smithi105 systemd[1]: Starting Ceph mds.k for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:32.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.479+0000 7fdbd1107700 1 -- 172.21.15.70:0/53260167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc105690 msgr2=0x7fdbcc105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:32.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.479+0000 7fdbd1107700 1 --2- 172.21.15.70:0/53260167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc105690 0x7fdbcc105a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00099c0 tx=0x7fdbc0009cd0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.479+0000 7fdbd1107700 1 -- 172.21.15.70:0/53260167 shutdown_connections 2023-10-08T08:41:32.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.479+0000 7fdbd1107700 1 --2- 172.21.15.70:0/53260167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbcc100640 0x7fdbcc10c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.479+0000 7fdbd1107700 1 --2- 172.21.15.70:0/53260167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc105690 0x7fdbcc105a70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.479+0000 7fdbd1107700 1 --2- 172.21.15.70:0/53260167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbcc0ffc80 0x7fdbcc100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.479+0000 7fdbd1107700 1 -- 172.21.15.70:0/53260167 >> 172.21.15.70:0/53260167 conn(0x7fdbcc075a90 msgr2=0x7fdbcc0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.479+0000 7fdbd1107700 1 -- 172.21.15.70:0/53260167 shutdown_connections 2023-10-08T08:41:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.479+0000 7fdbd1107700 1 -- 172.21.15.70:0/53260167 wait complete. 2023-10-08T08:41:32.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbd1107700 1 Processor -- start 2023-10-08T08:41:32.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbd1107700 1 -- start start 2023-10-08T08:41:32.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbd1107700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc0ffc80 0x7fdbcc19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:32.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbd1107700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbcc100640 0x7fdbcc19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:32.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbd1107700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbcc105690 0x7fdbcc1957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbd1107700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc195e50 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbd1107700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc195fc0 con 0x7fdbcc100640 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbd1107700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc196180 con 0x7fdbcc105690 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbcad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc0ffc80 0x7fdbcc19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbcad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc0ffc80 0x7fdbcc19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48716/0 (socket says 172.21.15.70:48716) 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbcad9d700 1 -- 172.21.15.70:0/3963714471 learned_addr learned my addr 172.21.15.70:0/3963714471 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbca59c700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbcc100640 0x7fdbcc19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbcb59e700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbcc105690 0x7fdbcc1957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbcad9d700 1 -- 172.21.15.70:0/3963714471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbcc105690 msgr2=0x7fdbcc1957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbcad9d700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbcc105690 0x7fdbcc1957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbcad9d700 1 -- 172.21.15.70:0/3963714471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbcc100640 msgr2=0x7fdbcc19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbcad9d700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbcc100640 0x7fdbcc19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.480+0000 7fdbcad9d700 1 -- 172.21.15.70:0/3963714471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc00095f0 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.481+0000 7fdbcad9d700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc0ffc80 0x7fdbcc19b660 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000b580 tx=0x7fdbc000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.481+0000 7fdbb3fff700 1 -- 172.21.15.70:0/3963714471 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc001c070 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.481+0000 7fdbb3fff700 1 -- 172.21.15.70:0/3963714471 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbc000fe30 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.481+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc196400 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.481+0000 7fdbb3fff700 1 -- 172.21.15.70:0/3963714471 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0022db0 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.481+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc1a2650 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.482+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc107b60 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.483+0000 7fdbb3fff700 1 -- 172.21.15.70:0/3963714471 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fdbc0020070 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.483+0000 7fdbb3fff700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdbb40a14d0 0x7fdbb40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.483+0000 7fdbca59c700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdbb40a14d0 0x7fdbb40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.483+0000 7fdbb3fff700 1 -- 172.21.15.70:0/3963714471 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fdbc00cdc90 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.484+0000 7fdbca59c700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdbb40a14d0 0x7fdbb40a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc196bb0 tx=0x7fdbbc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:32.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.487+0000 7fdbb3fff700 1 -- 172.21.15.70:0/3963714471 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdbc00976b0 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.722+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbcc100c90 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.723+0000 7fdbb3fff700 1 -- 172.21.15.70:0/3963714471 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7fdbc009acd0 con 0x7fdbcc0ffc80 2023-10-08T08:41:32.724 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:32.724 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T08:41:32.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdbb40a14d0 msgr2=0x7fdbb40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdbb40a14d0 0x7fdbb40a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc196bb0 tx=0x7fdbbc009260 comp rx=0 tx=0).stop 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc0ffc80 msgr2=0x7fdbcc19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc0ffc80 0x7fdbcc19b660 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000b580 tx=0x7fdbc000f690 comp rx=0 tx=0).stop 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 shutdown_connections 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdbb40a14d0 0x7fdbb40a3990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbcc105690 0x7fdbcc1957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbcc0ffc80 0x7fdbcc19b660 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 --2- 172.21.15.70:0/3963714471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbcc100640 0x7fdbcc19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.725+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 >> 172.21.15.70:0/3963714471 conn(0x7fdbcc075a90 msgr2=0x7fdbcc0fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.726+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 shutdown_connections 2023-10-08T08:41:32.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:32.726+0000 7fdbd1107700 1 -- 172.21.15.70:0/3963714471 wait complete. 2023-10-08T08:41:32.728 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 2 2023-10-08T08:41:32.956 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:41:32 smithi105 podman[141522]: 2023-10-08T08:41:33.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:32 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3963714471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:33.270 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:32 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3963714471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:33.271 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:41:32 smithi105 ceph-mds[141562]: -- 172.21.15.105:0/2464376482 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558eb9fb91e0 con 0x558eb9f8ec00 2023-10-08T08:41:33.271 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:41:32 smithi105 bash[141522]: 61a7e5c1cd15ff8acec9ddc81c8ba7c323d807e6b1d5d3f156da7ced074d2ed0 2023-10-08T08:41:33.271 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:41:32 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-k[141538]: starting mds.k at 2023-10-08T08:41:33.271 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:41:33 smithi105 systemd[1]: Started Ceph mds.k for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:33.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:32 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3963714471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: Deploying daemon mds.j on smithi070 2023-10-08T08:41:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6832/1292328490,v1:172.21.15.105:6833/1292328490] up:boot 2023-10-08T08:41:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: fsmap 2 up:standby 2023-10-08T08:41:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:34 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T08:41:34.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:34.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:34.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:34.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:34.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:34.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:34.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:34.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: Deploying daemon mds.j on smithi070 2023-10-08T08:41:34.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6832/1292328490,v1:172.21.15.105:6833/1292328490] up:boot 2023-10-08T08:41:34.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: fsmap 2 up:standby 2023-10-08T08:41:34.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:34 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T08:41:34.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:34.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:34.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: Deploying daemon mds.j on smithi070 2023-10-08T08:41:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6832/1292328490,v1:172.21.15.105:6833/1292328490] up:boot 2023-10-08T08:41:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: fsmap 2 up:standby 2023-10-08T08:41:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:34 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T08:41:34.721 INFO:journalctl@ceph.mds.j.smithi070.stdout:Oct 08 08:41:34 smithi070 systemd[1]: Starting Ceph mds.j for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:34.739 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:34.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.868+0000 7f359a7ef700 1 -- 172.21.15.70:0/1765989693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 msgr2=0x7f35940ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:34.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.868+0000 7f359a7ef700 1 --2- 172.21.15.70:0/1765989693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 0x7f35940ff9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35880099c0 tx=0x7f3588009cd0 comp rx=0 tx=0).stop 2023-10-08T08:41:34.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.869+0000 7f359a7ef700 1 -- 172.21.15.70:0/1765989693 shutdown_connections 2023-10-08T08:41:34.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.869+0000 7f359a7ef700 1 --2- 172.21.15.70:0/1765989693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35940fff00 0x7f359410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:34.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.869+0000 7f359a7ef700 1 --2- 172.21.15.70:0/1765989693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3594105600 0x7f35941059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:34.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.869+0000 7f359a7ef700 1 --2- 172.21.15.70:0/1765989693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 0x7f35940ff9c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:34.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.869+0000 7f359a7ef700 1 -- 172.21.15.70:0/1765989693 >> 172.21.15.70:0/1765989693 conn(0x7f35940fb030 msgr2=0x7f35940fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:34.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.869+0000 7f359a7ef700 1 -- 172.21.15.70:0/1765989693 shutdown_connections 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.869+0000 7f359a7ef700 1 -- 172.21.15.70:0/1765989693 wait complete. 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.869+0000 7f359a7ef700 1 Processor -- start 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.869+0000 7f359a7ef700 1 -- start start 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f359a7ef700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 0x7f3594195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f359a7ef700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35940fff00 0x7f3594195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f359a7ef700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3594105600 0x7f359419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f359a7ef700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359419a920 con 0x7f35940ff540 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f359a7ef700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359419aa90 con 0x7f35940fff00 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f359a7ef700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359419ac50 con 0x7f3594105600 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3593fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 0x7f3594195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3593fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 0x7f3594195a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48730/0 (socket says 172.21.15.70:48730) 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3593fff700 1 -- 172.21.15.70:0/3566356750 learned_addr learned my addr 172.21.15.70:0/3566356750 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f35937fe700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35940fff00 0x7f3594195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3598d8c700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3594105600 0x7f359419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3593fff700 1 -- 172.21.15.70:0/3566356750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3594105600 msgr2=0x7f359419a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3593fff700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3594105600 0x7f359419a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3593fff700 1 -- 172.21.15.70:0/3566356750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35940fff00 msgr2=0x7f3594195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3593fff700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35940fff00 0x7f3594195f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3593fff700 1 -- 172.21.15.70:0/3566356750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35880095f0 con 0x7f35940ff540 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3598d8c700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3594105600 0x7f359419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f3593fff700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 0x7f3594195a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f358400c920 tx=0x7f358400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f35917fa700 1 -- 172.21.15.70:0/3566356750 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584007b00 con 0x7f35940ff540 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359419af30 con 0x7f35940ff540 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f35917fa700 1 -- 172.21.15.70:0/3566356750 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f358400ce70 con 0x7f35940ff540 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f35917fa700 1 -- 172.21.15.70:0/3566356750 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584005460 con 0x7f35940ff540 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.870+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35941a27e0 con 0x7f35940ff540 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.871+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594107a00 con 0x7f35940ff540 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.872+0000 7f35917fa700 1 -- 172.21.15.70:0/3566356750 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3584004750 con 0x7f35940ff540 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.873+0000 7f35917fa700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a14d0 0x7f357c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.873+0000 7f35937fe700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a14d0 0x7f357c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.873+0000 7f35917fa700 1 -- 172.21.15.70:0/3566356750 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f35840cc5d0 con 0x7f35940ff540 2023-10-08T08:41:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.873+0000 7f35937fe700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a14d0 0x7f357c0a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3588009990 tx=0x7f3588005c60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:34.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:34.877+0000 7f35917fa700 1 -- 172.21.15.70:0/3566356750 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3584096000 con 0x7f35940ff540 2023-10-08T08:41:35.081 INFO:journalctl@ceph.mds.j.smithi070.stdout:Oct 08 08:41:34 smithi070 podman[158275]: 2023-10-08T08:41:35.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.128+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3594196d40 con 0x7f35940ff540 2023-10-08T08:41:35.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.129+0000 7f35917fa700 1 -- 172.21.15.70:0/3566356750 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f3584099620 con 0x7f35940ff540 2023-10-08T08:41:35.131 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:35.131 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-08T08:41:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a14d0 msgr2=0x7f357c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a14d0 0x7f357c0a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3588009990 tx=0x7f3588005c60 comp rx=0 tx=0).stop 2023-10-08T08:41:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 msgr2=0x7f3594195a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 0x7f3594195a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f358400c920 tx=0x7f358400cc30 comp rx=0 tx=0).stop 2023-10-08T08:41:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 shutdown_connections 2023-10-08T08:41:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a14d0 0x7f357c0a3990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3594105600 0x7f359419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35940ff540 0x7f3594195a40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 --2- 172.21.15.70:0/3566356750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35940fff00 0x7f3594195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 >> 172.21.15.70:0/3566356750 conn(0x7f35940fb030 msgr2=0x7f35940fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 shutdown_connections 2023-10-08T08:41:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:35.131+0000 7f359a7ef700 1 -- 172.21.15.70:0/3566356750 wait complete. 2023-10-08T08:41:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 3 2023-10-08T08:41:35.470 INFO:journalctl@ceph.mds.j.smithi070.stdout:Oct 08 08:41:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-j[158334]: starting mds.j at 2023-10-08T08:41:35.471 INFO:journalctl@ceph.mds.j.smithi070.stdout:Oct 08 08:41:35 smithi070 bash[158275]: 9d3a3005020fb96208829af8bbc8a7a2860aec1e81c3a9398f312530b3543f2d 2023-10-08T08:41:35.471 INFO:journalctl@ceph.mds.j.smithi070.stdout:Oct 08 08:41:35 smithi070 systemd[1]: Started Ceph mds.j for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:36.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:36 smithi070 ceph-mon[99513]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:36.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:36 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3566356750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:36.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:36.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:36.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:36.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:36.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:36.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:36 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:36.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:36 smithi070 ceph-mon[99513]: Deploying daemon mds.d on smithi070 2023-10-08T08:41:36.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:36 smithi191 ceph-mon[104220]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:36.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:36 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3566356750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:36.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:36.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:36.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:36.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:36.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:36.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:36 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:36.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:36 smithi191 ceph-mon[104220]: Deploying daemon mds.d on smithi070 2023-10-08T08:41:36.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:36 smithi105 ceph-mon[103798]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:36.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:36 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3566356750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:36.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:36.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:36.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:36.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:36.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:36.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:36 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:36.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:36 smithi105 ceph-mon[103798]: Deploying daemon mds.d on smithi070 2023-10-08T08:41:36.721 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:41:36 smithi070 systemd[1]: Starting Ceph mds.d for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:37.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:37.205 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:41:36 smithi070 podman[158659]: 2023-10-08T08:41:37.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:37 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.70:6834/915276133,v1:172.21.15.70:6835/915276133] up:boot 2023-10-08T08:41:37.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:37 smithi070 ceph-mon[99513]: fsmap 3 up:standby 2023-10-08T08:41:37.206 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:37 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T08:41:37.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.279+0000 7f57a435a700 1 -- 172.21.15.70:0/2827205554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c105610 msgr2=0x7f579c1059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:37.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.279+0000 7f57a435a700 1 --2- 172.21.15.70:0/2827205554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c105610 0x7f579c1059f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f57980099c0 tx=0x7f5798009cd0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.279+0000 7f57a435a700 1 -- 172.21.15.70:0/2827205554 shutdown_connections 2023-10-08T08:41:37.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.279+0000 7f57a435a700 1 --2- 172.21.15.70:0/2827205554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f579c0fff10 0x7f579c10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.279+0000 7f57a435a700 1 --2- 172.21.15.70:0/2827205554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c105610 0x7f579c1059f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.279+0000 7f57a435a700 1 --2- 172.21.15.70:0/2827205554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f579c0ff550 0x7f579c0ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.279+0000 7f57a435a700 1 -- 172.21.15.70:0/2827205554 >> 172.21.15.70:0/2827205554 conn(0x7f579c0fb060 msgr2=0x7f579c0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.279+0000 7f57a435a700 1 -- 172.21.15.70:0/2827205554 shutdown_connections 2023-10-08T08:41:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.279+0000 7f57a435a700 1 -- 172.21.15.70:0/2827205554 wait complete. 2023-10-08T08:41:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a435a700 1 Processor -- start 2023-10-08T08:41:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a435a700 1 -- start start 2023-10-08T08:41:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a435a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c0ff550 0x7f579c19e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a435a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f579c0fff10 0x7f579c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a435a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f579c105610 0x7f579c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a435a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c199120 con 0x7f579c0ff550 2023-10-08T08:41:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a435a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c199290 con 0x7f579c0fff10 2023-10-08T08:41:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a435a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c199450 con 0x7f579c105610 2023-10-08T08:41:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a20f6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c0ff550 0x7f579c19e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a20f6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c0ff550 0x7f579c19e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48766/0 (socket says 172.21.15.70:48766) 2023-10-08T08:41:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a20f6700 1 -- 172.21.15.70:0/590432269 learned_addr learned my addr 172.21.15.70:0/590432269 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a18f5700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f579c0fff10 0x7f579c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a20f6700 1 -- 172.21.15.70:0/590432269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f579c105610 msgr2=0x7f579c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a28f7700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f579c105610 0x7f579c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a20f6700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f579c105610 0x7f579c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a20f6700 1 -- 172.21.15.70:0/590432269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f579c0fff10 msgr2=0x7f579c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a20f6700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f579c0fff10 0x7f579c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a20f6700 1 -- 172.21.15.70:0/590432269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57980095f0 con 0x7f579c0ff550 2023-10-08T08:41:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a28f7700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f579c105610 0x7f579c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:41:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.280+0000 7f57a18f5700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f579c0fff10 0x7f579c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:41:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.281+0000 7f57a20f6700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c0ff550 0x7f579c19e990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f579800b580 tx=0x7f5798005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.281+0000 7f57937fe700 1 -- 172.21.15.70:0/590432269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579801d070 con 0x7f579c0ff550 2023-10-08T08:41:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.281+0000 7f57937fe700 1 -- 172.21.15.70:0/590432269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f579800fc30 con 0x7f579c0ff550 2023-10-08T08:41:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.281+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c1996d0 con 0x7f579c0ff550 2023-10-08T08:41:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.281+0000 7f57937fe700 1 -- 172.21.15.70:0/590432269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798022df0 con 0x7f579c0ff550 2023-10-08T08:41:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.281+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c1a5980 con 0x7f579c0ff550 2023-10-08T08:41:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.282+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c100c70 con 0x7f579c0ff550 2023-10-08T08:41:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.283+0000 7f57937fe700 1 -- 172.21.15.70:0/590432269 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5798022500 con 0x7f579c0ff550 2023-10-08T08:41:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.283+0000 7f57937fe700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57880a14d0 0x7f57880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.284+0000 7f57a18f5700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57880a14d0 0x7f57880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.284+0000 7f57937fe700 1 -- 172.21.15.70:0/590432269 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f57980cdcc0 con 0x7f579c0ff550 2023-10-08T08:41:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.284+0000 7f57a18f5700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57880a14d0 0x7f57880a3990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f578c005fd0 tx=0x7f578c005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.290+0000 7f57937fe700 1 -- 172.21.15.70:0/590432269 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5798097830 con 0x7f579c0ff550 2023-10-08T08:41:37.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:37 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.70:6834/915276133,v1:172.21.15.70:6835/915276133] up:boot 2023-10-08T08:41:37.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:37 smithi191 ceph-mon[104220]: fsmap 3 up:standby 2023-10-08T08:41:37.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:37 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T08:41:37.470 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:41:37 smithi070 ceph-mds[158722]: -- 172.21.15.70:0/1661505597 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eda93211e0 con 0x55eda92f6c00 2023-10-08T08:41:37.471 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:41:37 smithi070 bash[158659]: 4402fc9b64a2d64bbdbb99800b132b021b42666a65881204a13e85a3d1f7c593 2023-10-08T08:41:37.471 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:41:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-d[158675]: starting mds.d at 2023-10-08T08:41:37.471 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:41:37 smithi070 systemd[1]: Started Ceph mds.d for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:37.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:37 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.70:6834/915276133,v1:172.21.15.70:6835/915276133] up:boot 2023-10-08T08:41:37.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:37 smithi105 ceph-mon[103798]: fsmap 3 up:standby 2023-10-08T08:41:37.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:37 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T08:41:37.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.531+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f579c066bc0 con 0x7f579c0ff550 2023-10-08T08:41:37.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.532+0000 7f57937fe700 1 -- 172.21.15.70:0/590432269 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2910 (secure 0 0 0) 0x7f579809ae50 con 0x7f579c0ff550 2023-10-08T08:41:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:37.534 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-08T08:41:37.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57880a14d0 msgr2=0x7f57880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:37.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57880a14d0 0x7f57880a3990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f578c005fd0 tx=0x7f578c005ee0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c0ff550 msgr2=0x7f579c19e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:37.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c0ff550 0x7f579c19e990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f579800b580 tx=0x7f5798005e80 comp rx=0 tx=0).stop 2023-10-08T08:41:37.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 shutdown_connections 2023-10-08T08:41:37.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57880a14d0 0x7f57880a3990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f579c105610 0x7f579c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f579c0ff550 0x7f579c19e990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 --2- 172.21.15.70:0/590432269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f579c0fff10 0x7f579c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:37.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 >> 172.21.15.70:0/590432269 conn(0x7f579c0fb060 msgr2=0x7f579c068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:37.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 shutdown_connections 2023-10-08T08:41:37.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:37.534+0000 7f57a435a700 1 -- 172.21.15.70:0/590432269 wait complete. 2023-10-08T08:41:37.540 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 4 2023-10-08T08:41:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: Deploying daemon mds.e on smithi105 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/590432269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.70:6836/3566538223,v1:172.21.15.70:6837/3566538223] up:boot 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: fsmap 4 up:standby 2023-10-08T08:41:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:38 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T08:41:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: Deploying daemon mds.e on smithi105 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/590432269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.70:6836/3566538223,v1:172.21.15.70:6837/3566538223] up:boot 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: fsmap 4 up:standby 2023-10-08T08:41:38.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:38 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T08:41:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: Deploying daemon mds.e on smithi105 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/590432269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.70:6836/3566538223,v1:172.21.15.70:6837/3566538223] up:boot 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: fsmap 4 up:standby 2023-10-08T08:41:38.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:38 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T08:41:39.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:41:38 smithi105 systemd[1]: Starting Ceph mds.e for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:39.368 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:41:39 smithi105 podman[141862]: 2023-10-08T08:41:39.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:39.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 -- 172.21.15.70:0/1699524807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414101000 msgr2=0x7f141410d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:39.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 --2- 172.21.15.70:0/1699524807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414101000 0x7f141410d510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f140c00b0a0 tx=0x7f140c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 -- 172.21.15.70:0/1699524807 shutdown_connections 2023-10-08T08:41:39.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 --2- 172.21.15.70:0/1699524807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414101000 0x7f141410d510 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 --2- 172.21.15.70:0/1699524807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1414106650 0x7f1414106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 --2- 172.21.15.70:0/1699524807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1414100640 0x7f1414100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 -- 172.21.15.70:0/1699524807 >> 172.21.15.70:0/1699524807 conn(0x7f14140fc170 msgr2=0x7f14140fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:39.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 -- 172.21.15.70:0/1699524807 shutdown_connections 2023-10-08T08:41:39.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 -- 172.21.15.70:0/1699524807 wait complete. 2023-10-08T08:41:39.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.681+0000 7f141984d700 1 Processor -- start 2023-10-08T08:41:39.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141984d700 1 -- start start 2023-10-08T08:41:39.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141984d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1414100640 0x7f1414072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:39.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141984d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1414101000 0x7f1414073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:39.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141984d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414106650 0x7f1414073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:39.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141984d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141a4e10 con 0x7f1414106650 2023-10-08T08:41:39.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141984d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141a4f80 con 0x7f1414100640 2023-10-08T08:41:39.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141984d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141a5140 con 0x7f1414101000 2023-10-08T08:41:39.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14137fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414106650 0x7f1414073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:39.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14137fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414106650 0x7f1414073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48786/0 (socket says 172.21.15.70:48786) 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14127fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1414101000 0x7f1414073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14137fe700 1 -- 172.21.15.70:0/2324542406 learned_addr learned my addr 172.21.15.70:0/2324542406 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f1412ffd700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1414100640 0x7f1414072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14137fe700 1 -- 172.21.15.70:0/2324542406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1414101000 msgr2=0x7f1414073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14137fe700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1414101000 0x7f1414073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14137fe700 1 -- 172.21.15.70:0/2324542406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1414100640 msgr2=0x7f1414072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14137fe700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1414100640 0x7f1414072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14137fe700 1 -- 172.21.15.70:0/2324542406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c009d00 con 0x7f1414106650 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f14137fe700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414106650 0x7f1414073570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f140c00b070 tx=0x7f140c0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141884b700 1 -- 172.21.15.70:0/2324542406 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00e040 con 0x7f1414106650 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141884b700 1 -- 172.21.15.70:0/2324542406 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f140c0094c0 con 0x7f1414106650 2023-10-08T08:41:39.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14141a53c0 con 0x7f1414106650 2023-10-08T08:41:39.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.682+0000 7f141884b700 1 -- 172.21.15.70:0/2324542406 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c0044e0 con 0x7f1414106650 2023-10-08T08:41:39.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.683+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14141a5840 con 0x7f1414106650 2023-10-08T08:41:39.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.683+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1414108c60 con 0x7f1414106650 2023-10-08T08:41:39.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.685+0000 7f141884b700 1 -- 172.21.15.70:0/2324542406 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f140c004640 con 0x7f1414106650 2023-10-08T08:41:39.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.685+0000 7f141884b700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13fc0a14d0 0x7f13fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:39.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.685+0000 7f1412ffd700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13fc0a14d0 0x7f13fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:39.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.685+0000 7f141884b700 1 -- 172.21.15.70:0/2324542406 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f140c0cdea0 con 0x7f1414106650 2023-10-08T08:41:39.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.686+0000 7f1412ffd700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13fc0a14d0 0x7f13fc0a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1408009bd0 tx=0x7f1408009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:39.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.688+0000 7f141884b700 1 -- 172.21.15.70:0/2324542406 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f140c097960 con 0x7f1414106650 2023-10-08T08:41:39.770 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:41:39 smithi105 ceph-mds[141902]: -- 172.21.15.105:0/3798442609 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56136aa871e0 con 0x56136aa5d000 2023-10-08T08:41:39.770 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:41:39 smithi105 bash[141862]: 4b2fcf6cec29e5449cec3d8bf089997ea011a362fc40aefa8efe1e7118802127 2023-10-08T08:41:39.771 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:41:39 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[141878]: starting mds.e at 2023-10-08T08:41:39.771 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:41:39 smithi105 systemd[1]: Started Ceph mds.e for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:39.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.925+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1414074070 con 0x7f1414106650 2023-10-08T08:41:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.926+0000 7f141884b700 1 -- 172.21.15.70:0/2324542406 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3701 (secure 0 0 0) 0x7f140c09af80 con 0x7f1414106650 2023-10-08T08:41:39.927 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:39.927 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-08T08:41:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13fc0a14d0 msgr2=0x7f13fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13fc0a14d0 0x7f13fc0a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1408009bd0 tx=0x7f1408009260 comp rx=0 tx=0).stop 2023-10-08T08:41:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414106650 msgr2=0x7f1414073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414106650 0x7f1414073570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f140c00b070 tx=0x7f140c0077f0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 shutdown_connections 2023-10-08T08:41:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13fc0a14d0 0x7f13fc0a3990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1414106650 0x7f1414073570 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1414100640 0x7f1414072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 --2- 172.21.15.70:0/2324542406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1414101000 0x7f1414073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 >> 172.21.15.70:0/2324542406 conn(0x7f14140fc170 msgr2=0x7f14140fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 shutdown_connections 2023-10-08T08:41:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:39.928+0000 7f141984d700 1 -- 172.21.15.70:0/2324542406 wait complete. 2023-10-08T08:41:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2023-10-08T08:41:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2324542406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6834/2412806046,v1:172.21.15.105:6835/2412806046] up:boot 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: fsmap 5 up:standby 2023-10-08T08:41:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:41:40.725 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2324542406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6834/2412806046,v1:172.21.15.105:6835/2412806046] up:boot 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: fsmap 5 up:standby 2023-10-08T08:41:40.726 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:41:40.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2324542406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6834/2412806046,v1:172.21.15.105:6835/2412806046] up:boot 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: fsmap 5 up:standby 2023-10-08T08:41:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:41:41.095 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:41:40 smithi191 systemd[1]: Starting Ceph mds.f for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:41.506 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:41 smithi191 ceph-mon[104220]: Deploying daemon mds.f on smithi191 2023-10-08T08:41:41.507 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:41:41 smithi191 podman[142188]: 2023-10-08T08:41:41.507 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:41:41 smithi191 ceph-mds[142228]: -- 172.21.15.191:0/2104757272 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5625777bb1e0 con 0x562577791000 2023-10-08T08:41:41.507 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:41:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: starting mds.f at 2023-10-08T08:41:41.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:41 smithi070 ceph-mon[99513]: Deploying daemon mds.f on smithi191 2023-10-08T08:41:41.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:41 smithi105 ceph-mon[103798]: Deploying daemon mds.f on smithi191 2023-10-08T08:41:41.844 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:41:41 smithi191 bash[142188]: 7c2e3a480c7b81574307ff74698f38e48a4ff02aaadad71bd88900497b6a4411 2023-10-08T08:41:41.844 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:41:41 smithi191 systemd[1]: Started Ceph mds.f for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:41.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:42.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3002384996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00fff00 msgr2=0x7ff0e010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:42.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3002384996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00fff00 0x7ff0e010c3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800b0d0 tx=0x7ff0d800b3e0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3002384996 shutdown_connections 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3002384996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00fff00 0x7ff0e010c3c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3002384996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0e0105600 0x7ff0e01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3002384996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0e00ff540 0x7ff0e00ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3002384996 >> 172.21.15.70:0/3002384996 conn(0x7ff0e00fb030 msgr2=0x7ff0e00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3002384996 shutdown_connections 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3002384996 wait complete. 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 Processor -- start 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.076+0000 7ff0e70ab700 1 -- start start 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e70ab700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00ff540 0x7ff0e0195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e70ab700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0e00fff00 0x7ff0e0195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e70ab700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0e0105600 0x7ff0e01962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e70ab700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01a4fd0 con 0x7ff0e00ff540 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e70ab700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01a5140 con 0x7ff0e00fff00 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e70ab700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01a5300 con 0x7ff0e0105600 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e4e47700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00ff540 0x7ff0e0195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e4e47700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00ff540 0x7ff0e0195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48796/0 (socket says 172.21.15.70:48796) 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e4e47700 1 -- 172.21.15.70:0/3747150455 learned_addr learned my addr 172.21.15.70:0/3747150455 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e5648700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0e0105600 0x7ff0e01962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0dffff700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0e00fff00 0x7ff0e0195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e4e47700 1 -- 172.21.15.70:0/3747150455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0e0105600 msgr2=0x7ff0e01962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e4e47700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0e0105600 0x7ff0e01962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e4e47700 1 -- 172.21.15.70:0/3747150455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0e00fff00 msgr2=0x7ff0e0195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e4e47700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0e00fff00 0x7ff0e0195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e4e47700 1 -- 172.21.15.70:0/3747150455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8009d00 con 0x7ff0e00ff540 2023-10-08T08:41:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e4e47700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00ff540 0x7ff0e0195830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400e9a0 tx=0x7ff0d400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0ddffb700 1 -- 172.21.15.70:0/3747150455 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4009790 con 0x7ff0e00ff540 2023-10-08T08:41:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0ddffb700 1 -- 172.21.15.70:0/3747150455 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0d400cbd0 con 0x7ff0e00ff540 2023-10-08T08:41:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e01a55e0 con 0x7ff0e00ff540 2023-10-08T08:41:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.077+0000 7ff0ddffb700 1 -- 172.21.15.70:0/3747150455 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4018680 con 0x7ff0e00ff540 2023-10-08T08:41:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.078+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e01a5b40 con 0x7ff0e00ff540 2023-10-08T08:41:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.078+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0107aa0 con 0x7ff0e00ff540 2023-10-08T08:41:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.080+0000 7ff0ddffb700 1 -- 172.21.15.70:0/3747150455 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff0d400cd40 con 0x7ff0e00ff540 2023-10-08T08:41:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.080+0000 7ff0ddffb700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff0d00a1550 0x7ff0d00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.080+0000 7ff0dffff700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff0d00a1550 0x7ff0d00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:42.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.080+0000 7ff0ddffb700 1 -- 172.21.15.70:0/3747150455 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ff0d4014070 con 0x7ff0e00ff540 2023-10-08T08:41:42.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.080+0000 7ff0dffff700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff0d00a1550 0x7ff0d00a3a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc005950 tx=0x7ff0cc0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:42.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.083+0000 7ff0ddffb700 1 -- 172.21.15.70:0/3747150455 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff0d4096840 con 0x7ff0e00ff540 2023-10-08T08:41:42.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.323+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0e0067dd0 con 0x7ff0e00ff540 2023-10-08T08:41:42.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.323+0000 7ff0ddffb700 1 -- 172.21.15.70:0/3747150455 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4495 (secure 0 0 0) 0x7ff0d4099e60 con 0x7ff0e00ff540 2023-10-08T08:41:42.325 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:42.325 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-08T08:41:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.325+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff0d00a1550 msgr2=0x7ff0d00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.325+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff0d00a1550 0x7ff0d00a3a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc005950 tx=0x7ff0cc0058e0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.325+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00ff540 msgr2=0x7ff0e0195830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.325+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00ff540 0x7ff0e0195830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400e9a0 tx=0x7ff0d400ecb0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.326+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 shutdown_connections 2023-10-08T08:41:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.326+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff0d00a1550 0x7ff0d00a3a10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.326+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0e0105600 0x7ff0e01962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.326+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e00ff540 0x7ff0e0195830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.326+0000 7ff0e70ab700 1 --2- 172.21.15.70:0/3747150455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0e00fff00 0x7ff0e0195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:42.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.326+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 >> 172.21.15.70:0/3747150455 conn(0x7ff0e00fb030 msgr2=0x7ff0e00fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:42.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.326+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 shutdown_connections 2023-10-08T08:41:42.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:42.326+0000 7ff0e70ab700 1 -- 172.21.15.70:0/3747150455 wait complete. 2023-10-08T08:41:42.328 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2023-10-08T08:41:42.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:42 smithi191 ceph-mon[104220]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:42.559 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:42.559 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:42.559 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:42.559 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:42.559 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:42.559 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:42 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:42.559 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:42 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3747150455' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:42.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:42 smithi070 ceph-mon[99513]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:42.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:42.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:42.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:42.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:42.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:42.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:42 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:42.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:42 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3747150455' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:42.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:42 smithi105 ceph-mon[103798]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:42.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:42.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:42.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:42.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:42.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:42.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:42 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:42.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:42 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3747150455' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:43.345 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:41:43 smithi191 systemd[1]: Starting Ceph mds.c for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:43.680 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:43 smithi191 ceph-mon[104220]: Deploying daemon mds.c on smithi191 2023-10-08T08:41:43.681 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:43 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] up:boot 2023-10-08T08:41:43.681 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:43 smithi191 ceph-mon[104220]: fsmap 6 up:standby 2023-10-08T08:41:43.681 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:43 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T08:41:43.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:41:43 smithi191 podman[142535]: 2023-10-08T08:41:43.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:43 smithi070 ceph-mon[99513]: Deploying daemon mds.c on smithi191 2023-10-08T08:41:43.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:43 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] up:boot 2023-10-08T08:41:43.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:43 smithi070 ceph-mon[99513]: fsmap 6 up:standby 2023-10-08T08:41:43.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:43 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T08:41:43.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:43 smithi105 ceph-mon[103798]: Deploying daemon mds.c on smithi191 2023-10-08T08:41:43.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:43 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] up:boot 2023-10-08T08:41:43.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:43 smithi105 ceph-mon[103798]: fsmap 6 up:standby 2023-10-08T08:41:43.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:43 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T08:41:44.097 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:41:43 smithi191 ceph-mds[142575]: -- 172.21.15.191:0/4206061534 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5575651a11e0 con 0x557565177000 2023-10-08T08:41:44.110 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:41:43 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-c[142551]: starting mds.c at 2023-10-08T08:41:44.110 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:41:43 smithi191 bash[142535]: 8bd7de6160bd4633fc7ebe9123406514f7605c3b2ffa6313510bb73540579cb5 2023-10-08T08:41:44.110 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:41:43 smithi191 systemd[1]: Started Ceph mds.c for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:44.340 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:44.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.475+0000 7f9529baf700 1 -- 172.21.15.70:0/428984534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95240fff00 msgr2=0x7f952410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.475+0000 7f9529baf700 1 --2- 172.21.15.70:0/428984534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95240fff00 0x7f952410c3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f951c00b0d0 tx=0x7f951c00b3e0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.475+0000 7f9529baf700 1 -- 172.21.15.70:0/428984534 shutdown_connections 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.475+0000 7f9529baf700 1 --2- 172.21.15.70:0/428984534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95240fff00 0x7f952410c3c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.475+0000 7f9529baf700 1 --2- 172.21.15.70:0/428984534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9524105600 0x7f95241059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.475+0000 7f9529baf700 1 --2- 172.21.15.70:0/428984534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95240ff540 0x7f95240ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.475+0000 7f9529baf700 1 -- 172.21.15.70:0/428984534 >> 172.21.15.70:0/428984534 conn(0x7f95240fb030 msgr2=0x7f95240fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.475+0000 7f9529baf700 1 -- 172.21.15.70:0/428984534 shutdown_connections 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.475+0000 7f9529baf700 1 -- 172.21.15.70:0/428984534 wait complete. 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9529baf700 1 Processor -- start 2023-10-08T08:41:44.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9529baf700 1 -- start start 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9529baf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95240ff540 0x7f952419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9529baf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95240fff00 0x7f952419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9529baf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9524105600 0x7f9524196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9529baf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524197140 con 0x7f9524105600 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9529baf700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95241972b0 con 0x7f95240fff00 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9529baf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524197470 con 0x7f95240ff540 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9523fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9524105600 0x7f9524196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9523fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9524105600 0x7f9524196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48814/0 (socket says 172.21.15.70:48814) 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9523fff700 1 -- 172.21.15.70:0/2736218147 learned_addr learned my addr 172.21.15.70:0/2736218147 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9522ffd700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95240fff00 0x7f952419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f9523fff700 1 -- 172.21.15.70:0/2736218147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95240ff540 msgr2=0x7f952419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.476+0000 7f95237fe700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95240ff540 0x7f952419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9523fff700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95240ff540 0x7f952419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9523fff700 1 -- 172.21.15.70:0/2736218147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95240fff00 msgr2=0x7f952419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9523fff700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95240fff00 0x7f952419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9523fff700 1 -- 172.21.15.70:0/2736218147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c009d00 con 0x7f9524105600 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9522ffd700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95240fff00 0x7f952419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f95237fe700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95240ff540 0x7f952419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9523fff700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9524105600 0x7f9524196970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f951c00bd50 tx=0x7f951c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9520ff9700 1 -- 172.21.15.70:0/2736218147 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c00e040 con 0x7f9524105600 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95241976f0 con 0x7f9524105600 2023-10-08T08:41:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9520ff9700 1 -- 172.21.15.70:0/2736218147 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f951c01d930 con 0x7f9524105600 2023-10-08T08:41:44.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9520ff9700 1 -- 172.21.15.70:0/2736218147 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c01baf0 con 0x7f9524105600 2023-10-08T08:41:44.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.477+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95241a3850 con 0x7f9524105600 2023-10-08T08:41:44.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.478+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9524100c60 con 0x7f9524105600 2023-10-08T08:41:44.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.479+0000 7f9520ff9700 1 -- 172.21.15.70:0/2736218147 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f951c01daa0 con 0x7f9524105600 2023-10-08T08:41:44.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.479+0000 7f9520ff9700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f950c0a14d0 0x7f950c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:44.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.480+0000 7f95237fe700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f950c0a14d0 0x7f950c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:44.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.480+0000 7f9520ff9700 1 -- 172.21.15.70:0/2736218147 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f951c0ce540 con 0x7f9524105600 2023-10-08T08:41:44.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.480+0000 7f95237fe700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f950c0a14d0 0x7f950c0a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9514009be0 tx=0x7f9514009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:44.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.483+0000 7f9520ff9700 1 -- 172.21.15.70:0/2736218147 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f951c098000 con 0x7f9524105600 2023-10-08T08:41:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.716+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9524067450 con 0x7f9524105600 2023-10-08T08:41:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.717+0000 7f9520ff9700 1 -- 172.21.15.70:0/2736218147 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6083 (secure 0 0 0) 0x7f951c09b620 con 0x7f9524105600 2023-10-08T08:41:44.718 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:44.718 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24577,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-08T08:41:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f950c0a14d0 msgr2=0x7f950c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f950c0a14d0 0x7f950c0a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9514009be0 tx=0x7f9514009260 comp rx=0 tx=0).stop 2023-10-08T08:41:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9524105600 msgr2=0x7f9524196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:44.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9524105600 0x7f9524196970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f951c00bd50 tx=0x7f951c00be30 comp rx=0 tx=0).stop 2023-10-08T08:41:44.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 shutdown_connections 2023-10-08T08:41:44.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f950c0a14d0 0x7f950c0a3990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9524105600 0x7f9524196970 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95240ff540 0x7f952419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:44 smithi070 ceph-mon[99513]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:44.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:44.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:44.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:44.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:44.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:44.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:44 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:44.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 --2- 172.21.15.70:0/2736218147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95240fff00 0x7f952419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:44.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 >> 172.21.15.70:0/2736218147 conn(0x7f95240fb030 msgr2=0x7f95240fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:44.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 shutdown_connections 2023-10-08T08:41:44.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:44.719+0000 7f9529baf700 1 -- 172.21.15.70:0/2736218147 wait complete. 2023-10-08T08:41:44.727 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2023-10-08T08:41:44.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:44 smithi105 ceph-mon[103798]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:44.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:44.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:44.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:44.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:44.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:44.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:44 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:44.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:44 smithi191 ceph-mon[104220]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:44.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:44.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:44.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:44.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:44.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:44.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:44 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:45.595 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:45 smithi105 ceph-mon[103798]: Deploying daemon mds.h on smithi105 2023-10-08T08:41:45.595 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:45 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] up:boot 2023-10-08T08:41:45.595 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:45 smithi105 ceph-mon[103798]: fsmap 7 up:standby 2023-10-08T08:41:45.595 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:45 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T08:41:45.595 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:45 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2736218147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:45.596 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:41:45 smithi105 systemd[1]: Starting Ceph mds.h for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:45.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:45 smithi070 ceph-mon[99513]: Deploying daemon mds.h on smithi105 2023-10-08T08:41:45.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:45 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] up:boot 2023-10-08T08:41:45.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:45 smithi070 ceph-mon[99513]: fsmap 7 up:standby 2023-10-08T08:41:45.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:45 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T08:41:45.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:45 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2736218147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:45.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:45 smithi191 ceph-mon[104220]: Deploying daemon mds.h on smithi105 2023-10-08T08:41:45.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:45 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] up:boot 2023-10-08T08:41:45.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:45 smithi191 ceph-mon[104220]: fsmap 7 up:standby 2023-10-08T08:41:45.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:45 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T08:41:45.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:45 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2736218147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:45.901 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:41:45 smithi105 podman[142199]: 2023-10-08T08:41:46.270 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:41:45 smithi105 ceph-mds[142239]: -- 172.21.15.105:0/4225803903 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55913e7171e0 con 0x55913e6ed000 2023-10-08T08:41:46.271 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:41:45 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-h[142215]: starting mds.h at 2023-10-08T08:41:46.271 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:41:45 smithi105 bash[142199]: 04e6d38f35389e808c14a33975a7d4d5d0d3925b35887925b1662fc8da662075 2023-10-08T08:41:46.271 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:41:45 smithi105 systemd[1]: Started Ceph mds.h for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:46.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:46 smithi191 ceph-mon[104220]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:46.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:46.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:46.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:46.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:46.705 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:46.706 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:46 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:46 smithi070 ceph-mon[99513]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:46.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:46.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:46.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:46.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:46.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:46 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:46.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:46 smithi105 ceph-mon[103798]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:46.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:46.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:46.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:46.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:46.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:46.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:46 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.867+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/802203733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c4100880 msgr2=0x7fa6c4104150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.867+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/802203733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c4100880 0x7fa6c4104150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0099c0 tx=0x7fa6ac009cd0 comp rx=0 tx=0).stop 2023-10-08T08:41:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.867+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/802203733 shutdown_connections 2023-10-08T08:41:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.867+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/802203733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c4104880 0x7fa6c410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.867+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/802203733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c40ffed0 0x7fa6c41002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.867+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/802203733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c4100880 0x7fa6c4104150 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.867+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/802203733 >> 172.21.15.70:0/802203733 conn(0x7fa6c4075a60 msgr2=0x7fa6c40fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.867+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/802203733 shutdown_connections 2023-10-08T08:41:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.867+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/802203733 wait complete. 2023-10-08T08:41:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6ca0b4700 1 Processor -- start 2023-10-08T08:41:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6ca0b4700 1 -- start start 2023-10-08T08:41:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6ca0b4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffed0 0x7fa6c419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6ca0b4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c4104880 0x7fa6c419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6ca0b4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41957c0 0x7fa6c4195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6ca0b4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c41962c0 con 0x7fa6c40ffed0 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6ca0b4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c4196430 con 0x7fa6c41957c0 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6ca0b4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c41965f0 con 0x7fa6c4104880 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6c37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffed0 0x7fa6c419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6c37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffed0 0x7fa6c419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48824/0 (socket says 172.21.15.70:48824) 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6c37fe700 1 -- 172.21.15.70:0/1252992690 learned_addr learned my addr 172.21.15.70:0/1252992690 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6c3fff700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41957c0 0x7fa6c4195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.868+0000 7fa6c2ffd700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c4104880 0x7fa6c419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6c37fe700 1 -- 172.21.15.70:0/1252992690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c4104880 msgr2=0x7fa6c419bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6c37fe700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c4104880 0x7fa6c419bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6c37fe700 1 -- 172.21.15.70:0/1252992690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41957c0 msgr2=0x7fa6c4195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6c37fe700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41957c0 0x7fa6c4195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6c37fe700 1 -- 172.21.15.70:0/1252992690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac0095f0 con 0x7fa6c40ffed0 2023-10-08T08:41:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6c37fe700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffed0 0x7fa6c419b6b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400d950 tx=0x7fa6b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6c0ff9700 1 -- 172.21.15.70:0/1252992690 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400f890 con 0x7fa6c40ffed0 2023-10-08T08:41:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6c0ff9700 1 -- 172.21.15.70:0/1252992690 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6b4010460 con 0x7fa6c40ffed0 2023-10-08T08:41:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6c0ff9700 1 -- 172.21.15.70:0/1252992690 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400e610 con 0x7fa6c40ffed0 2023-10-08T08:41:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c41a2510 con 0x7fa6c40ffed0 2023-10-08T08:41:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.869+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c41a29a0 con 0x7fa6c40ffed0 2023-10-08T08:41:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.870+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c4107b70 con 0x7fa6c40ffed0 2023-10-08T08:41:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.871+0000 7fa6c0ff9700 1 -- 172.21.15.70:0/1252992690 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa6b40108d0 con 0x7fa6c40ffed0 2023-10-08T08:41:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.872+0000 7fa6c0ff9700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a14d0 0x7fa6b00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.872+0000 7fa6c2ffd700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a14d0 0x7fa6b00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.872+0000 7fa6c0ff9700 1 -- 172.21.15.70:0/1252992690 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fa6b40cc720 con 0x7fa6c40ffed0 2023-10-08T08:41:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.872+0000 7fa6c2ffd700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a14d0 0x7fa6b00a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac006010 tx=0x7fa6ac005c20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:46.876+0000 7fa6c0ff9700 1 -- 172.21.15.70:0/1252992690 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa6b4096150 con 0x7fa6c40ffed0 2023-10-08T08:41:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.112+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6c4196ca0 con 0x7fa6c40ffed0 2023-10-08T08:41:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.112+0000 7fa6c0ff9700 1 -- 172.21.15.70:0/1252992690 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6877 (secure 0 0 0) 0x7fa6b4099770 con 0x7fa6c40ffed0 2023-10-08T08:41:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:47.114 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24577,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-08T08:41:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a14d0 msgr2=0x7fa6b00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a14d0 0x7fa6b00a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac006010 tx=0x7fa6ac005c20 comp rx=0 tx=0).stop 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffed0 msgr2=0x7fa6c419b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffed0 0x7fa6c419b6b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400d950 tx=0x7fa6b400dc60 comp rx=0 tx=0).stop 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 shutdown_connections 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a14d0 0x7fa6b00a3990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41957c0 0x7fa6c4195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffed0 0x7fa6c419b6b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 --2- 172.21.15.70:0/1252992690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c4104880 0x7fa6c419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.114+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 >> 172.21.15.70:0/1252992690 conn(0x7fa6c4075a60 msgr2=0x7fa6c4102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.115+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 shutdown_connections 2023-10-08T08:41:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:47.115+0000 7fa6ca0b4700 1 -- 172.21.15.70:0/1252992690 wait complete. 2023-10-08T08:41:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 9 2023-10-08T08:41:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:47 smithi191 ceph-mon[104220]: Deploying daemon mds.i on smithi191 2023-10-08T08:41:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:47 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] up:boot 2023-10-08T08:41:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:47 smithi191 ceph-mon[104220]: fsmap 8 up:standby 2023-10-08T08:41:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:47 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T08:41:47.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:47 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1252992690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:47.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:47 smithi070 ceph-mon[99513]: Deploying daemon mds.i on smithi191 2023-10-08T08:41:47.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:47 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] up:boot 2023-10-08T08:41:47.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:47 smithi070 ceph-mon[99513]: fsmap 8 up:standby 2023-10-08T08:41:47.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:47 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T08:41:47.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:47 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1252992690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:47.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:47 smithi105 ceph-mon[103798]: Deploying daemon mds.i on smithi191 2023-10-08T08:41:47.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:47 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] up:boot 2023-10-08T08:41:47.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:47 smithi105 ceph-mon[103798]: fsmap 8 up:standby 2023-10-08T08:41:47.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:47 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T08:41:47.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:47 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1252992690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:47.845 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:41:47 smithi191 systemd[1]: Starting Ceph mds.i for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:48.177 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:41:47 smithi191 podman[142876]: 2023-10-08T08:41:48.458 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:41:48 smithi191 ceph-mds[142916]: -- 172.21.15.191:0/2624748277 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560e01a8f1e0 con 0x560e01a64c00 2023-10-08T08:41:48.458 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:41:48 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-i[142892]: starting mds.i at 2023-10-08T08:41:48.458 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:41:48 smithi191 bash[142876]: 4467f85e0385a1e33ff4b1eda6d15b4cc8d4f50bc8474c708c6c428a754c0beb 2023-10-08T08:41:48.459 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:41:48 smithi191 systemd[1]: Started Ceph mds.i for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:48 smithi070 ceph-mon[99513]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:48.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:48.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:48.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:48.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:48.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:48 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:48.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:48 smithi105 ceph-mon[103798]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:48.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:48.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:48.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:48.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:48.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:48.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:48 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:48.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:48 smithi191 ceph-mon[104220]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:48.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:48.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:48.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:48.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:48.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:48.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:48 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:49.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.268+0000 7fdfa8435700 1 -- 172.21.15.70:0/422665103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 msgr2=0x7fdfa00ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.268+0000 7fdfa8435700 1 --2- 172.21.15.70:0/422665103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 0x7fdfa00ff9c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdf900099c0 tx=0x7fdf90009cd0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.268+0000 7fdfa8435700 1 -- 172.21.15.70:0/422665103 shutdown_connections 2023-10-08T08:41:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.268+0000 7fdfa8435700 1 --2- 172.21.15.70:0/422665103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfa00fff00 0x7fdfa010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.268+0000 7fdfa8435700 1 --2- 172.21.15.70:0/422665103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfa0105600 0x7fdfa01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.268+0000 7fdfa8435700 1 --2- 172.21.15.70:0/422665103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 0x7fdfa00ff9c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.268+0000 7fdfa8435700 1 -- 172.21.15.70:0/422665103 >> 172.21.15.70:0/422665103 conn(0x7fdfa00fb030 msgr2=0x7fdfa00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.268+0000 7fdfa8435700 1 -- 172.21.15.70:0/422665103 shutdown_connections 2023-10-08T08:41:49.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.268+0000 7fdfa8435700 1 -- 172.21.15.70:0/422665103 wait complete. 2023-10-08T08:41:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa8435700 1 Processor -- start 2023-10-08T08:41:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa8435700 1 -- start start 2023-10-08T08:41:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa8435700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 0x7fdfa01011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa8435700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfa00fff00 0x7fdfa01016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa8435700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfa0105600 0x7fdfa0101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa8435700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa01a4e50 con 0x7fdfa00ff540 2023-10-08T08:41:49.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa8435700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa01a4fc0 con 0x7fdfa00fff00 2023-10-08T08:41:49.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa8435700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa01a5180 con 0x7fdfa0105600 2023-10-08T08:41:49.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa61d1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 0x7fdfa01011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:49.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa61d1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 0x7fdfa01011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48836/0 (socket says 172.21.15.70:48836) 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa61d1700 1 -- 172.21.15.70:0/1143457754 learned_addr learned my addr 172.21.15.70:0/1143457754 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa59d0700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfa00fff00 0x7fdfa01016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa69d2700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfa0105600 0x7fdfa0101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa61d1700 1 -- 172.21.15.70:0/1143457754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfa0105600 msgr2=0x7fdfa0101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa61d1700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfa0105600 0x7fdfa0101c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa61d1700 1 -- 172.21.15.70:0/1143457754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfa00fff00 msgr2=0x7fdfa01016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa61d1700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfa00fff00 0x7fdfa01016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa61d1700 1 -- 172.21.15.70:0/1143457754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf900095f0 con 0x7fdfa00ff540 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa69d2700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfa0105600 0x7fdfa0101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa59d0700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfa00fff00 0x7fdfa01016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:41:49.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa61d1700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 0x7fdfa01011b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00c920 tx=0x7fdf9c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdf977fe700 1 -- 172.21.15.70:0/1143457754 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c007b00 con 0x7fdfa00ff540 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdf977fe700 1 -- 172.21.15.70:0/1143457754 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf9c004cf0 con 0x7fdfa00ff540 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa01a5460 con 0x7fdfa00ff540 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.269+0000 7fdf977fe700 1 -- 172.21.15.70:0/1143457754 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c005610 con 0x7fdfa00ff540 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.270+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa01a5970 con 0x7fdfa00ff540 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.270+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa0100c60 con 0x7fdfa00ff540 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.271+0000 7fdf977fe700 1 -- 172.21.15.70:0/1143457754 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fdf9c004750 con 0x7fdfa00ff540 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.272+0000 7fdf977fe700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdf8c0a14d0 0x7fdf8c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.272+0000 7fdfa59d0700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdf8c0a14d0 0x7fdf8c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.272+0000 7fdf977fe700 1 -- 172.21.15.70:0/1143457754 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fdf9c0cc940 con 0x7fdfa00ff540 2023-10-08T08:41:49.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.272+0000 7fdfa59d0700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdf8c0a14d0 0x7fdf8c0a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdfa01028e0 tx=0x7fdf90005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:49.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.276+0000 7fdf977fe700 1 -- 172.21.15.70:0/1143457754 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf9c096370 con 0x7fdfa00ff540 2023-10-08T08:41:49.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.517+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfa0067450 con 0x7fdfa00ff540 2023-10-08T08:41:49.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.517+0000 7fdf977fe700 1 -- 172.21.15.70:0/1143457754 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7670 (secure 0 0 0) 0x7fdf9c099990 con 0x7fdfa00ff540 2023-10-08T08:41:49.521 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:49.522 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24577,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24604,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-08T08:41:49.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdf8c0a14d0 msgr2=0x7fdf8c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:49.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdf8c0a14d0 0x7fdf8c0a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdfa01028e0 tx=0x7fdf90005fd0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 msgr2=0x7fdfa01011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:49.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 0x7fdfa01011b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00c920 tx=0x7fdf9c00cce0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 shutdown_connections 2023-10-08T08:41:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdf8c0a14d0 0x7fdf8c0a3990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfa0105600 0x7fdfa0101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfa00ff540 0x7fdfa01011b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 --2- 172.21.15.70:0/1143457754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfa00fff00 0x7fdfa01016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 >> 172.21.15.70:0/1143457754 conn(0x7fdfa00fb030 msgr2=0x7fdfa00fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 shutdown_connections 2023-10-08T08:41:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:49.519+0000 7fdfa8435700 1 -- 172.21.15.70:0/1143457754 wait complete. 2023-10-08T08:41:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 10 2023-10-08T08:41:49.531 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:49 smithi070 ceph-mon[99513]: Deploying daemon mds.g on smithi070 2023-10-08T08:41:49.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:49 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] up:boot 2023-10-08T08:41:49.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:49 smithi070 ceph-mon[99513]: fsmap 9 up:standby 2023-10-08T08:41:49.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:49 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T08:41:49.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:49 smithi105 ceph-mon[103798]: Deploying daemon mds.g on smithi070 2023-10-08T08:41:49.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:49 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] up:boot 2023-10-08T08:41:49.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:49 smithi105 ceph-mon[103798]: fsmap 9 up:standby 2023-10-08T08:41:49.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:49 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T08:41:49.805 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:41:49 smithi070 systemd[1]: Starting Ceph mds.g for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:49.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:49 smithi191 ceph-mon[104220]: Deploying daemon mds.g on smithi070 2023-10-08T08:41:49.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:49 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] up:boot 2023-10-08T08:41:49.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:49 smithi191 ceph-mon[104220]: fsmap 9 up:standby 2023-10-08T08:41:49.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:49 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T08:41:50.393 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:41:50 smithi070 podman[159271]: 2023-10-08T08:41:50.393 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:41:50 smithi070 bash[159271]: 1f4d954e355e5f1151a36cf72880e8538264c783437037072b2f148f03bbda99 2023-10-08T08:41:50.393 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:41:50 smithi070 ceph-mds[159311]: -- 172.21.15.70:0/2767148253 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e54685d1e0 con 0x55e546832800 2023-10-08T08:41:50.394 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:41:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-g[159287]: starting mds.g at 2023-10-08T08:41:50.720 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:41:50 smithi070 systemd[1]: Started Ceph mds.g for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:50.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:50 smithi070 ceph-mon[99513]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:50.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:50 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1143457754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:50.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:50.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:50.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:50.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:50 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:50.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:50 smithi105 ceph-mon[103798]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:50.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:50 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1143457754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:50.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:50.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:50.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:50.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:50 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:50.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:50 smithi191 ceph-mon[104220]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:50 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1143457754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:50 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:51.534 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:51.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 -- 172.21.15.70:0/2170169191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40fff00 msgr2=0x7f67e410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:51.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/2170169191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40fff00 0x7f67e410c3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00b0d0 tx=0x7f67dc00b3e0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 -- 172.21.15.70:0/2170169191 shutdown_connections 2023-10-08T08:41:51.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/2170169191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40fff00 0x7f67e410c3c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/2170169191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67e4105600 0x7f67e41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/2170169191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67e40ff540 0x7f67e40ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 -- 172.21.15.70:0/2170169191 >> 172.21.15.70:0/2170169191 conn(0x7f67e40fb030 msgr2=0x7f67e40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:51.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 -- 172.21.15.70:0/2170169191 shutdown_connections 2023-10-08T08:41:51.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 -- 172.21.15.70:0/2170169191 wait complete. 2023-10-08T08:41:51.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.662+0000 7f67ec4bf700 1 Processor -- start 2023-10-08T08:41:51.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ec4bf700 1 -- start start 2023-10-08T08:41:51.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ec4bf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40ff540 0x7f67e4195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:51.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ec4bf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67e40fff00 0x7f67e4195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:51.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ec4bf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67e4105600 0x7f67e419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:51.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ec4bf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e419a910 con 0x7f67e40ff540 2023-10-08T08:41:51.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ec4bf700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e419aa80 con 0x7f67e4105600 2023-10-08T08:41:51.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ec4bf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e419ac40 con 0x7f67e40fff00 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ea25b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40ff540 0x7f67e4195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ea25b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40ff540 0x7f67e4195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48860/0 (socket says 172.21.15.70:48860) 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ea25b700 1 -- 172.21.15.70:0/3308279603 learned_addr learned my addr 172.21.15.70:0/3308279603 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67e9a5a700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67e40fff00 0x7f67e4195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67eaa5c700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67e4105600 0x7f67e419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ea25b700 1 -- 172.21.15.70:0/3308279603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67e40fff00 msgr2=0x7f67e4195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ea25b700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67e40fff00 0x7f67e4195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ea25b700 1 -- 172.21.15.70:0/3308279603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67e4105600 msgr2=0x7f67e419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ea25b700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67e4105600 0x7f67e419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ea25b700 1 -- 172.21.15.70:0/3308279603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc009d00 con 0x7f67e40ff540 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67eaa5c700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67e4105600 0x7f67e419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:41:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67e9a5a700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67e40fff00 0x7f67e4195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:41:51.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67ea25b700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40ff540 0x7f67e4195a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f67d400e9a0 tx=0x7f67d400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:51.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.663+0000 7f67db7fe700 1 -- 172.21.15.70:0/3308279603 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4009790 con 0x7f67e40ff540 2023-10-08T08:41:51.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.664+0000 7f67db7fe700 1 -- 172.21.15.70:0/3308279603 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67d400cbd0 con 0x7f67e40ff540 2023-10-08T08:41:51.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.664+0000 7f67db7fe700 1 -- 172.21.15.70:0/3308279603 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4018680 con 0x7f67e40ff540 2023-10-08T08:41:51.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.664+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e419af20 con 0x7f67e40ff540 2023-10-08T08:41:51.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.664+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e41a27d0 con 0x7f67e40ff540 2023-10-08T08:41:51.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.664+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e4107aa0 con 0x7f67e40ff540 2023-10-08T08:41:51.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.665+0000 7f67db7fe700 1 -- 172.21.15.70:0/3308279603 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f67d400cd40 con 0x7f67e40ff540 2023-10-08T08:41:51.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.666+0000 7f67db7fe700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67d00a14d0 0x7f67d00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:51.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.666+0000 7f67e9a5a700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67d00a14d0 0x7f67d00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:51.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.666+0000 7f67db7fe700 1 -- 172.21.15.70:0/3308279603 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f67d4014070 con 0x7f67e40ff540 2023-10-08T08:41:51.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.666+0000 7f67e9a5a700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67d00a14d0 0x7f67d00a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f67e4196f80 tx=0x7f67e0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:51.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.669+0000 7f67db7fe700 1 -- 172.21.15.70:0/3308279603 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f67d4096be0 con 0x7f67e40ff540 2023-10-08T08:41:51.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:51.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:51.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:51 smithi070 ceph-mon[99513]: Deploying daemon mds.a on smithi070 2023-10-08T08:41:51.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:51 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.70:6838/3288548320,v1:172.21.15.70:6839/3288548320] up:boot 2023-10-08T08:41:51.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:51 smithi070 ceph-mon[99513]: fsmap 10 up:standby 2023-10-08T08:41:51.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:51 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T08:41:51.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:51 smithi070 ceph-mon[99513]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:51.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:51.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:51.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:51 smithi105 ceph-mon[103798]: Deploying daemon mds.a on smithi070 2023-10-08T08:41:51.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:51 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.70:6838/3288548320,v1:172.21.15.70:6839/3288548320] up:boot 2023-10-08T08:41:51.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:51 smithi105 ceph-mon[103798]: fsmap 10 up:standby 2023-10-08T08:41:51.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:51 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T08:41:51.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:51 smithi105 ceph-mon[103798]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:51.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:51.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:51 smithi191 ceph-mon[104220]: Deploying daemon mds.a on smithi070 2023-10-08T08:41:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:51 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.70:6838/3288548320,v1:172.21.15.70:6839/3288548320] up:boot 2023-10-08T08:41:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:51 smithi191 ceph-mon[104220]: fsmap 10 up:standby 2023-10-08T08:41:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:51 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T08:41:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:51 smithi191 ceph-mon[104220]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:51.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.942+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67e4100c60 con 0x7f67e40ff540 2023-10-08T08:41:51.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.943+0000 7f67db7fe700 1 -- 172.21.15.70:0/3308279603 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8462 (secure 0 0 0) 0x7f67d409a200 con 0x7f67e40ff540 2023-10-08T08:41:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:51.944 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24577,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24604,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-08T08:41:51.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67d00a14d0 msgr2=0x7f67d00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:51.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67d00a14d0 0x7f67d00a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f67e4196f80 tx=0x7f67e0009260 comp rx=0 tx=0).stop 2023-10-08T08:41:51.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40ff540 msgr2=0x7f67e4195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:51.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40ff540 0x7f67e4195a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f67d400e9a0 tx=0x7f67d400ed60 comp rx=0 tx=0).stop 2023-10-08T08:41:51.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 shutdown_connections 2023-10-08T08:41:51.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67d00a14d0 0x7f67d00a3990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67e4105600 0x7f67e419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67e40ff540 0x7f67e4195a80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 --2- 172.21.15.70:0/3308279603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67e40fff00 0x7f67e4195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:51.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 >> 172.21.15.70:0/3308279603 conn(0x7f67e40fb030 msgr2=0x7f67e40fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:51.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 shutdown_connections 2023-10-08T08:41:51.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:51.945+0000 7f67ec4bf700 1 -- 172.21.15.70:0/3308279603 wait complete. 2023-10-08T08:41:51.949 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 11 2023-10-08T08:41:51.993 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:41:51 smithi070 systemd[1]: Starting Ceph mds.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:52.575 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:52 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3308279603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:52.576 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:41:52 smithi070 podman[159655]: 2023-10-08T08:41:52.576 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:41:52 smithi070 bash[159655]: 72be340a28dffa7c2e862751ae51675d101c595c97f8059faa17d61fcfca2aa6 2023-10-08T08:41:52.576 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:41:52 smithi070 ceph-mds[159695]: -- 172.21.15.70:0/3790806672 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5618684eb1e0 con 0x5618684c0800 2023-10-08T08:41:52.576 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:41:52 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-a[159671]: starting mds.a at 2023-10-08T08:41:52.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:52 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3308279603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:52 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3308279603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:52.970 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:41:52 smithi070 systemd[1]: Started Ceph mds.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: Deploying daemon mds.b on smithi105 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.70:6840/1499461306,v1:172.21.15.70:6841/1499461306] up:boot 2023-10-08T08:41:53.888 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: fsmap 11 up:standby 2023-10-08T08:41:53.889 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:53 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T08:41:53.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:53.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:53.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:53.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: Deploying daemon mds.b on smithi105 2023-10-08T08:41:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.70:6840/1499461306,v1:172.21.15.70:6841/1499461306] up:boot 2023-10-08T08:41:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: fsmap 11 up:standby 2023-10-08T08:41:53.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:53 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T08:41:54.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:54.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:54.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T08:41:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T08:41:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: Deploying daemon mds.b on smithi105 2023-10-08T08:41:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.70:6840/1499461306,v1:172.21.15.70:6841/1499461306] up:boot 2023-10-08T08:41:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: fsmap 11 up:standby 2023-10-08T08:41:54.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:53 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T08:41:54.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.100+0000 7f015cfce700 1 -- 172.21.15.70:0/1331846274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0158105600 msgr2=0x7f01581059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:54.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.100+0000 7f015cfce700 1 --2- 172.21.15.70:0/1331846274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0158105600 0x7f01581059e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f01480099c0 tx=0x7f0148009cd0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.100+0000 7f015cfce700 1 -- 172.21.15.70:0/1331846274 shutdown_connections 2023-10-08T08:41:54.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.100+0000 7f015cfce700 1 --2- 172.21.15.70:0/1331846274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01580fff00 0x7f015810c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.100+0000 7f015cfce700 1 --2- 172.21.15.70:0/1331846274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0158105600 0x7f01581059e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.100+0000 7f015cfce700 1 --2- 172.21.15.70:0/1331846274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01580ff540 0x7f01580ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.100+0000 7f015cfce700 1 -- 172.21.15.70:0/1331846274 >> 172.21.15.70:0/1331846274 conn(0x7f01580fb030 msgr2=0x7f01580fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:54.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.100+0000 7f015cfce700 1 -- 172.21.15.70:0/1331846274 shutdown_connections 2023-10-08T08:41:54.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.100+0000 7f015cfce700 1 -- 172.21.15.70:0/1331846274 wait complete. 2023-10-08T08:41:54.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.101+0000 7f015cfce700 1 Processor -- start 2023-10-08T08:41:54.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.101+0000 7f015cfce700 1 -- start start 2023-10-08T08:41:54.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.101+0000 7f015cfce700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01580ff540 0x7f0158197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:54.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.101+0000 7f015cfce700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01580fff00 0x7f0158197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.101+0000 7f015cfce700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0158105600 0x7f01581a2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f015cfce700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0158198630 con 0x7f01580fff00 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f015cfce700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01581a2e40 con 0x7f01580ff540 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f015cfce700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01581a2f80 con 0x7f0158105600 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0155d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01580fff00 0x7f0158197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0155d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01580fff00 0x7f0158197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48890/0 (socket says 172.21.15.70:48890) 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0155d9b700 1 -- 172.21.15.70:0/3679087336 learned_addr learned my addr 172.21.15.70:0/3679087336 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f015659c700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01580ff540 0x7f0158197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0156d9d700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0158105600 0x7f01581a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0155d9b700 1 -- 172.21.15.70:0/3679087336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0158105600 msgr2=0x7f01581a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0155d9b700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0158105600 0x7f01581a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0155d9b700 1 -- 172.21.15.70:0/3679087336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01580ff540 msgr2=0x7f0158197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:54.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0155d9b700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01580ff540 0x7f0158197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0155d9b700 1 -- 172.21.15.70:0/3679087336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480095f0 con 0x7f01580fff00 2023-10-08T08:41:54.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f0155d9b700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01580fff00 0x7f0158197dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f014c00d950 tx=0x7f014c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:54.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f01477fe700 1 -- 172.21.15.70:0/3679087336 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00f890 con 0x7f01580fff00 2023-10-08T08:41:54.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f01477fe700 1 -- 172.21.15.70:0/3679087336 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f014c010460 con 0x7f01580fff00 2023-10-08T08:41:54.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01581a3210 con 0x7f01580fff00 2023-10-08T08:41:54.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f01477fe700 1 -- 172.21.15.70:0/3679087336 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00e610 con 0x7f01580fff00 2023-10-08T08:41:54.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.102+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01581a3720 con 0x7f01580fff00 2023-10-08T08:41:54.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.103+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0158107a80 con 0x7f01580fff00 2023-10-08T08:41:54.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.104+0000 7f01477fe700 1 -- 172.21.15.70:0/3679087336 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f014c0108d0 con 0x7f01580fff00 2023-10-08T08:41:54.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.105+0000 7f01477fe700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01400a14d0 0x7f01400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:54.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.105+0000 7f015659c700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01400a14d0 0x7f01400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:54.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.105+0000 7f01477fe700 1 -- 172.21.15.70:0/3679087336 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f014c0cc720 con 0x7f01580fff00 2023-10-08T08:41:54.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.106+0000 7f015659c700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01400a14d0 0x7f01400a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0148009990 tx=0x7f0148003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:54.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.110+0000 7f01477fe700 1 -- 172.21.15.70:0/3679087336 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f014c096150 con 0x7f01580fff00 2023-10-08T08:41:54.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.344+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0158100c60 con 0x7f01580fff00 2023-10-08T08:41:54.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.345+0000 7f01477fe700 1 -- 172.21.15.70:0/3679087336 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9254 (secure 0 0 0) 0x7f014c099770 con 0x7f01580fff00 2023-10-08T08:41:54.346 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:54.346 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24577,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24604,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-08T08:41:54.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01400a14d0 msgr2=0x7f01400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:54.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01400a14d0 0x7f01400a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0148009990 tx=0x7f0148003680 comp rx=0 tx=0).stop 2023-10-08T08:41:54.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01580fff00 msgr2=0x7f0158197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:54.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01580fff00 0x7f0158197dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f014c00d950 tx=0x7f014c00dc60 comp rx=0 tx=0).stop 2023-10-08T08:41:54.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 shutdown_connections 2023-10-08T08:41:54.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01400a14d0 0x7f01400a3990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0158105600 0x7f01581a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01580ff540 0x7f0158197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 --2- 172.21.15.70:0/3679087336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01580fff00 0x7f0158197dc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:54.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 >> 172.21.15.70:0/3679087336 conn(0x7f01580fb030 msgr2=0x7f01580fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:54.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 shutdown_connections 2023-10-08T08:41:54.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:54.347+0000 7f015cfce700 1 -- 172.21.15.70:0/3679087336 wait complete. 2023-10-08T08:41:54.351 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 12 2023-10-08T08:41:54.493 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:41:54 smithi105 systemd[1]: Starting Ceph mds.b for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:41:54.757 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:41:54 smithi105 podman[142541]: 2023-10-08T08:41:55.020 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:41:54 smithi105 ceph-mds[142581]: -- 172.21.15.105:0/1596027356 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d2faea11e0 con 0x55d2fae76c00 2023-10-08T08:41:55.020 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:41:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: starting mds.b at 2023-10-08T08:41:55.021 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:41:54 smithi105 bash[142541]: b170da3262a983a7bd4b6d47e1d771e8f417861ee7db2facd494f9b3b00c9b15 2023-10-08T08:41:55.021 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:41:54 smithi105 systemd[1]: Started Ceph mds.b for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:41:55.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:55 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3679087336' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:55.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:55 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:55.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:55 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3679087336' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:55 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:55.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:55 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3679087336' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:55.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:55 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:56.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:56 smithi191 ceph-mon[104220]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:56.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:56 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] up:boot 2023-10-08T08:41:56.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:56 smithi191 ceph-mon[104220]: fsmap 12 up:standby 2023-10-08T08:41:56.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:56 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T08:41:56.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:41:56.387 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:56 smithi070 ceph-mon[99513]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:56.387 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:56 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] up:boot 2023-10-08T08:41:56.387 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:56 smithi070 ceph-mon[99513]: fsmap 12 up:standby 2023-10-08T08:41:56.387 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:56 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T08:41:56.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.489+0000 7f43c1d5c700 1 -- 172.21.15.70:0/3004172326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc105620 msgr2=0x7f43bc105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.489+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/3004172326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc105620 0x7f43bc105a00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0099c0 tx=0x7f43ac009cd0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.489+0000 7f43c1d5c700 1 -- 172.21.15.70:0/3004172326 shutdown_connections 2023-10-08T08:41:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.489+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/3004172326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43bc0fff20 0x7f43bc10c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.489+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/3004172326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc105620 0x7f43bc105a00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.489+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/3004172326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43bc0ff560 0x7f43bc0ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.489+0000 7f43c1d5c700 1 -- 172.21.15.70:0/3004172326 >> 172.21.15.70:0/3004172326 conn(0x7f43bc0fb070 msgr2=0x7f43bc0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.489+0000 7f43c1d5c700 1 -- 172.21.15.70:0/3004172326 shutdown_connections 2023-10-08T08:41:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.489+0000 7f43c1d5c700 1 -- 172.21.15.70:0/3004172326 wait complete. 2023-10-08T08:41:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43c1d5c700 1 Processor -- start 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43c1d5c700 1 -- start start 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43c1d5c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc0ff560 0x7f43bc195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43c1d5c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43bc0fff20 0x7f43bc195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43c1d5c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43bc105620 0x7f43bc196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43c1d5c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc1a4ea0 con 0x7f43bc0ff560 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43c1d5c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc1a5010 con 0x7f43bc0fff20 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43c1d5c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc1a51d0 con 0x7f43bc105620 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc0ff560 0x7f43bc195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc0ff560 0x7f43bc195700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48896/0 (socket says 172.21.15.70:48896) 2023-10-08T08:41:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bb7fe700 1 -- 172.21.15.70:0/631813543 learned_addr learned my addr 172.21.15.70:0/631813543 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43baffd700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43bc0fff20 0x7f43bc195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bb7fe700 1 -- 172.21.15.70:0/631813543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43bc105620 msgr2=0x7f43bc196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bbfff700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43bc105620 0x7f43bc196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bb7fe700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43bc105620 0x7f43bc196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bb7fe700 1 -- 172.21.15.70:0/631813543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43bc0fff20 msgr2=0x7f43bc195c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bb7fe700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43bc0fff20 0x7f43bc195c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bb7fe700 1 -- 172.21.15.70:0/631813543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac0095f0 con 0x7f43bc0ff560 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43baffd700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43bc0fff20 0x7f43bc195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.490+0000 7f43bbfff700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43bc105620 0x7f43bc196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.491+0000 7f43bb7fe700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc0ff560 0x7f43bc195700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009990 tx=0x7f43ac005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.491+0000 7f43b8ff9700 1 -- 172.21.15.70:0/631813543 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac01d070 con 0x7f43bc0ff560 2023-10-08T08:41:56.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.491+0000 7f43b8ff9700 1 -- 172.21.15.70:0/631813543 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43ac004ca0 con 0x7f43bc0ff560 2023-10-08T08:41:56.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.491+0000 7f43b8ff9700 1 -- 172.21.15.70:0/631813543 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00f9d0 con 0x7f43bc0ff560 2023-10-08T08:41:56.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.491+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc1a5450 con 0x7f43bc0ff560 2023-10-08T08:41:56.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.491+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc1a57c0 con 0x7f43bc0ff560 2023-10-08T08:41:56.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.492+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc107aa0 con 0x7f43bc0ff560 2023-10-08T08:41:56.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.493+0000 7f43b8ff9700 1 -- 172.21.15.70:0/631813543 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f43ac0047e0 con 0x7f43bc0ff560 2023-10-08T08:41:56.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.494+0000 7f43b8ff9700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43a40a1550 0x7f43a40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:56.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.494+0000 7f43baffd700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43a40a1550 0x7f43a40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:56.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.494+0000 7f43b8ff9700 1 -- 172.21.15.70:0/631813543 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f43ac0cd590 con 0x7f43bc0ff560 2023-10-08T08:41:56.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.494+0000 7f43baffd700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43a40a1550 0x7f43a40a3a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f43b0005950 tx=0x7f43b00058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:56.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.499+0000 7f43b8ff9700 1 -- 172.21.15.70:0/631813543 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f43ac097050 con 0x7f43bc0ff560 2023-10-08T08:41:56.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:56 smithi105 ceph-mon[103798]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:56.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:56 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] up:boot 2023-10-08T08:41:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:56 smithi105 ceph-mon[103798]: fsmap 12 up:standby 2023-10-08T08:41:56.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:56 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T08:41:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.749+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43bc068fd0 con 0x7f43bc0ff560 2023-10-08T08:41:56.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.750+0000 7f43b8ff9700 1 -- 172.21.15.70:0/631813543 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10046 (secure 0 0 0) 0x7f43ac09a670 con 0x7f43bc0ff560 2023-10-08T08:41:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:56.751 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24577,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24604,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-08T08:41:56.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43a40a1550 msgr2=0x7f43a40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:56.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43a40a1550 0x7f43a40a3a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f43b0005950 tx=0x7f43b00058e0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc0ff560 msgr2=0x7f43bc195700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:56.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc0ff560 0x7f43bc195700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009990 tx=0x7f43ac005e80 comp rx=0 tx=0).stop 2023-10-08T08:41:56.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 shutdown_connections 2023-10-08T08:41:56.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43a40a1550 0x7f43a40a3a10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43bc105620 0x7f43bc196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43bc0ff560 0x7f43bc195700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 --2- 172.21.15.70:0/631813543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43bc0fff20 0x7f43bc195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.752+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 >> 172.21.15.70:0/631813543 conn(0x7f43bc0fb070 msgr2=0x7f43bc0fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:56.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.753+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 shutdown_connections 2023-10-08T08:41:56.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.753+0000 7f43c1d5c700 1 -- 172.21.15.70:0/631813543 wait complete. 2023-10-08T08:41:56.755 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 13 2023-10-08T08:41:56.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:41:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.932+0000 7f17fa4bf700 1 -- 172.21.15.70:0/688624206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4100620 msgr2=0x7f17f410c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.932+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/688624206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4100620 0x7f17f410c610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00b0a0 tx=0x7f17ec00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.932+0000 7f17fa4bf700 1 -- 172.21.15.70:0/688624206 shutdown_connections 2023-10-08T08:41:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.932+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/688624206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f4100620 0x7f17f410c610 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.932+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/688624206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17f41057e0 0x7f17f4105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.932+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/688624206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17f40ffc60 0x7f17f41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.932+0000 7f17fa4bf700 1 -- 172.21.15.70:0/688624206 >> 172.21.15.70:0/688624206 conn(0x7f17f4075a90 msgr2=0x7f17f40fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.932+0000 7f17fa4bf700 1 -- 172.21.15.70:0/688624206 shutdown_connections 2023-10-08T08:41:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.932+0000 7f17fa4bf700 1 -- 172.21.15.70:0/688624206 wait complete. 2023-10-08T08:41:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17fa4bf700 1 Processor -- start 2023-10-08T08:41:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17fa4bf700 1 -- start start 2023-10-08T08:41:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17fa4bf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17f40ffc60 0x7f17f4197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17fa4bf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17f4100620 0x7f17f4197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:56.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17fa4bf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f41057e0 0x7f17f41a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:56.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17fa4bf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41987b0 con 0x7f17f41057e0 2023-10-08T08:41:56.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17fa4bf700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41a3000 con 0x7f17f40ffc60 2023-10-08T08:41:56.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17fa4bf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41a3140 con 0x7f17f4100620 2023-10-08T08:41:56.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17f8a5c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f41057e0 0x7f17f41a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:56.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17f8a5c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f41057e0 0x7f17f41a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48914/0 (socket says 172.21.15.70:48914) 2023-10-08T08:41:56.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17f8a5c700 1 -- 172.21.15.70:0/1052000092 learned_addr learned my addr 172.21.15.70:0/1052000092 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:56.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17f3fff700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17f40ffc60 0x7f17f4197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:56.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.933+0000 7f17f37fe700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17f4100620 0x7f17f4197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:56.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f8a5c700 1 -- 172.21.15.70:0/1052000092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17f4100620 msgr2=0x7f17f4197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:56.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f8a5c700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17f4100620 0x7f17f4197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f8a5c700 1 -- 172.21.15.70:0/1052000092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17f40ffc60 msgr2=0x7f17f4197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:56.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f8a5c700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17f40ffc60 0x7f17f4197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:56.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f8a5c700 1 -- 172.21.15.70:0/1052000092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec009d00 con 0x7f17f41057e0 2023-10-08T08:41:56.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f37fe700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17f4100620 0x7f17f4197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:41:56.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f8a5c700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f41057e0 0x7f17f41a2ac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00b070 tx=0x7f17ec007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:56.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f17fa700 1 -- 172.21.15.70:0/1052000092 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00e040 con 0x7f17f41057e0 2023-10-08T08:41:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f41a3340 con 0x7f17f41057e0 2023-10-08T08:41:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f17fa700 1 -- 172.21.15.70:0/1052000092 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17ec004e60 con 0x7f17f41057e0 2023-10-08T08:41:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17f17fa700 1 -- 172.21.15.70:0/1052000092 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec005280 con 0x7f17f41057e0 2023-10-08T08:41:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.934+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f41a37c0 con 0x7f17f41057e0 2023-10-08T08:41:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.935+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f4107d60 con 0x7f17f41057e0 2023-10-08T08:41:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.936+0000 7f17f17fa700 1 -- 172.21.15.70:0/1052000092 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f17ec0054a0 con 0x7f17f41057e0 2023-10-08T08:41:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.936+0000 7f17f17fa700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17dc0a14d0 0x7f17dc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.937+0000 7f17f17fa700 1 -- 172.21.15.70:0/1052000092 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f17ec0cdfd0 con 0x7f17f41057e0 2023-10-08T08:41:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.937+0000 7f17f3fff700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17dc0a14d0 0x7f17dc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.937+0000 7f17f3fff700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17dc0a14d0 0x7f17dc0a3990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17f4067220 tx=0x7f17e400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:56.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:56.941+0000 7f17f17fa700 1 -- 172.21.15.70:0/1052000092 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f17ec097a90 con 0x7f17f41057e0 2023-10-08T08:41:57.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.142+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17f4100f10 con 0x7f17f41057e0 2023-10-08T08:41:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.143+0000 7f17f17fa700 1 -- 172.21.15.70:0/1052000092 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18739 (secure 0 0 0) 0x7f17ec09b0b0 con 0x7f17f41057e0 2023-10-08T08:41:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:57.145 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":78,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:41:20.696287+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:41:57.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17dc0a14d0 msgr2=0x7f17dc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17dc0a14d0 0x7f17dc0a3990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17f4067220 tx=0x7f17e400b410 comp rx=0 tx=0).stop 2023-10-08T08:41:57.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f41057e0 msgr2=0x7f17f41a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f41057e0 0x7f17f41a2ac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00b070 tx=0x7f17ec007870 comp rx=0 tx=0).stop 2023-10-08T08:41:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 shutdown_connections 2023-10-08T08:41:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17dc0a14d0 0x7f17dc0a3990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17f41057e0 0x7f17f41a2ac0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17f40ffc60 0x7f17f4197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 --2- 172.21.15.70:0/1052000092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17f4100620 0x7f17f4197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 >> 172.21.15.70:0/1052000092 conn(0x7f17f4075a90 msgr2=0x7f17f40fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 shutdown_connections 2023-10-08T08:41:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.145+0000 7f17fa4bf700 1 -- 172.21.15.70:0/1052000092 wait complete. 2023-10-08T08:41:57.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T08:41:57.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:41:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 -- 172.21.15.70:0/1893666224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c100740 msgr2=0x7f162c100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 --2- 172.21.15.70:0/1893666224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c100740 0x7f162c100bc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f161c009990 tx=0x7f161c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 -- 172.21.15.70:0/1893666224 shutdown_connections 2023-10-08T08:41:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 --2- 172.21.15.70:0/1893666224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f162c101100 0x7f162c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 --2- 172.21.15.70:0/1893666224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c106750 0x7f162c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 --2- 172.21.15.70:0/1893666224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c100740 0x7f162c100bc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 -- 172.21.15.70:0/1893666224 >> 172.21.15.70:0/1893666224 conn(0x7f162c0fc230 msgr2=0x7f162c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 -- 172.21.15.70:0/1893666224 shutdown_connections 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 -- 172.21.15.70:0/1893666224 wait complete. 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 Processor -- start 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.291+0000 7f1631e86700 1 -- start start 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1631e86700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c100740 0x7f162c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1631e86700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f162c101100 0x7f162c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1631e86700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c106750 0x7f162c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1631e86700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1a4f00 con 0x7f162c106750 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1631e86700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1a5070 con 0x7f162c101100 2023-10-08T08:41:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1631e86700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1a5230 con 0x7f162c100740 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c106750 0x7f162c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c106750 0x7f162c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48928/0 (socket says 172.21.15.70:48928) 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162bfff700 1 -- 172.21.15.70:0/3874406939 learned_addr learned my addr 172.21.15.70:0/3874406939 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162b7fe700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c100740 0x7f162c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162affd700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f162c101100 0x7f162c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162bfff700 1 -- 172.21.15.70:0/3874406939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c100740 msgr2=0x7f162c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162bfff700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c100740 0x7f162c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162bfff700 1 -- 172.21.15.70:0/3874406939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f162c101100 msgr2=0x7f162c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162bfff700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f162c101100 0x7f162c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162bfff700 1 -- 172.21.15.70:0/3874406939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0095f0 con 0x7f162c106750 2023-10-08T08:41:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f162bfff700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c106750 0x7f162c073570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1624007ee0 tx=0x7f162400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1628ff9700 1 -- 172.21.15.70:0/3874406939 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624017070 con 0x7f162c106750 2023-10-08T08:41:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1628ff9700 1 -- 172.21.15.70:0/3874406939 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f162400f040 con 0x7f162c106750 2023-10-08T08:41:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c1a5510 con 0x7f162c106750 2023-10-08T08:41:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1628ff9700 1 -- 172.21.15.70:0/3874406939 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624005580 con 0x7f162c106750 2023-10-08T08:41:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.292+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c1a59f0 con 0x7f162c106750 2023-10-08T08:41:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.293+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c108cd0 con 0x7f162c106750 2023-10-08T08:41:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.294+0000 7f1628ff9700 1 -- 172.21.15.70:0/3874406939 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f162400db20 con 0x7f162c106750 2023-10-08T08:41:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.295+0000 7f1628ff9700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16140a14d0 0x7f16140a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.295+0000 7f162b7fe700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16140a14d0 0x7f16140a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.295+0000 7f1628ff9700 1 -- 172.21.15.70:0/3874406939 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f16240cc750 con 0x7f162c106750 2023-10-08T08:41:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.295+0000 7f162b7fe700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16140a14d0 0x7f16140a3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1620005950 tx=0x7f162000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:57.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.299+0000 7f1628ff9700 1 -- 172.21.15.70:0/3874406939 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1624096180 con 0x7f162c106750 2023-10-08T08:41:57.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:57 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/631813543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:57.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:57 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/631813543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.503+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f162c067560 con 0x7f162c106750 2023-10-08T08:41:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.503+0000 7f1628ff9700 1 -- 172.21.15.70:0/3874406939 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16240997a0 con 0x7f162c106750 2023-10-08T08:41:57.505 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:41:57.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16140a14d0 msgr2=0x7f16140a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16140a14d0 0x7f16140a3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1620005950 tx=0x7f162000b410 comp rx=0 tx=0).stop 2023-10-08T08:41:57.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c106750 msgr2=0x7f162c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c106750 0x7f162c073570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1624007ee0 tx=0x7f162400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 shutdown_connections 2023-10-08T08:41:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16140a14d0 0x7f16140a3990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162c106750 0x7f162c073570 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162c100740 0x7f162c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 --2- 172.21.15.70:0/3874406939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f162c101100 0x7f162c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 >> 172.21.15.70:0/3874406939 conn(0x7f162c0fc230 msgr2=0x7f162c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 shutdown_connections 2023-10-08T08:41:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.505+0000 7f1631e86700 1 -- 172.21.15.70:0/3874406939 wait complete. 2023-10-08T08:41:57.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:57 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/631813543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:41:57.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T08:41:57.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.652+0000 7f49f12eb700 1 -- 172.21.15.70:0/800282933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100ff0 msgr2=0x7f49ec10d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.652+0000 7f49f12eb700 1 --2- 172.21.15.70:0/800282933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100ff0 0x7f49ec10d500 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f49e400b0a0 tx=0x7f49e400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.652+0000 7f49f12eb700 1 -- 172.21.15.70:0/800282933 shutdown_connections 2023-10-08T08:41:57.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.652+0000 7f49f12eb700 1 --2- 172.21.15.70:0/800282933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100ff0 0x7f49ec10d500 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.652+0000 7f49f12eb700 1 --2- 172.21.15.70:0/800282933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49ec106640 0x7f49ec106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.652+0000 7f49f12eb700 1 --2- 172.21.15.70:0/800282933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49ec100630 0x7f49ec100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.652+0000 7f49f12eb700 1 -- 172.21.15.70:0/800282933 >> 172.21.15.70:0/800282933 conn(0x7f49ec0fc1a0 msgr2=0x7f49ec0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:57.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.652+0000 7f49f12eb700 1 -- 172.21.15.70:0/800282933 shutdown_connections 2023-10-08T08:41:57.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.652+0000 7f49f12eb700 1 -- 172.21.15.70:0/800282933 wait complete. 2023-10-08T08:41:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49f12eb700 1 Processor -- start 2023-10-08T08:41:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49f12eb700 1 -- start start 2023-10-08T08:41:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49f12eb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100630 0x7f49ec19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49f12eb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49ec100ff0 0x7f49ec19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49f12eb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49ec106640 0x7f49ec196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49f12eb700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec196ef0 con 0x7f49ec100630 2023-10-08T08:41:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49f12eb700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec197060 con 0x7f49ec106640 2023-10-08T08:41:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49f12eb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec197220 con 0x7f49ec100ff0 2023-10-08T08:41:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49eaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100630 0x7f49ec19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49eaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100630 0x7f49ec19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48938/0 (socket says 172.21.15.70:48938) 2023-10-08T08:41:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.653+0000 7f49eaffd700 1 -- 172.21.15.70:0/48504725 learned_addr learned my addr 172.21.15.70:0/48504725 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49ea7fc700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49ec100ff0 0x7f49ec19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49eb7fe700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49ec106640 0x7f49ec196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49eaffd700 1 -- 172.21.15.70:0/48504725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49ec100ff0 msgr2=0x7f49ec19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49eaffd700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49ec100ff0 0x7f49ec19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49eaffd700 1 -- 172.21.15.70:0/48504725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49ec106640 msgr2=0x7f49ec196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49eaffd700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49ec106640 0x7f49ec196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49eaffd700 1 -- 172.21.15.70:0/48504725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4009d00 con 0x7f49ec100630 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49eb7fe700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49ec106640 0x7f49ec196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49eaffd700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100630 0x7f49ec19c680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00d950 tx=0x7f49dc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49d3fff700 1 -- 172.21.15.70:0/48504725 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc009940 con 0x7f49ec100630 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec197500 con 0x7f49ec100630 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49d3fff700 1 -- 172.21.15.70:0/48504725 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49dc010460 con 0x7f49ec100630 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49d3fff700 1 -- 172.21.15.70:0/48504725 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc00f620 con 0x7f49ec100630 2023-10-08T08:41:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.654+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec1a36b0 con 0x7f49ec100630 2023-10-08T08:41:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.655+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec108c50 con 0x7f49ec100630 2023-10-08T08:41:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.656+0000 7f49d3fff700 1 -- 172.21.15.70:0/48504725 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f49dc0108d0 con 0x7f49ec100630 2023-10-08T08:41:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.657+0000 7f49d3fff700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49d40a14d0 0x7f49d40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.657+0000 7f49ea7fc700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49d40a14d0 0x7f49d40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.657+0000 7f49d3fff700 1 -- 172.21.15.70:0/48504725 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f49dc0cc820 con 0x7f49ec100630 2023-10-08T08:41:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.657+0000 7f49ea7fc700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49d40a14d0 0x7f49d40a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0fe810 tx=0x7f49e0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.660+0000 7f49d3fff700 1 -- 172.21.15.70:0/48504725 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f49dc0961b0 con 0x7f49ec100630 2023-10-08T08:41:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.872+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f49ec197d20 con 0x7f49ec100630 2023-10-08T08:41:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.873+0000 7f49d3fff700 1 -- 172.21.15.70:0/48504725 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+65 (secure 0 0 0) 0x7f49dc0997d0 con 0x7f49ec100630 2023-10-08T08:41:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:41:57.875 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-10-08T08:41:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:41:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2023-10-08T08:41:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2023-10-08T08:41:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:41:57.876 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-10-08T08:41:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49d40a14d0 msgr2=0x7f49d40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49d40a14d0 0x7f49d40a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0fe810 tx=0x7f49e0009260 comp rx=0 tx=0).stop 2023-10-08T08:41:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100630 msgr2=0x7f49ec19c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100630 0x7f49ec19c680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00d950 tx=0x7f49dc00dc60 comp rx=0 tx=0).stop 2023-10-08T08:41:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 shutdown_connections 2023-10-08T08:41:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49d40a14d0 0x7f49d40a3990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49ec106640 0x7f49ec196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49ec100630 0x7f49ec19c680 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 --2- 172.21.15.70:0/48504725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49ec100ff0 0x7f49ec19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 >> 172.21.15.70:0/48504725 conn(0x7f49ec0fc1a0 msgr2=0x7f49ec0fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 shutdown_connections 2023-10-08T08:41:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:57.875+0000 7f49f12eb700 1 -- 172.21.15.70:0/48504725 wait complete. 2023-10-08T08:41:57.889 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T08:41:57.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T08:41:58.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.016+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3842015791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b00ffa70 msgr2=0x7f83b010bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:58.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.016+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3842015791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b00ffa70 0x7f83b010bc80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b0d0 tx=0x7f83a800b3e0 comp rx=0 tx=0).stop 2023-10-08T08:41:58.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.017+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3842015791 shutdown_connections 2023-10-08T08:41:58.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.017+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3842015791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b00ffa70 0x7f83b010bc80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.017+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3842015791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83b0103df0 0x7f83b01041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.017+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3842015791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b00ff0b0 0x7f83b00ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.017+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3842015791 >> 172.21.15.70:0/3842015791 conn(0x7f83b0074940 msgr2=0x7f83b0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.017+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3842015791 shutdown_connections 2023-10-08T08:41:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.017+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3842015791 wait complete. 2023-10-08T08:41:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.017+0000 7f83b5b4e700 1 Processor -- start 2023-10-08T08:41:58.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83b5b4e700 1 -- start start 2023-10-08T08:41:58.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83b5b4e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b00ff0b0 0x7f83b019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:58.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83b5b4e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83b00ffa70 0x7f83b019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:58.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83b5b4e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b0103df0 0x7f83b0194950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:58.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83b5b4e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0195120 con 0x7f83b0103df0 2023-10-08T08:41:58.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83b5b4e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0195290 con 0x7f83b00ff0b0 2023-10-08T08:41:58.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83b5b4e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0195450 con 0x7f83b00ffa70 2023-10-08T08:41:58.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83affff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b0103df0 0x7f83b0194950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:58.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83affff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b0103df0 0x7f83b0194950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48956/0 (socket says 172.21.15.70:48956) 2023-10-08T08:41:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83affff700 1 -- 172.21.15.70:0/3370897728 learned_addr learned my addr 172.21.15.70:0/3370897728 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83af7fe700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b00ff0b0 0x7f83b019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83aeffd700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83b00ffa70 0x7f83b019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83affff700 1 -- 172.21.15.70:0/3370897728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83b00ffa70 msgr2=0x7f83b019adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83affff700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83b00ffa70 0x7f83b019adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83affff700 1 -- 172.21.15.70:0/3370897728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b00ff0b0 msgr2=0x7f83b019a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83affff700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b00ff0b0 0x7f83b019a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83affff700 1 -- 172.21.15.70:0/3370897728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8009d00 con 0x7f83b0103df0 2023-10-08T08:41:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.018+0000 7f83af7fe700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b00ff0b0 0x7f83b019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:41:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.019+0000 7f83affff700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b0103df0 0x7f83b0194950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f83a800d010 tx=0x7f83a80094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.019+0000 7f83acff9700 1 -- 172.21.15.70:0/3370897728 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800e040 con 0x7f83b0103df0 2023-10-08T08:41:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.019+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b01956d0 con 0x7f83b0103df0 2023-10-08T08:41:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.019+0000 7f83acff9700 1 -- 172.21.15.70:0/3370897728 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83a8007950 con 0x7f83b0103df0 2023-10-08T08:41:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.019+0000 7f83acff9700 1 -- 172.21.15.70:0/3370897728 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a801b6d0 con 0x7f83b0103df0 2023-10-08T08:41:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.019+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b01a1830 con 0x7f83b0103df0 2023-10-08T08:41:58.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.020+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b01073b0 con 0x7f83b0103df0 2023-10-08T08:41:58.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.021+0000 7f83acff9700 1 -- 172.21.15.70:0/3370897728 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f83a8005090 con 0x7f83b0103df0 2023-10-08T08:41:58.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.021+0000 7f83acff9700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83980a14d0 0x7f83980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:58.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.022+0000 7f83acff9700 1 -- 172.21.15.70:0/3370897728 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f83a80ce3c0 con 0x7f83b0103df0 2023-10-08T08:41:58.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.022+0000 7f83af7fe700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83980a14d0 0x7f83980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:58.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.022+0000 7f83af7fe700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83980a14d0 0x7f83980a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f83b0077170 tx=0x7f83a000b5f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:58.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.025+0000 7f83acff9700 1 -- 172.21.15.70:0/3370897728 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f83a8097e80 con 0x7f83b0103df0 2023-10-08T08:41:58.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:58.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1052000092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:41:58.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3874406939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:41:58.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:58 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/48504725' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T08:41:58.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:58.235+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f83b0100520 con 0x7f83b0103df0 2023-10-08T08:41:58.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1052000092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:41:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3874406939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:41:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:58 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/48504725' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T08:41:58.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:41:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1052000092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:41:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3874406939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:41:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:58.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:58 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/48504725' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T08:41:59.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.091+0000 7f83acff9700 1 -- 172.21.15.70:0/3370897728 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7f83a809b4a0 con 0x7f83b0103df0 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83980a14d0 msgr2=0x7f83980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83980a14d0 0x7f83980a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f83b0077170 tx=0x7f83a000b5f0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b0103df0 msgr2=0x7f83b0194950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b0103df0 0x7f83b0194950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f83a800d010 tx=0x7f83a80094f0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 shutdown_connections 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83980a14d0 0x7f83980a3990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b0103df0 0x7f83b0194950 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b00ff0b0 0x7f83b019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 --2- 172.21.15.70:0/3370897728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83b00ffa70 0x7f83b019adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 >> 172.21.15.70:0/3370897728 conn(0x7f83b0074940 msgr2=0x7f83b00fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.094+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 shutdown_connections 2023-10-08T08:41:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.095+0000 7f83b5b4e700 1 -- 172.21.15.70:0/3370897728 wait complete. 2023-10-08T08:41:59.101 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2023-10-08T08:41:59.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-08T08:41:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.245+0000 7f92fce81700 1 -- 172.21.15.70:0/2701371946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f80ff620 msgr2=0x7f92f80ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.245+0000 7f92fce81700 1 --2- 172.21.15.70:0/2701371946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f80ff620 0x7f92f80ffaa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009990 tx=0x7f92ec009ca0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.245+0000 7f92fce81700 1 -- 172.21.15.70:0/2701371946 shutdown_connections 2023-10-08T08:41:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.245+0000 7f92fce81700 1 --2- 172.21.15.70:0/2701371946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f80fffe0 0x7f92f810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.245+0000 7f92fce81700 1 --2- 172.21.15.70:0/2701371946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f81056b0 0x7f92f8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.245+0000 7f92fce81700 1 --2- 172.21.15.70:0/2701371946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f80ff620 0x7f92f80ffaa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.245+0000 7f92fce81700 1 -- 172.21.15.70:0/2701371946 >> 172.21.15.70:0/2701371946 conn(0x7f92f8076780 msgr2=0x7f92f8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.245+0000 7f92fce81700 1 -- 172.21.15.70:0/2701371946 shutdown_connections 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.245+0000 7f92fce81700 1 -- 172.21.15.70:0/2701371946 wait complete. 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92fce81700 1 Processor -- start 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92fce81700 1 -- start start 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92fce81700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f80ff620 0x7f92f8198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92fce81700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f80fffe0 0x7f92f81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92fce81700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f81056b0 0x7f92f819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92fce81700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f819dca0 con 0x7f92f81056b0 2023-10-08T08:41:59.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92fce81700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f819de10 con 0x7f92f80ff620 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92fce81700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f819dfd0 con 0x7f92f80fffe0 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f6d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f81056b0 0x7f92f819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f6d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f81056b0 0x7f92f819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48970/0 (socket says 172.21.15.70:48970) 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f6d9d700 1 -- 172.21.15.70:0/2918726490 learned_addr learned my addr 172.21.15.70:0/2918726490 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f5d9b700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f80fffe0 0x7f92f81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f659c700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f80ff620 0x7f92f8198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f6d9d700 1 -- 172.21.15.70:0/2918726490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f80fffe0 msgr2=0x7f92f81992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f6d9d700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f80fffe0 0x7f92f81992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f6d9d700 1 -- 172.21.15.70:0/2918726490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f80ff620 msgr2=0x7f92f8198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:41:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f6d9d700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f80ff620 0x7f92f8198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:41:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f6d9d700 1 -- 172.21.15.70:0/2918726490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0095f0 con 0x7f92f81056b0 2023-10-08T08:41:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.246+0000 7f92f6d9d700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f81056b0 0x7f92f819d660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92f000e940 tx=0x7f92f000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.247+0000 7f92e77fe700 1 -- 172.21.15.70:0/2918726490 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00097b0 con 0x7f92f81056b0 2023-10-08T08:41:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.247+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f819e2b0 con 0x7f92f81056b0 2023-10-08T08:41:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.247+0000 7f92e77fe700 1 -- 172.21.15.70:0/2918726490 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92f000ee90 con 0x7f92f81056b0 2023-10-08T08:41:59.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.247+0000 7f92e77fe700 1 -- 172.21.15.70:0/2918726490 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0005520 con 0x7f92f81056b0 2023-10-08T08:41:59.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.247+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f81a5af0 con 0x7f92f81056b0 2023-10-08T08:41:59.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.247+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f8100d50 con 0x7f92f81056b0 2023-10-08T08:41:59.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.249+0000 7f92e77fe700 1 -- 172.21.15.70:0/2918726490 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f92f0004750 con 0x7f92f81056b0 2023-10-08T08:41:59.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.249+0000 7f92e77fe700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f92e00a14d0 0x7f92e00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:41:59.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.249+0000 7f92e77fe700 1 -- 172.21.15.70:0/2918726490 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7712+0+0 (secure 0 0 0) 0x7f92f0014070 con 0x7f92f81056b0 2023-10-08T08:41:59.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.249+0000 7f92f659c700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f92e00a14d0 0x7f92e00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:41:59.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.250+0000 7f92f659c700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f92e00a14d0 0x7f92e00a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f92f8077ab0 tx=0x7f92e8009040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:41:59.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.254+0000 7f92e77fe700 1 -- 172.21.15.70:0/2918726490 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f92f00967f0 con 0x7f92f81056b0 2023-10-08T08:41:59.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:59 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3370897728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T08:41:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:59.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:41:59 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:59.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:41:59.451+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f92f819a120 con 0x7f92f81056b0 2023-10-08T08:41:59.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:59 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3370897728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T08:41:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:59.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:41:59 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:59.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:59 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3370897728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T08:41:59.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:41:59.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:41:59.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:41:59.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:41:59.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:41:59 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:00.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.094+0000 7f92e77fe700 1 -- 172.21.15.70:0/2918726490 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v80) v1 ==== 171+0+0 (secure 0 0 0) 0x7f92f0099e10 con 0x7f92f81056b0 2023-10-08T08:42:00.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f92e00a14d0 msgr2=0x7f92e00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:00.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f92e00a14d0 0x7f92e00a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f92f8077ab0 tx=0x7f92e8009040 comp rx=0 tx=0).stop 2023-10-08T08:42:00.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f81056b0 msgr2=0x7f92f819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:00.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f81056b0 0x7f92f819d660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92f000e940 tx=0x7f92f000ec50 comp rx=0 tx=0).stop 2023-10-08T08:42:00.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 shutdown_connections 2023-10-08T08:42:00.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f92e00a14d0 0x7f92e00a3990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92f81056b0 0x7f92f819d660 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f80ff620 0x7f92f8198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 --2- 172.21.15.70:0/2918726490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92f80fffe0 0x7f92f81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 >> 172.21.15.70:0/2918726490 conn(0x7f92f8076780 msgr2=0x7f92f80678b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:00.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 shutdown_connections 2023-10-08T08:42:00.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.097+0000 7f92fce81700 1 -- 172.21.15.70:0/2918726490 wait complete. 2023-10-08T08:42:00.101 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2023-10-08T08:42:00.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T08:42:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.251+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2427845477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ffa10 msgr2=0x7f7bac103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.251+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2427845477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ffa10 0x7f7bac103a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009990 tx=0x7f7b98009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.251+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2427845477 shutdown_connections 2023-10-08T08:42:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.251+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2427845477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac104130 0x7f7bac10bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.251+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2427845477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0ff060 0x7f7bac0ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.251+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2427845477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ffa10 0x7f7bac103a00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.251+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2427845477 >> 172.21.15.70:0/2427845477 conn(0x7f7bac075c20 msgr2=0x7f7bac0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.251+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2427845477 shutdown_connections 2023-10-08T08:42:00.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.251+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2427845477 wait complete. 2023-10-08T08:42:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb2df3700 1 Processor -- start 2023-10-08T08:42:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb2df3700 1 -- start start 2023-10-08T08:42:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb2df3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0ff060 0x7f7bac19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb2df3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac104130 0x7f7bac19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:00.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb2df3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac196a50 0x7f7bac196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb2df3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac1974d0 con 0x7f7bac104130 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb2df3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac197640 con 0x7f7bac0ff060 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb2df3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac197800 con 0x7f7bac196a50 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7babfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac104130 0x7f7bac19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7babfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac104130 0x7f7bac19ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48986/0 (socket says 172.21.15.70:48986) 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7babfff700 1 -- 172.21.15.70:0/2957360912 learned_addr learned my addr 172.21.15.70:0/2957360912 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb0b8f700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0ff060 0x7f7bac19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7bb1390700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac196a50 0x7f7bac196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7babfff700 1 -- 172.21.15.70:0/2957360912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac196a50 msgr2=0x7f7bac196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7babfff700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac196a50 0x7f7bac196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7babfff700 1 -- 172.21.15.70:0/2957360912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0ff060 msgr2=0x7f7bac19c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7babfff700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0ff060 0x7f7bac19c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:00.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7babfff700 1 -- 172.21.15.70:0/2957360912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980095f0 con 0x7f7bac104130 2023-10-08T08:42:00.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.252+0000 7f7babfff700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac104130 0x7f7bac19ce60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7b98000c00 tx=0x7f7b98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:00.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.253+0000 7f7ba9ffb700 1 -- 172.21.15.70:0/2957360912 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9801d070 con 0x7f7bac104130 2023-10-08T08:42:00.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.253+0000 7f7ba9ffb700 1 -- 172.21.15.70:0/2957360912 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b98022470 con 0x7f7bac104130 2023-10-08T08:42:00.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.253+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac1a3790 con 0x7f7bac104130 2023-10-08T08:42:00.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.253+0000 7f7ba9ffb700 1 -- 172.21.15.70:0/2957360912 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98017650 con 0x7f7bac104130 2023-10-08T08:42:00.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.253+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac1a3bb0 con 0x7f7bac104130 2023-10-08T08:42:00.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.254+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac107310 con 0x7f7bac104130 2023-10-08T08:42:00.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.255+0000 7f7ba9ffb700 1 -- 172.21.15.70:0/2957360912 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7b980225e0 con 0x7f7bac104130 2023-10-08T08:42:00.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.255+0000 7f7ba9ffb700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b9c0a1550 0x7f7b9c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:00.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.256+0000 7f7ba9ffb700 1 -- 172.21.15.70:0/2957360912 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8094+0+0 (secure 0 0 0) 0x7f7b980ce6b0 con 0x7f7bac104130 2023-10-08T08:42:00.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.256+0000 7f7bb0b8f700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b9c0a1550 0x7f7b9c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:00.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.256+0000 7f7bb0b8f700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b9c0a1550 0x7f7b9c0a3a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009c60 tx=0x7f7ba0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:00.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.259+0000 7f7ba9ffb700 1 -- 172.21.15.70:0/2957360912 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7b98097de0 con 0x7f7bac104130 2023-10-08T08:42:00.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:00 smithi070 ceph-mon[99513]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:42:00.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:00 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3370897728' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T08:42:00.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:00 smithi070 ceph-mon[99513]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T08:42:00.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:00 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2918726490' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T08:42:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:00.507+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7bac197f10 con 0x7f7bac104130 2023-10-08T08:42:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:00 smithi105 ceph-mon[103798]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:42:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:00 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3370897728' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T08:42:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:00 smithi105 ceph-mon[103798]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T08:42:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:00 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2918726490' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T08:42:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:00 smithi191 ceph-mon[104220]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:42:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:00 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3370897728' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T08:42:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:00 smithi191 ceph-mon[104220]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T08:42:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:00 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2918726490' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T08:42:01.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.115+0000 7f7ba9ffb700 1 -- 172.21.15.70:0/2957360912 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7b9809b400 con 0x7f7bac104130 2023-10-08T08:42:01.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b9c0a1550 msgr2=0x7f7b9c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b9c0a1550 0x7f7b9c0a3a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009c60 tx=0x7f7ba0009260 comp rx=0 tx=0).stop 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac104130 msgr2=0x7f7bac19ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac104130 0x7f7bac19ce60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7b98000c00 tx=0x7f7b98004730 comp rx=0 tx=0).stop 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 shutdown_connections 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b9c0a1550 0x7f7b9c0a3a10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac196a50 0x7f7bac196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0ff060 0x7f7bac19c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 --2- 172.21.15.70:0/2957360912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac104130 0x7f7bac19ce60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 >> 172.21.15.70:0/2957360912 conn(0x7f7bac075c20 msgr2=0x7f7bac0fb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 shutdown_connections 2023-10-08T08:42:01.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.118+0000 7f7bb2df3700 1 -- 172.21.15.70:0/2957360912 wait complete. 2023-10-08T08:42:01.121 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T08:42:01.143 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-08T08:42:01.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-08T08:42:01.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.277+0000 7fb1048c8700 1 -- 172.21.15.70:0/479306819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1000fec80 msgr2=0x7fb1000ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.277+0000 7fb1048c8700 1 --2- 172.21.15.70:0/479306819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1000fec80 0x7fb1000ff0e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009990 tx=0x7fb0f0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.277+0000 7fb1048c8700 1 -- 172.21.15.70:0/479306819 shutdown_connections 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.277+0000 7fb1048c8700 1 --2- 172.21.15.70:0/479306819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1000ff620 0x7fb10010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.277+0000 7fb1048c8700 1 --2- 172.21.15.70:0/479306819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb100106740 0x7fb100106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.277+0000 7fb1048c8700 1 --2- 172.21.15.70:0/479306819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1000fec80 0x7fb1000ff0e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.277+0000 7fb1048c8700 1 -- 172.21.15.70:0/479306819 >> 172.21.15.70:0/479306819 conn(0x7fb100075c20 msgr2=0x7fb1000fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.277+0000 7fb1048c8700 1 -- 172.21.15.70:0/479306819 shutdown_connections 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.277+0000 7fb1048c8700 1 -- 172.21.15.70:0/479306819 wait complete. 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb1048c8700 1 Processor -- start 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb1048c8700 1 -- start start 2023-10-08T08:42:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb1048c8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1000fec80 0x7fb1000ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb1048c8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1000ff620 0x7fb1001003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb1048c8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100106740 0x7fb100100900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb1048c8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1001a50b0 con 0x7fb100106740 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb1048c8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1001a5220 con 0x7fb1000ff620 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb1048c8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1001a53e0 con 0x7fb1000fec80 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb0fed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100106740 0x7fb100100900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb0fed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100106740 0x7fb100100900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49010/0 (socket says 172.21.15.70:49010) 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.278+0000 7fb0fed9d700 1 -- 172.21.15.70:0/2788888451 learned_addr learned my addr 172.21.15.70:0/2788888451 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0fdd9b700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1000ff620 0x7fb1001003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0fe59c700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1000fec80 0x7fb1000ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:01.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0fed9d700 1 -- 172.21.15.70:0/2788888451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1000fec80 msgr2=0x7fb1000ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0fed9d700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1000fec80 0x7fb1000ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0fed9d700 1 -- 172.21.15.70:0/2788888451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1000ff620 msgr2=0x7fb1001003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0fed9d700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1000ff620 0x7fb1001003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0fed9d700 1 -- 172.21.15.70:0/2788888451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f00095f0 con 0x7fb100106740 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0fed9d700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100106740 0x7fb100100900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800b970 tx=0x7fb0f800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0ef7fe700 1 -- 172.21.15.70:0/2788888451 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800c930 con 0x7fb100106740 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0ef7fe700 1 -- 172.21.15.70:0/2788888451 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb0f8014440 con 0x7fb100106740 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1001a56c0 con 0x7fb100106740 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb0ef7fe700 1 -- 172.21.15.70:0/2788888451 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80075d0 con 0x7fb100106740 2023-10-08T08:42:01.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.279+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1001a5bd0 con 0x7fb100106740 2023-10-08T08:42:01.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.280+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb100108cc0 con 0x7fb100106740 2023-10-08T08:42:01.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.282+0000 7fb0ef7fe700 1 -- 172.21.15.70:0/2788888451 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb0f80145b0 con 0x7fb100106740 2023-10-08T08:42:01.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.282+0000 7fb0ef7fe700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb0e80a14d0 0x7fb0e80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:01.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.283+0000 7fb0fe59c700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb0e80a14d0 0x7fb0e80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:01.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.283+0000 7fb0ef7fe700 1 -- 172.21.15.70:0/2788888451 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fb0f8006e40 con 0x7fb100106740 2023-10-08T08:42:01.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.283+0000 7fb0fe59c700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb0e80a14d0 0x7fb0e80a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4005950 tx=0x7fb0f40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:01.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.286+0000 7fb0ef7fe700 1 -- 172.21.15.70:0/2788888451 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb0f8095c10 con 0x7fb100106740 2023-10-08T08:42:01.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:01 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2918726490' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-08T08:42:01.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:01 smithi070 ceph-mon[99513]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T08:42:01.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:01 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2957360912' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T08:42:01.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:01 smithi070 ceph-mon[99513]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-08T08:42:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:01.499+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fb100101fa0 con 0x7fb100106740 2023-10-08T08:42:01.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:01 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2918726490' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-08T08:42:01.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:01 smithi105 ceph-mon[103798]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T08:42:01.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:01 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2957360912' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T08:42:01.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:01 smithi105 ceph-mon[103798]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-08T08:42:01.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:01 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2918726490' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-08T08:42:01.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:01 smithi191 ceph-mon[104220]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T08:42:01.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:01 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2957360912' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T08:42:01.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:01 smithi191 ceph-mon[104220]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-08T08:42:02.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.126+0000 7fb0ef7fe700 1 -- 172.21.15.70:0/2788888451 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v82) v1 ==== 157+0+0 (secure 0 0 0) 0x7fb0f8099230 con 0x7fb100106740 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.129+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb0e80a14d0 msgr2=0x7fb0e80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.129+0000 7fb1048c8700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb0e80a14d0 0x7fb0e80a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4005950 tx=0x7fb0f40058e0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.129+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100106740 msgr2=0x7fb100100900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.129+0000 7fb1048c8700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100106740 0x7fb100100900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800b970 tx=0x7fb0f800bc80 comp rx=0 tx=0).stop 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.130+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 shutdown_connections 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.130+0000 7fb1048c8700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb0e80a14d0 0x7fb0e80a3990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.130+0000 7fb1048c8700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100106740 0x7fb100100900 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.130+0000 7fb1048c8700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1000fec80 0x7fb1000ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.130+0000 7fb1048c8700 1 --2- 172.21.15.70:0/2788888451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1000ff620 0x7fb1001003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.130+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 >> 172.21.15.70:0/2788888451 conn(0x7fb100075c20 msgr2=0x7fb1000fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:02.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.130+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 shutdown_connections 2023-10-08T08:42:02.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.130+0000 7fb1048c8700 1 -- 172.21.15.70:0/2788888451 wait complete. 2023-10-08T08:42:02.147 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T08:42:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.281+0000 7fbae93a1700 1 -- 172.21.15.70:0/2439312473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41044f0 msgr2=0x7fbae41048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.281+0000 7fbae93a1700 1 --2- 172.21.15.70:0/2439312473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41044f0 0x7fbae41048d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009990 tx=0x7fbad8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.281+0000 7fbae93a1700 1 -- 172.21.15.70:0/2439312473 shutdown_connections 2023-10-08T08:42:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.281+0000 7fbae93a1700 1 --2- 172.21.15.70:0/2439312473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbae41009b0 0x7fbae410c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.281+0000 7fbae93a1700 1 --2- 172.21.15.70:0/2439312473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41044f0 0x7fbae41048d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.281+0000 7fbae93a1700 1 --2- 172.21.15.70:0/2439312473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae40ffff0 0x7fbae4100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.281+0000 7fbae93a1700 1 -- 172.21.15.70:0/2439312473 >> 172.21.15.70:0/2439312473 conn(0x7fbae40747c0 msgr2=0x7fbae4074bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.281+0000 7fbae93a1700 1 -- 172.21.15.70:0/2439312473 shutdown_connections 2023-10-08T08:42:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.281+0000 7fbae93a1700 1 -- 172.21.15.70:0/2439312473 wait complete. 2023-10-08T08:42:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae93a1700 1 Processor -- start 2023-10-08T08:42:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae93a1700 1 -- start start 2023-10-08T08:42:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae93a1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbae40ffff0 0x7fbae41978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae93a1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41009b0 0x7fbae4197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae93a1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae41044f0 0x7fbae41a2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae93a1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4198690 con 0x7fbae41009b0 2023-10-08T08:42:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae93a1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41a2ea0 con 0x7fbae41044f0 2023-10-08T08:42:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae93a1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41a2fe0 con 0x7fbae40ffff0 2023-10-08T08:42:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41009b0 0x7fbae4197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41009b0 0x7fbae4197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49022/0 (socket says 172.21.15.70:49022) 2023-10-08T08:42:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae37fe700 1 -- 172.21.15.70:0/1254812597 learned_addr learned my addr 172.21.15.70:0/1254812597 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae8ba0700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae41044f0 0x7fbae41a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae3fff700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbae40ffff0 0x7fbae41978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae37fe700 1 -- 172.21.15.70:0/1254812597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbae40ffff0 msgr2=0x7fbae41978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae37fe700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbae40ffff0 0x7fbae41978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae37fe700 1 -- 172.21.15.70:0/1254812597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae41044f0 msgr2=0x7fbae41a2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae37fe700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae41044f0 0x7fbae41a2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae37fe700 1 -- 172.21.15.70:0/1254812597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad80095f0 con 0x7fbae41009b0 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.282+0000 7fbae3fff700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbae40ffff0 0x7fbae41978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.283+0000 7fbae37fe700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41009b0 0x7fbae4197e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbad400d950 tx=0x7fbad400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.283+0000 7fbae17fa700 1 -- 172.21.15.70:0/1254812597 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4009940 con 0x7fbae41009b0 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.283+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae41a3270 con 0x7fbae41009b0 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.283+0000 7fbae17fa700 1 -- 172.21.15.70:0/1254812597 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbad4010460 con 0x7fbae41009b0 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.283+0000 7fbae17fa700 1 -- 172.21.15.70:0/1254812597 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad400f620 con 0x7fbae41009b0 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.283+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae41a3780 con 0x7fbae41009b0 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.284+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae4107a40 con 0x7fbae41009b0 2023-10-08T08:42:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.285+0000 7fbae17fa700 1 -- 172.21.15.70:0/1254812597 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fbad40108d0 con 0x7fbae41009b0 2023-10-08T08:42:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.285+0000 7fbae17fa700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbacc0a14d0 0x7fbacc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.285+0000 7fbae3fff700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbacc0a14d0 0x7fbacc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.285+0000 7fbae17fa700 1 -- 172.21.15.70:0/1254812597 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8420+0+0 (secure 0 0 0) 0x7fbad40ccc90 con 0x7fbae41009b0 2023-10-08T08:42:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.286+0000 7fbae3fff700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbacc0a14d0 0x7fbacc0a3990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbad800b5c0 tx=0x7fbad8005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.290+0000 7fbae17fa700 1 -- 172.21.15.70:0/1254812597 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbad4096230 con 0x7fbae41009b0 2023-10-08T08:42:02.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: pgmap v229: 97 pgs: 18 creating+peering, 4 active+clean, 75 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:42:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T08:42:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2957360912' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T08:42:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T08:42:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-08T08:42:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-08T08:42:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:42:02.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:42:02.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:02 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2788888451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-08T08:42:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:02.484+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbae4067400 con 0x7fbae41009b0 2023-10-08T08:42:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: pgmap v229: 97 pgs: 18 creating+peering, 4 active+clean, 75 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:42:02.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T08:42:02.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2957360912' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T08:42:02.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T08:42:02.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-08T08:42:02.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-08T08:42:02.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:42:02.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:42:02.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:02 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2788888451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-08T08:42:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: pgmap v229: 97 pgs: 18 creating+peering, 4 active+clean, 75 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:42:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2957360912' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:42:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:42:02.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:02 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2788888451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-08T08:42:03.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:03 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2788888451' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-08T08:42:03.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:03 smithi070 ceph-mon[99513]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T08:42:03.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:03 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] up:active 2023-10-08T08:42:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:03 smithi070 ceph-mon[99513]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:03 smithi070 ceph-mon[99513]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:03 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1254812597' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T08:42:03.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:03 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2788888451' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-08T08:42:03.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:03 smithi105 ceph-mon[103798]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T08:42:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:03 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] up:active 2023-10-08T08:42:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:03 smithi105 ceph-mon[103798]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:03 smithi105 ceph-mon[103798]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:03.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:03 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1254812597' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T08:42:03.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:03 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2788888451' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-08T08:42:03.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:03 smithi191 ceph-mon[104220]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T08:42:03.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:03 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] up:active 2023-10-08T08:42:03.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:03 smithi191 ceph-mon[104220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:03.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:03 smithi191 ceph-mon[104220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:03.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:03 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1254812597' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T08:42:04.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.149+0000 7fbae17fa700 1 -- 172.21.15.70:0/1254812597 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v84) v1 ==== 228+0+0 (secure 0 0 0) 0x7fbad4016100 con 0x7fbae41009b0 2023-10-08T08:42:04.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.152+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbacc0a14d0 msgr2=0x7fbacc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:04.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.152+0000 7fbae93a1700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbacc0a14d0 0x7fbacc0a3990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbad800b5c0 tx=0x7fbad8005fd0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.152+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41009b0 msgr2=0x7fbae4197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:04.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.152+0000 7fbae93a1700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41009b0 0x7fbae4197e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbad400d950 tx=0x7fbad400dc60 comp rx=0 tx=0).stop 2023-10-08T08:42:04.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.157+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 shutdown_connections 2023-10-08T08:42:04.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.157+0000 7fbae93a1700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbacc0a14d0 0x7fbacc0a3990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.157+0000 7fbae93a1700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbae41044f0 0x7fbae41a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.157+0000 7fbae93a1700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbae40ffff0 0x7fbae41978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.157+0000 7fbae93a1700 1 --2- 172.21.15.70:0/1254812597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbae41009b0 0x7fbae4197e20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.157+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 >> 172.21.15.70:0/1254812597 conn(0x7fbae40747c0 msgr2=0x7fbae40fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:04.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.159+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 shutdown_connections 2023-10-08T08:42:04.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.160+0000 7fbae93a1700 1 -- 172.21.15.70:0/1254812597 wait complete. 2023-10-08T08:42:04.162 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data_ec' created 2023-10-08T08:42:04.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-08T08:42:04.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.300+0000 7f3a9a736700 1 -- 172.21.15.70:0/3921136077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a94100000 msgr2=0x7f3a9410c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:04.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.300+0000 7f3a9a736700 1 --2- 172.21.15.70:0/3921136077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a94100000 0x7f3a9410c4f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00b0a0 tx=0x7f3a8c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.300+0000 7f3a9a736700 1 -- 172.21.15.70:0/3921136077 shutdown_connections 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.300+0000 7f3a9a736700 1 --2- 172.21.15.70:0/3921136077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a94100000 0x7f3a9410c4f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.300+0000 7f3a9a736700 1 --2- 172.21.15.70:0/3921136077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a94105630 0x7f3a94105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.300+0000 7f3a9a736700 1 --2- 172.21.15.70:0/3921136077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a940ff640 0x7f3a940ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.300+0000 7f3a9a736700 1 -- 172.21.15.70:0/3921136077 >> 172.21.15.70:0/3921136077 conn(0x7f3a94076790 msgr2=0x7f3a94076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.300+0000 7f3a9a736700 1 -- 172.21.15.70:0/3921136077 shutdown_connections 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.300+0000 7f3a9a736700 1 -- 172.21.15.70:0/3921136077 wait complete. 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a9a736700 1 Processor -- start 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a9a736700 1 -- start start 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a9a736700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a940ff640 0x7f3a9419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a9a736700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a94100000 0x7f3a9419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a9a736700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a94105630 0x7f3a94195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a9a736700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a94195f20 con 0x7f3a940ff640 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a9a736700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a94196090 con 0x7f3a94100000 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a9a736700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a94196250 con 0x7f3a94105630 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a93fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a940ff640 0x7f3a9419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a93fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a940ff640 0x7f3a9419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49042/0 (socket says 172.21.15.70:49042) 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a93fff700 1 -- 172.21.15.70:0/4150674608 learned_addr learned my addr 172.21.15.70:0/4150674608 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a8bfff700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a94100000 0x7f3a9419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a93fff700 1 -- 172.21.15.70:0/4150674608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a94105630 msgr2=0x7f3a94195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a98cd3700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a94105630 0x7f3a94195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a93fff700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a94105630 0x7f3a94195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a93fff700 1 -- 172.21.15.70:0/4150674608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a94100000 msgr2=0x7f3a9419bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a93fff700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a94100000 0x7f3a9419bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:04.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a93fff700 1 -- 172.21.15.70:0/4150674608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c009d00 con 0x7f3a940ff640 2023-10-08T08:42:04.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a8bfff700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a94100000 0x7f3a9419bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:04.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a93fff700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a940ff640 0x7f3a9419b6d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400d950 tx=0x7f3a8400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:04.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a91ffb700 1 -- 172.21.15.70:0/4150674608 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84009b40 con 0x7f3a940ff640 2023-10-08T08:42:04.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.301+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a94196530 con 0x7f3a940ff640 2023-10-08T08:42:04.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.302+0000 7f3a91ffb700 1 -- 172.21.15.70:0/4150674608 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a84009ca0 con 0x7f3a940ff640 2023-10-08T08:42:04.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.302+0000 7f3a91ffb700 1 -- 172.21.15.70:0/4150674608 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400f620 con 0x7f3a940ff640 2023-10-08T08:42:04.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.302+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a941a2700 con 0x7f3a940ff640 2023-10-08T08:42:04.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.303+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a94107c40 con 0x7f3a940ff640 2023-10-08T08:42:04.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.304+0000 7f3a91ffb700 1 -- 172.21.15.70:0/4150674608 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3a84010460 con 0x7f3a940ff640 2023-10-08T08:42:04.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.304+0000 7f3a91ffb700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a800a14d0 0x7f3a800a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:04.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.305+0000 7f3a8bfff700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a800a14d0 0x7f3a800a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:04.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.305+0000 7f3a91ffb700 1 -- 172.21.15.70:0/4150674608 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8913+0+0 (secure 0 0 0) 0x7f3a840cd2a0 con 0x7f3a940ff640 2023-10-08T08:42:04.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.305+0000 7f3a8bfff700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a800a14d0 0x7f3a800a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c005950 tx=0x7f3a7c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:04.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.308+0000 7f3a91ffb700 1 -- 172.21.15.70:0/4150674608 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a840966f0 con 0x7f3a940ff640 2023-10-08T08:42:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:04 smithi070 ceph-mon[99513]: pgmap v232: 97 pgs: 18 creating+peering, 28 active+clean, 51 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-08T08:42:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:04 smithi070 ceph-mon[99513]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-08T08:42:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:04 smithi070 ceph-mon[99513]: Cluster is now healthy 2023-10-08T08:42:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:04 smithi070 ceph-mon[99513]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T08:42:04.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:04.497+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f3a94196d00 con 0x7f3a940ff640 2023-10-08T08:42:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:04 smithi105 ceph-mon[103798]: pgmap v232: 97 pgs: 18 creating+peering, 28 active+clean, 51 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-08T08:42:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:04 smithi105 ceph-mon[103798]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-08T08:42:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:04 smithi105 ceph-mon[103798]: Cluster is now healthy 2023-10-08T08:42:04.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:04 smithi105 ceph-mon[103798]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T08:42:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:04 smithi191 ceph-mon[104220]: pgmap v232: 97 pgs: 18 creating+peering, 28 active+clean, 51 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-08T08:42:04.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:04 smithi191 ceph-mon[104220]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-08T08:42:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:04 smithi191 ceph-mon[104220]: Cluster is now healthy 2023-10-08T08:42:04.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:04 smithi191 ceph-mon[104220]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T08:42:05.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.155+0000 7f3a91ffb700 1 -- 172.21.15.70:0/4150674608 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3a84099d10 con 0x7f3a940ff640 2023-10-08T08:42:05.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a800a14d0 msgr2=0x7f3a800a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:05.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a800a14d0 0x7f3a800a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c005950 tx=0x7f3a7c0058e0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a940ff640 msgr2=0x7f3a9419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:05.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a940ff640 0x7f3a9419b6d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400d950 tx=0x7f3a8400dd10 comp rx=0 tx=0).stop 2023-10-08T08:42:05.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 shutdown_connections 2023-10-08T08:42:05.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a800a14d0 0x7f3a800a3990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a94105630 0x7f3a94195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a940ff640 0x7f3a9419b6d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 --2- 172.21.15.70:0/4150674608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a94100000 0x7f3a9419bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 >> 172.21.15.70:0/4150674608 conn(0x7f3a94076790 msgr2=0x7f3a940fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:05.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 shutdown_connections 2023-10-08T08:42:05.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.159+0000 7f3a9a736700 1 -- 172.21.15.70:0/4150674608 wait complete. 2023-10-08T08:42:05.163 INFO:teuthology.orchestra.run.smithi070.stderr:set pool 4 allow_ec_overwrites to true 2023-10-08T08:42:05.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-08T08:42:05.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.313+0000 7f8ba139e700 1 -- 172.21.15.70:0/3867957676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c103df0 msgr2=0x7f8b9c1041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:05.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.313+0000 7f8ba139e700 1 --2- 172.21.15.70:0/3867957676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c103df0 0x7f8b9c1041d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8b840099c0 tx=0x7f8b84009cd0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.313+0000 7f8ba139e700 1 -- 172.21.15.70:0/3867957676 shutdown_connections 2023-10-08T08:42:05.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.313+0000 7f8ba139e700 1 --2- 172.21.15.70:0/3867957676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b9c0ffa70 0x7f8b9c10bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.313+0000 7f8ba139e700 1 --2- 172.21.15.70:0/3867957676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c103df0 0x7f8b9c1041d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.313+0000 7f8ba139e700 1 --2- 172.21.15.70:0/3867957676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0ff0b0 0x7f8b9c0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.313+0000 7f8ba139e700 1 -- 172.21.15.70:0/3867957676 >> 172.21.15.70:0/3867957676 conn(0x7f8b9c074940 msgr2=0x7f8b9c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:05.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.313+0000 7f8ba139e700 1 -- 172.21.15.70:0/3867957676 shutdown_connections 2023-10-08T08:42:05.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.313+0000 7f8ba139e700 1 -- 172.21.15.70:0/3867957676 wait complete. 2023-10-08T08:42:05.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8ba139e700 1 Processor -- start 2023-10-08T08:42:05.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8ba139e700 1 -- start start 2023-10-08T08:42:05.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8ba139e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0ff0b0 0x7f8b9c19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:05.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8ba139e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c0ffa70 0x7f8b9c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:05.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8ba139e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b9c103df0 0x7f8b9c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:05.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8ba139e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c197050 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8ba139e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c1971c0 con 0x7f8b9c0ff0b0 2023-10-08T08:42:05.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8ba139e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c197380 con 0x7f8b9c103df0 2023-10-08T08:42:05.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8b9a7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c0ffa70 0x7f8b9c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:05.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8b9a7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c0ffa70 0x7f8b9c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49062/0 (socket says 172.21.15.70:49062) 2023-10-08T08:42:05.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8b9a7fc700 1 -- 172.21.15.70:0/1549398047 learned_addr learned my addr 172.21.15.70:0/1549398047 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:05.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8b9affd700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0ff0b0 0x7f8b9c19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:05.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.314+0000 7f8b9b7fe700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b9c103df0 0x7f8b9c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:05.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b9a7fc700 1 -- 172.21.15.70:0/1549398047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b9c103df0 msgr2=0x7f8b9c1969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:05.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b9a7fc700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b9c103df0 0x7f8b9c1969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b9a7fc700 1 -- 172.21.15.70:0/1549398047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0ff0b0 msgr2=0x7f8b9c19c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b9a7fc700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0ff0b0 0x7f8b9c19c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b9a7fc700 1 -- 172.21.15.70:0/1549398047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840095f0 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b9b7fe700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b9c103df0 0x7f8b9c1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b9a7fc700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c0ffa70 0x7f8b9c19ce00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00d950 tx=0x7f8b8c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b93fff700 1 -- 172.21.15.70:0/1549398047 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c009940 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b93fff700 1 -- 172.21.15.70:0/1549398047 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b8c010460 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c197660 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8b93fff700 1 -- 172.21.15.70:0/1549398047 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00f620 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.315+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c1a38b0 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.316+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9c1083e0 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.317+0000 7f8b93fff700 1 -- 172.21.15.70:0/1549398047 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8b8c0108d0 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.317+0000 7f8b93fff700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b880a14d0 0x7f8b880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.318+0000 7f8b9affd700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b880a14d0 0x7f8b880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.318+0000 7f8b93fff700 1 -- 172.21.15.70:0/1549398047 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8913+0+0 (secure 0 0 0) 0x7f8b8c0ccea0 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.318+0000 7f8b9affd700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b880a14d0 0x7f8b880a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b84006010 tx=0x7f8b84005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.321+0000 7f8b93fff700 1 -- 172.21.15.70:0/1549398047 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8b8c096250 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:05 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1254812597' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T08:42:05.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:05 smithi070 ceph-mon[99513]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T08:42:05.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:05 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4150674608' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-08T08:42:05.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:05 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1254812597' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T08:42:05.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:05 smithi105 ceph-mon[103798]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T08:42:05.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:05 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4150674608' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-08T08:42:05.521 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:42:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: 2023-10-08T08:42:05.086+0000 7f0a3704b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T08:42:05.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:05.562+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f8b9c197eb0 con 0x7f8b9c0ffa70 2023-10-08T08:42:05.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:05 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1254812597' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T08:42:05.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:05 smithi191 ceph-mon[104220]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T08:42:05.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:05 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4150674608' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-08T08:42:06.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.156+0000 7f8b93fff700 1 -- 172.21.15.70:0/1549398047 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7f8b8c0200b0 con 0x7f8b9c0ffa70 2023-10-08T08:42:06.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b880a14d0 msgr2=0x7f8b880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b880a14d0 0x7f8b880a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b84006010 tx=0x7f8b84005a90 comp rx=0 tx=0).stop 2023-10-08T08:42:06.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c0ffa70 msgr2=0x7f8b9c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c0ffa70 0x7f8b9c19ce00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00d950 tx=0x7f8b8c00dc60 comp rx=0 tx=0).stop 2023-10-08T08:42:06.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 shutdown_connections 2023-10-08T08:42:06.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b880a14d0 0x7f8b880a3990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b9c103df0 0x7f8b9c1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0ff0b0 0x7f8b9c19c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 --2- 172.21.15.70:0/1549398047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b9c0ffa70 0x7f8b9c19ce00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 >> 172.21.15.70:0/1549398047 conn(0x7f8b9c074940 msgr2=0x7f8b9c10c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:06.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.159+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 shutdown_connections 2023-10-08T08:42:06.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.160+0000 7f8ba139e700 1 -- 172.21.15.70:0/1549398047 wait complete. 2023-10-08T08:42:06.162 INFO:teuthology.orchestra.run.smithi070.stderr:added data pool 4 to fsmap 2023-10-08T08:42:06.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:42:06.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 -- 172.21.15.70:0/3294772951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c0105600 msgr2=0x7f01c01059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 --2- 172.21.15.70:0/3294772951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c0105600 0x7f01c01059e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f01b40099c0 tx=0x7f01b4009cd0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 -- 172.21.15.70:0/3294772951 shutdown_connections 2023-10-08T08:42:06.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 --2- 172.21.15.70:0/3294772951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01c00fff00 0x7f01c010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 --2- 172.21.15.70:0/3294772951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c0105600 0x7f01c01059e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 --2- 172.21.15.70:0/3294772951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01c00ff540 0x7f01c00ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 -- 172.21.15.70:0/3294772951 >> 172.21.15.70:0/3294772951 conn(0x7f01c00fb030 msgr2=0x7f01c00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 -- 172.21.15.70:0/3294772951 shutdown_connections 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 -- 172.21.15.70:0/3294772951 wait complete. 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 Processor -- start 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 -- start start 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c00ff540 0x7f01c0197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01c00fff00 0x7f01c0197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01c0105600 0x7f01c01a2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0198610 con 0x7f01c00ff540 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c01a2e40 con 0x7f01c00fff00 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c6cec700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c01a2f80 con 0x7f01c0105600 2023-10-08T08:42:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.299+0000 7f01c4a88700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c00ff540 0x7f01c0197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c4a88700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c00ff540 0x7f01c0197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49074/0 (socket says 172.21.15.70:49074) 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c4a88700 1 -- 172.21.15.70:0/1382511765 learned_addr learned my addr 172.21.15.70:0/1382511765 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01bffff700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01c00fff00 0x7f01c0197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c4a88700 1 -- 172.21.15.70:0/1382511765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01c0105600 msgr2=0x7f01c01a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c5289700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01c0105600 0x7f01c01a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c4a88700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01c0105600 0x7f01c01a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c4a88700 1 -- 172.21.15.70:0/1382511765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01c00fff00 msgr2=0x7f01c0197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c4a88700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01c00fff00 0x7f01c0197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c4a88700 1 -- 172.21.15.70:0/1382511765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b40095f0 con 0x7f01c00ff540 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01bffff700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01c00fff00 0x7f01c0197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c5289700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01c0105600 0x7f01c01a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:06.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c4a88700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c00ff540 0x7f01c0197880 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f01b4005910 tx=0x7f01b4003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:06.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01bdffb700 1 -- 172.21.15.70:0/1382511765 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b401d070 con 0x7f01c00ff540 2023-10-08T08:42:06.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01bdffb700 1 -- 172.21.15.70:0/1382511765 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01b400fd60 con 0x7f01c00ff540 2023-10-08T08:42:06.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01bdffb700 1 -- 172.21.15.70:0/1382511765 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b40037c0 con 0x7f01c00ff540 2023-10-08T08:42:06.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c01a3180 con 0x7f01c00ff540 2023-10-08T08:42:06.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.300+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c01a35a0 con 0x7f01c00ff540 2023-10-08T08:42:06.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.301+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c0107a80 con 0x7f01c00ff540 2023-10-08T08:42:06.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.302+0000 7f01bdffb700 1 -- 172.21.15.70:0/1382511765 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f01b4022670 con 0x7f01c00ff540 2023-10-08T08:42:06.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.303+0000 7f01bdffb700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01b00a1550 0x7f01b00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:06.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.303+0000 7f01bffff700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01b00a1550 0x7f01b00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:06.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.303+0000 7f01bdffb700 1 -- 172.21.15.70:0/1382511765 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f01b40ce840 con 0x7f01c00ff540 2023-10-08T08:42:06.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.304+0000 7f01bffff700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01b00a1550 0x7f01b00a3a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005fd0 tx=0x7f01ac005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:06.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.307+0000 7f01bdffb700 1 -- 172.21.15.70:0/1382511765 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f01b4097cf0 con 0x7f01c00ff540 2023-10-08T08:42:06.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:06 smithi070 ceph-mon[99513]: pgmap v235: 129 pgs: 16 creating+peering, 88 active+clean, 25 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-08T08:42:06.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:06 smithi070 ceph-mon[99513]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T08:42:06.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:06 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4150674608' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-08T08:42:06.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:06 smithi070 ceph-mon[99513]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T08:42:06.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:06 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1549398047' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-08T08:42:06.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:06 smithi105 ceph-mon[103798]: pgmap v235: 129 pgs: 16 creating+peering, 88 active+clean, 25 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-08T08:42:06.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:06 smithi105 ceph-mon[103798]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T08:42:06.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:06 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4150674608' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-08T08:42:06.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:06 smithi105 ceph-mon[103798]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T08:42:06.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:06 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1549398047' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-08T08:42:06.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.544+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01c0067e70 con 0x7f01c00ff540 2023-10-08T08:42:06.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.544+0000 7f01bdffb700 1 -- 172.21.15.70:0/1382511765 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11264 (secure 0 0 0) 0x7f01b409b310 con 0x7f01c00ff540 2023-10-08T08:42:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:06.546 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24577,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24604,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:05.564039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24638},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-08T08:42:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01b00a1550 msgr2=0x7f01b00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01b00a1550 0x7f01b00a3a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005fd0 tx=0x7f01ac005e20 comp rx=0 tx=0).stop 2023-10-08T08:42:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c00ff540 msgr2=0x7f01c0197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c00ff540 0x7f01c0197880 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f01b4005910 tx=0x7f01b4003710 comp rx=0 tx=0).stop 2023-10-08T08:42:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 shutdown_connections 2023-10-08T08:42:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f01b00a1550 0x7f01b00a3a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01c0105600 0x7f01c01a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01c00ff540 0x7f01c0197880 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 --2- 172.21.15.70:0/1382511765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01c00fff00 0x7f01c0197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 >> 172.21.15.70:0/1382511765 conn(0x7f01c00fb030 msgr2=0x7f01c00fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 shutdown_connections 2023-10-08T08:42:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.547+0000 7f01c6cec700 1 -- 172.21.15.70:0/1382511765 wait complete. 2023-10-08T08:42:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 17 2023-10-08T08:42:06.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:42:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:06 smithi191 ceph-mon[104220]: pgmap v235: 129 pgs: 16 creating+peering, 88 active+clean, 25 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-08T08:42:06.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:06 smithi191 ceph-mon[104220]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T08:42:06.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:06 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4150674608' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-08T08:42:06.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:06 smithi191 ceph-mon[104220]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T08:42:06.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:06 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1549398047' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-08T08:42:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.680+0000 7fce0f987700 1 -- 172.21.15.70:0/2492643601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081018a0 msgr2=0x7fce08101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.680+0000 7fce0f987700 1 --2- 172.21.15.70:0/2492643601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081018a0 0x7fce08101c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009990 tx=0x7fcdfc009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.680+0000 7fce0f987700 1 -- 172.21.15.70:0/2492643601 shutdown_connections 2023-10-08T08:42:06.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.680+0000 7fce0f987700 1 --2- 172.21.15.70:0/2492643601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce0810ac70 0x7fce0810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.680+0000 7fce0f987700 1 --2- 172.21.15.70:0/2492643601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081018a0 0x7fce08101c80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.680+0000 7fce0f987700 1 --2- 172.21.15.70:0/2492643601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce081021c0 0x7fce0810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.680+0000 7fce0f987700 1 -- 172.21.15.70:0/2492643601 >> 172.21.15.70:0/2492643601 conn(0x7fce080fb060 msgr2=0x7fce080fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.680+0000 7fce0f987700 1 -- 172.21.15.70:0/2492643601 shutdown_connections 2023-10-08T08:42:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.680+0000 7fce0f987700 1 -- 172.21.15.70:0/2492643601 wait complete. 2023-10-08T08:42:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0f987700 1 Processor -- start 2023-10-08T08:42:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0f987700 1 -- start start 2023-10-08T08:42:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0f987700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce081018a0 0x7fce0819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0f987700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081021c0 0x7fce0819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0f987700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce0810ac70 0x7fce08196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0f987700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce08196f80 con 0x7fce081021c0 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0f987700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce081970f0 con 0x7fce081018a0 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0f987700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce081972b0 con 0x7fce0810ac70 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0cf22700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081021c0 0x7fce0819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0cf22700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081021c0 0x7fce0819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49090/0 (socket says 172.21.15.70:49090) 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0cf22700 1 -- 172.21.15.70:0/4164688707 learned_addr learned my addr 172.21.15.70:0/4164688707 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0d723700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce081018a0 0x7fce0819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0cf22700 1 -- 172.21.15.70:0/4164688707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce0810ac70 msgr2=0x7fce08196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0cf22700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce0810ac70 0x7fce08196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0cf22700 1 -- 172.21.15.70:0/4164688707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce081018a0 msgr2=0x7fce0819c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0cf22700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce081018a0 0x7fce0819c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0cf22700 1 -- 172.21.15.70:0/4164688707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc0095f0 con 0x7fce081021c0 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0d723700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce081018a0 0x7fce0819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fce0cf22700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081021c0 0x7fce0819cce0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fce0400c9b0 tx=0x7fce0400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.681+0000 7fcdfa7fc700 1 -- 172.21.15.70:0/4164688707 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04007b00 con 0x7fce081021c0 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.682+0000 7fcdfa7fc700 1 -- 172.21.15.70:0/4164688707 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce04007c60 con 0x7fce081021c0 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.682+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce08197590 con 0x7fce081021c0 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.682+0000 7fcdfa7fc700 1 -- 172.21.15.70:0/4164688707 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04018660 con 0x7fce081021c0 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.682+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce081a3790 con 0x7fce081021c0 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.683+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce08105df0 con 0x7fce081021c0 2023-10-08T08:42:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.684+0000 7fcdfa7fc700 1 -- 172.21.15.70:0/4164688707 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fce04018880 con 0x7fce081021c0 2023-10-08T08:42:06.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.684+0000 7fcdfa7fc700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcdf40a14d0 0x7fcdf40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:06.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.684+0000 7fcdfa7fc700 1 -- 172.21.15.70:0/4164688707 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fce040cd370 con 0x7fce081021c0 2023-10-08T08:42:06.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.684+0000 7fce0d723700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcdf40a14d0 0x7fcdf40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:06.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.685+0000 7fce0d723700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcdf40a14d0 0x7fcdf40a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc006010 tx=0x7fcdfc01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:06.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.688+0000 7fcdfa7fc700 1 -- 172.21.15.70:0/4164688707 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fce04096790 con 0x7fce081021c0 2023-10-08T08:42:06.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.883+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce080692d0 con 0x7fce081021c0 2023-10-08T08:42:06.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.885+0000 7fcdfa7fc700 1 -- 172.21.15.70:0/4164688707 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24277 (secure 0 0 0) 0x7fce04099db0 con 0x7fce081021c0 2023-10-08T08:42:06.886 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:06.886 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:05.563861+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcdf40a14d0 msgr2=0x7fcdf40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcdf40a14d0 0x7fcdf40a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc006010 tx=0x7fcdfc01a040 comp rx=0 tx=0).stop 2023-10-08T08:42:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081021c0 msgr2=0x7fce0819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081021c0 0x7fce0819cce0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fce0400c9b0 tx=0x7fce0400cd70 comp rx=0 tx=0).stop 2023-10-08T08:42:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 shutdown_connections 2023-10-08T08:42:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcdf40a14d0 0x7fcdf40a3990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce0810ac70 0x7fce08196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce081018a0 0x7fce0819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 --2- 172.21.15.70:0/4164688707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce081021c0 0x7fce0819cce0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:06.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 >> 172.21.15.70:0/4164688707 conn(0x7fce080fb060 msgr2=0x7fce080fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:06.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 shutdown_connections 2023-10-08T08:42:06.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:06.887+0000 7fce0f987700 1 -- 172.21.15.70:0/4164688707 wait complete. 2023-10-08T08:42:06.902 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:42:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.022+0000 7f66fabdb700 1 -- 172.21.15.70:0/593143347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 msgr2=0x7f66f40ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.022+0000 7f66fabdb700 1 --2- 172.21.15.70:0/593143347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 0x7f66f40ff9c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f66e00099c0 tx=0x7f66e0009cd0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.022+0000 7f66fabdb700 1 -- 172.21.15.70:0/593143347 shutdown_connections 2023-10-08T08:42:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.022+0000 7f66fabdb700 1 --2- 172.21.15.70:0/593143347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f40fff00 0x7f66f410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.022+0000 7f66fabdb700 1 --2- 172.21.15.70:0/593143347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f4105600 0x7f66f41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.022+0000 7f66fabdb700 1 --2- 172.21.15.70:0/593143347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 0x7f66f40ff9c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.022+0000 7f66fabdb700 1 -- 172.21.15.70:0/593143347 >> 172.21.15.70:0/593143347 conn(0x7f66f40fb030 msgr2=0x7f66f40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.022+0000 7f66fabdb700 1 -- 172.21.15.70:0/593143347 shutdown_connections 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66fabdb700 1 -- 172.21.15.70:0/593143347 wait complete. 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66fabdb700 1 Processor -- start 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66fabdb700 1 -- start start 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66fabdb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 0x7f66f4197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66fabdb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f40fff00 0x7f66f4197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66fabdb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f4105600 0x7f66f41a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66fabdb700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41986e0 con 0x7f66f40ff540 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66fabdb700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41a2f10 con 0x7f66f4105600 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66fabdb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41a3050 con 0x7f66f40fff00 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66f8977700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 0x7f66f4197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66f8977700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 0x7f66f4197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49102/0 (socket says 172.21.15.70:49102) 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.023+0000 7f66f8977700 1 -- 172.21.15.70:0/610193447 learned_addr learned my addr 172.21.15.70:0/610193447 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f3fff700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f40fff00 0x7f66f4197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f9178700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f4105600 0x7f66f41a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f8977700 1 -- 172.21.15.70:0/610193447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f40fff00 msgr2=0x7f66f4197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f8977700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f40fff00 0x7f66f4197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f8977700 1 -- 172.21.15.70:0/610193447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f4105600 msgr2=0x7f66f41a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f8977700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f4105600 0x7f66f41a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f8977700 1 -- 172.21.15.70:0/610193447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e00095f0 con 0x7f66f40ff540 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f9178700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f4105600 0x7f66f41a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f3fff700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f40fff00 0x7f66f4197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f8977700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 0x7f66f4197950 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c950 tx=0x7f66e800cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f1ffb700 1 -- 172.21.15.70:0/610193447 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8007ac0 con 0x7f66f40ff540 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f1ffb700 1 -- 172.21.15.70:0/610193447 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66e8004cf0 con 0x7f66f40ff540 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f41a32b0 con 0x7f66f40ff540 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66f1ffb700 1 -- 172.21.15.70:0/610193447 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8005550 con 0x7f66f40ff540 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.024+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41a37c0 con 0x7f66f40ff540 2023-10-08T08:42:07.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.025+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f4107aa0 con 0x7f66f40ff540 2023-10-08T08:42:07.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.026+0000 7f66f1ffb700 1 -- 172.21.15.70:0/610193447 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f66e8004750 con 0x7f66f40ff540 2023-10-08T08:42:07.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.026+0000 7f66f1ffb700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66e40a1550 0x7f66e40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.027+0000 7f66f3fff700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66e40a1550 0x7f66e40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.027+0000 7f66f1ffb700 1 -- 172.21.15.70:0/610193447 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f66e80ccca0 con 0x7f66f40ff540 2023-10-08T08:42:07.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.027+0000 7f66f3fff700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66e40a1550 0x7f66e40a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66f4068020 tx=0x7f66e0005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:07.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.031+0000 7f66f1ffb700 1 -- 172.21.15.70:0/610193447 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f66e8095fd0 con 0x7f66f40ff540 2023-10-08T08:42:07.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.227+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66f4067dd0 con 0x7f66f40ff540 2023-10-08T08:42:07.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.229+0000 7f66f1ffb700 1 -- 172.21.15.70:0/610193447 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24277 (secure 0 0 0) 0x7f66e801d090 con 0x7f66f40ff540 2023-10-08T08:42:07.230 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:07.230 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:05.563861+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66e40a1550 msgr2=0x7f66e40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66e40a1550 0x7f66e40a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66f4068020 tx=0x7f66e0005fb0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 msgr2=0x7f66f4197950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 0x7f66f4197950 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c950 tx=0x7f66e800cd10 comp rx=0 tx=0).stop 2023-10-08T08:42:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 shutdown_connections 2023-10-08T08:42:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66e40a1550 0x7f66e40a3a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f4105600 0x7f66f41a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f40ff540 0x7f66f4197950 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 --2- 172.21.15.70:0/610193447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66f40fff00 0x7f66f4197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 >> 172.21.15.70:0/610193447 conn(0x7f66f40fb030 msgr2=0x7f66f40fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 shutdown_connections 2023-10-08T08:42:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.231+0000 7f66fabdb700 1 -- 172.21.15.70:0/610193447 wait complete. 2023-10-08T08:42:07.258 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:42:07.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 -- 172.21.15.70:0/657551420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0ff540 msgr2=0x7f993c0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 --2- 172.21.15.70:0/657551420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0ff540 0x7f993c0ff9c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f99280099c0 tx=0x7f9928009cd0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 -- 172.21.15.70:0/657551420 shutdown_connections 2023-10-08T08:42:07.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 --2- 172.21.15.70:0/657551420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993c0fff00 0x7f993c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 --2- 172.21.15.70:0/657551420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f993c105600 0x7f993c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 --2- 172.21.15.70:0/657551420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0ff540 0x7f993c0ff9c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 -- 172.21.15.70:0/657551420 >> 172.21.15.70:0/657551420 conn(0x7f993c0fb030 msgr2=0x7f993c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 -- 172.21.15.70:0/657551420 shutdown_connections 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 -- 172.21.15.70:0/657551420 wait complete. 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 Processor -- start 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.379+0000 7f9942ac1700 1 -- start start 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9942ac1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f993c0ff540 0x7f993c1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9942ac1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0fff00 0x7f993c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9942ac1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993c105600 0x7f993c1a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9942ac1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c198680 con 0x7f993c0fff00 2023-10-08T08:42:07.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9942ac1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c1a2e90 con 0x7f993c105600 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9942ac1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c1a2fd0 con 0x7f993c0ff540 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f993bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0fff00 0x7f993c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f993bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0fff00 0x7f993c197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49118/0 (socket says 172.21.15.70:49118) 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f993bfff700 1 -- 172.21.15.70:0/27591721 learned_addr learned my addr 172.21.15.70:0/27591721 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f994085d700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f993c0ff540 0x7f993c1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f993bfff700 1 -- 172.21.15.70:0/27591721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f993c0ff540 msgr2=0x7f993c1978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f993bfff700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f993c0ff540 0x7f993c1978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f993bfff700 1 -- 172.21.15.70:0/27591721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993c105600 msgr2=0x7f993c1a2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f993bfff700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993c105600 0x7f993c1a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f993bfff700 1 -- 172.21.15.70:0/27591721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280095f0 con 0x7f993c0fff00 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f993bfff700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0fff00 0x7f993c197e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f992800b580 tx=0x7f992800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:07.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9939ffb700 1 -- 172.21.15.70:0/27591721 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992801c070 con 0x7f993c0fff00 2023-10-08T08:42:07.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9939ffb700 1 -- 172.21.15.70:0/27591721 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f992800fe60 con 0x7f993c0fff00 2023-10-08T08:42:07.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c1a3200 con 0x7f993c0fff00 2023-10-08T08:42:07.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.380+0000 7f9939ffb700 1 -- 172.21.15.70:0/27591721 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9928022d20 con 0x7f993c0fff00 2023-10-08T08:42:07.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.381+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c1a3680 con 0x7f993c0fff00 2023-10-08T08:42:07.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.381+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c107aa0 con 0x7f993c0fff00 2023-10-08T08:42:07.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.383+0000 7f9939ffb700 1 -- 172.21.15.70:0/27591721 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f9928020070 con 0x7f993c0fff00 2023-10-08T08:42:07.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.384+0000 7f9939ffb700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f992c0a1550 0x7f992c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.384+0000 7f994085d700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f992c0a1550 0x7f992c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.384+0000 7f9939ffb700 1 -- 172.21.15.70:0/27591721 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f99280ce230 con 0x7f993c0fff00 2023-10-08T08:42:07.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.384+0000 7f994085d700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f992c0a1550 0x7f992c0a3a10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9930005950 tx=0x7f99300058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:07.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.387+0000 7f9939ffb700 1 -- 172.21.15.70:0/27591721 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9928097650 con 0x7f993c0fff00 2023-10-08T08:42:07.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:07 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1549398047' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-08T08:42:07.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:07 smithi070 ceph-mon[99513]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T08:42:07.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:07 smithi070 ceph-mon[99513]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:07.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:07 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1382511765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:42:07.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:07 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4164688707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:07.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:07 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1549398047' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-08T08:42:07.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:07 smithi105 ceph-mon[103798]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T08:42:07.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:07 smithi105 ceph-mon[103798]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:07.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:07 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1382511765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:42:07.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:07 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4164688707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:07.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:07 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1549398047' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-08T08:42:07.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:07 smithi191 ceph-mon[104220]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T08:42:07.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:07 smithi191 ceph-mon[104220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:07.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:07 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1382511765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:42:07.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:07 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4164688707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:07.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.622+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f993c100c60 con 0x7f993c0fff00 2023-10-08T08:42:07.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.623+0000 7f9939ffb700 1 -- 172.21.15.70:0/27591721 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11264 (secure 0 0 0) 0x7f992809ac70 con 0x7f993c0fff00 2023-10-08T08:42:07.624 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:07.624 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24577,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24604,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:05.564039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24638},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-08T08:42:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f992c0a1550 msgr2=0x7f992c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f992c0a1550 0x7f992c0a3a10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9930005950 tx=0x7f99300058e0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0fff00 msgr2=0x7f993c197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0fff00 0x7f993c197e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f992800b580 tx=0x7f992800f740 comp rx=0 tx=0).stop 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 shutdown_connections 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f992c0a1550 0x7f992c0a3a10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993c105600 0x7f993c1a2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f993c0ff540 0x7f993c1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 --2- 172.21.15.70:0/27591721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f993c0fff00 0x7f993c197e10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 >> 172.21.15.70:0/27591721 conn(0x7f993c0fb030 msgr2=0x7f993c0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 shutdown_connections 2023-10-08T08:42:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.625+0000 7f9942ac1700 1 -- 172.21.15.70:0/27591721 wait complete. 2023-10-08T08:42:07.628 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 17 2023-10-08T08:42:07.639 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:42:07.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.759+0000 7f1254fbd700 1 -- 172.21.15.70:0/1455105892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f125010ac80 msgr2=0x7f125010d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.759+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1455105892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f125010ac80 0x7f125010d0f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f124800b0a0 tx=0x7f124800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.759+0000 7f1254fbd700 1 -- 172.21.15.70:0/1455105892 shutdown_connections 2023-10-08T08:42:07.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.759+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1455105892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f125010ac80 0x7f125010d0f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.759+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1455105892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12501018b0 0x7f1250101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.759+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1455105892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12501021d0 0x7f125010a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.759+0000 7f1254fbd700 1 -- 172.21.15.70:0/1455105892 >> 172.21.15.70:0/1455105892 conn(0x7f12500fb050 msgr2=0x7f12500fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.759+0000 7f1254fbd700 1 -- 172.21.15.70:0/1455105892 shutdown_connections 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.759+0000 7f1254fbd700 1 -- 172.21.15.70:0/1455105892 wait complete. 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 Processor -- start 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 -- start start 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12501018b0 0x7f125019c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12501021d0 0x7f125019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f125010ac80 0x7f1250196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250197000 con 0x7f12501018b0 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250197170 con 0x7f125010ac80 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250197330 con 0x7f12501021d0 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12501018b0 0x7f125019c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12501018b0 0x7f125019c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49130/0 (socket says 172.21.15.70:49130) 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124e59c700 1 -- 172.21.15.70:0/1710466440 learned_addr learned my addr 172.21.15.70:0/1710466440 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124dd9b700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12501021d0 0x7f125019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124ed9d700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f125010ac80 0x7f1250196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124e59c700 1 -- 172.21.15.70:0/1710466440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12501021d0 msgr2=0x7f125019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124e59c700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12501021d0 0x7f125019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124e59c700 1 -- 172.21.15.70:0/1710466440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f125010ac80 msgr2=0x7f1250196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124e59c700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f125010ac80 0x7f1250196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124e59c700 1 -- 172.21.15.70:0/1710466440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248009d00 con 0x7f12501018b0 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124ed9d700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f125010ac80 0x7f1250196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f124e59c700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12501018b0 0x7f125019c860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f124400c9b0 tx=0x7f124400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f123f7fe700 1 -- 172.21.15.70:0/1710466440 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244007b00 con 0x7f12501018b0 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f123f7fe700 1 -- 172.21.15.70:0/1710466440 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1244007c60 con 0x7f12501018b0 2023-10-08T08:42:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1250197610 con 0x7f12501018b0 2023-10-08T08:42:07.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f123f7fe700 1 -- 172.21.15.70:0/1710466440 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244018660 con 0x7f12501018b0 2023-10-08T08:42:07.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.760+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12501a3850 con 0x7f12501018b0 2023-10-08T08:42:07.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.761+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1250105e00 con 0x7f12501018b0 2023-10-08T08:42:07.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.762+0000 7f123f7fe700 1 -- 172.21.15.70:0/1710466440 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f1244018880 con 0x7f12501018b0 2023-10-08T08:42:07.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.763+0000 7f123f7fe700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f12380a14d0 0x7f12380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:07.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.763+0000 7f124dd9b700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f12380a14d0 0x7f12380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:07.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.763+0000 7f123f7fe700 1 -- 172.21.15.70:0/1710466440 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f12440cd0a0 con 0x7f12501018b0 2023-10-08T08:42:07.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.763+0000 7f124dd9b700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f12380a14d0 0x7f12380a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1240005950 tx=0x7f12400058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:07.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.767+0000 7f123f7fe700 1 -- 172.21.15.70:0/1710466440 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1244096430 con 0x7f12501018b0 2023-10-08T08:42:07.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.956+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1250197e50 con 0x7f12501018b0 2023-10-08T08:42:07.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.957+0000 7f123f7fe700 1 -- 172.21.15.70:0/1710466440 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24277 (secure 0 0 0) 0x7f1244099a50 con 0x7f12501018b0 2023-10-08T08:42:07.959 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:07.959 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:05.563861+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f12380a14d0 msgr2=0x7f12380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f12380a14d0 0x7f12380a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1240005950 tx=0x7f12400058e0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12501018b0 msgr2=0x7f125019c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12501018b0 0x7f125019c860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f124400c9b0 tx=0x7f124400cd70 comp rx=0 tx=0).stop 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 shutdown_connections 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f12380a14d0 0x7f12380a3990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f125010ac80 0x7f1250196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12501018b0 0x7f125019c860 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 --2- 172.21.15.70:0/1710466440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12501021d0 0x7f125019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 >> 172.21.15.70:0/1710466440 conn(0x7f12500fb050 msgr2=0x7f12500fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.959+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 shutdown_connections 2023-10-08T08:42:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:07.960+0000 7f1254fbd700 1 -- 172.21.15.70:0/1710466440 wait complete. 2023-10-08T08:42:07.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T08:42:00.508850+0000', 'modified': '2023-10-08T08:42:05.564039+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24638}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24638': {'gid': 24638, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6839/586756410', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6838', 'nonce': 586756410}, {'type': 'v1', 'addr': '172.21.15.105:6839', 'nonce': 586756410}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-08T08:42:07.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T08:42:07.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T08:42:08.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.093+0000 7fd20f9f0700 1 -- 172.21.15.70:0/1423722391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 msgr2=0x7fd208100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:08.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.093+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/1423722391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 0x7fd208100640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009990 tx=0x7fd1f8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 -- 172.21.15.70:0/1423722391 shutdown_connections 2023-10-08T08:42:08.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/1423722391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd208100b80 0x7fd20810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/1423722391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2081046a0 0x7fd208104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/1423722391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 0x7fd208100640 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 -- 172.21.15.70:0/1423722391 >> 172.21.15.70:0/1423722391 conn(0x7fd208074940 msgr2=0x7fd208074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:08.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 -- 172.21.15.70:0/1423722391 shutdown_connections 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 -- 172.21.15.70:0/1423722391 wait complete. 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 Processor -- start 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 -- start start 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 0x7fd208197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd208100b80 0x7fd208197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2081046a0 0x7fd2081a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208198790 con 0x7fd2081001c0 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081a2fc0 con 0x7fd208100b80 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.094+0000 7fd20f9f0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081a3100 con 0x7fd2081046a0 2023-10-08T08:42:08.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20d78c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 0x7fd208197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20d78c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 0x7fd208197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49144/0 (socket says 172.21.15.70:49144) 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20d78c700 1 -- 172.21.15.70:0/455766371 learned_addr learned my addr 172.21.15.70:0/455766371 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20df8d700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2081046a0 0x7fd2081a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd208100b80 0x7fd208197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20d78c700 1 -- 172.21.15.70:0/455766371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2081046a0 msgr2=0x7fd2081a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20d78c700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2081046a0 0x7fd2081a2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20d78c700 1 -- 172.21.15.70:0/455766371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd208100b80 msgr2=0x7fd208197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20d78c700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd208100b80 0x7fd208197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20d78c700 1 -- 172.21.15.70:0/455766371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80095f0 con 0x7fd2081001c0 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20df8d700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2081046a0 0x7fd2081a2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:08.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20d78c700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 0x7fd208197a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd20400d9b0 tx=0x7fd20400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:08.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd1fe7fc700 1 -- 172.21.15.70:0/455766371 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400be80 con 0x7fd2081001c0 2023-10-08T08:42:08.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20f9f0700 1 -- 172.21.15.70:0/455766371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2081a3360 con 0x7fd2081001c0 2023-10-08T08:42:08.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd1fe7fc700 1 -- 172.21.15.70:0/455766371 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2040044e0 con 0x7fd2081001c0 2023-10-08T08:42:08.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd1fe7fc700 1 -- 172.21.15.70:0/455766371 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204003b40 con 0x7fd2081001c0 2023-10-08T08:42:08.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.095+0000 7fd20f9f0700 1 -- 172.21.15.70:0/455766371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2081a38c0 con 0x7fd2081001c0 2023-10-08T08:42:08.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.097+0000 7fd1fe7fc700 1 -- 172.21.15.70:0/455766371 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd204009940 con 0x7fd2081001c0 2023-10-08T08:42:08.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.098+0000 7fd1fe7fc700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a14d0 0x7fd1f40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.098+0000 7fd1fe7fc700 1 -- 172.21.15.70:0/455766371 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fd2040ccdc0 con 0x7fd2081001c0 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.098+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a14d0 0x7fd1f40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.098+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a14d0 0x7fd1f40a3990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8006010 tx=0x7fd1f800b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd21bbd9b80 1 Processor -- start 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd21bbd9b80 1 -- start start 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9ae30 0x557e2ff9b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9b750 0x557e2ffa60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 0x557e2ffa89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e2ff04410 con 0x557e2ff9b750 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e2fef5bd0 con 0x557e2ff9ae30 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e2fef34f0 con 0x557e2ffa6600 2023-10-08T08:42:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd20cf8b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9b750 0x557e2ffa60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd20cf8b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9b750 0x557e2ffa60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49154/0 (socket says 172.21.15.70:49154) 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd20cf8b700 1 -- 172.21.15.70:0/4036018486 learned_addr learned my addr 172.21.15.70:0/4036018486 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd20d78c700 1 --2- 172.21.15.70:0/4036018486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9ae30 0x557e2ff9b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd20df8d700 1 --2- 172.21.15.70:0/4036018486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 0x557e2ffa89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd20cf8b700 1 -- 172.21.15.70:0/4036018486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 msgr2=0x557e2ffa89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.099+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/4036018486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 0x557e2ffa89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.100+0000 7fd20cf8b700 1 -- 172.21.15.70:0/4036018486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9ae30 msgr2=0x557e2ff9b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.100+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/4036018486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9ae30 0x557e2ff9b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.100+0000 7fd20cf8b700 1 -- 172.21.15.70:0/4036018486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e2fd19d90 con 0x557e2ff9b750 2023-10-08T08:42:08.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.100+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/4036018486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9b750 0x557e2ffa60c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8015000 tx=0x7fd1f801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41252fc75c33edf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.100+0000 7fd1f37fe700 1 -- 172.21.15.70:0/4036018486 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f802b070 con 0x557e2ff9b750 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.100+0000 7fd1f37fe700 1 -- 172.21.15.70:0/4036018486 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1f801e040 con 0x557e2ff9b750 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.100+0000 7fd1f37fe700 1 -- 172.21.15.70:0/4036018486 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800f6c0 con 0x557e2ff9b750 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.100+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/4036018486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9b750 msgr2=0x557e2ffa60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.100+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/4036018486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9b750 0x557e2ffa60c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8015000 tx=0x7fd1f801f000 comp rx=0 tx=0).stop 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/4036018486 shutdown_connections 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/4036018486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 0x557e2ffa89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/4036018486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9ae30 0x557e2ff9b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/4036018486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9b750 0x557e2ffa60c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/4036018486 >> 172.21.15.70:0/4036018486 conn(0x557e2ff10210 msgr2=0x557e2ff97280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/4036018486 shutdown_connections 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/4036018486 wait complete. 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 -- start start 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 Processor -- start 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffa5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 0x557e2ffa3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 0x557e2ffa3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e2feeede0 con 0x557e2ff9ae30 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e2fe8b6c0 con 0x557e2ff9b750 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.101+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e2fe8b360 con 0x557e2ffa6600 2023-10-08T08:42:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd21bbd9b80 10 client.0 _ll_register_callbacks cb 0x557e2fce87b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20d78c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffa5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20d78c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffa5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49158/0 (socket says 172.21.15.70:49158) 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20d78c700 1 -- 172.21.15.70:0/3583136332 learned_addr learned my addr 172.21.15.70:0/3583136332 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 0x557e2ffa3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20df8d700 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 0x557e2ffa3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20d78c700 1 -- 172.21.15.70:0/3583136332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 msgr2=0x557e2ffa3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20d78c700 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 0x557e2ffa3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20d78c700 1 -- 172.21.15.70:0/3583136332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 msgr2=0x557e2ffa3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20d78c700 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 0x557e2ffa3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20d78c700 1 -- 172.21.15.70:0/3583136332 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20810cda0 con 0x557e2ff9ae30 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd20d78c700 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffa5f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd2040ca960 tx=0x7fd20409a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8336c3d1740b2132 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd1f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/3583136332 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040a21a0 con 0x557e2ff9ae30 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/3583136332 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fd20409a070 con 0x557e2ff9ae30 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/3583136332 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e2feb6e60 con 0x557e2ff9ae30 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/3583136332 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd20409a230 con 0x557e2ff9ae30 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd21bbd9b80 10 client.14913 fetch_fsmap learned FSMap version 17 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/3583136332 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x557e2fd02c10 con 0x557e2ff9ae30 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.102+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/3583136332 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd204063020 con 0x557e2ff9ae30 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/3583136332 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fd2040a1da0 con 0x557e2ff9ae30 2023-10-08T08:42:08.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd21bbd9b80 10 client.14913 fetch_fsmap finished waiting for FSMap version 17 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd21bbd9b80 10 client.14913 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd21bbd9b80 20 client.14913 populate_metadata read hostname 'smithi070' 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557e2ffb6010 0x557e2ffb4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd21bbd9b80 4 client.14913 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/3583136332 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e2fee7dc0 con 0x557e2ffb6010 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557e2ffb6010 0x557e2ffb4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd1f0ff9700 10 client.14913 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.103+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557e2ffb6010 0x557e2ffb4b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e88ec598486d167 server_cookie=fd8339a7ee7378bd in_seq=0 out_seq=0 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/3583136332 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557e2fee7dc0 con 0x557e2ffb6010 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd1f0ff9700 10 client.14913 handle_command_reply: tid=0 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd21bbd9b80 1 client.14913 shutdown 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/3583136332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 msgr2=0x557e2ffa5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffa5f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd2040ca960 tx=0x7fd20409a640 comp rx=0 tx=0).stop 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/3583136332 shutdown_connections 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ffa6600 0x557e2ffa3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffa5f90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557e2ffb6010 0x557e2ffb4b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/3583136332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 0x557e2ffa3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd1f0ff9700 0 client.14913 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.104+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/3583136332 >> 172.21.15.70:0/3583136332 conn(0x557e2ff10210 msgr2=0x557e2ff96e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.105+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/3583136332 shutdown_connections 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.105+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/3583136332 wait complete. 2023-10-08T08:42:08.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.105+0000 7fd21bbd9b80 20 client.14913 trim_cache size 0 max 16384 2023-10-08T08:42:08.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd21bbd9b80 1 Processor -- start 2023-10-08T08:42:08.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd21bbd9b80 1 -- start start 2023-10-08T08:42:08.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffb20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ff9b750 0x557e2ffbe980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ffa6600 0x557e2ffa3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e2fd6f8d0 con 0x557e2ff9ae30 2023-10-08T08:42:08.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e2fd7bde0 con 0x557e2ffa6600 2023-10-08T08:42:08.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e2fead590 con 0x557e2ff9b750 2023-10-08T08:42:08.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd20d78c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffb20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd20d78c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffb20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49166/0 (socket says 172.21.15.70:49166) 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd20d78c700 1 -- 172.21.15.70:0/2732697608 learned_addr learned my addr 172.21.15.70:0/2732697608 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd20d78c700 1 -- 172.21.15.70:0/2732697608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ff9b750 msgr2=0x557e2ffbe980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd20d78c700 1 --2- 172.21.15.70:0/2732697608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ff9b750 0x557e2ffbe980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd20d78c700 1 -- 172.21.15.70:0/2732697608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ffa6600 msgr2=0x557e2ffa3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd20d78c700 1 --2- 172.21.15.70:0/2732697608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ffa6600 0x557e2ffa3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.124+0000 7fd20d78c700 1 -- 172.21.15.70:0/2732697608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e2fd40200 con 0x557e2ff9ae30 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd20d78c700 1 --2- 172.21.15.70:0/2732697608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffb20b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd204096310 tx=0x7fd204099950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5456211473fc2a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd1f3fff700 1 -- 172.21.15.70:0/2732697608 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040cabf0 con 0x557e2ff9ae30 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd1f3fff700 1 -- 172.21.15.70:0/2732697608 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd204063070 con 0x557e2ff9ae30 2023-10-08T08:42:08.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd1f3fff700 1 -- 172.21.15.70:0/2732697608 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040a1d10 con 0x557e2ff9ae30 2023-10-08T08:42:08.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/2732697608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 msgr2=0x557e2ffb20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:08.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/2732697608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffb20b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd204096310 tx=0x7fd204099950 comp rx=0 tx=0).stop 2023-10-08T08:42:08.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/2732697608 shutdown_connections 2023-10-08T08:42:08.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/2732697608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ffa6600 0x557e2ffa3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/2732697608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ff9ae30 0x557e2ffb20b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/2732697608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ff9b750 0x557e2ffbe980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/2732697608 >> 172.21.15.70:0/2732697608 conn(0x557e2ff10210 msgr2=0x557e2ff9e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:08.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/2732697608 shutdown_connections 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.125+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/2732697608 wait complete. 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd21bbd9b80 1 -- start start 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd21bbd9b80 1 Processor -- start 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ff9ae30 0x557e2ffb90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 0x557e2ffb9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd21bbd9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ffa6600 0x557e2ffb9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e30009a00 con 0x557e2ffa6600 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e30009b40 con 0x557e2ff9b750 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd21bbd9b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e30009c80 con 0x557e2ff9ae30 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd21bbd9b80 10 client.0 _ll_register_callbacks cb 0x7fd204099770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd20df8d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ffa6600 0x557e2ffb9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd20df8d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ffa6600 0x557e2ffb9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49176/0 (socket says 172.21.15.70:49176) 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd20df8d700 1 -- 172.21.15.70:0/1046195513 learned_addr learned my addr 172.21.15.70:0/1046195513 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd20d78c700 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ff9ae30 0x557e2ffb90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 0x557e2ffb9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.126+0000 7fd20df8d700 1 -- 172.21.15.70:0/1046195513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ff9ae30 msgr2=0x557e2ffb90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd20df8d700 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ff9ae30 0x557e2ffb90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd20df8d700 1 -- 172.21.15.70:0/1046195513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 msgr2=0x557e2ffb9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd20df8d700 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 0x557e2ffb9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd20df8d700 1 -- 172.21.15.70:0/1046195513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e2fd02c10 con 0x557e2ffa6600 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd20cf8b700 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 0x557e2ffb9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd20df8d700 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ffa6600 0x557e2ffb9b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd20000aa20 tx=0x7fd20000aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77af7756e2cbc729 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd1f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/1046195513 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200015590 con 0x557e2ffa6600 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/1046195513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1f801e040 con 0x557e2ffa6600 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/1046195513 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fd200006e40 con 0x557e2ffa6600 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/1046195513 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd200009940 con 0x557e2ffa6600 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd21bbd9b80 10 client.14919 fetch_fsmap learned FSMap version 17 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/1046195513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x557e2fd18260 con 0x557e2ffa6600 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/1046195513 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1f801e040 con 0x557e2ffa6600 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/1046195513 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fd2000169d0 con 0x557e2ffa6600 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd21bbd9b80 10 client.14919 fetch_fsmap finished waiting for FSMap version 17 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd21bbd9b80 10 client.14919 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd21bbd9b80 20 client.14919 populate_metadata read hostname 'smithi070' 2023-10-08T08:42:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557e3000f030 0x557e3000b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd21bbd9b80 4 client.14919 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.127+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/1046195513 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557e2fee7ae0 con 0x557e3000f030 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd20d78c700 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557e3000f030 0x557e3000b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd20d78c700 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557e3000f030 0x557e3000b4d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64566c013a6ab3e server_cookie=59912944ac159f6b in_seq=0 out_seq=0 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd1f0ff9700 10 client.14919 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd1f0ff9700 1 -- 172.21.15.70:0/1046195513 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x557e2fee7ae0 con 0x557e3000f030 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd1f0ff9700 10 client.14919 handle_command_reply: tid=0 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd21bbd9b80 1 client.14919 shutdown 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/1046195513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ffa6600 msgr2=0x557e2ffb9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ffa6600 0x557e2ffb9b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd20000aa20 tx=0x7fd20000aa50 comp rx=0 tx=0).stop 2023-10-08T08:42:08.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/1046195513 shutdown_connections 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e2ffa6600 0x557e2ffb9b60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557e2ff9ae30 0x557e2ffb90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557e3000f030 0x557e3000b4d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd21bbd9b80 1 --2- 172.21.15.70:0/1046195513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e2ff9b750 0x557e2ffb9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd1f0ff9700 0 client.14919 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.128+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/1046195513 >> 172.21.15.70:0/1046195513 conn(0x557e2ff10210 msgr2=0x557e2ffa1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/1046195513 shutdown_connections 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd21bbd9b80 1 -- 172.21.15.70:0/1046195513 wait complete. 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd21bbd9b80 20 client.14919 trim_cache size 0 max 16384 2023-10-08T08:42:08.137 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24638, 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 7.0121494039999996, 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 17, 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 86, 2023-10-08T08:42:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 85, 2023-10-08T08:42:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 13.371221165 2023-10-08T08:42:08.139 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:42:08.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 -- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a14d0 msgr2=0x7fd1f40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:08.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a14d0 0x7fd1f40a3990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8006010 tx=0x7fd1f800b540 comp rx=0 tx=0).stop 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 -- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 msgr2=0x7fd208197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 0x7fd208197a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd20400d9b0 tx=0x7fd20400dd70 comp rx=0 tx=0).stop 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 -- 172.21.15.70:0/455766371 shutdown_connections 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a14d0 0x7fd1f40a3990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2081046a0 0x7fd2081a2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2081001c0 0x7fd208197a00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 --2- 172.21.15.70:0/455766371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd208100b80 0x7fd208197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 -- 172.21.15.70:0/455766371 >> 172.21.15.70:0/455766371 conn(0x7fd208074940 msgr2=0x7fd2080fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 -- 172.21.15.70:0/455766371 shutdown_connections 2023-10-08T08:42:08.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:08.129+0000 7fd20f9f0700 1 -- 172.21.15.70:0/455766371 wait complete. 2023-10-08T08:42:08.142 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T08:42:08.142 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-08T08:42:08.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-08T08:42:08.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:08 smithi070 ceph-mon[99513]: pgmap v238: 129 pgs: 17 creating+peering, 106 active+clean, 6 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-08T08:42:08.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:08 smithi070 ceph-mon[99513]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T08:42:08.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:08 smithi070 ceph-mon[99513]: Cluster is now healthy 2023-10-08T08:42:08.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:08 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/610193447' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:08.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:08 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/27591721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:42:08.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:08 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1710466440' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:08 smithi105 ceph-mon[103798]: pgmap v238: 129 pgs: 17 creating+peering, 106 active+clean, 6 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-08T08:42:08.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:08 smithi105 ceph-mon[103798]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T08:42:08.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:08 smithi105 ceph-mon[103798]: Cluster is now healthy 2023-10-08T08:42:08.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:08 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/610193447' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:08.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:08 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/27591721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:42:08.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:08 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1710466440' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:08 smithi191 ceph-mon[104220]: pgmap v238: 129 pgs: 17 creating+peering, 106 active+clean, 6 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-08T08:42:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:08 smithi191 ceph-mon[104220]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T08:42:08.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:08 smithi191 ceph-mon[104220]: Cluster is now healthy 2023-10-08T08:42:08.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:08 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/610193447' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:08.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:08 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/27591721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:42:08.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:08 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1710466440' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.925+0000 7f06d20a9700 1 -- 172.21.15.70:0/2822494133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc0ff750 msgr2=0x7f06cc0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.925+0000 7f06d20a9700 1 --2- 172.21.15.70:0/2822494133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc0ff750 0x7f06cc0ffbd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009990 tx=0x7f06c0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.925+0000 7f06d20a9700 1 -- 172.21.15.70:0/2822494133 shutdown_connections 2023-10-08T08:42:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.925+0000 7f06d20a9700 1 --2- 172.21.15.70:0/2822494133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06cc100110 0x7f06cc10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.925+0000 7f06d20a9700 1 --2- 172.21.15.70:0/2822494133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06cc1056b0 0x7f06cc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.925+0000 7f06d20a9700 1 --2- 172.21.15.70:0/2822494133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc0ff750 0x7f06cc0ffbd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.925+0000 7f06d20a9700 1 -- 172.21.15.70:0/2822494133 >> 172.21.15.70:0/2822494133 conn(0x7f06cc075790 msgr2=0x7f06cc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.926+0000 7f06d20a9700 1 -- 172.21.15.70:0/2822494133 shutdown_connections 2023-10-08T08:42:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.926+0000 7f06d20a9700 1 -- 172.21.15.70:0/2822494133 wait complete. 2023-10-08T08:42:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.926+0000 7f06d20a9700 1 Processor -- start 2023-10-08T08:42:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.926+0000 7f06d20a9700 1 -- start start 2023-10-08T08:42:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.926+0000 7f06d20a9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06cc0ff750 0x7f06cc197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.926+0000 7f06d20a9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc100110 0x7f06cc198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06d20a9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06cc1056b0 0x7f06cc1a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06d20a9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1988d0 con 0x7f06cc100110 2023-10-08T08:42:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06d20a9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1a3100 con 0x7f06cc1056b0 2023-10-08T08:42:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06d20a9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1a3240 con 0x7f06cc0ff750 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06caffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc100110 0x7f06cc198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06caffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc100110 0x7f06cc198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49186/0 (socket says 172.21.15.70:49186) 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06caffd700 1 -- 172.21.15.70:0/3681245228 learned_addr learned my addr 172.21.15.70:0/3681245228 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06cb7fe700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06cc0ff750 0x7f06cc197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06cbfff700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06cc1056b0 0x7f06cc1a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06caffd700 1 -- 172.21.15.70:0/3681245228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06cc0ff750 msgr2=0x7f06cc197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06caffd700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06cc0ff750 0x7f06cc197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06caffd700 1 -- 172.21.15.70:0/3681245228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06cc1056b0 msgr2=0x7f06cc1a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06caffd700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06cc1056b0 0x7f06cc1a2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06caffd700 1 -- 172.21.15.70:0/3681245228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c00095f0 con 0x7f06cc100110 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06caffd700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc100110 0x7f06cc198080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f06c000f7d0 tx=0x7f06c000f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06c8ff9700 1 -- 172.21.15.70:0/3681245228 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c001d070 con 0x7f06cc100110 2023-10-08T08:42:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06c8ff9700 1 -- 172.21.15.70:0/3681245228 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06c000fdd0 con 0x7f06cc100110 2023-10-08T08:42:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc1a3440 con 0x7f06cc100110 2023-10-08T08:42:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06c8ff9700 1 -- 172.21.15.70:0/3681245228 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0017790 con 0x7f06cc100110 2023-10-08T08:42:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.927+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc1a38b0 con 0x7f06cc100110 2023-10-08T08:42:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.928+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc107cd0 con 0x7f06cc100110 2023-10-08T08:42:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.929+0000 7f06c8ff9700 1 -- 172.21.15.70:0/3681245228 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f06c0022aa0 con 0x7f06cc100110 2023-10-08T08:42:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.930+0000 7f06c8ff9700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06b40a1550 0x7f06b40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.930+0000 7f06c8ff9700 1 -- 172.21.15.70:0/3681245228 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f06c00ce680 con 0x7f06cc100110 2023-10-08T08:42:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.930+0000 7f06cb7fe700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06b40a1550 0x7f06b40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.930+0000 7f06cb7fe700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06b40a1550 0x7f06b40a3a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f06bc006fd0 tx=0x7f06bc008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:09.933+0000 7f06c8ff9700 1 -- 172.21.15.70:0/3681245228 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f06c0097aa0 con 0x7f06cc100110 2023-10-08T08:42:10.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.169+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f06cc068730 con 0x7f06cc100110 2023-10-08T08:42:10.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.169+0000 7f06c8ff9700 1 -- 172.21.15.70:0/3681245228 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f06c0027070 con 0x7f06cc100110 2023-10-08T08:42:10.171 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-08T08:42:10.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.171+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06b40a1550 msgr2=0x7f06b40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.171+0000 7f06d20a9700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06b40a1550 0x7f06b40a3a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f06bc006fd0 tx=0x7f06bc008040 comp rx=0 tx=0).stop 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.171+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc100110 msgr2=0x7f06cc198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.171+0000 7f06d20a9700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc100110 0x7f06cc198080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f06c000f7d0 tx=0x7f06c000f8b0 comp rx=0 tx=0).stop 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.172+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 shutdown_connections 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.172+0000 7f06d20a9700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06b40a1550 0x7f06b40a3a10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.172+0000 7f06d20a9700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06cc1056b0 0x7f06cc1a2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.172+0000 7f06d20a9700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06cc0ff750 0x7f06cc197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.172+0000 7f06d20a9700 1 --2- 172.21.15.70:0/3681245228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06cc100110 0x7f06cc198080 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.172+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 >> 172.21.15.70:0/3681245228 conn(0x7f06cc075790 msgr2=0x7f06cc0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.172+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 shutdown_connections 2023-10-08T08:42:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:10.172+0000 7f06d20a9700 1 -- 172.21.15.70:0/3681245228 wait complete. 2023-10-08T08:42:10.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:10 smithi070 ceph-mon[99513]: pgmap v239: 129 pgs: 17 creating+peering, 112 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2023-10-08T08:42:10.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:10 smithi105 ceph-mon[103798]: pgmap v239: 129 pgs: 17 creating+peering, 112 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2023-10-08T08:42:10.551 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T08:42:10.551 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T08:42:10.551 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2023-10-08T08:42:10.551 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-08T08:42:10.551 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-08T08:42:10.551 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T08:42:10.552 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T08:42:10.552 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T08:42:10.552 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-08T08:42:10.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:10.552 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2023-10-08T08:42:10.571 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T08:42:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T08:42:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T08:42:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-10-08T08:42:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-10-08T08:42:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-10-08T08:42:10.572 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T08:42:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2023-10-08T08:42:10.572 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T08:42:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2023-10-08T08:42:10.573 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T08:42:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2023-10-08T08:42:10.573 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T08:42:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2023-10-08T08:42:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T08:42:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 41897sec preferred_lft 41897sec 2023-10-08T08:42:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::5cfd:8641:c68e:a723/64 scope link noprefixroute 2023-10-08T08:42:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-10-08T08:42:10.574 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T08:42:10.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:10.575 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:42:10.575 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:42:10.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2023-10-08T08:42:10.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2023-10-08T08:42:10.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2023-10-08T08:42:10.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T08:42:10.576 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:42:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:10 smithi191 ceph-mon[104220]: pgmap v239: 129 pgs: 17 creating+peering, 112 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2023-10-08T08:42:10.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:10.742 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T08:42:10.770 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-10-08T08:42:10.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:10.772 DEBUG:teuthology.orchestra.run.smithi070:> route 2023-10-08T08:42:10.847 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2023-10-08T08:42:10.847 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T08:42:10.847 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T08:42:10.847 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T08:42:10.848 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T08:42:10.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:10.848 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:42:10.848 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:42:10.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T08:42:10.849 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T08:42:10.849 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T08:42:10.849 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:42:11.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:11.102 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-10-08T08:42:11.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:11.120 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2023-10-08T08:42:11.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:11.178 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:42:11.178 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:42:11.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T08:42:11.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-08T08:42:11.178 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:42:11.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:11 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3681245228' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T08:42:11.272 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-08T08:42:11.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:11.272 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:42:11.272 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:42:11.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-08T08:42:11.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T08:42:11.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-08T08:42:11.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-08T08:42:11.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-08T08:42:11.273 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:42:11.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:11.469 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:42:11.470 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:42:11.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2023-10-08T08:42:11.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T08:42:11.470 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:42:11.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:11 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3681245228' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T08:42:11.570 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-08T08:42:11.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T08:42:11.570 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-08T08:42:11.587 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-08T08:42:11.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T08:42:11.587 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-08T08:42:11.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:11 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3681245228' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T08:42:11.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-10-08T08:42:11.710 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T08:42:11.768 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-10-08T08:42:11.768 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-10-08T08:42:11.768 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-10-08T08:42:11.768 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/systemd 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/pids 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/cpuset 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T08:42:11.769 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/memory 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/rdma 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/devices 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/perf_event 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/freezer 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/blkio 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-10-08T08:42:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/c3b31ebab99267debcf866bfefe5888cad34809b8d494aa218e7b64c9f3f6e2e/merged 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/506cf7cbc13ec640d172dc21f51247df8213b898d976bd8254602b9acc270664/merged 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T08:42:11.771 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2fd42641a541b82ca97e62d7a7b781a3b16aa08bda35e254795036598df1fa52/merged 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/c075158c1a5f0dcecd2e2304e9fc4ebb48a6f495a52733c6cf40f2aaeb1118de/merged 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/fdbbf7823f0e5362bbdafbef3bf2b667cb20cd5563e94f391d74f87bfb7bc2a9/merged 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/7e33b169142701db73e16af1de9f401b7e752aac7e4a8d4aaa922490dba422f2/merged 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/0f3c34c5c9c27cb9343584401887e2951bc93a236efa6d01b24a3cfd53ad92cf/merged 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/db42bb71533b41fa0fb1a06ab3c457cc1fc0596c813e19ebd1618d8cf31e8782/merged 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/29c2c0675e1c0400798bcd615c21878917423e79d7997d92c482e82c9930c293/merged 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/e602f44cf9227a1f1845f166f50918ec5864615f381c3107bcf87c46d85c8253/merged 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T08:42:11.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:11.773 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-10-08T08:42:11.825 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T08:42:11.825 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-08T08:42:11.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-10-08T08:42:11.893 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T08:42:11.952 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-10-08T08:42:11.952 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-10-08T08:42:11.952 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-10-08T08:42:11.952 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-10-08T08:42:11.952 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-10-08T08:42:11.952 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-10-08T08:42:11.952 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-10-08T08:42:11.953 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-10-08T08:42:11.953 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/systemd 2023-10-08T08:42:11.953 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-10-08T08:42:11.953 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-10-08T08:42:11.953 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T08:42:11.953 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/pids 2023-10-08T08:42:11.953 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/cpuset 2023-10-08T08:42:11.953 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T08:42:11.954 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/memory 2023-10-08T08:42:11.954 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T08:42:11.954 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/rdma 2023-10-08T08:42:11.954 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/devices 2023-10-08T08:42:11.954 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/perf_event 2023-10-08T08:42:11.954 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/freezer 2023-10-08T08:42:11.954 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup/blkio 2023-10-08T08:42:11.954 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-10-08T08:42:11.954 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-10-08T08:42:11.955 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/c3b31ebab99267debcf866bfefe5888cad34809b8d494aa218e7b64c9f3f6e2e/merged 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/506cf7cbc13ec640d172dc21f51247df8213b898d976bd8254602b9acc270664/merged 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/2fd42641a541b82ca97e62d7a7b781a3b16aa08bda35e254795036598df1fa52/merged 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/c075158c1a5f0dcecd2e2304e9fc4ebb48a6f495a52733c6cf40f2aaeb1118de/merged 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/fdbbf7823f0e5362bbdafbef3bf2b667cb20cd5563e94f391d74f87bfb7bc2a9/merged 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/7e33b169142701db73e16af1de9f401b7e752aac7e4a8d4aaa922490dba422f2/merged 2023-10-08T08:42:11.956 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/0f3c34c5c9c27cb9343584401887e2951bc93a236efa6d01b24a3cfd53ad92cf/merged 2023-10-08T08:42:11.957 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/db42bb71533b41fa0fb1a06ab3c457cc1fc0596c813e19ebd1618d8cf31e8782/merged 2023-10-08T08:42:11.957 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/29c2c0675e1c0400798bcd615c21878917423e79d7997d92c482e82c9930c293/merged 2023-10-08T08:42:11.957 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/e602f44cf9227a1f1845f166f50918ec5864615f381c3107bcf87c46d85c8253/merged 2023-10-08T08:42:11.957 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-10-08T08:42:11.957 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T08:42:11.957 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T08:42:11.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:11.957 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-10-08T08:42:11.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:2023-10-08T08:42:11.968+0000 7f524d9a45c0 -1 init, newargv = 0x55cef5746050 newargc=15 2023-10-08T08:42:11.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:ceph-fuse[162226]: starting ceph client 2023-10-08T08:42:11.975 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:ceph-fuse[162226]: starting fuse 2023-10-08T08:42:11.986 INFO:teuthology.orchestra.run.smithi070.stdout:124 2023-10-08T08:42:11.986 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2023-10-08T08:42:11.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2023-10-08T08:42:11.986 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2023-10-08T08:42:11.986 DEBUG:teuthology.orchestra.run.smithi070:> import re 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> import os 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2023-10-08T08:42:11.987 DEBUG:teuthology.orchestra.run.smithi070:> 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> return f 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.admin")) 2023-10-08T08:42:11.988 DEBUG:teuthology.orchestra.run.smithi070:> ' 2023-10-08T08:42:12.109 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.admin.162226.asok 2023-10-08T08:42:12.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T08:42:12.118 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.162226.asok 2023-10-08T08:42:12.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:12.118 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.162226.asok status 2023-10-08T08:42:12.274 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:42:12.274 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "7b3143bae3b6870a749bfb9810ed6e7d0e89d7de", 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "admin", 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "162226", 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2023-10-08T08:42:12.275 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 14931, 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 14931 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1073901835 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:42:12.276 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1073901835 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.14931 192.168.0.1:0/1073901835", 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/1073901835", 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 17, 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 86, 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2023-10-08T08:42:12.277 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2023-10-08T08:42:12.278 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:42:12.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:12.285 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2023-10-08T08:42:12.285 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-08T08:42:12.302 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2023-10-08T08:42:12.302 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-08T08:42:12.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:12.303 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-08T08:42:12.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:12.370 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-08T08:42:12.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:12 smithi070 ceph-mon[99513]: pgmap v240: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 3 op/s 2023-10-08T08:42:12.472 INFO:teuthology.orchestra.run.smithi070.stdout:# file: . 2023-10-08T08:42:12.472 INFO:teuthology.orchestra.run.smithi070.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-08T08:42:12.472 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:12.473 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:42:12.473 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T08:42:12.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:42:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:12 smithi105 ceph-mon[103798]: pgmap v240: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 3 op/s 2023-10-08T08:42:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:12 smithi191 ceph-mon[104220]: pgmap v240: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 3 op/s 2023-10-08T08:42:12.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 -- 172.21.15.70:0/929811634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c0ffc60 msgr2=0x7fbd0c1000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:12.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 --2- 172.21.15.70:0/929811634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c0ffc60 0x7fbd0c1000c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbd080099c0 tx=0x7fbd08009cd0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 -- 172.21.15.70:0/929811634 shutdown_connections 2023-10-08T08:42:12.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 --2- 172.21.15.70:0/929811634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd0c100600 0x7fbd0c10c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 --2- 172.21.15.70:0/929811634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd0c105630 0x7fbd0c105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 --2- 172.21.15.70:0/929811634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c0ffc60 0x7fbd0c1000c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 -- 172.21.15.70:0/929811634 >> 172.21.15.70:0/929811634 conn(0x7fbd0c075a70 msgr2=0x7fbd0c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 -- 172.21.15.70:0/929811634 shutdown_connections 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 -- 172.21.15.70:0/929811634 wait complete. 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 Processor -- start 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.651+0000 7fbd14377700 1 -- start start 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd14377700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd0c0ffc60 0x7fbd0c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd14377700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c100600 0x7fbd0c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd14377700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd0c105630 0x7fbd0c1a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd14377700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c198780 con 0x7fbd0c100600 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd14377700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c1a2fb0 con 0x7fbd0c0ffc60 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd14377700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c1a30f0 con 0x7fbd0c105630 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd11912700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c100600 0x7fbd0c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:12.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd11912700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c100600 0x7fbd0c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49212/0 (socket says 172.21.15.70:49212) 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd11912700 1 -- 172.21.15.70:0/2646134979 learned_addr learned my addr 172.21.15.70:0/2646134979 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd12914700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd0c105630 0x7fbd0c1a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd12113700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd0c0ffc60 0x7fbd0c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd11912700 1 -- 172.21.15.70:0/2646134979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd0c105630 msgr2=0x7fbd0c1a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd11912700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd0c105630 0x7fbd0c1a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd11912700 1 -- 172.21.15.70:0/2646134979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd0c0ffc60 msgr2=0x7fbd0c1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd11912700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd0c0ffc60 0x7fbd0c1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd11912700 1 -- 172.21.15.70:0/2646134979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080095f0 con 0x7fbd0c100600 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd12113700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd0c0ffc60 0x7fbd0c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd11912700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c100600 0x7fbd0c197f30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbd08000c00 tx=0x7fbd080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd037fe700 1 -- 172.21.15.70:0/2646134979 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0801d070 con 0x7fbd0c100600 2023-10-08T08:42:12.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd037fe700 1 -- 172.21.15.70:0/2646134979 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd0800fbb0 con 0x7fbd0c100600 2023-10-08T08:42:12.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c1a32f0 con 0x7fbd0c100600 2023-10-08T08:42:12.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd037fe700 1 -- 172.21.15.70:0/2646134979 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08022d00 con 0x7fbd0c100600 2023-10-08T08:42:12.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.652+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c1a3710 con 0x7fbd0c100600 2023-10-08T08:42:12.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.653+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c06a080 con 0x7fbd0c100600 2023-10-08T08:42:12.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.654+0000 7fbd037fe700 1 -- 172.21.15.70:0/2646134979 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fbd0800fd20 con 0x7fbd0c100600 2023-10-08T08:42:12.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.655+0000 7fbd037fe700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbcf80a14d0 0x7fbcf80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:12.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.655+0000 7fbd12113700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbcf80a14d0 0x7fbcf80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:12.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.655+0000 7fbd037fe700 1 -- 172.21.15.70:0/2646134979 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fbd080ce990 con 0x7fbd0c100600 2023-10-08T08:42:12.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.655+0000 7fbd12113700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbcf80a14d0 0x7fbcf80a3990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009b50 tx=0x7fbcfc009550 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:12.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.659+0000 7fbd037fe700 1 -- 172.21.15.70:0/2646134979 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbd08097db0 con 0x7fbd0c100600 2023-10-08T08:42:12.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.853+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd0c1079e0 con 0x7fbd0c100600 2023-10-08T08:42:12.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.854+0000 7fbd037fe700 1 -- 172.21.15.70:0/2646134979 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24277 (secure 0 0 0) 0x7fbd08022e60 con 0x7fbd0c100600 2023-10-08T08:42:12.856 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:12.856 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:05.563861+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.856+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbcf80a14d0 msgr2=0x7fbcf80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.856+0000 7fbd14377700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbcf80a14d0 0x7fbcf80a3990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009b50 tx=0x7fbcfc009550 comp rx=0 tx=0).stop 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.856+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c100600 msgr2=0x7fbd0c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.856+0000 7fbd14377700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c100600 0x7fbd0c197f30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbd08000c00 tx=0x7fbd080057f0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.856+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 shutdown_connections 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.856+0000 7fbd14377700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbcf80a14d0 0x7fbcf80a3990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.856+0000 7fbd14377700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd0c105630 0x7fbd0c1a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.856+0000 7fbd14377700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd0c0ffc60 0x7fbd0c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.856+0000 7fbd14377700 1 --2- 172.21.15.70:0/2646134979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd0c100600 0x7fbd0c197f30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.857+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 >> 172.21.15.70:0/2646134979 conn(0x7fbd0c075a70 msgr2=0x7fbd0c0fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:12.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.857+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 shutdown_connections 2023-10-08T08:42:12.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.857+0000 7fbd14377700 1 -- 172.21.15.70:0/2646134979 wait complete. 2023-10-08T08:42:12.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:42:12.870 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:42:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.994+0000 7fed24408700 1 -- 172.21.15.70:0/2154700167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 msgr2=0x7fed1c10bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.994+0000 7fed24408700 1 --2- 172.21.15.70:0/2154700167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 0x7fed1c10bcb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fed1400c210 tx=0x7fed1400c520 comp rx=0 tx=0).stop 2023-10-08T08:42:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.994+0000 7fed24408700 1 -- 172.21.15.70:0/2154700167 shutdown_connections 2023-10-08T08:42:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.994+0000 7fed24408700 1 --2- 172.21.15.70:0/2154700167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 0x7fed1c10bcb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.994+0000 7fed24408700 1 --2- 172.21.15.70:0/2154700167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed1c0ff060 0x7fed1c0ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.994+0000 7fed24408700 1 --2- 172.21.15.70:0/2154700167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed1c0ffa10 0x7fed1c103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.994+0000 7fed24408700 1 -- 172.21.15.70:0/2154700167 >> 172.21.15.70:0/2154700167 conn(0x7fed1c075c20 msgr2=0x7fed1c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.994+0000 7fed24408700 1 -- 172.21.15.70:0/2154700167 shutdown_connections 2023-10-08T08:42:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.994+0000 7fed24408700 1 -- 172.21.15.70:0/2154700167 wait complete. 2023-10-08T08:42:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.995+0000 7fed24408700 1 Processor -- start 2023-10-08T08:42:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.995+0000 7fed24408700 1 -- start start 2023-10-08T08:42:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.995+0000 7fed24408700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed1c0ff060 0x7fed1c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed24408700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 0x7fed1c19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed24408700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed1c194970 0x7fed1c194e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed24408700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c1953f0 con 0x7fed1c104130 2023-10-08T08:42:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed24408700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c195560 con 0x7fed1c0ff060 2023-10-08T08:42:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed24408700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c195720 con 0x7fed1c194970 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed219a3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 0x7fed1c19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed219a3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 0x7fed1c19ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49226/0 (socket says 172.21.15.70:49226) 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed219a3700 1 -- 172.21.15.70:0/780983292 learned_addr learned my addr 172.21.15.70:0/780983292 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed221a4700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed1c0ff060 0x7fed1c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed229a5700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed1c194970 0x7fed1c194e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed219a3700 1 -- 172.21.15.70:0/780983292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed1c194970 msgr2=0x7fed1c194e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed219a3700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed1c194970 0x7fed1c194e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed219a3700 1 -- 172.21.15.70:0/780983292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed1c0ff060 msgr2=0x7fed1c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed219a3700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed1c0ff060 0x7fed1c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed219a3700 1 -- 172.21.15.70:0/780983292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1400ae10 con 0x7fed1c104130 2023-10-08T08:42:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed221a4700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed1c0ff060 0x7fed1c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed219a3700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 0x7fed1c19ad30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fed1800d980 tx=0x7fed1800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed0f7fe700 1 -- 172.21.15.70:0/780983292 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18009930 con 0x7fed1c104130 2023-10-08T08:42:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed0f7fe700 1 -- 172.21.15.70:0/780983292 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed18010460 con 0x7fed1c104130 2023-10-08T08:42:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c1a16c0 con 0x7fed1c104130 2023-10-08T08:42:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed0f7fe700 1 -- 172.21.15.70:0/780983292 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1800f620 con 0x7fed1c104130 2023-10-08T08:42:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.996+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c1a1ba0 con 0x7fed1c104130 2023-10-08T08:42:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.997+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c107400 con 0x7fed1c104130 2023-10-08T08:42:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.998+0000 7fed0f7fe700 1 -- 172.21.15.70:0/780983292 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fed180108d0 con 0x7fed1c104130 2023-10-08T08:42:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.999+0000 7fed0f7fe700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed080a1550 0x7fed080a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.999+0000 7fed221a4700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed080a1550 0x7fed080a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.999+0000 7fed0f7fe700 1 -- 172.21.15.70:0/780983292 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fed180cca90 con 0x7fed1c104130 2023-10-08T08:42:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:12.999+0000 7fed221a4700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed080a1550 0x7fed080a3a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fed10009cb0 tx=0x7fed10009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:13.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.002+0000 7fed0f7fe700 1 -- 172.21.15.70:0/780983292 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fed18095dc0 con 0x7fed1c104130 2023-10-08T08:42:13.178 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:13 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2646134979' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.197+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed1c195de0 con 0x7fed1c104130 2023-10-08T08:42:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.198+0000 7fed0f7fe700 1 -- 172.21.15.70:0/780983292 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed180170a0 con 0x7fed1c104130 2023-10-08T08:42:13.199 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:42:13.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed080a1550 msgr2=0x7fed080a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed080a1550 0x7fed080a3a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fed10009cb0 tx=0x7fed10009260 comp rx=0 tx=0).stop 2023-10-08T08:42:13.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 msgr2=0x7fed1c19ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 0x7fed1c19ad30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fed1800d980 tx=0x7fed1800dc90 comp rx=0 tx=0).stop 2023-10-08T08:42:13.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 shutdown_connections 2023-10-08T08:42:13.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed080a1550 0x7fed080a3a10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed1c194970 0x7fed1c194e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed1c0ff060 0x7fed1c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 --2- 172.21.15.70:0/780983292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed1c104130 0x7fed1c19ad30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 >> 172.21.15.70:0/780983292 conn(0x7fed1c075c20 msgr2=0x7fed1c102280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:13.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 shutdown_connections 2023-10-08T08:42:13.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.200+0000 7fed24408700 1 -- 172.21.15.70:0/780983292 wait complete. 2023-10-08T08:42:13.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:42:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.335+0000 7f3202618700 1 -- 172.21.15.70:0/1712253663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc106730 msgr2=0x7f31fc106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.335+0000 7f3202618700 1 --2- 172.21.15.70:0/1712253663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc106730 0x7f31fc106b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009990 tx=0x7f31ec009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.335+0000 7f3202618700 1 -- 172.21.15.70:0/1712253663 shutdown_connections 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.335+0000 7f3202618700 1 --2- 172.21.15.70:0/1712253663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31fc0ff680 0x7f31fc10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.335+0000 7f3202618700 1 --2- 172.21.15.70:0/1712253663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc106730 0x7f31fc106b10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.335+0000 7f3202618700 1 --2- 172.21.15.70:0/1712253663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc0fecc0 0x7f31fc0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.335+0000 7f3202618700 1 -- 172.21.15.70:0/1712253663 >> 172.21.15.70:0/1712253663 conn(0x7f31fc075c20 msgr2=0x7f31fc0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.335+0000 7f3202618700 1 -- 172.21.15.70:0/1712253663 shutdown_connections 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.335+0000 7f3202618700 1 -- 172.21.15.70:0/1712253663 wait complete. 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.336+0000 7f3202618700 1 Processor -- start 2023-10-08T08:42:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.336+0000 7f3202618700 1 -- start start 2023-10-08T08:42:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.336+0000 7f3202618700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31fc0fecc0 0x7f31fc19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.336+0000 7f3202618700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0ff680 0x7f31fc19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.336+0000 7f3202618700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc106730 0x7f31fc196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.336+0000 7f3202618700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc197070 con 0x7f31fc0ff680 2023-10-08T08:42:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.336+0000 7f3202618700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc1971e0 con 0x7f31fc106730 2023-10-08T08:42:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.336+0000 7f3202618700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc1973a0 con 0x7f31fc0fecc0 2023-10-08T08:42:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.336+0000 7f31fb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0ff680 0x7f31fc19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0ff680 0x7f31fc19ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49252/0 (socket says 172.21.15.70:49252) 2023-10-08T08:42:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fb7fe700 1 -- 172.21.15.70:0/3004506374 learned_addr learned my addr 172.21.15.70:0/3004506374 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fbfff700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31fc0fecc0 0x7f31fc19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f3200bb5700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc106730 0x7f31fc196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fb7fe700 1 -- 172.21.15.70:0/3004506374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31fc0fecc0 msgr2=0x7f31fc19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fb7fe700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31fc0fecc0 0x7f31fc19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fb7fe700 1 -- 172.21.15.70:0/3004506374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc106730 msgr2=0x7f31fc196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fb7fe700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc106730 0x7f31fc196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fb7fe700 1 -- 172.21.15.70:0/3004506374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec0095f0 con 0x7f31fc0ff680 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f3200bb5700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc106730 0x7f31fc196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fbfff700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31fc0fecc0 0x7f31fc19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31fb7fe700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0ff680 0x7f31fc19ce20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c920 tx=0x7f31e400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31f97fa700 1 -- 172.21.15.70:0/3004506374 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4007b00 con 0x7f31fc0ff680 2023-10-08T08:42:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31fc197680 con 0x7f31fc0ff680 2023-10-08T08:42:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc1a38d0 con 0x7f31fc0ff680 2023-10-08T08:42:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31f97fa700 1 -- 172.21.15.70:0/3004506374 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31e4004cf0 con 0x7f31fc0ff680 2023-10-08T08:42:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.337+0000 7f31f97fa700 1 -- 172.21.15.70:0/3004506374 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4005520 con 0x7f31fc0ff680 2023-10-08T08:42:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.338+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31dc0052f0 con 0x7f31fc0ff680 2023-10-08T08:42:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.339+0000 7f31f97fa700 1 -- 172.21.15.70:0/3004506374 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f31e4007c60 con 0x7f31fc0ff680 2023-10-08T08:42:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.340+0000 7f31f97fa700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f31e80a14d0 0x7f31e80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.340+0000 7f31fbfff700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f31e80a14d0 0x7f31e80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.340+0000 7f31f97fa700 1 -- 172.21.15.70:0/3004506374 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f31e40ccf90 con 0x7f31fc0ff680 2023-10-08T08:42:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.341+0000 7f31fbfff700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f31e80a14d0 0x7f31e80a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f31ec006010 tx=0x7f31ec01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.344+0000 7f31f97fa700 1 -- 172.21.15.70:0/3004506374 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f31e4096320 con 0x7f31fc0ff680 2023-10-08T08:42:13.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:13 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2646134979' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:13.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.536+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31dc005b20 con 0x7f31fc0ff680 2023-10-08T08:42:13.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.537+0000 7f31f97fa700 1 -- 172.21.15.70:0/3004506374 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31e401d020 con 0x7f31fc0ff680 2023-10-08T08:42:13.538 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:42:13.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f31e80a14d0 msgr2=0x7f31e80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f31e80a14d0 0x7f31e80a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f31ec006010 tx=0x7f31ec01a040 comp rx=0 tx=0).stop 2023-10-08T08:42:13.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0ff680 msgr2=0x7f31fc19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0ff680 0x7f31fc19ce20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c920 tx=0x7f31e400cce0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 shutdown_connections 2023-10-08T08:42:13.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f31e80a14d0 0x7f31e80a3990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc106730 0x7f31fc196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31fc0fecc0 0x7f31fc19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 --2- 172.21.15.70:0/3004506374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0ff680 0x7f31fc19ce20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 >> 172.21.15.70:0/3004506374 conn(0x7f31fc075c20 msgr2=0x7f31fc0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:13.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 shutdown_connections 2023-10-08T08:42:13.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.539+0000 7f3202618700 1 -- 172.21.15.70:0/3004506374 wait complete. 2023-10-08T08:42:13.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:42:13.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:13 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2646134979' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:13.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.675+0000 7f160d913700 1 -- 172.21.15.70:0/3869988698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ff630 msgr2=0x7f16080ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.675+0000 7f160d913700 1 --2- 172.21.15.70:0/3869988698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ff630 0x7f16080ffab0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009990 tx=0x7f15f8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.675+0000 7f160d913700 1 -- 172.21.15.70:0/3869988698 shutdown_connections 2023-10-08T08:42:13.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.675+0000 7f160d913700 1 --2- 172.21.15.70:0/3869988698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16080ffff0 0x7f160810c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.675+0000 7f160d913700 1 --2- 172.21.15.70:0/3869988698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1608105640 0x7f1608105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.675+0000 7f160d913700 1 --2- 172.21.15.70:0/3869988698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ff630 0x7f16080ffab0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.675+0000 7f160d913700 1 -- 172.21.15.70:0/3869988698 >> 172.21.15.70:0/3869988698 conn(0x7f16080767f0 msgr2=0x7f1608076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:13.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.675+0000 7f160d913700 1 -- 172.21.15.70:0/3869988698 shutdown_connections 2023-10-08T08:42:13.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.675+0000 7f160d913700 1 -- 172.21.15.70:0/3869988698 wait complete. 2023-10-08T08:42:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f160d913700 1 Processor -- start 2023-10-08T08:42:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f160d913700 1 -- start start 2023-10-08T08:42:13.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f160d913700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16080ff630 0x7f160819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:13.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f160d913700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ffff0 0x7f160819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:13.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f160d913700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1608105640 0x7f1608195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:13.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f160d913700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608195ef0 con 0x7f16080ffff0 2023-10-08T08:42:13.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f160d913700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608196060 con 0x7f1608105640 2023-10-08T08:42:13.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f160d913700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608196220 con 0x7f16080ff630 2023-10-08T08:42:13.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f16067fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ffff0 0x7f160819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f16067fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ffff0 0x7f160819bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49266/0 (socket says 172.21.15.70:49266) 2023-10-08T08:42:13.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.676+0000 7f16067fc700 1 -- 172.21.15.70:0/2096294671 learned_addr learned my addr 172.21.15.70:0/2096294671 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f1606ffd700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16080ff630 0x7f160819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f16077fe700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1608105640 0x7f1608195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f16067fc700 1 -- 172.21.15.70:0/2096294671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16080ff630 msgr2=0x7f160819b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f16067fc700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16080ff630 0x7f160819b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f16067fc700 1 -- 172.21.15.70:0/2096294671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1608105640 msgr2=0x7f1608195880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f16067fc700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1608105640 0x7f1608195880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f16067fc700 1 -- 172.21.15.70:0/2096294671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80095f0 con 0x7f16080ffff0 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f1606ffd700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16080ff630 0x7f160819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f16077fe700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1608105640 0x7f1608195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f16067fc700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ffff0 0x7f160819bc40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f15f800f6a0 tx=0x7f15f800f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f160c911700 1 -- 172.21.15.70:0/2096294671 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f801d070 con 0x7f16080ffff0 2023-10-08T08:42:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f160c911700 1 -- 172.21.15.70:0/2096294671 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15f800fca0 con 0x7f16080ffff0 2023-10-08T08:42:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1608196500 con 0x7f16080ffff0 2023-10-08T08:42:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f160c911700 1 -- 172.21.15.70:0/2096294671 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8017650 con 0x7f16080ffff0 2023-10-08T08:42:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.677+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16081a26f0 con 0x7f16080ffff0 2023-10-08T08:42:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.678+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1608100d70 con 0x7f16080ffff0 2023-10-08T08:42:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.679+0000 7f160c911700 1 -- 172.21.15.70:0/2096294671 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f15f8022470 con 0x7f16080ffff0 2023-10-08T08:42:13.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.679+0000 7f160c911700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15f00a14d0 0x7f15f00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:13.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.680+0000 7f1606ffd700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15f00a14d0 0x7f15f00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:13.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.680+0000 7f160c911700 1 -- 172.21.15.70:0/2096294671 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f15f80ce460 con 0x7f16080ffff0 2023-10-08T08:42:13.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.680+0000 7f1606ffd700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15f00a14d0 0x7f15f00a3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15fc005fd0 tx=0x7f15fc005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:13.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.684+0000 7f160c911700 1 -- 172.21.15.70:0/2096294671 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f15f8097820 con 0x7f16080ffff0 2023-10-08T08:42:13.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.875+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1608196cf0 con 0x7f16080ffff0 2023-10-08T08:42:13.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.875+0000 7f160c911700 1 -- 172.21.15.70:0/2096294671 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15f809ae40 con 0x7f16080ffff0 2023-10-08T08:42:13.876 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.877+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15f00a14d0 msgr2=0x7f15f00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.877+0000 7f160d913700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15f00a14d0 0x7f15f00a3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15fc005fd0 tx=0x7f15fc005db0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.877+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ffff0 msgr2=0x7f160819bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.877+0000 7f160d913700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ffff0 0x7f160819bc40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f15f800f6a0 tx=0x7f15f800f780 comp rx=0 tx=0).stop 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.878+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 shutdown_connections 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.878+0000 7f160d913700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15f00a14d0 0x7f15f00a3990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.878+0000 7f160d913700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1608105640 0x7f1608195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.878+0000 7f160d913700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16080ff630 0x7f160819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.878+0000 7f160d913700 1 --2- 172.21.15.70:0/2096294671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16080ffff0 0x7f160819bc40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.878+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 >> 172.21.15.70:0/2096294671 conn(0x7f16080767f0 msgr2=0x7f1608102240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:13.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.878+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 shutdown_connections 2023-10-08T08:42:13.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:13.878+0000 7f160d913700 1 -- 172.21.15.70:0/2096294671 wait complete. 2023-10-08T08:42:13.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:42:14.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.013+0000 7f08b096c700 1 -- 172.21.15.70:0/3201855733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac106750 msgr2=0x7f08ac106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.013+0000 7f08b096c700 1 --2- 172.21.15.70:0/3201855733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac106750 0x7f08ac106b30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f089c009990 tx=0x7f089c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.014+0000 7f08b096c700 1 -- 172.21.15.70:0/3201855733 shutdown_connections 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.014+0000 7f08b096c700 1 --2- 172.21.15.70:0/3201855733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac101100 0x7f08ac10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.014+0000 7f08b096c700 1 --2- 172.21.15.70:0/3201855733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac106750 0x7f08ac106b30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.014+0000 7f08b096c700 1 --2- 172.21.15.70:0/3201855733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac100740 0x7f08ac100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.014+0000 7f08b096c700 1 -- 172.21.15.70:0/3201855733 >> 172.21.15.70:0/3201855733 conn(0x7f08ac0fc230 msgr2=0x7f08ac0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.014+0000 7f08b096c700 1 -- 172.21.15.70:0/3201855733 shutdown_connections 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.014+0000 7f08b096c700 1 -- 172.21.15.70:0/3201855733 wait complete. 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.014+0000 7f08b096c700 1 Processor -- start 2023-10-08T08:42:14.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.014+0000 7f08b096c700 1 -- start start 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08b096c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac100740 0x7f08ac072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08b096c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac101100 0x7f08ac073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08b096c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac106750 0x7f08ac073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08b096c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1a4f40 con 0x7f08ac101100 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08b096c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1a50b0 con 0x7f08ac100740 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08b096c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1a5270 con 0x7f08ac106750 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08a9d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac101100 0x7f08ac073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08a9d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac101100 0x7f08ac073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49278/0 (socket says 172.21.15.70:49278) 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08a9d9b700 1 -- 172.21.15.70:0/3148730787 learned_addr learned my addr 172.21.15.70:0/3148730787 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08aad9d700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac106750 0x7f08ac073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08aa59c700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac100740 0x7f08ac072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08a9d9b700 1 -- 172.21.15.70:0/3148730787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac106750 msgr2=0x7f08ac073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08a9d9b700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac106750 0x7f08ac073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08a9d9b700 1 -- 172.21.15.70:0/3148730787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac100740 msgr2=0x7f08ac072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08a9d9b700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac100740 0x7f08ac072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08a9d9b700 1 -- 172.21.15.70:0/3148730787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c0095f0 con 0x7f08ac101100 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08a9d9b700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac101100 0x7f08ac073030 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f08a000d950 tx=0x7f08a000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f089b7fe700 1 -- 172.21.15.70:0/3148730787 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a000f890 con 0x7f08ac101100 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac1a5550 con 0x7f08ac101100 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f089b7fe700 1 -- 172.21.15.70:0/3148730787 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08a0010460 con 0x7f08ac101100 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f089b7fe700 1 -- 172.21.15.70:0/3148730787 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a000e610 con 0x7f08ac101100 2023-10-08T08:42:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.015+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac1a5ab0 con 0x7f08ac101100 2023-10-08T08:42:14.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.016+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac108d40 con 0x7f08ac101100 2023-10-08T08:42:14.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.017+0000 7f089b7fe700 1 -- 172.21.15.70:0/3148730787 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f08a00108d0 con 0x7f08ac101100 2023-10-08T08:42:14.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.018+0000 7f089b7fe700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08940a1550 0x7f08940a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.018+0000 7f08aa59c700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08940a1550 0x7f08940a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.018+0000 7f089b7fe700 1 -- 172.21.15.70:0/3148730787 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f08a00cce20 con 0x7f08ac101100 2023-10-08T08:42:14.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.018+0000 7f08aa59c700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08940a1550 0x7f08940a3a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f089c00b5c0 tx=0x7f089c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:14.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.022+0000 7f089b7fe700 1 -- 172.21.15.70:0/3148730787 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f08a0096150 con 0x7f08ac101100 2023-10-08T08:42:14.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.215+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08ac073fd0 con 0x7f08ac101100 2023-10-08T08:42:14.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.215+0000 7f089b7fe700 1 -- 172.21.15.70:0/3148730787 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08a00160a0 con 0x7f08ac101100 2023-10-08T08:42:14.216 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:42:14.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08940a1550 msgr2=0x7f08940a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08940a1550 0x7f08940a3a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f089c00b5c0 tx=0x7f089c005960 comp rx=0 tx=0).stop 2023-10-08T08:42:14.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac101100 msgr2=0x7f08ac073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac101100 0x7f08ac073030 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f08a000d950 tx=0x7f08a000dc60 comp rx=0 tx=0).stop 2023-10-08T08:42:14.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 shutdown_connections 2023-10-08T08:42:14.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08940a1550 0x7f08940a3a10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac106750 0x7f08ac073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac100740 0x7f08ac072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 --2- 172.21.15.70:0/3148730787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac101100 0x7f08ac073030 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 >> 172.21.15.70:0/3148730787 conn(0x7f08ac0fc230 msgr2=0x7f08ac0fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:14.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 shutdown_connections 2023-10-08T08:42:14.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.217+0000 7f08b096c700 1 -- 172.21.15.70:0/3148730787 wait complete. 2023-10-08T08:42:14.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T08:42:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.351+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3835527450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc0ff640 msgr2=0x7f7bfc0ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.351+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3835527450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc0ff640 0x7f7bfc0ffac0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009990 tx=0x7f7be4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.351+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3835527450 shutdown_connections 2023-10-08T08:42:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.351+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3835527450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bfc100000 0x7f7bfc10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.351+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3835527450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bfc105630 0x7f7bfc105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.351+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3835527450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc0ff640 0x7f7bfc0ffac0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.351+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3835527450 >> 172.21.15.70:0/3835527450 conn(0x7f7bfc076790 msgr2=0x7f7bfc076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.351+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3835527450 shutdown_connections 2023-10-08T08:42:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.351+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3835527450 wait complete. 2023-10-08T08:42:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.352+0000 7f7c01fd9700 1 Processor -- start 2023-10-08T08:42:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.352+0000 7f7c01fd9700 1 -- start start 2023-10-08T08:42:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.352+0000 7f7c01fd9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bfc0ff640 0x7f7bfc19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.352+0000 7f7c01fd9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bfc100000 0x7f7bfc19bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.352+0000 7f7c01fd9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc105630 0x7f7bfc1958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.352+0000 7f7c01fd9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc195f30 con 0x7f7bfc105630 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.352+0000 7f7c01fd9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc1960a0 con 0x7f7bfc0ff640 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.352+0000 7f7c01fd9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc196260 con 0x7f7bfc100000 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.352+0000 7f7bfbfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc105630 0x7f7bfc1958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bfbfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc105630 0x7f7bfc1958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49294/0 (socket says 172.21.15.70:49294) 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bfbfff700 1 -- 172.21.15.70:0/3340322865 learned_addr learned my addr 172.21.15.70:0/3340322865 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bfb7fe700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bfc0ff640 0x7f7bfc19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bf3fff700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bfc100000 0x7f7bfc19bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bfbfff700 1 -- 172.21.15.70:0/3340322865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bfc100000 msgr2=0x7f7bfc19bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bfbfff700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bfc100000 0x7f7bfc19bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bfbfff700 1 -- 172.21.15.70:0/3340322865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bfc0ff640 msgr2=0x7f7bfc19b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bfbfff700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bfc0ff640 0x7f7bfc19b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bfbfff700 1 -- 172.21.15.70:0/3340322865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40095f0 con 0x7f7bfc105630 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bfbfff700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc105630 0x7f7bfc1958d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4007ee0 tx=0x7f7bf400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bf97fa700 1 -- 172.21.15.70:0/3340322865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400ddd0 con 0x7f7bfc105630 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bf97fa700 1 -- 172.21.15.70:0/3340322865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7bf400f040 con 0x7f7bfc105630 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bfc196540 con 0x7f7bfc105630 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7bf97fa700 1 -- 172.21.15.70:0/3340322865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40048e0 con 0x7f7bfc105630 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.353+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bfc1a2790 con 0x7f7bfc105630 2023-10-08T08:42:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.354+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bfc107c40 con 0x7f7bfc105630 2023-10-08T08:42:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.355+0000 7f7bf97fa700 1 -- 172.21.15.70:0/3340322865 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7bf4003a00 con 0x7f7bfc105630 2023-10-08T08:42:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.356+0000 7f7bf97fa700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7be80a14d0 0x7f7be80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.356+0000 7f7bf97fa700 1 -- 172.21.15.70:0/3340322865 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f7bf40cd210 con 0x7f7bfc105630 2023-10-08T08:42:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.356+0000 7f7bfb7fe700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7be80a14d0 0x7f7be80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.356+0000 7f7bfb7fe700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7be80a14d0 0x7f7be80a3990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7bec005950 tx=0x7f7bec00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:14.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.359+0000 7f7bf97fa700 1 -- 172.21.15.70:0/3340322865 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7bf4096540 con 0x7f7bfc105630 2023-10-08T08:42:14.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:14 smithi070 ceph-mon[99513]: pgmap v241: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-08T08:42:14.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:14 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/780983292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:42:14.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:14 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3004506374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:42:14.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:14 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2096294671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:42:14.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:14 smithi105 ceph-mon[103798]: pgmap v241: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-08T08:42:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:14 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/780983292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:42:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:14 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3004506374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:42:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:14 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2096294671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:42:14.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.565+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7bfc100d60 con 0x7f7bfc105630 2023-10-08T08:42:14.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.566+0000 7f7bf97fa700 1 -- 172.21.15.70:0/3340322865 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v86) v1 ==== 81+0+887 (secure 0 0 0) 0x7f7bf4023080 con 0x7f7bfc105630 2023-10-08T08:42:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/3825871538 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3658176342 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3301361990 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3846422459 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/4070856372 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1873815706 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/2782530370 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1161134171 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/741640578 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2321306431 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1852102021 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/3825871538 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1161134171 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1882565327 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/2782530370 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7be80a14d0 msgr2=0x7f7be80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7be80a14d0 0x7f7be80a3990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7bec005950 tx=0x7f7bec00b410 comp rx=0 tx=0).stop 2023-10-08T08:42:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc105630 msgr2=0x7f7bfc1958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc105630 0x7f7bfc1958d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4007ee0 tx=0x7f7bf400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 shutdown_connections 2023-10-08T08:42:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7be80a14d0 0x7f7be80a3990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bfc105630 0x7f7bfc1958d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bfc0ff640 0x7f7bfc19b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 --2- 172.21.15.70:0/3340322865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bfc100000 0x7f7bfc19bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 >> 172.21.15.70:0/3340322865 conn(0x7f7bfc076790 msgr2=0x7f7bfc0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 shutdown_connections 2023-10-08T08:42:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.568+0000 7f7c01fd9700 1 -- 172.21.15.70:0/3340322865 wait complete. 2023-10-08T08:42:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:listed 15 entries 2023-10-08T08:42:14.581 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:42:14.581 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T08:42:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:14 smithi191 ceph-mon[104220]: pgmap v241: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-08T08:42:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:14 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/780983292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:42:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:14 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3004506374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:42:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:14 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2096294671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:42:14.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:42:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.759+0000 7f20b9139700 1 -- 172.21.15.70:0/2760357029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 msgr2=0x7f20b410c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.759+0000 7f20b9139700 1 --2- 172.21.15.70:0/2760357029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 0x7f20b410c360 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00b0d0 tx=0x7f20ac00b3e0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.759+0000 7f20b9139700 1 -- 172.21.15.70:0/2760357029 shutdown_connections 2023-10-08T08:42:14.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.759+0000 7f20b9139700 1 --2- 172.21.15.70:0/2760357029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 0x7f20b410c360 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.759+0000 7f20b9139700 1 --2- 172.21.15.70:0/2760357029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20b4105690 0x7f20b4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.759+0000 7f20b9139700 1 --2- 172.21.15.70:0/2760357029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20b40ffcc0 0x7f20b4100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.759+0000 7f20b9139700 1 -- 172.21.15.70:0/2760357029 >> 172.21.15.70:0/2760357029 conn(0x7f20b4075a90 msgr2=0x7f20b40fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:14.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.759+0000 7f20b9139700 1 -- 172.21.15.70:0/2760357029 shutdown_connections 2023-10-08T08:42:14.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.759+0000 7f20b9139700 1 -- 172.21.15.70:0/2760357029 wait complete. 2023-10-08T08:42:14.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b9139700 1 Processor -- start 2023-10-08T08:42:14.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b9139700 1 -- start start 2023-10-08T08:42:14.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b9139700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20b40ffcc0 0x7f20b4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b9139700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 0x7f20b4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b9139700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20b4105690 0x7f20b419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b9139700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b419dc90 con 0x7f20b4100660 2023-10-08T08:42:14.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b9139700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b419de00 con 0x7f20b4105690 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b9139700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b419dfc0 con 0x7f20b40ffcc0 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 0x7f20b4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 0x7f20b4199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49304/0 (socket says 172.21.15.70:49304) 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b259c700 1 -- 172.21.15.70:0/3778839001 learned_addr learned my addr 172.21.15.70:0/3778839001 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b2d9d700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20b40ffcc0 0x7f20b4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.760+0000 7f20b359e700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20b4105690 0x7f20b419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20b259c700 1 -- 172.21.15.70:0/3778839001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20b40ffcc0 msgr2=0x7f20b4198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20b259c700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20b40ffcc0 0x7f20b4198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20b259c700 1 -- 172.21.15.70:0/3778839001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20b4105690 msgr2=0x7f20b419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20b259c700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20b4105690 0x7f20b419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20b259c700 1 -- 172.21.15.70:0/3778839001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac009d00 con 0x7f20b4100660 2023-10-08T08:42:14.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20b259c700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 0x7f20b4199300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c9b0 tx=0x7f20a400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:14.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20abfff700 1 -- 172.21.15.70:0/3778839001 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4007b00 con 0x7f20b4100660 2023-10-08T08:42:14.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b419e2a0 con 0x7f20b4100660 2023-10-08T08:42:14.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20abfff700 1 -- 172.21.15.70:0/3778839001 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20a400ce50 con 0x7f20b4100660 2023-10-08T08:42:14.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20abfff700 1 -- 172.21.15.70:0/3778839001 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4018660 con 0x7f20b4100660 2023-10-08T08:42:14.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.761+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b41a5ae0 con 0x7f20b4100660 2023-10-08T08:42:14.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.762+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b4100cd0 con 0x7f20b4100660 2023-10-08T08:42:14.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.763+0000 7f20abfff700 1 -- 172.21.15.70:0/3778839001 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f20a400f450 con 0x7f20b4100660 2023-10-08T08:42:14.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.763+0000 7f20abfff700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20a00a14d0 0x7f20a00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:14.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.763+0000 7f20abfff700 1 -- 172.21.15.70:0/3778839001 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f20a40ccfa0 con 0x7f20b4100660 2023-10-08T08:42:14.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.763+0000 7f20b2d9d700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20a00a14d0 0x7f20a00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:14.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.764+0000 7f20b2d9d700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20a00a14d0 0x7f20a00a3990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f209c005950 tx=0x7f209c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:14.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.768+0000 7f20abfff700 1 -- 172.21.15.70:0/3778839001 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f20a40962d0 con 0x7f20b4100660 2023-10-08T08:42:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.964+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20b419a070 con 0x7f20b4100660 2023-10-08T08:42:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.965+0000 7f20abfff700 1 -- 172.21.15.70:0/3778839001 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24277 (secure 0 0 0) 0x7f20a4007e60 con 0x7f20b4100660 2023-10-08T08:42:14.967 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:05.563861+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20a00a14d0 msgr2=0x7f20a00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20a00a14d0 0x7f20a00a3990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f209c005950 tx=0x7f209c00b410 comp rx=0 tx=0).stop 2023-10-08T08:42:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 msgr2=0x7f20b4199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 0x7f20b4199300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c9b0 tx=0x7f20a400ccc0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 shutdown_connections 2023-10-08T08:42:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20a00a14d0 0x7f20a00a3990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20b4105690 0x7f20b419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20b40ffcc0 0x7f20b4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 --2- 172.21.15.70:0/3778839001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b4100660 0x7f20b4199300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 >> 172.21.15.70:0/3778839001 conn(0x7f20b4075a90 msgr2=0x7f20b40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 shutdown_connections 2023-10-08T08:42:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:14.968+0000 7f20b9139700 1 -- 172.21.15.70:0/3778839001 wait complete. 2023-10-08T08:42:14.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:42:14.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:42:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 -- 172.21.15.70:0/1382845479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 msgr2=0x7f08ac10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 --2- 172.21.15.70:0/1382845479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 0x7f08ac10c4e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f08a400b0a0 tx=0x7f08a400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 -- 172.21.15.70:0/1382845479 shutdown_connections 2023-10-08T08:42:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 --2- 172.21.15.70:0/1382845479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 0x7f08ac10c4e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 --2- 172.21.15.70:0/1382845479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac1056b0 0x7f08ac105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 --2- 172.21.15.70:0/1382845479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac0ff620 0x7f08ac0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 -- 172.21.15.70:0/1382845479 >> 172.21.15.70:0/1382845479 conn(0x7f08ac076780 msgr2=0x7f08ac076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 -- 172.21.15.70:0/1382845479 shutdown_connections 2023-10-08T08:42:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 -- 172.21.15.70:0/1382845479 wait complete. 2023-10-08T08:42:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.105+0000 7f08b20da700 1 Processor -- start 2023-10-08T08:42:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08b20da700 1 -- start start 2023-10-08T08:42:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08b20da700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac0ff620 0x7f08ac1012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08b20da700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 0x7f08ac1017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08b20da700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac1056b0 0x7f08ac101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08b20da700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1a4e80 con 0x7f08ac0fffe0 2023-10-08T08:42:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08b20da700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1a4ff0 con 0x7f08ac0ff620 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08b20da700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1a51b0 con 0x7f08ac1056b0 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08aaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 0x7f08ac1017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08aaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 0x7f08ac1017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49318/0 (socket says 172.21.15.70:49318) 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08aaffd700 1 -- 172.21.15.70:0/4187882453 learned_addr learned my addr 172.21.15.70:0/4187882453 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08abfff700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac1056b0 0x7f08ac101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08ab7fe700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac0ff620 0x7f08ac1012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08aaffd700 1 -- 172.21.15.70:0/4187882453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac1056b0 msgr2=0x7f08ac101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08aaffd700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac1056b0 0x7f08ac101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08aaffd700 1 -- 172.21.15.70:0/4187882453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac0ff620 msgr2=0x7f08ac1012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08aaffd700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac0ff620 0x7f08ac1012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08aaffd700 1 -- 172.21.15.70:0/4187882453 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a4009d00 con 0x7f08ac0fffe0 2023-10-08T08:42:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08abfff700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac1056b0 0x7f08ac101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08aaffd700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 0x7f08ac1017f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f089c00d950 tx=0x7f089c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08a8ff9700 1 -- 172.21.15.70:0/4187882453 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c009b40 con 0x7f08ac0fffe0 2023-10-08T08:42:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac1a5490 con 0x7f08ac0fffe0 2023-10-08T08:42:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08a8ff9700 1 -- 172.21.15.70:0/4187882453 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f089c009ca0 con 0x7f08ac0fffe0 2023-10-08T08:42:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.106+0000 7f08a8ff9700 1 -- 172.21.15.70:0/4187882453 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c00f620 con 0x7f08ac0fffe0 2023-10-08T08:42:15.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.107+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac1a59a0 con 0x7f08ac0fffe0 2023-10-08T08:42:15.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.107+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac100d50 con 0x7f08ac0fffe0 2023-10-08T08:42:15.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.108+0000 7f08a8ff9700 1 -- 172.21.15.70:0/4187882453 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f089c010460 con 0x7f08ac0fffe0 2023-10-08T08:42:15.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.109+0000 7f08a8ff9700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08980a14d0 0x7f08980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.109+0000 7f08a8ff9700 1 -- 172.21.15.70:0/4187882453 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f089c0cd420 con 0x7f08ac0fffe0 2023-10-08T08:42:15.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.109+0000 7f08ab7fe700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08980a14d0 0x7f08980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.109+0000 7f08ab7fe700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08980a14d0 0x7f08980a3990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0894005950 tx=0x7f08940058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:15.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.113+0000 7f08a8ff9700 1 -- 172.21.15.70:0/4187882453 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f089c096750 con 0x7f08ac0fffe0 2023-10-08T08:42:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.305+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08ac102770 con 0x7f08ac0fffe0 2023-10-08T08:42:15.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.306+0000 7f08a8ff9700 1 -- 172.21.15.70:0/4187882453 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f089c099d70 con 0x7f08ac0fffe0 2023-10-08T08:42:15.345 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:42:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08980a14d0 msgr2=0x7f08980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08980a14d0 0x7f08980a3990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0894005950 tx=0x7f08940058e0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 msgr2=0x7f08ac1017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 0x7f08ac1017f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f089c00d950 tx=0x7f089c00dd10 comp rx=0 tx=0).stop 2023-10-08T08:42:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 shutdown_connections 2023-10-08T08:42:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08980a14d0 0x7f08980a3990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08ac1056b0 0x7f08ac101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ac0ff620 0x7f08ac1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 --2- 172.21.15.70:0/4187882453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08ac0fffe0 0x7f08ac1017f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 >> 172.21.15.70:0/4187882453 conn(0x7f08ac076780 msgr2=0x7f08ac0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 shutdown_connections 2023-10-08T08:42:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.308+0000 7f08b20da700 1 -- 172.21.15.70:0/4187882453 wait complete. 2023-10-08T08:42:15.347 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:15 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3148730787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:42:15.347 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:15 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3340322865' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T08:42:15.347 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:15 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3778839001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:15.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:42:15.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 -- 172.21.15.70:0/3244109379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 msgr2=0x7fe1b0105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 --2- 172.21.15.70:0/3244109379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 0x7fe1b0105a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009990 tx=0x7fe1a4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 -- 172.21.15.70:0/3244109379 shutdown_connections 2023-10-08T08:42:15.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 --2- 172.21.15.70:0/3244109379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1b00ffff0 0x7fe1b010c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 --2- 172.21.15.70:0/3244109379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 0x7fe1b0105a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 --2- 172.21.15.70:0/3244109379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1b00ff630 0x7fe1b00ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 -- 172.21.15.70:0/3244109379 >> 172.21.15.70:0/3244109379 conn(0x7fe1b00767f0 msgr2=0x7fe1b0076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:15.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 -- 172.21.15.70:0/3244109379 shutdown_connections 2023-10-08T08:42:15.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 -- 172.21.15.70:0/3244109379 wait complete. 2023-10-08T08:42:15.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 Processor -- start 2023-10-08T08:42:15.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.472+0000 7fe1b697d700 1 -- start start 2023-10-08T08:42:15.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b697d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1b00ff630 0x7fe1b019b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b697d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1b00ffff0 0x7fe1b019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b697d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 0x7fe1b0195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b697d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0195f80 con 0x7fe1b0105640 2023-10-08T08:42:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b697d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b01960f0 con 0x7fe1b00ff630 2023-10-08T08:42:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b697d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b01962b0 con 0x7fe1b00ffff0 2023-10-08T08:42:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b4f1a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 0x7fe1b0195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b4f1a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 0x7fe1b0195920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49334/0 (socket says 172.21.15.70:49334) 2023-10-08T08:42:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b4f1a700 1 -- 172.21.15.70:0/523053181 learned_addr learned my addr 172.21.15.70:0/523053181 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1af7fe700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1b00ffff0 0x7fe1b019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1affff700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1b00ff630 0x7fe1b019b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b4f1a700 1 -- 172.21.15.70:0/523053181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1b00ffff0 msgr2=0x7fe1b019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b4f1a700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1b00ffff0 0x7fe1b019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b4f1a700 1 -- 172.21.15.70:0/523053181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1b00ff630 msgr2=0x7fe1b019b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b4f1a700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1b00ff630 0x7fe1b019b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b4f1a700 1 -- 172.21.15.70:0/523053181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40095f0 con 0x7fe1b0105640 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1affff700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1b00ff630 0x7fe1b019b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b4f1a700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 0x7fe1b0195920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8007ee0 tx=0x7fe1a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1ad7fa700 1 -- 172.21.15.70:0/523053181 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8017070 con 0x7fe1b0105640 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b0196590 con 0x7fe1b0105640 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1ad7fa700 1 -- 172.21.15.70:0/523053181 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1a800f040 con 0x7fe1b0105640 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1ad7fa700 1 -- 172.21.15.70:0/523053181 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8005740 con 0x7fe1b0105640 2023-10-08T08:42:15.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.473+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b01a27e0 con 0x7fe1b0105640 2023-10-08T08:42:15.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.474+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b0100d70 con 0x7fe1b0105640 2023-10-08T08:42:15.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.475+0000 7fe1ad7fa700 1 -- 172.21.15.70:0/523053181 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe1a800dc60 con 0x7fe1b0105640 2023-10-08T08:42:15.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.476+0000 7fe1ad7fa700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1980a14d0 0x7fe1980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.476+0000 7fe1affff700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1980a14d0 0x7fe1980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.476+0000 7fe1ad7fa700 1 -- 172.21.15.70:0/523053181 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fe1a80cce70 con 0x7fe1b0105640 2023-10-08T08:42:15.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.477+0000 7fe1affff700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1980a14d0 0x7fe1980a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4006010 tx=0x7fe1a401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:15.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.480+0000 7fe1ad7fa700 1 -- 172.21.15.70:0/523053181 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe1a8096200 con 0x7fe1b0105640 2023-10-08T08:42:15.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:15 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3148730787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:42:15.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:15 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3340322865' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T08:42:15.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:15 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3778839001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:15.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:15 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3148730787' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:42:15.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:15 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3340322865' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T08:42:15.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:15 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3778839001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:15.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.671+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1b0067980 con 0x7fe1b0105640 2023-10-08T08:42:15.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.671+0000 7fe1ad7fa700 1 -- 172.21.15.70:0/523053181 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1a8099820 con 0x7fe1b0105640 2023-10-08T08:42:15.673 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:42:15.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1980a14d0 msgr2=0x7fe1980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1980a14d0 0x7fe1980a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4006010 tx=0x7fe1a401a040 comp rx=0 tx=0).stop 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 msgr2=0x7fe1b0195920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 0x7fe1b0195920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8007ee0 tx=0x7fe1a800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 shutdown_connections 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1980a14d0 0x7fe1980a3990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1b0105640 0x7fe1b0195920 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1b00ff630 0x7fe1b019b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 --2- 172.21.15.70:0/523053181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1b00ffff0 0x7fe1b019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.673+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 >> 172.21.15.70:0/523053181 conn(0x7fe1b00767f0 msgr2=0x7fe1b0102260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:15.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.674+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 shutdown_connections 2023-10-08T08:42:15.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.674+0000 7fe1b697d700 1 -- 172.21.15.70:0/523053181 wait complete. 2023-10-08T08:42:15.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:42:15.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 -- 172.21.15.70:0/1101474011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8101100 msgr2=0x7fadc810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 --2- 172.21.15.70:0/1101474011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8101100 0x7fadc810d610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fadc000b0a0 tx=0x7fadc000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 -- 172.21.15.70:0/1101474011 shutdown_connections 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 --2- 172.21.15.70:0/1101474011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8101100 0x7fadc810d610 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 --2- 172.21.15.70:0/1101474011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadc8106750 0x7fadc8106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 --2- 172.21.15.70:0/1101474011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadc8100740 0x7fadc8100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 -- 172.21.15.70:0/1101474011 >> 172.21.15.70:0/1101474011 conn(0x7fadc80fc230 msgr2=0x7fadc80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 -- 172.21.15.70:0/1101474011 shutdown_connections 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 -- 172.21.15.70:0/1101474011 wait complete. 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 Processor -- start 2023-10-08T08:42:15.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.810+0000 7fadcfcca700 1 -- start start 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcfcca700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadc8100740 0x7fadc8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcfcca700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadc8101100 0x7fadc8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcfcca700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8106750 0x7fadc8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcfcca700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc81a4f60 con 0x7fadc8106750 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcfcca700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc81a50d0 con 0x7fadc8101100 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcfcca700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc81a5290 con 0x7fadc8100740 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadce267700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8106750 0x7fadc8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadce267700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8106750 0x7fadc8073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49348/0 (socket says 172.21.15.70:49348) 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadce267700 1 -- 172.21.15.70:0/987627582 learned_addr learned my addr 172.21.15.70:0/987627582 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcd265700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadc8101100 0x7fadc8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcda66700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadc8100740 0x7fadc8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadce267700 1 -- 172.21.15.70:0/987627582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadc8100740 msgr2=0x7fadc8072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadce267700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadc8100740 0x7fadc8072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadce267700 1 -- 172.21.15.70:0/987627582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadc8101100 msgr2=0x7fadc8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadce267700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadc8101100 0x7fadc8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadce267700 1 -- 172.21.15.70:0/987627582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc0009d00 con 0x7fadc8106750 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadce267700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8106750 0x7fadc8073590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fadc000b070 tx=0x7fadc0007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadbeffd700 1 -- 172.21.15.70:0/987627582 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000e040 con 0x7fadc8106750 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc81a5510 con 0x7fadc8106750 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadbeffd700 1 -- 172.21.15.70:0/987627582 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadc0012dc0 con 0x7fadc8106750 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadbeffd700 1 -- 172.21.15.70:0/987627582 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc001b450 con 0x7fadc8106750 2023-10-08T08:42:15.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.811+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc81a5990 con 0x7fadc8106750 2023-10-08T08:42:15.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.812+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc8108d60 con 0x7fadc8106750 2023-10-08T08:42:15.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.814+0000 7fadbeffd700 1 -- 172.21.15.70:0/987627582 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fadc001d680 con 0x7fadc8106750 2023-10-08T08:42:15.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.814+0000 7fadbeffd700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fadb40a14d0 0x7fadb40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:15.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.814+0000 7fadcda66700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fadb40a14d0 0x7fadb40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:15.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.814+0000 7fadbeffd700 1 -- 172.21.15.70:0/987627582 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fadc00cf1f0 con 0x7fadc8106750 2023-10-08T08:42:15.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.814+0000 7fadcda66700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fadb40a14d0 0x7fadb40a3990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fadb8005950 tx=0x7fadb80058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:15.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:15.817+0000 7fadbeffd700 1 -- 172.21.15.70:0/987627582 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fadc0098610 con 0x7fadc8106750 2023-10-08T08:42:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.010+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fadc8073fd0 con 0x7fadc8106750 2023-10-08T08:42:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.010+0000 7fadbeffd700 1 -- 172.21.15.70:0/987627582 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fadc009bc30 con 0x7fadc8106750 2023-10-08T08:42:16.011 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:42:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fadb40a14d0 msgr2=0x7fadb40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fadb40a14d0 0x7fadb40a3990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fadb8005950 tx=0x7fadb80058e0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8106750 msgr2=0x7fadc8073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8106750 0x7fadc8073590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fadc000b070 tx=0x7fadc0007b70 comp rx=0 tx=0).stop 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 shutdown_connections 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fadb40a14d0 0x7fadb40a3990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc8106750 0x7fadc8073590 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadc8100740 0x7fadc8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 --2- 172.21.15.70:0/987627582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadc8101100 0x7fadc8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 >> 172.21.15.70:0/987627582 conn(0x7fadc80fc230 msgr2=0x7fadc80fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 shutdown_connections 2023-10-08T08:42:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.012+0000 7fadcfcca700 1 -- 172.21.15.70:0/987627582 wait complete. 2023-10-08T08:42:16.025 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:42:16.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.150+0000 7fc71cdb2700 1 -- 172.21.15.70:0/3517036761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7180fffe0 msgr2=0x7fc71810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.150+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/3517036761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7180fffe0 0x7fc71810c4e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc71000b0a0 tx=0x7fc71000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.150+0000 7fc71cdb2700 1 -- 172.21.15.70:0/3517036761 shutdown_connections 2023-10-08T08:42:16.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.150+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/3517036761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7180fffe0 0x7fc71810c4e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.150+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/3517036761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7181056b0 0x7fc718105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.150+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/3517036761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7180ff620 0x7fc7180ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.150+0000 7fc71cdb2700 1 -- 172.21.15.70:0/3517036761 >> 172.21.15.70:0/3517036761 conn(0x7fc718076780 msgr2=0x7fc718076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:16.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.150+0000 7fc71cdb2700 1 -- 172.21.15.70:0/3517036761 shutdown_connections 2023-10-08T08:42:16.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.150+0000 7fc71cdb2700 1 -- 172.21.15.70:0/3517036761 wait complete. 2023-10-08T08:42:16.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc71cdb2700 1 Processor -- start 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc71cdb2700 1 -- start start 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc71cdb2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7180ff620 0x7fc7181012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc71cdb2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7180fffe0 0x7fc7181017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc71cdb2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7181056b0 0x7fc718101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc71cdb2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181a4e80 con 0x7fc7181056b0 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc71cdb2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181a4ff0 con 0x7fc7180fffe0 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc71cdb2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181a51b0 con 0x7fc7180ff620 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc716d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7181056b0 0x7fc718101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc716d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7181056b0 0x7fc718101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49362/0 (socket says 172.21.15.70:49362) 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc716d9d700 1 -- 172.21.15.70:0/249094346 learned_addr learned my addr 172.21.15.70:0/249094346 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:16.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc715d9b700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7180fffe0 0x7fc7181017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:16.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc71659c700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7180ff620 0x7fc7181012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:16.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc716d9d700 1 -- 172.21.15.70:0/249094346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7180ff620 msgr2=0x7fc7181012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc716d9d700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7180ff620 0x7fc7181012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc716d9d700 1 -- 172.21.15.70:0/249094346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7180fffe0 msgr2=0x7fc7181017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc716d9d700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7180fffe0 0x7fc7181017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.151+0000 7fc716d9d700 1 -- 172.21.15.70:0/249094346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710009d00 con 0x7fc7181056b0 2023-10-08T08:42:16.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.152+0000 7fc716d9d700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7181056b0 0x7fc718101d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc71000b070 tx=0x7fc710007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:16.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.152+0000 7fc7077fe700 1 -- 172.21.15.70:0/249094346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71000e040 con 0x7fc7181056b0 2023-10-08T08:42:16.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.152+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7181a5430 con 0x7fc7181056b0 2023-10-08T08:42:16.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.152+0000 7fc7077fe700 1 -- 172.21.15.70:0/249094346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc710004e60 con 0x7fc7181056b0 2023-10-08T08:42:16.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.152+0000 7fc7077fe700 1 -- 172.21.15.70:0/249094346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7100052a0 con 0x7fc7181056b0 2023-10-08T08:42:16.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.152+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7181a5900 con 0x7fc7181056b0 2023-10-08T08:42:16.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.153+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc718100d50 con 0x7fc7181056b0 2023-10-08T08:42:16.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.154+0000 7fc7077fe700 1 -- 172.21.15.70:0/249094346 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc71001d470 con 0x7fc7181056b0 2023-10-08T08:42:16.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.154+0000 7fc7077fe700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc7000a14d0 0x7fc7000a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:16.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.154+0000 7fc71659c700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc7000a14d0 0x7fc7000a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:16.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.154+0000 7fc7077fe700 1 -- 172.21.15.70:0/249094346 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fc7100ceeb0 con 0x7fc7181056b0 2023-10-08T08:42:16.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.155+0000 7fc71659c700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc7000a14d0 0x7fc7000a3990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc718077ab0 tx=0x7fc708009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:16.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.158+0000 7fc7077fe700 1 -- 172.21.15.70:0/249094346 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc7100982d0 con 0x7fc7181056b0 2023-10-08T08:42:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.350+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc718102790 con 0x7fc7181056b0 2023-10-08T08:42:16.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.350+0000 7fc7077fe700 1 -- 172.21.15.70:0/249094346 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc71009b8f0 con 0x7fc7181056b0 2023-10-08T08:42:16.351 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:42:16.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc7000a14d0 msgr2=0x7fc7000a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc7000a14d0 0x7fc7000a3990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc718077ab0 tx=0x7fc708009260 comp rx=0 tx=0).stop 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7181056b0 msgr2=0x7fc718101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7181056b0 0x7fc718101d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc71000b070 tx=0x7fc710007870 comp rx=0 tx=0).stop 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 shutdown_connections 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc7000a14d0 0x7fc7000a3990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7181056b0 0x7fc718101d30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7180ff620 0x7fc7181012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 --2- 172.21.15.70:0/249094346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7180fffe0 0x7fc7181017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 >> 172.21.15.70:0/249094346 conn(0x7fc718076780 msgr2=0x7fc718067b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 shutdown_connections 2023-10-08T08:42:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.352+0000 7fc71cdb2700 1 -- 172.21.15.70:0/249094346 wait complete. 2023-10-08T08:42:16.364 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:16 smithi070 ceph-mon[99513]: pgmap v242: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 310 B/s wr, 0 op/s 2023-10-08T08:42:16.364 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:16 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4187882453' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:42:16.364 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:16 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/523053181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:42:16.364 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:16 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/987627582' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:42:16.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T08:42:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.486+0000 7f603aac3700 1 -- 172.21.15.70:0/1188706875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 msgr2=0x7f603410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.486+0000 7f603aac3700 1 --2- 172.21.15.70:0/1188706875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 0x7f603410d610 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f602c00b0a0 tx=0x7f602c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.486+0000 7f603aac3700 1 -- 172.21.15.70:0/1188706875 shutdown_connections 2023-10-08T08:42:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.486+0000 7f603aac3700 1 --2- 172.21.15.70:0/1188706875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 0x7f603410d610 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.486+0000 7f603aac3700 1 --2- 172.21.15.70:0/1188706875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034106750 0x7f6034106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.486+0000 7f603aac3700 1 --2- 172.21.15.70:0/1188706875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6034100740 0x7f6034100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.486+0000 7f603aac3700 1 -- 172.21.15.70:0/1188706875 >> 172.21.15.70:0/1188706875 conn(0x7f60340fc230 msgr2=0x7f60340fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.486+0000 7f603aac3700 1 -- 172.21.15.70:0/1188706875 shutdown_connections 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.486+0000 7f603aac3700 1 -- 172.21.15.70:0/1188706875 wait complete. 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f603aac3700 1 Processor -- start 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f603aac3700 1 -- start start 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f603aac3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6034100740 0x7f6034072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f603aac3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 0x7f6034073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f603aac3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034106750 0x7f6034073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f603aac3700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341a4e80 con 0x7f6034101100 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f603aac3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341a4ff0 con 0x7f6034106750 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f603aac3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341a51b0 con 0x7f6034100740 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6033fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 0x7f6034073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6033fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 0x7f6034073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49374/0 (socket says 172.21.15.70:49374) 2023-10-08T08:42:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6033fff700 1 -- 172.21.15.70:0/3347777517 learned_addr learned my addr 172.21.15.70:0/3347777517 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f603885f700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6034100740 0x7f6034072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6033fff700 1 -- 172.21.15.70:0/3347777517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6034100740 msgr2=0x7f6034072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6039060700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034106750 0x7f6034073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6033fff700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6034100740 0x7f6034072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6033fff700 1 -- 172.21.15.70:0/3347777517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034106750 msgr2=0x7f6034073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6033fff700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034106750 0x7f6034073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6033fff700 1 -- 172.21.15.70:0/3347777517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c009d00 con 0x7f6034101100 2023-10-08T08:42:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.487+0000 7f6033fff700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 0x7f6034073030 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f602000c920 tx=0x7f602000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.488+0000 7f6031ffb700 1 -- 172.21.15.70:0/3347777517 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020007b00 con 0x7f6034101100 2023-10-08T08:42:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.488+0000 7f6031ffb700 1 -- 172.21.15.70:0/3347777517 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6020004cf0 con 0x7f6034101100 2023-10-08T08:42:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.488+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60341a5490 con 0x7f6034101100 2023-10-08T08:42:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.488+0000 7f6031ffb700 1 -- 172.21.15.70:0/3347777517 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020005610 con 0x7f6034101100 2023-10-08T08:42:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.488+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60341a59a0 con 0x7f6034101100 2023-10-08T08:42:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.489+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6034108d40 con 0x7f6034101100 2023-10-08T08:42:16.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.490+0000 7f6031ffb700 1 -- 172.21.15.70:0/3347777517 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6020004750 con 0x7f6034101100 2023-10-08T08:42:16.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.490+0000 7f6031ffb700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60240a14d0 0x7f60240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:16.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.490+0000 7f6031ffb700 1 -- 172.21.15.70:0/3347777517 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f60200ccfe0 con 0x7f6034101100 2023-10-08T08:42:16.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.490+0000 7f603885f700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60240a14d0 0x7f60240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:16.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.491+0000 7f603885f700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60240a14d0 0x7f60240a3990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6028005950 tx=0x7f6028005c70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:16.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.494+0000 7f6031ffb700 1 -- 172.21.15.70:0/3347777517 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6020096370 con 0x7f6034101100 2023-10-08T08:42:16.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:16 smithi105 ceph-mon[103798]: pgmap v242: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 310 B/s wr, 0 op/s 2023-10-08T08:42:16.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:16 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4187882453' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:42:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:16 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/523053181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:42:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:16 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/987627582' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:42:16.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:16 smithi191 ceph-mon[104220]: pgmap v242: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 310 B/s wr, 0 op/s 2023-10-08T08:42:16.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:16 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4187882453' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:42:16.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:16 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/523053181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:42:16.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:16 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/987627582' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:42:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.700+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6034073fd0 con 0x7f6034101100 2023-10-08T08:42:16.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.700+0000 7f6031ffb700 1 -- 172.21.15.70:0/3347777517 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v86) v1 ==== 81+0+887 (secure 0 0 0) 0x7f602001d080 con 0x7f6034101100 2023-10-08T08:42:16.702 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/3825871538 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:16.702 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3658176342 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:16.702 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3301361990 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:16.702 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3846422459 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:16.702 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/4070856372 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:16.702 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1873815706 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:16.703 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/2782530370 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:16.703 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1161134171 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:16.703 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/741640578 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:16.703 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2321306431 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:16.703 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1852102021 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:16.703 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/3825871538 2023-10-09T08:36:38.980084+0000 2023-10-08T08:42:16.703 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1161134171 2023-10-09T08:35:13.093969+0000 2023-10-08T08:42:16.703 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1882565327 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:16.703 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/2782530370 2023-10-09T08:35:35.987952+0000 2023-10-08T08:42:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60240a14d0 msgr2=0x7f60240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60240a14d0 0x7f60240a3990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6028005950 tx=0x7f6028005c70 comp rx=0 tx=0).stop 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 msgr2=0x7f6034073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 0x7f6034073030 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f602000c920 tx=0x7f602000cce0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 shutdown_connections 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f60240a14d0 0x7f60240a3990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034106750 0x7f6034073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6034100740 0x7f6034072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 --2- 172.21.15.70:0/3347777517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6034101100 0x7f6034073030 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 >> 172.21.15.70:0/3347777517 conn(0x7f60340fc230 msgr2=0x7f60340fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 shutdown_connections 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:16.703+0000 7f603aac3700 1 -- 172.21.15.70:0/3347777517 wait complete. 2023-10-08T08:42:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:listed 15 entries 2023-10-08T08:42:16.715 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2023-10-08T08:42:16.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:16.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-08T08:42:16.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:ceph-fuse[162226]: fuse finished with error 0 and tester_r 0 2023-10-08T08:42:16.761 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T08:42:17.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:17 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/249094346' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:42:17.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:17 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3347777517' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T08:42:17.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:17 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/249094346' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:42:17.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:17 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3347777517' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T08:42:17.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:17 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/249094346' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:42:17.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:17 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3347777517' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T08:42:18.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:18 smithi070 ceph-mon[99513]: pgmap v243: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 282 B/s wr, 0 op/s 2023-10-08T08:42:18.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:18 smithi105 ceph-mon[103798]: pgmap v243: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 282 B/s wr, 0 op/s 2023-10-08T08:42:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:18 smithi191 ceph-mon[104220]: pgmap v243: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 282 B/s wr, 0 op/s 2023-10-08T08:42:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:20 smithi070 ceph-mon[99513]: pgmap v244: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2023-10-08T08:42:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:20 smithi105 ceph-mon[103798]: pgmap v244: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2023-10-08T08:42:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:20 smithi191 ceph-mon[104220]: pgmap v244: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2023-10-08T08:42:22.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:22 smithi070 ceph-mon[99513]: pgmap v245: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T08:42:22.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:22 smithi105 ceph-mon[103798]: pgmap v245: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T08:42:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:22 smithi191 ceph-mon[104220]: pgmap v245: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T08:42:22.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:42:22.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:42:22.863 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-08T08:42:22.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:42:23.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.068+0000 7fa9fb88f700 1 -- 172.21.15.70:0/2187601426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f40ff540 msgr2=0x7fa9f40ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.068+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/2187601426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f40ff540 0x7fa9f40ff9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00099c0 tx=0x7fa9f0009cd0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.068+0000 7fa9fb88f700 1 -- 172.21.15.70:0/2187601426 shutdown_connections 2023-10-08T08:42:23.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.068+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/2187601426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9f40fff00 0x7fa9f410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.068+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/2187601426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9f4105600 0x7fa9f41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.068+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/2187601426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f40ff540 0x7fa9f40ff9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 -- 172.21.15.70:0/2187601426 >> 172.21.15.70:0/2187601426 conn(0x7fa9f40fb030 msgr2=0x7fa9f40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:23.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 -- 172.21.15.70:0/2187601426 shutdown_connections 2023-10-08T08:42:23.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 -- 172.21.15.70:0/2187601426 wait complete. 2023-10-08T08:42:23.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 Processor -- start 2023-10-08T08:42:23.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 -- start start 2023-10-08T08:42:23.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9f40ff540 0x7fa9f41978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9f40fff00 0x7fa9f4197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f4105600 0x7fa9f41a2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f4198690 con 0x7fa9f4105600 2023-10-08T08:42:23.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f41a2ea0 con 0x7fa9f40fff00 2023-10-08T08:42:23.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.069+0000 7fa9fb88f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f41a2fe0 con 0x7fa9f40ff540 2023-10-08T08:42:23.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f9e2c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f4105600 0x7fa9f41a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f9e2c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f4105600 0x7fa9f41a2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49390/0 (socket says 172.21.15.70:49390) 2023-10-08T08:42:23.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f9e2c700 1 -- 172.21.15.70:0/1703839744 learned_addr learned my addr 172.21.15.70:0/1703839744 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:23.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f962b700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9f40ff540 0x7fa9f41978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f8e2a700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9f40fff00 0x7fa9f4197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f9e2c700 1 -- 172.21.15.70:0/1703839744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9f40ff540 msgr2=0x7fa9f41978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f9e2c700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9f40ff540 0x7fa9f41978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f9e2c700 1 -- 172.21.15.70:0/1703839744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9f40fff00 msgr2=0x7fa9f4197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f9e2c700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9f40fff00 0x7fa9f4197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f9e2c700 1 -- 172.21.15.70:0/1703839744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00095f0 con 0x7fa9f4105600 2023-10-08T08:42:23.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9f9e2c700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f4105600 0x7fa9f41a2960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00ada0 tx=0x7fa9ec00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:23.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9e67fc700 1 -- 172.21.15.70:0/1703839744 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec00f070 con 0x7fa9f4105600 2023-10-08T08:42:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9e67fc700 1 -- 172.21.15.70:0/1703839744 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9ec007b30 con 0x7fa9f4105600 2023-10-08T08:42:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f41a3270 con 0x7fa9f4105600 2023-10-08T08:42:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9e67fc700 1 -- 172.21.15.70:0/1703839744 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec005280 con 0x7fa9f4105600 2023-10-08T08:42:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.070+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f41a3700 con 0x7fa9f4105600 2023-10-08T08:42:23.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.071+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f4107aa0 con 0x7fa9f4105600 2023-10-08T08:42:23.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.072+0000 7fa9e67fc700 1 -- 172.21.15.70:0/1703839744 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa9ec00c8d0 con 0x7fa9f4105600 2023-10-08T08:42:23.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.073+0000 7fa9e67fc700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa9e00a14d0 0x7fa9e00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.073+0000 7fa9f962b700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa9e00a14d0 0x7fa9e00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.073+0000 7fa9e67fc700 1 -- 172.21.15.70:0/1703839744 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fa9ec0cc540 con 0x7fa9f4105600 2023-10-08T08:42:23.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.073+0000 7fa9f962b700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa9e00a14d0 0x7fa9e00a3990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8005950 tx=0x7fa9e800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:23.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.077+0000 7fa9e67fc700 1 -- 172.21.15.70:0/1703839744 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa9ec0993f0 con 0x7fa9f4105600 2023-10-08T08:42:23.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.274+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9f4100c60 con 0x7fa9f4105600 2023-10-08T08:42:23.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.276+0000 7fa9e67fc700 1 -- 172.21.15.70:0/1703839744 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24277 (secure 0 0 0) 0x7fa9ec098f80 con 0x7fa9f4105600 2023-10-08T08:42:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:23.277 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:05.563861+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:23.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa9e00a14d0 msgr2=0x7fa9e00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa9e00a14d0 0x7fa9e00a3990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8005950 tx=0x7fa9e800b410 comp rx=0 tx=0).stop 2023-10-08T08:42:23.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f4105600 msgr2=0x7fa9f41a2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f4105600 0x7fa9f41a2960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00ada0 tx=0x7fa9ec00c330 comp rx=0 tx=0).stop 2023-10-08T08:42:23.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 shutdown_connections 2023-10-08T08:42:23.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa9e00a14d0 0x7fa9e00a3990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9f4105600 0x7fa9f41a2960 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9f40ff540 0x7fa9f41978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 --2- 172.21.15.70:0/1703839744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9f40fff00 0x7fa9f4197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 >> 172.21.15.70:0/1703839744 conn(0x7fa9f40fb030 msgr2=0x7fa9f40fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:23.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 shutdown_connections 2023-10-08T08:42:23.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.278+0000 7fa9fb88f700 1 -- 172.21.15.70:0/1703839744 wait complete. 2023-10-08T08:42:23.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:42:23.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.411+0000 7f85c33d9700 1 -- 172.21.15.70:0/3296393507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc105610 msgr2=0x7f85bc1059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.411+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3296393507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc105610 0x7f85bc1059f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0099c0 tx=0x7f85ac009cd0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.411+0000 7f85c33d9700 1 -- 172.21.15.70:0/3296393507 shutdown_connections 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.411+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3296393507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85bc0fff10 0x7f85bc10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.411+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3296393507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc105610 0x7f85bc1059f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.411+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3296393507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85bc0ff550 0x7f85bc0ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.411+0000 7f85c33d9700 1 -- 172.21.15.70:0/3296393507 >> 172.21.15.70:0/3296393507 conn(0x7f85bc0fb060 msgr2=0x7f85bc0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.411+0000 7f85c33d9700 1 -- 172.21.15.70:0/3296393507 shutdown_connections 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.411+0000 7f85c33d9700 1 -- 172.21.15.70:0/3296393507 wait complete. 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c33d9700 1 Processor -- start 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c33d9700 1 -- start start 2023-10-08T08:42:23.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c33d9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc0ff550 0x7f85bc19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c33d9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85bc0fff10 0x7f85bc19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c33d9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85bc105610 0x7f85bc195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c33d9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc195e00 con 0x7f85bc0ff550 2023-10-08T08:42:23.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c33d9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc195f70 con 0x7f85bc105610 2023-10-08T08:42:23.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c33d9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc196130 con 0x7f85bc0fff10 2023-10-08T08:42:23.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1175700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc0ff550 0x7f85bc19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1175700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc0ff550 0x7f85bc19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49400/0 (socket says 172.21.15.70:49400) 2023-10-08T08:42:23.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1175700 1 -- 172.21.15.70:0/3541443775 learned_addr learned my addr 172.21.15.70:0/3541443775 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:23.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c0974700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85bc0fff10 0x7f85bc19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1175700 1 -- 172.21.15.70:0/3541443775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85bc0fff10 msgr2=0x7f85bc19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1175700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85bc0fff10 0x7f85bc19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1175700 1 -- 172.21.15.70:0/3541443775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85bc105610 msgr2=0x7f85bc195790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1976700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85bc105610 0x7f85bc195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1175700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85bc105610 0x7f85bc195790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1175700 1 -- 172.21.15.70:0/3541443775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0095f0 con 0x7f85bc0ff550 2023-10-08T08:42:23.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1976700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85bc105610 0x7f85bc195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:23.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.412+0000 7f85c1175700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc0ff550 0x7f85bc19b660 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00b580 tx=0x7f85ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:23.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.413+0000 7f85b27fc700 1 -- 172.21.15.70:0/3541443775 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac01d070 con 0x7f85bc0ff550 2023-10-08T08:42:23.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.413+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc1963b0 con 0x7f85bc0ff550 2023-10-08T08:42:23.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.413+0000 7f85b27fc700 1 -- 172.21.15.70:0/3541443775 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85ac00fb30 con 0x7f85bc0ff550 2023-10-08T08:42:23.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.413+0000 7f85b27fc700 1 -- 172.21.15.70:0/3541443775 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac022c60 con 0x7f85bc0ff550 2023-10-08T08:42:23.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.413+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc1a2650 con 0x7f85bc0ff550 2023-10-08T08:42:23.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.414+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc107a90 con 0x7f85bc0ff550 2023-10-08T08:42:23.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.415+0000 7f85b27fc700 1 -- 172.21.15.70:0/3541443775 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f85ac00fca0 con 0x7f85bc0ff550 2023-10-08T08:42:23.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.415+0000 7f85b27fc700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f85a80a14d0 0x7f85a80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.415+0000 7f85b27fc700 1 -- 172.21.15.70:0/3541443775 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f85ac0ce0b0 con 0x7f85bc0ff550 2023-10-08T08:42:23.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.415+0000 7f85c0974700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f85a80a14d0 0x7f85a80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.416+0000 7f85c0974700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f85a80a14d0 0x7f85a80a3990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f85bc196bb0 tx=0x7f85b800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:23.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.420+0000 7f85b27fc700 1 -- 172.21.15.70:0/3541443775 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f85ac05d100 con 0x7f85bc0ff550 2023-10-08T08:42:23.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.610+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85bc100c70 con 0x7f85bc0ff550 2023-10-08T08:42:23.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.612+0000 7f85b27fc700 1 -- 172.21.15.70:0/3541443775 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24277 (secure 0 0 0) 0x7f85ac0974d0 con 0x7f85bc0ff550 2023-10-08T08:42:23.614 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:23.614 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:05.563861+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:23.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f85a80a14d0 msgr2=0x7f85a80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f85a80a14d0 0x7f85a80a3990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f85bc196bb0 tx=0x7f85b800b410 comp rx=0 tx=0).stop 2023-10-08T08:42:23.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc0ff550 msgr2=0x7f85bc19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc0ff550 0x7f85bc19b660 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00b580 tx=0x7f85ac004730 comp rx=0 tx=0).stop 2023-10-08T08:42:23.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 shutdown_connections 2023-10-08T08:42:23.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f85a80a14d0 0x7f85a80a3990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85bc105610 0x7f85bc195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85bc0ff550 0x7f85bc19b660 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 --2- 172.21.15.70:0/3541443775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85bc0fff10 0x7f85bc19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 >> 172.21.15.70:0/3541443775 conn(0x7f85bc0fb060 msgr2=0x7f85bc0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:23.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 shutdown_connections 2023-10-08T08:42:23.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.614+0000 7f85c33d9700 1 -- 172.21.15.70:0/3541443775 wait complete. 2023-10-08T08:42:23.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T08:42:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 -- 172.21.15.70:0/3362902185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680fffe0 msgr2=0x7fa06810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 --2- 172.21.15.70:0/3362902185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680fffe0 0x7fa06810c4e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa06000b0a0 tx=0x7fa06000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 -- 172.21.15.70:0/3362902185 shutdown_connections 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 --2- 172.21.15.70:0/3362902185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680fffe0 0x7fa06810c4e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 --2- 172.21.15.70:0/3362902185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0681056b0 0x7fa068105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 --2- 172.21.15.70:0/3362902185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0680ff620 0x7fa0680ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 -- 172.21.15.70:0/3362902185 >> 172.21.15.70:0/3362902185 conn(0x7fa068076780 msgr2=0x7fa068076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 -- 172.21.15.70:0/3362902185 shutdown_connections 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 -- 172.21.15.70:0/3362902185 wait complete. 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.751+0000 7fa06d701700 1 Processor -- start 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa06d701700 1 -- start start 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa06d701700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680ff620 0x7fa0681012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa06d701700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0680fffe0 0x7fa0681017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa06d701700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0681056b0 0x7fa068101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa06d701700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0681a4e50 con 0x7fa0680ff620 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa06d701700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0681a4fc0 con 0x7fa0680fffe0 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa06d701700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0681a5180 con 0x7fa0681056b0 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa066ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680ff620 0x7fa0681012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa066ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680ff620 0x7fa0681012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49414/0 (socket says 172.21.15.70:49414) 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa066ffd700 1 -- 172.21.15.70:0/886267841 learned_addr learned my addr 172.21.15.70:0/886267841 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa0677fe700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0681056b0 0x7fa068101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa0667fc700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0680fffe0 0x7fa0681017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa066ffd700 1 -- 172.21.15.70:0/886267841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0681056b0 msgr2=0x7fa068101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa066ffd700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0681056b0 0x7fa068101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa066ffd700 1 -- 172.21.15.70:0/886267841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0680fffe0 msgr2=0x7fa0681017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa066ffd700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0680fffe0 0x7fa0681017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa066ffd700 1 -- 172.21.15.70:0/886267841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa060009d00 con 0x7fa0680ff620 2023-10-08T08:42:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa0667fc700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0680fffe0 0x7fa0681017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa066ffd700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680ff620 0x7fa0681012b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00d980 tx=0x7fa05c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa04ffff700 1 -- 172.21.15.70:0/886267841 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c004020 con 0x7fa0680ff620 2023-10-08T08:42:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0681a5460 con 0x7fa0680ff620 2023-10-08T08:42:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa04ffff700 1 -- 172.21.15.70:0/886267841 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa05c009730 con 0x7fa0680ff620 2023-10-08T08:42:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.752+0000 7fa04ffff700 1 -- 172.21.15.70:0/886267841 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c003a30 con 0x7fa0680ff620 2023-10-08T08:42:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.753+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0681a5970 con 0x7fa0680ff620 2023-10-08T08:42:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.753+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa068100d50 con 0x7fa0680ff620 2023-10-08T08:42:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.755+0000 7fa04ffff700 1 -- 172.21.15.70:0/886267841 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa05c0098a0 con 0x7fa0680ff620 2023-10-08T08:42:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.755+0000 7fa04ffff700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa0500a14d0 0x7fa0500a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.755+0000 7fa0667fc700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa0500a14d0 0x7fa0500a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.755+0000 7fa04ffff700 1 -- 172.21.15.70:0/886267841 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fa05c0cd000 con 0x7fa0680ff620 2023-10-08T08:42:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.756+0000 7fa0667fc700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa0500a14d0 0x7fa0500a3990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa058005d90 tx=0x7fa058005d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.759+0000 7fa04ffff700 1 -- 172.21.15.70:0/886267841 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa05c096390 con 0x7fa0680ff620 2023-10-08T08:42:23.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:23.995+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa068102770 con 0x7fa0680ff620 2023-10-08T08:42:24.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.208+0000 7fa04ffff700 1 -- 172.21.15.70:0/886267841 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa05c0999b0 con 0x7fa0680ff620 2023-10-08T08:42:24.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa0500a14d0 msgr2=0x7fa0500a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:24.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa0500a14d0 0x7fa0500a3990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa058005d90 tx=0x7fa058005d20 comp rx=0 tx=0).stop 2023-10-08T08:42:24.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680ff620 msgr2=0x7fa0681012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:24.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680ff620 0x7fa0681012b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00d980 tx=0x7fa05c00dc90 comp rx=0 tx=0).stop 2023-10-08T08:42:24.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 shutdown_connections 2023-10-08T08:42:24.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa0500a14d0 0x7fa0500a3990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0681056b0 0x7fa068101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0680ff620 0x7fa0681012b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 --2- 172.21.15.70:0/886267841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0680fffe0 0x7fa0681017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 >> 172.21.15.70:0/886267841 conn(0x7fa068076780 msgr2=0x7fa0680fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:24.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 shutdown_connections 2023-10-08T08:42:24.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.210+0000 7fa06d701700 1 -- 172.21.15.70:0/886267841 wait complete. 2023-10-08T08:42:24.223 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True} 2023-10-08T08:42:24.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-08T08:42:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/2529090174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980fffe0 msgr2=0x7f8b9810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/2529090174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980fffe0 0x7f8b9810c4e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000b0a0 tx=0x7f8b9000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/2529090174 shutdown_connections 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/2529090174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980fffe0 0x7f8b9810c4e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/2529090174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b981056b0 0x7f8b98105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/2529090174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b980ff620 0x7f8b980ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/2529090174 >> 172.21.15.70:0/2529090174 conn(0x7f8b98076780 msgr2=0x7f8b98076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/2529090174 shutdown_connections 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/2529090174 wait complete. 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.347+0000 7f8b9c8c0700 1 Processor -- start 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9c8c0700 1 -- start start 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9c8c0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980ff620 0x7f8b9819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9c8c0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b980fffe0 0x7f8b9819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9c8c0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b981056b0 0x7f8b981958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9c8c0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98195f50 con 0x7f8b980ff620 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9c8c0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981960c0 con 0x7f8b981056b0 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9c8c0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98196280 con 0x7f8b980fffe0 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980ff620 0x7f8b9819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980ff620 0x7f8b9819b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49428/0 (socket says 172.21.15.70:49428) 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9659c700 1 -- 172.21.15.70:0/3261483674 learned_addr learned my addr 172.21.15.70:0/3261483674 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b95d9b700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b980fffe0 0x7f8b9819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b96d9d700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b981056b0 0x7f8b981958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9659c700 1 -- 172.21.15.70:0/3261483674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b980fffe0 msgr2=0x7f8b9819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9659c700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b980fffe0 0x7f8b9819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9659c700 1 -- 172.21.15.70:0/3261483674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b981056b0 msgr2=0x7f8b981958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9659c700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b981056b0 0x7f8b981958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:24.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9659c700 1 -- 172.21.15.70:0/3261483674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b90009d00 con 0x7f8b980ff620 2023-10-08T08:42:24.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b9659c700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980ff620 0x7f8b9819b6e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00d980 tx=0x7f8b8c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:24.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.348+0000 7f8b877fe700 1 -- 172.21.15.70:0/3261483674 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c004020 con 0x7f8b980ff620 2023-10-08T08:42:24.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.349+0000 7f8b877fe700 1 -- 172.21.15.70:0/3261483674 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b8c009730 con 0x7f8b980ff620 2023-10-08T08:42:24.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.349+0000 7f8b877fe700 1 -- 172.21.15.70:0/3261483674 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c003a80 con 0x7f8b980ff620 2023-10-08T08:42:24.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.349+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b98196560 con 0x7f8b980ff620 2023-10-08T08:42:24.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.349+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b981a2710 con 0x7f8b980ff620 2023-10-08T08:42:24.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.349+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b98107c30 con 0x7f8b980ff620 2023-10-08T08:42:24.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.351+0000 7f8b877fe700 1 -- 172.21.15.70:0/3261483674 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8b8c022020 con 0x7f8b980ff620 2023-10-08T08:42:24.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.351+0000 7f8b877fe700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b800a1550 0x7f8b800a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:24.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.351+0000 7f8b877fe700 1 -- 172.21.15.70:0/3261483674 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f8b8c0cc760 con 0x7f8b980ff620 2023-10-08T08:42:24.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.351+0000 7f8b95d9b700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b800a1550 0x7f8b800a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:24.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.352+0000 7f8b95d9b700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b800a1550 0x7f8b800a3a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8b98104d20 tx=0x7f8b88009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:24.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.355+0000 7f8b877fe700 1 -- 172.21.15.70:0/3261483674 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8b8c095b70 con 0x7f8b980ff620 2023-10-08T08:42:24.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:24 smithi070 ceph-mon[99513]: pgmap v246: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T08:42:24.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:24 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1703839744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:24.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:24 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3541443775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:24.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:24 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/886267841' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T08:42:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:24 smithi105 ceph-mon[103798]: pgmap v246: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T08:42:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:24 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1703839744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:24.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:24 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3541443775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:24.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:24 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/886267841' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T08:42:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:24.592+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f8b98196d80 con 0x7f8b980ff620 2023-10-08T08:42:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:24 smithi191 ceph-mon[104220]: pgmap v246: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T08:42:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:24 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1703839744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:24 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3541443775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:24 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/886267841' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T08:42:25.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.213+0000 7f8b877fe700 1 -- 172.21.15.70:0/3261483674 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f8b8c0170b0 con 0x7f8b980ff620 2023-10-08T08:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b800a1550 msgr2=0x7f8b800a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b800a1550 0x7f8b800a3a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8b98104d20 tx=0x7f8b88009190 comp rx=0 tx=0).stop 2023-10-08T08:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980ff620 msgr2=0x7f8b9819b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980ff620 0x7f8b9819b6e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00d980 tx=0x7f8b8c00dc90 comp rx=0 tx=0).stop 2023-10-08T08:42:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 shutdown_connections 2023-10-08T08:42:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8b800a1550 0x7f8b800a3a10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b981056b0 0x7f8b981958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b980ff620 0x7f8b9819b6e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 --2- 172.21.15.70:0/3261483674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b980fffe0 0x7f8b9819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 >> 172.21.15.70:0/3261483674 conn(0x7f8b98076780 msgr2=0x7f8b980fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 shutdown_connections 2023-10-08T08:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.217+0000 7f8b9c8c0700 1 -- 172.21.15.70:0/3261483674 wait complete. 2023-10-08T08:42:25.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-08T08:42:25.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 -- 172.21.15.70:0/286217120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 msgr2=0x7fd738105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:25.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/286217120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 0x7fd738105a10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009990 tx=0x7fd72c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 -- 172.21.15.70:0/286217120 shutdown_connections 2023-10-08T08:42:25.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/286217120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd738100000 0x7fd73810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/286217120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 0x7fd738105a10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/286217120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7380ff640 0x7fd7380ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 -- 172.21.15.70:0/286217120 >> 172.21.15.70:0/286217120 conn(0x7fd738076790 msgr2=0x7fd738076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 -- 172.21.15.70:0/286217120 shutdown_connections 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 -- 172.21.15.70:0/286217120 wait complete. 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.364+0000 7fd73ebe7700 1 Processor -- start 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73ebe7700 1 -- start start 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73ebe7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7380ff640 0x7fd738197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73ebe7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd738100000 0x7fd738197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73ebe7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 0x7fd7381a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73ebe7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7381986e0 con 0x7fd738105630 2023-10-08T08:42:25.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73ebe7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7381a2ef0 con 0x7fd738100000 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73ebe7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7381a3030 con 0x7fd7380ff640 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73d184700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 0x7fd7381a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73d184700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 0x7fd7381a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49444/0 (socket says 172.21.15.70:49444) 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73d184700 1 -- 172.21.15.70:0/2952546480 learned_addr learned my addr 172.21.15.70:0/2952546480 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73c983700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7380ff640 0x7fd738197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd737fff700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd738100000 0x7fd738197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73d184700 1 -- 172.21.15.70:0/2952546480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7380ff640 msgr2=0x7fd738197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73d184700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7380ff640 0x7fd738197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73d184700 1 -- 172.21.15.70:0/2952546480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd738100000 msgr2=0x7fd738197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73d184700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd738100000 0x7fd738197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73d184700 1 -- 172.21.15.70:0/2952546480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0095f0 con 0x7fd738105630 2023-10-08T08:42:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73d184700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 0x7fd7381a29b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd730007d70 tx=0x7fd73000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:25.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd735ffb700 1 -- 172.21.15.70:0/2952546480 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73000ac90 con 0x7fd738105630 2023-10-08T08:42:25.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd735ffb700 1 -- 172.21.15.70:0/2952546480 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd73000adf0 con 0x7fd738105630 2023-10-08T08:42:25.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.365+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7381a32c0 con 0x7fd738105630 2023-10-08T08:42:25.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.366+0000 7fd735ffb700 1 -- 172.21.15.70:0/2952546480 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300115e0 con 0x7fd738105630 2023-10-08T08:42:25.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.366+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7381a3820 con 0x7fd738105630 2023-10-08T08:42:25.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.367+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd738107c20 con 0x7fd738105630 2023-10-08T08:42:25.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.367+0000 7fd735ffb700 1 -- 172.21.15.70:0/2952546480 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd730012420 con 0x7fd738105630 2023-10-08T08:42:25.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.368+0000 7fd735ffb700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7280a1550 0x7fd7280a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:25.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.368+0000 7fd73c983700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7280a1550 0x7fd7280a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:25.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.368+0000 7fd735ffb700 1 -- 172.21.15.70:0/2952546480 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fd7300cd0f0 con 0x7fd738105630 2023-10-08T08:42:25.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.368+0000 7fd73c983700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7280a1550 0x7fd7280a3a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0098e0 tx=0x7fd72c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:25.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.372+0000 7fd735ffb700 1 -- 172.21.15.70:0/2952546480 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd730096480 con 0x7fd738105630 2023-10-08T08:42:25.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:25 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/886267841' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T08:42:25.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:25 smithi070 ceph-mon[99513]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:25.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:25 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3261483674' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T08:42:25.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:25 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/886267841' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T08:42:25.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:25 smithi105 ceph-mon[103798]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:25.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:25 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3261483674' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T08:42:25.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:25 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/886267841' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T08:42:25.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:25 smithi191 ceph-mon[104220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:25.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:25 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3261483674' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T08:42:25.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:25.611+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fd738068ff0 con 0x7fd738105630 2023-10-08T08:42:26.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.220+0000 7fd735ffb700 1 -- 172.21.15.70:0/2952546480 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd730099aa0 con 0x7fd738105630 2023-10-08T08:42:26.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7280a1550 msgr2=0x7fd7280a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7280a1550 0x7fd7280a3a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0098e0 tx=0x7fd72c005960 comp rx=0 tx=0).stop 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 msgr2=0x7fd7381a29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 0x7fd7381a29b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd730007d70 tx=0x7fd73000a340 comp rx=0 tx=0).stop 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 shutdown_connections 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7280a1550 0x7fd7280a3a10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd738105630 0x7fd7381a29b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7380ff640 0x7fd738197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 --2- 172.21.15.70:0/2952546480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd738100000 0x7fd738197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 >> 172.21.15.70:0/2952546480 conn(0x7fd738076790 msgr2=0x7fd7380fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 shutdown_connections 2023-10-08T08:42:26.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.224+0000 7fd73ebe7700 1 -- 172.21.15.70:0/2952546480 wait complete. 2023-10-08T08:42:26.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.413+0000 7fd52f7c1700 1 -- 172.21.15.70:0/3219208740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 msgr2=0x7fd52810c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.413+0000 7fd52f7c1700 1 --2- 172.21.15.70:0/3219208740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 0x7fd52810c500 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd52000b0a0 tx=0x7fd52000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 -- 172.21.15.70:0/3219208740 shutdown_connections 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 --2- 172.21.15.70:0/3219208740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 0x7fd52810c500 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 --2- 172.21.15.70:0/3219208740 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd528105640 0x7fd528105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 --2- 172.21.15.70:0/3219208740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5280ff640 0x7fd5280ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 -- 172.21.15.70:0/3219208740 >> 172.21.15.70:0/3219208740 conn(0x7fd5280767f0 msgr2=0x7fd528076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 -- 172.21.15.70:0/3219208740 shutdown_connections 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 -- 172.21.15.70:0/3219208740 wait complete. 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 Processor -- start 2023-10-08T08:42:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 -- start start 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5280ff640 0x7fd528197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 0x7fd528197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd528105640 0x7fd5281a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5281986f0 con 0x7fd528100000 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5281a2f40 con 0x7fd528105640 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.414+0000 7fd52f7c1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5281a3080 con 0x7fd5280ff640 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52cd5c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 0x7fd528197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52cd5c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 0x7fd528197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49458/0 (socket says 172.21.15.70:49458) 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52cd5c700 1 -- 172.21.15.70:0/1156708440 learned_addr learned my addr 172.21.15.70:0/1156708440 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52d55d700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5280ff640 0x7fd528197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52dd5e700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd528105640 0x7fd5281a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52cd5c700 1 -- 172.21.15.70:0/1156708440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5280ff640 msgr2=0x7fd528197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52cd5c700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5280ff640 0x7fd528197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52cd5c700 1 -- 172.21.15.70:0/1156708440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd528105640 msgr2=0x7fd5281a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52cd5c700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd528105640 0x7fd5281a2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52cd5c700 1 -- 172.21.15.70:0/1156708440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520009d00 con 0x7fd528100000 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52cd5c700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 0x7fd528197ec0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c920 tx=0x7fd51800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd51e7fc700 1 -- 172.21.15.70:0/1156708440 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518007b00 con 0x7fd528100000 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52f7c1700 1 -- 172.21.15.70:0/1156708440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5281a32e0 con 0x7fd528100000 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd51e7fc700 1 -- 172.21.15.70:0/1156708440 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd51800ce70 con 0x7fd528100000 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd51e7fc700 1 -- 172.21.15.70:0/1156708440 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518005460 con 0x7fd528100000 2023-10-08T08:42:26.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.415+0000 7fd52f7c1700 1 -- 172.21.15.70:0/1156708440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5281a3810 con 0x7fd528100000 2023-10-08T08:42:26.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.416+0000 7fd513fff700 1 -- 172.21.15.70:0/1156708440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd528100d70 con 0x7fd528100000 2023-10-08T08:42:26.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.417+0000 7fd51e7fc700 1 -- 172.21.15.70:0/1156708440 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd518004750 con 0x7fd528100000 2023-10-08T08:42:26.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.418+0000 7fd51e7fc700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5140a14d0 0x7fd5140a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:26.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.418+0000 7fd52d55d700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5140a14d0 0x7fd5140a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:26.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.418+0000 7fd51e7fc700 1 -- 172.21.15.70:0/1156708440 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fd5180cd040 con 0x7fd528100000 2023-10-08T08:42:26.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.418+0000 7fd52d55d700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5140a14d0 0x7fd5140a3990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd524005950 tx=0x7fd52400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:26.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.421+0000 7fd51e7fc700 1 -- 172.21.15.70:0/1156708440 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd5180963d0 con 0x7fd528100000 2023-10-08T08:42:26.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:26 smithi070 ceph-mon[99513]: pgmap v247: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T08:42:26.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:26 smithi070 ceph-mon[99513]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T08:42:26.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:26 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3261483674' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T08:42:26.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:26 smithi070 ceph-mon[99513]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T08:42:26.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:26 smithi070 ceph-mon[99513]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:26.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:26 smithi070 ceph-mon[99513]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-10-08T08:42:26.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:26 smithi070 ceph-mon[99513]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-10-08T08:42:26.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:26 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2952546480' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T08:42:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:26 smithi105 ceph-mon[103798]: pgmap v247: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T08:42:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:26 smithi105 ceph-mon[103798]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T08:42:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:26 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3261483674' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T08:42:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:26 smithi105 ceph-mon[103798]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T08:42:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:26 smithi105 ceph-mon[103798]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:26 smithi105 ceph-mon[103798]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-10-08T08:42:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:26 smithi105 ceph-mon[103798]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-10-08T08:42:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:26 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2952546480' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T08:42:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:26 smithi191 ceph-mon[104220]: pgmap v247: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T08:42:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:26 smithi191 ceph-mon[104220]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T08:42:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:26 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3261483674' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T08:42:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:26 smithi191 ceph-mon[104220]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T08:42:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:26 smithi191 ceph-mon[104220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T08:42:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:26 smithi191 ceph-mon[104220]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-10-08T08:42:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:26 smithi191 ceph-mon[104220]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-10-08T08:42:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:26 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2952546480' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T08:42:26.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:26.658+0000 7fd513fff700 1 -- 172.21.15.70:0/1156708440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fd528067980 con 0x7fd528100000 2023-10-08T08:42:27.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.230+0000 7fd51e7fc700 1 -- 172.21.15.70:0/1156708440 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7fd51801d070 con 0x7fd528100000 2023-10-08T08:42:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.232+0000 7fd513fff700 1 -- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5140a14d0 msgr2=0x7fd5140a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.232+0000 7fd513fff700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5140a14d0 0x7fd5140a3990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd524005950 tx=0x7fd52400b410 comp rx=0 tx=0).stop 2023-10-08T08:42:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.232+0000 7fd513fff700 1 -- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 msgr2=0x7fd528197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.232+0000 7fd513fff700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 0x7fd528197ec0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c920 tx=0x7fd51800cc30 comp rx=0 tx=0).stop 2023-10-08T08:42:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.233+0000 7fd513fff700 1 -- 172.21.15.70:0/1156708440 shutdown_connections 2023-10-08T08:42:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.233+0000 7fd513fff700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5140a14d0 0x7fd5140a3990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.233+0000 7fd513fff700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd528105640 0x7fd5281a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.233+0000 7fd513fff700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5280ff640 0x7fd528197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.233+0000 7fd513fff700 1 --2- 172.21.15.70:0/1156708440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd528100000 0x7fd528197ec0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.233+0000 7fd513fff700 1 -- 172.21.15.70:0/1156708440 >> 172.21.15.70:0/1156708440 conn(0x7fd5280767f0 msgr2=0x7fd5280fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.233+0000 7fd513fff700 1 -- 172.21.15.70:0/1156708440 shutdown_connections 2023-10-08T08:42:27.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.233+0000 7fd513fff700 1 -- 172.21.15.70:0/1156708440 wait complete. 2023-10-08T08:42:27.252 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-08T08:42:27.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:42:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.378+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/2102588377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740fff00 msgr2=0x7f2e7410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.378+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/2102588377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740fff00 0x7f2e7410c3c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00b0d0 tx=0x7f2e6c00b3e0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.378+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/2102588377 shutdown_connections 2023-10-08T08:42:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.378+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/2102588377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740fff00 0x7f2e7410c3c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.378+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/2102588377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e74105600 0x7f2e741059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.378+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/2102588377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e740ff540 0x7f2e740ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.379+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/2102588377 >> 172.21.15.70:0/2102588377 conn(0x7f2e740fb030 msgr2=0x7f2e740fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.379+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/2102588377 shutdown_connections 2023-10-08T08:42:27.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.379+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/2102588377 wait complete. 2023-10-08T08:42:27.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.379+0000 7f2e7a3e2700 1 Processor -- start 2023-10-08T08:42:27.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.379+0000 7f2e7a3e2700 1 -- start start 2023-10-08T08:42:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.379+0000 7f2e7a3e2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740ff540 0x7f2e741979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e7a3e2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e740fff00 0x7f2e74197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e7a3e2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e74105600 0x7f2e741a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e7a3e2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74198730 con 0x7f2e740ff540 2023-10-08T08:42:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e7a3e2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741a2f80 con 0x7f2e740fff00 2023-10-08T08:42:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e7a3e2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741a30c0 con 0x7f2e74105600 2023-10-08T08:42:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740ff540 0x7f2e741979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740ff540 0x7f2e741979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49470/0 (socket says 172.21.15.70:49470) 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e73fff700 1 -- 172.21.15.70:0/1626460599 learned_addr learned my addr 172.21.15.70:0/1626460599 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e737fe700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e740fff00 0x7f2e74197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e73fff700 1 -- 172.21.15.70:0/1626460599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e74105600 msgr2=0x7f2e741a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e73fff700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e74105600 0x7f2e741a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e73fff700 1 -- 172.21.15.70:0/1626460599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e740fff00 msgr2=0x7f2e74197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e73fff700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e740fff00 0x7f2e74197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e73fff700 1 -- 172.21.15.70:0/1626460599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c009d00 con 0x7f2e740ff540 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e737fe700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e740fff00 0x7f2e74197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e73fff700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740ff540 0x7f2e741979c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400d950 tx=0x7f2e6400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e717fa700 1 -- 172.21.15.70:0/1626460599 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64009b40 con 0x7f2e740ff540 2023-10-08T08:42:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e717fa700 1 -- 172.21.15.70:0/1626460599 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e64009ca0 con 0x7f2e740ff540 2023-10-08T08:42:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e717fa700 1 -- 172.21.15.70:0/1626460599 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6400f620 con 0x7f2e740ff540 2023-10-08T08:42:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e741a3320 con 0x7f2e740ff540 2023-10-08T08:42:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.380+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e741a3800 con 0x7f2e740ff540 2023-10-08T08:42:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.381+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e74107aa0 con 0x7f2e740ff540 2023-10-08T08:42:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.382+0000 7f2e717fa700 1 -- 172.21.15.70:0/1626460599 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f2e64010460 con 0x7f2e740ff540 2023-10-08T08:42:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.383+0000 7f2e717fa700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2e5c0a1550 0x7f2e5c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.383+0000 7f2e737fe700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2e5c0a1550 0x7f2e5c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.383+0000 7f2e717fa700 1 -- 172.21.15.70:0/1626460599 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f2e640cd300 con 0x7f2e740ff540 2023-10-08T08:42:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.383+0000 7f2e737fe700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2e5c0a1550 0x7f2e5c0a3a10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e68005fd0 tx=0x7f2e68005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:27.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.387+0000 7f2e717fa700 1 -- 172.21.15.70:0/1626460599 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2e64096630 con 0x7f2e740ff540 2023-10-08T08:42:27.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:27 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2952546480' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T08:42:27.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:27 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] up:active 2023-10-08T08:42:27.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:27 smithi105 ceph-mon[103798]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T08:42:27.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:27 smithi105 ceph-mon[103798]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2023-10-08T08:42:27.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:27 smithi105 ceph-mon[103798]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2023-10-08T08:42:27.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:27 smithi105 ceph-mon[103798]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-10-08T08:42:27.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:27 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1156708440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T08:42:27.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:27 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2952546480' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T08:42:27.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:27 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] up:active 2023-10-08T08:42:27.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:27 smithi191 ceph-mon[104220]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T08:42:27.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:27 smithi191 ceph-mon[104220]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2023-10-08T08:42:27.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:27 smithi191 ceph-mon[104220]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2023-10-08T08:42:27.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:27 smithi191 ceph-mon[104220]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-10-08T08:42:27.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:27 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1156708440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T08:42:27.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.621+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e74100c60 con 0x7f2e740ff540 2023-10-08T08:42:27.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.622+0000 7f2e717fa700 1 -- 172.21.15.70:0/1626460599 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11320 (secure 0 0 0) 0x7f2e64099c50 con 0x7f2e740ff540 2023-10-08T08:42:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:27.623 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24541,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24572,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24577,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:27.234172+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:creating","state_seq":1,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:42:27.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2e5c0a1550 msgr2=0x7f2e5c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2e5c0a1550 0x7f2e5c0a3a10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e68005fd0 tx=0x7f2e68005f60 comp rx=0 tx=0).stop 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740ff540 msgr2=0x7f2e741979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740ff540 0x7f2e741979c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400d950 tx=0x7f2e6400dd10 comp rx=0 tx=0).stop 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 shutdown_connections 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2e5c0a1550 0x7f2e5c0a3a10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e74105600 0x7f2e741a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e740ff540 0x7f2e741979c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 --2- 172.21.15.70:0/1626460599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e740fff00 0x7f2e74197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 >> 172.21.15.70:0/1626460599 conn(0x7f2e740fb030 msgr2=0x7f2e740fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 shutdown_connections 2023-10-08T08:42:27.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.624+0000 7f2e7a3e2700 1 -- 172.21.15.70:0/1626460599 wait complete. 2023-10-08T08:42:27.627 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2023-10-08T08:42:27.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:27 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2952546480' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T08:42:27.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:27 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] up:active 2023-10-08T08:42:27.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:27 smithi070 ceph-mon[99513]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T08:42:27.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:27 smithi070 ceph-mon[99513]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2023-10-08T08:42:27.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:27 smithi070 ceph-mon[99513]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2023-10-08T08:42:27.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:27 smithi070 ceph-mon[99513]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-10-08T08:42:27.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:27 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1156708440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T08:42:27.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:42:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.757+0000 7f87bce70700 1 -- 172.21.15.70:0/2685087244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8100650 msgr2=0x7f87b8100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.757+0000 7f87bce70700 1 --2- 172.21.15.70:0/2685087244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8100650 0x7f87b8100ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009990 tx=0x7f87ac009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.758+0000 7f87bce70700 1 -- 172.21.15.70:0/2685087244 shutdown_connections 2023-10-08T08:42:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.758+0000 7f87bce70700 1 --2- 172.21.15.70:0/2685087244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87b8101010 0x7f87b810d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.758+0000 7f87bce70700 1 --2- 172.21.15.70:0/2685087244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87b8106660 0x7f87b8106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.758+0000 7f87bce70700 1 --2- 172.21.15.70:0/2685087244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8100650 0x7f87b8100ad0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.758+0000 7f87bce70700 1 -- 172.21.15.70:0/2685087244 >> 172.21.15.70:0/2685087244 conn(0x7f87b80fc160 msgr2=0x7f87b80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.758+0000 7f87bce70700 1 -- 172.21.15.70:0/2685087244 shutdown_connections 2023-10-08T08:42:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.758+0000 7f87bce70700 1 -- 172.21.15.70:0/2685087244 wait complete. 2023-10-08T08:42:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.758+0000 7f87bce70700 1 Processor -- start 2023-10-08T08:42:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.758+0000 7f87bce70700 1 -- start start 2023-10-08T08:42:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87bce70700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87b8100650 0x7f87b819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87bce70700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8101010 0x7f87b819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87bce70700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87b8106660 0x7f87b81968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87bce70700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8196f50 con 0x7f87b8101010 2023-10-08T08:42:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87bce70700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b81970c0 con 0x7f87b8106660 2023-10-08T08:42:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87bce70700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8197280 con 0x7f87b8100650 2023-10-08T08:42:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b5d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8101010 0x7f87b819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b5d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8101010 0x7f87b819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49486/0 (socket says 172.21.15.70:49486) 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b5d9b700 1 -- 172.21.15.70:0/3892819326 learned_addr learned my addr 172.21.15.70:0/3892819326 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b659c700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87b8100650 0x7f87b819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b6d9d700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87b8106660 0x7f87b81968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b5d9b700 1 -- 172.21.15.70:0/3892819326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87b8100650 msgr2=0x7f87b819c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b5d9b700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87b8100650 0x7f87b819c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b5d9b700 1 -- 172.21.15.70:0/3892819326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87b8106660 msgr2=0x7f87b81968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b5d9b700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87b8106660 0x7f87b81968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b5d9b700 1 -- 172.21.15.70:0/3892819326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0095f0 con 0x7f87b8101010 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87b5d9b700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8101010 0x7f87b819cd00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f87ac00b5c0 tx=0x7f87ac00f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87a77fe700 1 -- 172.21.15.70:0/3892819326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac01d070 con 0x7f87b8101010 2023-10-08T08:42:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b8197500 con 0x7f87b8101010 2023-10-08T08:42:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87a77fe700 1 -- 172.21.15.70:0/3892819326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87ac00fd60 con 0x7f87b8101010 2023-10-08T08:42:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87a77fe700 1 -- 172.21.15.70:0/3892819326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0173f0 con 0x7f87b8101010 2023-10-08T08:42:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.759+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b81a37b0 con 0x7f87b8101010 2023-10-08T08:42:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.760+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b8108c70 con 0x7f87b8101010 2023-10-08T08:42:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.761+0000 7f87a77fe700 1 -- 172.21.15.70:0/3892819326 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f87ac003860 con 0x7f87b8101010 2023-10-08T08:42:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.762+0000 7f87a77fe700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87a00a14d0 0x7f87a00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.762+0000 7f87b659c700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87a00a14d0 0x7f87a00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.762+0000 7f87a77fe700 1 -- 172.21.15.70:0/3892819326 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f87ac0ce560 con 0x7f87b8101010 2023-10-08T08:42:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.762+0000 7f87b659c700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87a00a14d0 0x7f87a00a3990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87a8005ea0 tx=0x7f87a8005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:27.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.766+0000 7f87a77fe700 1 -- 172.21.15.70:0/3892819326 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f87ac097920 con 0x7f87b8101010 2023-10-08T08:42:27.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.960+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87b8197db0 con 0x7f87b8101010 2023-10-08T08:42:27.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.961+0000 7f87a77fe700 1 -- 172.21.15.70:0/3892819326 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24277 (secure 0 0 0) 0x7f87ac09af40 con 0x7f87b8101010 2023-10-08T08:42:27.963 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:27.963 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:05.563861+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:27.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87a00a14d0 msgr2=0x7f87a00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87a00a14d0 0x7f87a00a3990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87a8005ea0 tx=0x7f87a8005e30 comp rx=0 tx=0).stop 2023-10-08T08:42:27.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8101010 msgr2=0x7f87b819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:27.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8101010 0x7f87b819cd00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f87ac00b5c0 tx=0x7f87ac00f7b0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 shutdown_connections 2023-10-08T08:42:27.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87a00a14d0 0x7f87a00a3990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87b8106660 0x7f87b81968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87b8100650 0x7f87b819c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 --2- 172.21.15.70:0/3892819326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87b8101010 0x7f87b819cd00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:27.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 >> 172.21.15.70:0/3892819326 conn(0x7f87b80fc160 msgr2=0x7f87b80fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:27.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 shutdown_connections 2023-10-08T08:42:27.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:27.964+0000 7f87bce70700 1 -- 172.21.15.70:0/3892819326 wait complete. 2023-10-08T08:42:27.977 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T08:42:27.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T08:42:28.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 -- 172.21.15.70:0/20301557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2440ffec0 msgr2=0x7fa24410c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 --2- 172.21.15.70:0/20301557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2440ffec0 0x7fa24410c380 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00b0d0 tx=0x7fa23c00b3e0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 -- 172.21.15.70:0/20301557 shutdown_connections 2023-10-08T08:42:28.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 --2- 172.21.15.70:0/20301557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2440ffec0 0x7fa24410c380 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 --2- 172.21.15.70:0/20301557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2441055c0 0x7fa2441059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 --2- 172.21.15.70:0/20301557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2440ff500 0x7fa2440ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 -- 172.21.15.70:0/20301557 >> 172.21.15.70:0/20301557 conn(0x7fa2440fafd0 msgr2=0x7fa2440fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 -- 172.21.15.70:0/20301557 shutdown_connections 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 -- 172.21.15.70:0/20301557 wait complete. 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.098+0000 7fa24899d700 1 Processor -- start 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa24899d700 1 -- start start 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa24899d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2440ff500 0x7fa24419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa24899d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2440ffec0 0x7fa24419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa24899d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2441055c0 0x7fa244196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:28.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa24899d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa244197140 con 0x7fa2441055c0 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa24899d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441972b0 con 0x7fa2440ffec0 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa24899d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa244197470 con 0x7fa2440ff500 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa243fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2441055c0 0x7fa244196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa243fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2441055c0 0x7fa244196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49502/0 (socket says 172.21.15.70:49502) 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa243fff700 1 -- 172.21.15.70:0/1492880476 learned_addr learned my addr 172.21.15.70:0/1492880476 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa2437fe700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2440ff500 0x7fa24419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa242ffd700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2440ffec0 0x7fa24419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa243fff700 1 -- 172.21.15.70:0/1492880476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2440ff500 msgr2=0x7fa24419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa243fff700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2440ff500 0x7fa24419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa243fff700 1 -- 172.21.15.70:0/1492880476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2440ffec0 msgr2=0x7fa24419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa243fff700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2440ffec0 0x7fa24419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.099+0000 7fa243fff700 1 -- 172.21.15.70:0/1492880476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c009d00 con 0x7fa2441055c0 2023-10-08T08:42:28.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.100+0000 7fa243fff700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2441055c0 0x7fa244196970 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0094c0 tx=0x7fa23c0095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:28.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.100+0000 7fa240ff9700 1 -- 172.21.15.70:0/1492880476 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00e040 con 0x7fa2441055c0 2023-10-08T08:42:28.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.100+0000 7fa240ff9700 1 -- 172.21.15.70:0/1492880476 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa23c01db40 con 0x7fa2441055c0 2023-10-08T08:42:28.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.100+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2441976f0 con 0x7fa2441055c0 2023-10-08T08:42:28.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.100+0000 7fa240ff9700 1 -- 172.21.15.70:0/1492880476 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c01baf0 con 0x7fa2441055c0 2023-10-08T08:42:28.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.100+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2441a3850 con 0x7fa2441055c0 2023-10-08T08:42:28.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.101+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa244100c20 con 0x7fa2441055c0 2023-10-08T08:42:28.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.102+0000 7fa240ff9700 1 -- 172.21.15.70:0/1492880476 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa23c01dcb0 con 0x7fa2441055c0 2023-10-08T08:42:28.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.102+0000 7fa240ff9700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa22c0a14d0 0x7fa22c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:28.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.103+0000 7fa2437fe700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa22c0a14d0 0x7fa22c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:28.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.103+0000 7fa240ff9700 1 -- 172.21.15.70:0/1492880476 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fa23c0cece0 con 0x7fa2441055c0 2023-10-08T08:42:28.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.103+0000 7fa2437fe700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa22c0a14d0 0x7fa22c0a3990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa238005950 tx=0x7fa2380058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:28.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.106+0000 7fa240ff9700 1 -- 172.21.15.70:0/1492880476 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa23c098100 con 0x7fa2441055c0 2023-10-08T08:42:28.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.301+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa244197e50 con 0x7fa22c0a14d0 2023-10-08T08:42:28.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.313+0000 7fa240ff9700 1 -- 172.21.15.70:0/1492880476 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422015 (secure 0 0 0) 0x7fa244197e50 con 0x7fa22c0a14d0 2023-10-08T08:42:28.323 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa22c0a14d0 msgr2=0x7fa22c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa22c0a14d0 0x7fa22c0a3990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa238005950 tx=0x7fa2380058e0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2441055c0 msgr2=0x7fa244196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2441055c0 0x7fa244196970 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0094c0 tx=0x7fa23c0095a0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 shutdown_connections 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa22c0a14d0 0x7fa22c0a3990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2441055c0 0x7fa244196970 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2440ff500 0x7fa24419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 --2- 172.21.15.70:0/1492880476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2440ffec0 0x7fa24419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.317+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 >> 172.21.15.70:0/1492880476 conn(0x7fa2440fafd0 msgr2=0x7fa2440fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:28.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.318+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 shutdown_connections 2023-10-08T08:42:28.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.318+0000 7fa24899d700 1 -- 172.21.15.70:0/1492880476 wait complete. 2023-10-08T08:42:28.328 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-10-08T08:42:28.331 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2023-10-08T08:42:27.053712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":236,"num_write_kb":2963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337304,"kb_used_data":13040,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604520,"statfs":{"total":1151940427776,"available":1151595028480,"internally_reserved":0,"allocated":13352960,"data_stored":7463317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003295"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168218+0000","last_change":"2023-10-08T08:42:01.146976+0000","last_active":"2023-10-08T08:42:05.168218+0000","last_peered":"2023-10-08T08:42:05.168218+0000","last_clean":"2023-10-08T08:42:05.168218+0000","last_became_active":"2023-10-08T08:42:01.146184+0000","last_became_peered":"2023-10-08T08:42:01.146184+0000","last_unstale":"2023-10-08T08:42:05.168218+0000","last_undegraded":"2023-10-08T08:42:05.168218+0000","last_fullsized":"2023-10-08T08:42:05.168218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:35.571911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175377+0000","last_change":"2023-10-08T08:42:01.142007+0000","last_active":"2023-10-08T08:42:05.175377+0000","last_peered":"2023-10-08T08:42:05.175377+0000","last_clean":"2023-10-08T08:42:05.175377+0000","last_became_active":"2023-10-08T08:42:01.141630+0000","last_became_peered":"2023-10-08T08:42:01.141630+0000","last_unstale":"2023-10-08T08:42:05.175377+0000","last_undegraded":"2023-10-08T08:42:05.175377+0000","last_fullsized":"2023-10-08T08:42:05.175377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:53.307828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175005+0000","last_change":"2023-10-08T08:42:01.154742+0000","last_active":"2023-10-08T08:42:05.175005+0000","last_peered":"2023-10-08T08:42:05.175005+0000","last_clean":"2023-10-08T08:42:05.175005+0000","last_became_active":"2023-10-08T08:42:01.154439+0000","last_became_peered":"2023-10-08T08:42:01.154439+0000","last_unstale":"2023-10-08T08:42:05.175005+0000","last_undegraded":"2023-10-08T08:42:05.175005+0000","last_fullsized":"2023-10-08T08:42:05.175005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:23.990594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165397+0000","last_change":"2023-10-08T08:42:01.149940+0000","last_active":"2023-10-08T08:42:05.165397+0000","last_peered":"2023-10-08T08:42:05.165397+0000","last_clean":"2023-10-08T08:42:05.165397+0000","last_became_active":"2023-10-08T08:42:01.149628+0000","last_became_peered":"2023-10-08T08:42:01.149628+0000","last_unstale":"2023-10-08T08:42:05.165397+0000","last_undegraded":"2023-10-08T08:42:05.165397+0000","last_fullsized":"2023-10-08T08:42:05.165397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:38.961102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164177+0000","last_change":"2023-10-08T08:42:01.145396+0000","last_active":"2023-10-08T08:42:05.164177+0000","last_peered":"2023-10-08T08:42:05.164177+0000","last_clean":"2023-10-08T08:42:05.164177+0000","last_became_active":"2023-10-08T08:42:01.140511+0000","last_became_peered":"2023-10-08T08:42:01.140511+0000","last_unstale":"2023-10-08T08:42:05.164177+0000","last_undegraded":"2023-10-08T08:42:05.164177+0000","last_fullsized":"2023-10-08T08:42:05.164177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:38.079768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158381+0000","last_change":"2023-10-08T08:42:01.128798+0000","last_active":"2023-10-08T08:42:05.158381+0000","last_peered":"2023-10-08T08:42:05.158381+0000","last_clean":"2023-10-08T08:42:05.158381+0000","last_became_active":"2023-10-08T08:42:01.128485+0000","last_became_peered":"2023-10-08T08:42:01.128485+0000","last_unstale":"2023-10-08T08:42:05.158381+0000","last_undegraded":"2023-10-08T08:42:05.158381+0000","last_fullsized":"2023-10-08T08:42:05.158381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:33:59.121551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163085+0000","last_change":"2023-10-08T08:42:01.136315+0000","last_active":"2023-10-08T08:42:05.163085+0000","last_peered":"2023-10-08T08:42:05.163085+0000","last_clean":"2023-10-08T08:42:05.163085+0000","last_became_active":"2023-10-08T08:42:01.136025+0000","last_became_peered":"2023-10-08T08:42:01.136025+0000","last_unstale":"2023-10-08T08:42:05.163085+0000","last_undegraded":"2023-10-08T08:42:05.163085+0000","last_fullsized":"2023-10-08T08:42:05.163085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:35.675920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165509+0000","last_change":"2023-10-08T08:42:01.129839+0000","last_active":"2023-10-08T08:42:05.165509+0000","last_peered":"2023-10-08T08:42:05.165509+0000","last_clean":"2023-10-08T08:42:05.165509+0000","last_became_active":"2023-10-08T08:42:01.129524+0000","last_became_peered":"2023-10-08T08:42:01.129524+0000","last_unstale":"2023-10-08T08:42:05.165509+0000","last_undegraded":"2023-10-08T08:42:05.165509+0000","last_fullsized":"2023-10-08T08:42:05.165509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:44.463024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166174+0000","last_change":"2023-10-08T08:42:01.135304+0000","last_active":"2023-10-08T08:42:05.166174+0000","last_peered":"2023-10-08T08:42:05.166174+0000","last_clean":"2023-10-08T08:42:05.166174+0000","last_became_active":"2023-10-08T08:42:01.134978+0000","last_became_peered":"2023-10-08T08:42:01.134978+0000","last_unstale":"2023-10-08T08:42:05.166174+0000","last_undegraded":"2023-10-08T08:42:05.166174+0000","last_fullsized":"2023-10-08T08:42:05.166174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:46:03.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158899+0000","last_change":"2023-10-08T08:42:01.134686+0000","last_active":"2023-10-08T08:42:05.158899+0000","last_peered":"2023-10-08T08:42:05.158899+0000","last_clean":"2023-10-08T08:42:05.158899+0000","last_became_active":"2023-10-08T08:42:01.134360+0000","last_became_peered":"2023-10-08T08:42:01.134360+0000","last_unstale":"2023-10-08T08:42:05.158899+0000","last_undegraded":"2023-10-08T08:42:05.158899+0000","last_fullsized":"2023-10-08T08:42:05.158899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:56.814182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168687+0000","last_change":"2023-10-08T08:42:01.148309+0000","last_active":"2023-10-08T08:42:05.168687+0000","last_peered":"2023-10-08T08:42:05.168687+0000","last_clean":"2023-10-08T08:42:05.168687+0000","last_became_active":"2023-10-08T08:42:01.147964+0000","last_became_peered":"2023-10-08T08:42:01.147964+0000","last_unstale":"2023-10-08T08:42:05.168687+0000","last_undegraded":"2023-10-08T08:42:05.168687+0000","last_fullsized":"2023-10-08T08:42:05.168687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:45.418572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165285+0000","last_change":"2023-10-08T08:42:01.148141+0000","last_active":"2023-10-08T08:42:05.165285+0000","last_peered":"2023-10-08T08:42:05.165285+0000","last_clean":"2023-10-08T08:42:05.165285+0000","last_became_active":"2023-10-08T08:42:01.147788+0000","last_became_peered":"2023-10-08T08:42:01.147788+0000","last_unstale":"2023-10-08T08:42:05.165285+0000","last_undegraded":"2023-10-08T08:42:05.165285+0000","last_fullsized":"2023-10-08T08:42:05.165285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:37.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157906+0000","last_change":"2023-10-08T08:42:01.141737+0000","last_active":"2023-10-08T08:42:05.157906+0000","last_peered":"2023-10-08T08:42:05.157906+0000","last_clean":"2023-10-08T08:42:05.157906+0000","last_became_active":"2023-10-08T08:42:01.141353+0000","last_became_peered":"2023-10-08T08:42:01.141353+0000","last_unstale":"2023-10-08T08:42:05.157906+0000","last_undegraded":"2023-10-08T08:42:05.157906+0000","last_fullsized":"2023-10-08T08:42:05.157906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:58:11.592880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.174082+0000","last_change":"2023-10-08T08:42:01.148031+0000","last_active":"2023-10-08T08:42:05.174082+0000","last_peered":"2023-10-08T08:42:05.174082+0000","last_clean":"2023-10-08T08:42:05.174082+0000","last_became_active":"2023-10-08T08:42:01.147785+0000","last_became_peered":"2023-10-08T08:42:01.147785+0000","last_unstale":"2023-10-08T08:42:05.174082+0000","last_undegraded":"2023-10-08T08:42:05.174082+0000","last_fullsized":"2023-10-08T08:42:05.174082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:43.702638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.172866+0000","last_change":"2023-10-08T08:42:01.154669+0000","last_active":"2023-10-08T08:42:05.172866+0000","last_peered":"2023-10-08T08:42:05.172866+0000","last_clean":"2023-10-08T08:42:05.172866+0000","last_became_active":"2023-10-08T08:42:01.154385+0000","last_became_peered":"2023-10-08T08:42:01.154385+0000","last_unstale":"2023-10-08T08:42:05.172866+0000","last_undegraded":"2023-10-08T08:42:05.172866+0000","last_fullsized":"2023-10-08T08:42:05.172866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:41.654979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165771+0000","last_change":"2023-10-08T08:42:01.143017+0000","last_active":"2023-10-08T08:42:05.165771+0000","last_peered":"2023-10-08T08:42:05.165771+0000","last_clean":"2023-10-08T08:42:05.165771+0000","last_became_active":"2023-10-08T08:42:01.142728+0000","last_became_peered":"2023-10-08T08:42:01.142728+0000","last_unstale":"2023-10-08T08:42:05.165771+0000","last_undegraded":"2023-10-08T08:42:05.165771+0000","last_fullsized":"2023-10-08T08:42:05.165771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.303212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168118+0000","last_change":"2023-10-08T08:42:01.147335+0000","last_active":"2023-10-08T08:42:05.168118+0000","last_peered":"2023-10-08T08:42:05.168118+0000","last_clean":"2023-10-08T08:42:05.168118+0000","last_became_active":"2023-10-08T08:42:01.146641+0000","last_became_peered":"2023-10-08T08:42:01.146641+0000","last_unstale":"2023-10-08T08:42:05.168118+0000","last_undegraded":"2023-10-08T08:42:05.168118+0000","last_fullsized":"2023-10-08T08:42:05.168118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:27.274207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164340+0000","last_change":"2023-10-08T08:42:01.132417+0000","last_active":"2023-10-08T08:42:05.164340+0000","last_peered":"2023-10-08T08:42:05.164340+0000","last_clean":"2023-10-08T08:42:05.164340+0000","last_became_active":"2023-10-08T08:42:01.132135+0000","last_became_peered":"2023-10-08T08:42:01.132135+0000","last_unstale":"2023-10-08T08:42:05.164340+0000","last_undegraded":"2023-10-08T08:42:05.164340+0000","last_fullsized":"2023-10-08T08:42:05.164340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:11.916677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167774+0000","last_change":"2023-10-08T08:42:01.136100+0000","last_active":"2023-10-08T08:42:05.167774+0000","last_peered":"2023-10-08T08:42:05.167774+0000","last_clean":"2023-10-08T08:42:05.167774+0000","last_became_active":"2023-10-08T08:42:01.135826+0000","last_became_peered":"2023-10-08T08:42:01.135826+0000","last_unstale":"2023-10-08T08:42:05.167774+0000","last_undegraded":"2023-10-08T08:42:05.167774+0000","last_fullsized":"2023-10-08T08:42:05.167774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:03.734296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160117+0000","last_change":"2023-10-08T08:42:05.177765+0000","last_active":"2023-10-08T08:42:06.160117+0000","last_peered":"2023-10-08T08:42:06.160117+0000","last_clean":"2023-10-08T08:42:06.160117+0000","last_became_active":"2023-10-08T08:42:05.177362+0000","last_became_peered":"2023-10-08T08:42:05.177362+0000","last_unstale":"2023-10-08T08:42:06.160117+0000","last_undegraded":"2023-10-08T08:42:06.160117+0000","last_fullsized":"2023-10-08T08:42:06.160117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:21.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163710+0000","last_change":"2023-10-08T08:42:00.111581+0000","last_active":"2023-10-08T08:42:05.163710+0000","last_peered":"2023-10-08T08:42:05.163710+0000","last_clean":"2023-10-08T08:42:05.163710+0000","last_became_active":"2023-10-08T08:42:00.111298+0000","last_became_peered":"2023-10-08T08:42:00.111298+0000","last_unstale":"2023-10-08T08:42:05.163710+0000","last_undegraded":"2023-10-08T08:42:05.163710+0000","last_fullsized":"2023-10-08T08:42:05.163710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:52:39.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167284+0000","last_change":"2023-10-08T08:42:01.134630+0000","last_active":"2023-10-08T08:42:05.167284+0000","last_peered":"2023-10-08T08:42:05.167284+0000","last_clean":"2023-10-08T08:42:05.167284+0000","last_became_active":"2023-10-08T08:42:01.134347+0000","last_became_peered":"2023-10-08T08:42:01.134347+0000","last_unstale":"2023-10-08T08:42:05.167284+0000","last_undegraded":"2023-10-08T08:42:05.167284+0000","last_fullsized":"2023-10-08T08:42:05.167284+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:51:14.364756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176587+0000","last_change":"2023-10-08T08:42:05.177223+0000","last_active":"2023-10-08T08:42:06.176587+0000","last_peered":"2023-10-08T08:42:06.176587+0000","last_clean":"2023-10-08T08:42:06.176587+0000","last_became_active":"2023-10-08T08:42:05.176811+0000","last_became_peered":"2023-10-08T08:42:05.176811+0000","last_unstale":"2023-10-08T08:42:06.176587+0000","last_undegraded":"2023-10-08T08:42:06.176587+0000","last_fullsized":"2023-10-08T08:42:06.176587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:41.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167381+0000","last_change":"2023-10-08T08:42:00.115860+0000","last_active":"2023-10-08T08:42:05.167381+0000","last_peered":"2023-10-08T08:42:05.167381+0000","last_clean":"2023-10-08T08:42:05.167381+0000","last_became_active":"2023-10-08T08:42:00.115601+0000","last_became_peered":"2023-10-08T08:42:00.115601+0000","last_unstale":"2023-10-08T08:42:05.167381+0000","last_undegraded":"2023-10-08T08:42:05.167381+0000","last_fullsized":"2023-10-08T08:42:05.167381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:20.071545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175806+0000","last_change":"2023-10-08T08:42:01.146648+0000","last_active":"2023-10-08T08:42:05.175806+0000","last_peered":"2023-10-08T08:42:05.175806+0000","last_clean":"2023-10-08T08:42:05.175806+0000","last_became_active":"2023-10-08T08:42:01.145978+0000","last_became_peered":"2023-10-08T08:42:01.145978+0000","last_unstale":"2023-10-08T08:42:05.175806+0000","last_undegraded":"2023-10-08T08:42:05.175806+0000","last_fullsized":"2023-10-08T08:42:05.175806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:55.768519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176895+0000","last_change":"2023-10-08T08:42:05.185079+0000","last_active":"2023-10-08T08:42:06.176895+0000","last_peered":"2023-10-08T08:42:06.176895+0000","last_clean":"2023-10-08T08:42:06.176895+0000","last_became_active":"2023-10-08T08:42:05.184521+0000","last_became_peered":"2023-10-08T08:42:05.184521+0000","last_unstale":"2023-10-08T08:42:06.176895+0000","last_undegraded":"2023-10-08T08:42:06.176895+0000","last_fullsized":"2023-10-08T08:42:06.176895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:39:17.457051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166205+0000","last_change":"2023-10-08T08:42:00.112111+0000","last_active":"2023-10-08T08:42:05.166205+0000","last_peered":"2023-10-08T08:42:05.166205+0000","last_clean":"2023-10-08T08:42:05.166205+0000","last_became_active":"2023-10-08T08:42:00.111808+0000","last_became_peered":"2023-10-08T08:42:00.111808+0000","last_unstale":"2023-10-08T08:42:05.166205+0000","last_undegraded":"2023-10-08T08:42:05.166205+0000","last_fullsized":"2023-10-08T08:42:05.166205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:03.022378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165079+0000","last_change":"2023-10-08T08:42:01.133308+0000","last_active":"2023-10-08T08:42:05.165079+0000","last_peered":"2023-10-08T08:42:05.165079+0000","last_clean":"2023-10-08T08:42:05.165079+0000","last_became_active":"2023-10-08T08:42:01.131649+0000","last_became_peered":"2023-10-08T08:42:01.131649+0000","last_unstale":"2023-10-08T08:42:05.165079+0000","last_undegraded":"2023-10-08T08:42:05.165079+0000","last_fullsized":"2023-10-08T08:42:05.165079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:05.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176411+0000","last_change":"2023-10-08T08:42:05.182409+0000","last_active":"2023-10-08T08:42:06.176411+0000","last_peered":"2023-10-08T08:42:06.176411+0000","last_clean":"2023-10-08T08:42:06.176411+0000","last_became_active":"2023-10-08T08:42:05.181974+0000","last_became_peered":"2023-10-08T08:42:05.181974+0000","last_unstale":"2023-10-08T08:42:06.176411+0000","last_undegraded":"2023-10-08T08:42:06.176411+0000","last_fullsized":"2023-10-08T08:42:06.176411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:05.821339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164990+0000","last_change":"2023-10-08T08:42:00.113287+0000","last_active":"2023-10-08T08:42:05.164990+0000","last_peered":"2023-10-08T08:42:05.164990+0000","last_clean":"2023-10-08T08:42:05.164990+0000","last_became_active":"2023-10-08T08:42:00.112996+0000","last_became_peered":"2023-10-08T08:42:00.112996+0000","last_unstale":"2023-10-08T08:42:05.164990+0000","last_undegraded":"2023-10-08T08:42:05.164990+0000","last_fullsized":"2023-10-08T08:42:05.164990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:42.559360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159558+0000","last_change":"2023-10-08T08:42:01.139763+0000","last_active":"2023-10-08T08:42:05.159558+0000","last_peered":"2023-10-08T08:42:05.159558+0000","last_clean":"2023-10-08T08:42:05.159558+0000","last_became_active":"2023-10-08T08:42:01.139451+0000","last_became_peered":"2023-10-08T08:42:01.139451+0000","last_unstale":"2023-10-08T08:42:05.159558+0000","last_undegraded":"2023-10-08T08:42:05.159558+0000","last_fullsized":"2023-10-08T08:42:05.159558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:10.166151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160495+0000","last_change":"2023-10-08T08:42:05.174612+0000","last_active":"2023-10-08T08:42:06.160495+0000","last_peered":"2023-10-08T08:42:06.160495+0000","last_clean":"2023-10-08T08:42:06.160495+0000","last_became_active":"2023-10-08T08:42:05.174174+0000","last_became_peered":"2023-10-08T08:42:05.174174+0000","last_unstale":"2023-10-08T08:42:06.160495+0000","last_undegraded":"2023-10-08T08:42:06.160495+0000","last_fullsized":"2023-10-08T08:42:06.160495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:07.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159118+0000","last_change":"2023-10-08T08:42:00.112537+0000","last_active":"2023-10-08T08:42:05.159118+0000","last_peered":"2023-10-08T08:42:05.159118+0000","last_clean":"2023-10-08T08:42:05.159118+0000","last_became_active":"2023-10-08T08:42:00.112060+0000","last_became_peered":"2023-10-08T08:42:00.112060+0000","last_unstale":"2023-10-08T08:42:05.159118+0000","last_undegraded":"2023-10-08T08:42:05.159118+0000","last_fullsized":"2023-10-08T08:42:05.159118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:41.878960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164840+0000","last_change":"2023-10-08T08:42:01.146929+0000","last_active":"2023-10-08T08:42:05.164840+0000","last_peered":"2023-10-08T08:42:05.164840+0000","last_clean":"2023-10-08T08:42:05.164840+0000","last_became_active":"2023-10-08T08:42:01.145980+0000","last_became_peered":"2023-10-08T08:42:01.145980+0000","last_unstale":"2023-10-08T08:42:05.164840+0000","last_undegraded":"2023-10-08T08:42:05.164840+0000","last_fullsized":"2023-10-08T08:42:05.164840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:37.411832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160530+0000","last_change":"2023-10-08T08:42:05.185417+0000","last_active":"2023-10-08T08:42:06.160530+0000","last_peered":"2023-10-08T08:42:06.160530+0000","last_clean":"2023-10-08T08:42:06.160530+0000","last_became_active":"2023-10-08T08:42:05.185033+0000","last_became_peered":"2023-10-08T08:42:05.185033+0000","last_unstale":"2023-10-08T08:42:06.160530+0000","last_undegraded":"2023-10-08T08:42:06.160530+0000","last_fullsized":"2023-10-08T08:42:06.160530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:40.827523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158414+0000","last_change":"2023-10-08T08:42:00.115656+0000","last_active":"2023-10-08T08:42:05.158414+0000","last_peered":"2023-10-08T08:42:05.158414+0000","last_clean":"2023-10-08T08:42:05.158414+0000","last_became_active":"2023-10-08T08:42:00.115342+0000","last_became_peered":"2023-10-08T08:42:00.115342+0000","last_unstale":"2023-10-08T08:42:05.158414+0000","last_undegraded":"2023-10-08T08:42:05.158414+0000","last_fullsized":"2023-10-08T08:42:05.158414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:32.630853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159322+0000","last_change":"2023-10-08T08:42:01.139137+0000","last_active":"2023-10-08T08:42:05.159322+0000","last_peered":"2023-10-08T08:42:05.159322+0000","last_clean":"2023-10-08T08:42:05.159322+0000","last_became_active":"2023-10-08T08:42:01.138510+0000","last_became_peered":"2023-10-08T08:42:01.138510+0000","last_unstale":"2023-10-08T08:42:05.159322+0000","last_undegraded":"2023-10-08T08:42:05.159322+0000","last_fullsized":"2023-10-08T08:42:05.159322+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:16:28.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178237+0000","last_change":"2023-10-08T08:42:05.179770+0000","last_active":"2023-10-08T08:42:06.178237+0000","last_peered":"2023-10-08T08:42:06.178237+0000","last_clean":"2023-10-08T08:42:06.178237+0000","last_became_active":"2023-10-08T08:42:05.179312+0000","last_became_peered":"2023-10-08T08:42:05.179312+0000","last_unstale":"2023-10-08T08:42:06.178237+0000","last_undegraded":"2023-10-08T08:42:06.178237+0000","last_fullsized":"2023-10-08T08:42:06.178237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.947270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157757+0000","last_change":"2023-10-08T08:42:00.111299+0000","last_active":"2023-10-08T08:42:05.157757+0000","last_peered":"2023-10-08T08:42:05.157757+0000","last_clean":"2023-10-08T08:42:05.157757+0000","last_became_active":"2023-10-08T08:42:00.110966+0000","last_became_peered":"2023-10-08T08:42:00.110966+0000","last_unstale":"2023-10-08T08:42:05.157757+0000","last_undegraded":"2023-10-08T08:42:05.157757+0000","last_fullsized":"2023-10-08T08:42:05.157757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:34.211598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165423+0000","last_change":"2023-10-08T08:42:01.134205+0000","last_active":"2023-10-08T08:42:05.165423+0000","last_peered":"2023-10-08T08:42:05.165423+0000","last_clean":"2023-10-08T08:42:05.165423+0000","last_became_active":"2023-10-08T08:42:01.133887+0000","last_became_peered":"2023-10-08T08:42:01.133887+0000","last_unstale":"2023-10-08T08:42:05.165423+0000","last_undegraded":"2023-10-08T08:42:05.165423+0000","last_fullsized":"2023-10-08T08:42:05.165423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:01.807150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176511+0000","last_change":"2023-10-08T08:42:05.179119+0000","last_active":"2023-10-08T08:42:06.176511+0000","last_peered":"2023-10-08T08:42:06.176511+0000","last_clean":"2023-10-08T08:42:06.176511+0000","last_became_active":"2023-10-08T08:42:05.178712+0000","last_became_peered":"2023-10-08T08:42:05.178712+0000","last_unstale":"2023-10-08T08:42:06.176511+0000","last_undegraded":"2023-10-08T08:42:06.176511+0000","last_fullsized":"2023-10-08T08:42:06.176511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:54:38.514047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159797+0000","last_change":"2023-10-08T08:42:00.116426+0000","last_active":"2023-10-08T08:42:05.159797+0000","last_peered":"2023-10-08T08:42:05.159797+0000","last_clean":"2023-10-08T08:42:05.159797+0000","last_became_active":"2023-10-08T08:42:00.115313+0000","last_became_peered":"2023-10-08T08:42:00.115313+0000","last_unstale":"2023-10-08T08:42:05.159797+0000","last_undegraded":"2023-10-08T08:42:05.159797+0000","last_fullsized":"2023-10-08T08:42:05.159797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:42.989380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.162862+0000","last_change":"2023-10-08T08:42:01.129719+0000","last_active":"2023-10-08T08:42:05.162862+0000","last_peered":"2023-10-08T08:42:05.162862+0000","last_clean":"2023-10-08T08:42:05.162862+0000","last_became_active":"2023-10-08T08:42:01.129293+0000","last_became_peered":"2023-10-08T08:42:01.129293+0000","last_unstale":"2023-10-08T08:42:05.162862+0000","last_undegraded":"2023-10-08T08:42:05.162862+0000","last_fullsized":"2023-10-08T08:42:05.162862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:35.463614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176044+0000","last_change":"2023-10-08T08:42:05.172880+0000","last_active":"2023-10-08T08:42:06.176044+0000","last_peered":"2023-10-08T08:42:06.176044+0000","last_clean":"2023-10-08T08:42:06.176044+0000","last_became_active":"2023-10-08T08:42:05.172485+0000","last_became_peered":"2023-10-08T08:42:05.172485+0000","last_unstale":"2023-10-08T08:42:06.176044+0000","last_undegraded":"2023-10-08T08:42:06.176044+0000","last_fullsized":"2023-10-08T08:42:06.176044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:29.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159239+0000","last_change":"2023-10-08T08:42:00.115206+0000","last_active":"2023-10-08T08:42:05.159239+0000","last_peered":"2023-10-08T08:42:05.159239+0000","last_clean":"2023-10-08T08:42:05.159239+0000","last_became_active":"2023-10-08T08:42:00.114905+0000","last_became_peered":"2023-10-08T08:42:00.114905+0000","last_unstale":"2023-10-08T08:42:05.159239+0000","last_undegraded":"2023-10-08T08:42:05.159239+0000","last_fullsized":"2023-10-08T08:42:05.159239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:09.275317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165576+0000","last_change":"2023-10-08T08:42:01.141422+0000","last_active":"2023-10-08T08:42:05.165576+0000","last_peered":"2023-10-08T08:42:05.165576+0000","last_clean":"2023-10-08T08:42:05.165576+0000","last_became_active":"2023-10-08T08:42:01.140979+0000","last_became_peered":"2023-10-08T08:42:01.140979+0000","last_unstale":"2023-10-08T08:42:05.165576+0000","last_undegraded":"2023-10-08T08:42:05.165576+0000","last_fullsized":"2023-10-08T08:42:05.165576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:14.018786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177301+0000","last_change":"2023-10-08T08:42:05.184358+0000","last_active":"2023-10-08T08:42:06.177301+0000","last_peered":"2023-10-08T08:42:06.177301+0000","last_clean":"2023-10-08T08:42:06.177301+0000","last_became_active":"2023-10-08T08:42:05.183994+0000","last_became_peered":"2023-10-08T08:42:05.183994+0000","last_unstale":"2023-10-08T08:42:06.177301+0000","last_undegraded":"2023-10-08T08:42:06.177301+0000","last_fullsized":"2023-10-08T08:42:06.177301+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:46.465110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163408+0000","last_change":"2023-10-08T08:42:00.115765+0000","last_active":"2023-10-08T08:42:05.163408+0000","last_peered":"2023-10-08T08:42:05.163408+0000","last_clean":"2023-10-08T08:42:05.163408+0000","last_became_active":"2023-10-08T08:42:00.115288+0000","last_became_peered":"2023-10-08T08:42:00.115288+0000","last_unstale":"2023-10-08T08:42:05.163408+0000","last_undegraded":"2023-10-08T08:42:05.163408+0000","last_fullsized":"2023-10-08T08:42:05.163408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:20.973280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175911+0000","last_change":"2023-10-08T08:42:01.143290+0000","last_active":"2023-10-08T08:42:05.175911+0000","last_peered":"2023-10-08T08:42:05.175911+0000","last_clean":"2023-10-08T08:42:05.175911+0000","last_became_active":"2023-10-08T08:42:01.143034+0000","last_became_peered":"2023-10-08T08:42:01.143034+0000","last_unstale":"2023-10-08T08:42:05.175911+0000","last_undegraded":"2023-10-08T08:42:05.175911+0000","last_fullsized":"2023-10-08T08:42:05.175911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:45.784275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177181+0000","last_change":"2023-10-08T08:42:05.185022+0000","last_active":"2023-10-08T08:42:06.177181+0000","last_peered":"2023-10-08T08:42:06.177181+0000","last_clean":"2023-10-08T08:42:06.177181+0000","last_became_active":"2023-10-08T08:42:05.184476+0000","last_became_peered":"2023-10-08T08:42:05.184476+0000","last_unstale":"2023-10-08T08:42:06.177181+0000","last_undegraded":"2023-10-08T08:42:06.177181+0000","last_fullsized":"2023-10-08T08:42:06.177181+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:14:04.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159734+0000","last_change":"2023-10-08T08:42:00.115556+0000","last_active":"2023-10-08T08:42:05.159734+0000","last_peered":"2023-10-08T08:42:05.159734+0000","last_clean":"2023-10-08T08:42:05.159734+0000","last_became_active":"2023-10-08T08:42:00.115251+0000","last_became_peered":"2023-10-08T08:42:00.115251+0000","last_unstale":"2023-10-08T08:42:05.159734+0000","last_undegraded":"2023-10-08T08:42:05.159734+0000","last_fullsized":"2023-10-08T08:42:05.159734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:55.439502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165192+0000","last_change":"2023-10-08T08:42:01.135969+0000","last_active":"2023-10-08T08:42:05.165192+0000","last_peered":"2023-10-08T08:42:05.165192+0000","last_clean":"2023-10-08T08:42:05.165192+0000","last_became_active":"2023-10-08T08:42:01.135615+0000","last_became_peered":"2023-10-08T08:42:01.135615+0000","last_unstale":"2023-10-08T08:42:05.165192+0000","last_undegraded":"2023-10-08T08:42:05.165192+0000","last_fullsized":"2023-10-08T08:42:05.165192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:23.153920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177379+0000","last_change":"2023-10-08T08:42:05.177904+0000","last_active":"2023-10-08T08:42:06.177379+0000","last_peered":"2023-10-08T08:42:06.177379+0000","last_clean":"2023-10-08T08:42:06.177379+0000","last_became_active":"2023-10-08T08:42:05.176397+0000","last_became_peered":"2023-10-08T08:42:05.176397+0000","last_unstale":"2023-10-08T08:42:06.177379+0000","last_undegraded":"2023-10-08T08:42:06.177379+0000","last_fullsized":"2023-10-08T08:42:06.177379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:50.134974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:16.762768+0000","last_change":"2023-10-08T08:42:00.114485+0000","last_active":"2023-10-08T08:42:16.762768+0000","last_peered":"2023-10-08T08:42:16.762768+0000","last_clean":"2023-10-08T08:42:16.762768+0000","last_became_active":"2023-10-08T08:42:00.114186+0000","last_became_peered":"2023-10-08T08:42:00.114186+0000","last_unstale":"2023-10-08T08:42:16.762768+0000","last_undegraded":"2023-10-08T08:42:16.762768+0000","last_fullsized":"2023-10-08T08:42:16.762768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:30.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165965+0000","last_change":"2023-10-08T08:42:01.146627+0000","last_active":"2023-10-08T08:42:05.165965+0000","last_peered":"2023-10-08T08:42:05.165965+0000","last_clean":"2023-10-08T08:42:05.165965+0000","last_became_active":"2023-10-08T08:42:01.146332+0000","last_became_peered":"2023-10-08T08:42:01.146332+0000","last_unstale":"2023-10-08T08:42:05.165965+0000","last_undegraded":"2023-10-08T08:42:05.165965+0000","last_fullsized":"2023-10-08T08:42:05.165965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:00.825191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178059+0000","last_change":"2023-10-08T08:42:05.173257+0000","last_active":"2023-10-08T08:42:06.178059+0000","last_peered":"2023-10-08T08:42:06.178059+0000","last_clean":"2023-10-08T08:42:06.178059+0000","last_became_active":"2023-10-08T08:42:05.172891+0000","last_became_peered":"2023-10-08T08:42:05.172891+0000","last_unstale":"2023-10-08T08:42:06.178059+0000","last_undegraded":"2023-10-08T08:42:06.178059+0000","last_fullsized":"2023-10-08T08:42:06.178059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:32.802194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164206+0000","last_change":"2023-10-08T08:42:00.113330+0000","last_active":"2023-10-08T08:42:05.164206+0000","last_peered":"2023-10-08T08:42:05.164206+0000","last_clean":"2023-10-08T08:42:05.164206+0000","last_became_active":"2023-10-08T08:42:00.112183+0000","last_became_peered":"2023-10-08T08:42:00.112183+0000","last_unstale":"2023-10-08T08:42:05.164206+0000","last_undegraded":"2023-10-08T08:42:05.164206+0000","last_fullsized":"2023-10-08T08:42:05.164206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:13.158570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158566+0000","last_change":"2023-10-08T08:42:01.133854+0000","last_active":"2023-10-08T08:42:05.158566+0000","last_peered":"2023-10-08T08:42:05.158566+0000","last_clean":"2023-10-08T08:42:05.158566+0000","last_became_active":"2023-10-08T08:42:01.133540+0000","last_became_peered":"2023-10-08T08:42:01.133540+0000","last_unstale":"2023-10-08T08:42:05.158566+0000","last_undegraded":"2023-10-08T08:42:05.158566+0000","last_fullsized":"2023-10-08T08:42:05.158566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:50.011909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177380+0000","last_change":"2023-10-08T08:42:05.180359+0000","last_active":"2023-10-08T08:42:06.177380+0000","last_peered":"2023-10-08T08:42:06.177380+0000","last_clean":"2023-10-08T08:42:06.177380+0000","last_became_active":"2023-10-08T08:42:05.179877+0000","last_became_peered":"2023-10-08T08:42:05.179877+0000","last_unstale":"2023-10-08T08:42:06.177380+0000","last_undegraded":"2023-10-08T08:42:06.177380+0000","last_fullsized":"2023-10-08T08:42:06.177380+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:52.926297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159394+0000","last_change":"2023-10-08T08:42:00.112036+0000","last_active":"2023-10-08T08:42:05.159394+0000","last_peered":"2023-10-08T08:42:05.159394+0000","last_clean":"2023-10-08T08:42:05.159394+0000","last_became_active":"2023-10-08T08:42:00.111710+0000","last_became_peered":"2023-10-08T08:42:00.111710+0000","last_unstale":"2023-10-08T08:42:05.159394+0000","last_undegraded":"2023-10-08T08:42:05.159394+0000","last_fullsized":"2023-10-08T08:42:05.159394+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:58:16.004802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163515+0000","last_change":"2023-10-08T08:42:01.135245+0000","last_active":"2023-10-08T08:42:05.163515+0000","last_peered":"2023-10-08T08:42:05.163515+0000","last_clean":"2023-10-08T08:42:05.163515+0000","last_became_active":"2023-10-08T08:42:01.134941+0000","last_became_peered":"2023-10-08T08:42:01.134941+0000","last_unstale":"2023-10-08T08:42:05.163515+0000","last_undegraded":"2023-10-08T08:42:05.163515+0000","last_fullsized":"2023-10-08T08:42:05.163515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:13.745895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177909+0000","last_change":"2023-10-08T08:42:05.183155+0000","last_active":"2023-10-08T08:42:06.177909+0000","last_peered":"2023-10-08T08:42:06.177909+0000","last_clean":"2023-10-08T08:42:06.177909+0000","last_became_active":"2023-10-08T08:42:05.182722+0000","last_became_peered":"2023-10-08T08:42:05.182722+0000","last_unstale":"2023-10-08T08:42:06.177909+0000","last_undegraded":"2023-10-08T08:42:06.177909+0000","last_fullsized":"2023-10-08T08:42:06.177909+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:49.544702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163571+0000","last_change":"2023-10-08T08:42:00.112610+0000","last_active":"2023-10-08T08:42:05.163571+0000","last_peered":"2023-10-08T08:42:05.163571+0000","last_clean":"2023-10-08T08:42:05.163571+0000","last_became_active":"2023-10-08T08:42:00.112313+0000","last_became_peered":"2023-10-08T08:42:00.112313+0000","last_unstale":"2023-10-08T08:42:05.163571+0000","last_undegraded":"2023-10-08T08:42:05.163571+0000","last_fullsized":"2023-10-08T08:42:05.163571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:35.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165949+0000","last_change":"2023-10-08T08:42:01.141538+0000","last_active":"2023-10-08T08:42:05.165949+0000","last_peered":"2023-10-08T08:42:05.165949+0000","last_clean":"2023-10-08T08:42:05.165949+0000","last_became_active":"2023-10-08T08:42:01.141241+0000","last_became_peered":"2023-10-08T08:42:01.141241+0000","last_unstale":"2023-10-08T08:42:05.165949+0000","last_undegraded":"2023-10-08T08:42:05.165949+0000","last_fullsized":"2023-10-08T08:42:05.165949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:41.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160064+0000","last_change":"2023-10-08T08:42:05.181949+0000","last_active":"2023-10-08T08:42:06.160064+0000","last_peered":"2023-10-08T08:42:06.160064+0000","last_clean":"2023-10-08T08:42:06.160064+0000","last_became_active":"2023-10-08T08:42:05.181532+0000","last_became_peered":"2023-10-08T08:42:05.181532+0000","last_unstale":"2023-10-08T08:42:06.160064+0000","last_undegraded":"2023-10-08T08:42:06.160064+0000","last_fullsized":"2023-10-08T08:42:06.160064+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:44.035004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164050+0000","last_change":"2023-10-08T08:42:00.111175+0000","last_active":"2023-10-08T08:42:05.164050+0000","last_peered":"2023-10-08T08:42:05.164050+0000","last_clean":"2023-10-08T08:42:05.164050+0000","last_became_active":"2023-10-08T08:42:00.109672+0000","last_became_peered":"2023-10-08T08:42:00.109672+0000","last_unstale":"2023-10-08T08:42:05.164050+0000","last_undegraded":"2023-10-08T08:42:05.164050+0000","last_fullsized":"2023-10-08T08:42:05.164050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:42.715127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159030+0000","last_change":"2023-10-08T08:42:01.133910+0000","last_active":"2023-10-08T08:42:05.159030+0000","last_peered":"2023-10-08T08:42:05.159030+0000","last_clean":"2023-10-08T08:42:05.159030+0000","last_became_active":"2023-10-08T08:42:01.132738+0000","last_became_peered":"2023-10-08T08:42:01.132738+0000","last_unstale":"2023-10-08T08:42:05.159030+0000","last_undegraded":"2023-10-08T08:42:05.159030+0000","last_fullsized":"2023-10-08T08:42:05.159030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:19.966595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176836+0000","last_change":"2023-10-08T08:42:05.177048+0000","last_active":"2023-10-08T08:42:06.176836+0000","last_peered":"2023-10-08T08:42:06.176836+0000","last_clean":"2023-10-08T08:42:06.176836+0000","last_became_active":"2023-10-08T08:42:05.176654+0000","last_became_peered":"2023-10-08T08:42:05.176654+0000","last_unstale":"2023-10-08T08:42:06.176836+0000","last_undegraded":"2023-10-08T08:42:06.176836+0000","last_fullsized":"2023-10-08T08:42:06.176836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:22.424769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164699+0000","last_change":"2023-10-08T08:42:00.112684+0000","last_active":"2023-10-08T08:42:05.164699+0000","last_peered":"2023-10-08T08:42:05.164699+0000","last_clean":"2023-10-08T08:42:05.164699+0000","last_became_active":"2023-10-08T08:42:00.112235+0000","last_became_peered":"2023-10-08T08:42:00.112235+0000","last_unstale":"2023-10-08T08:42:05.164699+0000","last_undegraded":"2023-10-08T08:42:05.164699+0000","last_fullsized":"2023-10-08T08:42:05.164699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:47.984940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166804+0000","last_change":"2023-10-08T08:42:01.133393+0000","last_active":"2023-10-08T08:42:05.166804+0000","last_peered":"2023-10-08T08:42:05.166804+0000","last_clean":"2023-10-08T08:42:05.166804+0000","last_became_active":"2023-10-08T08:42:01.133121+0000","last_became_peered":"2023-10-08T08:42:01.133121+0000","last_unstale":"2023-10-08T08:42:05.166804+0000","last_undegraded":"2023-10-08T08:42:05.166804+0000","last_fullsized":"2023-10-08T08:42:05.166804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:54.542269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177248+0000","last_change":"2023-10-08T08:42:05.176873+0000","last_active":"2023-10-08T08:42:06.177248+0000","last_peered":"2023-10-08T08:42:06.177248+0000","last_clean":"2023-10-08T08:42:06.177248+0000","last_became_active":"2023-10-08T08:42:05.176450+0000","last_became_peered":"2023-10-08T08:42:05.176450+0000","last_unstale":"2023-10-08T08:42:06.177248+0000","last_undegraded":"2023-10-08T08:42:06.177248+0000","last_fullsized":"2023-10-08T08:42:06.177248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:43.333931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164483+0000","last_change":"2023-10-08T08:42:00.110059+0000","last_active":"2023-10-08T08:42:05.164483+0000","last_peered":"2023-10-08T08:42:05.164483+0000","last_clean":"2023-10-08T08:42:05.164483+0000","last_became_active":"2023-10-08T08:42:00.109743+0000","last_became_peered":"2023-10-08T08:42:00.109743+0000","last_unstale":"2023-10-08T08:42:05.164483+0000","last_undegraded":"2023-10-08T08:42:05.164483+0000","last_fullsized":"2023-10-08T08:42:05.164483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:03:40.950213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158971+0000","last_change":"2023-10-08T08:42:01.133595+0000","last_active":"2023-10-08T08:42:05.158971+0000","last_peered":"2023-10-08T08:42:05.158971+0000","last_clean":"2023-10-08T08:42:05.158971+0000","last_became_active":"2023-10-08T08:42:01.133268+0000","last_became_peered":"2023-10-08T08:42:01.133268+0000","last_unstale":"2023-10-08T08:42:05.158971+0000","last_undegraded":"2023-10-08T08:42:05.158971+0000","last_fullsized":"2023-10-08T08:42:05.158971+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:49.571517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.159798+0000","last_change":"2023-10-08T08:42:05.174472+0000","last_active":"2023-10-08T08:42:06.159798+0000","last_peered":"2023-10-08T08:42:06.159798+0000","last_clean":"2023-10-08T08:42:06.159798+0000","last_became_active":"2023-10-08T08:42:05.174073+0000","last_became_peered":"2023-10-08T08:42:05.174073+0000","last_unstale":"2023-10-08T08:42:06.159798+0000","last_undegraded":"2023-10-08T08:42:06.159798+0000","last_fullsized":"2023-10-08T08:42:06.159798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:36.208008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163996+0000","last_change":"2023-10-08T08:42:00.115978+0000","last_active":"2023-10-08T08:42:05.163996+0000","last_peered":"2023-10-08T08:42:05.163996+0000","last_clean":"2023-10-08T08:42:05.163996+0000","last_became_active":"2023-10-08T08:42:00.115670+0000","last_became_peered":"2023-10-08T08:42:00.115670+0000","last_unstale":"2023-10-08T08:42:05.163996+0000","last_undegraded":"2023-10-08T08:42:05.163996+0000","last_fullsized":"2023-10-08T08:42:05.163996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:11:41.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158669+0000","last_change":"2023-10-08T08:42:01.142576+0000","last_active":"2023-10-08T08:42:05.158669+0000","last_peered":"2023-10-08T08:42:05.158669+0000","last_clean":"2023-10-08T08:42:05.158669+0000","last_became_active":"2023-10-08T08:42:01.142290+0000","last_became_peered":"2023-10-08T08:42:01.142290+0000","last_unstale":"2023-10-08T08:42:05.158669+0000","last_undegraded":"2023-10-08T08:42:05.158669+0000","last_fullsized":"2023-10-08T08:42:05.158669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:30:28.050063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.159811+0000","last_change":"2023-10-08T08:42:05.177922+0000","last_active":"2023-10-08T08:42:06.159811+0000","last_peered":"2023-10-08T08:42:06.159811+0000","last_clean":"2023-10-08T08:42:06.159811+0000","last_became_active":"2023-10-08T08:42:05.177504+0000","last_became_peered":"2023-10-08T08:42:05.177504+0000","last_unstale":"2023-10-08T08:42:06.159811+0000","last_undegraded":"2023-10-08T08:42:06.159811+0000","last_fullsized":"2023-10-08T08:42:06.159811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:02.602437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159895+0000","last_change":"2023-10-08T08:42:01.139125+0000","last_active":"2023-10-08T08:42:05.159895+0000","last_peered":"2023-10-08T08:42:05.159895+0000","last_clean":"2023-10-08T08:42:05.159895+0000","last_became_active":"2023-10-08T08:42:01.138769+0000","last_became_peered":"2023-10-08T08:42:01.138769+0000","last_unstale":"2023-10-08T08:42:05.159895+0000","last_undegraded":"2023-10-08T08:42:05.159895+0000","last_fullsized":"2023-10-08T08:42:05.159895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:31:57.717833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157691+0000","last_change":"2023-10-08T08:42:00.115528+0000","last_active":"2023-10-08T08:42:05.157691+0000","last_peered":"2023-10-08T08:42:05.157691+0000","last_clean":"2023-10-08T08:42:05.157691+0000","last_became_active":"2023-10-08T08:42:00.115189+0000","last_became_peered":"2023-10-08T08:42:00.115189+0000","last_unstale":"2023-10-08T08:42:05.157691+0000","last_undegraded":"2023-10-08T08:42:05.157691+0000","last_fullsized":"2023-10-08T08:42:05.157691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.254073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176991+0000","last_change":"2023-10-08T08:42:05.179885+0000","last_active":"2023-10-08T08:42:06.176991+0000","last_peered":"2023-10-08T08:42:06.176991+0000","last_clean":"2023-10-08T08:42:06.176991+0000","last_became_active":"2023-10-08T08:42:05.179436+0000","last_became_peered":"2023-10-08T08:42:05.179436+0000","last_unstale":"2023-10-08T08:42:06.176991+0000","last_undegraded":"2023-10-08T08:42:06.176991+0000","last_fullsized":"2023-10-08T08:42:06.176991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:49.713475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164259+0000","last_change":"2023-10-08T08:42:01.131992+0000","last_active":"2023-10-08T08:42:05.164259+0000","last_peered":"2023-10-08T08:42:05.164259+0000","last_clean":"2023-10-08T08:42:05.164259+0000","last_became_active":"2023-10-08T08:42:01.131633+0000","last_became_peered":"2023-10-08T08:42:01.131633+0000","last_unstale":"2023-10-08T08:42:05.164259+0000","last_undegraded":"2023-10-08T08:42:05.164259+0000","last_fullsized":"2023-10-08T08:42:05.164259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:40.653710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:25.231531+0000","last_change":"2023-10-08T08:42:00.112987+0000","last_active":"2023-10-08T08:42:25.231531+0000","last_peered":"2023-10-08T08:42:25.231531+0000","last_clean":"2023-10-08T08:42:25.231531+0000","last_became_active":"2023-10-08T08:42:00.112276+0000","last_became_peered":"2023-10-08T08:42:00.112276+0000","last_unstale":"2023-10-08T08:42:25.231531+0000","last_undegraded":"2023-10-08T08:42:25.231531+0000","last_fullsized":"2023-10-08T08:42:25.231531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.193726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":318,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165843+0000","last_change":"2023-10-08T08:41:02.223132+0000","last_active":"2023-10-08T08:42:05.165843+0000","last_peered":"2023-10-08T08:42:05.165843+0000","last_clean":"2023-10-08T08:42:05.165843+0000","last_became_active":"2023-10-08T08:41:02.222688+0000","last_became_peered":"2023-10-08T08:41:02.222688+0000","last_unstale":"2023-10-08T08:42:05.165843+0000","last_undegraded":"2023-10-08T08:42:05.165843+0000","last_fullsized":"2023-10-08T08:42:05.165843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_clean_scrub_stamp":"2023-10-08T08:38:15.738972+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:27.673603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178163+0000","last_change":"2023-10-08T08:42:05.169025+0000","last_active":"2023-10-08T08:42:06.178163+0000","last_peered":"2023-10-08T08:42:06.178163+0000","last_clean":"2023-10-08T08:42:06.178163+0000","last_became_active":"2023-10-08T08:42:05.168100+0000","last_became_peered":"2023-10-08T08:42:05.168100+0000","last_unstale":"2023-10-08T08:42:06.178163+0000","last_undegraded":"2023-10-08T08:42:06.178163+0000","last_fullsized":"2023-10-08T08:42:06.178163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:30:40.830952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157649+0000","last_change":"2023-10-08T08:42:01.130878+0000","last_active":"2023-10-08T08:42:05.157649+0000","last_peered":"2023-10-08T08:42:05.157649+0000","last_clean":"2023-10-08T08:42:05.157649+0000","last_became_active":"2023-10-08T08:42:01.130649+0000","last_became_peered":"2023-10-08T08:42:01.130649+0000","last_unstale":"2023-10-08T08:42:05.157649+0000","last_undegraded":"2023-10-08T08:42:05.157649+0000","last_fullsized":"2023-10-08T08:42:05.157649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:15.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165991+0000","last_change":"2023-10-08T08:42:00.117747+0000","last_active":"2023-10-08T08:42:05.165991+0000","last_peered":"2023-10-08T08:42:05.165991+0000","last_clean":"2023-10-08T08:42:05.165991+0000","last_became_active":"2023-10-08T08:42:00.117437+0000","last_became_peered":"2023-10-08T08:42:00.117437+0000","last_unstale":"2023-10-08T08:42:05.165991+0000","last_undegraded":"2023-10-08T08:42:05.165991+0000","last_fullsized":"2023-10-08T08:42:05.165991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:13.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177792+0000","last_change":"2023-10-08T08:42:05.173175+0000","last_active":"2023-10-08T08:42:06.177792+0000","last_peered":"2023-10-08T08:42:06.177792+0000","last_clean":"2023-10-08T08:42:06.177792+0000","last_became_active":"2023-10-08T08:42:05.172754+0000","last_became_peered":"2023-10-08T08:42:05.172754+0000","last_unstale":"2023-10-08T08:42:06.177792+0000","last_undegraded":"2023-10-08T08:42:06.177792+0000","last_fullsized":"2023-10-08T08:42:06.177792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:48.900020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166051+0000","last_change":"2023-10-08T08:42:00.117094+0000","last_active":"2023-10-08T08:42:05.166051+0000","last_peered":"2023-10-08T08:42:05.166051+0000","last_clean":"2023-10-08T08:42:05.166051+0000","last_became_active":"2023-10-08T08:42:00.116773+0000","last_became_peered":"2023-10-08T08:42:00.116773+0000","last_unstale":"2023-10-08T08:42:05.166051+0000","last_undegraded":"2023-10-08T08:42:05.166051+0000","last_fullsized":"2023-10-08T08:42:05.166051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:28.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157964+0000","last_change":"2023-10-08T08:42:01.146290+0000","last_active":"2023-10-08T08:42:05.157964+0000","last_peered":"2023-10-08T08:42:05.157964+0000","last_clean":"2023-10-08T08:42:05.157964+0000","last_became_active":"2023-10-08T08:42:01.145585+0000","last_became_peered":"2023-10-08T08:42:01.145585+0000","last_unstale":"2023-10-08T08:42:05.157964+0000","last_undegraded":"2023-10-08T08:42:05.157964+0000","last_fullsized":"2023-10-08T08:42:05.157964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:16:15.140659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176329+0000","last_change":"2023-10-08T08:42:05.177611+0000","last_active":"2023-10-08T08:42:06.176329+0000","last_peered":"2023-10-08T08:42:06.176329+0000","last_clean":"2023-10-08T08:42:06.176329+0000","last_became_active":"2023-10-08T08:42:05.177027+0000","last_became_peered":"2023-10-08T08:42:05.177027+0000","last_unstale":"2023-10-08T08:42:06.176329+0000","last_undegraded":"2023-10-08T08:42:06.176329+0000","last_fullsized":"2023-10-08T08:42:06.176329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.846359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164254+0000","last_change":"2023-10-08T08:42:00.112453+0000","last_active":"2023-10-08T08:42:05.164254+0000","last_peered":"2023-10-08T08:42:05.164254+0000","last_clean":"2023-10-08T08:42:05.164254+0000","last_became_active":"2023-10-08T08:42:00.112159+0000","last_became_peered":"2023-10-08T08:42:00.112159+0000","last_unstale":"2023-10-08T08:42:05.164254+0000","last_undegraded":"2023-10-08T08:42:05.164254+0000","last_fullsized":"2023-10-08T08:42:05.164254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:27.713764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164358+0000","last_change":"2023-10-08T08:42:01.136743+0000","last_active":"2023-10-08T08:42:05.164358+0000","last_peered":"2023-10-08T08:42:05.164358+0000","last_clean":"2023-10-08T08:42:05.164358+0000","last_became_active":"2023-10-08T08:42:01.136442+0000","last_became_peered":"2023-10-08T08:42:01.136442+0000","last_unstale":"2023-10-08T08:42:05.164358+0000","last_undegraded":"2023-10-08T08:42:05.164358+0000","last_fullsized":"2023-10-08T08:42:05.164358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:50:41.937240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.159960+0000","last_change":"2023-10-08T08:42:05.171945+0000","last_active":"2023-10-08T08:42:06.159960+0000","last_peered":"2023-10-08T08:42:06.159960+0000","last_clean":"2023-10-08T08:42:06.159960+0000","last_became_active":"2023-10-08T08:42:05.171573+0000","last_became_peered":"2023-10-08T08:42:05.171573+0000","last_unstale":"2023-10-08T08:42:06.159960+0000","last_undegraded":"2023-10-08T08:42:06.159960+0000","last_fullsized":"2023-10-08T08:42:06.159960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:03.677144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:25.231519+0000","last_change":"2023-10-08T08:42:00.116005+0000","last_active":"2023-10-08T08:42:25.231519+0000","last_peered":"2023-10-08T08:42:25.231519+0000","last_clean":"2023-10-08T08:42:25.231519+0000","last_became_active":"2023-10-08T08:42:00.115701+0000","last_became_peered":"2023-10-08T08:42:00.115701+0000","last_unstale":"2023-10-08T08:42:25.231519+0000","last_undegraded":"2023-10-08T08:42:25.231519+0000","last_fullsized":"2023-10-08T08:42:25.231519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:46.114324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175467+0000","last_change":"2023-10-08T08:42:01.140370+0000","last_active":"2023-10-08T08:42:05.175467+0000","last_peered":"2023-10-08T08:42:05.175467+0000","last_clean":"2023-10-08T08:42:05.175467+0000","last_became_active":"2023-10-08T08:42:01.139923+0000","last_became_peered":"2023-10-08T08:42:01.139923+0000","last_unstale":"2023-10-08T08:42:05.175467+0000","last_undegraded":"2023-10-08T08:42:05.175467+0000","last_fullsized":"2023-10-08T08:42:05.175467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:07.052821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176576+0000","last_change":"2023-10-08T08:42:05.177542+0000","last_active":"2023-10-08T08:42:06.176576+0000","last_peered":"2023-10-08T08:42:06.176576+0000","last_clean":"2023-10-08T08:42:06.176576+0000","last_became_active":"2023-10-08T08:42:05.176808+0000","last_became_peered":"2023-10-08T08:42:05.176808+0000","last_unstale":"2023-10-08T08:42:06.176576+0000","last_undegraded":"2023-10-08T08:42:06.176576+0000","last_fullsized":"2023-10-08T08:42:06.176576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:44.845948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165863+0000","last_change":"2023-10-08T08:42:00.112307+0000","last_active":"2023-10-08T08:42:05.165863+0000","last_peered":"2023-10-08T08:42:05.165863+0000","last_clean":"2023-10-08T08:42:05.165863+0000","last_became_active":"2023-10-08T08:42:00.111758+0000","last_became_peered":"2023-10-08T08:42:00.111758+0000","last_unstale":"2023-10-08T08:42:05.165863+0000","last_undegraded":"2023-10-08T08:42:05.165863+0000","last_fullsized":"2023-10-08T08:42:05.165863+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:46.244899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163788+0000","last_change":"2023-10-08T08:42:01.139641+0000","last_active":"2023-10-08T08:42:05.163788+0000","last_peered":"2023-10-08T08:42:05.163788+0000","last_clean":"2023-10-08T08:42:05.163788+0000","last_became_active":"2023-10-08T08:42:01.139332+0000","last_became_peered":"2023-10-08T08:42:01.139332+0000","last_unstale":"2023-10-08T08:42:05.163788+0000","last_undegraded":"2023-10-08T08:42:05.163788+0000","last_fullsized":"2023-10-08T08:42:05.163788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:14.948944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178074+0000","last_change":"2023-10-08T08:42:05.180307+0000","last_active":"2023-10-08T08:42:06.178074+0000","last_peered":"2023-10-08T08:42:06.178074+0000","last_clean":"2023-10-08T08:42:06.178074+0000","last_became_active":"2023-10-08T08:42:05.179755+0000","last_became_peered":"2023-10-08T08:42:05.179755+0000","last_unstale":"2023-10-08T08:42:06.178074+0000","last_undegraded":"2023-10-08T08:42:06.178074+0000","last_fullsized":"2023-10-08T08:42:06.178074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:34.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166079+0000","last_change":"2023-10-08T08:42:00.112674+0000","last_active":"2023-10-08T08:42:05.166079+0000","last_peered":"2023-10-08T08:42:05.166079+0000","last_clean":"2023-10-08T08:42:05.166079+0000","last_became_active":"2023-10-08T08:42:00.110746+0000","last_became_peered":"2023-10-08T08:42:00.110746+0000","last_unstale":"2023-10-08T08:42:05.166079+0000","last_undegraded":"2023-10-08T08:42:05.166079+0000","last_fullsized":"2023-10-08T08:42:05.166079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:27.463811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167377+0000","last_change":"2023-10-08T08:42:01.150107+0000","last_active":"2023-10-08T08:42:05.167377+0000","last_peered":"2023-10-08T08:42:05.167377+0000","last_clean":"2023-10-08T08:42:05.167377+0000","last_became_active":"2023-10-08T08:42:01.149609+0000","last_became_peered":"2023-10-08T08:42:01.149609+0000","last_unstale":"2023-10-08T08:42:05.167377+0000","last_undegraded":"2023-10-08T08:42:05.167377+0000","last_fullsized":"2023-10-08T08:42:05.167377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:05.378286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178148+0000","last_change":"2023-10-08T08:42:05.177571+0000","last_active":"2023-10-08T08:42:06.178148+0000","last_peered":"2023-10-08T08:42:06.178148+0000","last_clean":"2023-10-08T08:42:06.178148+0000","last_became_active":"2023-10-08T08:42:05.177061+0000","last_became_peered":"2023-10-08T08:42:05.177061+0000","last_unstale":"2023-10-08T08:42:06.178148+0000","last_undegraded":"2023-10-08T08:42:06.178148+0000","last_fullsized":"2023-10-08T08:42:06.178148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:10.274262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163825+0000","last_change":"2023-10-08T08:42:00.112712+0000","last_active":"2023-10-08T08:42:05.163825+0000","last_peered":"2023-10-08T08:42:05.163825+0000","last_clean":"2023-10-08T08:42:05.163825+0000","last_became_active":"2023-10-08T08:42:00.112159+0000","last_became_peered":"2023-10-08T08:42:00.112159+0000","last_unstale":"2023-10-08T08:42:05.163825+0000","last_undegraded":"2023-10-08T08:42:05.163825+0000","last_fullsized":"2023-10-08T08:42:05.163825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:29.023373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164621+0000","last_change":"2023-10-08T08:42:01.142209+0000","last_active":"2023-10-08T08:42:05.164621+0000","last_peered":"2023-10-08T08:42:05.164621+0000","last_clean":"2023-10-08T08:42:05.164621+0000","last_became_active":"2023-10-08T08:42:01.141911+0000","last_became_peered":"2023-10-08T08:42:01.141911+0000","last_unstale":"2023-10-08T08:42:05.164621+0000","last_undegraded":"2023-10-08T08:42:05.164621+0000","last_fullsized":"2023-10-08T08:42:05.164621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:00.066595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176345+0000","last_change":"2023-10-08T08:42:05.173463+0000","last_active":"2023-10-08T08:42:06.176345+0000","last_peered":"2023-10-08T08:42:06.176345+0000","last_clean":"2023-10-08T08:42:06.176345+0000","last_became_active":"2023-10-08T08:42:05.173045+0000","last_became_peered":"2023-10-08T08:42:05.173045+0000","last_unstale":"2023-10-08T08:42:06.176345+0000","last_undegraded":"2023-10-08T08:42:06.176345+0000","last_fullsized":"2023-10-08T08:42:06.176345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:10.774694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164304+0000","last_change":"2023-10-08T08:42:00.111005+0000","last_active":"2023-10-08T08:42:05.164304+0000","last_peered":"2023-10-08T08:42:05.164304+0000","last_clean":"2023-10-08T08:42:05.164304+0000","last_became_active":"2023-10-08T08:42:00.110687+0000","last_became_peered":"2023-10-08T08:42:00.110687+0000","last_unstale":"2023-10-08T08:42:05.164304+0000","last_undegraded":"2023-10-08T08:42:05.164304+0000","last_fullsized":"2023-10-08T08:42:05.164304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:38.682150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163834+0000","last_change":"2023-10-08T08:42:01.144443+0000","last_active":"2023-10-08T08:42:05.163834+0000","last_peered":"2023-10-08T08:42:05.163834+0000","last_clean":"2023-10-08T08:42:05.163834+0000","last_became_active":"2023-10-08T08:42:01.143960+0000","last_became_peered":"2023-10-08T08:42:01.143960+0000","last_unstale":"2023-10-08T08:42:05.163834+0000","last_undegraded":"2023-10-08T08:42:05.163834+0000","last_fullsized":"2023-10-08T08:42:05.163834+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:46:57.209569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160340+0000","last_change":"2023-10-08T08:42:05.178212+0000","last_active":"2023-10-08T08:42:06.160340+0000","last_peered":"2023-10-08T08:42:06.160340+0000","last_clean":"2023-10-08T08:42:06.160340+0000","last_became_active":"2023-10-08T08:42:05.177751+0000","last_became_peered":"2023-10-08T08:42:05.177751+0000","last_unstale":"2023-10-08T08:42:06.160340+0000","last_undegraded":"2023-10-08T08:42:06.160340+0000","last_fullsized":"2023-10-08T08:42:06.160340+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:10.128104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166558+0000","last_change":"2023-10-08T08:42:00.115576+0000","last_active":"2023-10-08T08:42:05.166558+0000","last_peered":"2023-10-08T08:42:05.166558+0000","last_clean":"2023-10-08T08:42:05.166558+0000","last_became_active":"2023-10-08T08:42:00.115296+0000","last_became_peered":"2023-10-08T08:42:00.115296+0000","last_unstale":"2023-10-08T08:42:05.166558+0000","last_undegraded":"2023-10-08T08:42:05.166558+0000","last_fullsized":"2023-10-08T08:42:05.166558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:22.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168798+0000","last_change":"2023-10-08T08:42:01.139104+0000","last_active":"2023-10-08T08:42:05.168798+0000","last_peered":"2023-10-08T08:42:05.168798+0000","last_clean":"2023-10-08T08:42:05.168798+0000","last_became_active":"2023-10-08T08:42:01.138653+0000","last_became_peered":"2023-10-08T08:42:01.138653+0000","last_unstale":"2023-10-08T08:42:05.168798+0000","last_undegraded":"2023-10-08T08:42:05.168798+0000","last_fullsized":"2023-10-08T08:42:05.168798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:24.784017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176657+0000","last_change":"2023-10-08T08:42:05.186990+0000","last_active":"2023-10-08T08:42:06.176657+0000","last_peered":"2023-10-08T08:42:06.176657+0000","last_clean":"2023-10-08T08:42:06.176657+0000","last_became_active":"2023-10-08T08:42:05.186397+0000","last_became_peered":"2023-10-08T08:42:05.186397+0000","last_unstale":"2023-10-08T08:42:06.176657+0000","last_undegraded":"2023-10-08T08:42:06.176657+0000","last_fullsized":"2023-10-08T08:42:06.176657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:53.633137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159841+0000","last_change":"2023-10-08T08:42:00.114499+0000","last_active":"2023-10-08T08:42:05.159841+0000","last_peered":"2023-10-08T08:42:05.159841+0000","last_clean":"2023-10-08T08:42:05.159841+0000","last_became_active":"2023-10-08T08:42:00.114062+0000","last_became_peered":"2023-10-08T08:42:00.114062+0000","last_unstale":"2023-10-08T08:42:05.159841+0000","last_undegraded":"2023-10-08T08:42:05.159841+0000","last_fullsized":"2023-10-08T08:42:05.159841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:23.576889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163514+0000","last_change":"2023-10-08T08:42:01.139810+0000","last_active":"2023-10-08T08:42:05.163514+0000","last_peered":"2023-10-08T08:42:05.163514+0000","last_clean":"2023-10-08T08:42:05.163514+0000","last_became_active":"2023-10-08T08:42:01.139489+0000","last_became_peered":"2023-10-08T08:42:01.139489+0000","last_unstale":"2023-10-08T08:42:05.163514+0000","last_undegraded":"2023-10-08T08:42:05.163514+0000","last_fullsized":"2023-10-08T08:42:05.163514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:06.724645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176553+0000","last_change":"2023-10-08T08:42:05.172808+0000","last_active":"2023-10-08T08:42:06.176553+0000","last_peered":"2023-10-08T08:42:06.176553+0000","last_clean":"2023-10-08T08:42:06.176553+0000","last_became_active":"2023-10-08T08:42:05.172307+0000","last_became_peered":"2023-10-08T08:42:05.172307+0000","last_unstale":"2023-10-08T08:42:06.176553+0000","last_undegraded":"2023-10-08T08:42:06.176553+0000","last_fullsized":"2023-10-08T08:42:06.176553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.031070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158198+0000","last_change":"2023-10-08T08:42:00.112423+0000","last_active":"2023-10-08T08:42:05.158198+0000","last_peered":"2023-10-08T08:42:05.158198+0000","last_clean":"2023-10-08T08:42:05.158198+0000","last_became_active":"2023-10-08T08:42:00.112130+0000","last_became_peered":"2023-10-08T08:42:00.112130+0000","last_unstale":"2023-10-08T08:42:05.158198+0000","last_undegraded":"2023-10-08T08:42:05.158198+0000","last_fullsized":"2023-10-08T08:42:05.158198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:54.898037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164974+0000","last_change":"2023-10-08T08:42:01.148404+0000","last_active":"2023-10-08T08:42:05.164974+0000","last_peered":"2023-10-08T08:42:05.164974+0000","last_clean":"2023-10-08T08:42:05.164974+0000","last_became_active":"2023-10-08T08:42:01.148087+0000","last_became_peered":"2023-10-08T08:42:01.148087+0000","last_unstale":"2023-10-08T08:42:05.164974+0000","last_undegraded":"2023-10-08T08:42:05.164974+0000","last_fullsized":"2023-10-08T08:42:05.164974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:12.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167483+0000","last_change":"2023-10-08T08:42:01.149762+0000","last_active":"2023-10-08T08:42:05.167483+0000","last_peered":"2023-10-08T08:42:05.167483+0000","last_clean":"2023-10-08T08:42:05.167483+0000","last_became_active":"2023-10-08T08:42:01.149392+0000","last_became_peered":"2023-10-08T08:42:01.149392+0000","last_unstale":"2023-10-08T08:42:05.167483+0000","last_undegraded":"2023-10-08T08:42:05.167483+0000","last_fullsized":"2023-10-08T08:42:05.167483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:22.487634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166057+0000","last_change":"2023-10-08T08:42:01.145106+0000","last_active":"2023-10-08T08:42:05.166057+0000","last_peered":"2023-10-08T08:42:05.166057+0000","last_clean":"2023-10-08T08:42:05.166057+0000","last_became_active":"2023-10-08T08:42:01.144709+0000","last_became_peered":"2023-10-08T08:42:01.144709+0000","last_unstale":"2023-10-08T08:42:05.166057+0000","last_undegraded":"2023-10-08T08:42:05.166057+0000","last_fullsized":"2023-10-08T08:42:05.166057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:24.248415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163725+0000","last_change":"2023-10-08T08:42:01.148384+0000","last_active":"2023-10-08T08:42:05.163725+0000","last_peered":"2023-10-08T08:42:05.163725+0000","last_clean":"2023-10-08T08:42:05.163725+0000","last_became_active":"2023-10-08T08:42:01.148098+0000","last_became_peered":"2023-10-08T08:42:01.148098+0000","last_unstale":"2023-10-08T08:42:05.163725+0000","last_undegraded":"2023-10-08T08:42:05.163725+0000","last_fullsized":"2023-10-08T08:42:05.163725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:45.361279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175037+0000","last_change":"2023-10-08T08:42:01.141282+0000","last_active":"2023-10-08T08:42:05.175037+0000","last_peered":"2023-10-08T08:42:05.175037+0000","last_clean":"2023-10-08T08:42:05.175037+0000","last_became_active":"2023-10-08T08:42:01.140996+0000","last_became_peered":"2023-10-08T08:42:01.140996+0000","last_unstale":"2023-10-08T08:42:05.175037+0000","last_undegraded":"2023-10-08T08:42:05.175037+0000","last_fullsized":"2023-10-08T08:42:05.175037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:25:35.451135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158058+0000","last_change":"2023-10-08T08:42:01.146486+0000","last_active":"2023-10-08T08:42:05.158058+0000","last_peered":"2023-10-08T08:42:05.158058+0000","last_clean":"2023-10-08T08:42:05.158058+0000","last_became_active":"2023-10-08T08:42:01.146002+0000","last_became_peered":"2023-10-08T08:42:01.146002+0000","last_unstale":"2023-10-08T08:42:05.158058+0000","last_undegraded":"2023-10-08T08:42:05.158058+0000","last_fullsized":"2023-10-08T08:42:05.158058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:28.217937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168341+0000","last_change":"2023-10-08T08:42:01.152380+0000","last_active":"2023-10-08T08:42:05.168341+0000","last_peered":"2023-10-08T08:42:05.168341+0000","last_clean":"2023-10-08T08:42:05.168341+0000","last_became_active":"2023-10-08T08:42:01.149760+0000","last_became_peered":"2023-10-08T08:42:01.149760+0000","last_unstale":"2023-10-08T08:42:05.168341+0000","last_undegraded":"2023-10-08T08:42:05.168341+0000","last_fullsized":"2023-10-08T08:42:05.168341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:47:58.326416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165103+0000","last_change":"2023-10-08T08:42:01.149593+0000","last_active":"2023-10-08T08:42:05.165103+0000","last_peered":"2023-10-08T08:42:05.165103+0000","last_clean":"2023-10-08T08:42:05.165103+0000","last_became_active":"2023-10-08T08:42:01.149235+0000","last_became_peered":"2023-10-08T08:42:01.149235+0000","last_unstale":"2023-10-08T08:42:05.165103+0000","last_undegraded":"2023-10-08T08:42:05.165103+0000","last_fullsized":"2023-10-08T08:42:05.165103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:51.379305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164409+0000","last_change":"2023-10-08T08:42:01.133460+0000","last_active":"2023-10-08T08:42:05.164409+0000","last_peered":"2023-10-08T08:42:05.164409+0000","last_clean":"2023-10-08T08:42:05.164409+0000","last_became_active":"2023-10-08T08:42:01.133132+0000","last_became_peered":"2023-10-08T08:42:01.133132+0000","last_unstale":"2023-10-08T08:42:05.164409+0000","last_undegraded":"2023-10-08T08:42:05.164409+0000","last_fullsized":"2023-10-08T08:42:05.164409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:29.047135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159918+0000","last_change":"2023-10-08T08:42:01.134274+0000","last_active":"2023-10-08T08:42:05.159918+0000","last_peered":"2023-10-08T08:42:05.159918+0000","last_clean":"2023-10-08T08:42:05.159918+0000","last_became_active":"2023-10-08T08:42:01.133040+0000","last_became_peered":"2023-10-08T08:42:01.133040+0000","last_unstale":"2023-10-08T08:42:05.159918+0000","last_undegraded":"2023-10-08T08:42:05.159918+0000","last_fullsized":"2023-10-08T08:42:05.159918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:18.054859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166177+0000","last_change":"2023-10-08T08:42:01.128333+0000","last_active":"2023-10-08T08:42:05.166177+0000","last_peered":"2023-10-08T08:42:05.166177+0000","last_clean":"2023-10-08T08:42:05.166177+0000","last_became_active":"2023-10-08T08:42:01.128076+0000","last_became_peered":"2023-10-08T08:42:01.128076+0000","last_unstale":"2023-10-08T08:42:05.166177+0000","last_undegraded":"2023-10-08T08:42:05.166177+0000","last_fullsized":"2023-10-08T08:42:05.166177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.675185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165166+0000","last_change":"2023-10-08T08:42:01.139518+0000","last_active":"2023-10-08T08:42:05.165166+0000","last_peered":"2023-10-08T08:42:05.165166+0000","last_clean":"2023-10-08T08:42:05.165166+0000","last_became_active":"2023-10-08T08:42:01.139217+0000","last_became_peered":"2023-10-08T08:42:01.139217+0000","last_unstale":"2023-10-08T08:42:05.165166+0000","last_undegraded":"2023-10-08T08:42:05.165166+0000","last_fullsized":"2023-10-08T08:42:05.165166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:05:02.485500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157964+0000","last_change":"2023-10-08T08:42:01.142664+0000","last_active":"2023-10-08T08:42:05.157964+0000","last_peered":"2023-10-08T08:42:05.157964+0000","last_clean":"2023-10-08T08:42:05.157964+0000","last_became_active":"2023-10-08T08:42:01.142136+0000","last_became_peered":"2023-10-08T08:42:01.142136+0000","last_unstale":"2023-10-08T08:42:05.157964+0000","last_undegraded":"2023-10-08T08:42:05.157964+0000","last_fullsized":"2023-10-08T08:42:05.157964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:18.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167363+0000","last_change":"2023-10-08T08:42:01.147551+0000","last_active":"2023-10-08T08:42:05.167363+0000","last_peered":"2023-10-08T08:42:05.167363+0000","last_clean":"2023-10-08T08:42:05.167363+0000","last_became_active":"2023-10-08T08:42:01.147187+0000","last_became_peered":"2023-10-08T08:42:01.147187+0000","last_unstale":"2023-10-08T08:42:05.167363+0000","last_undegraded":"2023-10-08T08:42:05.167363+0000","last_fullsized":"2023-10-08T08:42:05.167363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:42:25.900357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":15308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481808,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":473103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.496}]},{"osd":1,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.59999999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.436},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.745},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.53200000000000003}]},{"osd":5,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.621},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79000000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.83199999999999996}]},{"osd":10,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.77700000000000002}]}]},{"osd":10,"up_from":70,"seq":300647710739,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1572864,"data_stored":1067507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.436},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.505},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71899999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.41299999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.50700000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.63300000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.73599999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":9,"up_from":65,"seq":279172874264,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":473685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48299999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51400000000000001}]},{"osd":2,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.66300000000000003}]},{"osd":3,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.628}]},{"osd":5,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68200000000000005}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39100000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.75},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.83799999999999997}]},{"osd":10,"last update":"Sun Oct 8 08:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":8,"up_from":58,"seq":249108103196,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":473707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68999999999999995}]},{"osd":1,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.92600000000000005}]},{"osd":2,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.622},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65200000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.878},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.755}]},{"osd":4,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77200000000000002}]},{"osd":6,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.073}]},{"osd":7,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.026}]},{"osd":9,"last update":"Sun Oct 8 08:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.147}]},{"osd":10,"last update":"Sun Oct 8 08:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.052},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":1.036}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]}]},{"osd":7,"up_from":51,"seq":219043332128,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1552384,"data_stored":1064053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63300000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.434,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73399999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55200000000000005}]},{"osd":3,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.754},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.53300000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.79600000000000004}]},{"osd":6,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64000000000000001,"15min":0.628},"min":{"1min":0.52600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82999999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71599999999999997,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94499999999999995,"5min":1.234,"15min":1.234},"last":0.90600000000000003}]},{"osd":9,"last update":"Sun Oct 8 08:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.879},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.86799999999999999}]},{"osd":10,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.84299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495651,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":954368,"data_stored":473103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.27200000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57099999999999995,"5min":0.62,"15min":0.62},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.26100000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.57599999999999996}]},{"osd":2,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.67200000000000004}]},{"osd":3,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.435,"15min":0.42499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.314,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.66100000000000003,"15min":0.624},"min":{"1min":0.45200000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.7670000000000003,"5min":4.7670000000000003,"15min":4.7670000000000003},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Oct 8 08:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.51700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.91900000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66700000000000004,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94699999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.70699999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93999999999999995,"5min":1.087,"15min":1.087},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54200000000000004}]},{"osd":9,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.747}]},{"osd":10,"last update":"Sun Oct 8 08:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.83499999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":476945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.49299999999999999,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.85599999999999998,"5min":1.242,"15min":1.242},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.44},"min":{"1min":0.40100000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.89700000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.42599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.52900000000000003,"15min":0.502},"min":{"1min":0.42399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.496}]},{"osd":3,"last update":"Sun Oct 8 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.873,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84999999999999998,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.67800000000000005}]},{"osd":4,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.41899999999999998},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39800000000000002}]},{"osd":5,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.44700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.63,"15min":0.61499999999999999},"min":{"1min":0.53200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81000000000000005,"5min":1.788,"15min":1.788},"last":0.51700000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.66300000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.629},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.70899999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.75}]},{"osd":10,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":474581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 08:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.51500000000000001},"min":{"1min":0.40400000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55900000000000005,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.92500000000000004}]},{"osd":2,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80800000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.79000000000000004}]},{"osd":3,"last update":"Sun Oct 8 08:40:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.38700000000000001},"min":{"1min":0.27200000000000002,"5min":0.251,"15min":0.251},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.41799999999999998},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.69399999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.626},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.28299999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76300000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.58499999999999996}]},{"osd":7,"last update":"Sun Oct 8 08:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.91000000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.53900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.85499999999999998}]},{"osd":9,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.872}]},{"osd":10,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.96299999999999997}]},{"osd":11,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.94199999999999995}]}]},{"osd":2,"up_from":19,"seq":81604378677,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":476979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.32800000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.86399999999999999}]},{"osd":3,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38500000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.79200000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.53200000000000003,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.51300000000000001},"min":{"1min":0.38300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.77100000000000002}]},{"osd":5,"last update":"Sun Oct 8 08:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.45200000000000001},"min":{"1min":0.34699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.52700000000000002,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.90300000000000002}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.83199999999999996}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.91500000000000004}]},{"osd":8,"last update":"Sun Oct 8 08:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98499999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.95899999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.02},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.94699999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":1.004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.042}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149744,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":472876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.35999999999999999,"15min":0.34599999999999997},"min":{"1min":0.33300000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.38100000000000001,"15min":0.35699999999999998},"min":{"1min":0.28799999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53500000000000003,"15min":0.51200000000000001},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.996,"15min":0.996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.55600000000000005,"15min":0.51200000000000001},"min":{"1min":0.50800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.55700000000000005,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.624,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.61299999999999999,"15min":0.58299999999999996},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":0.66200000000000003}]},{"osd":5,"last update":"Sun Oct 8 08:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57599999999999996,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.49199999999999999,"15min":0.47499999999999998},"min":{"1min":0.40799999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.75}]},{"osd":7,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.65100000000000002},"min":{"1min":0.496,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51400000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.76800000000000002}]},{"osd":8,"last update":"Sun Oct 8 08:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]},{"osd":9,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.877}]},{"osd":10,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.84299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920813,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":473125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67700000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77000000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.36499999999999999},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.66900000000000004}]},{"osd":3,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.53700000000000003,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.373,"5min":0.315,"15min":0.315},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.45000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.85799999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Sun Oct 8 08:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.46300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70199999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.76000000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.84099999999999997}]},{"osd":10,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757288,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1560576,"data_stored":1063653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.50800000000000001,"15min":0.48599999999999999},"min":{"1min":0.437,"5min":0.313,"15min":0.313},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.78400000000000003}]},{"osd":1,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.871,"15min":0.871},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.74199999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.38500000000000001},"min":{"1min":0.32100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.40300000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52800000000000002,"15min":0.502},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.63200000000000001}]},{"osd":4,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.95399999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96999999999999997,"5min":1.006,"15min":1.006},"last":0.85399999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:41:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.41399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90100000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.83299999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.39000000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.95499999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:41:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.94599999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.873}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T08:42:28.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T08:42:28.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 -- 172.21.15.70:0/4235612114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440ff8f0 msgr2=0x7f104410d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 --2- 172.21.15.70:0/4235612114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440ff8f0 0x7f104410d4f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f103c00b0a0 tx=0x7f103c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 -- 172.21.15.70:0/4235612114 shutdown_connections 2023-10-08T08:42:28.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 --2- 172.21.15.70:0/4235612114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440ff8f0 0x7f104410d4f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 --2- 172.21.15.70:0/4235612114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1044106870 0x7f1044106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 --2- 172.21.15.70:0/4235612114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10440fef30 0x7f10440ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 -- 172.21.15.70:0/4235612114 >> 172.21.15.70:0/4235612114 conn(0x7f1044074820 msgr2=0x7f1044074c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:28.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 -- 172.21.15.70:0/4235612114 shutdown_connections 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 -- 172.21.15.70:0/4235612114 wait complete. 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.492+0000 7f10499b0700 1 Processor -- start 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10499b0700 1 -- start start 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10499b0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440fef30 0x7f1044100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10499b0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10440ff8f0 0x7f1044100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10499b0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1044106870 0x7f1044100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10499b0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10441a4f80 con 0x7f10440fef30 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10499b0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10441a50f0 con 0x7f10440ff8f0 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10499b0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10441a52b0 con 0x7f1044106870 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f1042ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440fef30 0x7f1044100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f1042ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440fef30 0x7f1044100110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49512/0 (socket says 172.21.15.70:49512) 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f1042ffd700 1 -- 172.21.15.70:0/1772403815 learned_addr learned my addr 172.21.15.70:0/1772403815 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10437fe700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1044106870 0x7f1044100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10427fc700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10440ff8f0 0x7f1044100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f1042ffd700 1 -- 172.21.15.70:0/1772403815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1044106870 msgr2=0x7f1044100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f1042ffd700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1044106870 0x7f1044100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f1042ffd700 1 -- 172.21.15.70:0/1772403815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10440ff8f0 msgr2=0x7f1044100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f1042ffd700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10440ff8f0 0x7f1044100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f1042ffd700 1 -- 172.21.15.70:0/1772403815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c009d00 con 0x7f10440fef30 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10437fe700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1044106870 0x7f1044100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10427fc700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10440ff8f0 0x7f1044100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:28.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f1042ffd700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440fef30 0x7f1044100110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f103800c970 tx=0x7f103800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:28.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10489ae700 1 -- 172.21.15.70:0/1772403815 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038007aa0 con 0x7f10440fef30 2023-10-08T08:42:28.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10489ae700 1 -- 172.21.15.70:0/1772403815 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1038004cf0 con 0x7f10440fef30 2023-10-08T08:42:28.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10441a5590 con 0x7f10440fef30 2023-10-08T08:42:28.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.493+0000 7f10489ae700 1 -- 172.21.15.70:0/1772403815 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038005600 con 0x7f10440fef30 2023-10-08T08:42:28.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.494+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10441a5a50 con 0x7f10440fef30 2023-10-08T08:42:28.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.494+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1044108bb0 con 0x7f10440fef30 2023-10-08T08:42:28.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.496+0000 7f10489ae700 1 -- 172.21.15.70:0/1772403815 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f1038004750 con 0x7f10440fef30 2023-10-08T08:42:28.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.496+0000 7f10489ae700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f102c0a14d0 0x7f102c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:28.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.496+0000 7f10427fc700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f102c0a14d0 0x7f102c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:28.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.497+0000 7f10489ae700 1 -- 172.21.15.70:0/1772403815 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f1038013070 con 0x7f10440fef30 2023-10-08T08:42:28.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.497+0000 7f10427fc700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f102c0a14d0 0x7f102c0a3990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1034005fd0 tx=0x7f1034005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:28.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.500+0000 7f10489ae700 1 -- 172.21.15.70:0/1772403815 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1038096870 con 0x7f10440fef30 2023-10-08T08:42:28.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:28 smithi105 ceph-mon[103798]: pgmap v248: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 0 op/s 2023-10-08T08:42:28.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:28 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1156708440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T08:42:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:28 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] up:active 2023-10-08T08:42:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:28 smithi105 ceph-mon[103798]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T08:42:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:28 smithi105 ceph-mon[103798]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2023-10-08T08:42:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:28 smithi105 ceph-mon[103798]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2023-10-08T08:42:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:28 smithi105 ceph-mon[103798]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-10-08T08:42:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:28 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1626460599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:42:28.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:28 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3892819326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:28 smithi191 ceph-mon[104220]: pgmap v248: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 0 op/s 2023-10-08T08:42:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:28 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1156708440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T08:42:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:28 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] up:active 2023-10-08T08:42:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:28 smithi191 ceph-mon[104220]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T08:42:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:28 smithi191 ceph-mon[104220]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2023-10-08T08:42:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:28 smithi191 ceph-mon[104220]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2023-10-08T08:42:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:28 smithi191 ceph-mon[104220]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-10-08T08:42:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:28 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1626460599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:42:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:28 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3892819326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:28.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.688+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10441015f0 con 0x7f102c0a14d0 2023-10-08T08:42:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.700+0000 7f10489ae700 1 -- 172.21.15.70:0/1772403815 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422015 (secure 0 0 0) 0x7f10441015f0 con 0x7f102c0a14d0 2023-10-08T08:42:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f102c0a14d0 msgr2=0x7f102c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f102c0a14d0 0x7f102c0a3990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1034005fd0 tx=0x7f1034005ee0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440fef30 msgr2=0x7f1044100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440fef30 0x7f1044100110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f103800c970 tx=0x7f103800cd30 comp rx=0 tx=0).stop 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 shutdown_connections 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f102c0a14d0 0x7f102c0a3990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1044106870 0x7f1044100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10440fef30 0x7f1044100110 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 --2- 172.21.15.70:0/1772403815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10440ff8f0 0x7f1044100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 >> 172.21.15.70:0/1772403815 conn(0x7f1044074820 msgr2=0x7f10440fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 shutdown_connections 2023-10-08T08:42:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:28.704+0000 7f10499b0700 1 -- 172.21.15.70:0/1772403815 wait complete. 2023-10-08T08:42:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-10-08T08:42:28.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:28 smithi070 ceph-mon[99513]: pgmap v248: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 0 op/s 2023-10-08T08:42:28.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:28 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1156708440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T08:42:28.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:28 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] up:active 2023-10-08T08:42:28.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:28 smithi070 ceph-mon[99513]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T08:42:28.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:28 smithi070 ceph-mon[99513]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2023-10-08T08:42:28.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:28 smithi070 ceph-mon[99513]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2023-10-08T08:42:28.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:28 smithi070 ceph-mon[99513]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-10-08T08:42:28.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:28 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1626460599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:42:28.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:28 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3892819326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:28.720 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2023-10-08T08:42:27.053712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":236,"num_write_kb":2963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337304,"kb_used_data":13040,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604520,"statfs":{"total":1151940427776,"available":1151595028480,"internally_reserved":0,"allocated":13352960,"data_stored":7463317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003295"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168218+0000","last_change":"2023-10-08T08:42:01.146976+0000","last_active":"2023-10-08T08:42:05.168218+0000","last_peered":"2023-10-08T08:42:05.168218+0000","last_clean":"2023-10-08T08:42:05.168218+0000","last_became_active":"2023-10-08T08:42:01.146184+0000","last_became_peered":"2023-10-08T08:42:01.146184+0000","last_unstale":"2023-10-08T08:42:05.168218+0000","last_undegraded":"2023-10-08T08:42:05.168218+0000","last_fullsized":"2023-10-08T08:42:05.168218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:35.571911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175377+0000","last_change":"2023-10-08T08:42:01.142007+0000","last_active":"2023-10-08T08:42:05.175377+0000","last_peered":"2023-10-08T08:42:05.175377+0000","last_clean":"2023-10-08T08:42:05.175377+0000","last_became_active":"2023-10-08T08:42:01.141630+0000","last_became_peered":"2023-10-08T08:42:01.141630+0000","last_unstale":"2023-10-08T08:42:05.175377+0000","last_undegraded":"2023-10-08T08:42:05.175377+0000","last_fullsized":"2023-10-08T08:42:05.175377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:53.307828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175005+0000","last_change":"2023-10-08T08:42:01.154742+0000","last_active":"2023-10-08T08:42:05.175005+0000","last_peered":"2023-10-08T08:42:05.175005+0000","last_clean":"2023-10-08T08:42:05.175005+0000","last_became_active":"2023-10-08T08:42:01.154439+0000","last_became_peered":"2023-10-08T08:42:01.154439+0000","last_unstale":"2023-10-08T08:42:05.175005+0000","last_undegraded":"2023-10-08T08:42:05.175005+0000","last_fullsized":"2023-10-08T08:42:05.175005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:23.990594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165397+0000","last_change":"2023-10-08T08:42:01.149940+0000","last_active":"2023-10-08T08:42:05.165397+0000","last_peered":"2023-10-08T08:42:05.165397+0000","last_clean":"2023-10-08T08:42:05.165397+0000","last_became_active":"2023-10-08T08:42:01.149628+0000","last_became_peered":"2023-10-08T08:42:01.149628+0000","last_unstale":"2023-10-08T08:42:05.165397+0000","last_undegraded":"2023-10-08T08:42:05.165397+0000","last_fullsized":"2023-10-08T08:42:05.165397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:38.961102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164177+0000","last_change":"2023-10-08T08:42:01.145396+0000","last_active":"2023-10-08T08:42:05.164177+0000","last_peered":"2023-10-08T08:42:05.164177+0000","last_clean":"2023-10-08T08:42:05.164177+0000","last_became_active":"2023-10-08T08:42:01.140511+0000","last_became_peered":"2023-10-08T08:42:01.140511+0000","last_unstale":"2023-10-08T08:42:05.164177+0000","last_undegraded":"2023-10-08T08:42:05.164177+0000","last_fullsized":"2023-10-08T08:42:05.164177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:38.079768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158381+0000","last_change":"2023-10-08T08:42:01.128798+0000","last_active":"2023-10-08T08:42:05.158381+0000","last_peered":"2023-10-08T08:42:05.158381+0000","last_clean":"2023-10-08T08:42:05.158381+0000","last_became_active":"2023-10-08T08:42:01.128485+0000","last_became_peered":"2023-10-08T08:42:01.128485+0000","last_unstale":"2023-10-08T08:42:05.158381+0000","last_undegraded":"2023-10-08T08:42:05.158381+0000","last_fullsized":"2023-10-08T08:42:05.158381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:33:59.121551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163085+0000","last_change":"2023-10-08T08:42:01.136315+0000","last_active":"2023-10-08T08:42:05.163085+0000","last_peered":"2023-10-08T08:42:05.163085+0000","last_clean":"2023-10-08T08:42:05.163085+0000","last_became_active":"2023-10-08T08:42:01.136025+0000","last_became_peered":"2023-10-08T08:42:01.136025+0000","last_unstale":"2023-10-08T08:42:05.163085+0000","last_undegraded":"2023-10-08T08:42:05.163085+0000","last_fullsized":"2023-10-08T08:42:05.163085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:35.675920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165509+0000","last_change":"2023-10-08T08:42:01.129839+0000","last_active":"2023-10-08T08:42:05.165509+0000","last_peered":"2023-10-08T08:42:05.165509+0000","last_clean":"2023-10-08T08:42:05.165509+0000","last_became_active":"2023-10-08T08:42:01.129524+0000","last_became_peered":"2023-10-08T08:42:01.129524+0000","last_unstale":"2023-10-08T08:42:05.165509+0000","last_undegraded":"2023-10-08T08:42:05.165509+0000","last_fullsized":"2023-10-08T08:42:05.165509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:44.463024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166174+0000","last_change":"2023-10-08T08:42:01.135304+0000","last_active":"2023-10-08T08:42:05.166174+0000","last_peered":"2023-10-08T08:42:05.166174+0000","last_clean":"2023-10-08T08:42:05.166174+0000","last_became_active":"2023-10-08T08:42:01.134978+0000","last_became_peered":"2023-10-08T08:42:01.134978+0000","last_unstale":"2023-10-08T08:42:05.166174+0000","last_undegraded":"2023-10-08T08:42:05.166174+0000","last_fullsized":"2023-10-08T08:42:05.166174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:46:03.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158899+0000","last_change":"2023-10-08T08:42:01.134686+0000","last_active":"2023-10-08T08:42:05.158899+0000","last_peered":"2023-10-08T08:42:05.158899+0000","last_clean":"2023-10-08T08:42:05.158899+0000","last_became_active":"2023-10-08T08:42:01.134360+0000","last_became_peered":"2023-10-08T08:42:01.134360+0000","last_unstale":"2023-10-08T08:42:05.158899+0000","last_undegraded":"2023-10-08T08:42:05.158899+0000","last_fullsized":"2023-10-08T08:42:05.158899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:56.814182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168687+0000","last_change":"2023-10-08T08:42:01.148309+0000","last_active":"2023-10-08T08:42:05.168687+0000","last_peered":"2023-10-08T08:42:05.168687+0000","last_clean":"2023-10-08T08:42:05.168687+0000","last_became_active":"2023-10-08T08:42:01.147964+0000","last_became_peered":"2023-10-08T08:42:01.147964+0000","last_unstale":"2023-10-08T08:42:05.168687+0000","last_undegraded":"2023-10-08T08:42:05.168687+0000","last_fullsized":"2023-10-08T08:42:05.168687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:45.418572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165285+0000","last_change":"2023-10-08T08:42:01.148141+0000","last_active":"2023-10-08T08:42:05.165285+0000","last_peered":"2023-10-08T08:42:05.165285+0000","last_clean":"2023-10-08T08:42:05.165285+0000","last_became_active":"2023-10-08T08:42:01.147788+0000","last_became_peered":"2023-10-08T08:42:01.147788+0000","last_unstale":"2023-10-08T08:42:05.165285+0000","last_undegraded":"2023-10-08T08:42:05.165285+0000","last_fullsized":"2023-10-08T08:42:05.165285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:37.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157906+0000","last_change":"2023-10-08T08:42:01.141737+0000","last_active":"2023-10-08T08:42:05.157906+0000","last_peered":"2023-10-08T08:42:05.157906+0000","last_clean":"2023-10-08T08:42:05.157906+0000","last_became_active":"2023-10-08T08:42:01.141353+0000","last_became_peered":"2023-10-08T08:42:01.141353+0000","last_unstale":"2023-10-08T08:42:05.157906+0000","last_undegraded":"2023-10-08T08:42:05.157906+0000","last_fullsized":"2023-10-08T08:42:05.157906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:58:11.592880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.174082+0000","last_change":"2023-10-08T08:42:01.148031+0000","last_active":"2023-10-08T08:42:05.174082+0000","last_peered":"2023-10-08T08:42:05.174082+0000","last_clean":"2023-10-08T08:42:05.174082+0000","last_became_active":"2023-10-08T08:42:01.147785+0000","last_became_peered":"2023-10-08T08:42:01.147785+0000","last_unstale":"2023-10-08T08:42:05.174082+0000","last_undegraded":"2023-10-08T08:42:05.174082+0000","last_fullsized":"2023-10-08T08:42:05.174082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:43.702638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.172866+0000","last_change":"2023-10-08T08:42:01.154669+0000","last_active":"2023-10-08T08:42:05.172866+0000","last_peered":"2023-10-08T08:42:05.172866+0000","last_clean":"2023-10-08T08:42:05.172866+0000","last_became_active":"2023-10-08T08:42:01.154385+0000","last_became_peered":"2023-10-08T08:42:01.154385+0000","last_unstale":"2023-10-08T08:42:05.172866+0000","last_undegraded":"2023-10-08T08:42:05.172866+0000","last_fullsized":"2023-10-08T08:42:05.172866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:41.654979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165771+0000","last_change":"2023-10-08T08:42:01.143017+0000","last_active":"2023-10-08T08:42:05.165771+0000","last_peered":"2023-10-08T08:42:05.165771+0000","last_clean":"2023-10-08T08:42:05.165771+0000","last_became_active":"2023-10-08T08:42:01.142728+0000","last_became_peered":"2023-10-08T08:42:01.142728+0000","last_unstale":"2023-10-08T08:42:05.165771+0000","last_undegraded":"2023-10-08T08:42:05.165771+0000","last_fullsized":"2023-10-08T08:42:05.165771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.303212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168118+0000","last_change":"2023-10-08T08:42:01.147335+0000","last_active":"2023-10-08T08:42:05.168118+0000","last_peered":"2023-10-08T08:42:05.168118+0000","last_clean":"2023-10-08T08:42:05.168118+0000","last_became_active":"2023-10-08T08:42:01.146641+0000","last_became_peered":"2023-10-08T08:42:01.146641+0000","last_unstale":"2023-10-08T08:42:05.168118+0000","last_undegraded":"2023-10-08T08:42:05.168118+0000","last_fullsized":"2023-10-08T08:42:05.168118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:27.274207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164340+0000","last_change":"2023-10-08T08:42:01.132417+0000","last_active":"2023-10-08T08:42:05.164340+0000","last_peered":"2023-10-08T08:42:05.164340+0000","last_clean":"2023-10-08T08:42:05.164340+0000","last_became_active":"2023-10-08T08:42:01.132135+0000","last_became_peered":"2023-10-08T08:42:01.132135+0000","last_unstale":"2023-10-08T08:42:05.164340+0000","last_undegraded":"2023-10-08T08:42:05.164340+0000","last_fullsized":"2023-10-08T08:42:05.164340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:11.916677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167774+0000","last_change":"2023-10-08T08:42:01.136100+0000","last_active":"2023-10-08T08:42:05.167774+0000","last_peered":"2023-10-08T08:42:05.167774+0000","last_clean":"2023-10-08T08:42:05.167774+0000","last_became_active":"2023-10-08T08:42:01.135826+0000","last_became_peered":"2023-10-08T08:42:01.135826+0000","last_unstale":"2023-10-08T08:42:05.167774+0000","last_undegraded":"2023-10-08T08:42:05.167774+0000","last_fullsized":"2023-10-08T08:42:05.167774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:03.734296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160117+0000","last_change":"2023-10-08T08:42:05.177765+0000","last_active":"2023-10-08T08:42:06.160117+0000","last_peered":"2023-10-08T08:42:06.160117+0000","last_clean":"2023-10-08T08:42:06.160117+0000","last_became_active":"2023-10-08T08:42:05.177362+0000","last_became_peered":"2023-10-08T08:42:05.177362+0000","last_unstale":"2023-10-08T08:42:06.160117+0000","last_undegraded":"2023-10-08T08:42:06.160117+0000","last_fullsized":"2023-10-08T08:42:06.160117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:21.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163710+0000","last_change":"2023-10-08T08:42:00.111581+0000","last_active":"2023-10-08T08:42:05.163710+0000","last_peered":"2023-10-08T08:42:05.163710+0000","last_clean":"2023-10-08T08:42:05.163710+0000","last_became_active":"2023-10-08T08:42:00.111298+0000","last_became_peered":"2023-10-08T08:42:00.111298+0000","last_unstale":"2023-10-08T08:42:05.163710+0000","last_undegraded":"2023-10-08T08:42:05.163710+0000","last_fullsized":"2023-10-08T08:42:05.163710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:52:39.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167284+0000","last_change":"2023-10-08T08:42:01.134630+0000","last_active":"2023-10-08T08:42:05.167284+0000","last_peered":"2023-10-08T08:42:05.167284+0000","last_clean":"2023-10-08T08:42:05.167284+0000","last_became_active":"2023-10-08T08:42:01.134347+0000","last_became_peered":"2023-10-08T08:42:01.134347+0000","last_unstale":"2023-10-08T08:42:05.167284+0000","last_undegraded":"2023-10-08T08:42:05.167284+0000","last_fullsized":"2023-10-08T08:42:05.167284+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:51:14.364756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176587+0000","last_change":"2023-10-08T08:42:05.177223+0000","last_active":"2023-10-08T08:42:06.176587+0000","last_peered":"2023-10-08T08:42:06.176587+0000","last_clean":"2023-10-08T08:42:06.176587+0000","last_became_active":"2023-10-08T08:42:05.176811+0000","last_became_peered":"2023-10-08T08:42:05.176811+0000","last_unstale":"2023-10-08T08:42:06.176587+0000","last_undegraded":"2023-10-08T08:42:06.176587+0000","last_fullsized":"2023-10-08T08:42:06.176587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:41.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167381+0000","last_change":"2023-10-08T08:42:00.115860+0000","last_active":"2023-10-08T08:42:05.167381+0000","last_peered":"2023-10-08T08:42:05.167381+0000","last_clean":"2023-10-08T08:42:05.167381+0000","last_became_active":"2023-10-08T08:42:00.115601+0000","last_became_peered":"2023-10-08T08:42:00.115601+0000","last_unstale":"2023-10-08T08:42:05.167381+0000","last_undegraded":"2023-10-08T08:42:05.167381+0000","last_fullsized":"2023-10-08T08:42:05.167381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:20.071545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175806+0000","last_change":"2023-10-08T08:42:01.146648+0000","last_active":"2023-10-08T08:42:05.175806+0000","last_peered":"2023-10-08T08:42:05.175806+0000","last_clean":"2023-10-08T08:42:05.175806+0000","last_became_active":"2023-10-08T08:42:01.145978+0000","last_became_peered":"2023-10-08T08:42:01.145978+0000","last_unstale":"2023-10-08T08:42:05.175806+0000","last_undegraded":"2023-10-08T08:42:05.175806+0000","last_fullsized":"2023-10-08T08:42:05.175806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:55.768519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176895+0000","last_change":"2023-10-08T08:42:05.185079+0000","last_active":"2023-10-08T08:42:06.176895+0000","last_peered":"2023-10-08T08:42:06.176895+0000","last_clean":"2023-10-08T08:42:06.176895+0000","last_became_active":"2023-10-08T08:42:05.184521+0000","last_became_peered":"2023-10-08T08:42:05.184521+0000","last_unstale":"2023-10-08T08:42:06.176895+0000","last_undegraded":"2023-10-08T08:42:06.176895+0000","last_fullsized":"2023-10-08T08:42:06.176895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:39:17.457051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166205+0000","last_change":"2023-10-08T08:42:00.112111+0000","last_active":"2023-10-08T08:42:05.166205+0000","last_peered":"2023-10-08T08:42:05.166205+0000","last_clean":"2023-10-08T08:42:05.166205+0000","last_became_active":"2023-10-08T08:42:00.111808+0000","last_became_peered":"2023-10-08T08:42:00.111808+0000","last_unstale":"2023-10-08T08:42:05.166205+0000","last_undegraded":"2023-10-08T08:42:05.166205+0000","last_fullsized":"2023-10-08T08:42:05.166205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:03.022378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165079+0000","last_change":"2023-10-08T08:42:01.133308+0000","last_active":"2023-10-08T08:42:05.165079+0000","last_peered":"2023-10-08T08:42:05.165079+0000","last_clean":"2023-10-08T08:42:05.165079+0000","last_became_active":"2023-10-08T08:42:01.131649+0000","last_became_peered":"2023-10-08T08:42:01.131649+0000","last_unstale":"2023-10-08T08:42:05.165079+0000","last_undegraded":"2023-10-08T08:42:05.165079+0000","last_fullsized":"2023-10-08T08:42:05.165079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:05.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176411+0000","last_change":"2023-10-08T08:42:05.182409+0000","last_active":"2023-10-08T08:42:06.176411+0000","last_peered":"2023-10-08T08:42:06.176411+0000","last_clean":"2023-10-08T08:42:06.176411+0000","last_became_active":"2023-10-08T08:42:05.181974+0000","last_became_peered":"2023-10-08T08:42:05.181974+0000","last_unstale":"2023-10-08T08:42:06.176411+0000","last_undegraded":"2023-10-08T08:42:06.176411+0000","last_fullsized":"2023-10-08T08:42:06.176411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:05.821339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164990+0000","last_change":"2023-10-08T08:42:00.113287+0000","last_active":"2023-10-08T08:42:05.164990+0000","last_peered":"2023-10-08T08:42:05.164990+0000","last_clean":"2023-10-08T08:42:05.164990+0000","last_became_active":"2023-10-08T08:42:00.112996+0000","last_became_peered":"2023-10-08T08:42:00.112996+0000","last_unstale":"2023-10-08T08:42:05.164990+0000","last_undegraded":"2023-10-08T08:42:05.164990+0000","last_fullsized":"2023-10-08T08:42:05.164990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:42.559360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159558+0000","last_change":"2023-10-08T08:42:01.139763+0000","last_active":"2023-10-08T08:42:05.159558+0000","last_peered":"2023-10-08T08:42:05.159558+0000","last_clean":"2023-10-08T08:42:05.159558+0000","last_became_active":"2023-10-08T08:42:01.139451+0000","last_became_peered":"2023-10-08T08:42:01.139451+0000","last_unstale":"2023-10-08T08:42:05.159558+0000","last_undegraded":"2023-10-08T08:42:05.159558+0000","last_fullsized":"2023-10-08T08:42:05.159558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:10.166151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160495+0000","last_change":"2023-10-08T08:42:05.174612+0000","last_active":"2023-10-08T08:42:06.160495+0000","last_peered":"2023-10-08T08:42:06.160495+0000","last_clean":"2023-10-08T08:42:06.160495+0000","last_became_active":"2023-10-08T08:42:05.174174+0000","last_became_peered":"2023-10-08T08:42:05.174174+0000","last_unstale":"2023-10-08T08:42:06.160495+0000","last_undegraded":"2023-10-08T08:42:06.160495+0000","last_fullsized":"2023-10-08T08:42:06.160495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:07.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159118+0000","last_change":"2023-10-08T08:42:00.112537+0000","last_active":"2023-10-08T08:42:05.159118+0000","last_peered":"2023-10-08T08:42:05.159118+0000","last_clean":"2023-10-08T08:42:05.159118+0000","last_became_active":"2023-10-08T08:42:00.112060+0000","last_became_peered":"2023-10-08T08:42:00.112060+0000","last_unstale":"2023-10-08T08:42:05.159118+0000","last_undegraded":"2023-10-08T08:42:05.159118+0000","last_fullsized":"2023-10-08T08:42:05.159118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:41.878960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164840+0000","last_change":"2023-10-08T08:42:01.146929+0000","last_active":"2023-10-08T08:42:05.164840+0000","last_peered":"2023-10-08T08:42:05.164840+0000","last_clean":"2023-10-08T08:42:05.164840+0000","last_became_active":"2023-10-08T08:42:01.145980+0000","last_became_peered":"2023-10-08T08:42:01.145980+0000","last_unstale":"2023-10-08T08:42:05.164840+0000","last_undegraded":"2023-10-08T08:42:05.164840+0000","last_fullsized":"2023-10-08T08:42:05.164840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:37.411832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160530+0000","last_change":"2023-10-08T08:42:05.185417+0000","last_active":"2023-10-08T08:42:06.160530+0000","last_peered":"2023-10-08T08:42:06.160530+0000","last_clean":"2023-10-08T08:42:06.160530+0000","last_became_active":"2023-10-08T08:42:05.185033+0000","last_became_peered":"2023-10-08T08:42:05.185033+0000","last_unstale":"2023-10-08T08:42:06.160530+0000","last_undegraded":"2023-10-08T08:42:06.160530+0000","last_fullsized":"2023-10-08T08:42:06.160530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:40.827523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158414+0000","last_change":"2023-10-08T08:42:00.115656+0000","last_active":"2023-10-08T08:42:05.158414+0000","last_peered":"2023-10-08T08:42:05.158414+0000","last_clean":"2023-10-08T08:42:05.158414+0000","last_became_active":"2023-10-08T08:42:00.115342+0000","last_became_peered":"2023-10-08T08:42:00.115342+0000","last_unstale":"2023-10-08T08:42:05.158414+0000","last_undegraded":"2023-10-08T08:42:05.158414+0000","last_fullsized":"2023-10-08T08:42:05.158414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:32.630853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159322+0000","last_change":"2023-10-08T08:42:01.139137+0000","last_active":"2023-10-08T08:42:05.159322+0000","last_peered":"2023-10-08T08:42:05.159322+0000","last_clean":"2023-10-08T08:42:05.159322+0000","last_became_active":"2023-10-08T08:42:01.138510+0000","last_became_peered":"2023-10-08T08:42:01.138510+0000","last_unstale":"2023-10-08T08:42:05.159322+0000","last_undegraded":"2023-10-08T08:42:05.159322+0000","last_fullsized":"2023-10-08T08:42:05.159322+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:16:28.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178237+0000","last_change":"2023-10-08T08:42:05.179770+0000","last_active":"2023-10-08T08:42:06.178237+0000","last_peered":"2023-10-08T08:42:06.178237+0000","last_clean":"2023-10-08T08:42:06.178237+0000","last_became_active":"2023-10-08T08:42:05.179312+0000","last_became_peered":"2023-10-08T08:42:05.179312+0000","last_unstale":"2023-10-08T08:42:06.178237+0000","last_undegraded":"2023-10-08T08:42:06.178237+0000","last_fullsized":"2023-10-08T08:42:06.178237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.947270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157757+0000","last_change":"2023-10-08T08:42:00.111299+0000","last_active":"2023-10-08T08:42:05.157757+0000","last_peered":"2023-10-08T08:42:05.157757+0000","last_clean":"2023-10-08T08:42:05.157757+0000","last_became_active":"2023-10-08T08:42:00.110966+0000","last_became_peered":"2023-10-08T08:42:00.110966+0000","last_unstale":"2023-10-08T08:42:05.157757+0000","last_undegraded":"2023-10-08T08:42:05.157757+0000","last_fullsized":"2023-10-08T08:42:05.157757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:34.211598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165423+0000","last_change":"2023-10-08T08:42:01.134205+0000","last_active":"2023-10-08T08:42:05.165423+0000","last_peered":"2023-10-08T08:42:05.165423+0000","last_clean":"2023-10-08T08:42:05.165423+0000","last_became_active":"2023-10-08T08:42:01.133887+0000","last_became_peered":"2023-10-08T08:42:01.133887+0000","last_unstale":"2023-10-08T08:42:05.165423+0000","last_undegraded":"2023-10-08T08:42:05.165423+0000","last_fullsized":"2023-10-08T08:42:05.165423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:01.807150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176511+0000","last_change":"2023-10-08T08:42:05.179119+0000","last_active":"2023-10-08T08:42:06.176511+0000","last_peered":"2023-10-08T08:42:06.176511+0000","last_clean":"2023-10-08T08:42:06.176511+0000","last_became_active":"2023-10-08T08:42:05.178712+0000","last_became_peered":"2023-10-08T08:42:05.178712+0000","last_unstale":"2023-10-08T08:42:06.176511+0000","last_undegraded":"2023-10-08T08:42:06.176511+0000","last_fullsized":"2023-10-08T08:42:06.176511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:54:38.514047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159797+0000","last_change":"2023-10-08T08:42:00.116426+0000","last_active":"2023-10-08T08:42:05.159797+0000","last_peered":"2023-10-08T08:42:05.159797+0000","last_clean":"2023-10-08T08:42:05.159797+0000","last_became_active":"2023-10-08T08:42:00.115313+0000","last_became_peered":"2023-10-08T08:42:00.115313+0000","last_unstale":"2023-10-08T08:42:05.159797+0000","last_undegraded":"2023-10-08T08:42:05.159797+0000","last_fullsized":"2023-10-08T08:42:05.159797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:42.989380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.162862+0000","last_change":"2023-10-08T08:42:01.129719+0000","last_active":"2023-10-08T08:42:05.162862+0000","last_peered":"2023-10-08T08:42:05.162862+0000","last_clean":"2023-10-08T08:42:05.162862+0000","last_became_active":"2023-10-08T08:42:01.129293+0000","last_became_peered":"2023-10-08T08:42:01.129293+0000","last_unstale":"2023-10-08T08:42:05.162862+0000","last_undegraded":"2023-10-08T08:42:05.162862+0000","last_fullsized":"2023-10-08T08:42:05.162862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:35.463614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176044+0000","last_change":"2023-10-08T08:42:05.172880+0000","last_active":"2023-10-08T08:42:06.176044+0000","last_peered":"2023-10-08T08:42:06.176044+0000","last_clean":"2023-10-08T08:42:06.176044+0000","last_became_active":"2023-10-08T08:42:05.172485+0000","last_became_peered":"2023-10-08T08:42:05.172485+0000","last_unstale":"2023-10-08T08:42:06.176044+0000","last_undegraded":"2023-10-08T08:42:06.176044+0000","last_fullsized":"2023-10-08T08:42:06.176044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:29.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159239+0000","last_change":"2023-10-08T08:42:00.115206+0000","last_active":"2023-10-08T08:42:05.159239+0000","last_peered":"2023-10-08T08:42:05.159239+0000","last_clean":"2023-10-08T08:42:05.159239+0000","last_became_active":"2023-10-08T08:42:00.114905+0000","last_became_peered":"2023-10-08T08:42:00.114905+0000","last_unstale":"2023-10-08T08:42:05.159239+0000","last_undegraded":"2023-10-08T08:42:05.159239+0000","last_fullsized":"2023-10-08T08:42:05.159239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:09.275317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165576+0000","last_change":"2023-10-08T08:42:01.141422+0000","last_active":"2023-10-08T08:42:05.165576+0000","last_peered":"2023-10-08T08:42:05.165576+0000","last_clean":"2023-10-08T08:42:05.165576+0000","last_became_active":"2023-10-08T08:42:01.140979+0000","last_became_peered":"2023-10-08T08:42:01.140979+0000","last_unstale":"2023-10-08T08:42:05.165576+0000","last_undegraded":"2023-10-08T08:42:05.165576+0000","last_fullsized":"2023-10-08T08:42:05.165576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:14.018786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177301+0000","last_change":"2023-10-08T08:42:05.184358+0000","last_active":"2023-10-08T08:42:06.177301+0000","last_peered":"2023-10-08T08:42:06.177301+0000","last_clean":"2023-10-08T08:42:06.177301+0000","last_became_active":"2023-10-08T08:42:05.183994+0000","last_became_peered":"2023-10-08T08:42:05.183994+0000","last_unstale":"2023-10-08T08:42:06.177301+0000","last_undegraded":"2023-10-08T08:42:06.177301+0000","last_fullsized":"2023-10-08T08:42:06.177301+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:46.465110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163408+0000","last_change":"2023-10-08T08:42:00.115765+0000","last_active":"2023-10-08T08:42:05.163408+0000","last_peered":"2023-10-08T08:42:05.163408+0000","last_clean":"2023-10-08T08:42:05.163408+0000","last_became_active":"2023-10-08T08:42:00.115288+0000","last_became_peered":"2023-10-08T08:42:00.115288+0000","last_unstale":"2023-10-08T08:42:05.163408+0000","last_undegraded":"2023-10-08T08:42:05.163408+0000","last_fullsized":"2023-10-08T08:42:05.163408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:20.973280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175911+0000","last_change":"2023-10-08T08:42:01.143290+0000","last_active":"2023-10-08T08:42:05.175911+0000","last_peered":"2023-10-08T08:42:05.175911+0000","last_clean":"2023-10-08T08:42:05.175911+0000","last_became_active":"2023-10-08T08:42:01.143034+0000","last_became_peered":"2023-10-08T08:42:01.143034+0000","last_unstale":"2023-10-08T08:42:05.175911+0000","last_undegraded":"2023-10-08T08:42:05.175911+0000","last_fullsized":"2023-10-08T08:42:05.175911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:45.784275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177181+0000","last_change":"2023-10-08T08:42:05.185022+0000","last_active":"2023-10-08T08:42:06.177181+0000","last_peered":"2023-10-08T08:42:06.177181+0000","last_clean":"2023-10-08T08:42:06.177181+0000","last_became_active":"2023-10-08T08:42:05.184476+0000","last_became_peered":"2023-10-08T08:42:05.184476+0000","last_unstale":"2023-10-08T08:42:06.177181+0000","last_undegraded":"2023-10-08T08:42:06.177181+0000","last_fullsized":"2023-10-08T08:42:06.177181+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:14:04.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159734+0000","last_change":"2023-10-08T08:42:00.115556+0000","last_active":"2023-10-08T08:42:05.159734+0000","last_peered":"2023-10-08T08:42:05.159734+0000","last_clean":"2023-10-08T08:42:05.159734+0000","last_became_active":"2023-10-08T08:42:00.115251+0000","last_became_peered":"2023-10-08T08:42:00.115251+0000","last_unstale":"2023-10-08T08:42:05.159734+0000","last_undegraded":"2023-10-08T08:42:05.159734+0000","last_fullsized":"2023-10-08T08:42:05.159734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:55.439502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165192+0000","last_change":"2023-10-08T08:42:01.135969+0000","last_active":"2023-10-08T08:42:05.165192+0000","last_peered":"2023-10-08T08:42:05.165192+0000","last_clean":"2023-10-08T08:42:05.165192+0000","last_became_active":"2023-10-08T08:42:01.135615+0000","last_became_peered":"2023-10-08T08:42:01.135615+0000","last_unstale":"2023-10-08T08:42:05.165192+0000","last_undegraded":"2023-10-08T08:42:05.165192+0000","last_fullsized":"2023-10-08T08:42:05.165192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:23.153920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177379+0000","last_change":"2023-10-08T08:42:05.177904+0000","last_active":"2023-10-08T08:42:06.177379+0000","last_peered":"2023-10-08T08:42:06.177379+0000","last_clean":"2023-10-08T08:42:06.177379+0000","last_became_active":"2023-10-08T08:42:05.176397+0000","last_became_peered":"2023-10-08T08:42:05.176397+0000","last_unstale":"2023-10-08T08:42:06.177379+0000","last_undegraded":"2023-10-08T08:42:06.177379+0000","last_fullsized":"2023-10-08T08:42:06.177379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:50.134974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'10","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:16.762768+0000","last_change":"2023-10-08T08:42:00.114485+0000","last_active":"2023-10-08T08:42:16.762768+0000","last_peered":"2023-10-08T08:42:16.762768+0000","last_clean":"2023-10-08T08:42:16.762768+0000","last_became_active":"2023-10-08T08:42:00.114186+0000","last_became_peered":"2023-10-08T08:42:00.114186+0000","last_unstale":"2023-10-08T08:42:16.762768+0000","last_undegraded":"2023-10-08T08:42:16.762768+0000","last_fullsized":"2023-10-08T08:42:16.762768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:30.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165965+0000","last_change":"2023-10-08T08:42:01.146627+0000","last_active":"2023-10-08T08:42:05.165965+0000","last_peered":"2023-10-08T08:42:05.165965+0000","last_clean":"2023-10-08T08:42:05.165965+0000","last_became_active":"2023-10-08T08:42:01.146332+0000","last_became_peered":"2023-10-08T08:42:01.146332+0000","last_unstale":"2023-10-08T08:42:05.165965+0000","last_undegraded":"2023-10-08T08:42:05.165965+0000","last_fullsized":"2023-10-08T08:42:05.165965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:00.825191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178059+0000","last_change":"2023-10-08T08:42:05.173257+0000","last_active":"2023-10-08T08:42:06.178059+0000","last_peered":"2023-10-08T08:42:06.178059+0000","last_clean":"2023-10-08T08:42:06.178059+0000","last_became_active":"2023-10-08T08:42:05.172891+0000","last_became_peered":"2023-10-08T08:42:05.172891+0000","last_unstale":"2023-10-08T08:42:06.178059+0000","last_undegraded":"2023-10-08T08:42:06.178059+0000","last_fullsized":"2023-10-08T08:42:06.178059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:32.802194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164206+0000","last_change":"2023-10-08T08:42:00.113330+0000","last_active":"2023-10-08T08:42:05.164206+0000","last_peered":"2023-10-08T08:42:05.164206+0000","last_clean":"2023-10-08T08:42:05.164206+0000","last_became_active":"2023-10-08T08:42:00.112183+0000","last_became_peered":"2023-10-08T08:42:00.112183+0000","last_unstale":"2023-10-08T08:42:05.164206+0000","last_undegraded":"2023-10-08T08:42:05.164206+0000","last_fullsized":"2023-10-08T08:42:05.164206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:13.158570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158566+0000","last_change":"2023-10-08T08:42:01.133854+0000","last_active":"2023-10-08T08:42:05.158566+0000","last_peered":"2023-10-08T08:42:05.158566+0000","last_clean":"2023-10-08T08:42:05.158566+0000","last_became_active":"2023-10-08T08:42:01.133540+0000","last_became_peered":"2023-10-08T08:42:01.133540+0000","last_unstale":"2023-10-08T08:42:05.158566+0000","last_undegraded":"2023-10-08T08:42:05.158566+0000","last_fullsized":"2023-10-08T08:42:05.158566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:50.011909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177380+0000","last_change":"2023-10-08T08:42:05.180359+0000","last_active":"2023-10-08T08:42:06.177380+0000","last_peered":"2023-10-08T08:42:06.177380+0000","last_clean":"2023-10-08T08:42:06.177380+0000","last_became_active":"2023-10-08T08:42:05.179877+0000","last_became_peered":"2023-10-08T08:42:05.179877+0000","last_unstale":"2023-10-08T08:42:06.177380+0000","last_undegraded":"2023-10-08T08:42:06.177380+0000","last_fullsized":"2023-10-08T08:42:06.177380+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:52.926297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159394+0000","last_change":"2023-10-08T08:42:00.112036+0000","last_active":"2023-10-08T08:42:05.159394+0000","last_peered":"2023-10-08T08:42:05.159394+0000","last_clean":"2023-10-08T08:42:05.159394+0000","last_became_active":"2023-10-08T08:42:00.111710+0000","last_became_peered":"2023-10-08T08:42:00.111710+0000","last_unstale":"2023-10-08T08:42:05.159394+0000","last_undegraded":"2023-10-08T08:42:05.159394+0000","last_fullsized":"2023-10-08T08:42:05.159394+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:58:16.004802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163515+0000","last_change":"2023-10-08T08:42:01.135245+0000","last_active":"2023-10-08T08:42:05.163515+0000","last_peered":"2023-10-08T08:42:05.163515+0000","last_clean":"2023-10-08T08:42:05.163515+0000","last_became_active":"2023-10-08T08:42:01.134941+0000","last_became_peered":"2023-10-08T08:42:01.134941+0000","last_unstale":"2023-10-08T08:42:05.163515+0000","last_undegraded":"2023-10-08T08:42:05.163515+0000","last_fullsized":"2023-10-08T08:42:05.163515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:13.745895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177909+0000","last_change":"2023-10-08T08:42:05.183155+0000","last_active":"2023-10-08T08:42:06.177909+0000","last_peered":"2023-10-08T08:42:06.177909+0000","last_clean":"2023-10-08T08:42:06.177909+0000","last_became_active":"2023-10-08T08:42:05.182722+0000","last_became_peered":"2023-10-08T08:42:05.182722+0000","last_unstale":"2023-10-08T08:42:06.177909+0000","last_undegraded":"2023-10-08T08:42:06.177909+0000","last_fullsized":"2023-10-08T08:42:06.177909+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:49.544702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163571+0000","last_change":"2023-10-08T08:42:00.112610+0000","last_active":"2023-10-08T08:42:05.163571+0000","last_peered":"2023-10-08T08:42:05.163571+0000","last_clean":"2023-10-08T08:42:05.163571+0000","last_became_active":"2023-10-08T08:42:00.112313+0000","last_became_peered":"2023-10-08T08:42:00.112313+0000","last_unstale":"2023-10-08T08:42:05.163571+0000","last_undegraded":"2023-10-08T08:42:05.163571+0000","last_fullsized":"2023-10-08T08:42:05.163571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:35.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165949+0000","last_change":"2023-10-08T08:42:01.141538+0000","last_active":"2023-10-08T08:42:05.165949+0000","last_peered":"2023-10-08T08:42:05.165949+0000","last_clean":"2023-10-08T08:42:05.165949+0000","last_became_active":"2023-10-08T08:42:01.141241+0000","last_became_peered":"2023-10-08T08:42:01.141241+0000","last_unstale":"2023-10-08T08:42:05.165949+0000","last_undegraded":"2023-10-08T08:42:05.165949+0000","last_fullsized":"2023-10-08T08:42:05.165949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:41.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160064+0000","last_change":"2023-10-08T08:42:05.181949+0000","last_active":"2023-10-08T08:42:06.160064+0000","last_peered":"2023-10-08T08:42:06.160064+0000","last_clean":"2023-10-08T08:42:06.160064+0000","last_became_active":"2023-10-08T08:42:05.181532+0000","last_became_peered":"2023-10-08T08:42:05.181532+0000","last_unstale":"2023-10-08T08:42:06.160064+0000","last_undegraded":"2023-10-08T08:42:06.160064+0000","last_fullsized":"2023-10-08T08:42:06.160064+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:44.035004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164050+0000","last_change":"2023-10-08T08:42:00.111175+0000","last_active":"2023-10-08T08:42:05.164050+0000","last_peered":"2023-10-08T08:42:05.164050+0000","last_clean":"2023-10-08T08:42:05.164050+0000","last_became_active":"2023-10-08T08:42:00.109672+0000","last_became_peered":"2023-10-08T08:42:00.109672+0000","last_unstale":"2023-10-08T08:42:05.164050+0000","last_undegraded":"2023-10-08T08:42:05.164050+0000","last_fullsized":"2023-10-08T08:42:05.164050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:42.715127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159030+0000","last_change":"2023-10-08T08:42:01.133910+0000","last_active":"2023-10-08T08:42:05.159030+0000","last_peered":"2023-10-08T08:42:05.159030+0000","last_clean":"2023-10-08T08:42:05.159030+0000","last_became_active":"2023-10-08T08:42:01.132738+0000","last_became_peered":"2023-10-08T08:42:01.132738+0000","last_unstale":"2023-10-08T08:42:05.159030+0000","last_undegraded":"2023-10-08T08:42:05.159030+0000","last_fullsized":"2023-10-08T08:42:05.159030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:19.966595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176836+0000","last_change":"2023-10-08T08:42:05.177048+0000","last_active":"2023-10-08T08:42:06.176836+0000","last_peered":"2023-10-08T08:42:06.176836+0000","last_clean":"2023-10-08T08:42:06.176836+0000","last_became_active":"2023-10-08T08:42:05.176654+0000","last_became_peered":"2023-10-08T08:42:05.176654+0000","last_unstale":"2023-10-08T08:42:06.176836+0000","last_undegraded":"2023-10-08T08:42:06.176836+0000","last_fullsized":"2023-10-08T08:42:06.176836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:22.424769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164699+0000","last_change":"2023-10-08T08:42:00.112684+0000","last_active":"2023-10-08T08:42:05.164699+0000","last_peered":"2023-10-08T08:42:05.164699+0000","last_clean":"2023-10-08T08:42:05.164699+0000","last_became_active":"2023-10-08T08:42:00.112235+0000","last_became_peered":"2023-10-08T08:42:00.112235+0000","last_unstale":"2023-10-08T08:42:05.164699+0000","last_undegraded":"2023-10-08T08:42:05.164699+0000","last_fullsized":"2023-10-08T08:42:05.164699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:47.984940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166804+0000","last_change":"2023-10-08T08:42:01.133393+0000","last_active":"2023-10-08T08:42:05.166804+0000","last_peered":"2023-10-08T08:42:05.166804+0000","last_clean":"2023-10-08T08:42:05.166804+0000","last_became_active":"2023-10-08T08:42:01.133121+0000","last_became_peered":"2023-10-08T08:42:01.133121+0000","last_unstale":"2023-10-08T08:42:05.166804+0000","last_undegraded":"2023-10-08T08:42:05.166804+0000","last_fullsized":"2023-10-08T08:42:05.166804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:54.542269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177248+0000","last_change":"2023-10-08T08:42:05.176873+0000","last_active":"2023-10-08T08:42:06.177248+0000","last_peered":"2023-10-08T08:42:06.177248+0000","last_clean":"2023-10-08T08:42:06.177248+0000","last_became_active":"2023-10-08T08:42:05.176450+0000","last_became_peered":"2023-10-08T08:42:05.176450+0000","last_unstale":"2023-10-08T08:42:06.177248+0000","last_undegraded":"2023-10-08T08:42:06.177248+0000","last_fullsized":"2023-10-08T08:42:06.177248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:43.333931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164483+0000","last_change":"2023-10-08T08:42:00.110059+0000","last_active":"2023-10-08T08:42:05.164483+0000","last_peered":"2023-10-08T08:42:05.164483+0000","last_clean":"2023-10-08T08:42:05.164483+0000","last_became_active":"2023-10-08T08:42:00.109743+0000","last_became_peered":"2023-10-08T08:42:00.109743+0000","last_unstale":"2023-10-08T08:42:05.164483+0000","last_undegraded":"2023-10-08T08:42:05.164483+0000","last_fullsized":"2023-10-08T08:42:05.164483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:03:40.950213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158971+0000","last_change":"2023-10-08T08:42:01.133595+0000","last_active":"2023-10-08T08:42:05.158971+0000","last_peered":"2023-10-08T08:42:05.158971+0000","last_clean":"2023-10-08T08:42:05.158971+0000","last_became_active":"2023-10-08T08:42:01.133268+0000","last_became_peered":"2023-10-08T08:42:01.133268+0000","last_unstale":"2023-10-08T08:42:05.158971+0000","last_undegraded":"2023-10-08T08:42:05.158971+0000","last_fullsized":"2023-10-08T08:42:05.158971+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:49.571517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.159798+0000","last_change":"2023-10-08T08:42:05.174472+0000","last_active":"2023-10-08T08:42:06.159798+0000","last_peered":"2023-10-08T08:42:06.159798+0000","last_clean":"2023-10-08T08:42:06.159798+0000","last_became_active":"2023-10-08T08:42:05.174073+0000","last_became_peered":"2023-10-08T08:42:05.174073+0000","last_unstale":"2023-10-08T08:42:06.159798+0000","last_undegraded":"2023-10-08T08:42:06.159798+0000","last_fullsized":"2023-10-08T08:42:06.159798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:36.208008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163996+0000","last_change":"2023-10-08T08:42:00.115978+0000","last_active":"2023-10-08T08:42:05.163996+0000","last_peered":"2023-10-08T08:42:05.163996+0000","last_clean":"2023-10-08T08:42:05.163996+0000","last_became_active":"2023-10-08T08:42:00.115670+0000","last_became_peered":"2023-10-08T08:42:00.115670+0000","last_unstale":"2023-10-08T08:42:05.163996+0000","last_undegraded":"2023-10-08T08:42:05.163996+0000","last_fullsized":"2023-10-08T08:42:05.163996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:11:41.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158669+0000","last_change":"2023-10-08T08:42:01.142576+0000","last_active":"2023-10-08T08:42:05.158669+0000","last_peered":"2023-10-08T08:42:05.158669+0000","last_clean":"2023-10-08T08:42:05.158669+0000","last_became_active":"2023-10-08T08:42:01.142290+0000","last_became_peered":"2023-10-08T08:42:01.142290+0000","last_unstale":"2023-10-08T08:42:05.158669+0000","last_undegraded":"2023-10-08T08:42:05.158669+0000","last_fullsized":"2023-10-08T08:42:05.158669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:30:28.050063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.159811+0000","last_change":"2023-10-08T08:42:05.177922+0000","last_active":"2023-10-08T08:42:06.159811+0000","last_peered":"2023-10-08T08:42:06.159811+0000","last_clean":"2023-10-08T08:42:06.159811+0000","last_became_active":"2023-10-08T08:42:05.177504+0000","last_became_peered":"2023-10-08T08:42:05.177504+0000","last_unstale":"2023-10-08T08:42:06.159811+0000","last_undegraded":"2023-10-08T08:42:06.159811+0000","last_fullsized":"2023-10-08T08:42:06.159811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:02.602437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159895+0000","last_change":"2023-10-08T08:42:01.139125+0000","last_active":"2023-10-08T08:42:05.159895+0000","last_peered":"2023-10-08T08:42:05.159895+0000","last_clean":"2023-10-08T08:42:05.159895+0000","last_became_active":"2023-10-08T08:42:01.138769+0000","last_became_peered":"2023-10-08T08:42:01.138769+0000","last_unstale":"2023-10-08T08:42:05.159895+0000","last_undegraded":"2023-10-08T08:42:05.159895+0000","last_fullsized":"2023-10-08T08:42:05.159895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:31:57.717833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157691+0000","last_change":"2023-10-08T08:42:00.115528+0000","last_active":"2023-10-08T08:42:05.157691+0000","last_peered":"2023-10-08T08:42:05.157691+0000","last_clean":"2023-10-08T08:42:05.157691+0000","last_became_active":"2023-10-08T08:42:00.115189+0000","last_became_peered":"2023-10-08T08:42:00.115189+0000","last_unstale":"2023-10-08T08:42:05.157691+0000","last_undegraded":"2023-10-08T08:42:05.157691+0000","last_fullsized":"2023-10-08T08:42:05.157691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.254073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176991+0000","last_change":"2023-10-08T08:42:05.179885+0000","last_active":"2023-10-08T08:42:06.176991+0000","last_peered":"2023-10-08T08:42:06.176991+0000","last_clean":"2023-10-08T08:42:06.176991+0000","last_became_active":"2023-10-08T08:42:05.179436+0000","last_became_peered":"2023-10-08T08:42:05.179436+0000","last_unstale":"2023-10-08T08:42:06.176991+0000","last_undegraded":"2023-10-08T08:42:06.176991+0000","last_fullsized":"2023-10-08T08:42:06.176991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:49.713475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164259+0000","last_change":"2023-10-08T08:42:01.131992+0000","last_active":"2023-10-08T08:42:05.164259+0000","last_peered":"2023-10-08T08:42:05.164259+0000","last_clean":"2023-10-08T08:42:05.164259+0000","last_became_active":"2023-10-08T08:42:01.131633+0000","last_became_peered":"2023-10-08T08:42:01.131633+0000","last_unstale":"2023-10-08T08:42:05.164259+0000","last_undegraded":"2023-10-08T08:42:05.164259+0000","last_fullsized":"2023-10-08T08:42:05.164259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:40.653710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:25.231531+0000","last_change":"2023-10-08T08:42:00.112987+0000","last_active":"2023-10-08T08:42:25.231531+0000","last_peered":"2023-10-08T08:42:25.231531+0000","last_clean":"2023-10-08T08:42:25.231531+0000","last_became_active":"2023-10-08T08:42:00.112276+0000","last_became_peered":"2023-10-08T08:42:00.112276+0000","last_unstale":"2023-10-08T08:42:25.231531+0000","last_undegraded":"2023-10-08T08:42:25.231531+0000","last_fullsized":"2023-10-08T08:42:25.231531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.193726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":318,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165843+0000","last_change":"2023-10-08T08:41:02.223132+0000","last_active":"2023-10-08T08:42:05.165843+0000","last_peered":"2023-10-08T08:42:05.165843+0000","last_clean":"2023-10-08T08:42:05.165843+0000","last_became_active":"2023-10-08T08:41:02.222688+0000","last_became_peered":"2023-10-08T08:41:02.222688+0000","last_unstale":"2023-10-08T08:42:05.165843+0000","last_undegraded":"2023-10-08T08:42:05.165843+0000","last_fullsized":"2023-10-08T08:42:05.165843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_clean_scrub_stamp":"2023-10-08T08:38:15.738972+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:27.673603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178163+0000","last_change":"2023-10-08T08:42:05.169025+0000","last_active":"2023-10-08T08:42:06.178163+0000","last_peered":"2023-10-08T08:42:06.178163+0000","last_clean":"2023-10-08T08:42:06.178163+0000","last_became_active":"2023-10-08T08:42:05.168100+0000","last_became_peered":"2023-10-08T08:42:05.168100+0000","last_unstale":"2023-10-08T08:42:06.178163+0000","last_undegraded":"2023-10-08T08:42:06.178163+0000","last_fullsized":"2023-10-08T08:42:06.178163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:30:40.830952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157649+0000","last_change":"2023-10-08T08:42:01.130878+0000","last_active":"2023-10-08T08:42:05.157649+0000","last_peered":"2023-10-08T08:42:05.157649+0000","last_clean":"2023-10-08T08:42:05.157649+0000","last_became_active":"2023-10-08T08:42:01.130649+0000","last_became_peered":"2023-10-08T08:42:01.130649+0000","last_unstale":"2023-10-08T08:42:05.157649+0000","last_undegraded":"2023-10-08T08:42:05.157649+0000","last_fullsized":"2023-10-08T08:42:05.157649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:15.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165991+0000","last_change":"2023-10-08T08:42:00.117747+0000","last_active":"2023-10-08T08:42:05.165991+0000","last_peered":"2023-10-08T08:42:05.165991+0000","last_clean":"2023-10-08T08:42:05.165991+0000","last_became_active":"2023-10-08T08:42:00.117437+0000","last_became_peered":"2023-10-08T08:42:00.117437+0000","last_unstale":"2023-10-08T08:42:05.165991+0000","last_undegraded":"2023-10-08T08:42:05.165991+0000","last_fullsized":"2023-10-08T08:42:05.165991+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:13.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.177792+0000","last_change":"2023-10-08T08:42:05.173175+0000","last_active":"2023-10-08T08:42:06.177792+0000","last_peered":"2023-10-08T08:42:06.177792+0000","last_clean":"2023-10-08T08:42:06.177792+0000","last_became_active":"2023-10-08T08:42:05.172754+0000","last_became_peered":"2023-10-08T08:42:05.172754+0000","last_unstale":"2023-10-08T08:42:06.177792+0000","last_undegraded":"2023-10-08T08:42:06.177792+0000","last_fullsized":"2023-10-08T08:42:06.177792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:48.900020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166051+0000","last_change":"2023-10-08T08:42:00.117094+0000","last_active":"2023-10-08T08:42:05.166051+0000","last_peered":"2023-10-08T08:42:05.166051+0000","last_clean":"2023-10-08T08:42:05.166051+0000","last_became_active":"2023-10-08T08:42:00.116773+0000","last_became_peered":"2023-10-08T08:42:00.116773+0000","last_unstale":"2023-10-08T08:42:05.166051+0000","last_undegraded":"2023-10-08T08:42:05.166051+0000","last_fullsized":"2023-10-08T08:42:05.166051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:28.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157964+0000","last_change":"2023-10-08T08:42:01.146290+0000","last_active":"2023-10-08T08:42:05.157964+0000","last_peered":"2023-10-08T08:42:05.157964+0000","last_clean":"2023-10-08T08:42:05.157964+0000","last_became_active":"2023-10-08T08:42:01.145585+0000","last_became_peered":"2023-10-08T08:42:01.145585+0000","last_unstale":"2023-10-08T08:42:05.157964+0000","last_undegraded":"2023-10-08T08:42:05.157964+0000","last_fullsized":"2023-10-08T08:42:05.157964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:16:15.140659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176329+0000","last_change":"2023-10-08T08:42:05.177611+0000","last_active":"2023-10-08T08:42:06.176329+0000","last_peered":"2023-10-08T08:42:06.176329+0000","last_clean":"2023-10-08T08:42:06.176329+0000","last_became_active":"2023-10-08T08:42:05.177027+0000","last_became_peered":"2023-10-08T08:42:05.177027+0000","last_unstale":"2023-10-08T08:42:06.176329+0000","last_undegraded":"2023-10-08T08:42:06.176329+0000","last_fullsized":"2023-10-08T08:42:06.176329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.846359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164254+0000","last_change":"2023-10-08T08:42:00.112453+0000","last_active":"2023-10-08T08:42:05.164254+0000","last_peered":"2023-10-08T08:42:05.164254+0000","last_clean":"2023-10-08T08:42:05.164254+0000","last_became_active":"2023-10-08T08:42:00.112159+0000","last_became_peered":"2023-10-08T08:42:00.112159+0000","last_unstale":"2023-10-08T08:42:05.164254+0000","last_undegraded":"2023-10-08T08:42:05.164254+0000","last_fullsized":"2023-10-08T08:42:05.164254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:27.713764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164358+0000","last_change":"2023-10-08T08:42:01.136743+0000","last_active":"2023-10-08T08:42:05.164358+0000","last_peered":"2023-10-08T08:42:05.164358+0000","last_clean":"2023-10-08T08:42:05.164358+0000","last_became_active":"2023-10-08T08:42:01.136442+0000","last_became_peered":"2023-10-08T08:42:01.136442+0000","last_unstale":"2023-10-08T08:42:05.164358+0000","last_undegraded":"2023-10-08T08:42:05.164358+0000","last_fullsized":"2023-10-08T08:42:05.164358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:50:41.937240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.159960+0000","last_change":"2023-10-08T08:42:05.171945+0000","last_active":"2023-10-08T08:42:06.159960+0000","last_peered":"2023-10-08T08:42:06.159960+0000","last_clean":"2023-10-08T08:42:06.159960+0000","last_became_active":"2023-10-08T08:42:05.171573+0000","last_became_peered":"2023-10-08T08:42:05.171573+0000","last_unstale":"2023-10-08T08:42:06.159960+0000","last_undegraded":"2023-10-08T08:42:06.159960+0000","last_fullsized":"2023-10-08T08:42:06.159960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:03.677144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:25.231519+0000","last_change":"2023-10-08T08:42:00.116005+0000","last_active":"2023-10-08T08:42:25.231519+0000","last_peered":"2023-10-08T08:42:25.231519+0000","last_clean":"2023-10-08T08:42:25.231519+0000","last_became_active":"2023-10-08T08:42:00.115701+0000","last_became_peered":"2023-10-08T08:42:00.115701+0000","last_unstale":"2023-10-08T08:42:25.231519+0000","last_undegraded":"2023-10-08T08:42:25.231519+0000","last_fullsized":"2023-10-08T08:42:25.231519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:46.114324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175467+0000","last_change":"2023-10-08T08:42:01.140370+0000","last_active":"2023-10-08T08:42:05.175467+0000","last_peered":"2023-10-08T08:42:05.175467+0000","last_clean":"2023-10-08T08:42:05.175467+0000","last_became_active":"2023-10-08T08:42:01.139923+0000","last_became_peered":"2023-10-08T08:42:01.139923+0000","last_unstale":"2023-10-08T08:42:05.175467+0000","last_undegraded":"2023-10-08T08:42:05.175467+0000","last_fullsized":"2023-10-08T08:42:05.175467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:07.052821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176576+0000","last_change":"2023-10-08T08:42:05.177542+0000","last_active":"2023-10-08T08:42:06.176576+0000","last_peered":"2023-10-08T08:42:06.176576+0000","last_clean":"2023-10-08T08:42:06.176576+0000","last_became_active":"2023-10-08T08:42:05.176808+0000","last_became_peered":"2023-10-08T08:42:05.176808+0000","last_unstale":"2023-10-08T08:42:06.176576+0000","last_undegraded":"2023-10-08T08:42:06.176576+0000","last_fullsized":"2023-10-08T08:42:06.176576+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:44.845948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165863+0000","last_change":"2023-10-08T08:42:00.112307+0000","last_active":"2023-10-08T08:42:05.165863+0000","last_peered":"2023-10-08T08:42:05.165863+0000","last_clean":"2023-10-08T08:42:05.165863+0000","last_became_active":"2023-10-08T08:42:00.111758+0000","last_became_peered":"2023-10-08T08:42:00.111758+0000","last_unstale":"2023-10-08T08:42:05.165863+0000","last_undegraded":"2023-10-08T08:42:05.165863+0000","last_fullsized":"2023-10-08T08:42:05.165863+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:46.244899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163788+0000","last_change":"2023-10-08T08:42:01.139641+0000","last_active":"2023-10-08T08:42:05.163788+0000","last_peered":"2023-10-08T08:42:05.163788+0000","last_clean":"2023-10-08T08:42:05.163788+0000","last_became_active":"2023-10-08T08:42:01.139332+0000","last_became_peered":"2023-10-08T08:42:01.139332+0000","last_unstale":"2023-10-08T08:42:05.163788+0000","last_undegraded":"2023-10-08T08:42:05.163788+0000","last_fullsized":"2023-10-08T08:42:05.163788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:14.948944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178074+0000","last_change":"2023-10-08T08:42:05.180307+0000","last_active":"2023-10-08T08:42:06.178074+0000","last_peered":"2023-10-08T08:42:06.178074+0000","last_clean":"2023-10-08T08:42:06.178074+0000","last_became_active":"2023-10-08T08:42:05.179755+0000","last_became_peered":"2023-10-08T08:42:05.179755+0000","last_unstale":"2023-10-08T08:42:06.178074+0000","last_undegraded":"2023-10-08T08:42:06.178074+0000","last_fullsized":"2023-10-08T08:42:06.178074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:34.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166079+0000","last_change":"2023-10-08T08:42:00.112674+0000","last_active":"2023-10-08T08:42:05.166079+0000","last_peered":"2023-10-08T08:42:05.166079+0000","last_clean":"2023-10-08T08:42:05.166079+0000","last_became_active":"2023-10-08T08:42:00.110746+0000","last_became_peered":"2023-10-08T08:42:00.110746+0000","last_unstale":"2023-10-08T08:42:05.166079+0000","last_undegraded":"2023-10-08T08:42:05.166079+0000","last_fullsized":"2023-10-08T08:42:05.166079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:27.463811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167377+0000","last_change":"2023-10-08T08:42:01.150107+0000","last_active":"2023-10-08T08:42:05.167377+0000","last_peered":"2023-10-08T08:42:05.167377+0000","last_clean":"2023-10-08T08:42:05.167377+0000","last_became_active":"2023-10-08T08:42:01.149609+0000","last_became_peered":"2023-10-08T08:42:01.149609+0000","last_unstale":"2023-10-08T08:42:05.167377+0000","last_undegraded":"2023-10-08T08:42:05.167377+0000","last_fullsized":"2023-10-08T08:42:05.167377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:05.378286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.178148+0000","last_change":"2023-10-08T08:42:05.177571+0000","last_active":"2023-10-08T08:42:06.178148+0000","last_peered":"2023-10-08T08:42:06.178148+0000","last_clean":"2023-10-08T08:42:06.178148+0000","last_became_active":"2023-10-08T08:42:05.177061+0000","last_became_peered":"2023-10-08T08:42:05.177061+0000","last_unstale":"2023-10-08T08:42:06.178148+0000","last_undegraded":"2023-10-08T08:42:06.178148+0000","last_fullsized":"2023-10-08T08:42:06.178148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:10.274262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163825+0000","last_change":"2023-10-08T08:42:00.112712+0000","last_active":"2023-10-08T08:42:05.163825+0000","last_peered":"2023-10-08T08:42:05.163825+0000","last_clean":"2023-10-08T08:42:05.163825+0000","last_became_active":"2023-10-08T08:42:00.112159+0000","last_became_peered":"2023-10-08T08:42:00.112159+0000","last_unstale":"2023-10-08T08:42:05.163825+0000","last_undegraded":"2023-10-08T08:42:05.163825+0000","last_fullsized":"2023-10-08T08:42:05.163825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:29.023373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164621+0000","last_change":"2023-10-08T08:42:01.142209+0000","last_active":"2023-10-08T08:42:05.164621+0000","last_peered":"2023-10-08T08:42:05.164621+0000","last_clean":"2023-10-08T08:42:05.164621+0000","last_became_active":"2023-10-08T08:42:01.141911+0000","last_became_peered":"2023-10-08T08:42:01.141911+0000","last_unstale":"2023-10-08T08:42:05.164621+0000","last_undegraded":"2023-10-08T08:42:05.164621+0000","last_fullsized":"2023-10-08T08:42:05.164621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:00.066595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176345+0000","last_change":"2023-10-08T08:42:05.173463+0000","last_active":"2023-10-08T08:42:06.176345+0000","last_peered":"2023-10-08T08:42:06.176345+0000","last_clean":"2023-10-08T08:42:06.176345+0000","last_became_active":"2023-10-08T08:42:05.173045+0000","last_became_peered":"2023-10-08T08:42:05.173045+0000","last_unstale":"2023-10-08T08:42:06.176345+0000","last_undegraded":"2023-10-08T08:42:06.176345+0000","last_fullsized":"2023-10-08T08:42:06.176345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:10.774694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164304+0000","last_change":"2023-10-08T08:42:00.111005+0000","last_active":"2023-10-08T08:42:05.164304+0000","last_peered":"2023-10-08T08:42:05.164304+0000","last_clean":"2023-10-08T08:42:05.164304+0000","last_became_active":"2023-10-08T08:42:00.110687+0000","last_became_peered":"2023-10-08T08:42:00.110687+0000","last_unstale":"2023-10-08T08:42:05.164304+0000","last_undegraded":"2023-10-08T08:42:05.164304+0000","last_fullsized":"2023-10-08T08:42:05.164304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:38.682150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163834+0000","last_change":"2023-10-08T08:42:01.144443+0000","last_active":"2023-10-08T08:42:05.163834+0000","last_peered":"2023-10-08T08:42:05.163834+0000","last_clean":"2023-10-08T08:42:05.163834+0000","last_became_active":"2023-10-08T08:42:01.143960+0000","last_became_peered":"2023-10-08T08:42:01.143960+0000","last_unstale":"2023-10-08T08:42:05.163834+0000","last_undegraded":"2023-10-08T08:42:05.163834+0000","last_fullsized":"2023-10-08T08:42:05.163834+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:46:57.209569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.160340+0000","last_change":"2023-10-08T08:42:05.178212+0000","last_active":"2023-10-08T08:42:06.160340+0000","last_peered":"2023-10-08T08:42:06.160340+0000","last_clean":"2023-10-08T08:42:06.160340+0000","last_became_active":"2023-10-08T08:42:05.177751+0000","last_became_peered":"2023-10-08T08:42:05.177751+0000","last_unstale":"2023-10-08T08:42:06.160340+0000","last_undegraded":"2023-10-08T08:42:06.160340+0000","last_fullsized":"2023-10-08T08:42:06.160340+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:10.128104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166558+0000","last_change":"2023-10-08T08:42:00.115576+0000","last_active":"2023-10-08T08:42:05.166558+0000","last_peered":"2023-10-08T08:42:05.166558+0000","last_clean":"2023-10-08T08:42:05.166558+0000","last_became_active":"2023-10-08T08:42:00.115296+0000","last_became_peered":"2023-10-08T08:42:00.115296+0000","last_unstale":"2023-10-08T08:42:05.166558+0000","last_undegraded":"2023-10-08T08:42:05.166558+0000","last_fullsized":"2023-10-08T08:42:05.166558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:22.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168798+0000","last_change":"2023-10-08T08:42:01.139104+0000","last_active":"2023-10-08T08:42:05.168798+0000","last_peered":"2023-10-08T08:42:05.168798+0000","last_clean":"2023-10-08T08:42:05.168798+0000","last_became_active":"2023-10-08T08:42:01.138653+0000","last_became_peered":"2023-10-08T08:42:01.138653+0000","last_unstale":"2023-10-08T08:42:05.168798+0000","last_undegraded":"2023-10-08T08:42:05.168798+0000","last_fullsized":"2023-10-08T08:42:05.168798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:24.784017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176657+0000","last_change":"2023-10-08T08:42:05.186990+0000","last_active":"2023-10-08T08:42:06.176657+0000","last_peered":"2023-10-08T08:42:06.176657+0000","last_clean":"2023-10-08T08:42:06.176657+0000","last_became_active":"2023-10-08T08:42:05.186397+0000","last_became_peered":"2023-10-08T08:42:05.186397+0000","last_unstale":"2023-10-08T08:42:06.176657+0000","last_undegraded":"2023-10-08T08:42:06.176657+0000","last_fullsized":"2023-10-08T08:42:06.176657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:53.633137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159841+0000","last_change":"2023-10-08T08:42:00.114499+0000","last_active":"2023-10-08T08:42:05.159841+0000","last_peered":"2023-10-08T08:42:05.159841+0000","last_clean":"2023-10-08T08:42:05.159841+0000","last_became_active":"2023-10-08T08:42:00.114062+0000","last_became_peered":"2023-10-08T08:42:00.114062+0000","last_unstale":"2023-10-08T08:42:05.159841+0000","last_undegraded":"2023-10-08T08:42:05.159841+0000","last_fullsized":"2023-10-08T08:42:05.159841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:23.576889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163514+0000","last_change":"2023-10-08T08:42:01.139810+0000","last_active":"2023-10-08T08:42:05.163514+0000","last_peered":"2023-10-08T08:42:05.163514+0000","last_clean":"2023-10-08T08:42:05.163514+0000","last_became_active":"2023-10-08T08:42:01.139489+0000","last_became_peered":"2023-10-08T08:42:01.139489+0000","last_unstale":"2023-10-08T08:42:05.163514+0000","last_undegraded":"2023-10-08T08:42:05.163514+0000","last_fullsized":"2023-10-08T08:42:05.163514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:06.724645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T08:42:06.176553+0000","last_change":"2023-10-08T08:42:05.172808+0000","last_active":"2023-10-08T08:42:06.176553+0000","last_peered":"2023-10-08T08:42:06.176553+0000","last_clean":"2023-10-08T08:42:06.176553+0000","last_became_active":"2023-10-08T08:42:05.172307+0000","last_became_peered":"2023-10-08T08:42:05.172307+0000","last_unstale":"2023-10-08T08:42:06.176553+0000","last_undegraded":"2023-10-08T08:42:06.176553+0000","last_fullsized":"2023-10-08T08:42:06.176553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.031070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158198+0000","last_change":"2023-10-08T08:42:00.112423+0000","last_active":"2023-10-08T08:42:05.158198+0000","last_peered":"2023-10-08T08:42:05.158198+0000","last_clean":"2023-10-08T08:42:05.158198+0000","last_became_active":"2023-10-08T08:42:00.112130+0000","last_became_peered":"2023-10-08T08:42:00.112130+0000","last_unstale":"2023-10-08T08:42:05.158198+0000","last_undegraded":"2023-10-08T08:42:05.158198+0000","last_fullsized":"2023-10-08T08:42:05.158198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:54.898037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164974+0000","last_change":"2023-10-08T08:42:01.148404+0000","last_active":"2023-10-08T08:42:05.164974+0000","last_peered":"2023-10-08T08:42:05.164974+0000","last_clean":"2023-10-08T08:42:05.164974+0000","last_became_active":"2023-10-08T08:42:01.148087+0000","last_became_peered":"2023-10-08T08:42:01.148087+0000","last_unstale":"2023-10-08T08:42:05.164974+0000","last_undegraded":"2023-10-08T08:42:05.164974+0000","last_fullsized":"2023-10-08T08:42:05.164974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:12.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167483+0000","last_change":"2023-10-08T08:42:01.149762+0000","last_active":"2023-10-08T08:42:05.167483+0000","last_peered":"2023-10-08T08:42:05.167483+0000","last_clean":"2023-10-08T08:42:05.167483+0000","last_became_active":"2023-10-08T08:42:01.149392+0000","last_became_peered":"2023-10-08T08:42:01.149392+0000","last_unstale":"2023-10-08T08:42:05.167483+0000","last_undegraded":"2023-10-08T08:42:05.167483+0000","last_fullsized":"2023-10-08T08:42:05.167483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:22.487634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166057+0000","last_change":"2023-10-08T08:42:01.145106+0000","last_active":"2023-10-08T08:42:05.166057+0000","last_peered":"2023-10-08T08:42:05.166057+0000","last_clean":"2023-10-08T08:42:05.166057+0000","last_became_active":"2023-10-08T08:42:01.144709+0000","last_became_peered":"2023-10-08T08:42:01.144709+0000","last_unstale":"2023-10-08T08:42:05.166057+0000","last_undegraded":"2023-10-08T08:42:05.166057+0000","last_fullsized":"2023-10-08T08:42:05.166057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:24.248415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.163725+0000","last_change":"2023-10-08T08:42:01.148384+0000","last_active":"2023-10-08T08:42:05.163725+0000","last_peered":"2023-10-08T08:42:05.163725+0000","last_clean":"2023-10-08T08:42:05.163725+0000","last_became_active":"2023-10-08T08:42:01.148098+0000","last_became_peered":"2023-10-08T08:42:01.148098+0000","last_unstale":"2023-10-08T08:42:05.163725+0000","last_undegraded":"2023-10-08T08:42:05.163725+0000","last_fullsized":"2023-10-08T08:42:05.163725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:45.361279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.175037+0000","last_change":"2023-10-08T08:42:01.141282+0000","last_active":"2023-10-08T08:42:05.175037+0000","last_peered":"2023-10-08T08:42:05.175037+0000","last_clean":"2023-10-08T08:42:05.175037+0000","last_became_active":"2023-10-08T08:42:01.140996+0000","last_became_peered":"2023-10-08T08:42:01.140996+0000","last_unstale":"2023-10-08T08:42:05.175037+0000","last_undegraded":"2023-10-08T08:42:05.175037+0000","last_fullsized":"2023-10-08T08:42:05.175037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:25:35.451135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.158058+0000","last_change":"2023-10-08T08:42:01.146486+0000","last_active":"2023-10-08T08:42:05.158058+0000","last_peered":"2023-10-08T08:42:05.158058+0000","last_clean":"2023-10-08T08:42:05.158058+0000","last_became_active":"2023-10-08T08:42:01.146002+0000","last_became_peered":"2023-10-08T08:42:01.146002+0000","last_unstale":"2023-10-08T08:42:05.158058+0000","last_undegraded":"2023-10-08T08:42:05.158058+0000","last_fullsized":"2023-10-08T08:42:05.158058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:28.217937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.168341+0000","last_change":"2023-10-08T08:42:01.152380+0000","last_active":"2023-10-08T08:42:05.168341+0000","last_peered":"2023-10-08T08:42:05.168341+0000","last_clean":"2023-10-08T08:42:05.168341+0000","last_became_active":"2023-10-08T08:42:01.149760+0000","last_became_peered":"2023-10-08T08:42:01.149760+0000","last_unstale":"2023-10-08T08:42:05.168341+0000","last_undegraded":"2023-10-08T08:42:05.168341+0000","last_fullsized":"2023-10-08T08:42:05.168341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:47:58.326416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165103+0000","last_change":"2023-10-08T08:42:01.149593+0000","last_active":"2023-10-08T08:42:05.165103+0000","last_peered":"2023-10-08T08:42:05.165103+0000","last_clean":"2023-10-08T08:42:05.165103+0000","last_became_active":"2023-10-08T08:42:01.149235+0000","last_became_peered":"2023-10-08T08:42:01.149235+0000","last_unstale":"2023-10-08T08:42:05.165103+0000","last_undegraded":"2023-10-08T08:42:05.165103+0000","last_fullsized":"2023-10-08T08:42:05.165103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:51.379305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.164409+0000","last_change":"2023-10-08T08:42:01.133460+0000","last_active":"2023-10-08T08:42:05.164409+0000","last_peered":"2023-10-08T08:42:05.164409+0000","last_clean":"2023-10-08T08:42:05.164409+0000","last_became_active":"2023-10-08T08:42:01.133132+0000","last_became_peered":"2023-10-08T08:42:01.133132+0000","last_unstale":"2023-10-08T08:42:05.164409+0000","last_undegraded":"2023-10-08T08:42:05.164409+0000","last_fullsized":"2023-10-08T08:42:05.164409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:29.047135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.159918+0000","last_change":"2023-10-08T08:42:01.134274+0000","last_active":"2023-10-08T08:42:05.159918+0000","last_peered":"2023-10-08T08:42:05.159918+0000","last_clean":"2023-10-08T08:42:05.159918+0000","last_became_active":"2023-10-08T08:42:01.133040+0000","last_became_peered":"2023-10-08T08:42:01.133040+0000","last_unstale":"2023-10-08T08:42:05.159918+0000","last_undegraded":"2023-10-08T08:42:05.159918+0000","last_fullsized":"2023-10-08T08:42:05.159918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:18.054859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.166177+0000","last_change":"2023-10-08T08:42:01.128333+0000","last_active":"2023-10-08T08:42:05.166177+0000","last_peered":"2023-10-08T08:42:05.166177+0000","last_clean":"2023-10-08T08:42:05.166177+0000","last_became_active":"2023-10-08T08:42:01.128076+0000","last_became_peered":"2023-10-08T08:42:01.128076+0000","last_unstale":"2023-10-08T08:42:05.166177+0000","last_undegraded":"2023-10-08T08:42:05.166177+0000","last_fullsized":"2023-10-08T08:42:05.166177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.675185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.165166+0000","last_change":"2023-10-08T08:42:01.139518+0000","last_active":"2023-10-08T08:42:05.165166+0000","last_peered":"2023-10-08T08:42:05.165166+0000","last_clean":"2023-10-08T08:42:05.165166+0000","last_became_active":"2023-10-08T08:42:01.139217+0000","last_became_peered":"2023-10-08T08:42:01.139217+0000","last_unstale":"2023-10-08T08:42:05.165166+0000","last_undegraded":"2023-10-08T08:42:05.165166+0000","last_fullsized":"2023-10-08T08:42:05.165166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:05:02.485500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.157964+0000","last_change":"2023-10-08T08:42:01.142664+0000","last_active":"2023-10-08T08:42:05.157964+0000","last_peered":"2023-10-08T08:42:05.157964+0000","last_clean":"2023-10-08T08:42:05.157964+0000","last_became_active":"2023-10-08T08:42:01.142136+0000","last_became_peered":"2023-10-08T08:42:01.142136+0000","last_unstale":"2023-10-08T08:42:05.157964+0000","last_undegraded":"2023-10-08T08:42:05.157964+0000","last_fullsized":"2023-10-08T08:42:05.157964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:18.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T08:42:05.167363+0000","last_change":"2023-10-08T08:42:01.147551+0000","last_active":"2023-10-08T08:42:05.167363+0000","last_peered":"2023-10-08T08:42:05.167363+0000","last_clean":"2023-10-08T08:42:05.167363+0000","last_became_active":"2023-10-08T08:42:01.147187+0000","last_became_peered":"2023-10-08T08:42:01.147187+0000","last_unstale":"2023-10-08T08:42:05.167363+0000","last_undegraded":"2023-10-08T08:42:05.167363+0000","last_fullsized":"2023-10-08T08:42:05.167363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:42:25.900357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":15308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481808,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":473103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.496}]},{"osd":1,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.59999999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.436},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.745},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.53200000000000003}]},{"osd":5,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.621},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79000000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.83199999999999996}]},{"osd":10,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.77700000000000002}]}]},{"osd":10,"up_from":70,"seq":300647710739,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1572864,"data_stored":1067507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.436},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.505},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71899999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.41299999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.50700000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.63300000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.73599999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":9,"up_from":65,"seq":279172874264,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":473685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48299999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51400000000000001}]},{"osd":2,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.66300000000000003}]},{"osd":3,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.628}]},{"osd":5,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68200000000000005}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39100000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.75},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.83799999999999997}]},{"osd":10,"last update":"Sun Oct 8 08:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":8,"up_from":58,"seq":249108103196,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":473707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.68999999999999995}]},{"osd":1,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.92600000000000005}]},{"osd":2,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.622},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65200000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.878},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.755}]},{"osd":4,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77200000000000002}]},{"osd":6,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.073}]},{"osd":7,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.026}]},{"osd":9,"last update":"Sun Oct 8 08:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.147}]},{"osd":10,"last update":"Sun Oct 8 08:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.052},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":1.036}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]}]},{"osd":7,"up_from":51,"seq":219043332128,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1552384,"data_stored":1064053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63300000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.434,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73399999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55200000000000005}]},{"osd":3,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.754},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.53300000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.79600000000000004}]},{"osd":6,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64000000000000001,"15min":0.628},"min":{"1min":0.52600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82999999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71599999999999997,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94499999999999995,"5min":1.234,"15min":1.234},"last":0.90600000000000003}]},{"osd":9,"last update":"Sun Oct 8 08:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.879},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.86799999999999999}]},{"osd":10,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.84299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495651,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":954368,"data_stored":473103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.27200000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57099999999999995,"5min":0.62,"15min":0.62},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.26100000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.57599999999999996}]},{"osd":2,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.40600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.67200000000000004}]},{"osd":3,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.435,"15min":0.42499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.314,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.60699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.66100000000000003,"15min":0.624},"min":{"1min":0.45200000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":4.7670000000000003,"5min":4.7670000000000003,"15min":4.7670000000000003},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Oct 8 08:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.51700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.91900000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66700000000000004,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94699999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.70699999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93999999999999995,"5min":1.087,"15min":1.087},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54200000000000004}]},{"osd":9,"last update":"Sun Oct 8 08:41:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.747}]},{"osd":10,"last update":"Sun Oct 8 08:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.83499999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":476945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.49299999999999999,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.85599999999999998,"5min":1.242,"15min":1.242},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.44},"min":{"1min":0.40100000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.89700000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.42599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.52900000000000003,"15min":0.502},"min":{"1min":0.42399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.496}]},{"osd":3,"last update":"Sun Oct 8 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.873,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84999999999999998,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.67800000000000005}]},{"osd":4,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.41899999999999998},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39800000000000002}]},{"osd":5,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.44700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.63,"15min":0.61499999999999999},"min":{"1min":0.53200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58299999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81000000000000005,"5min":1.788,"15min":1.788},"last":0.51700000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.66300000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.629},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.70899999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.75}]},{"osd":10,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":474581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 08:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.51500000000000001},"min":{"1min":0.40400000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55900000000000005,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.92500000000000004}]},{"osd":2,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80800000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.79000000000000004}]},{"osd":3,"last update":"Sun Oct 8 08:40:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.38700000000000001},"min":{"1min":0.27200000000000002,"5min":0.251,"15min":0.251},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.41799999999999998},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.69399999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68700000000000006,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.626},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.28299999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76300000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.58499999999999996}]},{"osd":7,"last update":"Sun Oct 8 08:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.91000000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.53900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.85499999999999998}]},{"osd":9,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.872}]},{"osd":10,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.96299999999999997}]},{"osd":11,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.94199999999999995}]}]},{"osd":2,"up_from":19,"seq":81604378677,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":476979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.46800000000000003,"15min":0.45400000000000001},"min":{"1min":0.32800000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.50800000000000001,"15min":0.49399999999999999},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.86399999999999999}]},{"osd":3,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38500000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.47899999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.79200000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.53200000000000003,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53700000000000003,"15min":0.51300000000000001},"min":{"1min":0.38300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.77100000000000002}]},{"osd":5,"last update":"Sun Oct 8 08:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.45200000000000001},"min":{"1min":0.34699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.52700000000000002,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.90300000000000002}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82599999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.83199999999999996}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.91500000000000004}]},{"osd":8,"last update":"Sun Oct 8 08:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98499999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.95899999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.02},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.94699999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":1.004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.042}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149744,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":472876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.35999999999999999,"15min":0.34599999999999997},"min":{"1min":0.33300000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.38100000000000001,"15min":0.35699999999999998},"min":{"1min":0.28799999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53500000000000003,"15min":0.51200000000000001},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":0.996,"15min":0.996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.55600000000000005,"15min":0.51200000000000001},"min":{"1min":0.50800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.55700000000000005,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.624,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.61299999999999999,"15min":0.58299999999999996},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":0.66200000000000003}]},{"osd":5,"last update":"Sun Oct 8 08:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57599999999999996,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.49199999999999999,"15min":0.47499999999999998},"min":{"1min":0.40799999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.75}]},{"osd":7,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.65100000000000002},"min":{"1min":0.496,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.51400000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.76800000000000002}]},{"osd":8,"last update":"Sun Oct 8 08:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]},{"osd":9,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.877}]},{"osd":10,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.84299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920813,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":473125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67700000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77000000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.36499999999999999},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.53900000000000003,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.66900000000000004}]},{"osd":3,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.53700000000000003,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.373,"5min":0.315,"15min":0.315},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.45000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.85799999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Sun Oct 8 08:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.46300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.434,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70199999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.76000000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.84099999999999997}]},{"osd":10,"last update":"Sun Oct 8 08:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757288,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1560576,"data_stored":1063653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.50800000000000001,"15min":0.48599999999999999},"min":{"1min":0.437,"5min":0.313,"15min":0.313},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.78400000000000003}]},{"osd":1,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.871,"15min":0.871},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.74199999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.38500000000000001},"min":{"1min":0.32100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.40300000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52800000000000002,"15min":0.502},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.63200000000000001}]},{"osd":4,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.95399999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96999999999999997,"5min":1.006,"15min":1.006},"last":0.85399999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:41:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.60699999999999998,"15min":0.59499999999999997},"min":{"1min":0.41399999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90100000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.83299999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.39000000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.95499999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:41:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.94599999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.873}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T08:42:28.730 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T08:42:28.731 INFO:tasks.cephadm:Setting up client nodes... 2023-10-08T08:42:28.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-08T08:42:29.317 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:29.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] up:active 2023-10-08T08:42:29.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T08:42:29.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T08:42:29.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: Cluster is now healthy 2023-10-08T08:42:29.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2023-10-08T08:42:29.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-08T08:42:29.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: daemon mds.f is now active in filesystem cephfs as rank 4 2023-10-08T08:42:29.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:42:29.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] up:active 2023-10-08T08:42:29.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:29 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:42:29.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] up:active 2023-10-08T08:42:29.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T08:42:29.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T08:42:29.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: Cluster is now healthy 2023-10-08T08:42:29.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2023-10-08T08:42:29.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-08T08:42:29.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: daemon mds.f is now active in filesystem cephfs as rank 4 2023-10-08T08:42:29.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:42:29.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] up:active 2023-10-08T08:42:29.561 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:29 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:42:29.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] up:active 2023-10-08T08:42:29.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T08:42:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T08:42:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: Cluster is now healthy 2023-10-08T08:42:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2023-10-08T08:42:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-08T08:42:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: daemon mds.f is now active in filesystem cephfs as rank 4 2023-10-08T08:42:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:42:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] up:active 2023-10-08T08:42:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:29 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:42:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:30 smithi105 ceph-mon[103798]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:42:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:30 smithi105 ceph-mon[103798]: pgmap v249: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 3 op/s 2023-10-08T08:42:30.521 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:42:30 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: 2023-10-08T08:42:30.086+0000 7f0a3704b700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-10-08T08:42:30.521 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:42:30 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: 2023-10-08T08:42:30.086+0000 7f0a3704b700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-08T08:42:30.521 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:42:30 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: 2023-10-08T08:42:30.086+0000 7f0a3704b700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-08T08:42:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:30 smithi191 ceph-mon[104220]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:42:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:30 smithi191 ceph-mon[104220]: pgmap v249: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 3 op/s 2023-10-08T08:42:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.636+0000 7efee3aa8700 1 -- 172.21.15.70:0/1134775917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc100170 msgr2=0x7efedc10c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.636+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1134775917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc100170 0x7efedc10c590 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efed400b0a0 tx=0x7efed400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.636+0000 7efee3aa8700 1 -- 172.21.15.70:0/1134775917 shutdown_connections 2023-10-08T08:42:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.636+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1134775917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc100170 0x7efedc10c590 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.636+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1134775917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efedc1056c0 0x7efedc105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.636+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1134775917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc0ff7b0 0x7efedc0ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.636+0000 7efee3aa8700 1 -- 172.21.15.70:0/1134775917 >> 172.21.15.70:0/1134775917 conn(0x7efedc0757d0 msgr2=0x7efedc075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.636+0000 7efee3aa8700 1 -- 172.21.15.70:0/1134775917 shutdown_connections 2023-10-08T08:42:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee3aa8700 1 -- 172.21.15.70:0/1134775917 wait complete. 2023-10-08T08:42:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee3aa8700 1 Processor -- start 2023-10-08T08:42:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee3aa8700 1 -- start start 2023-10-08T08:42:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee3aa8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efedc0ff7b0 0x7efedc197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee3aa8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc100170 0x7efedc198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee3aa8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc1056c0 0x7efedc1a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee3aa8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc198910 con 0x7efedc1056c0 2023-10-08T08:42:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee3aa8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc1a30d0 con 0x7efedc100170 2023-10-08T08:42:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee3aa8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc1a3210 con 0x7efedc0ff7b0 2023-10-08T08:42:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.637+0000 7efee2045700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc1056c0 0x7efedc1a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee2045700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc1056c0 0x7efedc1a2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49550/0 (socket says 172.21.15.70:49550) 2023-10-08T08:42:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee2045700 1 -- 172.21.15.70:0/1253059693 learned_addr learned my addr 172.21.15.70:0/1253059693 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee1844700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efedc0ff7b0 0x7efedc197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee1043700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc100170 0x7efedc198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee2045700 1 -- 172.21.15.70:0/1253059693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efedc0ff7b0 msgr2=0x7efedc197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee2045700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efedc0ff7b0 0x7efedc197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee2045700 1 -- 172.21.15.70:0/1253059693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc100170 msgr2=0x7efedc198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee2045700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc100170 0x7efedc198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee2045700 1 -- 172.21.15.70:0/1253059693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4009d00 con 0x7efedc1056c0 2023-10-08T08:42:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee1043700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc100170 0x7efedc198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee2045700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc1056c0 0x7efedc1a2b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efed400b830 tx=0x7efed40077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efed2ffd700 1 -- 172.21.15.70:0/1253059693 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed400e040 con 0x7efedc1056c0 2023-10-08T08:42:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc1a3430 con 0x7efedc1056c0 2023-10-08T08:42:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efed2ffd700 1 -- 172.21.15.70:0/1253059693 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efed4004e60 con 0x7efedc1056c0 2023-10-08T08:42:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efed2ffd700 1 -- 172.21.15.70:0/1253059693 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed40053c0 con 0x7efedc1056c0 2023-10-08T08:42:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.638+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc1a38a0 con 0x7efedc1056c0 2023-10-08T08:42:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.639+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efedc107cc0 con 0x7efedc1056c0 2023-10-08T08:42:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.640+0000 7efed2ffd700 1 -- 172.21.15.70:0/1253059693 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7efed401b450 con 0x7efedc1056c0 2023-10-08T08:42:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.641+0000 7efed2ffd700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec80a14d0 0x7efec80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.641+0000 7efee1844700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec80a14d0 0x7efec80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.641+0000 7efed2ffd700 1 -- 172.21.15.70:0/1253059693 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7efed40cf0b0 con 0x7efedc1056c0 2023-10-08T08:42:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.641+0000 7efee1844700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec80a14d0 0x7efec80a3990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efecc005950 tx=0x7efecc00a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.644+0000 7efed2ffd700 1 -- 172.21.15.70:0/1253059693 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efed4098470 con 0x7efedc1056c0 2023-10-08T08:42:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:30 smithi070 ceph-mon[99513]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:42:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:30 smithi070 ceph-mon[99513]: pgmap v249: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 3 op/s 2023-10-08T08:42:30.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.911+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7efedc069500 con 0x7efedc1056c0 2023-10-08T08:42:30.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.914+0000 7efed2ffd700 1 -- 172.21.15.70:0/1253059693 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7efed409ba90 con 0x7efedc1056c0 2023-10-08T08:42:30.916 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-10-08T08:42:30.916 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQB2ayJlhZt7NhAA5mMDylx4Pp0GhLm0vsgXJg== 2023-10-08T08:42:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec80a14d0 msgr2=0x7efec80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec80a14d0 0x7efec80a3990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efecc005950 tx=0x7efecc00a300 comp rx=0 tx=0).stop 2023-10-08T08:42:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc1056c0 msgr2=0x7efedc1a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc1056c0 0x7efedc1a2b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efed400b830 tx=0x7efed40077f0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 shutdown_connections 2023-10-08T08:42:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec80a14d0 0x7efec80a3990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efedc1056c0 0x7efedc1a2b90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efedc0ff7b0 0x7efedc197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 --2- 172.21.15.70:0/1253059693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc100170 0x7efedc198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 >> 172.21.15.70:0/1253059693 conn(0x7efedc0757d0 msgr2=0x7efedc0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 shutdown_connections 2023-10-08T08:42:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:30.917+0000 7efee3aa8700 1 -- 172.21.15.70:0/1253059693 wait complete. 2023-10-08T08:42:31.280 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:42:31.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-08T08:42:31.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T08:42:31.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph config log 1 --format=json 2023-10-08T08:42:31.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:31 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1253059693' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T08:42:31.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:31 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1253059693' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T08:42:31.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:31 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1253059693' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T08:42:31.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:31 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1253059693' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T08:42:31.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:31 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1253059693' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T08:42:31.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:31 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1253059693' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T08:42:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:32.436 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:32 smithi070 ceph-mon[99513]: pgmap v250: 129 pgs: 129 active+clean; 585 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2023-10-08T08:42:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:32 smithi105 ceph-mon[103798]: pgmap v250: 129 pgs: 129 active+clean; 585 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2023-10-08T08:42:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:32 smithi191 ceph-mon[104220]: pgmap v250: 129 pgs: 129 active+clean; 585 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2023-10-08T08:42:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.119+0000 7f8afe01e700 1 -- 172.21.15.70:0/3388525149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8104720 msgr2=0x7f8af8104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.119+0000 7f8afe01e700 1 --2- 172.21.15.70:0/3388525149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8104720 0x7f8af8104b00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009990 tx=0x7f8aec009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.119+0000 7f8afe01e700 1 -- 172.21.15.70:0/3388525149 shutdown_connections 2023-10-08T08:42:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.119+0000 7f8afe01e700 1 --2- 172.21.15.70:0/3388525149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af8100c60 0x7f8af810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.119+0000 7f8afe01e700 1 --2- 172.21.15.70:0/3388525149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8104720 0x7f8af8104b00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.119+0000 7f8afe01e700 1 --2- 172.21.15.70:0/3388525149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af81002a0 0x7f8af8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.119+0000 7f8afe01e700 1 -- 172.21.15.70:0/3388525149 >> 172.21.15.70:0/3388525149 conn(0x7f8af8074a10 msgr2=0x7f8af8074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.119+0000 7f8afe01e700 1 -- 172.21.15.70:0/3388525149 shutdown_connections 2023-10-08T08:42:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.119+0000 7f8afe01e700 1 -- 172.21.15.70:0/3388525149 wait complete. 2023-10-08T08:42:33.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8afe01e700 1 Processor -- start 2023-10-08T08:42:33.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8afe01e700 1 -- start start 2023-10-08T08:42:33.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8afe01e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af81002a0 0x7f8af819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:33.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8afe01e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8100c60 0x7f8af819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:33.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8afe01e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8104720 0x7f8af81959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:33.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8afe01e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8196190 con 0x7f8af8100c60 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8afe01e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8196300 con 0x7f8af81002a0 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8afe01e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af81964c0 con 0x7f8af8104720 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8af6ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8100c60 0x7f8af819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8af6ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8100c60 0x7f8af819be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49562/0 (socket says 172.21.15.70:49562) 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.120+0000 7f8af6ffd700 1 -- 172.21.15.70:0/902082185 learned_addr learned my addr 172.21.15.70:0/902082185 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af77fe700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af81002a0 0x7f8af819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af7fff700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8104720 0x7f8af81959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af6ffd700 1 -- 172.21.15.70:0/902082185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8104720 msgr2=0x7f8af81959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af6ffd700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8104720 0x7f8af81959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af6ffd700 1 -- 172.21.15.70:0/902082185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af81002a0 msgr2=0x7f8af819b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:33.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af6ffd700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af81002a0 0x7f8af819b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af6ffd700 1 -- 172.21.15.70:0/902082185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0095f0 con 0x7f8af8100c60 2023-10-08T08:42:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af7fff700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8104720 0x7f8af81959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af6ffd700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8100c60 0x7f8af819be70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800b530 tx=0x7f8ae800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af4ff9700 1 -- 172.21.15.70:0/902082185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8011830 con 0x7f8af8100c60 2023-10-08T08:42:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af81967a0 con 0x7f8af8100c60 2023-10-08T08:42:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af4ff9700 1 -- 172.21.15.70:0/902082185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ae8011e50 con 0x7f8af8100c60 2023-10-08T08:42:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8af4ff9700 1 -- 172.21.15.70:0/902082185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800f2e0 con 0x7f8af8100c60 2023-10-08T08:42:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.121+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af81a28b0 con 0x7f8af8100c60 2023-10-08T08:42:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.122+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af8107c80 con 0x7f8af8100c60 2023-10-08T08:42:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.123+0000 7f8af4ff9700 1 -- 172.21.15.70:0/902082185 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8ae8010380 con 0x7f8af8100c60 2023-10-08T08:42:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.123+0000 7f8af4ff9700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a14d0 0x7f8ae00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.124+0000 7f8af77fe700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a14d0 0x7f8ae00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.124+0000 7f8af4ff9700 1 -- 172.21.15.70:0/902082185 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f8ae80ccbd0 con 0x7f8af8100c60 2023-10-08T08:42:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.124+0000 7f8af77fe700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a14d0 0x7f8ae00a3990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00b5c0 tx=0x7f8aec005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.128+0000 7f8af4ff9700 1 -- 172.21.15.70:0/902082185 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ae8095f60 con 0x7f8af8100c60 2023-10-08T08:42:33.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.324+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f8af8196ec0 con 0x7f8af8100c60 2023-10-08T08:42:33.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.324+0000 7f8af4ff9700 1 -- 172.21.15.70:0/902082185 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) v1 ==== 86+0+133 (secure 0 0 0) 0x7f8ae8015090 con 0x7f8af8100c60 2023-10-08T08:42:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:33.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.326+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a14d0 msgr2=0x7f8ae00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.326+0000 7f8afe01e700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a14d0 0x7f8ae00a3990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00b5c0 tx=0x7f8aec005960 comp rx=0 tx=0).stop 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.326+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8100c60 msgr2=0x7f8af819be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.326+0000 7f8afe01e700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8100c60 0x7f8af819be70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800b530 tx=0x7f8ae800b840 comp rx=0 tx=0).stop 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.326+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 shutdown_connections 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.326+0000 7f8afe01e700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a14d0 0x7f8ae00a3990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.326+0000 7f8afe01e700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8104720 0x7f8af81959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.326+0000 7f8afe01e700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af81002a0 0x7f8af819b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.327+0000 7f8afe01e700 1 --2- 172.21.15.70:0/902082185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8100c60 0x7f8af819be70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.327+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 >> 172.21.15.70:0/902082185 conn(0x7f8af8074a10 msgr2=0x7f8af80fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.327+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 shutdown_connections 2023-10-08T08:42:33.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:33.327+0000 7f8afe01e700 1 -- 172.21.15.70:0/902082185 wait complete. 2023-10-08T08:42:33.667 INFO:teuthology.orchestra.run.smithi070.stdout:[{"version":46,"timestamp":"2023-10-08T08:41:54.859409+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2023-10-08T08:42:33.668 INFO:tasks.ceph_manager:config epoch is 46 2023-10-08T08:42:33.668 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T08:42:33.668 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-08T08:42:33.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-08T08:42:34.223 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:34.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:34 smithi105 ceph-mon[103798]: pgmap v251: 129 pgs: 129 active+clean; 585 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2023-10-08T08:42:34.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:34 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/902082185' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T08:42:34.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:34 smithi191 ceph-mon[104220]: pgmap v251: 129 pgs: 129 active+clean; 585 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2023-10-08T08:42:34.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:34 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/902082185' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T08:42:34.613 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:34 smithi070 ceph-mon[99513]: pgmap v251: 129 pgs: 129 active+clean; 585 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2023-10-08T08:42:34.613 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:34 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/902082185' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T08:42:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.461+0000 7f5d565e9700 1 -- 172.21.15.70:0/1516392111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 msgr2=0x7f5d50105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.461+0000 7f5d565e9700 1 --2- 172.21.15.70:0/1516392111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 0x7f5d50105a90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009990 tx=0x7f5d44009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.461+0000 7f5d565e9700 1 -- 172.21.15.70:0/1516392111 shutdown_connections 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.461+0000 7f5d565e9700 1 --2- 172.21.15.70:0/1516392111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d50100110 0x7f5d5010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.461+0000 7f5d565e9700 1 --2- 172.21.15.70:0/1516392111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 0x7f5d50105a90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.461+0000 7f5d565e9700 1 --2- 172.21.15.70:0/1516392111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d500ff750 0x7f5d500ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.461+0000 7f5d565e9700 1 -- 172.21.15.70:0/1516392111 >> 172.21.15.70:0/1516392111 conn(0x7f5d50075790 msgr2=0x7f5d50075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.461+0000 7f5d565e9700 1 -- 172.21.15.70:0/1516392111 shutdown_connections 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.461+0000 7f5d565e9700 1 -- 172.21.15.70:0/1516392111 wait complete. 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d565e9700 1 Processor -- start 2023-10-08T08:42:35.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d565e9700 1 -- start start 2023-10-08T08:42:35.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d565e9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d500ff750 0x7f5d5019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:35.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d565e9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d50100110 0x7f5d5019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:35.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d565e9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 0x7f5d50195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:35.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d565e9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d50195f70 con 0x7f5d501056b0 2023-10-08T08:42:35.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d565e9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d501960e0 con 0x7f5d50100110 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d565e9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d501962a0 con 0x7f5d500ff750 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d54b86700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 0x7f5d50195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d54b86700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 0x7f5d50195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49576/0 (socket says 172.21.15.70:49576) 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d54b86700 1 -- 172.21.15.70:0/3829591279 learned_addr learned my addr 172.21.15.70:0/3829591279 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d4ffff700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d500ff750 0x7f5d5019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.462+0000 7f5d4f7fe700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d50100110 0x7f5d5019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d54b86700 1 -- 172.21.15.70:0/3829591279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d500ff750 msgr2=0x7f5d5019b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d54b86700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d500ff750 0x7f5d5019b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d54b86700 1 -- 172.21.15.70:0/3829591279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d50100110 msgr2=0x7f5d5019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d54b86700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d50100110 0x7f5d5019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d54b86700 1 -- 172.21.15.70:0/3829591279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d440095f0 con 0x7f5d501056b0 2023-10-08T08:42:35.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d54b86700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 0x7f5d50195910 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5d48007ee0 tx=0x7f5d4800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:35.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d4d7fa700 1 -- 172.21.15.70:0/3829591279 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48017070 con 0x7f5d501056b0 2023-10-08T08:42:35.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d4d7fa700 1 -- 172.21.15.70:0/3829591279 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d4800f040 con 0x7f5d501056b0 2023-10-08T08:42:35.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d50196580 con 0x7f5d501056b0 2023-10-08T08:42:35.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d4d7fa700 1 -- 172.21.15.70:0/3829591279 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48005580 con 0x7f5d501056b0 2023-10-08T08:42:35.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.463+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d501a27c0 con 0x7f5d501056b0 2023-10-08T08:42:35.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.464+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d50107c40 con 0x7f5d501056b0 2023-10-08T08:42:35.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.465+0000 7f5d4d7fa700 1 -- 172.21.15.70:0/3829591279 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5d48022020 con 0x7f5d501056b0 2023-10-08T08:42:35.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.466+0000 7f5d4d7fa700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5d380a1550 0x7f5d380a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:35.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.466+0000 7f5d4ffff700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5d380a1550 0x7f5d380a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:35.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.466+0000 7f5d4d7fa700 1 -- 172.21.15.70:0/3829591279 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f5d480cc5b0 con 0x7f5d501056b0 2023-10-08T08:42:35.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.466+0000 7f5d4ffff700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5d380a1550 0x7f5d380a3a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400b5c0 tx=0x7f5d44005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:35.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.469+0000 7f5d4d7fa700 1 -- 172.21.15.70:0/3829591279 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5d48095940 con 0x7f5d501056b0 2023-10-08T08:42:35.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.715+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5d50100df0 con 0x7f5d501056b0 2023-10-08T08:42:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.720+0000 7f5d4d7fa700 1 -- 172.21.15.70:0/3829591279 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v20) v1 ==== 74+0+260333 (secure 0 0 0) 0x7f5d48098f60 con 0x7f5d501056b0 2023-10-08T08:42:35.724 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5d380a1550 msgr2=0x7f5d380a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5d380a1550 0x7f5d380a3a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400b5c0 tx=0x7f5d44005960 comp rx=0 tx=0).stop 2023-10-08T08:42:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 msgr2=0x7f5d50195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 0x7f5d50195910 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5d48007ee0 tx=0x7f5d4800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 shutdown_connections 2023-10-08T08:42:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5d380a1550 0x7f5d380a3a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d501056b0 0x7f5d50195910 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d500ff750 0x7f5d5019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 --2- 172.21.15.70:0/3829591279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d50100110 0x7f5d5019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 >> 172.21.15.70:0/3829591279 conn(0x7f5d50075790 msgr2=0x7f5d500fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 shutdown_connections 2023-10-08T08:42:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:35.723+0000 7f5d565e9700 1 -- 172.21.15.70:0/3829591279 wait complete. 2023-10-08T08:42:36.176 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"active_gid":14217,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1401477652},{"type":"v1","addr":"172.21.15.70:6801","nonce":1401477652}]},"active_addr":"172.21.15.70:6801/1401477652","active_change":"2023-10-08T08:36:38.980210+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24133,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24152,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.70:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":111182972}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2897101762}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":170249253}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":549805397}]}]} 2023-10-08T08:42:36.183 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-08T08:42:36.184 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-08T08:42:36.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T08:42:36.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:36 smithi070 ceph-mon[99513]: pgmap v252: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2023-10-08T08:42:36.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:36 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3829591279' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T08:42:36.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:36 smithi105 ceph-mon[103798]: pgmap v252: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2023-10-08T08:42:36.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:36 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3829591279' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T08:42:36.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:36 smithi191 ceph-mon[104220]: pgmap v252: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2023-10-08T08:42:36.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:36 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3829591279' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T08:42:36.740 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:37.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.835+0000 7f0b244ef700 1 -- 172.21.15.70:0/1622798294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 msgr2=0x7f0b1c0ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:37.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.835+0000 7f0b244ef700 1 --2- 172.21.15.70:0/1622798294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 0x7f0b1c0ffb60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009990 tx=0x7f0b0c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.835+0000 7f0b244ef700 1 -- 172.21.15.70:0/1622798294 shutdown_connections 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.835+0000 7f0b244ef700 1 --2- 172.21.15.70:0/1622798294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c1000a0 0x7f0b1c10c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.835+0000 7f0b244ef700 1 --2- 172.21.15.70:0/1622798294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c1045b0 0x7f0b1c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.835+0000 7f0b244ef700 1 --2- 172.21.15.70:0/1622798294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 0x7f0b1c0ffb60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.835+0000 7f0b244ef700 1 -- 172.21.15.70:0/1622798294 >> 172.21.15.70:0/1622798294 conn(0x7f0b1c0766c0 msgr2=0x7f0b1c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.835+0000 7f0b244ef700 1 -- 172.21.15.70:0/1622798294 shutdown_connections 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.835+0000 7f0b244ef700 1 -- 172.21.15.70:0/1622798294 wait complete. 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b244ef700 1 Processor -- start 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b244ef700 1 -- start start 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b244ef700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 0x7f0b1c19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b244ef700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c1000a0 0x7f0b1c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:37.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b244ef700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c1045b0 0x7f0b1c195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b244ef700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c195f90 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b244ef700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c196100 con 0x7f0b1c1000a0 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b244ef700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c1962c0 con 0x7f0b1c1045b0 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b2228b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 0x7f0b1c19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b2228b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 0x7f0b1c19b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49586/0 (socket says 172.21.15.70:49586) 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b2228b700 1 -- 172.21.15.70:0/465887456 learned_addr learned my addr 172.21.15.70:0/465887456 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b21a8a700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c1000a0 0x7f0b1c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.836+0000 7f0b22a8c700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c1045b0 0x7f0b1c195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b2228b700 1 -- 172.21.15.70:0/465887456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c1045b0 msgr2=0x7f0b1c195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b2228b700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c1045b0 0x7f0b1c195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b2228b700 1 -- 172.21.15.70:0/465887456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c1000a0 msgr2=0x7f0b1c19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:37.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b2228b700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c1000a0 0x7f0b1c19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:37.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b2228b700 1 -- 172.21.15.70:0/465887456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c0095f0 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b22a8c700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c1045b0 0x7f0b1c195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:37.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b2228b700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 0x7f0b1c19b7f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800d950 tx=0x7f0b1800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:37.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b137fe700 1 -- 172.21.15.70:0/465887456 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18009940 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b137fe700 1 -- 172.21.15.70:0/465887456 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b18010460 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c1965a0 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b137fe700 1 -- 172.21.15.70:0/465887456 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800f620 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.837+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c1a27e0 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.838+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c107c20 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.839+0000 7f0b137fe700 1 -- 172.21.15.70:0/465887456 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0b180108d0 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.839+0000 7f0b137fe700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b080a14d0 0x7f0b080a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:37.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.840+0000 7f0b21a8a700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b080a14d0 0x7f0b080a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:37.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.840+0000 7f0b137fe700 1 -- 172.21.15.70:0/465887456 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f0b180cce10 con 0x7f0b1c0ff6e0 2023-10-08T08:42:37.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.840+0000 7f0b21a8a700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b080a14d0 0x7f0b080a3990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00b5c0 tx=0x7f0b0c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:37.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:37.843+0000 7f0b137fe700 1 -- 172.21.15.70:0/465887456 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0b180961a0 con 0x7f0b1c0ff6e0 2023-10-08T08:42:38.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.032+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b1c100dd0 con 0x7f0b1c0ff6e0 2023-10-08T08:42:38.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.034+0000 7f0b137fe700 1 -- 172.21.15.70:0/465887456 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24277 (secure 0 0 0) 0x7f0b18016090 con 0x7f0b1c0ff6e0 2023-10-08T08:42:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:38.035 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":86,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:05.563861+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b080a14d0 msgr2=0x7f0b080a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b080a14d0 0x7f0b080a3990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00b5c0 tx=0x7f0b0c005960 comp rx=0 tx=0).stop 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 msgr2=0x7f0b1c19b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 0x7f0b1c19b7f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800d950 tx=0x7f0b1800dc60 comp rx=0 tx=0).stop 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 shutdown_connections 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0b080a14d0 0x7f0b080a3990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c1045b0 0x7f0b1c195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c0ff6e0 0x7f0b1c19b7f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 --2- 172.21.15.70:0/465887456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c1000a0 0x7f0b1c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 >> 172.21.15.70:0/465887456 conn(0x7f0b1c0766c0 msgr2=0x7f0b1c0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:38.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 shutdown_connections 2023-10-08T08:42:38.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:38.036+0000 7f0b244ef700 1 -- 172.21.15.70:0/465887456 wait complete. 2023-10-08T08:42:38.408 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:38 smithi070 ceph-mon[99513]: pgmap v253: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2023-10-08T08:42:38.408 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:38 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/465887456' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:38.499 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-08T08:42:38.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T08:42:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:38 smithi105 ceph-mon[103798]: pgmap v253: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2023-10-08T08:42:38.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:38 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/465887456' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:38 smithi191 ceph-mon[104220]: pgmap v253: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2023-10-08T08:42:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:38 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/465887456' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:39.054 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:39.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-10-08T08:42:39.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-08T08:42:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-10-08T08:42:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2023-10-08T08:42:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-08T08:42:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2023-10-08T08:42:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2023-10-08T08:42:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2023-10-08T08:42:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-10-08T08:42:39.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:39 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]: dispatch 2023-10-08T08:42:39.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-10-08T08:42:39.534 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-08T08:42:39.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-10-08T08:42:39.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2023-10-08T08:42:39.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-08T08:42:39.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2023-10-08T08:42:39.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2023-10-08T08:42:39.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2023-10-08T08:42:39.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-10-08T08:42:39.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:39 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]: dispatch 2023-10-08T08:42:39.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-10-08T08:42:39.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-10-08T08:42:39.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-10-08T08:42:39.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]: dispatch 2023-10-08T08:42:39.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-08T08:42:39.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2023-10-08T08:42:39.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2023-10-08T08:42:39.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2023-10-08T08:42:39.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-10-08T08:42:39.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:39 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]: dispatch 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.157+0000 7fd3a0350700 1 -- 172.21.15.70:0/2499161916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3980ff190 msgr2=0x7fd3980ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.157+0000 7fd3a0350700 1 --2- 172.21.15.70:0/2499161916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3980ff190 0x7fd3980ff610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd394009990 tx=0x7fd394009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.157+0000 7fd3a0350700 1 -- 172.21.15.70:0/2499161916 shutdown_connections 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.157+0000 7fd3a0350700 1 --2- 172.21.15.70:0/2499161916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3980ffb50 0x7fd39810bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.157+0000 7fd3a0350700 1 --2- 172.21.15.70:0/2499161916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd398103e70 0x7fd398104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.157+0000 7fd3a0350700 1 --2- 172.21.15.70:0/2499161916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3980ff190 0x7fd3980ff610 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.157+0000 7fd3a0350700 1 -- 172.21.15.70:0/2499161916 >> 172.21.15.70:0/2499161916 conn(0x7fd398074a10 msgr2=0x7fd398074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.157+0000 7fd3a0350700 1 -- 172.21.15.70:0/2499161916 shutdown_connections 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.157+0000 7fd3a0350700 1 -- 172.21.15.70:0/2499161916 wait complete. 2023-10-08T08:42:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd3a0350700 1 Processor -- start 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd3a0350700 1 -- start start 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd3a0350700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3980ff190 0x7fd398100b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd3a0350700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980ffb50 0x7fd3981010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd3a0350700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd398103e70 0x7fd3981015f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd3a0350700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3981a4f90 con 0x7fd398103e70 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd3a0350700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3981a5100 con 0x7fd3980ffb50 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd3a0350700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3981a52c0 con 0x7fd3980ff190 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e8ed700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd398103e70 0x7fd3981015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e8ed700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd398103e70 0x7fd3981015f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49602/0 (socket says 172.21.15.70:49602) 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e8ed700 1 -- 172.21.15.70:0/907648428 learned_addr learned my addr 172.21.15.70:0/907648428 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e0ec700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3980ff190 0x7fd398100b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39d8eb700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980ffb50 0x7fd3981010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e8ed700 1 -- 172.21.15.70:0/907648428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3980ff190 msgr2=0x7fd398100b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e8ed700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3980ff190 0x7fd398100b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e8ed700 1 -- 172.21.15.70:0/907648428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980ffb50 msgr2=0x7fd3981010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e8ed700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980ffb50 0x7fd3981010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e8ed700 1 -- 172.21.15.70:0/907648428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940095f0 con 0x7fd398103e70 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.158+0000 7fd39e8ed700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd398103e70 0x7fd3981015f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd390007d70 tx=0x7fd39000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.159+0000 7fd38f7fe700 1 -- 172.21.15.70:0/907648428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39000ad40 con 0x7fd398103e70 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.159+0000 7fd38f7fe700 1 -- 172.21.15.70:0/907648428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3900128e0 con 0x7fd398103e70 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.159+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3981a55a0 con 0x7fd398103e70 2023-10-08T08:42:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.159+0000 7fd38f7fe700 1 -- 172.21.15.70:0/907648428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3900116b0 con 0x7fd398103e70 2023-10-08T08:42:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.159+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3981a5aa0 con 0x7fd398103e70 2023-10-08T08:42:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.160+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3981093a0 con 0x7fd398103e70 2023-10-08T08:42:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.161+0000 7fd38f7fe700 1 -- 172.21.15.70:0/907648428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd390012420 con 0x7fd398103e70 2023-10-08T08:42:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.161+0000 7fd38f7fe700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3840a1550 0x7fd3840a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.161+0000 7fd38f7fe700 1 -- 172.21.15.70:0/907648428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd3900cd740 con 0x7fd398103e70 2023-10-08T08:42:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.161+0000 7fd39e0ec700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3840a1550 0x7fd3840a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.162+0000 7fd39e0ec700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3840a1550 0x7fd3840a3a10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd398077270 tx=0x7fd38800b510 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.165+0000 7fd38f7fe700 1 -- 172.21.15.70:0/907648428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd3900969b0 con 0x7fd398103e70 2023-10-08T08:42:40.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.360+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3981005b0 con 0x7fd398103e70 2023-10-08T08:42:40.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.362+0000 7fd38f7fe700 1 -- 172.21.15.70:0/907648428 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7fd390099fd0 con 0x7fd398103e70 2023-10-08T08:42:40.363 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:42:40.363 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:42:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3840a1550 msgr2=0x7fd3840a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3840a1550 0x7fd3840a3a10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd398077270 tx=0x7fd38800b510 comp rx=0 tx=0).stop 2023-10-08T08:42:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd398103e70 msgr2=0x7fd3981015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd398103e70 0x7fd3981015f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd390007d70 tx=0x7fd39000a340 comp rx=0 tx=0).stop 2023-10-08T08:42:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 shutdown_connections 2023-10-08T08:42:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd3840a1550 0x7fd3840a3a10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd398103e70 0x7fd3981015f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3980ff190 0x7fd398100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 --2- 172.21.15.70:0/907648428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980ffb50 0x7fd3981010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:40.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 >> 172.21.15.70:0/907648428 conn(0x7fd398074a10 msgr2=0x7fd3980fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:40.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 shutdown_connections 2023-10-08T08:42:40.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:40.364+0000 7fd3a0350700 1 -- 172.21.15.70:0/907648428 wait complete. 2023-10-08T08:42:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: pgmap v254: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 21 op/s 2023-10-08T08:42:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-10-08T08:42:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-08T08:42:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-10-08T08:42:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2023-10-08T08:42:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-08T08:42:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2023-10-08T08:42:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2023-10-08T08:42:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2023-10-08T08:42:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-10-08T08:42:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]': finished 2023-10-08T08:42:40.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:40 smithi105 ceph-mon[103798]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T08:42:40.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: pgmap v254: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 21 op/s 2023-10-08T08:42:40.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]': finished 2023-10-08T08:42:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:40 smithi191 ceph-mon[104220]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T08:42:40.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: pgmap v254: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.5 KiB/s wr, 21 op/s 2023-10-08T08:42:40.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-10-08T08:42:40.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-10-08T08:42:40.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-10-08T08:42:40.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2023-10-08T08:42:40.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-08T08:42:40.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2023-10-08T08:42:40.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2023-10-08T08:42:40.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2023-10-08T08:42:40.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-10-08T08:42:40.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]': finished 2023-10-08T08:42:40.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:40 smithi070 ceph-mon[99513]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T08:42:40.720 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-08T08:42:40.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-08T08:42:40.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-08T08:42:40.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-08T08:42:40.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-08T08:42:40.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-08T08:42:40.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-08T08:42:40.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-08T08:42:40.724 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-08T08:42:40.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-08T08:42:40.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-08T08:42:40.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-08T08:42:41.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:41 smithi191 ceph-mon[104220]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T08:42:41.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:41 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/907648428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:41.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:41 smithi070 ceph-mon[99513]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T08:42:41.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:41 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/907648428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:41.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:41 smithi105 ceph-mon[103798]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T08:42:41.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:41 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/907648428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:42:41.826 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:42.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:42 smithi070 ceph-mon[99513]: pgmap v257: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 383 B/s wr, 15 op/s 2023-10-08T08:42:42.386 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:42.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:42 smithi191 ceph-mon[104220]: pgmap v257: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 383 B/s wr, 15 op/s 2023-10-08T08:42:42.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:42 smithi105 ceph-mon[103798]: pgmap v257: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 383 B/s wr, 15 op/s 2023-10-08T08:42:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:43.782 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:43.926 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:44.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 -- 172.21.15.70:0/886863123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8581008a0 msgr2=0x7fb858100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:44.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 --2- 172.21.15.70:0/886863123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8581008a0 0x7fb858100d20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009990 tx=0x7fb84c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:44.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 -- 172.21.15.70:0/886863123 shutdown_connections 2023-10-08T08:42:44.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 --2- 172.21.15.70:0/886863123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb858101260 0x7fb85810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:44.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 --2- 172.21.15.70:0/886863123 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8581057c0 0x7fb858105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:44.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 --2- 172.21.15.70:0/886863123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8581008a0 0x7fb858100d20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:44.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 -- 172.21.15.70:0/886863123 >> 172.21.15.70:0/886863123 conn(0x7fb8580779e0 msgr2=0x7fb858077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:44.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 -- 172.21.15.70:0/886863123 shutdown_connections 2023-10-08T08:42:44.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 -- 172.21.15.70:0/886863123 wait complete. 2023-10-08T08:42:44.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 Processor -- start 2023-10-08T08:42:44.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.158+0000 7fb85e320700 1 -- start start 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85e320700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8581008a0 0x7fb85819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85e320700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb858101260 0x7fb85819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85e320700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8581057c0 0x7fb858196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85e320700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb858197130 con 0x7fb8581057c0 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85e320700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8581972a0 con 0x7fb858101260 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85e320700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb858197460 con 0x7fb8581008a0 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85c8bd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8581057c0 0x7fb858196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85c8bd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8581057c0 0x7fb858196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49614/0 (socket says 172.21.15.70:49614) 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85c8bd700 1 -- 172.21.15.70:0/3238558096 learned_addr learned my addr 172.21.15.70:0/3238558096 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb8577fe700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb858101260 0x7fb85819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb857fff700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8581008a0 0x7fb85819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85c8bd700 1 -- 172.21.15.70:0/3238558096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8581008a0 msgr2=0x7fb85819c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85c8bd700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8581008a0 0x7fb85819c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85c8bd700 1 -- 172.21.15.70:0/3238558096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb858101260 msgr2=0x7fb85819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85c8bd700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb858101260 0x7fb85819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85c8bd700 1 -- 172.21.15.70:0/3238558096 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c0095f0 con 0x7fb8581057c0 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.159+0000 7fb85c8bd700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8581057c0 0x7fb858196ad0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb85000cca0 tx=0x7fb85000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.160+0000 7fb8557fa700 1 -- 172.21.15.70:0/3238558096 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000aba0 con 0x7fb8581057c0 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.160+0000 7fb8557fa700 1 -- 172.21.15.70:0/3238558096 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb85000ad00 con 0x7fb8581057c0 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.160+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb858197740 con 0x7fb8581057c0 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.160+0000 7fb8557fa700 1 -- 172.21.15.70:0/3238558096 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500115e0 con 0x7fb8581057c0 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.160+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8581a3980 con 0x7fb8581057c0 2023-10-08T08:42:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.160+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb858110a30 con 0x7fb8581057c0 2023-10-08T08:42:44.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.162+0000 7fb8557fa700 1 -- 172.21.15.70:0/3238558096 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb850012420 con 0x7fb8581057c0 2023-10-08T08:42:44.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.162+0000 7fb8557fa700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb8400a1550 0x7fb8400a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:44.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.162+0000 7fb857fff700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb8400a1550 0x7fb8400a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:44.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.162+0000 7fb8557fa700 1 -- 172.21.15.70:0/3238558096 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fb8500cd880 con 0x7fb8581057c0 2023-10-08T08:42:44.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.163+0000 7fb8557fa700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] conn(0x7fb8400ac700 0x7fb8400aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:44.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.163+0000 7fb8557fa700 1 -- 172.21.15.70:0/3238558096 --> [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8400af270 con 0x7fb8400ac700 2023-10-08T08:42:44.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.163+0000 7fb8557fa700 1 -- 172.21.15.70:0/3238558096 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8500cdc90 con 0x7fb8581057c0 2023-10-08T08:42:44.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.163+0000 7fb857fff700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb8400a1550 0x7fb8400a3a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb848005950 tx=0x7fb8480058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:44.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.163+0000 7fb8577fe700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] conn(0x7fb8400ac700 0x7fb8400aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:44.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.163+0000 7fb8577fe700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] conn(0x7fb8400ac700 0x7fb8400aeba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:44.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.164+0000 7fb8557fa700 1 -- 172.21.15.70:0/3238558096 <== osd.1 v2:172.21.15.105:6800/898277124 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb8400af270 con 0x7fb8400ac700 2023-10-08T08:42:44.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.180+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 --> [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb858060e70 con 0x7fb8400ac700 2023-10-08T08:42:44.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.180+0000 7fb8557fa700 1 -- 172.21.15.70:0/3238558096 <== osd.1 v2:172.21.15.105:6800/898277124 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb858060e70 con 0x7fb8400ac700 2023-10-08T08:42:44.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.180+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 >> [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] conn(0x7fb8400ac700 msgr2=0x7fb8400aeba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:44.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.180+0000 7fb85e320700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] conn(0x7fb8400ac700 0x7fb8400aeba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:44.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.181+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb8400a1550 msgr2=0x7fb8400a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:44.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.181+0000 7fb85e320700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb8400a1550 0x7fb8400a3a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb848005950 tx=0x7fb8480058e0 comp rx=0 tx=0).stop 2023-10-08T08:42:44.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.181+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8581057c0 msgr2=0x7fb858196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:44.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.181+0000 7fb85e320700 1 --2- 172.21.15.70:0/3238558096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8581057c0 0x7fb858196ad0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb85000cca0 tx=0x7fb85000a060 comp rx=0 tx=0).stop 2023-10-08T08:42:44.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.181+0000 7fb85c8bd700 1 -- 172.21.15.70:0/3238558096 reap_dead start 2023-10-08T08:42:44.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.181+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 shutdown_connections 2023-10-08T08:42:44.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.181+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 >> 172.21.15.70:0/3238558096 conn(0x7fb8580779e0 msgr2=0x7fb8580fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:44.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.181+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 shutdown_connections 2023-10-08T08:42:44.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:44.181+0000 7fb85e320700 1 -- 172.21.15.70:0/3238558096 wait complete. 2023-10-08T08:42:44.458 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:44.460 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:44 smithi070 ceph-mon[99513]: pgmap v258: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:44.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:44 smithi191 ceph-mon[104220]: pgmap v258: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:44.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:44 smithi105 ceph-mon[103798]: pgmap v258: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 -- 172.21.15.70:0/332918460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f814c068b30 msgr2=0x7f814c10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 --2- 172.21.15.70:0/332918460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f814c068b30 0x7f814c10d690 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f814400b0a0 tx=0x7f814400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 -- 172.21.15.70:0/332918460 shutdown_connections 2023-10-08T08:42:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 --2- 172.21.15.70:0/332918460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f814c068b30 0x7f814c10d690 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 --2- 172.21.15.70:0/332918460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f814c1067c0 0x7f814c106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 --2- 172.21.15.70:0/332918460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814c068190 0x7f814c0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 -- 172.21.15.70:0/332918460 >> 172.21.15.70:0/332918460 conn(0x7f814c075790 msgr2=0x7f814c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 -- 172.21.15.70:0/332918460 shutdown_connections 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 -- 172.21.15.70:0/332918460 wait complete. 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 Processor -- start 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.319+0000 7f81535b2700 1 -- start start 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81535b2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814c068190 0x7f814c196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81535b2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f814c068b30 0x7f814c1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81535b2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f814c1067c0 0x7f814c19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81535b2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c19bd60 con 0x7f814c1067c0 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81535b2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c19bed0 con 0x7f814c068190 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81535b2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c19c090 con 0x7f814c068b30 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8151b4f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f814c1067c0 0x7f814c19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8151b4f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f814c1067c0 0x7f814c19b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49630/0 (socket says 172.21.15.70:49630) 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8151b4f700 1 -- 172.21.15.70:0/3777364550 learned_addr learned my addr 172.21.15.70:0/3777364550 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8150b4d700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f814c068b30 0x7f814c1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f815134e700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814c068190 0x7f814c196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8151b4f700 1 -- 172.21.15.70:0/3777364550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f814c068b30 msgr2=0x7f814c1973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8151b4f700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f814c068b30 0x7f814c1973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8151b4f700 1 -- 172.21.15.70:0/3777364550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814c068190 msgr2=0x7f814c196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8151b4f700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814c068190 0x7f814c196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8151b4f700 1 -- 172.21.15.70:0/3777364550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144009d00 con 0x7f814c1067c0 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f815134e700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814c068190 0x7f814c196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f8151b4f700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f814c1067c0 0x7f814c19b750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f81440077f0 tx=0x7f81440078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81427fc700 1 -- 172.21.15.70:0/3777364550 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400e040 con 0x7f814c1067c0 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81427fc700 1 -- 172.21.15.70:0/3777364550 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81440094c0 con 0x7f814c1067c0 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c19c310 con 0x7f814c1067c0 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81427fc700 1 -- 172.21.15.70:0/3777364550 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814401b780 con 0x7f814c1067c0 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.320+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814c1a3bd0 con 0x7f814c1067c0 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.321+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f814c19c5f0 con 0x7f814c1067c0 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.322+0000 7f81427fc700 1 -- 172.21.15.70:0/3777364550 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f814401d9d0 con 0x7f814c1067c0 2023-10-08T08:42:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.323+0000 7f81427fc700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81380a14d0 0x7f81380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.323+0000 7f815134e700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81380a14d0 0x7f81380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.323+0000 7f81427fc700 1 -- 172.21.15.70:0/3777364550 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f81440cf370 con 0x7f814c1067c0 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.323+0000 7f81427fc700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] conn(0x7f81380ac680 0x7f81380aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.323+0000 7f81427fc700 1 -- 172.21.15.70:0/3777364550 --> [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81380af1f0 con 0x7f81380ac680 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.323+0000 7f81427fc700 1 -- 172.21.15.70:0/3777364550 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81440cf780 con 0x7f814c1067c0 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.323+0000 7f8150b4d700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] conn(0x7f81380ac680 0x7f81380aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.323+0000 7f815134e700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81380a14d0 0x7f81380a3990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8148007900 tx=0x7f8148008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.324+0000 7f8150b4d700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] conn(0x7f81380ac680 0x7f81380aeb20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.324+0000 7f81427fc700 1 -- 172.21.15.70:0/3777364550 <== osd.6 v2:172.21.15.70:6818/2512675210 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f81380af1f0 con 0x7f81380ac680 2023-10-08T08:42:45.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.340+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 --> [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f814c110b20 con 0x7f81380ac680 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.340+0000 7f81427fc700 1 -- 172.21.15.70:0/3777364550 <== osd.6 v2:172.21.15.70:6818/2512675210 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f813c0099e0 con 0x7f81380ac680 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] conn(0x7f81380ac680 msgr2=0x7f81380aeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] conn(0x7f81380ac680 0x7f81380aeb20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81380a14d0 msgr2=0x7f81380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81380a14d0 0x7f81380a3990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8148007900 tx=0x7f8148008040 comp rx=0 tx=0).stop 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f814c1067c0 msgr2=0x7f814c19b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 --2- 172.21.15.70:0/3777364550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f814c1067c0 0x7f814c19b750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f81440077f0 tx=0x7f81440078d0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f8151b4f700 1 -- 172.21.15.70:0/3777364550 reap_dead start 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 shutdown_connections 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 >> 172.21.15.70:0/3777364550 conn(0x7f814c075790 msgr2=0x7f814c0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 shutdown_connections 2023-10-08T08:42:45.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.341+0000 7f81535b2700 1 -- 172.21.15.70:0/3777364550 wait complete. 2023-10-08T08:42:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:45.771 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:45.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.888+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3529523070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe841056b0 msgr2=0x7fbe84105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.888+0000 7fbe8b56f700 1 --2- 172.21.15.70:0/3529523070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe841056b0 0x7fbe84105a90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009990 tx=0x7fbe74009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.888+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3529523070 shutdown_connections 2023-10-08T08:42:45.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.888+0000 7fbe8b56f700 1 --2- 172.21.15.70:0/3529523070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe84100110 0x7fbe8410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.888+0000 7fbe8b56f700 1 --2- 172.21.15.70:0/3529523070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe841056b0 0x7fbe84105a90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.888+0000 7fbe8b56f700 1 --2- 172.21.15.70:0/3529523070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe840ff750 0x7fbe840ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.888+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3529523070 >> 172.21.15.70:0/3529523070 conn(0x7fbe84075790 msgr2=0x7fbe84075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:45.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.889+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3529523070 shutdown_connections 2023-10-08T08:42:45.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.889+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3529523070 wait complete. 2023-10-08T08:42:45.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.889+0000 7fbe8b56f700 1 Processor -- start 2023-10-08T08:42:45.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.889+0000 7fbe8b56f700 1 -- start start 2023-10-08T08:42:45.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe8b56f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe840ff750 0x7fbe8419b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe8b56f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe84100110 0x7fbe8419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe8b56f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe841056b0 0x7fbe841959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe8b56f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84196000 con 0x7fbe84100110 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe8b56f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84196170 con 0x7fbe840ff750 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe8b56f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84196330 con 0x7fbe841056b0 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe88b0a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe84100110 0x7fbe8419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe88b0a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe84100110 0x7fbe8419bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49644/0 (socket says 172.21.15.70:49644) 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe88b0a700 1 -- 172.21.15.70:0/3839951277 learned_addr learned my addr 172.21.15.70:0/3839951277 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe89b0c700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe841056b0 0x7fbe841959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe8930b700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe840ff750 0x7fbe8419b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe88b0a700 1 -- 172.21.15.70:0/3839951277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe841056b0 msgr2=0x7fbe841959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe88b0a700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe841056b0 0x7fbe841959a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe88b0a700 1 -- 172.21.15.70:0/3839951277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe840ff750 msgr2=0x7fbe8419b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe88b0a700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe840ff750 0x7fbe8419b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe88b0a700 1 -- 172.21.15.70:0/3839951277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe740095f0 con 0x7fbe84100110 2023-10-08T08:42:45.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe88b0a700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe84100110 0x7fbe8419bda0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000d950 tx=0x7fbe8000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:45.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe7a7fc700 1 -- 172.21.15.70:0/3839951277 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80009b40 con 0x7fbe84100110 2023-10-08T08:42:45.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.890+0000 7fbe7a7fc700 1 -- 172.21.15.70:0/3839951277 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe80009ca0 con 0x7fbe84100110 2023-10-08T08:42:45.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.891+0000 7fbe7a7fc700 1 -- 172.21.15.70:0/3839951277 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000f620 con 0x7fbe84100110 2023-10-08T08:42:45.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.891+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe84196610 con 0x7fbe84100110 2023-10-08T08:42:45.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.891+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe841a2850 con 0x7fbe84100110 2023-10-08T08:42:45.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.891+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe8410f920 con 0x7fbe84100110 2023-10-08T08:42:45.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.893+0000 7fbe7a7fc700 1 -- 172.21.15.70:0/3839951277 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fbe80010460 con 0x7fbe84100110 2023-10-08T08:42:45.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.893+0000 7fbe7a7fc700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbe700a1550 0x7fbe700a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.893+0000 7fbe8930b700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbe700a1550 0x7fbe700a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.893+0000 7fbe7a7fc700 1 -- 172.21.15.70:0/3839951277 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fbe800cd590 con 0x7fbe84100110 2023-10-08T08:42:45.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.893+0000 7fbe7a7fc700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] conn(0x7fbe700ac700 0x7fbe700aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:45.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.893+0000 7fbe7a7fc700 1 -- 172.21.15.70:0/3839951277 --> [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe700af270 con 0x7fbe700ac700 2023-10-08T08:42:45.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.893+0000 7fbe7a7fc700 1 -- 172.21.15.70:0/3839951277 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe800cd9a0 con 0x7fbe84100110 2023-10-08T08:42:45.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.894+0000 7fbe8930b700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbe700a1550 0x7fbe700a3a10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe74005850 tx=0x7fbe7401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:45.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.894+0000 7fbe89b0c700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] conn(0x7fbe700ac700 0x7fbe700aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:45.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.894+0000 7fbe89b0c700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] conn(0x7fbe700ac700 0x7fbe700aeba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:45.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.895+0000 7fbe7a7fc700 1 -- 172.21.15.70:0/3839951277 <== osd.9 v2:172.21.15.70:6826/4105424601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbe700af270 con 0x7fbe700ac700 2023-10-08T08:42:45.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 --> [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe84060ef0 con 0x7fbe700ac700 2023-10-08T08:42:45.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe7a7fc700 1 -- 172.21.15.70:0/3839951277 <== osd.9 v2:172.21.15.70:6826/4105424601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbe84060ef0 con 0x7fbe700ac700 2023-10-08T08:42:45.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] conn(0x7fbe700ac700 msgr2=0x7fbe700aeba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] conn(0x7fbe700ac700 0x7fbe700aeba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbe700a1550 msgr2=0x7fbe700a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbe700a1550 0x7fbe700a3a10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe74005850 tx=0x7fbe7401a040 comp rx=0 tx=0).stop 2023-10-08T08:42:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe84100110 msgr2=0x7fbe8419bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 --2- 172.21.15.70:0/3839951277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe84100110 0x7fbe8419bda0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000d950 tx=0x7fbe8000dd10 comp rx=0 tx=0).stop 2023-10-08T08:42:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe89b0c700 1 -- 172.21.15.70:0/3839951277 reap_dead start 2023-10-08T08:42:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 shutdown_connections 2023-10-08T08:42:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 >> 172.21.15.70:0/3839951277 conn(0x7fbe84075790 msgr2=0x7fbe840fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 shutdown_connections 2023-10-08T08:42:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:45.911+0000 7fbe8b56f700 1 -- 172.21.15.70:0/3839951277 wait complete. 2023-10-08T08:42:45.986 INFO:teuthology.orchestra.run.smithi070.stdout:60129542205 2023-10-08T08:42:45.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-08T08:42:46.410 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:46.448 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:46 smithi070 ceph-mon[99513]: pgmap v259: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:46.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:46 smithi191 ceph-mon[104220]: pgmap v259: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:46 smithi105 ceph-mon[103798]: pgmap v259: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:46.834 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:46.905 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:47.204 INFO:teuthology.orchestra.run.smithi070.stdout:279172874269 2023-10-08T08:42:47.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-08T08:42:47.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.306+0000 7fd75c0e0700 1 -- 172.21.15.70:0/256163983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7540ffb30 msgr2=0x7fd75410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.306+0000 7fd75c0e0700 1 --2- 172.21.15.70:0/256163983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7540ffb30 0x7fd75410d5c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00b0a0 tx=0x7fd74c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.306+0000 7fd75c0e0700 1 -- 172.21.15.70:0/256163983 shutdown_connections 2023-10-08T08:42:47.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.306+0000 7fd75c0e0700 1 --2- 172.21.15.70:0/256163983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7540ffb30 0x7fd75410d5c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.306+0000 7fd75c0e0700 1 --2- 172.21.15.70:0/256163983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7541058d0 0x7fd754105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.306+0000 7fd75c0e0700 1 --2- 172.21.15.70:0/256163983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7540ff190 0x7fd7540ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.306+0000 7fd75c0e0700 1 -- 172.21.15.70:0/256163983 >> 172.21.15.70:0/256163983 conn(0x7fd754074a10 msgr2=0x7fd754074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:47.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.306+0000 7fd75c0e0700 1 -- 172.21.15.70:0/256163983 shutdown_connections 2023-10-08T08:42:47.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.306+0000 7fd75c0e0700 1 -- 172.21.15.70:0/256163983 wait complete. 2023-10-08T08:42:47.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75c0e0700 1 Processor -- start 2023-10-08T08:42:47.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75c0e0700 1 -- start start 2023-10-08T08:42:47.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75c0e0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7540ff190 0x7fd754100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75c0e0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7540ffb30 0x7fd7541008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75c0e0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7541058d0 0x7fd754100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75c0e0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541a5090 con 0x7fd7540ffb30 2023-10-08T08:42:47.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75c0e0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541a5200 con 0x7fd7541058d0 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75c0e0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541a53c0 con 0x7fd7540ff190 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75967b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7540ffb30 0x7fd7541008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75967b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7540ffb30 0x7fd7541008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49658/0 (socket says 172.21.15.70:49658) 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75967b700 1 -- 172.21.15.70:0/758973976 learned_addr learned my addr 172.21.15.70:0/758973976 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd75a67d700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7541058d0 0x7fd754100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.307+0000 7fd759e7c700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7540ff190 0x7fd754100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd75967b700 1 -- 172.21.15.70:0/758973976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7540ff190 msgr2=0x7fd754100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd75967b700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd7540ff190 0x7fd754100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd75967b700 1 -- 172.21.15.70:0/758973976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7541058d0 msgr2=0x7fd754100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd75967b700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7541058d0 0x7fd754100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd75967b700 1 -- 172.21.15.70:0/758973976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c009d00 con 0x7fd7540ffb30 2023-10-08T08:42:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd75967b700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7540ffb30 0x7fd7541008b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd74400d950 tx=0x7fd74400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd74affd700 1 -- 172.21.15.70:0/758973976 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744009b40 con 0x7fd7540ffb30 2023-10-08T08:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd74affd700 1 -- 172.21.15.70:0/758973976 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd744009ca0 con 0x7fd7540ffb30 2023-10-08T08:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7541a56a0 con 0x7fd7540ffb30 2023-10-08T08:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd74affd700 1 -- 172.21.15.70:0/758973976 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74400f620 con 0x7fd7540ffb30 2023-10-08T08:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.308+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7541a5ba0 con 0x7fd7540ffb30 2023-10-08T08:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.309+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd754110a20 con 0x7fd7540ffb30 2023-10-08T08:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.310+0000 7fd74affd700 1 -- 172.21.15.70:0/758973976 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd744010460 con 0x7fd7540ffb30 2023-10-08T08:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.310+0000 7fd74affd700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7400a1550 0x7fd7400a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.311+0000 7fd759e7c700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7400a1550 0x7fd7400a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.311+0000 7fd74affd700 1 -- 172.21.15.70:0/758973976 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd7440cd540 con 0x7fd7540ffb30 2023-10-08T08:42:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.311+0000 7fd74affd700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] conn(0x7fd7400ac700 0x7fd7400aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.311+0000 7fd74affd700 1 -- 172.21.15.70:0/758973976 --> [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7400af270 con 0x7fd7400ac700 2023-10-08T08:42:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.311+0000 7fd74affd700 1 -- 172.21.15.70:0/758973976 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7440cfaa0 con 0x7fd7540ffb30 2023-10-08T08:42:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.311+0000 7fd759e7c700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7400a1550 0x7fd7400a3a10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd750005950 tx=0x7fd7500058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.311+0000 7fd75a67d700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] conn(0x7fd7400ac700 0x7fd7400aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.312+0000 7fd75a67d700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] conn(0x7fd7400ac700 0x7fd7400aeba0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.313+0000 7fd74affd700 1 -- 172.21.15.70:0/758973976 <== osd.8 v2:172.21.15.191:6816/1026056491 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd7400af270 con 0x7fd7400ac700 2023-10-08T08:42:47.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.329+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 --> [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd754060ef0 con 0x7fd7400ac700 2023-10-08T08:42:47.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd74affd700 1 -- 172.21.15.70:0/758973976 <== osd.8 v2:172.21.15.191:6816/1026056491 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd754060ef0 con 0x7fd7400ac700 2023-10-08T08:42:47.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 >> [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] conn(0x7fd7400ac700 msgr2=0x7fd7400aeba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] conn(0x7fd7400ac700 0x7fd7400aeba0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7400a1550 msgr2=0x7fd7400a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd7400a1550 0x7fd7400a3a10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd750005950 tx=0x7fd7500058e0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7540ffb30 msgr2=0x7fd7541008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 --2- 172.21.15.70:0/758973976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7540ffb30 0x7fd7541008b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd74400d950 tx=0x7fd74400dd10 comp rx=0 tx=0).stop 2023-10-08T08:42:47.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75a67d700 1 -- 172.21.15.70:0/758973976 reap_dead start 2023-10-08T08:42:47.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 shutdown_connections 2023-10-08T08:42:47.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 >> 172.21.15.70:0/758973976 conn(0x7fd754074a10 msgr2=0x7fd7540fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:47.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 shutdown_connections 2023-10-08T08:42:47.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.330+0000 7fd75c0e0700 1 -- 172.21.15.70:0/758973976 wait complete. 2023-10-08T08:42:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 -- 172.21.15.70:0/2648676319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeac1056b0 msgr2=0x7efeac105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 --2- 172.21.15.70:0/2648676319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeac1056b0 0x7efeac105a90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efea0009990 tx=0x7efea0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 -- 172.21.15.70:0/2648676319 shutdown_connections 2023-10-08T08:42:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 --2- 172.21.15.70:0/2648676319 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeac100110 0x7efeac10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 --2- 172.21.15.70:0/2648676319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeac1056b0 0x7efeac105a90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 --2- 172.21.15.70:0/2648676319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0ff750 0x7efeac0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 -- 172.21.15.70:0/2648676319 >> 172.21.15.70:0/2648676319 conn(0x7efeac075790 msgr2=0x7efeac075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 -- 172.21.15.70:0/2648676319 shutdown_connections 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 -- 172.21.15.70:0/2648676319 wait complete. 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.567+0000 7efeb1f2a700 1 Processor -- start 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeb1f2a700 1 -- start start 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeb1f2a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0ff750 0x7efeac19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeb1f2a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeac100110 0x7efeac19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeb1f2a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeac1056b0 0x7efeac195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeb1f2a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac196100 con 0x7efeac1056b0 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeb1f2a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac196270 con 0x7efeac0ff750 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeb1f2a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac196430 con 0x7efeac100110 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeabfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeac1056b0 0x7efeac195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeabfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeac1056b0 0x7efeac195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49676/0 (socket says 172.21.15.70:49676) 2023-10-08T08:42:47.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeabfff700 1 -- 172.21.15.70:0/22603477 learned_addr learned my addr 172.21.15.70:0/22603477 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeab7fe700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0ff750 0x7efeac19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeaaffd700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeac100110 0x7efeac19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeabfff700 1 -- 172.21.15.70:0/22603477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeac100110 msgr2=0x7efeac19bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeabfff700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeac100110 0x7efeac19bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeabfff700 1 -- 172.21.15.70:0/22603477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0ff750 msgr2=0x7efeac19b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeabfff700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0ff750 0x7efeac19b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeabfff700 1 -- 172.21.15.70:0/22603477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00095f0 con 0x7efeac1056b0 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.568+0000 7efeabfff700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeac1056b0 0x7efeac195950 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efea4007ee0 tx=0x7efea400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.569+0000 7efea8ff9700 1 -- 172.21.15.70:0/22603477 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4017070 con 0x7efeac1056b0 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.569+0000 7efea8ff9700 1 -- 172.21.15.70:0/22603477 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efea400f040 con 0x7efeac1056b0 2023-10-08T08:42:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.569+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac196710 con 0x7efeac1056b0 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.569+0000 7efea8ff9700 1 -- 172.21.15.70:0/22603477 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4005580 con 0x7efeac1056b0 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.569+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac1a27d0 con 0x7efeac1056b0 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.569+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efeac10f910 con 0x7efeac1056b0 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.571+0000 7efea8ff9700 1 -- 172.21.15.70:0/22603477 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7efea400db20 con 0x7efeac1056b0 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.571+0000 7efea8ff9700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efe940a14d0 0x7efe940a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.571+0000 7efea8ff9700 1 -- 172.21.15.70:0/22603477 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7efea40ccf20 con 0x7efeac1056b0 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.571+0000 7efeab7fe700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efe940a14d0 0x7efe940a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.571+0000 7efea8ff9700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] conn(0x7efe940ac680 0x7efe940aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.571+0000 7efea8ff9700 1 -- 172.21.15.70:0/22603477 --> [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe940af1f0 con 0x7efe940ac680 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.571+0000 7efea8ff9700 1 -- 172.21.15.70:0/22603477 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7efea40cd330 con 0x7efeac1056b0 2023-10-08T08:42:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.572+0000 7efeab7fe700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efe940a14d0 0x7efe940a3990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efea000b5c0 tx=0x7efea0005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.572+0000 7efeaaffd700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] conn(0x7efe940ac680 0x7efe940aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.572+0000 7efeaaffd700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] conn(0x7efe940ac680 0x7efe940aeb20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.573+0000 7efea8ff9700 1 -- 172.21.15.70:0/22603477 <== osd.2 v2:172.21.15.191:6800/1578654309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efe940af1f0 con 0x7efe940ac680 2023-10-08T08:42:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.589+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 --> [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efeac060e70 con 0x7efe940ac680 2023-10-08T08:42:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efea8ff9700 1 -- 172.21.15.70:0/22603477 <== osd.2 v2:172.21.15.191:6800/1578654309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efeac060e70 con 0x7efe940ac680 2023-10-08T08:42:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 >> [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] conn(0x7efe940ac680 msgr2=0x7efe940aeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] conn(0x7efe940ac680 0x7efe940aeb20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efe940a14d0 msgr2=0x7efe940a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efe940a14d0 0x7efe940a3990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efea000b5c0 tx=0x7efea0005960 comp rx=0 tx=0).stop 2023-10-08T08:42:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeac1056b0 msgr2=0x7efeac195950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 --2- 172.21.15.70:0/22603477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeac1056b0 0x7efeac195950 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efea4007ee0 tx=0x7efea400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeabfff700 1 -- 172.21.15.70:0/22603477 reap_dead start 2023-10-08T08:42:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 shutdown_connections 2023-10-08T08:42:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 >> 172.21.15.70:0/22603477 conn(0x7efeac075790 msgr2=0x7efeac0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 shutdown_connections 2023-10-08T08:42:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:47.590+0000 7efeb1f2a700 1 -- 172.21.15.70:0/22603477 wait complete. 2023-10-08T08:42:48.162 INFO:teuthology.orchestra.run.smithi070.stdout:197568495656 2023-10-08T08:42:48.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-08T08:42:48.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:48 smithi191 ceph-mon[104220]: pgmap v260: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:48.598 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:48 smithi070 ceph-mon[99513]: pgmap v260: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:48.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.712+0000 7fec1b8cc700 1 -- 172.21.15.70:0/2166264567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec141002a0 msgr2=0x7fec14100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:48.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.712+0000 7fec1b8cc700 1 --2- 172.21.15.70:0/2166264567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec141002a0 0x7fec14100720 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fec10009990 tx=0x7fec10009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:48.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.712+0000 7fec1b8cc700 1 -- 172.21.15.70:0/2166264567 shutdown_connections 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.712+0000 7fec1b8cc700 1 --2- 172.21.15.70:0/2166264567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec14100c60 0x7fec1410c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.712+0000 7fec1b8cc700 1 --2- 172.21.15.70:0/2166264567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec14104720 0x7fec14104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.712+0000 7fec1b8cc700 1 --2- 172.21.15.70:0/2166264567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec141002a0 0x7fec14100720 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.712+0000 7fec1b8cc700 1 -- 172.21.15.70:0/2166264567 >> 172.21.15.70:0/2166264567 conn(0x7fec14074a10 msgr2=0x7fec14074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.712+0000 7fec1b8cc700 1 -- 172.21.15.70:0/2166264567 shutdown_connections 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.712+0000 7fec1b8cc700 1 -- 172.21.15.70:0/2166264567 wait complete. 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec1b8cc700 1 Processor -- start 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec1b8cc700 1 -- start start 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec1b8cc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec141002a0 0x7fec14197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec1b8cc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec14100c60 0x7fec14198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec1b8cc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec14104720 0x7fec141a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec1b8cc700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14198940 con 0x7fec14100c60 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec1b8cc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec141a3100 con 0x7fec141002a0 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec1b8cc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec141a3240 con 0x7fec14104720 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec18e67700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec14100c60 0x7fec14198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec18e67700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec14100c60 0x7fec14198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49690/0 (socket says 172.21.15.70:49690) 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec18e67700 1 -- 172.21.15.70:0/1136544205 learned_addr learned my addr 172.21.15.70:0/1136544205 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.713+0000 7fec19668700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec141002a0 0x7fec14197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec18e67700 1 -- 172.21.15.70:0/1136544205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec14104720 msgr2=0x7fec141a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec18e67700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec14104720 0x7fec141a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec18e67700 1 -- 172.21.15.70:0/1136544205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec141002a0 msgr2=0x7fec14197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec18e67700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec141002a0 0x7fec14197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec18e67700 1 -- 172.21.15.70:0/1136544205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100095f0 con 0x7fec14100c60 2023-10-08T08:42:48.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec19668700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec141002a0 0x7fec14197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:48.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec18e67700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec14100c60 0x7fec14198080 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fec10000c00 tx=0x7fec1000f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:48.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec0a7fc700 1 -- 172.21.15.70:0/1136544205 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1001d070 con 0x7fec14100c60 2023-10-08T08:42:48.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec141a3460 con 0x7fec14100c60 2023-10-08T08:42:48.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec0a7fc700 1 -- 172.21.15.70:0/1136544205 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec1000fde0 con 0x7fec14100c60 2023-10-08T08:42:48.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec0a7fc700 1 -- 172.21.15.70:0/1136544205 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10017770 con 0x7fec14100c60 2023-10-08T08:42:48.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.714+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec141a3870 con 0x7fec14100c60 2023-10-08T08:42:48.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.715+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec1410fa20 con 0x7fec14100c60 2023-10-08T08:42:48.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.716+0000 7fec0a7fc700 1 -- 172.21.15.70:0/1136544205 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fec10022aa0 con 0x7fec14100c60 2023-10-08T08:42:48.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.716+0000 7fec0a7fc700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec000a14d0 0x7fec000a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.717+0000 7fec19668700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec000a14d0 0x7fec000a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.717+0000 7fec0a7fc700 1 -- 172.21.15.70:0/1136544205 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fec100ceb30 con 0x7fec14100c60 2023-10-08T08:42:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.717+0000 7fec0a7fc700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] conn(0x7fec000ac680 0x7fec000aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.717+0000 7fec0a7fc700 1 -- 172.21.15.70:0/1136544205 --> [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec000af1f0 con 0x7fec000ac680 2023-10-08T08:42:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.717+0000 7fec0a7fc700 1 -- 172.21.15.70:0/1136544205 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec100cef40 con 0x7fec14100c60 2023-10-08T08:42:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.717+0000 7fec19668700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec000a14d0 0x7fec000a3990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fec040099d0 tx=0x7fec04008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.717+0000 7fec19e69700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] conn(0x7fec000ac680 0x7fec000aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.718+0000 7fec19e69700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] conn(0x7fec000ac680 0x7fec000aeb20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.718+0000 7fec0a7fc700 1 -- 172.21.15.70:0/1136544205 <== osd.10 v2:172.21.15.105:6824/911786652 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fec000af1f0 con 0x7fec000ac680 2023-10-08T08:42:48.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.734+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 --> [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fec14060e70 con 0x7fec000ac680 2023-10-08T08:42:48.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec0a7fc700 1 -- 172.21.15.70:0/1136544205 <== osd.10 v2:172.21.15.105:6824/911786652 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fec14060e70 con 0x7fec000ac680 2023-10-08T08:42:48.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 >> [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] conn(0x7fec000ac680 msgr2=0x7fec000aeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:48.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] conn(0x7fec000ac680 0x7fec000aeb20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:48.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec000a14d0 msgr2=0x7fec000a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:48.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec000a14d0 0x7fec000a3990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fec040099d0 tx=0x7fec04008040 comp rx=0 tx=0).stop 2023-10-08T08:42:48.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec14100c60 msgr2=0x7fec14198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:48.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 --2- 172.21.15.70:0/1136544205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec14100c60 0x7fec14198080 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fec10000c00 tx=0x7fec1000f880 comp rx=0 tx=0).stop 2023-10-08T08:42:48.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec19e69700 1 -- 172.21.15.70:0/1136544205 reap_dead start 2023-10-08T08:42:48.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 shutdown_connections 2023-10-08T08:42:48.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 >> 172.21.15.70:0/1136544205 conn(0x7fec14074a10 msgr2=0x7fec140fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:48.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 shutdown_connections 2023-10-08T08:42:48.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:48.735+0000 7fec1b8cc700 1 -- 172.21.15.70:0/1136544205 wait complete. 2023-10-08T08:42:48.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:48 smithi105 ceph-mon[103798]: pgmap v260: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:49.157 INFO:teuthology.orchestra.run.smithi070.stdout:81604378682 2023-10-08T08:42:49.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-08T08:42:50.247 INFO:teuthology.orchestra.run.smithi070.stdout:300647710744 2023-10-08T08:42:50.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-08T08:42:50.306 INFO:teuthology.orchestra.run.smithi070.stdout:249108103201 2023-10-08T08:42:50.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-08T08:42:50.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:50 smithi070 ceph-mon[99513]: pgmap v261: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:50.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.583+0000 7fe15e932700 1 -- 172.21.15.70:0/2085114759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1581056b0 msgr2=0x7fe158105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.583+0000 7fe15e932700 1 --2- 172.21.15.70:0/2085114759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1581056b0 0x7fe158105a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe148009990 tx=0x7fe148009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.584+0000 7fe15e932700 1 -- 172.21.15.70:0/2085114759 shutdown_connections 2023-10-08T08:42:50.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.584+0000 7fe15e932700 1 --2- 172.21.15.70:0/2085114759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe158100110 0x7fe15810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.584+0000 7fe15e932700 1 --2- 172.21.15.70:0/2085114759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1581056b0 0x7fe158105a90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.584+0000 7fe15e932700 1 --2- 172.21.15.70:0/2085114759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1580ff750 0x7fe1580ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.584+0000 7fe15e932700 1 -- 172.21.15.70:0/2085114759 >> 172.21.15.70:0/2085114759 conn(0x7fe158075790 msgr2=0x7fe158075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:50.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.584+0000 7fe15e932700 1 -- 172.21.15.70:0/2085114759 shutdown_connections 2023-10-08T08:42:50.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.584+0000 7fe15e932700 1 -- 172.21.15.70:0/2085114759 wait complete. 2023-10-08T08:42:50.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.584+0000 7fe15e932700 1 Processor -- start 2023-10-08T08:42:50.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.584+0000 7fe15e932700 1 -- start start 2023-10-08T08:42:50.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15e932700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1580ff750 0x7fe15819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15e932700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe158100110 0x7fe15819cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15e932700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1581056b0 0x7fe158196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15e932700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581971e0 con 0x7fe1580ff750 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15e932700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe158197350 con 0x7fe158100110 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15e932700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe158197510 con 0x7fe1581056b0 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe157fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1580ff750 0x7fe15819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe157fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1580ff750 0x7fe15819ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49702/0 (socket says 172.21.15.70:49702) 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe157fff700 1 -- 172.21.15.70:0/1667743134 learned_addr learned my addr 172.21.15.70:0/1667743134 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe1577fe700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe158100110 0x7fe15819cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15cecf700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1581056b0 0x7fe158196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe157fff700 1 -- 172.21.15.70:0/1667743134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1581056b0 msgr2=0x7fe158196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe157fff700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1581056b0 0x7fe158196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe157fff700 1 -- 172.21.15.70:0/1667743134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe158100110 msgr2=0x7fe15819cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe157fff700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe158100110 0x7fe15819cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe157fff700 1 -- 172.21.15.70:0/1667743134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1480095f0 con 0x7fe1580ff750 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15cecf700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1581056b0 0x7fe158196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe157fff700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1580ff750 0x7fe15819ca40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe14800f6a0 tx=0x7fe14800f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe1557fa700 1 -- 172.21.15.70:0/1667743134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14801d070 con 0x7fe1580ff750 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe1557fa700 1 -- 172.21.15.70:0/1667743134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe14800fbf0 con 0x7fe1580ff750 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe158197790 con 0x7fe1580ff750 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe1557fa700 1 -- 172.21.15.70:0/1667743134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148017650 con 0x7fe1580ff750 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.585+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1581a3a30 con 0x7fe1580ff750 2023-10-08T08:42:50.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.586+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe15810f9a0 con 0x7fe1580ff750 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.587+0000 7fe1557fa700 1 -- 172.21.15.70:0/1667743134 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe148022470 con 0x7fe1580ff750 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.588+0000 7fe1557fa700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1400a14d0 0x7fe1400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.588+0000 7fe1577fe700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1400a14d0 0x7fe1400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.588+0000 7fe1557fa700 1 -- 172.21.15.70:0/1667743134 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe1480cf010 con 0x7fe1580ff750 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.588+0000 7fe1557fa700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] conn(0x7fe1400ac680 0x7fe1400aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.588+0000 7fe1557fa700 1 -- 172.21.15.70:0/1667743134 --> [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1400af1f0 con 0x7fe1400ac680 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.588+0000 7fe1557fa700 1 -- 172.21.15.70:0/1667743134 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1480cf420 con 0x7fe1580ff750 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.588+0000 7fe1577fe700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1400a14d0 0x7fe1400a3990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe158198220 tx=0x7fe14c009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.589+0000 7fe15cecf700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] conn(0x7fe1400ac680 0x7fe1400aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.589+0000 7fe15cecf700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] conn(0x7fe1400ac680 0x7fe1400aeb20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:50.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.590+0000 7fe1557fa700 1 -- 172.21.15.70:0/1667743134 <== osd.11 v2:172.21.15.191:6824/1547082968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe1400af1f0 con 0x7fe1400ac680 2023-10-08T08:42:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:50 smithi191 ceph-mon[104220]: pgmap v261: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:50.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.614+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 --> [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe158100df0 con 0x7fe1400ac680 2023-10-08T08:42:50.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.615+0000 7fe1557fa700 1 -- 172.21.15.70:0/1667743134 <== osd.11 v2:172.21.15.191:6824/1547082968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe158100df0 con 0x7fe1400ac680 2023-10-08T08:42:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 >> [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] conn(0x7fe1400ac680 msgr2=0x7fe1400aeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] conn(0x7fe1400ac680 0x7fe1400aeb20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1400a14d0 msgr2=0x7fe1400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe1400a14d0 0x7fe1400a3990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe158198220 tx=0x7fe14c009190 comp rx=0 tx=0).stop 2023-10-08T08:42:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1580ff750 msgr2=0x7fe15819ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 --2- 172.21.15.70:0/1667743134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1580ff750 0x7fe15819ca40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe14800f6a0 tx=0x7fe14800f6d0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15cecf700 1 -- 172.21.15.70:0/1667743134 reap_dead start 2023-10-08T08:42:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 shutdown_connections 2023-10-08T08:42:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 >> 172.21.15.70:0/1667743134 conn(0x7fe158075790 msgr2=0x7fe158068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 shutdown_connections 2023-10-08T08:42:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.616+0000 7fe15e932700 1 -- 172.21.15.70:0/1667743134 wait complete. 2023-10-08T08:42:50.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:50 smithi105 ceph-mon[103798]: pgmap v261: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:50.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.868+0000 7fe8b2163700 1 -- 172.21.15.70:0/1305323912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8ac100110 msgr2=0x7fe8ac10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.868+0000 7fe8b2163700 1 --2- 172.21.15.70:0/1305323912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8ac100110 0x7fe8ac10c580 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400b0a0 tx=0x7fe8a400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.868+0000 7fe8b2163700 1 -- 172.21.15.70:0/1305323912 shutdown_connections 2023-10-08T08:42:50.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.868+0000 7fe8b2163700 1 --2- 172.21.15.70:0/1305323912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8ac100110 0x7fe8ac10c580 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.868+0000 7fe8b2163700 1 --2- 172.21.15.70:0/1305323912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8ac1056b0 0x7fe8ac105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.868+0000 7fe8b2163700 1 --2- 172.21.15.70:0/1305323912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8ac0ff750 0x7fe8ac0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.868+0000 7fe8b2163700 1 -- 172.21.15.70:0/1305323912 >> 172.21.15.70:0/1305323912 conn(0x7fe8ac075790 msgr2=0x7fe8ac075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.868+0000 7fe8b2163700 1 -- 172.21.15.70:0/1305323912 shutdown_connections 2023-10-08T08:42:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.868+0000 7fe8b2163700 1 -- 172.21.15.70:0/1305323912 wait complete. 2023-10-08T08:42:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.869+0000 7fe8b2163700 1 Processor -- start 2023-10-08T08:42:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.869+0000 7fe8b2163700 1 -- start start 2023-10-08T08:42:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.869+0000 7fe8b2163700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8ac0ff750 0x7fe8ac195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.869+0000 7fe8b2163700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8ac100110 0x7fe8ac195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.869+0000 7fe8b2163700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8ac1056b0 0x7fe8ac196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.869+0000 7fe8b2163700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1a5120 con 0x7fe8ac1056b0 2023-10-08T08:42:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.869+0000 7fe8b2163700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1a5290 con 0x7fe8ac100110 2023-10-08T08:42:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.869+0000 7fe8b2163700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1a5450 con 0x7fe8ac0ff750 2023-10-08T08:42:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8abfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8ac1056b0 0x7fe8ac196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8abfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8ac1056b0 0x7fe8ac196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49722/0 (socket says 172.21.15.70:49722) 2023-10-08T08:42:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8abfff700 1 -- 172.21.15.70:0/1255055065 learned_addr learned my addr 172.21.15.70:0/1255055065 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8aaffd700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8ac100110 0x7fe8ac195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8ab7fe700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8ac0ff750 0x7fe8ac195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8abfff700 1 -- 172.21.15.70:0/1255055065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8ac0ff750 msgr2=0x7fe8ac195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8abfff700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8ac0ff750 0x7fe8ac195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8abfff700 1 -- 172.21.15.70:0/1255055065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8ac100110 msgr2=0x7fe8ac195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8abfff700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8ac100110 0x7fe8ac195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8abfff700 1 -- 172.21.15.70:0/1255055065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a4009d00 con 0x7fe8ac1056b0 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8ab7fe700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8ac0ff750 0x7fe8ac195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8abfff700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8ac1056b0 0x7fe8ac196490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400b070 tx=0x7fe8a4007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8a8ff9700 1 -- 172.21.15.70:0/1255055065 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a400e040 con 0x7fe8ac1056b0 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac1a56d0 con 0x7fe8ac1056b0 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8a8ff9700 1 -- 172.21.15.70:0/1255055065 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8a4009440 con 0x7fe8ac1056b0 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8a8ff9700 1 -- 172.21.15.70:0/1255055065 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a401b450 con 0x7fe8ac1056b0 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.870+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac1a5b40 con 0x7fe8ac1056b0 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.871+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8ac10f960 con 0x7fe8ac1056b0 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.872+0000 7fe8a8ff9700 1 -- 172.21.15.70:0/1255055065 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe8a4004cf0 con 0x7fe8ac1056b0 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.873+0000 7fe8a8ff9700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe8940a14d0 0x7fe8940a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.873+0000 7fe8a8ff9700 1 -- 172.21.15.70:0/1255055065 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe8a40cf150 con 0x7fe8ac1056b0 2023-10-08T08:42:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.873+0000 7fe8ab7fe700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe8940a14d0 0x7fe8940a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.873+0000 7fe8a8ff9700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] conn(0x7fe8940ac600 0x7fe8940aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.873+0000 7fe8a8ff9700 1 -- 172.21.15.70:0/1255055065 --> [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8940af170 con 0x7fe8940ac600 2023-10-08T08:42:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.873+0000 7fe8a8ff9700 1 -- 172.21.15.70:0/1255055065 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8a40cf560 con 0x7fe8ac1056b0 2023-10-08T08:42:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.874+0000 7fe8aaffd700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] conn(0x7fe8940ac600 0x7fe8940aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.874+0000 7fe8ab7fe700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe8940a14d0 0x7fe8940a3990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe89c005fd0 tx=0x7fe89c005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.874+0000 7fe8aaffd700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] conn(0x7fe8940ac600 0x7fe8940aeaa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.875+0000 7fe8a8ff9700 1 -- 172.21.15.70:0/1255055065 <== osd.3 v2:172.21.15.70:6810/2319296502 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe8940af170 con 0x7fe8940ac600 2023-10-08T08:42:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.892+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 --> [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8ac060e70 con 0x7fe8940ac600 2023-10-08T08:42:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.892+0000 7fe8a8ff9700 1 -- 172.21.15.70:0/1255055065 <== osd.3 v2:172.21.15.70:6810/2319296502 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe8ac060e70 con 0x7fe8940ac600 2023-10-08T08:42:50.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] conn(0x7fe8940ac600 msgr2=0x7fe8940aeaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] conn(0x7fe8940ac600 0x7fe8940aeaa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe8940a14d0 msgr2=0x7fe8940a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe8940a14d0 0x7fe8940a3990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe89c005fd0 tx=0x7fe89c005db0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8ac1056b0 msgr2=0x7fe8ac196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 --2- 172.21.15.70:0/1255055065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8ac1056b0 0x7fe8ac196490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400b070 tx=0x7fe8a4007870 comp rx=0 tx=0).stop 2023-10-08T08:42:50.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8abfff700 1 -- 172.21.15.70:0/1255055065 reap_dead start 2023-10-08T08:42:50.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 shutdown_connections 2023-10-08T08:42:50.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 >> 172.21.15.70:0/1255055065 conn(0x7fe8ac075790 msgr2=0x7fe8ac0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:50.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 shutdown_connections 2023-10-08T08:42:50.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.893+0000 7fe8b2163700 1 -- 172.21.15.70:0/1255055065 wait complete. 2023-10-08T08:42:50.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.987+0000 7f23e72d5700 1 -- 172.21.15.70:0/3530674306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e0100840 msgr2=0x7f23e0100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.987+0000 7f23e72d5700 1 --2- 172.21.15.70:0/3530674306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e0100840 0x7f23e0100cc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009990 tx=0x7f23d0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.987+0000 7f23e72d5700 1 -- 172.21.15.70:0/3530674306 shutdown_connections 2023-10-08T08:42:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.987+0000 7f23e72d5700 1 --2- 172.21.15.70:0/3530674306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e0101200 0x7f23e010d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.987+0000 7f23e72d5700 1 --2- 172.21.15.70:0/3530674306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e01057a0 0x7f23e0105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.987+0000 7f23e72d5700 1 --2- 172.21.15.70:0/3530674306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e0100840 0x7f23e0100cc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.987+0000 7f23e72d5700 1 -- 172.21.15.70:0/3530674306 >> 172.21.15.70:0/3530674306 conn(0x7f23e0077950 msgr2=0x7f23e0077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.987+0000 7f23e72d5700 1 -- 172.21.15.70:0/3530674306 shutdown_connections 2023-10-08T08:42:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.987+0000 7f23e72d5700 1 -- 172.21.15.70:0/3530674306 wait complete. 2023-10-08T08:42:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e72d5700 1 Processor -- start 2023-10-08T08:42:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e72d5700 1 -- start start 2023-10-08T08:42:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e72d5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e0100840 0x7f23e019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e72d5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e0101200 0x7f23e019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e72d5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e01057a0 0x7f23e0196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e72d5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e01970e0 con 0x7f23e0101200 2023-10-08T08:42:50.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e72d5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0197250 con 0x7f23e0100840 2023-10-08T08:42:50.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e72d5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0197410 con 0x7f23e01057a0 2023-10-08T08:42:50.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e4870700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e0101200 0x7f23e019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e4870700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e0101200 0x7f23e019ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49736/0 (socket says 172.21.15.70:49736) 2023-10-08T08:42:50.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e4870700 1 -- 172.21.15.70:0/609969915 learned_addr learned my addr 172.21.15.70:0/609969915 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:50.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e5872700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e01057a0 0x7f23e0196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e5071700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e0100840 0x7f23e019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e4870700 1 -- 172.21.15.70:0/609969915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e01057a0 msgr2=0x7f23e0196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e4870700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e01057a0 0x7f23e0196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e4870700 1 -- 172.21.15.70:0/609969915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e0100840 msgr2=0x7f23e019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:50.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e4870700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e0100840 0x7f23e019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:50.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e4870700 1 -- 172.21.15.70:0/609969915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d00095f0 con 0x7f23e0101200 2023-10-08T08:42:50.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e5071700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e0100840 0x7f23e019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:50.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.988+0000 7f23e4870700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e0101200 0x7f23e019ce30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009fd0 tx=0x7f23d000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:50.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.989+0000 7f23d67fc700 1 -- 172.21.15.70:0/609969915 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d001d070 con 0x7f23e0101200 2023-10-08T08:42:50.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.989+0000 7f23d67fc700 1 -- 172.21.15.70:0/609969915 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23d0005510 con 0x7f23e0101200 2023-10-08T08:42:50.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.989+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e0197690 con 0x7f23e0101200 2023-10-08T08:42:50.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.989+0000 7f23d67fc700 1 -- 172.21.15.70:0/609969915 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0004bd0 con 0x7f23e0101200 2023-10-08T08:42:50.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.989+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e01a38e0 con 0x7f23e0101200 2023-10-08T08:42:50.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.989+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23e0110a00 con 0x7f23e0101200 2023-10-08T08:42:50.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.991+0000 7f23d67fc700 1 -- 172.21.15.70:0/609969915 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f23d0004d30 con 0x7f23e0101200 2023-10-08T08:42:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.992+0000 7f23d67fc700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a14d0 0x7f23cc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.992+0000 7f23e5071700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a14d0 0x7f23cc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.992+0000 7f23d67fc700 1 -- 172.21.15.70:0/609969915 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f23d00ce640 con 0x7f23e0101200 2023-10-08T08:42:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.992+0000 7f23d67fc700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] conn(0x7f23cc0ac600 0x7f23cc0aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.992+0000 7f23d67fc700 1 -- 172.21.15.70:0/609969915 --> [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23cc0af170 con 0x7f23cc0ac600 2023-10-08T08:42:50.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.992+0000 7f23d67fc700 1 -- 172.21.15.70:0/609969915 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23d00cea50 con 0x7f23e0101200 2023-10-08T08:42:50.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.992+0000 7f23e5872700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] conn(0x7f23cc0ac600 0x7f23cc0aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:50.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.992+0000 7f23e5071700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a14d0 0x7f23cc0a3990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009b50 tx=0x7f23dc009550 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:50.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.992+0000 7f23e5872700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] conn(0x7f23cc0ac600 0x7f23cc0aeaa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:50.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:50.993+0000 7f23d67fc700 1 -- 172.21.15.70:0/609969915 <== osd.0 v2:172.21.15.70:6802/2462488428 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f23cc0af170 con 0x7f23cc0ac600 2023-10-08T08:42:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.010+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 --> [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f23e0060e70 con 0x7f23cc0ac600 2023-10-08T08:42:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23d67fc700 1 -- 172.21.15.70:0/609969915 <== osd.0 v2:172.21.15.70:6802/2462488428 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f23e0060e70 con 0x7f23cc0ac600 2023-10-08T08:42:51.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] conn(0x7f23cc0ac600 msgr2=0x7f23cc0aeaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:51.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] conn(0x7f23cc0ac600 0x7f23cc0aeaa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:51.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a14d0 msgr2=0x7f23cc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:51.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f23cc0a14d0 0x7f23cc0a3990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009b50 tx=0x7f23dc009550 comp rx=0 tx=0).stop 2023-10-08T08:42:51.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e0101200 msgr2=0x7f23e019ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:51.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 --2- 172.21.15.70:0/609969915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23e0101200 0x7f23e019ce30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009fd0 tx=0x7f23d000f720 comp rx=0 tx=0).stop 2023-10-08T08:42:51.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e5872700 1 -- 172.21.15.70:0/609969915 reap_dead start 2023-10-08T08:42:51.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 shutdown_connections 2023-10-08T08:42:51.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 >> 172.21.15.70:0/609969915 conn(0x7f23e0077950 msgr2=0x7f23e00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:51.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 shutdown_connections 2023-10-08T08:42:51.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:51.011+0000 7f23e72d5700 1 -- 172.21.15.70:0/609969915 wait complete. 2023-10-08T08:42:51.511 INFO:teuthology.orchestra.run.smithi070.stdout:111669149750 2023-10-08T08:42:51.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-08T08:42:51.522 INFO:teuthology.orchestra.run.smithi070.stdout:330712481814 2023-10-08T08:42:51.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-08T08:42:52.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.328+0000 7fe75bf40700 1 -- 172.21.15.70:0/1195565528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7541008a0 msgr2=0x7fe754100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.328+0000 7fe75bf40700 1 --2- 172.21.15.70:0/1195565528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7541008a0 0x7fe754100d20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe748009990 tx=0x7fe748009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.328+0000 7fe75bf40700 1 -- 172.21.15.70:0/1195565528 shutdown_connections 2023-10-08T08:42:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.328+0000 7fe75bf40700 1 --2- 172.21.15.70:0/1195565528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe754101260 0x7fe75410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.328+0000 7fe75bf40700 1 --2- 172.21.15.70:0/1195565528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7541067f0 0x7fe754106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.328+0000 7fe75bf40700 1 --2- 172.21.15.70:0/1195565528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7541008a0 0x7fe754100d20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.329+0000 7fe75bf40700 1 -- 172.21.15.70:0/1195565528 >> 172.21.15.70:0/1195565528 conn(0x7fe754077910 msgr2=0x7fe754077d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.329+0000 7fe75bf40700 1 -- 172.21.15.70:0/1195565528 shutdown_connections 2023-10-08T08:42:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.329+0000 7fe75bf40700 1 -- 172.21.15.70:0/1195565528 wait complete. 2023-10-08T08:42:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.329+0000 7fe75bf40700 1 Processor -- start 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.329+0000 7fe75bf40700 1 -- start start 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe75bf40700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7541008a0 0x7fe75419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe75bf40700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe754101260 0x7fe75419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe75bf40700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7541067f0 0x7fe754196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe75bf40700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541970a0 con 0x7fe754101260 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe75bf40700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe754197210 con 0x7fe7541067f0 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe75bf40700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541973d0 con 0x7fe7541008a0 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe7594db700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe754101260 0x7fe75419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe7594db700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe754101260 0x7fe75419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49750/0 (socket says 172.21.15.70:49750) 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe7594db700 1 -- 172.21.15.70:0/1552413897 learned_addr learned my addr 172.21.15.70:0/1552413897 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:52.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe759cdc700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7541008a0 0x7fe75419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe75a4dd700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7541067f0 0x7fe754196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe7594db700 1 -- 172.21.15.70:0/1552413897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7541008a0 msgr2=0x7fe75419c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe7594db700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7541008a0 0x7fe75419c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe7594db700 1 -- 172.21.15.70:0/1552413897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7541067f0 msgr2=0x7fe754196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe7594db700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7541067f0 0x7fe754196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe7594db700 1 -- 172.21.15.70:0/1552413897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7480095f0 con 0x7fe754101260 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe7594db700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe754101260 0x7fe75419cdf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe748000c00 tx=0x7fe74800f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe752ffd700 1 -- 172.21.15.70:0/1552413897 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74801d070 con 0x7fe754101260 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe754197650 con 0x7fe754101260 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe752ffd700 1 -- 172.21.15.70:0/1552413897 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe74800fc80 con 0x7fe754101260 2023-10-08T08:42:52.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe752ffd700 1 -- 172.21.15.70:0/1552413897 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748017630 con 0x7fe754101260 2023-10-08T08:42:52.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.330+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7541a38a0 con 0x7fe754101260 2023-10-08T08:42:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.331+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7541109e0 con 0x7fe754101260 2023-10-08T08:42:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.332+0000 7fe752ffd700 1 -- 172.21.15.70:0/1552413897 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe748022470 con 0x7fe754101260 2023-10-08T08:42:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.333+0000 7fe752ffd700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe73c0a14d0 0x7fe73c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.333+0000 7fe752ffd700 1 -- 172.21.15.70:0/1552413897 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe7480cec80 con 0x7fe754101260 2023-10-08T08:42:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.333+0000 7fe759cdc700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe73c0a14d0 0x7fe73c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.333+0000 7fe752ffd700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] conn(0x7fe73c0ac680 0x7fe73c0aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.333+0000 7fe752ffd700 1 -- 172.21.15.70:0/1552413897 --> [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe73c0af1f0 con 0x7fe73c0ac680 2023-10-08T08:42:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.333+0000 7fe752ffd700 1 -- 172.21.15.70:0/1552413897 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7480cf090 con 0x7fe754101260 2023-10-08T08:42:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.333+0000 7fe759cdc700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe73c0a14d0 0x7fe73c0a3990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe744007fd0 tx=0x7fe7440079e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:52.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.333+0000 7fe75a4dd700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] conn(0x7fe73c0ac680 0x7fe73c0aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.334+0000 7fe75a4dd700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] conn(0x7fe73c0ac680 0x7fe73c0aeb20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:52.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.335+0000 7fe752ffd700 1 -- 172.21.15.70:0/1552413897 <== osd.4 v2:172.21.15.105:6808/2528806135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe73c0af1f0 con 0x7fe73c0ac680 2023-10-08T08:42:52.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.353+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 --> [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe754060e70 con 0x7fe73c0ac680 2023-10-08T08:42:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.354+0000 7fe752ffd700 1 -- 172.21.15.70:0/1552413897 <== osd.4 v2:172.21.15.105:6808/2528806135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe754060e70 con 0x7fe73c0ac680 2023-10-08T08:42:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 >> [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] conn(0x7fe73c0ac680 msgr2=0x7fe73c0aeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] conn(0x7fe73c0ac680 0x7fe73c0aeb20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe73c0a14d0 msgr2=0x7fe73c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe73c0a14d0 0x7fe73c0a3990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe744007fd0 tx=0x7fe7440079e0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe754101260 msgr2=0x7fe75419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 --2- 172.21.15.70:0/1552413897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe754101260 0x7fe75419cdf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe748000c00 tx=0x7fe74800f7d0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75a4dd700 1 -- 172.21.15.70:0/1552413897 reap_dead start 2023-10-08T08:42:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 shutdown_connections 2023-10-08T08:42:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 >> 172.21.15.70:0/1552413897 conn(0x7fe754077910 msgr2=0x7fe7540ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 shutdown_connections 2023-10-08T08:42:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.355+0000 7fe75bf40700 1 -- 172.21.15.70:0/1552413897 wait complete. 2023-10-08T08:42:52.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.466+0000 7f2300e97700 1 -- 172.21.15.70:0/2178167501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22fc0ffa40 msgr2=0x7f22fc0ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.466+0000 7f2300e97700 1 --2- 172.21.15.70:0/2178167501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22fc0ffa40 0x7f22fc0ffec0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009990 tx=0x7f22f0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.466+0000 7f2300e97700 1 -- 172.21.15.70:0/2178167501 shutdown_connections 2023-10-08T08:42:52.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.466+0000 7f2300e97700 1 --2- 172.21.15.70:0/2178167501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22fc100400 0x7f22fc10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.466+0000 7f2300e97700 1 --2- 172.21.15.70:0/2178167501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22fc1057b0 0x7f22fc105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.466+0000 7f2300e97700 1 --2- 172.21.15.70:0/2178167501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22fc0ffa40 0x7f22fc0ffec0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.466+0000 7f2300e97700 1 -- 172.21.15.70:0/2178167501 >> 172.21.15.70:0/2178167501 conn(0x7f22fc0764a0 msgr2=0x7f22fc0768b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:52.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.466+0000 7f2300e97700 1 -- 172.21.15.70:0/2178167501 shutdown_connections 2023-10-08T08:42:52.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.466+0000 7f2300e97700 1 -- 172.21.15.70:0/2178167501 wait complete. 2023-10-08T08:42:52.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f2300e97700 1 Processor -- start 2023-10-08T08:42:52.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f2300e97700 1 -- start start 2023-10-08T08:42:52.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f2300e97700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22fc0ffa40 0x7f22fc19b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f2300e97700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22fc100400 0x7f22fc19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f2300e97700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22fc1057b0 0x7f22fc195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f2300e97700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc195f70 con 0x7f22fc0ffa40 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f2300e97700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1960e0 con 0x7f22fc1057b0 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f2300e97700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1962a0 con 0x7f22fc100400 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f22fa59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22fc0ffa40 0x7f22fc19b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f22fa59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22fc0ffa40 0x7f22fc19b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49764/0 (socket says 172.21.15.70:49764) 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f22fa59c700 1 -- 172.21.15.70:0/4030063848 learned_addr learned my addr 172.21.15.70:0/4030063848 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f22f9d9b700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22fc100400 0x7f22fc19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.467+0000 7f22fad9d700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22fc1057b0 0x7f22fc195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22fa59c700 1 -- 172.21.15.70:0/4030063848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22fc100400 msgr2=0x7f22fc19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22fa59c700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22fc100400 0x7f22fc19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22fa59c700 1 -- 172.21.15.70:0/4030063848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22fc1057b0 msgr2=0x7f22fc195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22fa59c700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22fc1057b0 0x7f22fc195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22fa59c700 1 -- 172.21.15.70:0/4030063848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f00095f0 con 0x7f22fc0ffa40 2023-10-08T08:42:52.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22fad9d700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22fc1057b0 0x7f22fc195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:42:52.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22fa59c700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22fc0ffa40 0x7f22fc19b7d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00d980 tx=0x7f22ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:52.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22eb7fe700 1 -- 172.21.15.70:0/4030063848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec004220 con 0x7f22fc0ffa40 2023-10-08T08:42:52.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc196580 con 0x7f22fc0ffa40 2023-10-08T08:42:52.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22eb7fe700 1 -- 172.21.15.70:0/4030063848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22ec007640 con 0x7f22fc0ffa40 2023-10-08T08:42:52.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f22eb7fe700 1 -- 172.21.15.70:0/4030063848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec005610 con 0x7f22fc0ffa40 2023-10-08T08:42:52.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.468+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc1a27c0 con 0x7f22fc0ffa40 2023-10-08T08:42:52.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.469+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22fc10f910 con 0x7f22fc0ffa40 2023-10-08T08:42:52.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:52 smithi070 ceph-mon[99513]: pgmap v262: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:52.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.471+0000 7f22eb7fe700 1 -- 172.21.15.70:0/4030063848 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f22ec004750 con 0x7f22fc0ffa40 2023-10-08T08:42:52.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.471+0000 7f22eb7fe700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22e40a14d0 0x7f22e40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.471+0000 7f22eb7fe700 1 -- 172.21.15.70:0/4030063848 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f22ec0cd640 con 0x7f22fc0ffa40 2023-10-08T08:42:52.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.472+0000 7f22eb7fe700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] conn(0x7f22e40ae890 0x7f22e40b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.472+0000 7f22eb7fe700 1 -- 172.21.15.70:0/4030063848 --> [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22e40b1400 con 0x7f22e40ae890 2023-10-08T08:42:52.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.472+0000 7f22eb7fe700 1 -- 172.21.15.70:0/4030063848 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22ec0cda50 con 0x7f22fc0ffa40 2023-10-08T08:42:52.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.472+0000 7f22fad9d700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] conn(0x7f22e40ae890 0x7f22e40b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.473+0000 7f22f9d9b700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22e40a14d0 0x7f22e40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.473+0000 7f22fad9d700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] conn(0x7f22e40ae890 0x7f22e40b0d30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:52.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.473+0000 7f22f9d9b700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22e40a14d0 0x7f22e40a3990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22f000b5c0 tx=0x7f22f0005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:52.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.474+0000 7f22eb7fe700 1 -- 172.21.15.70:0/4030063848 <== osd.5 v2:172.21.15.191:6808/3480587463 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f22e40b1400 con 0x7f22e40ae890 2023-10-08T08:42:52.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.491+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 --> [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22fc069120 con 0x7f22e40ae890 2023-10-08T08:42:52.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.492+0000 7f22eb7fe700 1 -- 172.21.15.70:0/4030063848 <== osd.5 v2:172.21.15.191:6808/3480587463 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f22fc069120 con 0x7f22e40ae890 2023-10-08T08:42:52.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 >> [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] conn(0x7f22e40ae890 msgr2=0x7f22e40b0d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] conn(0x7f22e40ae890 0x7f22e40b0d30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22e40a14d0 msgr2=0x7f22e40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22e40a14d0 0x7f22e40a3990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22f000b5c0 tx=0x7f22f0005960 comp rx=0 tx=0).stop 2023-10-08T08:42:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22fc0ffa40 msgr2=0x7f22fc19b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 --2- 172.21.15.70:0/4030063848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22fc0ffa40 0x7f22fc19b7d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00d980 tx=0x7f22ec00dc90 comp rx=0 tx=0).stop 2023-10-08T08:42:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f22fad9d700 1 -- 172.21.15.70:0/4030063848 reap_dead start 2023-10-08T08:42:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 shutdown_connections 2023-10-08T08:42:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 >> 172.21.15.70:0/4030063848 conn(0x7f22fc0764a0 msgr2=0x7f22fc0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 shutdown_connections 2023-10-08T08:42:52.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.493+0000 7f2300e97700 1 -- 172.21.15.70:0/4030063848 wait complete. 2023-10-08T08:42:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:52 smithi191 ceph-mon[104220]: pgmap v262: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:52.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:52 smithi105 ceph-mon[103798]: pgmap v262: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 -- 172.21.15.70:0/3180329421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ff190 msgr2=0x7fa6c40ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 --2- 172.21.15.70:0/3180329421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ff190 0x7fa6c40ff5f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009990 tx=0x7fa6c0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 -- 172.21.15.70:0/3180329421 shutdown_connections 2023-10-08T08:42:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 --2- 172.21.15.70:0/3180329421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c40ffb30 0x7fa6c410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 --2- 172.21.15.70:0/3180329421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41058d0 0x7fa6c4105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 --2- 172.21.15.70:0/3180329421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ff190 0x7fa6c40ff5f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 -- 172.21.15.70:0/3180329421 >> 172.21.15.70:0/3180329421 conn(0x7fa6c4074a10 msgr2=0x7fa6c4074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 -- 172.21.15.70:0/3180329421 shutdown_connections 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 -- 172.21.15.70:0/3180329421 wait complete. 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 Processor -- start 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.750+0000 7fa6cba91700 1 -- start start 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6cba91700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c40ff190 0x7fa6c4100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6cba91700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffb30 0x7fa6c41008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6cba91700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41058d0 0x7fa6c4100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6cba91700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c41a4f70 con 0x7fa6c40ffb30 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6cba91700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c41a50e0 con 0x7fa6c41058d0 2023-10-08T08:42:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6cba91700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c41a52a0 con 0x7fa6c40ff190 2023-10-08T08:42:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c902c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffb30 0x7fa6c41008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c902c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffb30 0x7fa6c41008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49782/0 (socket says 172.21.15.70:49782) 2023-10-08T08:42:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c902c700 1 -- 172.21.15.70:0/3922108442 learned_addr learned my addr 172.21.15.70:0/3922108442 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c982d700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c40ff190 0x7fa6c4100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6ca02e700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41058d0 0x7fa6c4100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c902c700 1 -- 172.21.15.70:0/3922108442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c40ff190 msgr2=0x7fa6c4100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c902c700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6c40ff190 0x7fa6c4100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c902c700 1 -- 172.21.15.70:0/3922108442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41058d0 msgr2=0x7fa6c4100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c902c700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6c41058d0 0x7fa6c4100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c902c700 1 -- 172.21.15.70:0/3922108442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00095f0 con 0x7fa6c40ffb30 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6c902c700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffb30 0x7fa6c41008b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00098e0 tx=0x7fa6c000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6baffd700 1 -- 172.21.15.70:0/3922108442 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c001d070 con 0x7fa6c40ffb30 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6baffd700 1 -- 172.21.15.70:0/3922108442 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6c0022470 con 0x7fa6c40ffb30 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c41a5520 con 0x7fa6c40ffb30 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6baffd700 1 -- 172.21.15.70:0/3922108442 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0017650 con 0x7fa6c40ffb30 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.751+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c41a5930 con 0x7fa6c40ffb30 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.752+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6c41109a0 con 0x7fa6c40ffb30 2023-10-08T08:42:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.753+0000 7fa6baffd700 1 -- 172.21.15.70:0/3922108442 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa6c00225e0 con 0x7fa6c40ffb30 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.754+0000 7fa6baffd700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a1550 0x7fa6b00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.754+0000 7fa6c982d700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a1550 0x7fa6b00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.754+0000 7fa6baffd700 1 -- 172.21.15.70:0/3922108442 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fa6c00ce830 con 0x7fa6c40ffb30 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.754+0000 7fa6baffd700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] conn(0x7fa6b00ac700 0x7fa6b00aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.754+0000 7fa6baffd700 1 -- 172.21.15.70:0/3922108442 --> [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6b00af270 con 0x7fa6b00ac700 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.754+0000 7fa6baffd700 1 -- 172.21.15.70:0/3922108442 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6c00cebe0 con 0x7fa6c40ffb30 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.754+0000 7fa6c982d700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a1550 0x7fa6b00a3a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4068160 tx=0x7fa6b400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.754+0000 7fa6ca02e700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] conn(0x7fa6b00ac700 0x7fa6b00aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.755+0000 7fa6ca02e700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] conn(0x7fa6b00ac700 0x7fa6b00aeba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.756+0000 7fa6baffd700 1 -- 172.21.15.70:0/3922108442 <== osd.7 v2:172.21.15.105:6816/591750025 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa6b00af270 con 0x7fa6b00ac700 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.771+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 --> [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6c4060ef0 con 0x7fa6b00ac700 2023-10-08T08:42:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6baffd700 1 -- 172.21.15.70:0/3922108442 <== osd.7 v2:172.21.15.105:6816/591750025 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa6c4060ef0 con 0x7fa6b00ac700 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 >> [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] conn(0x7fa6b00ac700 msgr2=0x7fa6b00aeba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] conn(0x7fa6b00ac700 0x7fa6b00aeba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a1550 msgr2=0x7fa6b00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa6b00a1550 0x7fa6b00a3a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4068160 tx=0x7fa6b400b410 comp rx=0 tx=0).stop 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffb30 msgr2=0x7fa6c41008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 --2- 172.21.15.70:0/3922108442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6c40ffb30 0x7fa6c41008b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00098e0 tx=0x7fa6c000f670 comp rx=0 tx=0).stop 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6ca02e700 1 -- 172.21.15.70:0/3922108442 reap_dead start 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 shutdown_connections 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 >> 172.21.15.70:0/3922108442 conn(0x7fa6c4074a10 msgr2=0x7fa6c40fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 shutdown_connections 2023-10-08T08:42:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:52.772+0000 7fa6cba91700 1 -- 172.21.15.70:0/3922108442 wait complete. 2023-10-08T08:42:52.965 INFO:teuthology.orchestra.run.smithi070.stdout:163208757294 2023-10-08T08:42:52.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-08T08:42:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:53.360 INFO:teuthology.orchestra.run.smithi070.stdout:219043332134 2023-10-08T08:42:53.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-08T08:42:53.445 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:53.514 INFO:teuthology.orchestra.run.smithi070.stdout:38654705730 2023-10-08T08:42:53.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-08T08:42:53.854 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:54.043 INFO:teuthology.orchestra.run.smithi070.stdout:141733920819 2023-10-08T08:42:54.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-08T08:42:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:54.324 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:54.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:54 smithi070 ceph-mon[99513]: pgmap v263: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:54.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:54 smithi191 ceph-mon[104220]: pgmap v263: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:54.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:54 smithi105 ceph-mon[103798]: pgmap v263: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:55.383 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:55.733 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:56.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.250+0000 7f9ddeff1700 1 -- 172.21.15.70:0/1441594926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8105700 msgr2=0x7f9dd8105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:56.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.250+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/1441594926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8105700 0x7f9dd8105ae0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0099c0 tx=0x7f9dcc009cd0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.250+0000 7f9ddeff1700 1 -- 172.21.15.70:0/1441594926 shutdown_connections 2023-10-08T08:42:56.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.250+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/1441594926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd8100110 0x7f9dd810c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.250+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/1441594926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8105700 0x7f9dd8105ae0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.250+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/1441594926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dd80ff750 0x7f9dd80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.250+0000 7f9ddeff1700 1 -- 172.21.15.70:0/1441594926 >> 172.21.15.70:0/1441594926 conn(0x7f9dd8075790 msgr2=0x7f9dd8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.250+0000 7f9ddeff1700 1 -- 172.21.15.70:0/1441594926 shutdown_connections 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.250+0000 7f9ddeff1700 1 -- 172.21.15.70:0/1441594926 wait complete. 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9ddeff1700 1 Processor -- start 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9ddeff1700 1 -- start start 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9ddeff1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dd80ff750 0x7f9dd81957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9ddeff1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8100110 0x7f9dd8195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9ddeff1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd8105700 0x7f9dd8196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9ddeff1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd81a4f20 con 0x7f9dd8100110 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9ddeff1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd81a5090 con 0x7f9dd80ff750 2023-10-08T08:42:56.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9ddeff1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd81a5250 con 0x7f9dd8105700 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9dd7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8100110 0x7f9dd8195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.251+0000 7f9dd7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8100110 0x7f9dd8195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49798/0 (socket says 172.21.15.70:49798) 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd7fff700 1 -- 172.21.15.70:0/2578859971 learned_addr learned my addr 172.21.15.70:0/2578859971 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9ddcd8d700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dd80ff750 0x7f9dd81957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9ddd58e700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd8105700 0x7f9dd8196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd7fff700 1 -- 172.21.15.70:0/2578859971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd8105700 msgr2=0x7f9dd8196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd7fff700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd8105700 0x7f9dd8196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd7fff700 1 -- 172.21.15.70:0/2578859971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dd80ff750 msgr2=0x7f9dd81957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd7fff700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dd80ff750 0x7f9dd81957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd7fff700 1 -- 172.21.15.70:0/2578859971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0095f0 con 0x7f9dd8100110 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9ddcd8d700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dd80ff750 0x7f9dd81957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:42:56.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd7fff700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8100110 0x7f9dd8195d10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400e9a0 tx=0x7f9dc400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd5ffb700 1 -- 172.21.15.70:0/2578859971 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4009790 con 0x7f9dd8100110 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd5ffb700 1 -- 172.21.15.70:0/2578859971 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dc400cbd0 con 0x7f9dd8100110 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd81a5530 con 0x7f9dd8100110 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9dd5ffb700 1 -- 172.21.15.70:0/2578859971 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4018680 con 0x7f9dd8100110 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.252+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd81a5a30 con 0x7f9dd8100110 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.253+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd8107c20 con 0x7f9dd8100110 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.255+0000 7f9dd5ffb700 1 -- 172.21.15.70:0/2578859971 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f9dc400cd40 con 0x7f9dd8100110 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.255+0000 7f9dd5ffb700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9dc80a14d0 0x7f9dc80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.255+0000 7f9ddcd8d700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9dc80a14d0 0x7f9dc80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.255+0000 7f9dd5ffb700 1 -- 172.21.15.70:0/2578859971 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9dc4014070 con 0x7f9dd8100110 2023-10-08T08:42:56.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.256+0000 7f9ddcd8d700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9dc80a14d0 0x7f9dc80a3990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009fd0 tx=0x7f9dcc005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:56.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.260+0000 7f9dd5ffb700 1 -- 172.21.15.70:0/2578859971 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9dc4096910 con 0x7f9dd8100110 2023-10-08T08:42:56.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:56 smithi070 ceph-mon[99513]: pgmap v264: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:56.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.482+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9dd8100dd0 con 0x7f9dd8100110 2023-10-08T08:42:56.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.482+0000 7f9dd5ffb700 1 -- 172.21.15.70:0/2578859971 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9dc4099f30 con 0x7f9dd8100110 2023-10-08T08:42:56.483 INFO:teuthology.orchestra.run.smithi070.stdout:81604378684 2023-10-08T08:42:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9dc80a14d0 msgr2=0x7f9dc80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9dc80a14d0 0x7f9dc80a3990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009fd0 tx=0x7f9dcc005fd0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8100110 msgr2=0x7f9dd8195d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8100110 0x7f9dd8195d10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400e9a0 tx=0x7f9dc400ecb0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 shutdown_connections 2023-10-08T08:42:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9dc80a14d0 0x7f9dc80a3990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd8105700 0x7f9dd8196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dd80ff750 0x7f9dd81957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 --2- 172.21.15.70:0/2578859971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dd8100110 0x7f9dd8195d10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 >> 172.21.15.70:0/2578859971 conn(0x7f9dd8075790 msgr2=0x7f9dd80fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.484+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 shutdown_connections 2023-10-08T08:42:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.485+0000 7f9ddeff1700 1 -- 172.21.15.70:0/2578859971 wait complete. 2023-10-08T08:42:56.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:56 smithi191 ceph-mon[104220]: pgmap v264: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:56.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:56 smithi105 ceph-mon[103798]: pgmap v264: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.735+0000 7f67ce684700 1 -- 172.21.15.70:0/2515853617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068b30 msgr2=0x7f67c810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.735+0000 7f67ce684700 1 --2- 172.21.15.70:0/2515853617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068b30 0x7f67c810d670 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f67c000b0a0 tx=0x7f67c000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.735+0000 7f67ce684700 1 -- 172.21.15.70:0/2515853617 shutdown_connections 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.735+0000 7f67ce684700 1 --2- 172.21.15.70:0/2515853617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068b30 0x7f67c810d670 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.735+0000 7f67ce684700 1 --2- 172.21.15.70:0/2515853617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67c81067a0 0x7f67c8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.735+0000 7f67ce684700 1 --2- 172.21.15.70:0/2515853617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c8068190 0x7f67c80685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.735+0000 7f67ce684700 1 -- 172.21.15.70:0/2515853617 >> 172.21.15.70:0/2515853617 conn(0x7f67c8075790 msgr2=0x7f67c8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.735+0000 7f67ce684700 1 -- 172.21.15.70:0/2515853617 shutdown_connections 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.735+0000 7f67ce684700 1 -- 172.21.15.70:0/2515853617 wait complete. 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67ce684700 1 Processor -- start 2023-10-08T08:42:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67ce684700 1 -- start start 2023-10-08T08:42:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67ce684700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068190 0x7f67c8196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67ce684700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67c8068b30 0x7f67c8197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67ce684700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c81067a0 0x7f67c819b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67ce684700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c819bc20 con 0x7f67c8068190 2023-10-08T08:42:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67ce684700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c819bd90 con 0x7f67c8068b30 2023-10-08T08:42:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67ce684700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c819bf50 con 0x7f67c81067a0 2023-10-08T08:42:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67c7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068190 0x7f67c8196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67c7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068190 0x7f67c8196dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49808/0 (socket says 172.21.15.70:49808) 2023-10-08T08:42:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.736+0000 7f67c7fff700 1 -- 172.21.15.70:0/1292803968 learned_addr learned my addr 172.21.15.70:0/1292803968 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:57.041 INFO:teuthology.orchestra.run.smithi070.stdout:60129542207 2023-10-08T08:42:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c77fe700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67c8068b30 0x7f67c8197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67ccc21700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c81067a0 0x7f67c819b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c7fff700 1 -- 172.21.15.70:0/1292803968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c81067a0 msgr2=0x7f67c819b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c7fff700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c81067a0 0x7f67c819b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c7fff700 1 -- 172.21.15.70:0/1292803968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67c8068b30 msgr2=0x7f67c8197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c7fff700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67c8068b30 0x7f67c8197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c7fff700 1 -- 172.21.15.70:0/1292803968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c0009d00 con 0x7f67c8068190 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67ccc21700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c81067a0 0x7f67c819b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c7fff700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068190 0x7f67c8196dc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f67b800d980 tx=0x7f67b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c57fa700 1 -- 172.21.15.70:0/1292803968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8004220 con 0x7f67c8068190 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c57fa700 1 -- 172.21.15.70:0/1292803968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67b8007640 con 0x7f67c8068190 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c819c230 con 0x7f67c8068190 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67c57fa700 1 -- 172.21.15.70:0/1292803968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8005610 con 0x7f67c8068190 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.737+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c81a3a90 con 0x7f67c8068190 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.738+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c8108d50 con 0x7f67c8068190 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.739+0000 7f67c57fa700 1 -- 172.21.15.70:0/1292803968 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f67b8004750 con 0x7f67c8068190 2023-10-08T08:42:57.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.740+0000 7f67c57fa700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67b00a14d0 0x7f67b00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.740+0000 7f67c77fe700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67b00a14d0 0x7f67b00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.740+0000 7f67c57fa700 1 -- 172.21.15.70:0/1292803968 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f67b80cd3c0 con 0x7f67c8068190 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.740+0000 7f67c77fe700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67b00a14d0 0x7f67b00a3990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f67c8198320 tx=0x7f67bc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.744+0000 7f67c57fa700 1 -- 172.21.15.70:0/1292803968 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f67b80966d0 con 0x7f67c8068190 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.944+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67c81980d0 con 0x7f67c8068190 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.944+0000 7f67c57fa700 1 -- 172.21.15.70:0/1292803968 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67b8016020 con 0x7f67c8068190 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67b00a14d0 msgr2=0x7f67b00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67b00a14d0 0x7f67b00a3990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f67c8198320 tx=0x7f67bc009260 comp rx=0 tx=0).stop 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068190 msgr2=0x7f67c8196dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068190 0x7f67c8196dc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f67b800d980 tx=0x7f67b800dc90 comp rx=0 tx=0).stop 2023-10-08T08:42:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 shutdown_connections 2023-10-08T08:42:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f67b00a14d0 0x7f67b00a3990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c81067a0 0x7f67c819b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67c8068190 0x7f67c8196dc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 --2- 172.21.15.70:0/1292803968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67c8068b30 0x7f67c8197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 >> 172.21.15.70:0/1292803968 conn(0x7f67c8075790 msgr2=0x7f67c80fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 shutdown_connections 2023-10-08T08:42:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:56.946+0000 7f67ce684700 1 -- 172.21.15.70:0/1292803968 wait complete. 2023-10-08T08:42:57.432 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378682 got 81604378684 for osd.2 2023-10-08T08:42:57.433 DEBUG:teuthology.parallel:result is None 2023-10-08T08:42:57.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:57 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2578859971' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T08:42:57.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:57 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1292803968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T08:42:57.595 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:57 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2578859971' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T08:42:57.595 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:57 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1292803968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T08:42:57.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:57 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2578859971' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T08:42:57.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:57 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1292803968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T08:42:58.081 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:58.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 -- 172.21.15.70:0/3751025587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 msgr2=0x7f6b5410c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 --2- 172.21.15.70:0/3751025587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 0x7f6b5410c590 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00b0d0 tx=0x7f6b4c00b3e0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 -- 172.21.15.70:0/3751025587 shutdown_connections 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 --2- 172.21.15.70:0/3751025587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 0x7f6b5410c590 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 --2- 172.21.15.70:0/3751025587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b54105730 0x7f6b54105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 --2- 172.21.15.70:0/3751025587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b540ff6e0 0x7f6b540ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 -- 172.21.15.70:0/3751025587 >> 172.21.15.70:0/3751025587 conn(0x7f6b540766f0 msgr2=0x7f6b54076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 -- 172.21.15.70:0/3751025587 shutdown_connections 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 -- 172.21.15.70:0/3751025587 wait complete. 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.881+0000 7f6b58d08700 1 Processor -- start 2023-10-08T08:42:58.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b58d08700 1 -- start start 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b58d08700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b540ff6e0 0x7f6b54198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b58d08700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 0x7f6b54199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b58d08700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b54105730 0x7f6b5419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b58d08700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5419de00 con 0x7f6b541000a0 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b58d08700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5419df70 con 0x7f6b54105730 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b58d08700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5419e130 con 0x7f6b540ff6e0 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b51d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 0x7f6b54199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b51d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 0x7f6b54199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49824/0 (socket says 172.21.15.70:49824) 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b51d9b700 1 -- 172.21.15.70:0/4209352868 learned_addr learned my addr 172.21.15.70:0/4209352868 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b52d9d700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b54105730 0x7f6b5419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b5259c700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b540ff6e0 0x7f6b54198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b51d9b700 1 -- 172.21.15.70:0/4209352868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b540ff6e0 msgr2=0x7f6b54198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b51d9b700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b540ff6e0 0x7f6b54198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b51d9b700 1 -- 172.21.15.70:0/4209352868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b54105730 msgr2=0x7f6b5419d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b51d9b700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b54105730 0x7f6b5419d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b51d9b700 1 -- 172.21.15.70:0/4209352868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c009d00 con 0x7f6b541000a0 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b5259c700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b540ff6e0 0x7f6b54198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b51d9b700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 0x7f6b54199440 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800d980 tx=0x7f6b4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b437fe700 1 -- 172.21.15.70:0/4209352868 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48004220 con 0x7f6b541000a0 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b437fe700 1 -- 172.21.15.70:0/4209352868 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b48007640 con 0x7f6b541000a0 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5419e410 con 0x7f6b541000a0 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.882+0000 7f6b437fe700 1 -- 172.21.15.70:0/4209352868 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48005610 con 0x7f6b541000a0 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.883+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b541a5c70 con 0x7f6b541000a0 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.884+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b54100e00 con 0x7f6b541000a0 2023-10-08T08:42:58.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.885+0000 7f6b437fe700 1 -- 172.21.15.70:0/4209352868 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6b48004750 con 0x7f6b541000a0 2023-10-08T08:42:58.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.885+0000 7f6b437fe700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b3c0a1550 0x7f6b3c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:58.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.885+0000 7f6b5259c700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b3c0a1550 0x7f6b3c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:58.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.885+0000 7f6b437fe700 1 -- 172.21.15.70:0/4209352868 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6b480cccf0 con 0x7f6b541000a0 2023-10-08T08:42:58.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.886+0000 7f6b5259c700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b3c0a1550 0x7f6b3c0a3a10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009b50 tx=0x7f6b44009550 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:58.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:57.890+0000 7f6b437fe700 1 -- 172.21.15.70:0/4209352868 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b480d1070 con 0x7f6b541000a0 2023-10-08T08:42:58.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.098+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f6b5404e4c0 con 0x7f6b541000a0 2023-10-08T08:42:58.374 INFO:teuthology.orchestra.run.smithi070.stdout:279172874271 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.099+0000 7f6b437fe700 1 -- 172.21.15.70:0/4209352868 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b48016020 con 0x7f6b541000a0 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b3c0a1550 msgr2=0x7f6b3c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b3c0a1550 0x7f6b3c0a3a10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009b50 tx=0x7f6b44009550 comp rx=0 tx=0).stop 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 msgr2=0x7f6b54199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 0x7f6b54199440 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800d980 tx=0x7f6b4800dc90 comp rx=0 tx=0).stop 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 shutdown_connections 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b3c0a1550 0x7f6b3c0a3a10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b54105730 0x7f6b5419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b540ff6e0 0x7f6b54198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 --2- 172.21.15.70:0/4209352868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b541000a0 0x7f6b54199440 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.102+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 >> 172.21.15.70:0/4209352868 conn(0x7f6b540766f0 msgr2=0x7f6b54068e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:58.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.103+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 shutdown_connections 2023-10-08T08:42:58.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.103+0000 7f6b58d08700 1 -- 172.21.15.70:0/4209352868 wait complete. 2023-10-08T08:42:58.501 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:58.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:58 smithi191 ceph-mon[104220]: pgmap v265: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:58.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:58 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4209352868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T08:42:58.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:58 smithi070 ceph-mon[99513]: pgmap v265: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:58 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4209352868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T08:42:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.745+0000 7ff14597b700 1 -- 172.21.15.70:0/368395930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1401067f0 msgr2=0x7ff140106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.745+0000 7ff14597b700 1 --2- 172.21.15.70:0/368395930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1401067f0 0x7ff140106bd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff13800b0a0 tx=0x7ff13800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.745+0000 7ff14597b700 1 -- 172.21.15.70:0/368395930 shutdown_connections 2023-10-08T08:42:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.745+0000 7ff14597b700 1 --2- 172.21.15.70:0/368395930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff140101260 0x7ff14010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.745+0000 7ff14597b700 1 --2- 172.21.15.70:0/368395930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1401067f0 0x7ff140106bd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.745+0000 7ff14597b700 1 --2- 172.21.15.70:0/368395930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1401008a0 0x7ff140100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.745+0000 7ff14597b700 1 -- 172.21.15.70:0/368395930 >> 172.21.15.70:0/368395930 conn(0x7ff140077910 msgr2=0x7ff140077d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.745+0000 7ff14597b700 1 -- 172.21.15.70:0/368395930 shutdown_connections 2023-10-08T08:42:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.745+0000 7ff14597b700 1 -- 172.21.15.70:0/368395930 wait complete. 2023-10-08T08:42:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff14597b700 1 Processor -- start 2023-10-08T08:42:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff14597b700 1 -- start start 2023-10-08T08:42:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff14597b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1401008a0 0x7ff140196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff14597b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140101260 0x7ff140197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff14597b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14019b890 0x7ff14019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff14597b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14019c280 con 0x7ff14019b890 2023-10-08T08:42:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff14597b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14019c3f0 con 0x7ff1401008a0 2023-10-08T08:42:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff14597b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14019c5b0 con 0x7ff140101260 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff13f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14019b890 0x7ff14019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff13f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14019b890 0x7ff14019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49840/0 (socket says 172.21.15.70:49840) 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.746+0000 7ff13f7fe700 1 -- 172.21.15.70:0/3971463866 learned_addr learned my addr 172.21.15.70:0/3971463866 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff13effd700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1401008a0 0x7ff140196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff13e7fc700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140101260 0x7ff140197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff13f7fe700 1 -- 172.21.15.70:0/3971463866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140101260 msgr2=0x7ff140197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff13f7fe700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140101260 0x7ff140197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff13f7fe700 1 -- 172.21.15.70:0/3971463866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1401008a0 msgr2=0x7ff140196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff13f7fe700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1401008a0 0x7ff140196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff13f7fe700 1 -- 172.21.15.70:0/3971463866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138009d00 con 0x7ff14019b890 2023-10-08T08:42:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff13f7fe700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14019b890 0x7ff14019bd10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff13000d980 tx=0x7ff13000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff144979700 1 -- 172.21.15.70:0/3971463866 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130004a30 con 0x7ff14019b890 2023-10-08T08:42:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1401a3b40 con 0x7ff14019b890 2023-10-08T08:42:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff144979700 1 -- 172.21.15.70:0/3971463866 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff13000b5c0 con 0x7ff14019b890 2023-10-08T08:42:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff144979700 1 -- 172.21.15.70:0/3971463866 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130009b50 con 0x7ff14019b890 2023-10-08T08:42:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.747+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1401a4040 con 0x7ff14019b890 2023-10-08T08:42:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.748+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff140108d30 con 0x7ff14019b890 2023-10-08T08:42:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.749+0000 7ff144979700 1 -- 172.21.15.70:0/3971463866 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff130009cb0 con 0x7ff14019b890 2023-10-08T08:42:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.750+0000 7ff144979700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff1280a14d0 0x7ff1280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:42:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.750+0000 7ff13effd700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff1280a14d0 0x7ff1280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:42:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.750+0000 7ff144979700 1 -- 172.21.15.70:0/3971463866 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ff1300ccf90 con 0x7ff14019b890 2023-10-08T08:42:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.750+0000 7ff13effd700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff1280a14d0 0x7ff1280a3990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff13800b070 tx=0x7ff13800b7b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:42:58.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.755+0000 7ff144979700 1 -- 172.21.15.70:0/3971463866 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff130100100 con 0x7ff14019b890 2023-10-08T08:42:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:58 smithi105 ceph-mon[103798]: pgmap v265: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T08:42:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:58 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4209352868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T08:42:58.773 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:42:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.972+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff1401982b0 con 0x7ff14019b890 2023-10-08T08:42:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.972+0000 7ff144979700 1 -- 172.21.15.70:0/3971463866 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff130017020 con 0x7ff14019b890 2023-10-08T08:42:58.974 INFO:teuthology.orchestra.run.smithi070.stdout:197568495658 2023-10-08T08:42:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff1280a14d0 msgr2=0x7ff1280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff1280a14d0 0x7ff1280a3990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff13800b070 tx=0x7ff13800b7b0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14019b890 msgr2=0x7ff14019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:42:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14019b890 0x7ff14019bd10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff13000d980 tx=0x7ff13000dc90 comp rx=0 tx=0).stop 2023-10-08T08:42:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 shutdown_connections 2023-10-08T08:42:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff1280a14d0 0x7ff1280a3990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14019b890 0x7ff14019bd10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1401008a0 0x7ff140196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 --2- 172.21.15.70:0/3971463866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff140101260 0x7ff140197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:42:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 >> 172.21.15.70:0/3971463866 conn(0x7ff140077910 msgr2=0x7ff1400ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:42:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 shutdown_connections 2023-10-08T08:42:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:42:58.974+0000 7ff14597b700 1 -- 172.21.15.70:0/3971463866 wait complete. 2023-10-08T08:42:59.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:42:59 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3971463866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T08:42:59.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:42:59 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3971463866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T08:42:59.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:42:59 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3971463866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T08:43:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:00 smithi191 ceph-mon[104220]: pgmap v266: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T08:43:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.639+0000 7f838c421700 1 -- 172.21.15.70:0/575008059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841000a0 msgr2=0x7f838410c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.639+0000 7f838c421700 1 --2- 172.21.15.70:0/575008059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841000a0 0x7f838410c540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f837c00b0a0 tx=0x7f837c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.639+0000 7f838c421700 1 -- 172.21.15.70:0/575008059 shutdown_connections 2023-10-08T08:43:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.639+0000 7f838c421700 1 --2- 172.21.15.70:0/575008059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841000a0 0x7f838410c540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.639+0000 7f838c421700 1 --2- 172.21.15.70:0/575008059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83841045b0 0x7f8384104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.639+0000 7f838c421700 1 --2- 172.21.15.70:0/575008059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83840ff6e0 0x7f83840ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.639+0000 7f838c421700 1 -- 172.21.15.70:0/575008059 >> 172.21.15.70:0/575008059 conn(0x7f83840766c0 msgr2=0x7f8384076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.639+0000 7f838c421700 1 -- 172.21.15.70:0/575008059 shutdown_connections 2023-10-08T08:43:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.639+0000 7f838c421700 1 -- 172.21.15.70:0/575008059 wait complete. 2023-10-08T08:43:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838c421700 1 Processor -- start 2023-10-08T08:43:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838c421700 1 -- start start 2023-10-08T08:43:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838c421700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83840ff6e0 0x7f8384197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838c421700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83841000a0 0x7f83841980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838c421700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841045b0 0x7f83841a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838c421700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841989c0 con 0x7f83841045b0 2023-10-08T08:43:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838c421700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841a3150 con 0x7f83840ff6e0 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838c421700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841a32c0 con 0x7f83841000a0 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838a9be700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841045b0 0x7f83841a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.640+0000 7f838a9be700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841045b0 0x7f83841a2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49854/0 (socket says 172.21.15.70:49854) 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838a9be700 1 -- 172.21.15.70:0/4047980426 learned_addr learned my addr 172.21.15.70:0/4047980426 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f83899bc700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83841000a0 0x7f83841980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838a1bd700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83840ff6e0 0x7f8384197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838a9be700 1 -- 172.21.15.70:0/4047980426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83841000a0 msgr2=0x7f83841980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838a9be700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83841000a0 0x7f83841980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838a9be700 1 -- 172.21.15.70:0/4047980426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83840ff6e0 msgr2=0x7f8384197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838a9be700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83840ff6e0 0x7f8384197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838a9be700 1 -- 172.21.15.70:0/4047980426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009d00 con 0x7f83841045b0 2023-10-08T08:43:00.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838a1bd700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83840ff6e0 0x7f8384197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:00.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838a9be700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841045b0 0x7f83841a2c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f837c00b070 tx=0x7f837c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:00.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f837b7fe700 1 -- 172.21.15.70:0/4047980426 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00e040 con 0x7f83841045b0 2023-10-08T08:43:00.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83841a34e0 con 0x7f83841045b0 2023-10-08T08:43:00.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f837b7fe700 1 -- 172.21.15.70:0/4047980426 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f837c009440 con 0x7f83841045b0 2023-10-08T08:43:00.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f837b7fe700 1 -- 172.21.15.70:0/4047980426 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c01b450 con 0x7f83841045b0 2023-10-08T08:43:00.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.641+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83841a39a0 con 0x7f83841045b0 2023-10-08T08:43:00.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.642+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8384107c20 con 0x7f83841045b0 2023-10-08T08:43:00.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.643+0000 7f837b7fe700 1 -- 172.21.15.70:0/4047980426 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f837c01d480 con 0x7f83841045b0 2023-10-08T08:43:00.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.644+0000 7f837b7fe700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83700a1550 0x7f83700a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.644+0000 7f838a1bd700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83700a1550 0x7f83700a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.644+0000 7f837b7fe700 1 -- 172.21.15.70:0/4047980426 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f837c0ce760 con 0x7f83841045b0 2023-10-08T08:43:00.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.644+0000 7f838a1bd700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83700a1550 0x7f83700a3a10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8380005fd0 tx=0x7f838000a5e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:00.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.648+0000 7f837b7fe700 1 -- 172.21.15.70:0/4047980426 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f837c097a00 con 0x7f83841045b0 2023-10-08T08:43:00.685 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:00 smithi070 ceph-mon[99513]: pgmap v266: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T08:43:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.754+0000 7f08a96f1700 1 -- 172.21.15.70:0/1730247334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4104720 msgr2=0x7f08a4104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.754+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1730247334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4104720 0x7f08a4104b00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0894009990 tx=0x7f0894009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.754+0000 7f08a96f1700 1 -- 172.21.15.70:0/1730247334 shutdown_connections 2023-10-08T08:43:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.754+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1730247334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a4100c60 0x7f08a410c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.754+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1730247334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4104720 0x7f08a4104b00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.754+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1730247334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a41002a0 0x7f08a4100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.754+0000 7f08a96f1700 1 -- 172.21.15.70:0/1730247334 >> 172.21.15.70:0/1730247334 conn(0x7f08a4074a10 msgr2=0x7f08a4074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.754+0000 7f08a96f1700 1 -- 172.21.15.70:0/1730247334 shutdown_connections 2023-10-08T08:43:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.754+0000 7f08a96f1700 1 -- 172.21.15.70:0/1730247334 wait complete. 2023-10-08T08:43:00.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.755+0000 7f08a96f1700 1 Processor -- start 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.755+0000 7f08a96f1700 1 -- start start 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.755+0000 7f08a96f1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a41002a0 0x7f08a4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.755+0000 7f08a96f1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4100c60 0x7f08a4101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.755+0000 7f08a96f1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a4104720 0x7f08a4101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.755+0000 7f08a96f1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41a4fa0 con 0x7f08a4100c60 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.755+0000 7f08a96f1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41a5110 con 0x7f08a4104720 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.755+0000 7f08a96f1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41a52d0 con 0x7f08a41002a0 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4100c60 0x7f08a4101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4100c60 0x7f08a4101960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49864/0 (socket says 172.21.15.70:49864) 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a27fc700 1 -- 172.21.15.70:0/1659911719 learned_addr learned my addr 172.21.15.70:0/1659911719 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:00.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a37fe700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a4104720 0x7f08a4101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a2ffd700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a41002a0 0x7f08a4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a27fc700 1 -- 172.21.15.70:0/1659911719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a41002a0 msgr2=0x7f08a4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a27fc700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a41002a0 0x7f08a4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a27fc700 1 -- 172.21.15.70:0/1659911719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a4104720 msgr2=0x7f08a4101ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a27fc700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a4104720 0x7f08a4101ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a27fc700 1 -- 172.21.15.70:0/1659911719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940095f0 con 0x7f08a4100c60 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a27fc700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4100c60 0x7f08a4101960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f089800d950 tx=0x7f089800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f088bfff700 1 -- 172.21.15.70:0/1659911719 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089800f890 con 0x7f08a4100c60 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a41969c0 con 0x7f08a4100c60 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f088bfff700 1 -- 172.21.15.70:0/1659911719 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0898010460 con 0x7f08a4100c60 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.756+0000 7f088bfff700 1 -- 172.21.15.70:0/1659911719 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089800e610 con 0x7f08a4100c60 2023-10-08T08:43:00.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.757+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a4196f10 con 0x7f08a4100c60 2023-10-08T08:43:00.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.757+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a4108cb0 con 0x7f08a4100c60 2023-10-08T08:43:00.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.760+0000 7f088bfff700 1 -- 172.21.15.70:0/1659911719 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f08980108d0 con 0x7f08a4100c60 2023-10-08T08:43:00.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.760+0000 7f088bfff700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f088c0a14d0 0x7f088c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.761+0000 7f08a2ffd700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f088c0a14d0 0x7f088c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.761+0000 7f088bfff700 1 -- 172.21.15.70:0/1659911719 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f08980cd270 con 0x7f08a4100c60 2023-10-08T08:43:00.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.761+0000 7f08a2ffd700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f088c0a14d0 0x7f088c0a3990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f089400b5c0 tx=0x7f0894005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:00.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:00 smithi105 ceph-mon[103798]: pgmap v266: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T08:43:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.769+0000 7f088bfff700 1 -- 172.21.15.70:0/1659911719 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f08980964e0 con 0x7f08a4100c60 2023-10-08T08:43:00.786 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495656 got 197568495658 for osd.6 2023-10-08T08:43:00.786 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.894+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f8384100dd0 con 0x7f83841045b0 2023-10-08T08:43:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.895+0000 7f837b7fe700 1 -- 172.21.15.70:0/4047980426 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f837c09b020 con 0x7f83841045b0 2023-10-08T08:43:00.896 INFO:teuthology.orchestra.run.smithi070.stdout:249108103204 2023-10-08T08:43:00.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83700a1550 msgr2=0x7f83700a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83700a1550 0x7f83700a3a10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8380005fd0 tx=0x7f838000a5e0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841045b0 msgr2=0x7f83841a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841045b0 0x7f83841a2c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f837c00b070 tx=0x7f837c007870 comp rx=0 tx=0).stop 2023-10-08T08:43:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 shutdown_connections 2023-10-08T08:43:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f83700a1550 0x7f83700a3a10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83841045b0 0x7f83841a2c10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83840ff6e0 0x7f8384197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 --2- 172.21.15.70:0/4047980426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83841000a0 0x7f83841980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 >> 172.21.15.70:0/4047980426 conn(0x7f83840766c0 msgr2=0x7f83840fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:00.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 shutdown_connections 2023-10-08T08:43:00.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.898+0000 7f838c421700 1 -- 172.21.15.70:0/4047980426 wait complete. 2023-10-08T08:43:00.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.953+0000 7ff7dc221700 1 -- 172.21.15.70:0/2893596118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ffb30 msgr2=0x7ff7d410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.953+0000 7ff7dc221700 1 --2- 172.21.15.70:0/2893596118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ffb30 0x7ff7d410d5c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00b0a0 tx=0x7ff7cc00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.953+0000 7ff7dc221700 1 -- 172.21.15.70:0/2893596118 shutdown_connections 2023-10-08T08:43:00.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.953+0000 7ff7dc221700 1 --2- 172.21.15.70:0/2893596118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ffb30 0x7ff7d410d5c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.953+0000 7ff7dc221700 1 --2- 172.21.15.70:0/2893596118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d41058d0 0x7ff7d4105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.953+0000 7ff7dc221700 1 --2- 172.21.15.70:0/2893596118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7d40ff190 0x7ff7d40ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.953+0000 7ff7dc221700 1 -- 172.21.15.70:0/2893596118 >> 172.21.15.70:0/2893596118 conn(0x7ff7d4074a10 msgr2=0x7ff7d4074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:00.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 -- 172.21.15.70:0/2893596118 shutdown_connections 2023-10-08T08:43:00.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 -- 172.21.15.70:0/2893596118 wait complete. 2023-10-08T08:43:00.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 Processor -- start 2023-10-08T08:43:00.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 -- start start 2023-10-08T08:43:00.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ff190 0x7ff7d419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7d40ffb30 0x7ff7d419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d41058d0 0x7ff7d4196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d41970d0 con 0x7ff7d40ff190 2023-10-08T08:43:00.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d4197240 con 0x7ff7d41058d0 2023-10-08T08:43:00.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.954+0000 7ff7dc221700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d4197400 con 0x7ff7d40ffb30 2023-10-08T08:43:00.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d9fbd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ff190 0x7ff7d419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d9fbd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ff190 0x7ff7d419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49876/0 (socket says 172.21.15.70:49876) 2023-10-08T08:43:00.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d9fbd700 1 -- 172.21.15.70:0/1620169326 learned_addr learned my addr 172.21.15.70:0/1620169326 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:00.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d97bc700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7d40ffb30 0x7ff7d419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7da7be700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d41058d0 0x7ff7d4196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d9fbd700 1 -- 172.21.15.70:0/1620169326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7d40ffb30 msgr2=0x7ff7d419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d9fbd700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7d40ffb30 0x7ff7d419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d9fbd700 1 -- 172.21.15.70:0/1620169326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d41058d0 msgr2=0x7ff7d4196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d9fbd700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d41058d0 0x7ff7d4196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d9fbd700 1 -- 172.21.15.70:0/1620169326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc009d00 con 0x7ff7d40ff190 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7d9fbd700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ff190 0x7ff7d419c920 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000e970 tx=0x7ff7d000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7caffd700 1 -- 172.21.15.70:0/1620169326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0009790 con 0x7ff7d40ff190 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d41976e0 con 0x7ff7d40ff190 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7caffd700 1 -- 172.21.15.70:0/1620169326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7d000eec0 con 0x7ff7d40ff190 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7caffd700 1 -- 172.21.15.70:0/1620169326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0003d30 con 0x7ff7d40ff190 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.955+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d41a3910 con 0x7ff7d40ff190 2023-10-08T08:43:00.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.956+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d4108d30 con 0x7ff7d40ff190 2023-10-08T08:43:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.958+0000 7ff7caffd700 1 -- 172.21.15.70:0/1620169326 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff7d000ccd0 con 0x7ff7d40ff190 2023-10-08T08:43:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.959+0000 7ff7caffd700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7c00a5960 0x7ff7c00a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.959+0000 7ff7d97bc700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7c00a5960 0x7ff7c00a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.959+0000 7ff7caffd700 1 -- 172.21.15.70:0/1620169326 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ff7d0014070 con 0x7ff7d40ff190 2023-10-08T08:43:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.959+0000 7ff7d97bc700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7c00a5960 0x7ff7c00a7e20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4074e10 tx=0x7ff7c400a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.963+0000 7ff7caffd700 1 -- 172.21.15.70:0/1620169326 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff7d00967b0 con 0x7ff7d40ff190 2023-10-08T08:43:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.989+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f08a4102900 con 0x7f08a4100c60 2023-10-08T08:43:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.989+0000 7f088bfff700 1 -- 172.21.15.70:0/1659911719 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0898020020 con 0x7f08a4100c60 2023-10-08T08:43:00.993 INFO:teuthology.orchestra.run.smithi070.stdout:111669149751 2023-10-08T08:43:00.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.993+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f088c0a14d0 msgr2=0x7f088c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.993+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f088c0a14d0 0x7f088c0a3990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f089400b5c0 tx=0x7f0894005960 comp rx=0 tx=0).stop 2023-10-08T08:43:00.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.993+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4100c60 msgr2=0x7f08a4101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:00.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.993+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4100c60 0x7f08a4101960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f089800d950 tx=0x7f089800dc60 comp rx=0 tx=0).stop 2023-10-08T08:43:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.997+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 shutdown_connections 2023-10-08T08:43:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.997+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f088c0a14d0 0x7f088c0a3990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.997+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a4104720 0x7f08a4101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.997+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08a41002a0 0x7f08a4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.997+0000 7f08a96f1700 1 --2- 172.21.15.70:0/1659911719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08a4100c60 0x7f08a4101960 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.997+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 >> 172.21.15.70:0/1659911719 conn(0x7f08a4074a10 msgr2=0x7f08a40ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.997+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 shutdown_connections 2023-10-08T08:43:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:00.997+0000 7f08a96f1700 1 -- 172.21.15.70:0/1659911719 wait complete. 2023-10-08T08:43:01.020 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874269 got 279172874271 for osd.9 2023-10-08T08:43:01.020 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:01.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.038+0000 7f821552e700 1 -- 172.21.15.70:0/1474788792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82101056b0 msgr2=0x7f8210105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.038+0000 7f821552e700 1 --2- 172.21.15.70:0/1474788792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82101056b0 0x7f8210105a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8200009990 tx=0x7f8200009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.038+0000 7f821552e700 1 -- 172.21.15.70:0/1474788792 shutdown_connections 2023-10-08T08:43:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.038+0000 7f821552e700 1 --2- 172.21.15.70:0/1474788792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8210100110 0x7f821010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.038+0000 7f821552e700 1 --2- 172.21.15.70:0/1474788792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82101056b0 0x7f8210105a90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.038+0000 7f821552e700 1 --2- 172.21.15.70:0/1474788792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82100ff750 0x7f82100ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.038+0000 7f821552e700 1 -- 172.21.15.70:0/1474788792 >> 172.21.15.70:0/1474788792 conn(0x7f8210075790 msgr2=0x7f8210075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.038+0000 7f821552e700 1 -- 172.21.15.70:0/1474788792 shutdown_connections 2023-10-08T08:43:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.038+0000 7f821552e700 1 -- 172.21.15.70:0/1474788792 wait complete. 2023-10-08T08:43:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f821552e700 1 Processor -- start 2023-10-08T08:43:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f821552e700 1 -- start start 2023-10-08T08:43:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f821552e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82100ff750 0x7f8210197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f821552e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210100110 0x7f8210197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f821552e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82101056b0 0x7f82101a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f821552e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8210198810 con 0x7f82101056b0 2023-10-08T08:43:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f821552e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82101a2fd0 con 0x7f82100ff750 2023-10-08T08:43:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f821552e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82101a3110 con 0x7f8210100110 2023-10-08T08:43:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f820f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82101056b0 0x7f82101a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f820f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82101056b0 0x7f82101a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49894/0 (socket says 172.21.15.70:49894) 2023-10-08T08:43:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f820f7fe700 1 -- 172.21.15.70:0/2179060276 learned_addr learned my addr 172.21.15.70:0/2179060276 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f820effd700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82100ff750 0x7f8210197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.039+0000 7f820e7fc700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210100110 0x7f8210197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f820f7fe700 1 -- 172.21.15.70:0/2179060276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210100110 msgr2=0x7f8210197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f820f7fe700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210100110 0x7f8210197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f820f7fe700 1 -- 172.21.15.70:0/2179060276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82100ff750 msgr2=0x7f8210197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f820f7fe700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82100ff750 0x7f8210197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f820f7fe700 1 -- 172.21.15.70:0/2179060276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000095f0 con 0x7f82101056b0 2023-10-08T08:43:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f820f7fe700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82101056b0 0x7f82101a2a90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f820800ef30 tx=0x7f820800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f81f7fff700 1 -- 172.21.15.70:0/2179060276 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208018070 con 0x7f82101056b0 2023-10-08T08:43:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82101a3330 con 0x7f82101056b0 2023-10-08T08:43:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f81f7fff700 1 -- 172.21.15.70:0/2179060276 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f820800f040 con 0x7f82101056b0 2023-10-08T08:43:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f81f7fff700 1 -- 172.21.15.70:0/2179060276 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800cdb0 con 0x7f82101056b0 2023-10-08T08:43:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.040+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82101a3880 con 0x7f82101056b0 2023-10-08T08:43:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.041+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8210107c40 con 0x7f82101056b0 2023-10-08T08:43:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.042+0000 7f81f7fff700 1 -- 172.21.15.70:0/2179060276 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8208003a00 con 0x7f82101056b0 2023-10-08T08:43:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.043+0000 7f81f7fff700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81f80a14d0 0x7f81f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.043+0000 7f820effd700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81f80a14d0 0x7f81f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.043+0000 7f81f7fff700 1 -- 172.21.15.70:0/2179060276 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f82080ccc80 con 0x7f82101056b0 2023-10-08T08:43:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.043+0000 7f820effd700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81f80a14d0 0x7f81f80a3990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f820000b2e0 tx=0x7f8200005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.047+0000 7f81f7fff700 1 -- 172.21.15.70:0/2179060276 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8208095f80 con 0x7f82101056b0 2023-10-08T08:43:01.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.198+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7ff7d4067c30 con 0x7ff7d40ff190 2023-10-08T08:43:01.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.198+0000 7ff7caffd700 1 -- 172.21.15.70:0/1620169326 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7ff7d0099dd0 con 0x7ff7d40ff190 2023-10-08T08:43:01.201 INFO:teuthology.orchestra.run.smithi070.stdout:300647710746 2023-10-08T08:43:01.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7c00a5960 msgr2=0x7ff7c00a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7c00a5960 0x7ff7c00a7e20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4074e10 tx=0x7ff7c400a380 comp rx=0 tx=0).stop 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ff190 msgr2=0x7ff7d419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ff190 0x7ff7d419c920 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000e970 tx=0x7ff7d000ec80 comp rx=0 tx=0).stop 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 shutdown_connections 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7c00a5960 0x7ff7c00a7e20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d41058d0 0x7ff7d4196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d40ff190 0x7ff7d419c920 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 --2- 172.21.15.70:0/1620169326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7d40ffb30 0x7ff7d419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 >> 172.21.15.70:0/1620169326 conn(0x7ff7d4074a10 msgr2=0x7ff7d40fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 shutdown_connections 2023-10-08T08:43:01.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.200+0000 7ff7dc221700 1 -- 172.21.15.70:0/1620169326 wait complete. 2023-10-08T08:43:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.276+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8210068750 con 0x7f82101056b0 2023-10-08T08:43:01.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.276+0000 7f81f7fff700 1 -- 172.21.15.70:0/2179060276 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82080995a0 con 0x7f82101056b0 2023-10-08T08:43:01.277 INFO:teuthology.orchestra.run.smithi070.stdout:163208757295 2023-10-08T08:43:01.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.278+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81f80a14d0 msgr2=0x7f81f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.278+0000 7f821552e700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81f80a14d0 0x7f81f80a3990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f820000b2e0 tx=0x7f8200005960 comp rx=0 tx=0).stop 2023-10-08T08:43:01.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.278+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82101056b0 msgr2=0x7f82101a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.278+0000 7f821552e700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82101056b0 0x7f82101a2a90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f820800ef30 tx=0x7f820800c3a0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.279+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 shutdown_connections 2023-10-08T08:43:01.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.279+0000 7f821552e700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f81f80a14d0 0x7f81f80a3990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.279+0000 7f821552e700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82101056b0 0x7f82101a2a90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.279+0000 7f821552e700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82100ff750 0x7f8210197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.279+0000 7f821552e700 1 --2- 172.21.15.70:0/2179060276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210100110 0x7f8210197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.279+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 >> 172.21.15.70:0/2179060276 conn(0x7f8210075790 msgr2=0x7f82100fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.279+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 shutdown_connections 2023-10-08T08:43:01.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.279+0000 7f821552e700 1 -- 172.21.15.70:0/2179060276 wait complete. 2023-10-08T08:43:01.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.341+0000 7f06532db700 1 -- 172.21.15.70:0/601371266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 msgr2=0x7f064c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.341+0000 7f06532db700 1 --2- 172.21.15.70:0/601371266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 0x7f064c105a90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0648009990 tx=0x7f0648009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.341+0000 7f06532db700 1 -- 172.21.15.70:0/601371266 shutdown_connections 2023-10-08T08:43:01.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.341+0000 7f06532db700 1 --2- 172.21.15.70:0/601371266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c100110 0x7f064c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.341+0000 7f06532db700 1 --2- 172.21.15.70:0/601371266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 0x7f064c105a90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.341+0000 7f06532db700 1 --2- 172.21.15.70:0/601371266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f064c0ff750 0x7f064c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.341+0000 7f06532db700 1 -- 172.21.15.70:0/601371266 >> 172.21.15.70:0/601371266 conn(0x7f064c075790 msgr2=0x7f064c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:01.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.341+0000 7f06532db700 1 -- 172.21.15.70:0/601371266 shutdown_connections 2023-10-08T08:43:01.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.341+0000 7f06532db700 1 -- 172.21.15.70:0/601371266 wait complete. 2023-10-08T08:43:01.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f06532db700 1 Processor -- start 2023-10-08T08:43:01.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f06532db700 1 -- start start 2023-10-08T08:43:01.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f06532db700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c0ff750 0x7f064c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:01.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f06532db700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f064c100110 0x7f064c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:01.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f06532db700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 0x7f064c196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:01.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f06532db700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1970c0 con 0x7f064c1056b0 2023-10-08T08:43:01.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f06532db700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c197230 con 0x7f064c0ff750 2023-10-08T08:43:01.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f06532db700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1973f0 con 0x7f064c100110 2023-10-08T08:43:01.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0651878700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 0x7f064c196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:01.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0651878700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 0x7f064c196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49908/0 (socket says 172.21.15.70:49908) 2023-10-08T08:43:01.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0651878700 1 -- 172.21.15.70:0/1917931578 learned_addr learned my addr 172.21.15.70:0/1917931578 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:01.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0651077700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c0ff750 0x7f064c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:01.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0650876700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f064c100110 0x7f064c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:01.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0651878700 1 -- 172.21.15.70:0/1917931578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f064c100110 msgr2=0x7f064c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0651878700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f064c100110 0x7f064c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0651878700 1 -- 172.21.15.70:0/1917931578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c0ff750 msgr2=0x7f064c19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0651878700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c0ff750 0x7f064c19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.342+0000 7f0651878700 1 -- 172.21.15.70:0/1917931578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480095f0 con 0x7f064c1056b0 2023-10-08T08:43:01.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.343+0000 7f0651878700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 0x7f064c196a60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0644007ee0 tx=0x7f064400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:01.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.343+0000 7f06427fc700 1 -- 172.21.15.70:0/1917931578 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644017070 con 0x7f064c1056b0 2023-10-08T08:43:01.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.343+0000 7f06427fc700 1 -- 172.21.15.70:0/1917931578 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f064400f040 con 0x7f064c1056b0 2023-10-08T08:43:01.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.343+0000 7f06427fc700 1 -- 172.21.15.70:0/1917931578 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644005740 con 0x7f064c1056b0 2023-10-08T08:43:01.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.343+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c1976d0 con 0x7f064c1056b0 2023-10-08T08:43:01.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.343+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c1a38c0 con 0x7f064c1056b0 2023-10-08T08:43:01.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.344+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c107c40 con 0x7f064c1056b0 2023-10-08T08:43:01.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.345+0000 7f06427fc700 1 -- 172.21.15.70:0/1917931578 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f064400dc60 con 0x7f064c1056b0 2023-10-08T08:43:01.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.345+0000 7f06427fc700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06380a1550 0x7f06380a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:01.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.345+0000 7f0651077700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06380a1550 0x7f06380a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:01.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.345+0000 7f06427fc700 1 -- 172.21.15.70:0/1917931578 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f06440ccea0 con 0x7f064c1056b0 2023-10-08T08:43:01.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.346+0000 7f0651077700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06380a1550 0x7f06380a3a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f06480098e0 tx=0x7f0648005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:01.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.349+0000 7f06427fc700 1 -- 172.21.15.70:0/1917931578 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0644096110 con 0x7f064c1056b0 2023-10-08T08:43:01.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.579+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f064c100df0 con 0x7f064c1056b0 2023-10-08T08:43:01.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.579+0000 7f06427fc700 1 -- 172.21.15.70:0/1917931578 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f06440058a0 con 0x7f064c1056b0 2023-10-08T08:43:01.580 INFO:teuthology.orchestra.run.smithi070.stdout:330712481816 2023-10-08T08:43:01.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06380a1550 msgr2=0x7f06380a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06380a1550 0x7f06380a3a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f06480098e0 tx=0x7f0648005960 comp rx=0 tx=0).stop 2023-10-08T08:43:01.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 msgr2=0x7f064c196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:01.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 0x7f064c196a60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0644007ee0 tx=0x7f064400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 shutdown_connections 2023-10-08T08:43:01.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06380a1550 0x7f06380a3a10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f064c1056b0 0x7f064c196a60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c0ff750 0x7f064c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 --2- 172.21.15.70:0/1917931578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f064c100110 0x7f064c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:01.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.582+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 >> 172.21.15.70:0/1917931578 conn(0x7f064c075790 msgr2=0x7f064c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.585+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 shutdown_connections 2023-10-08T08:43:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:01.585+0000 7f06532db700 1 -- 172.21.15.70:0/1917931578 wait complete. 2023-10-08T08:43:01.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:01 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4047980426' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T08:43:01.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:01 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1659911719' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T08:43:01.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:01 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1620169326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T08:43:01.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:01 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2179060276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T08:43:01.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:01 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4047980426' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T08:43:01.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:01 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1659911719' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T08:43:01.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:01 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1620169326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T08:43:01.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:01 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2179060276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T08:43:01.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:01 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4047980426' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T08:43:01.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:01 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1659911719' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T08:43:01.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:01 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1620169326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T08:43:01.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:01 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2179060276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T08:43:02.230 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757294 got 163208757295 for osd.5 2023-10-08T08:43:02.230 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:02.474 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710744 got 300647710746 for osd.10 2023-10-08T08:43:02.474 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:02 smithi191 ceph-mon[104220]: pgmap v267: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-10-08T08:43:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:02 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:43:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:02 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1917931578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T08:43:02.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:02 smithi070 ceph-mon[99513]: pgmap v267: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-10-08T08:43:02.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:02 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:43:02.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:02 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1917931578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T08:43:02.770 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542205 got 60129542207 for osd.1 2023-10-08T08:43:02.770 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:02.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:02 smithi105 ceph-mon[103798]: pgmap v267: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-10-08T08:43:02.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:02 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:43:02.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:02 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1917931578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T08:43:03.157 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149750 got 111669149751 for osd.3 2023-10-08T08:43:03.157 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:03.573 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103201 got 249108103204 for osd.8 2023-10-08T08:43:03.574 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:03.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 -- 172.21.15.70:0/603869914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c1070f0 msgr2=0x7fb28c1008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:03.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 --2- 172.21.15.70:0/603869914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c1070f0 0x7fb28c1008c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb280009990 tx=0x7fb280009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:03.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 -- 172.21.15.70:0/603869914 shutdown_connections 2023-10-08T08:43:03.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 --2- 172.21.15.70:0/603869914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb28c100ff0 0x7fb28c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:03.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 --2- 172.21.15.70:0/603869914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb28c1067d0 0x7fb28c106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:03.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 --2- 172.21.15.70:0/603869914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c1070f0 0x7fb28c1008c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:03.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 -- 172.21.15.70:0/603869914 >> 172.21.15.70:0/603869914 conn(0x7fb28c077910 msgr2=0x7fb28c077d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:03.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 -- 172.21.15.70:0/603869914 shutdown_connections 2023-10-08T08:43:03.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 -- 172.21.15.70:0/603869914 wait complete. 2023-10-08T08:43:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.960+0000 7fb29205e700 1 Processor -- start 2023-10-08T08:43:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb29205e700 1 -- start start 2023-10-08T08:43:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb29205e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c100ff0 0x7fb28c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb29205e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb28c1067d0 0x7fb28c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb29205e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb28c0747a0 0x7fb28c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb29205e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c1a9850 con 0x7fb28c100ff0 2023-10-08T08:43:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb29205e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c19add0 con 0x7fb28c0747a0 2023-10-08T08:43:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb29205e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c19af90 con 0x7fb28c1067d0 2023-10-08T08:43:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c100ff0 0x7fb28c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c100ff0 0x7fb28c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49916/0 (socket says 172.21.15.70:49916) 2023-10-08T08:43:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28b7fe700 1 -- 172.21.15.70:0/903331185 learned_addr learned my addr 172.21.15.70:0/903331185 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28affd700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb28c1067d0 0x7fb28c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28bfff700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb28c0747a0 0x7fb28c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28b7fe700 1 -- 172.21.15.70:0/903331185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb28c1067d0 msgr2=0x7fb28c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28b7fe700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb28c1067d0 0x7fb28c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28b7fe700 1 -- 172.21.15.70:0/903331185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb28c0747a0 msgr2=0x7fb28c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:03.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28b7fe700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb28c0747a0 0x7fb28c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:03.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.961+0000 7fb28b7fe700 1 -- 172.21.15.70:0/903331185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2800095f0 con 0x7fb28c100ff0 2023-10-08T08:43:03.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.962+0000 7fb28bfff700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb28c0747a0 0x7fb28c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:03.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.962+0000 7fb28b7fe700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c100ff0 0x7fb28c072af0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d950 tx=0x7fb27c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:03.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.962+0000 7fb288ff9700 1 -- 172.21.15.70:0/903331185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c009940 con 0x7fb28c100ff0 2023-10-08T08:43:03.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.962+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c19b270 con 0x7fb28c100ff0 2023-10-08T08:43:03.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.962+0000 7fb288ff9700 1 -- 172.21.15.70:0/903331185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb27c010460 con 0x7fb28c100ff0 2023-10-08T08:43:03.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.962+0000 7fb288ff9700 1 -- 172.21.15.70:0/903331185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00f620 con 0x7fb28c100ff0 2023-10-08T08:43:03.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.962+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c19b740 con 0x7fb28c100ff0 2023-10-08T08:43:03.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.963+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28c108d30 con 0x7fb28c100ff0 2023-10-08T08:43:03.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.964+0000 7fb288ff9700 1 -- 172.21.15.70:0/903331185 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb27c0108d0 con 0x7fb28c100ff0 2023-10-08T08:43:03.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.965+0000 7fb288ff9700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2740a14d0 0x7fb2740a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:03.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.965+0000 7fb288ff9700 1 -- 172.21.15.70:0/903331185 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fb27c0ccf50 con 0x7fb28c100ff0 2023-10-08T08:43:03.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.965+0000 7fb28affd700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2740a14d0 0x7fb2740a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:03.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.965+0000 7fb28affd700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2740a14d0 0x7fb2740a3990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb2800059d0 tx=0x7fb280005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:03.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:03.970+0000 7fb288ff9700 1 -- 172.21.15.70:0/903331185 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb27c0961c0 con 0x7fb28c100ff0 2023-10-08T08:43:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.176+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb28c101f00 con 0x7fb28c100ff0 2023-10-08T08:43:04.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.176+0000 7fb288ff9700 1 -- 172.21.15.70:0/903331185 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb27c016090 con 0x7fb28c100ff0 2023-10-08T08:43:04.178 INFO:teuthology.orchestra.run.smithi070.stdout:38654705733 2023-10-08T08:43:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2740a14d0 msgr2=0x7fb2740a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2740a14d0 0x7fb2740a3990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb2800059d0 tx=0x7fb280005960 comp rx=0 tx=0).stop 2023-10-08T08:43:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c100ff0 msgr2=0x7fb28c072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c100ff0 0x7fb28c072af0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d950 tx=0x7fb27c00dc60 comp rx=0 tx=0).stop 2023-10-08T08:43:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 shutdown_connections 2023-10-08T08:43:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2740a14d0 0x7fb2740a3990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb28c0747a0 0x7fb28c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb28c100ff0 0x7fb28c072af0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 --2- 172.21.15.70:0/903331185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb28c1067d0 0x7fb28c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 >> 172.21.15.70:0/903331185 conn(0x7fb28c077910 msgr2=0x7fb28c0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 shutdown_connections 2023-10-08T08:43:04.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.178+0000 7fb29205e700 1 -- 172.21.15.70:0/903331185 wait complete. 2023-10-08T08:43:04.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.349+0000 7f749dace700 1 -- 172.21.15.70:0/2257162677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 msgr2=0x7f7498100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.349+0000 7f749dace700 1 --2- 172.21.15.70:0/2257162677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 0x7f7498100720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f748c009990 tx=0x7f748c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.349+0000 7f749dace700 1 -- 172.21.15.70:0/2257162677 shutdown_connections 2023-10-08T08:43:04.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.349+0000 7f749dace700 1 --2- 172.21.15.70:0/2257162677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7498100c60 0x7f749810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.349+0000 7f749dace700 1 --2- 172.21.15.70:0/2257162677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7498104720 0x7f7498104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.349+0000 7f749dace700 1 --2- 172.21.15.70:0/2257162677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 0x7f7498100720 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.349+0000 7f749dace700 1 -- 172.21.15.70:0/2257162677 >> 172.21.15.70:0/2257162677 conn(0x7f7498074a10 msgr2=0x7f7498074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.349+0000 7f749dace700 1 -- 172.21.15.70:0/2257162677 shutdown_connections 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.349+0000 7f749dace700 1 -- 172.21.15.70:0/2257162677 wait complete. 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.350+0000 7f749dace700 1 Processor -- start 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.350+0000 7f749dace700 1 -- start start 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.350+0000 7f749dace700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 0x7f749819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.350+0000 7f749dace700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7498100c60 0x7f749819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.350+0000 7f749dace700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7498104720 0x7f7498196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.350+0000 7f749dace700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7498197070 con 0x7f74981002a0 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.350+0000 7f749dace700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74981971e0 con 0x7f7498104720 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.350+0000 7f749dace700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74981973a0 con 0x7f7498100c60 2023-10-08T08:43:04.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f74977fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 0x7f749819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f74977fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 0x7f749819c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49930/0 (socket says 172.21.15.70:49930) 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f74977fe700 1 -- 172.21.15.70:0/622723167 learned_addr learned my addr 172.21.15.70:0/622723167 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f7496ffd700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7498100c60 0x7f749819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f7497fff700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7498104720 0x7f7498196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f74977fe700 1 -- 172.21.15.70:0/622723167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7498100c60 msgr2=0x7f749819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f74977fe700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7498100c60 0x7f749819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f74977fe700 1 -- 172.21.15.70:0/622723167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7498104720 msgr2=0x7f7498196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f74977fe700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7498104720 0x7f7498196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f74977fe700 1 -- 172.21.15.70:0/622723167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0095f0 con 0x7f74981002a0 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f7497fff700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7498104720 0x7f7498196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:04.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f74977fe700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 0x7f749819c8d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f748800d980 tx=0x7f748800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f7494ff9700 1 -- 172.21.15.70:0/622723167 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488004220 con 0x7f74981002a0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f7494ff9700 1 -- 172.21.15.70:0/622723167 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7488007640 con 0x7f74981002a0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7498197680 con 0x7f74981002a0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f7494ff9700 1 -- 172.21.15.70:0/622723167 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488005610 con 0x7f74981002a0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.351+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74981a38c0 con 0x7f74981002a0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.352+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7498107d10 con 0x7f74981002a0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.353+0000 7f7494ff9700 1 -- 172.21.15.70:0/622723167 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f7488004750 con 0x7f74981002a0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.354+0000 7f7494ff9700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74800a1550 0x7f74800a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.354+0000 7f7496ffd700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74800a1550 0x7f74800a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.354+0000 7f7494ff9700 1 -- 172.21.15.70:0/622723167 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f74880cd3c0 con 0x7f74981002a0 2023-10-08T08:43:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.354+0000 7f7496ffd700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74800a1550 0x7f74800a3a10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f748c00b5c0 tx=0x7f748c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.358+0000 7f7494ff9700 1 -- 172.21.15.70:0/622723167 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f74880966d0 con 0x7f74981002a0 2023-10-08T08:43:04.421 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:04 smithi070 ceph-mon[99513]: pgmap v268: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-08T08:43:04.421 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:04 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.421 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:04 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.421 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:04 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.421 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:04 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.421 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:04 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/903331185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T08:43:04.475 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481814 got 330712481816 for osd.11 2023-10-08T08:43:04.475 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:04.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.563+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7498067d10 con 0x7f74981002a0 2023-10-08T08:43:04.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.564+0000 7f7494ff9700 1 -- 172.21.15.70:0/622723167 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7488016090 con 0x7f74981002a0 2023-10-08T08:43:04.566 INFO:teuthology.orchestra.run.smithi070.stdout:141733920821 2023-10-08T08:43:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74800a1550 msgr2=0x7f74800a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74800a1550 0x7f74800a3a10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f748c00b5c0 tx=0x7f748c005960 comp rx=0 tx=0).stop 2023-10-08T08:43:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 msgr2=0x7f749819c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 0x7f749819c8d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f748800d980 tx=0x7f748800dc90 comp rx=0 tx=0).stop 2023-10-08T08:43:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 shutdown_connections 2023-10-08T08:43:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74800a1550 0x7f74800a3a10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7498104720 0x7f7498196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74981002a0 0x7f749819c8d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 --2- 172.21.15.70:0/622723167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7498100c60 0x7f749819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 >> 172.21.15.70:0/622723167 conn(0x7f7498074a10 msgr2=0x7f74980fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 shutdown_connections 2023-10-08T08:43:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.566+0000 7f749dace700 1 -- 172.21.15.70:0/622723167 wait complete. 2023-10-08T08:43:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:04 smithi191 ceph-mon[104220]: pgmap v268: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-08T08:43:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:04 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:04 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:04 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:04 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:04 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/903331185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T08:43:04.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.691+0000 7f210ad94700 1 -- 172.21.15.70:0/56579578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 msgr2=0x7f210410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.691+0000 7f210ad94700 1 --2- 172.21.15.70:0/56579578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 0x7f210410c580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00b0a0 tx=0x7f20fc00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.691+0000 7f210ad94700 1 -- 172.21.15.70:0/56579578 shutdown_connections 2023-10-08T08:43:04.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.691+0000 7f210ad94700 1 --2- 172.21.15.70:0/56579578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 0x7f210410c580 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.691+0000 7f210ad94700 1 --2- 172.21.15.70:0/56579578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21041056b0 0x7f2104105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.691+0000 7f210ad94700 1 --2- 172.21.15.70:0/56579578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21040ff750 0x7f21040ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.691+0000 7f210ad94700 1 -- 172.21.15.70:0/56579578 >> 172.21.15.70:0/56579578 conn(0x7f2104075790 msgr2=0x7f2104075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:04.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.691+0000 7f210ad94700 1 -- 172.21.15.70:0/56579578 shutdown_connections 2023-10-08T08:43:04.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.691+0000 7f210ad94700 1 -- 172.21.15.70:0/56579578 wait complete. 2023-10-08T08:43:04.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f210ad94700 1 Processor -- start 2023-10-08T08:43:04.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f210ad94700 1 -- start start 2023-10-08T08:43:04.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f210ad94700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21040ff750 0x7f210419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:04.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f210ad94700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 0x7f210419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:04.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f210ad94700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21041056b0 0x7f2104195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:04.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f210ad94700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104196220 con 0x7f2104100110 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f210ad94700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104196390 con 0x7f21041056b0 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f210ad94700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104196550 con 0x7f21040ff750 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2103fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 0x7f210419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2103fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 0x7f210419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49944/0 (socket says 172.21.15.70:49944) 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2103fff700 1 -- 172.21.15.70:0/3668537293 learned_addr learned my addr 172.21.15.70:0/3668537293 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2108b30700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21040ff750 0x7f210419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2109331700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21041056b0 0x7f2104195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2103fff700 1 -- 172.21.15.70:0/3668537293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21040ff750 msgr2=0x7f210419b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2103fff700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21040ff750 0x7f210419b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2103fff700 1 -- 172.21.15.70:0/3668537293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21041056b0 msgr2=0x7f2104195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2103fff700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21041056b0 0x7f2104195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2103fff700 1 -- 172.21.15.70:0/3668537293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc009d00 con 0x7f2104100110 2023-10-08T08:43:04.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.692+0000 7f2109331700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21041056b0 0x7f2104195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:04.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.693+0000 7f2103fff700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 0x7f210419beb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e9a0 tx=0x7f20f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:04.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.693+0000 7f2101ffb700 1 -- 172.21.15.70:0/3668537293 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0009790 con 0x7f2104100110 2023-10-08T08:43:04.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.693+0000 7f2101ffb700 1 -- 172.21.15.70:0/3668537293 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20f000cbd0 con 0x7f2104100110 2023-10-08T08:43:04.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.693+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2104196770 con 0x7f2104100110 2023-10-08T08:43:04.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.693+0000 7f2101ffb700 1 -- 172.21.15.70:0/3668537293 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0018680 con 0x7f2104100110 2023-10-08T08:43:04.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.693+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2104068360 con 0x7f2104100110 2023-10-08T08:43:04.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.694+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2104100df0 con 0x7f2104100110 2023-10-08T08:43:04.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.695+0000 7f2101ffb700 1 -- 172.21.15.70:0/3668537293 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f20f000cd40 con 0x7f2104100110 2023-10-08T08:43:04.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.696+0000 7f2101ffb700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20f40a14d0 0x7f20f40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:04.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.696+0000 7f2108b30700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20f40a14d0 0x7f20f40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:04.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.696+0000 7f2101ffb700 1 -- 172.21.15.70:0/3668537293 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f20f0014070 con 0x7f2104100110 2023-10-08T08:43:04.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.696+0000 7f2108b30700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20f40a14d0 0x7f20f40a3990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f20f8005950 tx=0x7f20f800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:04.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.699+0000 7f2101ffb700 1 -- 172.21.15.70:0/3668537293 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f20f0096880 con 0x7f2104100110 2023-10-08T08:43:04.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:04 smithi105 ceph-mon[103798]: pgmap v268: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-08T08:43:04.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:04 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:04 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:04 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:04 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:04.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:04 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/903331185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T08:43:04.814 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705730 got 38654705733 for osd.0 2023-10-08T08:43:04.815 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:04.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.899+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2104196f00 con 0x7f2104100110 2023-10-08T08:43:04.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.900+0000 7f2101ffb700 1 -- 172.21.15.70:0/3668537293 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20f0026020 con 0x7f2104100110 2023-10-08T08:43:04.902 INFO:teuthology.orchestra.run.smithi070.stdout:219043332136 2023-10-08T08:43:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.902+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20f40a14d0 msgr2=0x7f20f40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.902+0000 7f210ad94700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20f40a14d0 0x7f20f40a3990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f20f8005950 tx=0x7f20f800b410 comp rx=0 tx=0).stop 2023-10-08T08:43:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.902+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 msgr2=0x7f210419beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.902+0000 7f210ad94700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 0x7f210419beb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e9a0 tx=0x7f20f000ecb0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.902+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 shutdown_connections 2023-10-08T08:43:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.902+0000 7f210ad94700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f20f40a14d0 0x7f20f40a3990 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f20f8005950 tx=0x7f20f800b410 comp rx=0 tx=0).stop 2023-10-08T08:43:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.902+0000 7f210ad94700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21041056b0 0x7f2104195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.902+0000 7f210ad94700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21040ff750 0x7f210419b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.903+0000 7f210ad94700 1 --2- 172.21.15.70:0/3668537293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2104100110 0x7f210419beb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.903+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 >> 172.21.15.70:0/3668537293 conn(0x7f2104075790 msgr2=0x7f21040fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.903+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 shutdown_connections 2023-10-08T08:43:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:04.903+0000 7f210ad94700 1 -- 172.21.15.70:0/3668537293 wait complete. 2023-10-08T08:43:05.247 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920819 got 141733920821 for osd.4 2023-10-08T08:43:05.247 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:05.514 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:05 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/622723167' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T08:43:05.514 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:05 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3668537293' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T08:43:05.515 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332134 got 219043332136 for osd.7 2023-10-08T08:43:05.515 DEBUG:teuthology.parallel:result is None 2023-10-08T08:43:05.515 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-08T08:43:05.516 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T08:43:05.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:05 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/622723167' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T08:43:05.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:05 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3668537293' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T08:43:05.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:05 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/622723167' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T08:43:05.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:05 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3668537293' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T08:43:06.180 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:06.580 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:06 smithi070 ceph-mon[99513]: pgmap v269: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T08:43:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:06 smithi191 ceph-mon[104220]: pgmap v269: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T08:43:06.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:06 smithi105 ceph-mon[103798]: pgmap v269: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.344+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1654765571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068b30 msgr2=0x7f2a4410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.344+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1654765571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068b30 0x7f2a4410d670 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00b0a0 tx=0x7f2a3c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.344+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1654765571 shutdown_connections 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.344+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1654765571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068b30 0x7f2a4410d670 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.344+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1654765571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a441067a0 0x7f2a44106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.344+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1654765571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a44068190 0x7f2a440685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.344+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1654765571 >> 172.21.15.70:0/1654765571 conn(0x7f2a44075790 msgr2=0x7f2a44075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.344+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1654765571 shutdown_connections 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.344+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1654765571 wait complete. 2023-10-08T08:43:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.345+0000 7f2a4a2b1700 1 Processor -- start 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.345+0000 7f2a4a2b1700 1 -- start start 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.345+0000 7f2a4a2b1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068190 0x7f2a440ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.345+0000 7f2a4a2b1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a44068b30 0x7f2a440ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.345+0000 7f2a4a2b1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a441067a0 0x7f2a441002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.345+0000 7f2a4a2b1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441a50c0 con 0x7f2a44068190 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.345+0000 7f2a4a2b1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441a5230 con 0x7f2a44068b30 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.345+0000 7f2a4a2b1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441a53f0 con 0x7f2a441067a0 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a43fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068190 0x7f2a440ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a43fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068190 0x7f2a440ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49956/0 (socket says 172.21.15.70:49956) 2023-10-08T08:43:07.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a43fff700 1 -- 172.21.15.70:0/1896931749 learned_addr learned my addr 172.21.15.70:0/1896931749 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:07.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a4884e700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a441067a0 0x7f2a441002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:07.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a437fe700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a44068b30 0x7f2a440ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a43fff700 1 -- 172.21.15.70:0/1896931749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a441067a0 msgr2=0x7f2a441002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a43fff700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a441067a0 0x7f2a441002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a43fff700 1 -- 172.21.15.70:0/1896931749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a44068b30 msgr2=0x7f2a440ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a43fff700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a44068b30 0x7f2a440ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a43fff700 1 -- 172.21.15.70:0/1896931749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c009d00 con 0x7f2a44068190 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a437fe700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a44068b30 0x7f2a440ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a43fff700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068190 0x7f2a440ff820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400e9a0 tx=0x7f2a3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a417fa700 1 -- 172.21.15.70:0/1896931749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34009790 con 0x7f2a44068190 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a441a56d0 con 0x7f2a44068190 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a417fa700 1 -- 172.21.15.70:0/1896931749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a3400cbd0 con 0x7f2a44068190 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a417fa700 1 -- 172.21.15.70:0/1896931749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34018680 con 0x7f2a44068190 2023-10-08T08:43:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.346+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a441a5bd0 con 0x7f2a44068190 2023-10-08T08:43:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.347+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44108d50 con 0x7f2a44068190 2023-10-08T08:43:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.348+0000 7f2a417fa700 1 -- 172.21.15.70:0/1896931749 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f2a3400cd40 con 0x7f2a44068190 2023-10-08T08:43:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.349+0000 7f2a417fa700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2a2c0a14d0 0x7f2a2c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.349+0000 7f2a417fa700 1 -- 172.21.15.70:0/1896931749 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2a34014070 con 0x7f2a44068190 2023-10-08T08:43:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.349+0000 7f2a437fe700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2a2c0a14d0 0x7f2a2c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.349+0000 7f2a437fe700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2a2c0a14d0 0x7f2a2c0a3990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a44100f50 tx=0x7f2a38009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:07.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.353+0000 7f2a417fa700 1 -- 172.21.15.70:0/1896931749 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2a34052100 con 0x7f2a44068190 2023-10-08T08:43:07.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.545+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a44100d00 con 0x7f2a2c0a14d0 2023-10-08T08:43:07.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.557+0000 7f2a417fa700 1 -- 172.21.15.70:0/1896931749 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+425686 (secure 0 0 0) 0x7f2a44100d00 con 0x7f2a2c0a14d0 2023-10-08T08:43:07.559 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:07.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2a2c0a14d0 msgr2=0x7f2a2c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:07.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2a2c0a14d0 0x7f2a2c0a3990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a44100f50 tx=0x7f2a38009260 comp rx=0 tx=0).stop 2023-10-08T08:43:07.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068190 msgr2=0x7f2a440ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:07.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068190 0x7f2a440ff820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400e9a0 tx=0x7f2a3400ecb0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 shutdown_connections 2023-10-08T08:43:07.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2a2c0a14d0 0x7f2a2c0a3990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a441067a0 0x7f2a441002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a44068190 0x7f2a440ff820 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 --2- 172.21.15.70:0/1896931749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a44068b30 0x7f2a440ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:07.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 >> 172.21.15.70:0/1896931749 conn(0x7f2a44075790 msgr2=0x7f2a440fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:07.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 shutdown_connections 2023-10-08T08:43:07.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:07.560+0000 7f2a4a2b1700 1 -- 172.21.15.70:0/1896931749 wait complete. 2023-10-08T08:43:07.579 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-10-08T08:43:07.948 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2023-10-08T08:43:07.065083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":525,"num_read_kb":332,"num_write":390,"num_write_kb":3005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":320,"ondisk_log_size":320,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337964,"kb_used_data":13688,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603860,"statfs":{"total":1151940427776,"available":1151594352640,"internally_reserved":0,"allocated":14016512,"data_stored":7712969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003361"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275511+0000","last_change":"2023-10-08T08:42:01.146976+0000","last_active":"2023-10-08T08:42:39.275511+0000","last_peered":"2023-10-08T08:42:39.275511+0000","last_clean":"2023-10-08T08:42:39.275511+0000","last_became_active":"2023-10-08T08:42:01.146184+0000","last_became_peered":"2023-10-08T08:42:01.146184+0000","last_unstale":"2023-10-08T08:42:39.275511+0000","last_undegraded":"2023-10-08T08:42:39.275511+0000","last_fullsized":"2023-10-08T08:42:39.275511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:35.571911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273896+0000","last_change":"2023-10-08T08:42:01.142007+0000","last_active":"2023-10-08T08:42:39.273896+0000","last_peered":"2023-10-08T08:42:39.273896+0000","last_clean":"2023-10-08T08:42:39.273896+0000","last_became_active":"2023-10-08T08:42:01.141630+0000","last_became_peered":"2023-10-08T08:42:01.141630+0000","last_unstale":"2023-10-08T08:42:39.273896+0000","last_undegraded":"2023-10-08T08:42:39.273896+0000","last_fullsized":"2023-10-08T08:42:39.273896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:53.307828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272914+0000","last_change":"2023-10-08T08:42:01.154742+0000","last_active":"2023-10-08T08:42:39.272914+0000","last_peered":"2023-10-08T08:42:39.272914+0000","last_clean":"2023-10-08T08:42:39.272914+0000","last_became_active":"2023-10-08T08:42:01.154439+0000","last_became_peered":"2023-10-08T08:42:01.154439+0000","last_unstale":"2023-10-08T08:42:39.272914+0000","last_undegraded":"2023-10-08T08:42:39.272914+0000","last_fullsized":"2023-10-08T08:42:39.272914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:23.990594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270927+0000","last_change":"2023-10-08T08:42:01.149940+0000","last_active":"2023-10-08T08:42:39.270927+0000","last_peered":"2023-10-08T08:42:39.270927+0000","last_clean":"2023-10-08T08:42:39.270927+0000","last_became_active":"2023-10-08T08:42:01.149628+0000","last_became_peered":"2023-10-08T08:42:01.149628+0000","last_unstale":"2023-10-08T08:42:39.270927+0000","last_undegraded":"2023-10-08T08:42:39.270927+0000","last_fullsized":"2023-10-08T08:42:39.270927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:38.961102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272780+0000","last_change":"2023-10-08T08:42:01.145396+0000","last_active":"2023-10-08T08:42:39.272780+0000","last_peered":"2023-10-08T08:42:39.272780+0000","last_clean":"2023-10-08T08:42:39.272780+0000","last_became_active":"2023-10-08T08:42:01.140511+0000","last_became_peered":"2023-10-08T08:42:01.140511+0000","last_unstale":"2023-10-08T08:42:39.272780+0000","last_undegraded":"2023-10-08T08:42:39.272780+0000","last_fullsized":"2023-10-08T08:42:39.272780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:38.079768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273059+0000","last_change":"2023-10-08T08:42:01.128798+0000","last_active":"2023-10-08T08:42:39.273059+0000","last_peered":"2023-10-08T08:42:39.273059+0000","last_clean":"2023-10-08T08:42:39.273059+0000","last_became_active":"2023-10-08T08:42:01.128485+0000","last_became_peered":"2023-10-08T08:42:01.128485+0000","last_unstale":"2023-10-08T08:42:39.273059+0000","last_undegraded":"2023-10-08T08:42:39.273059+0000","last_fullsized":"2023-10-08T08:42:39.273059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:33:59.121551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277231+0000","last_change":"2023-10-08T08:42:01.136315+0000","last_active":"2023-10-08T08:42:39.277231+0000","last_peered":"2023-10-08T08:42:39.277231+0000","last_clean":"2023-10-08T08:42:39.277231+0000","last_became_active":"2023-10-08T08:42:01.136025+0000","last_became_peered":"2023-10-08T08:42:01.136025+0000","last_unstale":"2023-10-08T08:42:39.277231+0000","last_undegraded":"2023-10-08T08:42:39.277231+0000","last_fullsized":"2023-10-08T08:42:39.277231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:35.675920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269573+0000","last_change":"2023-10-08T08:42:01.129839+0000","last_active":"2023-10-08T08:42:39.269573+0000","last_peered":"2023-10-08T08:42:39.269573+0000","last_clean":"2023-10-08T08:42:39.269573+0000","last_became_active":"2023-10-08T08:42:01.129524+0000","last_became_peered":"2023-10-08T08:42:01.129524+0000","last_unstale":"2023-10-08T08:42:39.269573+0000","last_undegraded":"2023-10-08T08:42:39.269573+0000","last_fullsized":"2023-10-08T08:42:39.269573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:44.463024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276906+0000","last_change":"2023-10-08T08:42:01.135304+0000","last_active":"2023-10-08T08:42:39.276906+0000","last_peered":"2023-10-08T08:42:39.276906+0000","last_clean":"2023-10-08T08:42:39.276906+0000","last_became_active":"2023-10-08T08:42:01.134978+0000","last_became_peered":"2023-10-08T08:42:01.134978+0000","last_unstale":"2023-10-08T08:42:39.276906+0000","last_undegraded":"2023-10-08T08:42:39.276906+0000","last_fullsized":"2023-10-08T08:42:39.276906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:46:03.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273758+0000","last_change":"2023-10-08T08:42:01.134686+0000","last_active":"2023-10-08T08:42:39.273758+0000","last_peered":"2023-10-08T08:42:39.273758+0000","last_clean":"2023-10-08T08:42:39.273758+0000","last_became_active":"2023-10-08T08:42:01.134360+0000","last_became_peered":"2023-10-08T08:42:01.134360+0000","last_unstale":"2023-10-08T08:42:39.273758+0000","last_undegraded":"2023-10-08T08:42:39.273758+0000","last_fullsized":"2023-10-08T08:42:39.273758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:56.814182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278374+0000","last_change":"2023-10-08T08:42:01.148309+0000","last_active":"2023-10-08T08:42:39.278374+0000","last_peered":"2023-10-08T08:42:39.278374+0000","last_clean":"2023-10-08T08:42:39.278374+0000","last_became_active":"2023-10-08T08:42:01.147964+0000","last_became_peered":"2023-10-08T08:42:01.147964+0000","last_unstale":"2023-10-08T08:42:39.278374+0000","last_undegraded":"2023-10-08T08:42:39.278374+0000","last_fullsized":"2023-10-08T08:42:39.278374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:45.418572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270831+0000","last_change":"2023-10-08T08:42:01.148141+0000","last_active":"2023-10-08T08:42:39.270831+0000","last_peered":"2023-10-08T08:42:39.270831+0000","last_clean":"2023-10-08T08:42:39.270831+0000","last_became_active":"2023-10-08T08:42:01.147788+0000","last_became_peered":"2023-10-08T08:42:01.147788+0000","last_unstale":"2023-10-08T08:42:39.270831+0000","last_undegraded":"2023-10-08T08:42:39.270831+0000","last_fullsized":"2023-10-08T08:42:39.270831+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:37.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696516+0000","last_change":"2023-10-08T08:42:40.696516+0000","last_active":"2023-10-08T08:42:40.696516+0000","last_peered":"2023-10-08T08:42:40.696516+0000","last_clean":"2023-10-08T08:42:40.696516+0000","last_became_active":"2023-10-08T08:42:40.696193+0000","last_became_peered":"2023-10-08T08:42:40.696193+0000","last_unstale":"2023-10-08T08:42:40.696516+0000","last_undegraded":"2023-10-08T08:42:40.696516+0000","last_fullsized":"2023-10-08T08:42:40.696516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:40:57.843021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:01.148031+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:01.147785+0000","last_became_peered":"2023-10-08T08:42:01.147785+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:43.702638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272901+0000","last_change":"2023-10-08T08:42:01.154669+0000","last_active":"2023-10-08T08:42:39.272901+0000","last_peered":"2023-10-08T08:42:39.272901+0000","last_clean":"2023-10-08T08:42:39.272901+0000","last_became_active":"2023-10-08T08:42:01.154385+0000","last_became_peered":"2023-10-08T08:42:01.154385+0000","last_unstale":"2023-10-08T08:42:39.272901+0000","last_undegraded":"2023-10-08T08:42:39.272901+0000","last_fullsized":"2023-10-08T08:42:39.272901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:41.654979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275659+0000","last_change":"2023-10-08T08:42:01.143017+0000","last_active":"2023-10-08T08:42:39.275659+0000","last_peered":"2023-10-08T08:42:39.275659+0000","last_clean":"2023-10-08T08:42:39.275659+0000","last_became_active":"2023-10-08T08:42:01.142728+0000","last_became_peered":"2023-10-08T08:42:01.142728+0000","last_unstale":"2023-10-08T08:42:39.275659+0000","last_undegraded":"2023-10-08T08:42:39.275659+0000","last_fullsized":"2023-10-08T08:42:39.275659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.303212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275414+0000","last_change":"2023-10-08T08:42:01.147335+0000","last_active":"2023-10-08T08:42:39.275414+0000","last_peered":"2023-10-08T08:42:39.275414+0000","last_clean":"2023-10-08T08:42:39.275414+0000","last_became_active":"2023-10-08T08:42:01.146641+0000","last_became_peered":"2023-10-08T08:42:01.146641+0000","last_unstale":"2023-10-08T08:42:39.275414+0000","last_undegraded":"2023-10-08T08:42:39.275414+0000","last_fullsized":"2023-10-08T08:42:39.275414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:27.274207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275754+0000","last_change":"2023-10-08T08:42:01.132417+0000","last_active":"2023-10-08T08:42:39.275754+0000","last_peered":"2023-10-08T08:42:39.275754+0000","last_clean":"2023-10-08T08:42:39.275754+0000","last_became_active":"2023-10-08T08:42:01.132135+0000","last_became_peered":"2023-10-08T08:42:01.132135+0000","last_unstale":"2023-10-08T08:42:39.275754+0000","last_undegraded":"2023-10-08T08:42:39.275754+0000","last_fullsized":"2023-10-08T08:42:39.275754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:11.916677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279495+0000","last_change":"2023-10-08T08:42:01.136100+0000","last_active":"2023-10-08T08:42:39.279495+0000","last_peered":"2023-10-08T08:42:39.279495+0000","last_clean":"2023-10-08T08:42:39.279495+0000","last_became_active":"2023-10-08T08:42:01.135826+0000","last_became_peered":"2023-10-08T08:42:01.135826+0000","last_unstale":"2023-10-08T08:42:39.279495+0000","last_undegraded":"2023-10-08T08:42:39.279495+0000","last_fullsized":"2023-10-08T08:42:39.279495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:03.734296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279138+0000","last_change":"2023-10-08T08:42:05.177765+0000","last_active":"2023-10-08T08:42:39.279138+0000","last_peered":"2023-10-08T08:42:39.279138+0000","last_clean":"2023-10-08T08:42:39.279138+0000","last_became_active":"2023-10-08T08:42:05.177362+0000","last_became_peered":"2023-10-08T08:42:05.177362+0000","last_unstale":"2023-10-08T08:42:39.279138+0000","last_undegraded":"2023-10-08T08:42:39.279138+0000","last_fullsized":"2023-10-08T08:42:39.279138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:21.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:03.147351+0000","last_change":"2023-10-08T08:42:00.111581+0000","last_active":"2023-10-08T08:43:03.147351+0000","last_peered":"2023-10-08T08:43:03.147351+0000","last_clean":"2023-10-08T08:43:03.147351+0000","last_became_active":"2023-10-08T08:42:00.111298+0000","last_became_peered":"2023-10-08T08:42:00.111298+0000","last_unstale":"2023-10-08T08:43:03.147351+0000","last_undegraded":"2023-10-08T08:43:03.147351+0000","last_fullsized":"2023-10-08T08:43:03.147351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:52:39.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270526+0000","last_change":"2023-10-08T08:42:01.134630+0000","last_active":"2023-10-08T08:42:39.270526+0000","last_peered":"2023-10-08T08:42:39.270526+0000","last_clean":"2023-10-08T08:42:39.270526+0000","last_became_active":"2023-10-08T08:42:01.134347+0000","last_became_peered":"2023-10-08T08:42:01.134347+0000","last_unstale":"2023-10-08T08:42:39.270526+0000","last_undegraded":"2023-10-08T08:42:39.270526+0000","last_fullsized":"2023-10-08T08:42:39.270526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:51:14.364756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270287+0000","last_change":"2023-10-08T08:42:05.177223+0000","last_active":"2023-10-08T08:42:39.270287+0000","last_peered":"2023-10-08T08:42:39.270287+0000","last_clean":"2023-10-08T08:42:39.270287+0000","last_became_active":"2023-10-08T08:42:05.176811+0000","last_became_peered":"2023-10-08T08:42:05.176811+0000","last_unstale":"2023-10-08T08:42:39.270287+0000","last_undegraded":"2023-10-08T08:42:39.270287+0000","last_fullsized":"2023-10-08T08:42:39.270287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:41.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270575+0000","last_change":"2023-10-08T08:42:00.115860+0000","last_active":"2023-10-08T08:42:39.270575+0000","last_peered":"2023-10-08T08:42:39.270575+0000","last_clean":"2023-10-08T08:42:39.270575+0000","last_became_active":"2023-10-08T08:42:00.115601+0000","last_became_peered":"2023-10-08T08:42:00.115601+0000","last_unstale":"2023-10-08T08:42:39.270575+0000","last_undegraded":"2023-10-08T08:42:39.270575+0000","last_fullsized":"2023-10-08T08:42:39.270575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:20.071545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274100+0000","last_change":"2023-10-08T08:42:01.146648+0000","last_active":"2023-10-08T08:42:39.274100+0000","last_peered":"2023-10-08T08:42:39.274100+0000","last_clean":"2023-10-08T08:42:39.274100+0000","last_became_active":"2023-10-08T08:42:01.145978+0000","last_became_peered":"2023-10-08T08:42:01.145978+0000","last_unstale":"2023-10-08T08:42:39.274100+0000","last_undegraded":"2023-10-08T08:42:39.274100+0000","last_fullsized":"2023-10-08T08:42:39.274100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:55.768519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270396+0000","last_change":"2023-10-08T08:42:05.185079+0000","last_active":"2023-10-08T08:42:39.270396+0000","last_peered":"2023-10-08T08:42:39.270396+0000","last_clean":"2023-10-08T08:42:39.270396+0000","last_became_active":"2023-10-08T08:42:05.184521+0000","last_became_peered":"2023-10-08T08:42:05.184521+0000","last_unstale":"2023-10-08T08:42:39.270396+0000","last_undegraded":"2023-10-08T08:42:39.270396+0000","last_fullsized":"2023-10-08T08:42:39.270396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:39:17.457051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273959+0000","last_change":"2023-10-08T08:42:00.112111+0000","last_active":"2023-10-08T08:42:39.273959+0000","last_peered":"2023-10-08T08:42:39.273959+0000","last_clean":"2023-10-08T08:42:39.273959+0000","last_became_active":"2023-10-08T08:42:00.111808+0000","last_became_peered":"2023-10-08T08:42:00.111808+0000","last_unstale":"2023-10-08T08:42:39.273959+0000","last_undegraded":"2023-10-08T08:42:39.273959+0000","last_fullsized":"2023-10-08T08:42:39.273959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:03.022378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276049+0000","last_change":"2023-10-08T08:42:01.133308+0000","last_active":"2023-10-08T08:42:39.276049+0000","last_peered":"2023-10-08T08:42:39.276049+0000","last_clean":"2023-10-08T08:42:39.276049+0000","last_became_active":"2023-10-08T08:42:01.131649+0000","last_became_peered":"2023-10-08T08:42:01.131649+0000","last_unstale":"2023-10-08T08:42:39.276049+0000","last_undegraded":"2023-10-08T08:42:39.276049+0000","last_fullsized":"2023-10-08T08:42:39.276049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:05.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270293+0000","last_change":"2023-10-08T08:42:05.182409+0000","last_active":"2023-10-08T08:42:39.270293+0000","last_peered":"2023-10-08T08:42:39.270293+0000","last_clean":"2023-10-08T08:42:39.270293+0000","last_became_active":"2023-10-08T08:42:05.181974+0000","last_became_peered":"2023-10-08T08:42:05.181974+0000","last_unstale":"2023-10-08T08:42:39.270293+0000","last_undegraded":"2023-10-08T08:42:39.270293+0000","last_fullsized":"2023-10-08T08:42:39.270293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:05.821339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273251+0000","last_change":"2023-10-08T08:42:00.113287+0000","last_active":"2023-10-08T08:42:39.273251+0000","last_peered":"2023-10-08T08:42:39.273251+0000","last_clean":"2023-10-08T08:42:39.273251+0000","last_became_active":"2023-10-08T08:42:00.112996+0000","last_became_peered":"2023-10-08T08:42:00.112996+0000","last_unstale":"2023-10-08T08:42:39.273251+0000","last_undegraded":"2023-10-08T08:42:39.273251+0000","last_fullsized":"2023-10-08T08:42:39.273251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:42.559360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276426+0000","last_change":"2023-10-08T08:42:01.139763+0000","last_active":"2023-10-08T08:42:39.276426+0000","last_peered":"2023-10-08T08:42:39.276426+0000","last_clean":"2023-10-08T08:42:39.276426+0000","last_became_active":"2023-10-08T08:42:01.139451+0000","last_became_peered":"2023-10-08T08:42:01.139451+0000","last_unstale":"2023-10-08T08:42:39.276426+0000","last_undegraded":"2023-10-08T08:42:39.276426+0000","last_fullsized":"2023-10-08T08:42:39.276426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:10.166151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279067+0000","last_change":"2023-10-08T08:42:05.174612+0000","last_active":"2023-10-08T08:42:39.279067+0000","last_peered":"2023-10-08T08:42:39.279067+0000","last_clean":"2023-10-08T08:42:39.279067+0000","last_became_active":"2023-10-08T08:42:05.174174+0000","last_became_peered":"2023-10-08T08:42:05.174174+0000","last_unstale":"2023-10-08T08:42:39.279067+0000","last_undegraded":"2023-10-08T08:42:39.279067+0000","last_fullsized":"2023-10-08T08:42:39.279067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:07.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:03.136533+0000","last_change":"2023-10-08T08:42:00.112537+0000","last_active":"2023-10-08T08:43:03.136533+0000","last_peered":"2023-10-08T08:43:03.136533+0000","last_clean":"2023-10-08T08:43:03.136533+0000","last_became_active":"2023-10-08T08:42:00.112060+0000","last_became_peered":"2023-10-08T08:42:00.112060+0000","last_unstale":"2023-10-08T08:43:03.136533+0000","last_undegraded":"2023-10-08T08:43:03.136533+0000","last_fullsized":"2023-10-08T08:43:03.136533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:41.878960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273799+0000","last_change":"2023-10-08T08:42:01.146929+0000","last_active":"2023-10-08T08:42:39.273799+0000","last_peered":"2023-10-08T08:42:39.273799+0000","last_clean":"2023-10-08T08:42:39.273799+0000","last_became_active":"2023-10-08T08:42:01.145980+0000","last_became_peered":"2023-10-08T08:42:01.145980+0000","last_unstale":"2023-10-08T08:42:39.273799+0000","last_undegraded":"2023-10-08T08:42:39.273799+0000","last_fullsized":"2023-10-08T08:42:39.273799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:37.411832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.443543+0000","last_change":"2023-10-08T08:42:40.443543+0000","last_active":"2023-10-08T08:42:40.443543+0000","last_peered":"2023-10-08T08:42:40.443543+0000","last_clean":"2023-10-08T08:42:40.443543+0000","last_became_active":"2023-10-08T08:42:40.443041+0000","last_became_peered":"2023-10-08T08:42:40.443041+0000","last_unstale":"2023-10-08T08:42:40.443543+0000","last_undegraded":"2023-10-08T08:42:40.443543+0000","last_fullsized":"2023-10-08T08:42:40.443543+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:21:35.827659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:00.115656+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:00.115342+0000","last_became_peered":"2023-10-08T08:42:00.115342+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:32.630853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277813+0000","last_change":"2023-10-08T08:42:01.139137+0000","last_active":"2023-10-08T08:42:39.277813+0000","last_peered":"2023-10-08T08:42:39.277813+0000","last_clean":"2023-10-08T08:42:39.277813+0000","last_became_active":"2023-10-08T08:42:01.138510+0000","last_became_peered":"2023-10-08T08:42:01.138510+0000","last_unstale":"2023-10-08T08:42:39.277813+0000","last_undegraded":"2023-10-08T08:42:39.277813+0000","last_fullsized":"2023-10-08T08:42:39.277813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:16:28.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275308+0000","last_change":"2023-10-08T08:42:05.179770+0000","last_active":"2023-10-08T08:42:39.275308+0000","last_peered":"2023-10-08T08:42:39.275308+0000","last_clean":"2023-10-08T08:42:39.275308+0000","last_became_active":"2023-10-08T08:42:05.179312+0000","last_became_peered":"2023-10-08T08:42:05.179312+0000","last_unstale":"2023-10-08T08:42:39.275308+0000","last_undegraded":"2023-10-08T08:42:39.275308+0000","last_fullsized":"2023-10-08T08:42:39.275308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.947270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276681+0000","last_change":"2023-10-08T08:42:00.111299+0000","last_active":"2023-10-08T08:42:39.276681+0000","last_peered":"2023-10-08T08:42:39.276681+0000","last_clean":"2023-10-08T08:42:39.276681+0000","last_became_active":"2023-10-08T08:42:00.110966+0000","last_became_peered":"2023-10-08T08:42:00.110966+0000","last_unstale":"2023-10-08T08:42:39.276681+0000","last_undegraded":"2023-10-08T08:42:39.276681+0000","last_fullsized":"2023-10-08T08:42:39.276681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:34.211598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269504+0000","last_change":"2023-10-08T08:42:01.134205+0000","last_active":"2023-10-08T08:42:39.269504+0000","last_peered":"2023-10-08T08:42:39.269504+0000","last_clean":"2023-10-08T08:42:39.269504+0000","last_became_active":"2023-10-08T08:42:01.133887+0000","last_became_peered":"2023-10-08T08:42:01.133887+0000","last_unstale":"2023-10-08T08:42:39.269504+0000","last_undegraded":"2023-10-08T08:42:39.269504+0000","last_fullsized":"2023-10-08T08:42:39.269504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:01.807150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273842+0000","last_change":"2023-10-08T08:42:05.179119+0000","last_active":"2023-10-08T08:42:39.273842+0000","last_peered":"2023-10-08T08:42:39.273842+0000","last_clean":"2023-10-08T08:42:39.273842+0000","last_became_active":"2023-10-08T08:42:05.178712+0000","last_became_peered":"2023-10-08T08:42:05.178712+0000","last_unstale":"2023-10-08T08:42:39.273842+0000","last_undegraded":"2023-10-08T08:42:39.273842+0000","last_fullsized":"2023-10-08T08:42:39.273842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:54:38.514047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278470+0000","last_change":"2023-10-08T08:42:00.116426+0000","last_active":"2023-10-08T08:42:39.278470+0000","last_peered":"2023-10-08T08:42:39.278470+0000","last_clean":"2023-10-08T08:42:39.278470+0000","last_became_active":"2023-10-08T08:42:00.115313+0000","last_became_peered":"2023-10-08T08:42:00.115313+0000","last_unstale":"2023-10-08T08:42:39.278470+0000","last_undegraded":"2023-10-08T08:42:39.278470+0000","last_fullsized":"2023-10-08T08:42:39.278470+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:42.989380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275493+0000","last_change":"2023-10-08T08:42:01.129719+0000","last_active":"2023-10-08T08:42:39.275493+0000","last_peered":"2023-10-08T08:42:39.275493+0000","last_clean":"2023-10-08T08:42:39.275493+0000","last_became_active":"2023-10-08T08:42:01.129293+0000","last_became_peered":"2023-10-08T08:42:01.129293+0000","last_unstale":"2023-10-08T08:42:39.275493+0000","last_undegraded":"2023-10-08T08:42:39.275493+0000","last_fullsized":"2023-10-08T08:42:39.275493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:35.463614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269587+0000","last_change":"2023-10-08T08:42:05.172880+0000","last_active":"2023-10-08T08:42:39.269587+0000","last_peered":"2023-10-08T08:42:39.269587+0000","last_clean":"2023-10-08T08:42:39.269587+0000","last_became_active":"2023-10-08T08:42:05.172485+0000","last_became_peered":"2023-10-08T08:42:05.172485+0000","last_unstale":"2023-10-08T08:42:39.269587+0000","last_undegraded":"2023-10-08T08:42:39.269587+0000","last_fullsized":"2023-10-08T08:42:39.269587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:29.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:04.137170+0000","last_change":"2023-10-08T08:42:00.115206+0000","last_active":"2023-10-08T08:43:04.137170+0000","last_peered":"2023-10-08T08:43:04.137170+0000","last_clean":"2023-10-08T08:43:04.137170+0000","last_became_active":"2023-10-08T08:42:00.114905+0000","last_became_peered":"2023-10-08T08:42:00.114905+0000","last_unstale":"2023-10-08T08:43:04.137170+0000","last_undegraded":"2023-10-08T08:43:04.137170+0000","last_fullsized":"2023-10-08T08:43:04.137170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:09.275317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276638+0000","last_change":"2023-10-08T08:42:01.141422+0000","last_active":"2023-10-08T08:42:39.276638+0000","last_peered":"2023-10-08T08:42:39.276638+0000","last_clean":"2023-10-08T08:42:39.276638+0000","last_became_active":"2023-10-08T08:42:01.140979+0000","last_became_peered":"2023-10-08T08:42:01.140979+0000","last_unstale":"2023-10-08T08:42:39.276638+0000","last_undegraded":"2023-10-08T08:42:39.276638+0000","last_fullsized":"2023-10-08T08:42:39.276638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:14.018786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275152+0000","last_change":"2023-10-08T08:42:05.184358+0000","last_active":"2023-10-08T08:42:39.275152+0000","last_peered":"2023-10-08T08:42:39.275152+0000","last_clean":"2023-10-08T08:42:39.275152+0000","last_became_active":"2023-10-08T08:42:05.183994+0000","last_became_peered":"2023-10-08T08:42:05.183994+0000","last_unstale":"2023-10-08T08:42:39.275152+0000","last_undegraded":"2023-10-08T08:42:39.275152+0000","last_fullsized":"2023-10-08T08:42:39.275152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:46.465110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277535+0000","last_change":"2023-10-08T08:42:00.115765+0000","last_active":"2023-10-08T08:42:39.277535+0000","last_peered":"2023-10-08T08:42:39.277535+0000","last_clean":"2023-10-08T08:42:39.277535+0000","last_became_active":"2023-10-08T08:42:00.115288+0000","last_became_peered":"2023-10-08T08:42:00.115288+0000","last_unstale":"2023-10-08T08:42:39.277535+0000","last_undegraded":"2023-10-08T08:42:39.277535+0000","last_fullsized":"2023-10-08T08:42:39.277535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:20.973280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273767+0000","last_change":"2023-10-08T08:42:01.143290+0000","last_active":"2023-10-08T08:42:39.273767+0000","last_peered":"2023-10-08T08:42:39.273767+0000","last_clean":"2023-10-08T08:42:39.273767+0000","last_became_active":"2023-10-08T08:42:01.143034+0000","last_became_peered":"2023-10-08T08:42:01.143034+0000","last_unstale":"2023-10-08T08:42:39.273767+0000","last_undegraded":"2023-10-08T08:42:39.273767+0000","last_fullsized":"2023-10-08T08:42:39.273767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:45.784275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.271060+0000","last_change":"2023-10-08T08:42:05.185022+0000","last_active":"2023-10-08T08:42:39.271060+0000","last_peered":"2023-10-08T08:42:39.271060+0000","last_clean":"2023-10-08T08:42:39.271060+0000","last_became_active":"2023-10-08T08:42:05.184476+0000","last_became_peered":"2023-10-08T08:42:05.184476+0000","last_unstale":"2023-10-08T08:42:39.271060+0000","last_undegraded":"2023-10-08T08:42:39.271060+0000","last_fullsized":"2023-10-08T08:42:39.271060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:14:04.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276317+0000","last_change":"2023-10-08T08:42:00.115556+0000","last_active":"2023-10-08T08:42:39.276317+0000","last_peered":"2023-10-08T08:42:39.276317+0000","last_clean":"2023-10-08T08:42:39.276317+0000","last_became_active":"2023-10-08T08:42:00.115251+0000","last_became_peered":"2023-10-08T08:42:00.115251+0000","last_unstale":"2023-10-08T08:42:39.276317+0000","last_undegraded":"2023-10-08T08:42:39.276317+0000","last_fullsized":"2023-10-08T08:42:39.276317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:55.439502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276120+0000","last_change":"2023-10-08T08:42:01.135969+0000","last_active":"2023-10-08T08:42:39.276120+0000","last_peered":"2023-10-08T08:42:39.276120+0000","last_clean":"2023-10-08T08:42:39.276120+0000","last_became_active":"2023-10-08T08:42:01.135615+0000","last_became_peered":"2023-10-08T08:42:01.135615+0000","last_unstale":"2023-10-08T08:42:39.276120+0000","last_undegraded":"2023-10-08T08:42:39.276120+0000","last_fullsized":"2023-10-08T08:42:39.276120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:23.153920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276151+0000","last_change":"2023-10-08T08:42:05.177904+0000","last_active":"2023-10-08T08:42:39.276151+0000","last_peered":"2023-10-08T08:42:39.276151+0000","last_clean":"2023-10-08T08:42:39.276151+0000","last_became_active":"2023-10-08T08:42:05.176397+0000","last_became_peered":"2023-10-08T08:42:05.176397+0000","last_unstale":"2023-10-08T08:42:39.276151+0000","last_undegraded":"2023-10-08T08:42:39.276151+0000","last_fullsized":"2023-10-08T08:42:39.276151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:50.134974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'14","reported_seq":107,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:04.137212+0000","last_change":"2023-10-08T08:42:00.114485+0000","last_active":"2023-10-08T08:43:04.137212+0000","last_peered":"2023-10-08T08:43:04.137212+0000","last_clean":"2023-10-08T08:43:04.137212+0000","last_became_active":"2023-10-08T08:42:00.114186+0000","last_became_peered":"2023-10-08T08:42:00.114186+0000","last_unstale":"2023-10-08T08:43:04.137212+0000","last_undegraded":"2023-10-08T08:43:04.137212+0000","last_fullsized":"2023-10-08T08:43:04.137212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:30.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":74,"num_read_kb":41,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273394+0000","last_change":"2023-10-08T08:42:01.146627+0000","last_active":"2023-10-08T08:42:39.273394+0000","last_peered":"2023-10-08T08:42:39.273394+0000","last_clean":"2023-10-08T08:42:39.273394+0000","last_became_active":"2023-10-08T08:42:01.146332+0000","last_became_peered":"2023-10-08T08:42:01.146332+0000","last_unstale":"2023-10-08T08:42:39.273394+0000","last_undegraded":"2023-10-08T08:42:39.273394+0000","last_fullsized":"2023-10-08T08:42:39.273394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:00.825191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278530+0000","last_change":"2023-10-08T08:42:05.173257+0000","last_active":"2023-10-08T08:42:39.278530+0000","last_peered":"2023-10-08T08:42:39.278530+0000","last_clean":"2023-10-08T08:42:39.278530+0000","last_became_active":"2023-10-08T08:42:05.172891+0000","last_became_peered":"2023-10-08T08:42:05.172891+0000","last_unstale":"2023-10-08T08:42:39.278530+0000","last_undegraded":"2023-10-08T08:42:39.278530+0000","last_fullsized":"2023-10-08T08:42:39.278530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:32.802194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279368+0000","last_change":"2023-10-08T08:42:00.113330+0000","last_active":"2023-10-08T08:42:39.279368+0000","last_peered":"2023-10-08T08:42:39.279368+0000","last_clean":"2023-10-08T08:42:39.279368+0000","last_became_active":"2023-10-08T08:42:00.112183+0000","last_became_peered":"2023-10-08T08:42:00.112183+0000","last_unstale":"2023-10-08T08:42:39.279368+0000","last_undegraded":"2023-10-08T08:42:39.279368+0000","last_fullsized":"2023-10-08T08:42:39.279368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:13.158570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275089+0000","last_change":"2023-10-08T08:42:01.133854+0000","last_active":"2023-10-08T08:42:39.275089+0000","last_peered":"2023-10-08T08:42:39.275089+0000","last_clean":"2023-10-08T08:42:39.275089+0000","last_became_active":"2023-10-08T08:42:01.133540+0000","last_became_peered":"2023-10-08T08:42:01.133540+0000","last_unstale":"2023-10-08T08:42:39.275089+0000","last_undegraded":"2023-10-08T08:42:39.275089+0000","last_fullsized":"2023-10-08T08:42:39.275089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:50.011909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275437+0000","last_change":"2023-10-08T08:42:05.180359+0000","last_active":"2023-10-08T08:42:39.275437+0000","last_peered":"2023-10-08T08:42:39.275437+0000","last_clean":"2023-10-08T08:42:39.275437+0000","last_became_active":"2023-10-08T08:42:05.179877+0000","last_became_peered":"2023-10-08T08:42:05.179877+0000","last_unstale":"2023-10-08T08:42:39.275437+0000","last_undegraded":"2023-10-08T08:42:39.275437+0000","last_fullsized":"2023-10-08T08:42:39.275437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:52.926297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276709+0000","last_change":"2023-10-08T08:42:00.112036+0000","last_active":"2023-10-08T08:42:39.276709+0000","last_peered":"2023-10-08T08:42:39.276709+0000","last_clean":"2023-10-08T08:42:39.276709+0000","last_became_active":"2023-10-08T08:42:00.111710+0000","last_became_peered":"2023-10-08T08:42:00.111710+0000","last_unstale":"2023-10-08T08:42:39.276709+0000","last_undegraded":"2023-10-08T08:42:39.276709+0000","last_fullsized":"2023-10-08T08:42:39.276709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:58:16.004802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277573+0000","last_change":"2023-10-08T08:42:01.135245+0000","last_active":"2023-10-08T08:42:39.277573+0000","last_peered":"2023-10-08T08:42:39.277573+0000","last_clean":"2023-10-08T08:42:39.277573+0000","last_became_active":"2023-10-08T08:42:01.134941+0000","last_became_peered":"2023-10-08T08:42:01.134941+0000","last_unstale":"2023-10-08T08:42:39.277573+0000","last_undegraded":"2023-10-08T08:42:39.277573+0000","last_fullsized":"2023-10-08T08:42:39.277573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:13.745895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.282736+0000","last_change":"2023-10-08T08:42:40.281786+0000","last_active":"2023-10-08T08:42:40.282736+0000","last_peered":"2023-10-08T08:42:40.282736+0000","last_clean":"2023-10-08T08:42:40.282736+0000","last_became_active":"2023-10-08T08:42:40.280780+0000","last_became_peered":"2023-10-08T08:42:40.280780+0000","last_unstale":"2023-10-08T08:42:40.282736+0000","last_undegraded":"2023-10-08T08:42:40.282736+0000","last_fullsized":"2023-10-08T08:42:40.282736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:49.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:04.138486+0000","last_change":"2023-10-08T08:42:00.112610+0000","last_active":"2023-10-08T08:43:04.138486+0000","last_peered":"2023-10-08T08:43:04.138486+0000","last_clean":"2023-10-08T08:43:04.138486+0000","last_became_active":"2023-10-08T08:42:00.112313+0000","last_became_peered":"2023-10-08T08:42:00.112313+0000","last_unstale":"2023-10-08T08:43:04.138486+0000","last_undegraded":"2023-10-08T08:43:04.138486+0000","last_fullsized":"2023-10-08T08:43:04.138486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:35.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277060+0000","last_change":"2023-10-08T08:42:01.141538+0000","last_active":"2023-10-08T08:42:39.277060+0000","last_peered":"2023-10-08T08:42:39.277060+0000","last_clean":"2023-10-08T08:42:39.277060+0000","last_became_active":"2023-10-08T08:42:01.141241+0000","last_became_peered":"2023-10-08T08:42:01.141241+0000","last_unstale":"2023-10-08T08:42:39.277060+0000","last_undegraded":"2023-10-08T08:42:39.277060+0000","last_fullsized":"2023-10-08T08:42:39.277060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:41.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275573+0000","last_change":"2023-10-08T08:42:05.181949+0000","last_active":"2023-10-08T08:42:39.275573+0000","last_peered":"2023-10-08T08:42:39.275573+0000","last_clean":"2023-10-08T08:42:39.275573+0000","last_became_active":"2023-10-08T08:42:05.181532+0000","last_became_peered":"2023-10-08T08:42:05.181532+0000","last_unstale":"2023-10-08T08:42:39.275573+0000","last_undegraded":"2023-10-08T08:42:39.275573+0000","last_fullsized":"2023-10-08T08:42:39.275573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:44.035004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272872+0000","last_change":"2023-10-08T08:42:00.111175+0000","last_active":"2023-10-08T08:42:39.272872+0000","last_peered":"2023-10-08T08:42:39.272872+0000","last_clean":"2023-10-08T08:42:39.272872+0000","last_became_active":"2023-10-08T08:42:00.109672+0000","last_became_peered":"2023-10-08T08:42:00.109672+0000","last_unstale":"2023-10-08T08:42:39.272872+0000","last_undegraded":"2023-10-08T08:42:39.272872+0000","last_fullsized":"2023-10-08T08:42:39.272872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:42.715127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278596+0000","last_change":"2023-10-08T08:42:01.133910+0000","last_active":"2023-10-08T08:42:39.278596+0000","last_peered":"2023-10-08T08:42:39.278596+0000","last_clean":"2023-10-08T08:42:39.278596+0000","last_became_active":"2023-10-08T08:42:01.132738+0000","last_became_peered":"2023-10-08T08:42:01.132738+0000","last_unstale":"2023-10-08T08:42:39.278596+0000","last_undegraded":"2023-10-08T08:42:39.278596+0000","last_fullsized":"2023-10-08T08:42:39.278596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:19.966595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276206+0000","last_change":"2023-10-08T08:42:05.177048+0000","last_active":"2023-10-08T08:42:39.276206+0000","last_peered":"2023-10-08T08:42:39.276206+0000","last_clean":"2023-10-08T08:42:39.276206+0000","last_became_active":"2023-10-08T08:42:05.176654+0000","last_became_peered":"2023-10-08T08:42:05.176654+0000","last_unstale":"2023-10-08T08:42:39.276206+0000","last_undegraded":"2023-10-08T08:42:39.276206+0000","last_fullsized":"2023-10-08T08:42:39.276206+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:22.424769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274788+0000","last_change":"2023-10-08T08:42:00.112684+0000","last_active":"2023-10-08T08:42:39.274788+0000","last_peered":"2023-10-08T08:42:39.274788+0000","last_clean":"2023-10-08T08:42:39.274788+0000","last_became_active":"2023-10-08T08:42:00.112235+0000","last_became_peered":"2023-10-08T08:42:00.112235+0000","last_unstale":"2023-10-08T08:42:39.274788+0000","last_undegraded":"2023-10-08T08:42:39.274788+0000","last_fullsized":"2023-10-08T08:42:39.274788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:47.984940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276005+0000","last_change":"2023-10-08T08:42:01.133393+0000","last_active":"2023-10-08T08:42:39.276005+0000","last_peered":"2023-10-08T08:42:39.276005+0000","last_clean":"2023-10-08T08:42:39.276005+0000","last_became_active":"2023-10-08T08:42:01.133121+0000","last_became_peered":"2023-10-08T08:42:01.133121+0000","last_unstale":"2023-10-08T08:42:39.276005+0000","last_undegraded":"2023-10-08T08:42:39.276005+0000","last_fullsized":"2023-10-08T08:42:39.276005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:54.542269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.281572+0000","last_change":"2023-10-08T08:42:40.281572+0000","last_active":"2023-10-08T08:42:40.281572+0000","last_peered":"2023-10-08T08:42:40.281572+0000","last_clean":"2023-10-08T08:42:40.281572+0000","last_became_active":"2023-10-08T08:42:40.280996+0000","last_became_peered":"2023-10-08T08:42:40.280996+0000","last_unstale":"2023-10-08T08:42:40.281572+0000","last_undegraded":"2023-10-08T08:42:40.281572+0000","last_fullsized":"2023-10-08T08:42:40.281572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:11:34.435906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277067+0000","last_change":"2023-10-08T08:42:00.110059+0000","last_active":"2023-10-08T08:42:39.277067+0000","last_peered":"2023-10-08T08:42:39.277067+0000","last_clean":"2023-10-08T08:42:39.277067+0000","last_became_active":"2023-10-08T08:42:00.109743+0000","last_became_peered":"2023-10-08T08:42:00.109743+0000","last_unstale":"2023-10-08T08:42:39.277067+0000","last_undegraded":"2023-10-08T08:42:39.277067+0000","last_fullsized":"2023-10-08T08:42:39.277067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:03:40.950213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273339+0000","last_change":"2023-10-08T08:42:01.133595+0000","last_active":"2023-10-08T08:42:39.273339+0000","last_peered":"2023-10-08T08:42:39.273339+0000","last_clean":"2023-10-08T08:42:39.273339+0000","last_became_active":"2023-10-08T08:42:01.133268+0000","last_became_peered":"2023-10-08T08:42:01.133268+0000","last_unstale":"2023-10-08T08:42:39.273339+0000","last_undegraded":"2023-10-08T08:42:39.273339+0000","last_fullsized":"2023-10-08T08:42:39.273339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:49.571517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276328+0000","last_change":"2023-10-08T08:42:05.174472+0000","last_active":"2023-10-08T08:42:39.276328+0000","last_peered":"2023-10-08T08:42:39.276328+0000","last_clean":"2023-10-08T08:42:39.276328+0000","last_became_active":"2023-10-08T08:42:05.174073+0000","last_became_peered":"2023-10-08T08:42:05.174073+0000","last_unstale":"2023-10-08T08:42:39.276328+0000","last_undegraded":"2023-10-08T08:42:39.276328+0000","last_fullsized":"2023-10-08T08:42:39.276328+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:36.208008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:01.145559+0000","last_change":"2023-10-08T08:42:00.115978+0000","last_active":"2023-10-08T08:43:01.145559+0000","last_peered":"2023-10-08T08:43:01.145559+0000","last_clean":"2023-10-08T08:43:01.145559+0000","last_became_active":"2023-10-08T08:42:00.115670+0000","last_became_peered":"2023-10-08T08:42:00.115670+0000","last_unstale":"2023-10-08T08:43:01.145559+0000","last_undegraded":"2023-10-08T08:43:01.145559+0000","last_fullsized":"2023-10-08T08:43:01.145559+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:11:41.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696927+0000","last_change":"2023-10-08T08:42:40.696927+0000","last_active":"2023-10-08T08:42:40.696927+0000","last_peered":"2023-10-08T08:42:40.696927+0000","last_clean":"2023-10-08T08:42:40.696927+0000","last_became_active":"2023-10-08T08:42:40.696534+0000","last_became_peered":"2023-10-08T08:42:40.696534+0000","last_unstale":"2023-10-08T08:42:40.696927+0000","last_undegraded":"2023-10-08T08:42:40.696927+0000","last_fullsized":"2023-10-08T08:42:40.696927+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:05.888834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275650+0000","last_change":"2023-10-08T08:42:05.177922+0000","last_active":"2023-10-08T08:42:39.275650+0000","last_peered":"2023-10-08T08:42:39.275650+0000","last_clean":"2023-10-08T08:42:39.275650+0000","last_became_active":"2023-10-08T08:42:05.177504+0000","last_became_peered":"2023-10-08T08:42:05.177504+0000","last_unstale":"2023-10-08T08:42:39.275650+0000","last_undegraded":"2023-10-08T08:42:39.275650+0000","last_fullsized":"2023-10-08T08:42:39.275650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:02.602437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278640+0000","last_change":"2023-10-08T08:42:01.139125+0000","last_active":"2023-10-08T08:42:39.278640+0000","last_peered":"2023-10-08T08:42:39.278640+0000","last_clean":"2023-10-08T08:42:39.278640+0000","last_became_active":"2023-10-08T08:42:01.138769+0000","last_became_peered":"2023-10-08T08:42:01.138769+0000","last_unstale":"2023-10-08T08:42:39.278640+0000","last_undegraded":"2023-10-08T08:42:39.278640+0000","last_fullsized":"2023-10-08T08:42:39.278640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:31:57.717833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:01.134297+0000","last_change":"2023-10-08T08:42:00.115528+0000","last_active":"2023-10-08T08:43:01.134297+0000","last_peered":"2023-10-08T08:43:01.134297+0000","last_clean":"2023-10-08T08:43:01.134297+0000","last_became_active":"2023-10-08T08:42:00.115189+0000","last_became_peered":"2023-10-08T08:42:00.115189+0000","last_unstale":"2023-10-08T08:43:01.134297+0000","last_undegraded":"2023-10-08T08:43:01.134297+0000","last_fullsized":"2023-10-08T08:43:01.134297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.254073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.695382+0000","last_change":"2023-10-08T08:42:40.695382+0000","last_active":"2023-10-08T08:42:40.695382+0000","last_peered":"2023-10-08T08:42:40.695382+0000","last_clean":"2023-10-08T08:42:40.695382+0000","last_became_active":"2023-10-08T08:42:40.695009+0000","last_became_peered":"2023-10-08T08:42:40.695009+0000","last_unstale":"2023-10-08T08:42:40.695382+0000","last_undegraded":"2023-10-08T08:42:40.695382+0000","last_fullsized":"2023-10-08T08:42:40.695382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:35.298546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269706+0000","last_change":"2023-10-08T08:42:01.131992+0000","last_active":"2023-10-08T08:42:39.269706+0000","last_peered":"2023-10-08T08:42:39.269706+0000","last_clean":"2023-10-08T08:42:39.269706+0000","last_became_active":"2023-10-08T08:42:01.131633+0000","last_became_peered":"2023-10-08T08:42:01.131633+0000","last_unstale":"2023-10-08T08:42:39.269706+0000","last_undegraded":"2023-10-08T08:42:39.269706+0000","last_fullsized":"2023-10-08T08:42:39.269706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:40.653710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270531+0000","last_change":"2023-10-08T08:42:00.112987+0000","last_active":"2023-10-08T08:42:39.270531+0000","last_peered":"2023-10-08T08:42:39.270531+0000","last_clean":"2023-10-08T08:42:39.270531+0000","last_became_active":"2023-10-08T08:42:00.112276+0000","last_became_peered":"2023-10-08T08:42:00.112276+0000","last_unstale":"2023-10-08T08:42:39.270531+0000","last_undegraded":"2023-10-08T08:42:39.270531+0000","last_fullsized":"2023-10-08T08:42:39.270531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.193726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277082+0000","last_change":"2023-10-08T08:41:02.223132+0000","last_active":"2023-10-08T08:42:39.277082+0000","last_peered":"2023-10-08T08:42:39.277082+0000","last_clean":"2023-10-08T08:42:39.277082+0000","last_became_active":"2023-10-08T08:41:02.222688+0000","last_became_peered":"2023-10-08T08:41:02.222688+0000","last_unstale":"2023-10-08T08:42:39.277082+0000","last_undegraded":"2023-10-08T08:42:39.277082+0000","last_fullsized":"2023-10-08T08:42:39.277082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_clean_scrub_stamp":"2023-10-08T08:38:15.738972+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:27.673603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276236+0000","last_change":"2023-10-08T08:42:05.169025+0000","last_active":"2023-10-08T08:42:39.276236+0000","last_peered":"2023-10-08T08:42:39.276236+0000","last_clean":"2023-10-08T08:42:39.276236+0000","last_became_active":"2023-10-08T08:42:05.168100+0000","last_became_peered":"2023-10-08T08:42:05.168100+0000","last_unstale":"2023-10-08T08:42:39.276236+0000","last_undegraded":"2023-10-08T08:42:39.276236+0000","last_fullsized":"2023-10-08T08:42:39.276236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:30:40.830952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276572+0000","last_change":"2023-10-08T08:42:01.130878+0000","last_active":"2023-10-08T08:42:39.276572+0000","last_peered":"2023-10-08T08:42:39.276572+0000","last_clean":"2023-10-08T08:42:39.276572+0000","last_became_active":"2023-10-08T08:42:01.130649+0000","last_became_peered":"2023-10-08T08:42:01.130649+0000","last_unstale":"2023-10-08T08:42:39.276572+0000","last_undegraded":"2023-10-08T08:42:39.276572+0000","last_fullsized":"2023-10-08T08:42:39.276572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:15.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277371+0000","last_change":"2023-10-08T08:42:00.117747+0000","last_active":"2023-10-08T08:42:39.277371+0000","last_peered":"2023-10-08T08:42:39.277371+0000","last_clean":"2023-10-08T08:42:39.277371+0000","last_became_active":"2023-10-08T08:42:00.117437+0000","last_became_peered":"2023-10-08T08:42:00.117437+0000","last_unstale":"2023-10-08T08:42:39.277371+0000","last_undegraded":"2023-10-08T08:42:39.277371+0000","last_fullsized":"2023-10-08T08:42:39.277371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:13.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274614+0000","last_change":"2023-10-08T08:42:05.173175+0000","last_active":"2023-10-08T08:42:39.274614+0000","last_peered":"2023-10-08T08:42:39.274614+0000","last_clean":"2023-10-08T08:42:39.274614+0000","last_became_active":"2023-10-08T08:42:05.172754+0000","last_became_peered":"2023-10-08T08:42:05.172754+0000","last_unstale":"2023-10-08T08:42:39.274614+0000","last_undegraded":"2023-10-08T08:42:39.274614+0000","last_fullsized":"2023-10-08T08:42:39.274614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:48.900020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273546+0000","last_change":"2023-10-08T08:42:00.117094+0000","last_active":"2023-10-08T08:42:39.273546+0000","last_peered":"2023-10-08T08:42:39.273546+0000","last_clean":"2023-10-08T08:42:39.273546+0000","last_became_active":"2023-10-08T08:42:00.116773+0000","last_became_peered":"2023-10-08T08:42:00.116773+0000","last_unstale":"2023-10-08T08:42:39.273546+0000","last_undegraded":"2023-10-08T08:42:39.273546+0000","last_fullsized":"2023-10-08T08:42:39.273546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:28.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276460+0000","last_change":"2023-10-08T08:42:01.146290+0000","last_active":"2023-10-08T08:42:39.276460+0000","last_peered":"2023-10-08T08:42:39.276460+0000","last_clean":"2023-10-08T08:42:39.276460+0000","last_became_active":"2023-10-08T08:42:01.145585+0000","last_became_peered":"2023-10-08T08:42:01.145585+0000","last_unstale":"2023-10-08T08:42:39.276460+0000","last_undegraded":"2023-10-08T08:42:39.276460+0000","last_fullsized":"2023-10-08T08:42:39.276460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:16:15.140659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269495+0000","last_change":"2023-10-08T08:42:05.177611+0000","last_active":"2023-10-08T08:42:39.269495+0000","last_peered":"2023-10-08T08:42:39.269495+0000","last_clean":"2023-10-08T08:42:39.269495+0000","last_became_active":"2023-10-08T08:42:05.177027+0000","last_became_peered":"2023-10-08T08:42:05.177027+0000","last_unstale":"2023-10-08T08:42:39.269495+0000","last_undegraded":"2023-10-08T08:42:39.269495+0000","last_fullsized":"2023-10-08T08:42:39.269495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.846359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275664+0000","last_change":"2023-10-08T08:42:00.112453+0000","last_active":"2023-10-08T08:42:39.275664+0000","last_peered":"2023-10-08T08:42:39.275664+0000","last_clean":"2023-10-08T08:42:39.275664+0000","last_became_active":"2023-10-08T08:42:00.112159+0000","last_became_peered":"2023-10-08T08:42:00.112159+0000","last_unstale":"2023-10-08T08:42:39.275664+0000","last_undegraded":"2023-10-08T08:42:39.275664+0000","last_fullsized":"2023-10-08T08:42:39.275664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:27.713764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270602+0000","last_change":"2023-10-08T08:42:01.136743+0000","last_active":"2023-10-08T08:42:39.270602+0000","last_peered":"2023-10-08T08:42:39.270602+0000","last_clean":"2023-10-08T08:42:39.270602+0000","last_became_active":"2023-10-08T08:42:01.136442+0000","last_became_peered":"2023-10-08T08:42:01.136442+0000","last_unstale":"2023-10-08T08:42:39.270602+0000","last_undegraded":"2023-10-08T08:42:39.270602+0000","last_fullsized":"2023-10-08T08:42:39.270602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:50:41.937240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278976+0000","last_change":"2023-10-08T08:42:05.171945+0000","last_active":"2023-10-08T08:42:39.278976+0000","last_peered":"2023-10-08T08:42:39.278976+0000","last_clean":"2023-10-08T08:42:39.278976+0000","last_became_active":"2023-10-08T08:42:05.171573+0000","last_became_peered":"2023-10-08T08:42:05.171573+0000","last_unstale":"2023-10-08T08:42:39.278976+0000","last_undegraded":"2023-10-08T08:42:39.278976+0000","last_fullsized":"2023-10-08T08:42:39.278976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:03.677144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270977+0000","last_change":"2023-10-08T08:42:00.116005+0000","last_active":"2023-10-08T08:42:39.270977+0000","last_peered":"2023-10-08T08:42:39.270977+0000","last_clean":"2023-10-08T08:42:39.270977+0000","last_became_active":"2023-10-08T08:42:00.115701+0000","last_became_peered":"2023-10-08T08:42:00.115701+0000","last_unstale":"2023-10-08T08:42:39.270977+0000","last_undegraded":"2023-10-08T08:42:39.270977+0000","last_fullsized":"2023-10-08T08:42:39.270977+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:46.114324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273957+0000","last_change":"2023-10-08T08:42:01.140370+0000","last_active":"2023-10-08T08:42:39.273957+0000","last_peered":"2023-10-08T08:42:39.273957+0000","last_clean":"2023-10-08T08:42:39.273957+0000","last_became_active":"2023-10-08T08:42:01.139923+0000","last_became_peered":"2023-10-08T08:42:01.139923+0000","last_unstale":"2023-10-08T08:42:39.273957+0000","last_undegraded":"2023-10-08T08:42:39.273957+0000","last_fullsized":"2023-10-08T08:42:39.273957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:07.052821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270782+0000","last_change":"2023-10-08T08:42:05.177542+0000","last_active":"2023-10-08T08:42:39.270782+0000","last_peered":"2023-10-08T08:42:39.270782+0000","last_clean":"2023-10-08T08:42:39.270782+0000","last_became_active":"2023-10-08T08:42:05.176808+0000","last_became_peered":"2023-10-08T08:42:05.176808+0000","last_unstale":"2023-10-08T08:42:39.270782+0000","last_undegraded":"2023-10-08T08:42:39.270782+0000","last_fullsized":"2023-10-08T08:42:39.270782+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:44.845948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.284070+0000","last_change":"2023-10-08T08:42:40.284070+0000","last_active":"2023-10-08T08:42:40.284070+0000","last_peered":"2023-10-08T08:42:40.284070+0000","last_clean":"2023-10-08T08:42:40.284070+0000","last_became_active":"2023-10-08T08:42:40.280519+0000","last_became_peered":"2023-10-08T08:42:40.280519+0000","last_unstale":"2023-10-08T08:42:40.284070+0000","last_undegraded":"2023-10-08T08:42:40.284070+0000","last_fullsized":"2023-10-08T08:42:40.284070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:29.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272903+0000","last_change":"2023-10-08T08:42:01.139641+0000","last_active":"2023-10-08T08:42:39.272903+0000","last_peered":"2023-10-08T08:42:39.272903+0000","last_clean":"2023-10-08T08:42:39.272903+0000","last_became_active":"2023-10-08T08:42:01.139332+0000","last_became_peered":"2023-10-08T08:42:01.139332+0000","last_unstale":"2023-10-08T08:42:39.272903+0000","last_undegraded":"2023-10-08T08:42:39.272903+0000","last_fullsized":"2023-10-08T08:42:39.272903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:14.948944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278104+0000","last_change":"2023-10-08T08:42:05.180307+0000","last_active":"2023-10-08T08:42:39.278104+0000","last_peered":"2023-10-08T08:42:39.278104+0000","last_clean":"2023-10-08T08:42:39.278104+0000","last_became_active":"2023-10-08T08:42:05.179755+0000","last_became_peered":"2023-10-08T08:42:05.179755+0000","last_unstale":"2023-10-08T08:42:39.278104+0000","last_undegraded":"2023-10-08T08:42:39.278104+0000","last_fullsized":"2023-10-08T08:42:39.278104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:34.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269609+0000","last_change":"2023-10-08T08:42:00.112674+0000","last_active":"2023-10-08T08:42:39.269609+0000","last_peered":"2023-10-08T08:42:39.269609+0000","last_clean":"2023-10-08T08:42:39.269609+0000","last_became_active":"2023-10-08T08:42:00.110746+0000","last_became_peered":"2023-10-08T08:42:00.110746+0000","last_unstale":"2023-10-08T08:42:39.269609+0000","last_undegraded":"2023-10-08T08:42:39.269609+0000","last_fullsized":"2023-10-08T08:42:39.269609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:27.463811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274453+0000","last_change":"2023-10-08T08:42:01.150107+0000","last_active":"2023-10-08T08:42:39.274453+0000","last_peered":"2023-10-08T08:42:39.274453+0000","last_clean":"2023-10-08T08:42:39.274453+0000","last_became_active":"2023-10-08T08:42:01.149609+0000","last_became_peered":"2023-10-08T08:42:01.149609+0000","last_unstale":"2023-10-08T08:42:39.274453+0000","last_undegraded":"2023-10-08T08:42:39.274453+0000","last_fullsized":"2023-10-08T08:42:39.274453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:05.378286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270656+0000","last_change":"2023-10-08T08:42:05.177571+0000","last_active":"2023-10-08T08:42:39.270656+0000","last_peered":"2023-10-08T08:42:39.270656+0000","last_clean":"2023-10-08T08:42:39.270656+0000","last_became_active":"2023-10-08T08:42:05.177061+0000","last_became_peered":"2023-10-08T08:42:05.177061+0000","last_unstale":"2023-10-08T08:42:39.270656+0000","last_undegraded":"2023-10-08T08:42:39.270656+0000","last_fullsized":"2023-10-08T08:42:39.270656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:10.274262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.286517+0000","last_change":"2023-10-08T08:42:40.286517+0000","last_active":"2023-10-08T08:42:40.286517+0000","last_peered":"2023-10-08T08:42:40.286517+0000","last_clean":"2023-10-08T08:42:40.286517+0000","last_became_active":"2023-10-08T08:42:40.281562+0000","last_became_peered":"2023-10-08T08:42:40.281562+0000","last_unstale":"2023-10-08T08:42:40.286517+0000","last_undegraded":"2023-10-08T08:42:40.286517+0000","last_fullsized":"2023-10-08T08:42:40.286517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:23.313740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270339+0000","last_change":"2023-10-08T08:42:01.142209+0000","last_active":"2023-10-08T08:42:39.270339+0000","last_peered":"2023-10-08T08:42:39.270339+0000","last_clean":"2023-10-08T08:42:39.270339+0000","last_became_active":"2023-10-08T08:42:01.141911+0000","last_became_peered":"2023-10-08T08:42:01.141911+0000","last_unstale":"2023-10-08T08:42:39.270339+0000","last_undegraded":"2023-10-08T08:42:39.270339+0000","last_fullsized":"2023-10-08T08:42:39.270339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:00.066595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270619+0000","last_change":"2023-10-08T08:42:05.173463+0000","last_active":"2023-10-08T08:42:39.270619+0000","last_peered":"2023-10-08T08:42:39.270619+0000","last_clean":"2023-10-08T08:42:39.270619+0000","last_became_active":"2023-10-08T08:42:05.173045+0000","last_became_peered":"2023-10-08T08:42:05.173045+0000","last_unstale":"2023-10-08T08:42:39.270619+0000","last_undegraded":"2023-10-08T08:42:39.270619+0000","last_fullsized":"2023-10-08T08:42:39.270619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:10.774694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272997+0000","last_change":"2023-10-08T08:42:00.111005+0000","last_active":"2023-10-08T08:42:39.272997+0000","last_peered":"2023-10-08T08:42:39.272997+0000","last_clean":"2023-10-08T08:42:39.272997+0000","last_became_active":"2023-10-08T08:42:00.110687+0000","last_became_peered":"2023-10-08T08:42:00.110687+0000","last_unstale":"2023-10-08T08:42:39.272997+0000","last_undegraded":"2023-10-08T08:42:39.272997+0000","last_fullsized":"2023-10-08T08:42:39.272997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:38.682150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277572+0000","last_change":"2023-10-08T08:42:01.144443+0000","last_active":"2023-10-08T08:42:39.277572+0000","last_peered":"2023-10-08T08:42:39.277572+0000","last_clean":"2023-10-08T08:42:39.277572+0000","last_became_active":"2023-10-08T08:42:01.143960+0000","last_became_peered":"2023-10-08T08:42:01.143960+0000","last_unstale":"2023-10-08T08:42:39.277572+0000","last_undegraded":"2023-10-08T08:42:39.277572+0000","last_fullsized":"2023-10-08T08:42:39.277572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:46:57.209569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275843+0000","last_change":"2023-10-08T08:42:05.178212+0000","last_active":"2023-10-08T08:42:39.275843+0000","last_peered":"2023-10-08T08:42:39.275843+0000","last_clean":"2023-10-08T08:42:39.275843+0000","last_became_active":"2023-10-08T08:42:05.177751+0000","last_became_peered":"2023-10-08T08:42:05.177751+0000","last_unstale":"2023-10-08T08:42:39.275843+0000","last_undegraded":"2023-10-08T08:42:39.275843+0000","last_fullsized":"2023-10-08T08:42:39.275843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:10.128104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:03.155615+0000","last_change":"2023-10-08T08:42:00.115576+0000","last_active":"2023-10-08T08:43:03.155615+0000","last_peered":"2023-10-08T08:43:03.155615+0000","last_clean":"2023-10-08T08:43:03.155615+0000","last_became_active":"2023-10-08T08:42:00.115296+0000","last_became_peered":"2023-10-08T08:42:00.115296+0000","last_unstale":"2023-10-08T08:43:03.155615+0000","last_undegraded":"2023-10-08T08:43:03.155615+0000","last_fullsized":"2023-10-08T08:43:03.155615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:22.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278387+0000","last_change":"2023-10-08T08:42:01.139104+0000","last_active":"2023-10-08T08:42:39.278387+0000","last_peered":"2023-10-08T08:42:39.278387+0000","last_clean":"2023-10-08T08:42:39.278387+0000","last_became_active":"2023-10-08T08:42:01.138653+0000","last_became_peered":"2023-10-08T08:42:01.138653+0000","last_unstale":"2023-10-08T08:42:39.278387+0000","last_undegraded":"2023-10-08T08:42:39.278387+0000","last_fullsized":"2023-10-08T08:42:39.278387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:24.784017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273245+0000","last_change":"2023-10-08T08:42:05.186990+0000","last_active":"2023-10-08T08:42:39.273245+0000","last_peered":"2023-10-08T08:42:39.273245+0000","last_clean":"2023-10-08T08:42:39.273245+0000","last_became_active":"2023-10-08T08:42:05.186397+0000","last_became_peered":"2023-10-08T08:42:05.186397+0000","last_unstale":"2023-10-08T08:42:39.273245+0000","last_undegraded":"2023-10-08T08:42:39.273245+0000","last_fullsized":"2023-10-08T08:42:39.273245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:53.633137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276542+0000","last_change":"2023-10-08T08:42:00.114499+0000","last_active":"2023-10-08T08:42:39.276542+0000","last_peered":"2023-10-08T08:42:39.276542+0000","last_clean":"2023-10-08T08:42:39.276542+0000","last_became_active":"2023-10-08T08:42:00.114062+0000","last_became_peered":"2023-10-08T08:42:00.114062+0000","last_unstale":"2023-10-08T08:42:39.276542+0000","last_undegraded":"2023-10-08T08:42:39.276542+0000","last_fullsized":"2023-10-08T08:42:39.276542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:23.576889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277486+0000","last_change":"2023-10-08T08:42:01.139810+0000","last_active":"2023-10-08T08:42:39.277486+0000","last_peered":"2023-10-08T08:42:39.277486+0000","last_clean":"2023-10-08T08:42:39.277486+0000","last_became_active":"2023-10-08T08:42:01.139489+0000","last_became_peered":"2023-10-08T08:42:01.139489+0000","last_unstale":"2023-10-08T08:42:39.277486+0000","last_undegraded":"2023-10-08T08:42:39.277486+0000","last_fullsized":"2023-10-08T08:42:39.277486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:06.724645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278227+0000","last_change":"2023-10-08T08:42:05.172808+0000","last_active":"2023-10-08T08:42:39.278227+0000","last_peered":"2023-10-08T08:42:39.278227+0000","last_clean":"2023-10-08T08:42:39.278227+0000","last_became_active":"2023-10-08T08:42:05.172307+0000","last_became_peered":"2023-10-08T08:42:05.172307+0000","last_unstale":"2023-10-08T08:42:39.278227+0000","last_undegraded":"2023-10-08T08:42:39.278227+0000","last_fullsized":"2023-10-08T08:42:39.278227+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.031070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275490+0000","last_change":"2023-10-08T08:42:00.112423+0000","last_active":"2023-10-08T08:42:39.275490+0000","last_peered":"2023-10-08T08:42:39.275490+0000","last_clean":"2023-10-08T08:42:39.275490+0000","last_became_active":"2023-10-08T08:42:00.112130+0000","last_became_peered":"2023-10-08T08:42:00.112130+0000","last_unstale":"2023-10-08T08:42:39.275490+0000","last_undegraded":"2023-10-08T08:42:39.275490+0000","last_fullsized":"2023-10-08T08:42:39.275490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:54.898037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277793+0000","last_change":"2023-10-08T08:42:01.148404+0000","last_active":"2023-10-08T08:42:39.277793+0000","last_peered":"2023-10-08T08:42:39.277793+0000","last_clean":"2023-10-08T08:42:39.277793+0000","last_became_active":"2023-10-08T08:42:01.148087+0000","last_became_peered":"2023-10-08T08:42:01.148087+0000","last_unstale":"2023-10-08T08:42:39.277793+0000","last_undegraded":"2023-10-08T08:42:39.277793+0000","last_fullsized":"2023-10-08T08:42:39.277793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:12.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274525+0000","last_change":"2023-10-08T08:42:01.149762+0000","last_active":"2023-10-08T08:42:39.274525+0000","last_peered":"2023-10-08T08:42:39.274525+0000","last_clean":"2023-10-08T08:42:39.274525+0000","last_became_active":"2023-10-08T08:42:01.149392+0000","last_became_peered":"2023-10-08T08:42:01.149392+0000","last_unstale":"2023-10-08T08:42:39.274525+0000","last_undegraded":"2023-10-08T08:42:39.274525+0000","last_fullsized":"2023-10-08T08:42:39.274525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:22.487634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279392+0000","last_change":"2023-10-08T08:42:01.145106+0000","last_active":"2023-10-08T08:42:39.279392+0000","last_peered":"2023-10-08T08:42:39.279392+0000","last_clean":"2023-10-08T08:42:39.279392+0000","last_became_active":"2023-10-08T08:42:01.144709+0000","last_became_peered":"2023-10-08T08:42:01.144709+0000","last_unstale":"2023-10-08T08:42:39.279392+0000","last_undegraded":"2023-10-08T08:42:39.279392+0000","last_fullsized":"2023-10-08T08:42:39.279392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:24.248415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.280122+0000","last_change":"2023-10-08T08:42:01.148384+0000","last_active":"2023-10-08T08:42:39.280122+0000","last_peered":"2023-10-08T08:42:39.280122+0000","last_clean":"2023-10-08T08:42:39.280122+0000","last_became_active":"2023-10-08T08:42:01.148098+0000","last_became_peered":"2023-10-08T08:42:01.148098+0000","last_unstale":"2023-10-08T08:42:39.280122+0000","last_undegraded":"2023-10-08T08:42:39.280122+0000","last_fullsized":"2023-10-08T08:42:39.280122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:45.361279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.278516+0000","last_change":"2023-10-08T08:42:40.278516+0000","last_active":"2023-10-08T08:42:40.278516+0000","last_peered":"2023-10-08T08:42:40.278516+0000","last_clean":"2023-10-08T08:42:40.278516+0000","last_became_active":"2023-10-08T08:42:40.278111+0000","last_became_peered":"2023-10-08T08:42:40.278111+0000","last_unstale":"2023-10-08T08:42:40.278516+0000","last_undegraded":"2023-10-08T08:42:40.278516+0000","last_fullsized":"2023-10-08T08:42:40.278516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:32.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276507+0000","last_change":"2023-10-08T08:42:01.146486+0000","last_active":"2023-10-08T08:42:39.276507+0000","last_peered":"2023-10-08T08:42:39.276507+0000","last_clean":"2023-10-08T08:42:39.276507+0000","last_became_active":"2023-10-08T08:42:01.146002+0000","last_became_peered":"2023-10-08T08:42:01.146002+0000","last_unstale":"2023-10-08T08:42:39.276507+0000","last_undegraded":"2023-10-08T08:42:39.276507+0000","last_fullsized":"2023-10-08T08:42:39.276507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:28.217937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276175+0000","last_change":"2023-10-08T08:42:01.152380+0000","last_active":"2023-10-08T08:42:39.276175+0000","last_peered":"2023-10-08T08:42:39.276175+0000","last_clean":"2023-10-08T08:42:39.276175+0000","last_became_active":"2023-10-08T08:42:01.149760+0000","last_became_peered":"2023-10-08T08:42:01.149760+0000","last_unstale":"2023-10-08T08:42:39.276175+0000","last_undegraded":"2023-10-08T08:42:39.276175+0000","last_fullsized":"2023-10-08T08:42:39.276175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:47:58.326416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279642+0000","last_change":"2023-10-08T08:42:01.149593+0000","last_active":"2023-10-08T08:42:39.279642+0000","last_peered":"2023-10-08T08:42:39.279642+0000","last_clean":"2023-10-08T08:42:39.279642+0000","last_became_active":"2023-10-08T08:42:01.149235+0000","last_became_peered":"2023-10-08T08:42:01.149235+0000","last_unstale":"2023-10-08T08:42:39.279642+0000","last_undegraded":"2023-10-08T08:42:39.279642+0000","last_fullsized":"2023-10-08T08:42:39.279642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:51.379305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270673+0000","last_change":"2023-10-08T08:42:01.133460+0000","last_active":"2023-10-08T08:42:39.270673+0000","last_peered":"2023-10-08T08:42:39.270673+0000","last_clean":"2023-10-08T08:42:39.270673+0000","last_became_active":"2023-10-08T08:42:01.133132+0000","last_became_peered":"2023-10-08T08:42:01.133132+0000","last_unstale":"2023-10-08T08:42:39.270673+0000","last_undegraded":"2023-10-08T08:42:39.270673+0000","last_fullsized":"2023-10-08T08:42:39.270673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:29.047135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278661+0000","last_change":"2023-10-08T08:42:01.134274+0000","last_active":"2023-10-08T08:42:39.278661+0000","last_peered":"2023-10-08T08:42:39.278661+0000","last_clean":"2023-10-08T08:42:39.278661+0000","last_became_active":"2023-10-08T08:42:01.133040+0000","last_became_peered":"2023-10-08T08:42:01.133040+0000","last_unstale":"2023-10-08T08:42:39.278661+0000","last_undegraded":"2023-10-08T08:42:39.278661+0000","last_fullsized":"2023-10-08T08:42:39.278661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:18.054859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269663+0000","last_change":"2023-10-08T08:42:01.128333+0000","last_active":"2023-10-08T08:42:39.269663+0000","last_peered":"2023-10-08T08:42:39.269663+0000","last_clean":"2023-10-08T08:42:39.269663+0000","last_became_active":"2023-10-08T08:42:01.128076+0000","last_became_peered":"2023-10-08T08:42:01.128076+0000","last_unstale":"2023-10-08T08:42:39.269663+0000","last_undegraded":"2023-10-08T08:42:39.269663+0000","last_fullsized":"2023-10-08T08:42:39.269663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.675185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276377+0000","last_change":"2023-10-08T08:42:01.139518+0000","last_active":"2023-10-08T08:42:39.276377+0000","last_peered":"2023-10-08T08:42:39.276377+0000","last_clean":"2023-10-08T08:42:39.276377+0000","last_became_active":"2023-10-08T08:42:01.139217+0000","last_became_peered":"2023-10-08T08:42:01.139217+0000","last_unstale":"2023-10-08T08:42:39.276377+0000","last_undegraded":"2023-10-08T08:42:39.276377+0000","last_fullsized":"2023-10-08T08:42:39.276377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:05:02.485500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275263+0000","last_change":"2023-10-08T08:42:01.142664+0000","last_active":"2023-10-08T08:42:39.275263+0000","last_peered":"2023-10-08T08:42:39.275263+0000","last_clean":"2023-10-08T08:42:39.275263+0000","last_became_active":"2023-10-08T08:42:01.142136+0000","last_became_peered":"2023-10-08T08:42:01.142136+0000","last_unstale":"2023-10-08T08:42:39.275263+0000","last_undegraded":"2023-10-08T08:42:39.275263+0000","last_fullsized":"2023-10-08T08:42:39.275263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:18.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696535+0000","last_change":"2023-10-08T08:42:40.696535+0000","last_active":"2023-10-08T08:42:40.696535+0000","last_peered":"2023-10-08T08:42:40.696535+0000","last_clean":"2023-10-08T08:42:40.696535+0000","last_became_active":"2023-10-08T08:42:40.695973+0000","last_became_peered":"2023-10-08T08:42:40.695973+0000","last_unstale":"2023-10-08T08:42:40.696535+0000","last_undegraded":"2023-10-08T08:42:40.696535+0000","last_fullsized":"2023-10-08T08:42:40.696535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:50.008782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":389,"num_read_kb":213,"num_write":209,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":30792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481817,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":493809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50700000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.40200000000000002}]},{"osd":6,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.52600000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.45300000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57499999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56599999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.629},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.621}]}]},{"osd":10,"up_from":70,"seq":300647710748,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1638400,"data_stored":1088563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.317}]},{"osd":2,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82599999999999996,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.83699999999999997,"5min":0.87,"15min":0.87},"last":0.48799999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0489999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.432}]},{"osd":6,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93899999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.50800000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.50700000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.032,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.55500000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.95599999999999996,"5min":1.23,"15min":1.23},"last":0.55500000000000005}]},{"osd":9,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.998,"5min":1.208,"15min":1.208},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98399999999999999,"5min":1.173,"15min":1.173},"last":0.58699999999999997}]},{"osd":11,"last update":"Sun Oct 8 08:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.61599999999999999}]}]},{"osd":9,"up_from":65,"seq":279172874273,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":493739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.44400000000000001,"15min":0.45400000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.623,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52600000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68600000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.501}]},{"osd":2,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71999999999999997,"5min":1.022,"15min":1.022},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.53800000000000003,"15min":0.56100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.52400000000000002,"15min":0.54200000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61499999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65000000000000002}]},{"osd":4,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77900000000000003,"5min":1.028,"15min":1.028},"last":0.60799999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84099999999999997,"5min":0.995,"15min":0.995},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68400000000000005,"15min":0.69799999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39100000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81200000000000006,"5min":1.151,"15min":1.151},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.73599999999999999,"15min":0.75700000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82399999999999995,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.76400000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83699999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.751,"15min":0.76500000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86599999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.87}]},{"osd":10,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82499999999999996,"5min":1.216,"15min":1.216},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":8,"up_from":58,"seq":249108103205,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":494117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.61799999999999999,"15min":0.627},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84199999999999997,"5min":1.256,"15min":1.256},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59299999999999997,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92600000000000005,"5min":1.028,"15min":1.028},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.443,"15min":0.439},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67100000000000004,"5min":0.748,"15min":0.748},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72799999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51600000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80500000000000005,"5min":1.288,"15min":1.288},"last":0.61199999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73999999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83399999999999996,"5min":0.87,"15min":0.87},"last":0.69599999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97399999999999998,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.073,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.51100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1120000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.82399999999999995}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.83899999999999997}]},{"osd":10,"last update":"Sun Oct 8 08:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.88900000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":7,"up_from":51,"seq":219043332137,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1086127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63300000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.377},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.434,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.34499999999999997}]},{"osd":2,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.60699999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55100000000000005}]},{"osd":4,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.41699999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.53300000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.64000000000000001,"15min":0.628},"min":{"1min":0.52600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65500000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71599999999999997,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94499999999999995,"5min":1.234,"15min":1.234},"last":0.745}]},{"osd":9,"last update":"Sun Oct 8 08:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0580000000000001,"5min":1.181,"15min":1.181},"last":0.497},{"interface":"front","average":{"1min":0.753,"5min":0.73499999999999999,"15min":0.73199999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95499999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72799999999999998}]},{"osd":10,"last update":"Sun Oct 8 08:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.76200000000000001}]},{"osd":11,"last update":"Sun Oct 8 08:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.79500000000000004}]}]},{"osd":6,"up_from":46,"seq":197568495660,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":493339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.311,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57499999999999996,"5min":0.62,"15min":0.62},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.44}]},{"osd":1,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.745,"15min":0.745},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.57099999999999995},"min":{"1min":0.46200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.88700000000000001,"5min":1.034,"15min":1.034},"last":0.60999999999999999}]},{"osd":3,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.434,"15min":0.42499999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70099999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.46400000000000002},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67400000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48499999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.45900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.60999999999999999},"min":{"1min":0.45700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":0.627},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89300000000000002,"5min":4.7670000000000003,"15min":4.7670000000000003},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 08:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.51700000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.91900000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66700000000000004,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94699999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93999999999999995,"5min":1.087,"15min":1.087},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.745}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.497},{"interface":"front","average":{"1min":0.62,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96399999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56499999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.66800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542209,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":498211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.49299999999999999,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.85599999999999998,"5min":1.242,"15min":1.242},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.44},"min":{"1min":0.40100000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.89700000000000002,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.439}]},{"osd":2,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.42599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.52900000000000003,"15min":0.502},"min":{"1min":0.42399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.81899999999999995}]},{"osd":3,"last update":"Sun Oct 8 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79100000000000004,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.39900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.41899999999999998},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.44700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.63,"15min":0.61499999999999999},"min":{"1min":0.53200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.84699999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.61099999999999999,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0980000000000001,"5min":1.788,"15min":1.788},"last":0.66600000000000004}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54900000000000004}]},{"osd":8,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79400000000000004}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.68300000000000005}]},{"osd":10,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":494795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 08:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.51500000000000001},"min":{"1min":0.40400000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55900000000000005,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64500000000000002}]},{"osd":2,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80800000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.375}]},{"osd":4,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52100000000000002,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.79300000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.50700000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52100000000000002}]},{"osd":6,"last update":"Sun Oct 8 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.376,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81999999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76100000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.58599999999999997}]},{"osd":8,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.53900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65900000000000003}]},{"osd":9,"last update":"Sun Oct 8 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67700000000000005,"15min":0.68600000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90600000000000003,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.88900000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54000000000000004}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.53900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.753,"5min":0.755,"15min":0.755},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.006,"15min":1.006},"last":0.68200000000000005}]},{"osd":11,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.628}]}]},{"osd":2,"up_from":19,"seq":81604378686,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":498431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.505,"15min":0.46700000000000003},"min":{"1min":0.39300000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49199999999999999,"15min":0.47799999999999998},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64100000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52400000000000002,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76200000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.56299999999999994,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.51600000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.59199999999999997,"15min":0.54700000000000004},"min":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.6800000000000002,"5min":3.6800000000000002,"15min":3.6800000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.61299999999999999,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.6970000000000001,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.442}]},{"osd":5,"last update":"Sun Oct 8 08:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.45200000000000001},"min":{"1min":0.34699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.373},{"interface":"front","average":{"1min":0.624,"5min":0.52700000000000002,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.624,"15min":0.60199999999999998},"min":{"1min":0.46500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.48899999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.57599999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.497},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98499999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.68700000000000006}]},{"osd":9,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.79300000000000004},"min":{"1min":0.59299999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.109,"15min":2.109},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.72299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.72299999999999998}]},{"osd":11,"last update":"Sun Oct 8 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.70399999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149753,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":492716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.371,"15min":0.34999999999999998},"min":{"1min":0.27000000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39200000000000002,"15min":0.36099999999999999},"min":{"1min":0.27400000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.74199999999999999,"5min":1.889,"15min":1.889},"last":0.29199999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.996,"15min":0.996},"last":0.5},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57599999999999996,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.878,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78500000000000003,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70399999999999996,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":1.927,"15min":1.927},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":0.52800000000000002}]},{"osd":5,"last update":"Sun Oct 8 08:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57599999999999996,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.38900000000000001}]},{"osd":6,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48799999999999999,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83499999999999996,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80500000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93899999999999995,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.59399999999999997}]},{"osd":8,"last update":"Sun Oct 8 08:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]},{"osd":9,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.70899999999999996,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89500000000000002,"5min":1.712,"15min":1.712},"last":0.749},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.753,"15min":0.77700000000000002},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91700000000000004,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.72399999999999998}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96199999999999997,"5min":2.339,"15min":2.339},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89800000000000002,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.71199999999999997}]},{"osd":11,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.68999999999999995}]}]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":493317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67700000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77000000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.35899999999999999},"min":{"1min":0.314,"5min":0.247,"15min":0.247},"max":{"1min":0.53800000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.371},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54300000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.309}]},{"osd":2,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.54000000000000004,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77500000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.51300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71299999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70399999999999996}]},{"osd":3,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.57399999999999995,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Sun Oct 8 08:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.45000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.85799999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61099999999999999,"15min":0.59299999999999997},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.82999999999999996,"5min":0.88,"15min":0.88},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76300000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.49099999999999999}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.441},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79900000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.42599999999999999}]},{"osd":8,"last update":"Sun Oct 8 08:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.68899999999999995}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89700000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.03,"15min":1.03},"last":0.56100000000000005}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.81699999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52200000000000002}]},{"osd":11,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72099999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1626112,"data_stored":1085805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.50800000000000001,"15min":0.48599999999999999},"min":{"1min":0.437,"5min":0.313,"15min":0.313},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.871,"15min":0.871},"last":0.499},{"interface":"front","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.38500000000000001},"min":{"1min":0.32100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.40300000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.35399999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52800000000000002,"15min":0.502},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.43099999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.95399999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96999999999999997,"5min":1.006,"15min":1.006},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89800000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.68400000000000005,"15min":0.66400000000000003},"min":{"1min":0.55300000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53900000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.39000000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.51600000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.748,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.63100000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98699999999999999,"5min":1.038,"15min":1.038},"last":0.48899999999999999}]},{"osd":10,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77800000000000002,"15min":0.76500000000000001},"min":{"1min":0.57699999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.032},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.74399999999999999,"15min":0.73599999999999999},"min":{"1min":0.62,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93899999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T08:43:07.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T08:43:08.522 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:08 smithi191 ceph-mon[104220]: pgmap v270: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T08:43:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:08 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:08 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:08.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:08 smithi070 ceph-mon[99513]: pgmap v270: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T08:43:08.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:08 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:08.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:08 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:08.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:08 smithi105 ceph-mon[103798]: pgmap v270: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T08:43:08.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:08 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:08.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:08 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:09.591 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:09 smithi070 ceph-mon[99513]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:09.591 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:09 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:43:09.591 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:09 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:43:09.591 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:09 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:09.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:09 smithi191 ceph-mon[104220]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:09.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:09 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:43:09.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:09 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:43:09.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:09 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.740+0000 7f25d10e7700 1 -- 172.21.15.70:0/2751602076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc100110 msgr2=0x7f25cc10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.740+0000 7f25d10e7700 1 --2- 172.21.15.70:0/2751602076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc100110 0x7f25cc10c580 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f25c400b0a0 tx=0x7f25c400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.740+0000 7f25d10e7700 1 -- 172.21.15.70:0/2751602076 shutdown_connections 2023-10-08T08:43:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.740+0000 7f25d10e7700 1 --2- 172.21.15.70:0/2751602076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc100110 0x7f25cc10c580 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.740+0000 7f25d10e7700 1 --2- 172.21.15.70:0/2751602076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25cc1056b0 0x7f25cc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.740+0000 7f25d10e7700 1 --2- 172.21.15.70:0/2751602076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25cc0ff750 0x7f25cc0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.740+0000 7f25d10e7700 1 -- 172.21.15.70:0/2751602076 >> 172.21.15.70:0/2751602076 conn(0x7f25cc075790 msgr2=0x7f25cc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.740+0000 7f25d10e7700 1 -- 172.21.15.70:0/2751602076 shutdown_connections 2023-10-08T08:43:09.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.740+0000 7f25d10e7700 1 -- 172.21.15.70:0/2751602076 wait complete. 2023-10-08T08:43:09.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25d10e7700 1 Processor -- start 2023-10-08T08:43:09.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25d10e7700 1 -- start start 2023-10-08T08:43:09.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25d10e7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc0ff750 0x7f25cc101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:09.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25d10e7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25cc100110 0x7f25cc1017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:09.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25d10e7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25cc1056b0 0x7f25cc101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25d10e7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a5130 con 0x7f25cc0ff750 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25d10e7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a52a0 con 0x7f25cc100110 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25d10e7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a5460 con 0x7f25cc1056b0 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25cad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc0ff750 0x7f25cc101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25cad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc0ff750 0x7f25cc101280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49970/0 (socket says 172.21.15.70:49970) 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25cad9d700 1 -- 172.21.15.70:0/1883007652 learned_addr learned my addr 172.21.15.70:0/1883007652 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.741+0000 7f25ca59c700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25cc100110 0x7f25cc1017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25cb59e700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25cc1056b0 0x7f25cc101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25cad9d700 1 -- 172.21.15.70:0/1883007652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25cc1056b0 msgr2=0x7f25cc101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25cad9d700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25cc1056b0 0x7f25cc101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25cad9d700 1 -- 172.21.15.70:0/1883007652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25cc100110 msgr2=0x7f25cc1017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:09.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25cad9d700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25cc100110 0x7f25cc1017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25cad9d700 1 -- 172.21.15.70:0/1883007652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4009d00 con 0x7f25cc0ff750 2023-10-08T08:43:09.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25ca59c700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25cc100110 0x7f25cc1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:09.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25cad9d700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc0ff750 0x7f25cc101280 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c920 tx=0x7f25b400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:09.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25c3fff700 1 -- 172.21.15.70:0/1883007652 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4007b00 con 0x7f25cc0ff750 2023-10-08T08:43:09.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc1a5740 con 0x7f25cc0ff750 2023-10-08T08:43:09.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25c3fff700 1 -- 172.21.15.70:0/1883007652 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25b4004cf0 con 0x7f25cc0ff750 2023-10-08T08:43:09.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25c3fff700 1 -- 172.21.15.70:0/1883007652 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4005520 con 0x7f25cc0ff750 2023-10-08T08:43:09.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.742+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1a5c90 con 0x7f25cc0ff750 2023-10-08T08:43:09.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.743+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc108cc0 con 0x7f25cc0ff750 2023-10-08T08:43:09.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.744+0000 7f25c3fff700 1 -- 172.21.15.70:0/1883007652 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f25b4004750 con 0x7f25cc0ff750 2023-10-08T08:43:09.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.744+0000 7f25c3fff700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25b80a14d0 0x7f25b80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:09.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.745+0000 7f25ca59c700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25b80a14d0 0x7f25b80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:09.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.745+0000 7f25c3fff700 1 -- 172.21.15.70:0/1883007652 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f25b40ccd60 con 0x7f25cc0ff750 2023-10-08T08:43:09.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.745+0000 7f25ca59c700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25b80a14d0 0x7f25b80a3990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25bc005fd0 tx=0x7f25bc005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:09.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.749+0000 7f25c3fff700 1 -- 172.21.15.70:0/1883007652 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f25b4095fd0 con 0x7f25cc0ff750 2023-10-08T08:43:09.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:09 smithi105 ceph-mon[103798]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:09.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:09 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:43:09.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:09 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:43:09.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:09 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:43:09.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.934+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25cc102760 con 0x7f25b80a14d0 2023-10-08T08:43:09.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.946+0000 7f25c3fff700 1 -- 172.21.15.70:0/1883007652 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426831 (secure 0 0 0) 0x7f25cc102760 con 0x7f25b80a14d0 2023-10-08T08:43:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:09.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25b80a14d0 msgr2=0x7f25b80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25b80a14d0 0x7f25b80a3990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25bc005fd0 tx=0x7f25bc005e30 comp rx=0 tx=0).stop 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc0ff750 msgr2=0x7f25cc101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc0ff750 0x7f25cc101280 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c920 tx=0x7f25b400cce0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 shutdown_connections 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f25b80a14d0 0x7f25b80a3990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25cc1056b0 0x7f25cc101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25cc0ff750 0x7f25cc101280 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 --2- 172.21.15.70:0/1883007652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25cc100110 0x7f25cc1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 >> 172.21.15.70:0/1883007652 conn(0x7f25cc075790 msgr2=0x7f25cc068470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 shutdown_connections 2023-10-08T08:43:09.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:09.950+0000 7f25d10e7700 1 -- 172.21.15.70:0/1883007652 wait complete. 2023-10-08T08:43:09.957 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-10-08T08:43:10.282 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2023-10-08T08:43:09.065568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":535,"num_read_kb":337,"num_write":390,"num_write_kb":3005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":320,"ondisk_log_size":320,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337964,"kb_used_data":13688,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603860,"statfs":{"total":1151940427776,"available":1151594352640,"internally_reserved":0,"allocated":14016512,"data_stored":7712969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003278"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275511+0000","last_change":"2023-10-08T08:42:01.146976+0000","last_active":"2023-10-08T08:42:39.275511+0000","last_peered":"2023-10-08T08:42:39.275511+0000","last_clean":"2023-10-08T08:42:39.275511+0000","last_became_active":"2023-10-08T08:42:01.146184+0000","last_became_peered":"2023-10-08T08:42:01.146184+0000","last_unstale":"2023-10-08T08:42:39.275511+0000","last_undegraded":"2023-10-08T08:42:39.275511+0000","last_fullsized":"2023-10-08T08:42:39.275511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:35.571911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273896+0000","last_change":"2023-10-08T08:42:01.142007+0000","last_active":"2023-10-08T08:42:39.273896+0000","last_peered":"2023-10-08T08:42:39.273896+0000","last_clean":"2023-10-08T08:42:39.273896+0000","last_became_active":"2023-10-08T08:42:01.141630+0000","last_became_peered":"2023-10-08T08:42:01.141630+0000","last_unstale":"2023-10-08T08:42:39.273896+0000","last_undegraded":"2023-10-08T08:42:39.273896+0000","last_fullsized":"2023-10-08T08:42:39.273896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:53.307828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272914+0000","last_change":"2023-10-08T08:42:01.154742+0000","last_active":"2023-10-08T08:42:39.272914+0000","last_peered":"2023-10-08T08:42:39.272914+0000","last_clean":"2023-10-08T08:42:39.272914+0000","last_became_active":"2023-10-08T08:42:01.154439+0000","last_became_peered":"2023-10-08T08:42:01.154439+0000","last_unstale":"2023-10-08T08:42:39.272914+0000","last_undegraded":"2023-10-08T08:42:39.272914+0000","last_fullsized":"2023-10-08T08:42:39.272914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:23.990594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270927+0000","last_change":"2023-10-08T08:42:01.149940+0000","last_active":"2023-10-08T08:42:39.270927+0000","last_peered":"2023-10-08T08:42:39.270927+0000","last_clean":"2023-10-08T08:42:39.270927+0000","last_became_active":"2023-10-08T08:42:01.149628+0000","last_became_peered":"2023-10-08T08:42:01.149628+0000","last_unstale":"2023-10-08T08:42:39.270927+0000","last_undegraded":"2023-10-08T08:42:39.270927+0000","last_fullsized":"2023-10-08T08:42:39.270927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:38.961102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272780+0000","last_change":"2023-10-08T08:42:01.145396+0000","last_active":"2023-10-08T08:42:39.272780+0000","last_peered":"2023-10-08T08:42:39.272780+0000","last_clean":"2023-10-08T08:42:39.272780+0000","last_became_active":"2023-10-08T08:42:01.140511+0000","last_became_peered":"2023-10-08T08:42:01.140511+0000","last_unstale":"2023-10-08T08:42:39.272780+0000","last_undegraded":"2023-10-08T08:42:39.272780+0000","last_fullsized":"2023-10-08T08:42:39.272780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:38.079768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273059+0000","last_change":"2023-10-08T08:42:01.128798+0000","last_active":"2023-10-08T08:42:39.273059+0000","last_peered":"2023-10-08T08:42:39.273059+0000","last_clean":"2023-10-08T08:42:39.273059+0000","last_became_active":"2023-10-08T08:42:01.128485+0000","last_became_peered":"2023-10-08T08:42:01.128485+0000","last_unstale":"2023-10-08T08:42:39.273059+0000","last_undegraded":"2023-10-08T08:42:39.273059+0000","last_fullsized":"2023-10-08T08:42:39.273059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:33:59.121551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277231+0000","last_change":"2023-10-08T08:42:01.136315+0000","last_active":"2023-10-08T08:42:39.277231+0000","last_peered":"2023-10-08T08:42:39.277231+0000","last_clean":"2023-10-08T08:42:39.277231+0000","last_became_active":"2023-10-08T08:42:01.136025+0000","last_became_peered":"2023-10-08T08:42:01.136025+0000","last_unstale":"2023-10-08T08:42:39.277231+0000","last_undegraded":"2023-10-08T08:42:39.277231+0000","last_fullsized":"2023-10-08T08:42:39.277231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:35.675920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269573+0000","last_change":"2023-10-08T08:42:01.129839+0000","last_active":"2023-10-08T08:42:39.269573+0000","last_peered":"2023-10-08T08:42:39.269573+0000","last_clean":"2023-10-08T08:42:39.269573+0000","last_became_active":"2023-10-08T08:42:01.129524+0000","last_became_peered":"2023-10-08T08:42:01.129524+0000","last_unstale":"2023-10-08T08:42:39.269573+0000","last_undegraded":"2023-10-08T08:42:39.269573+0000","last_fullsized":"2023-10-08T08:42:39.269573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:44.463024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276906+0000","last_change":"2023-10-08T08:42:01.135304+0000","last_active":"2023-10-08T08:42:39.276906+0000","last_peered":"2023-10-08T08:42:39.276906+0000","last_clean":"2023-10-08T08:42:39.276906+0000","last_became_active":"2023-10-08T08:42:01.134978+0000","last_became_peered":"2023-10-08T08:42:01.134978+0000","last_unstale":"2023-10-08T08:42:39.276906+0000","last_undegraded":"2023-10-08T08:42:39.276906+0000","last_fullsized":"2023-10-08T08:42:39.276906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:46:03.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273758+0000","last_change":"2023-10-08T08:42:01.134686+0000","last_active":"2023-10-08T08:42:39.273758+0000","last_peered":"2023-10-08T08:42:39.273758+0000","last_clean":"2023-10-08T08:42:39.273758+0000","last_became_active":"2023-10-08T08:42:01.134360+0000","last_became_peered":"2023-10-08T08:42:01.134360+0000","last_unstale":"2023-10-08T08:42:39.273758+0000","last_undegraded":"2023-10-08T08:42:39.273758+0000","last_fullsized":"2023-10-08T08:42:39.273758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:56.814182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278374+0000","last_change":"2023-10-08T08:42:01.148309+0000","last_active":"2023-10-08T08:42:39.278374+0000","last_peered":"2023-10-08T08:42:39.278374+0000","last_clean":"2023-10-08T08:42:39.278374+0000","last_became_active":"2023-10-08T08:42:01.147964+0000","last_became_peered":"2023-10-08T08:42:01.147964+0000","last_unstale":"2023-10-08T08:42:39.278374+0000","last_undegraded":"2023-10-08T08:42:39.278374+0000","last_fullsized":"2023-10-08T08:42:39.278374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:45.418572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270831+0000","last_change":"2023-10-08T08:42:01.148141+0000","last_active":"2023-10-08T08:42:39.270831+0000","last_peered":"2023-10-08T08:42:39.270831+0000","last_clean":"2023-10-08T08:42:39.270831+0000","last_became_active":"2023-10-08T08:42:01.147788+0000","last_became_peered":"2023-10-08T08:42:01.147788+0000","last_unstale":"2023-10-08T08:42:39.270831+0000","last_undegraded":"2023-10-08T08:42:39.270831+0000","last_fullsized":"2023-10-08T08:42:39.270831+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:37.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696516+0000","last_change":"2023-10-08T08:42:40.696516+0000","last_active":"2023-10-08T08:42:40.696516+0000","last_peered":"2023-10-08T08:42:40.696516+0000","last_clean":"2023-10-08T08:42:40.696516+0000","last_became_active":"2023-10-08T08:42:40.696193+0000","last_became_peered":"2023-10-08T08:42:40.696193+0000","last_unstale":"2023-10-08T08:42:40.696516+0000","last_undegraded":"2023-10-08T08:42:40.696516+0000","last_fullsized":"2023-10-08T08:42:40.696516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:40:57.843021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:01.148031+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:01.147785+0000","last_became_peered":"2023-10-08T08:42:01.147785+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:43.702638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272901+0000","last_change":"2023-10-08T08:42:01.154669+0000","last_active":"2023-10-08T08:42:39.272901+0000","last_peered":"2023-10-08T08:42:39.272901+0000","last_clean":"2023-10-08T08:42:39.272901+0000","last_became_active":"2023-10-08T08:42:01.154385+0000","last_became_peered":"2023-10-08T08:42:01.154385+0000","last_unstale":"2023-10-08T08:42:39.272901+0000","last_undegraded":"2023-10-08T08:42:39.272901+0000","last_fullsized":"2023-10-08T08:42:39.272901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:41.654979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275659+0000","last_change":"2023-10-08T08:42:01.143017+0000","last_active":"2023-10-08T08:42:39.275659+0000","last_peered":"2023-10-08T08:42:39.275659+0000","last_clean":"2023-10-08T08:42:39.275659+0000","last_became_active":"2023-10-08T08:42:01.142728+0000","last_became_peered":"2023-10-08T08:42:01.142728+0000","last_unstale":"2023-10-08T08:42:39.275659+0000","last_undegraded":"2023-10-08T08:42:39.275659+0000","last_fullsized":"2023-10-08T08:42:39.275659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.303212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275414+0000","last_change":"2023-10-08T08:42:01.147335+0000","last_active":"2023-10-08T08:42:39.275414+0000","last_peered":"2023-10-08T08:42:39.275414+0000","last_clean":"2023-10-08T08:42:39.275414+0000","last_became_active":"2023-10-08T08:42:01.146641+0000","last_became_peered":"2023-10-08T08:42:01.146641+0000","last_unstale":"2023-10-08T08:42:39.275414+0000","last_undegraded":"2023-10-08T08:42:39.275414+0000","last_fullsized":"2023-10-08T08:42:39.275414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:27.274207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275754+0000","last_change":"2023-10-08T08:42:01.132417+0000","last_active":"2023-10-08T08:42:39.275754+0000","last_peered":"2023-10-08T08:42:39.275754+0000","last_clean":"2023-10-08T08:42:39.275754+0000","last_became_active":"2023-10-08T08:42:01.132135+0000","last_became_peered":"2023-10-08T08:42:01.132135+0000","last_unstale":"2023-10-08T08:42:39.275754+0000","last_undegraded":"2023-10-08T08:42:39.275754+0000","last_fullsized":"2023-10-08T08:42:39.275754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:11.916677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279495+0000","last_change":"2023-10-08T08:42:01.136100+0000","last_active":"2023-10-08T08:42:39.279495+0000","last_peered":"2023-10-08T08:42:39.279495+0000","last_clean":"2023-10-08T08:42:39.279495+0000","last_became_active":"2023-10-08T08:42:01.135826+0000","last_became_peered":"2023-10-08T08:42:01.135826+0000","last_unstale":"2023-10-08T08:42:39.279495+0000","last_undegraded":"2023-10-08T08:42:39.279495+0000","last_fullsized":"2023-10-08T08:42:39.279495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:03.734296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279138+0000","last_change":"2023-10-08T08:42:05.177765+0000","last_active":"2023-10-08T08:42:39.279138+0000","last_peered":"2023-10-08T08:42:39.279138+0000","last_clean":"2023-10-08T08:42:39.279138+0000","last_became_active":"2023-10-08T08:42:05.177362+0000","last_became_peered":"2023-10-08T08:42:05.177362+0000","last_unstale":"2023-10-08T08:42:39.279138+0000","last_undegraded":"2023-10-08T08:42:39.279138+0000","last_fullsized":"2023-10-08T08:42:39.279138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:21.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:03.147351+0000","last_change":"2023-10-08T08:42:00.111581+0000","last_active":"2023-10-08T08:43:03.147351+0000","last_peered":"2023-10-08T08:43:03.147351+0000","last_clean":"2023-10-08T08:43:03.147351+0000","last_became_active":"2023-10-08T08:42:00.111298+0000","last_became_peered":"2023-10-08T08:42:00.111298+0000","last_unstale":"2023-10-08T08:43:03.147351+0000","last_undegraded":"2023-10-08T08:43:03.147351+0000","last_fullsized":"2023-10-08T08:43:03.147351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:52:39.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270526+0000","last_change":"2023-10-08T08:42:01.134630+0000","last_active":"2023-10-08T08:42:39.270526+0000","last_peered":"2023-10-08T08:42:39.270526+0000","last_clean":"2023-10-08T08:42:39.270526+0000","last_became_active":"2023-10-08T08:42:01.134347+0000","last_became_peered":"2023-10-08T08:42:01.134347+0000","last_unstale":"2023-10-08T08:42:39.270526+0000","last_undegraded":"2023-10-08T08:42:39.270526+0000","last_fullsized":"2023-10-08T08:42:39.270526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:51:14.364756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270287+0000","last_change":"2023-10-08T08:42:05.177223+0000","last_active":"2023-10-08T08:42:39.270287+0000","last_peered":"2023-10-08T08:42:39.270287+0000","last_clean":"2023-10-08T08:42:39.270287+0000","last_became_active":"2023-10-08T08:42:05.176811+0000","last_became_peered":"2023-10-08T08:42:05.176811+0000","last_unstale":"2023-10-08T08:42:39.270287+0000","last_undegraded":"2023-10-08T08:42:39.270287+0000","last_fullsized":"2023-10-08T08:42:39.270287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:41.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270575+0000","last_change":"2023-10-08T08:42:00.115860+0000","last_active":"2023-10-08T08:42:39.270575+0000","last_peered":"2023-10-08T08:42:39.270575+0000","last_clean":"2023-10-08T08:42:39.270575+0000","last_became_active":"2023-10-08T08:42:00.115601+0000","last_became_peered":"2023-10-08T08:42:00.115601+0000","last_unstale":"2023-10-08T08:42:39.270575+0000","last_undegraded":"2023-10-08T08:42:39.270575+0000","last_fullsized":"2023-10-08T08:42:39.270575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:20.071545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274100+0000","last_change":"2023-10-08T08:42:01.146648+0000","last_active":"2023-10-08T08:42:39.274100+0000","last_peered":"2023-10-08T08:42:39.274100+0000","last_clean":"2023-10-08T08:42:39.274100+0000","last_became_active":"2023-10-08T08:42:01.145978+0000","last_became_peered":"2023-10-08T08:42:01.145978+0000","last_unstale":"2023-10-08T08:42:39.274100+0000","last_undegraded":"2023-10-08T08:42:39.274100+0000","last_fullsized":"2023-10-08T08:42:39.274100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:55.768519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270396+0000","last_change":"2023-10-08T08:42:05.185079+0000","last_active":"2023-10-08T08:42:39.270396+0000","last_peered":"2023-10-08T08:42:39.270396+0000","last_clean":"2023-10-08T08:42:39.270396+0000","last_became_active":"2023-10-08T08:42:05.184521+0000","last_became_peered":"2023-10-08T08:42:05.184521+0000","last_unstale":"2023-10-08T08:42:39.270396+0000","last_undegraded":"2023-10-08T08:42:39.270396+0000","last_fullsized":"2023-10-08T08:42:39.270396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:39:17.457051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273959+0000","last_change":"2023-10-08T08:42:00.112111+0000","last_active":"2023-10-08T08:42:39.273959+0000","last_peered":"2023-10-08T08:42:39.273959+0000","last_clean":"2023-10-08T08:42:39.273959+0000","last_became_active":"2023-10-08T08:42:00.111808+0000","last_became_peered":"2023-10-08T08:42:00.111808+0000","last_unstale":"2023-10-08T08:42:39.273959+0000","last_undegraded":"2023-10-08T08:42:39.273959+0000","last_fullsized":"2023-10-08T08:42:39.273959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:03.022378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276049+0000","last_change":"2023-10-08T08:42:01.133308+0000","last_active":"2023-10-08T08:42:39.276049+0000","last_peered":"2023-10-08T08:42:39.276049+0000","last_clean":"2023-10-08T08:42:39.276049+0000","last_became_active":"2023-10-08T08:42:01.131649+0000","last_became_peered":"2023-10-08T08:42:01.131649+0000","last_unstale":"2023-10-08T08:42:39.276049+0000","last_undegraded":"2023-10-08T08:42:39.276049+0000","last_fullsized":"2023-10-08T08:42:39.276049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:05.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270293+0000","last_change":"2023-10-08T08:42:05.182409+0000","last_active":"2023-10-08T08:42:39.270293+0000","last_peered":"2023-10-08T08:42:39.270293+0000","last_clean":"2023-10-08T08:42:39.270293+0000","last_became_active":"2023-10-08T08:42:05.181974+0000","last_became_peered":"2023-10-08T08:42:05.181974+0000","last_unstale":"2023-10-08T08:42:39.270293+0000","last_undegraded":"2023-10-08T08:42:39.270293+0000","last_fullsized":"2023-10-08T08:42:39.270293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:05.821339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273251+0000","last_change":"2023-10-08T08:42:00.113287+0000","last_active":"2023-10-08T08:42:39.273251+0000","last_peered":"2023-10-08T08:42:39.273251+0000","last_clean":"2023-10-08T08:42:39.273251+0000","last_became_active":"2023-10-08T08:42:00.112996+0000","last_became_peered":"2023-10-08T08:42:00.112996+0000","last_unstale":"2023-10-08T08:42:39.273251+0000","last_undegraded":"2023-10-08T08:42:39.273251+0000","last_fullsized":"2023-10-08T08:42:39.273251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:42.559360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276426+0000","last_change":"2023-10-08T08:42:01.139763+0000","last_active":"2023-10-08T08:42:39.276426+0000","last_peered":"2023-10-08T08:42:39.276426+0000","last_clean":"2023-10-08T08:42:39.276426+0000","last_became_active":"2023-10-08T08:42:01.139451+0000","last_became_peered":"2023-10-08T08:42:01.139451+0000","last_unstale":"2023-10-08T08:42:39.276426+0000","last_undegraded":"2023-10-08T08:42:39.276426+0000","last_fullsized":"2023-10-08T08:42:39.276426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:10.166151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279067+0000","last_change":"2023-10-08T08:42:05.174612+0000","last_active":"2023-10-08T08:42:39.279067+0000","last_peered":"2023-10-08T08:42:39.279067+0000","last_clean":"2023-10-08T08:42:39.279067+0000","last_became_active":"2023-10-08T08:42:05.174174+0000","last_became_peered":"2023-10-08T08:42:05.174174+0000","last_unstale":"2023-10-08T08:42:39.279067+0000","last_undegraded":"2023-10-08T08:42:39.279067+0000","last_fullsized":"2023-10-08T08:42:39.279067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:07.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:03.136533+0000","last_change":"2023-10-08T08:42:00.112537+0000","last_active":"2023-10-08T08:43:03.136533+0000","last_peered":"2023-10-08T08:43:03.136533+0000","last_clean":"2023-10-08T08:43:03.136533+0000","last_became_active":"2023-10-08T08:42:00.112060+0000","last_became_peered":"2023-10-08T08:42:00.112060+0000","last_unstale":"2023-10-08T08:43:03.136533+0000","last_undegraded":"2023-10-08T08:43:03.136533+0000","last_fullsized":"2023-10-08T08:43:03.136533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:41.878960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273799+0000","last_change":"2023-10-08T08:42:01.146929+0000","last_active":"2023-10-08T08:42:39.273799+0000","last_peered":"2023-10-08T08:42:39.273799+0000","last_clean":"2023-10-08T08:42:39.273799+0000","last_became_active":"2023-10-08T08:42:01.145980+0000","last_became_peered":"2023-10-08T08:42:01.145980+0000","last_unstale":"2023-10-08T08:42:39.273799+0000","last_undegraded":"2023-10-08T08:42:39.273799+0000","last_fullsized":"2023-10-08T08:42:39.273799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:37.411832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.443543+0000","last_change":"2023-10-08T08:42:40.443543+0000","last_active":"2023-10-08T08:42:40.443543+0000","last_peered":"2023-10-08T08:42:40.443543+0000","last_clean":"2023-10-08T08:42:40.443543+0000","last_became_active":"2023-10-08T08:42:40.443041+0000","last_became_peered":"2023-10-08T08:42:40.443041+0000","last_unstale":"2023-10-08T08:42:40.443543+0000","last_undegraded":"2023-10-08T08:42:40.443543+0000","last_fullsized":"2023-10-08T08:42:40.443543+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:21:35.827659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:00.115656+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:00.115342+0000","last_became_peered":"2023-10-08T08:42:00.115342+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:32.630853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277813+0000","last_change":"2023-10-08T08:42:01.139137+0000","last_active":"2023-10-08T08:42:39.277813+0000","last_peered":"2023-10-08T08:42:39.277813+0000","last_clean":"2023-10-08T08:42:39.277813+0000","last_became_active":"2023-10-08T08:42:01.138510+0000","last_became_peered":"2023-10-08T08:42:01.138510+0000","last_unstale":"2023-10-08T08:42:39.277813+0000","last_undegraded":"2023-10-08T08:42:39.277813+0000","last_fullsized":"2023-10-08T08:42:39.277813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:16:28.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275308+0000","last_change":"2023-10-08T08:42:05.179770+0000","last_active":"2023-10-08T08:42:39.275308+0000","last_peered":"2023-10-08T08:42:39.275308+0000","last_clean":"2023-10-08T08:42:39.275308+0000","last_became_active":"2023-10-08T08:42:05.179312+0000","last_became_peered":"2023-10-08T08:42:05.179312+0000","last_unstale":"2023-10-08T08:42:39.275308+0000","last_undegraded":"2023-10-08T08:42:39.275308+0000","last_fullsized":"2023-10-08T08:42:39.275308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.947270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276681+0000","last_change":"2023-10-08T08:42:00.111299+0000","last_active":"2023-10-08T08:42:39.276681+0000","last_peered":"2023-10-08T08:42:39.276681+0000","last_clean":"2023-10-08T08:42:39.276681+0000","last_became_active":"2023-10-08T08:42:00.110966+0000","last_became_peered":"2023-10-08T08:42:00.110966+0000","last_unstale":"2023-10-08T08:42:39.276681+0000","last_undegraded":"2023-10-08T08:42:39.276681+0000","last_fullsized":"2023-10-08T08:42:39.276681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:34.211598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269504+0000","last_change":"2023-10-08T08:42:01.134205+0000","last_active":"2023-10-08T08:42:39.269504+0000","last_peered":"2023-10-08T08:42:39.269504+0000","last_clean":"2023-10-08T08:42:39.269504+0000","last_became_active":"2023-10-08T08:42:01.133887+0000","last_became_peered":"2023-10-08T08:42:01.133887+0000","last_unstale":"2023-10-08T08:42:39.269504+0000","last_undegraded":"2023-10-08T08:42:39.269504+0000","last_fullsized":"2023-10-08T08:42:39.269504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:01.807150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273842+0000","last_change":"2023-10-08T08:42:05.179119+0000","last_active":"2023-10-08T08:42:39.273842+0000","last_peered":"2023-10-08T08:42:39.273842+0000","last_clean":"2023-10-08T08:42:39.273842+0000","last_became_active":"2023-10-08T08:42:05.178712+0000","last_became_peered":"2023-10-08T08:42:05.178712+0000","last_unstale":"2023-10-08T08:42:39.273842+0000","last_undegraded":"2023-10-08T08:42:39.273842+0000","last_fullsized":"2023-10-08T08:42:39.273842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:54:38.514047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278470+0000","last_change":"2023-10-08T08:42:00.116426+0000","last_active":"2023-10-08T08:42:39.278470+0000","last_peered":"2023-10-08T08:42:39.278470+0000","last_clean":"2023-10-08T08:42:39.278470+0000","last_became_active":"2023-10-08T08:42:00.115313+0000","last_became_peered":"2023-10-08T08:42:00.115313+0000","last_unstale":"2023-10-08T08:42:39.278470+0000","last_undegraded":"2023-10-08T08:42:39.278470+0000","last_fullsized":"2023-10-08T08:42:39.278470+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:42.989380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275493+0000","last_change":"2023-10-08T08:42:01.129719+0000","last_active":"2023-10-08T08:42:39.275493+0000","last_peered":"2023-10-08T08:42:39.275493+0000","last_clean":"2023-10-08T08:42:39.275493+0000","last_became_active":"2023-10-08T08:42:01.129293+0000","last_became_peered":"2023-10-08T08:42:01.129293+0000","last_unstale":"2023-10-08T08:42:39.275493+0000","last_undegraded":"2023-10-08T08:42:39.275493+0000","last_fullsized":"2023-10-08T08:42:39.275493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:35.463614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269587+0000","last_change":"2023-10-08T08:42:05.172880+0000","last_active":"2023-10-08T08:42:39.269587+0000","last_peered":"2023-10-08T08:42:39.269587+0000","last_clean":"2023-10-08T08:42:39.269587+0000","last_became_active":"2023-10-08T08:42:05.172485+0000","last_became_peered":"2023-10-08T08:42:05.172485+0000","last_unstale":"2023-10-08T08:42:39.269587+0000","last_undegraded":"2023-10-08T08:42:39.269587+0000","last_fullsized":"2023-10-08T08:42:39.269587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:29.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:04.137170+0000","last_change":"2023-10-08T08:42:00.115206+0000","last_active":"2023-10-08T08:43:04.137170+0000","last_peered":"2023-10-08T08:43:04.137170+0000","last_clean":"2023-10-08T08:43:04.137170+0000","last_became_active":"2023-10-08T08:42:00.114905+0000","last_became_peered":"2023-10-08T08:42:00.114905+0000","last_unstale":"2023-10-08T08:43:04.137170+0000","last_undegraded":"2023-10-08T08:43:04.137170+0000","last_fullsized":"2023-10-08T08:43:04.137170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:09.275317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276638+0000","last_change":"2023-10-08T08:42:01.141422+0000","last_active":"2023-10-08T08:42:39.276638+0000","last_peered":"2023-10-08T08:42:39.276638+0000","last_clean":"2023-10-08T08:42:39.276638+0000","last_became_active":"2023-10-08T08:42:01.140979+0000","last_became_peered":"2023-10-08T08:42:01.140979+0000","last_unstale":"2023-10-08T08:42:39.276638+0000","last_undegraded":"2023-10-08T08:42:39.276638+0000","last_fullsized":"2023-10-08T08:42:39.276638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:14.018786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275152+0000","last_change":"2023-10-08T08:42:05.184358+0000","last_active":"2023-10-08T08:42:39.275152+0000","last_peered":"2023-10-08T08:42:39.275152+0000","last_clean":"2023-10-08T08:42:39.275152+0000","last_became_active":"2023-10-08T08:42:05.183994+0000","last_became_peered":"2023-10-08T08:42:05.183994+0000","last_unstale":"2023-10-08T08:42:39.275152+0000","last_undegraded":"2023-10-08T08:42:39.275152+0000","last_fullsized":"2023-10-08T08:42:39.275152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:46.465110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277535+0000","last_change":"2023-10-08T08:42:00.115765+0000","last_active":"2023-10-08T08:42:39.277535+0000","last_peered":"2023-10-08T08:42:39.277535+0000","last_clean":"2023-10-08T08:42:39.277535+0000","last_became_active":"2023-10-08T08:42:00.115288+0000","last_became_peered":"2023-10-08T08:42:00.115288+0000","last_unstale":"2023-10-08T08:42:39.277535+0000","last_undegraded":"2023-10-08T08:42:39.277535+0000","last_fullsized":"2023-10-08T08:42:39.277535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:20.973280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273767+0000","last_change":"2023-10-08T08:42:01.143290+0000","last_active":"2023-10-08T08:42:39.273767+0000","last_peered":"2023-10-08T08:42:39.273767+0000","last_clean":"2023-10-08T08:42:39.273767+0000","last_became_active":"2023-10-08T08:42:01.143034+0000","last_became_peered":"2023-10-08T08:42:01.143034+0000","last_unstale":"2023-10-08T08:42:39.273767+0000","last_undegraded":"2023-10-08T08:42:39.273767+0000","last_fullsized":"2023-10-08T08:42:39.273767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:45.784275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.271060+0000","last_change":"2023-10-08T08:42:05.185022+0000","last_active":"2023-10-08T08:42:39.271060+0000","last_peered":"2023-10-08T08:42:39.271060+0000","last_clean":"2023-10-08T08:42:39.271060+0000","last_became_active":"2023-10-08T08:42:05.184476+0000","last_became_peered":"2023-10-08T08:42:05.184476+0000","last_unstale":"2023-10-08T08:42:39.271060+0000","last_undegraded":"2023-10-08T08:42:39.271060+0000","last_fullsized":"2023-10-08T08:42:39.271060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:14:04.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276317+0000","last_change":"2023-10-08T08:42:00.115556+0000","last_active":"2023-10-08T08:42:39.276317+0000","last_peered":"2023-10-08T08:42:39.276317+0000","last_clean":"2023-10-08T08:42:39.276317+0000","last_became_active":"2023-10-08T08:42:00.115251+0000","last_became_peered":"2023-10-08T08:42:00.115251+0000","last_unstale":"2023-10-08T08:42:39.276317+0000","last_undegraded":"2023-10-08T08:42:39.276317+0000","last_fullsized":"2023-10-08T08:42:39.276317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:55.439502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276120+0000","last_change":"2023-10-08T08:42:01.135969+0000","last_active":"2023-10-08T08:42:39.276120+0000","last_peered":"2023-10-08T08:42:39.276120+0000","last_clean":"2023-10-08T08:42:39.276120+0000","last_became_active":"2023-10-08T08:42:01.135615+0000","last_became_peered":"2023-10-08T08:42:01.135615+0000","last_unstale":"2023-10-08T08:42:39.276120+0000","last_undegraded":"2023-10-08T08:42:39.276120+0000","last_fullsized":"2023-10-08T08:42:39.276120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:23.153920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276151+0000","last_change":"2023-10-08T08:42:05.177904+0000","last_active":"2023-10-08T08:42:39.276151+0000","last_peered":"2023-10-08T08:42:39.276151+0000","last_clean":"2023-10-08T08:42:39.276151+0000","last_became_active":"2023-10-08T08:42:05.176397+0000","last_became_peered":"2023-10-08T08:42:05.176397+0000","last_unstale":"2023-10-08T08:42:39.276151+0000","last_undegraded":"2023-10-08T08:42:39.276151+0000","last_fullsized":"2023-10-08T08:42:39.276151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:50.134974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'14","reported_seq":107,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:04.137212+0000","last_change":"2023-10-08T08:42:00.114485+0000","last_active":"2023-10-08T08:43:04.137212+0000","last_peered":"2023-10-08T08:43:04.137212+0000","last_clean":"2023-10-08T08:43:04.137212+0000","last_became_active":"2023-10-08T08:42:00.114186+0000","last_became_peered":"2023-10-08T08:42:00.114186+0000","last_unstale":"2023-10-08T08:43:04.137212+0000","last_undegraded":"2023-10-08T08:43:04.137212+0000","last_fullsized":"2023-10-08T08:43:04.137212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:30.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":74,"num_read_kb":41,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273394+0000","last_change":"2023-10-08T08:42:01.146627+0000","last_active":"2023-10-08T08:42:39.273394+0000","last_peered":"2023-10-08T08:42:39.273394+0000","last_clean":"2023-10-08T08:42:39.273394+0000","last_became_active":"2023-10-08T08:42:01.146332+0000","last_became_peered":"2023-10-08T08:42:01.146332+0000","last_unstale":"2023-10-08T08:42:39.273394+0000","last_undegraded":"2023-10-08T08:42:39.273394+0000","last_fullsized":"2023-10-08T08:42:39.273394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:00.825191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278530+0000","last_change":"2023-10-08T08:42:05.173257+0000","last_active":"2023-10-08T08:42:39.278530+0000","last_peered":"2023-10-08T08:42:39.278530+0000","last_clean":"2023-10-08T08:42:39.278530+0000","last_became_active":"2023-10-08T08:42:05.172891+0000","last_became_peered":"2023-10-08T08:42:05.172891+0000","last_unstale":"2023-10-08T08:42:39.278530+0000","last_undegraded":"2023-10-08T08:42:39.278530+0000","last_fullsized":"2023-10-08T08:42:39.278530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:32.802194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279368+0000","last_change":"2023-10-08T08:42:00.113330+0000","last_active":"2023-10-08T08:42:39.279368+0000","last_peered":"2023-10-08T08:42:39.279368+0000","last_clean":"2023-10-08T08:42:39.279368+0000","last_became_active":"2023-10-08T08:42:00.112183+0000","last_became_peered":"2023-10-08T08:42:00.112183+0000","last_unstale":"2023-10-08T08:42:39.279368+0000","last_undegraded":"2023-10-08T08:42:39.279368+0000","last_fullsized":"2023-10-08T08:42:39.279368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:13.158570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275089+0000","last_change":"2023-10-08T08:42:01.133854+0000","last_active":"2023-10-08T08:42:39.275089+0000","last_peered":"2023-10-08T08:42:39.275089+0000","last_clean":"2023-10-08T08:42:39.275089+0000","last_became_active":"2023-10-08T08:42:01.133540+0000","last_became_peered":"2023-10-08T08:42:01.133540+0000","last_unstale":"2023-10-08T08:42:39.275089+0000","last_undegraded":"2023-10-08T08:42:39.275089+0000","last_fullsized":"2023-10-08T08:42:39.275089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:50.011909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275437+0000","last_change":"2023-10-08T08:42:05.180359+0000","last_active":"2023-10-08T08:42:39.275437+0000","last_peered":"2023-10-08T08:42:39.275437+0000","last_clean":"2023-10-08T08:42:39.275437+0000","last_became_active":"2023-10-08T08:42:05.179877+0000","last_became_peered":"2023-10-08T08:42:05.179877+0000","last_unstale":"2023-10-08T08:42:39.275437+0000","last_undegraded":"2023-10-08T08:42:39.275437+0000","last_fullsized":"2023-10-08T08:42:39.275437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:52.926297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276709+0000","last_change":"2023-10-08T08:42:00.112036+0000","last_active":"2023-10-08T08:42:39.276709+0000","last_peered":"2023-10-08T08:42:39.276709+0000","last_clean":"2023-10-08T08:42:39.276709+0000","last_became_active":"2023-10-08T08:42:00.111710+0000","last_became_peered":"2023-10-08T08:42:00.111710+0000","last_unstale":"2023-10-08T08:42:39.276709+0000","last_undegraded":"2023-10-08T08:42:39.276709+0000","last_fullsized":"2023-10-08T08:42:39.276709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:58:16.004802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277573+0000","last_change":"2023-10-08T08:42:01.135245+0000","last_active":"2023-10-08T08:42:39.277573+0000","last_peered":"2023-10-08T08:42:39.277573+0000","last_clean":"2023-10-08T08:42:39.277573+0000","last_became_active":"2023-10-08T08:42:01.134941+0000","last_became_peered":"2023-10-08T08:42:01.134941+0000","last_unstale":"2023-10-08T08:42:39.277573+0000","last_undegraded":"2023-10-08T08:42:39.277573+0000","last_fullsized":"2023-10-08T08:42:39.277573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:13.745895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.282736+0000","last_change":"2023-10-08T08:42:40.281786+0000","last_active":"2023-10-08T08:42:40.282736+0000","last_peered":"2023-10-08T08:42:40.282736+0000","last_clean":"2023-10-08T08:42:40.282736+0000","last_became_active":"2023-10-08T08:42:40.280780+0000","last_became_peered":"2023-10-08T08:42:40.280780+0000","last_unstale":"2023-10-08T08:42:40.282736+0000","last_undegraded":"2023-10-08T08:42:40.282736+0000","last_fullsized":"2023-10-08T08:42:40.282736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:49.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:04.138486+0000","last_change":"2023-10-08T08:42:00.112610+0000","last_active":"2023-10-08T08:43:04.138486+0000","last_peered":"2023-10-08T08:43:04.138486+0000","last_clean":"2023-10-08T08:43:04.138486+0000","last_became_active":"2023-10-08T08:42:00.112313+0000","last_became_peered":"2023-10-08T08:42:00.112313+0000","last_unstale":"2023-10-08T08:43:04.138486+0000","last_undegraded":"2023-10-08T08:43:04.138486+0000","last_fullsized":"2023-10-08T08:43:04.138486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:35.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277060+0000","last_change":"2023-10-08T08:42:01.141538+0000","last_active":"2023-10-08T08:42:39.277060+0000","last_peered":"2023-10-08T08:42:39.277060+0000","last_clean":"2023-10-08T08:42:39.277060+0000","last_became_active":"2023-10-08T08:42:01.141241+0000","last_became_peered":"2023-10-08T08:42:01.141241+0000","last_unstale":"2023-10-08T08:42:39.277060+0000","last_undegraded":"2023-10-08T08:42:39.277060+0000","last_fullsized":"2023-10-08T08:42:39.277060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:41.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275573+0000","last_change":"2023-10-08T08:42:05.181949+0000","last_active":"2023-10-08T08:42:39.275573+0000","last_peered":"2023-10-08T08:42:39.275573+0000","last_clean":"2023-10-08T08:42:39.275573+0000","last_became_active":"2023-10-08T08:42:05.181532+0000","last_became_peered":"2023-10-08T08:42:05.181532+0000","last_unstale":"2023-10-08T08:42:39.275573+0000","last_undegraded":"2023-10-08T08:42:39.275573+0000","last_fullsized":"2023-10-08T08:42:39.275573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:44.035004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272872+0000","last_change":"2023-10-08T08:42:00.111175+0000","last_active":"2023-10-08T08:42:39.272872+0000","last_peered":"2023-10-08T08:42:39.272872+0000","last_clean":"2023-10-08T08:42:39.272872+0000","last_became_active":"2023-10-08T08:42:00.109672+0000","last_became_peered":"2023-10-08T08:42:00.109672+0000","last_unstale":"2023-10-08T08:42:39.272872+0000","last_undegraded":"2023-10-08T08:42:39.272872+0000","last_fullsized":"2023-10-08T08:42:39.272872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:42.715127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278596+0000","last_change":"2023-10-08T08:42:01.133910+0000","last_active":"2023-10-08T08:42:39.278596+0000","last_peered":"2023-10-08T08:42:39.278596+0000","last_clean":"2023-10-08T08:42:39.278596+0000","last_became_active":"2023-10-08T08:42:01.132738+0000","last_became_peered":"2023-10-08T08:42:01.132738+0000","last_unstale":"2023-10-08T08:42:39.278596+0000","last_undegraded":"2023-10-08T08:42:39.278596+0000","last_fullsized":"2023-10-08T08:42:39.278596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:19.966595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276206+0000","last_change":"2023-10-08T08:42:05.177048+0000","last_active":"2023-10-08T08:42:39.276206+0000","last_peered":"2023-10-08T08:42:39.276206+0000","last_clean":"2023-10-08T08:42:39.276206+0000","last_became_active":"2023-10-08T08:42:05.176654+0000","last_became_peered":"2023-10-08T08:42:05.176654+0000","last_unstale":"2023-10-08T08:42:39.276206+0000","last_undegraded":"2023-10-08T08:42:39.276206+0000","last_fullsized":"2023-10-08T08:42:39.276206+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:22.424769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274788+0000","last_change":"2023-10-08T08:42:00.112684+0000","last_active":"2023-10-08T08:42:39.274788+0000","last_peered":"2023-10-08T08:42:39.274788+0000","last_clean":"2023-10-08T08:42:39.274788+0000","last_became_active":"2023-10-08T08:42:00.112235+0000","last_became_peered":"2023-10-08T08:42:00.112235+0000","last_unstale":"2023-10-08T08:42:39.274788+0000","last_undegraded":"2023-10-08T08:42:39.274788+0000","last_fullsized":"2023-10-08T08:42:39.274788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:47.984940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276005+0000","last_change":"2023-10-08T08:42:01.133393+0000","last_active":"2023-10-08T08:42:39.276005+0000","last_peered":"2023-10-08T08:42:39.276005+0000","last_clean":"2023-10-08T08:42:39.276005+0000","last_became_active":"2023-10-08T08:42:01.133121+0000","last_became_peered":"2023-10-08T08:42:01.133121+0000","last_unstale":"2023-10-08T08:42:39.276005+0000","last_undegraded":"2023-10-08T08:42:39.276005+0000","last_fullsized":"2023-10-08T08:42:39.276005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:54.542269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.281572+0000","last_change":"2023-10-08T08:42:40.281572+0000","last_active":"2023-10-08T08:42:40.281572+0000","last_peered":"2023-10-08T08:42:40.281572+0000","last_clean":"2023-10-08T08:42:40.281572+0000","last_became_active":"2023-10-08T08:42:40.280996+0000","last_became_peered":"2023-10-08T08:42:40.280996+0000","last_unstale":"2023-10-08T08:42:40.281572+0000","last_undegraded":"2023-10-08T08:42:40.281572+0000","last_fullsized":"2023-10-08T08:42:40.281572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:11:34.435906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277067+0000","last_change":"2023-10-08T08:42:00.110059+0000","last_active":"2023-10-08T08:42:39.277067+0000","last_peered":"2023-10-08T08:42:39.277067+0000","last_clean":"2023-10-08T08:42:39.277067+0000","last_became_active":"2023-10-08T08:42:00.109743+0000","last_became_peered":"2023-10-08T08:42:00.109743+0000","last_unstale":"2023-10-08T08:42:39.277067+0000","last_undegraded":"2023-10-08T08:42:39.277067+0000","last_fullsized":"2023-10-08T08:42:39.277067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:03:40.950213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273339+0000","last_change":"2023-10-08T08:42:01.133595+0000","last_active":"2023-10-08T08:42:39.273339+0000","last_peered":"2023-10-08T08:42:39.273339+0000","last_clean":"2023-10-08T08:42:39.273339+0000","last_became_active":"2023-10-08T08:42:01.133268+0000","last_became_peered":"2023-10-08T08:42:01.133268+0000","last_unstale":"2023-10-08T08:42:39.273339+0000","last_undegraded":"2023-10-08T08:42:39.273339+0000","last_fullsized":"2023-10-08T08:42:39.273339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:49.571517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276328+0000","last_change":"2023-10-08T08:42:05.174472+0000","last_active":"2023-10-08T08:42:39.276328+0000","last_peered":"2023-10-08T08:42:39.276328+0000","last_clean":"2023-10-08T08:42:39.276328+0000","last_became_active":"2023-10-08T08:42:05.174073+0000","last_became_peered":"2023-10-08T08:42:05.174073+0000","last_unstale":"2023-10-08T08:42:39.276328+0000","last_undegraded":"2023-10-08T08:42:39.276328+0000","last_fullsized":"2023-10-08T08:42:39.276328+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:36.208008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:06.151259+0000","last_change":"2023-10-08T08:42:00.115978+0000","last_active":"2023-10-08T08:43:06.151259+0000","last_peered":"2023-10-08T08:43:06.151259+0000","last_clean":"2023-10-08T08:43:06.151259+0000","last_became_active":"2023-10-08T08:42:00.115670+0000","last_became_peered":"2023-10-08T08:42:00.115670+0000","last_unstale":"2023-10-08T08:43:06.151259+0000","last_undegraded":"2023-10-08T08:43:06.151259+0000","last_fullsized":"2023-10-08T08:43:06.151259+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:11:41.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696927+0000","last_change":"2023-10-08T08:42:40.696927+0000","last_active":"2023-10-08T08:42:40.696927+0000","last_peered":"2023-10-08T08:42:40.696927+0000","last_clean":"2023-10-08T08:42:40.696927+0000","last_became_active":"2023-10-08T08:42:40.696534+0000","last_became_peered":"2023-10-08T08:42:40.696534+0000","last_unstale":"2023-10-08T08:42:40.696927+0000","last_undegraded":"2023-10-08T08:42:40.696927+0000","last_fullsized":"2023-10-08T08:42:40.696927+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:05.888834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275650+0000","last_change":"2023-10-08T08:42:05.177922+0000","last_active":"2023-10-08T08:42:39.275650+0000","last_peered":"2023-10-08T08:42:39.275650+0000","last_clean":"2023-10-08T08:42:39.275650+0000","last_became_active":"2023-10-08T08:42:05.177504+0000","last_became_peered":"2023-10-08T08:42:05.177504+0000","last_unstale":"2023-10-08T08:42:39.275650+0000","last_undegraded":"2023-10-08T08:42:39.275650+0000","last_fullsized":"2023-10-08T08:42:39.275650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:02.602437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278640+0000","last_change":"2023-10-08T08:42:01.139125+0000","last_active":"2023-10-08T08:42:39.278640+0000","last_peered":"2023-10-08T08:42:39.278640+0000","last_clean":"2023-10-08T08:42:39.278640+0000","last_became_active":"2023-10-08T08:42:01.138769+0000","last_became_peered":"2023-10-08T08:42:01.138769+0000","last_unstale":"2023-10-08T08:42:39.278640+0000","last_undegraded":"2023-10-08T08:42:39.278640+0000","last_fullsized":"2023-10-08T08:42:39.278640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:31:57.717833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:06.140130+0000","last_change":"2023-10-08T08:42:00.115528+0000","last_active":"2023-10-08T08:43:06.140130+0000","last_peered":"2023-10-08T08:43:06.140130+0000","last_clean":"2023-10-08T08:43:06.140130+0000","last_became_active":"2023-10-08T08:42:00.115189+0000","last_became_peered":"2023-10-08T08:42:00.115189+0000","last_unstale":"2023-10-08T08:43:06.140130+0000","last_undegraded":"2023-10-08T08:43:06.140130+0000","last_fullsized":"2023-10-08T08:43:06.140130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.254073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.695382+0000","last_change":"2023-10-08T08:42:40.695382+0000","last_active":"2023-10-08T08:42:40.695382+0000","last_peered":"2023-10-08T08:42:40.695382+0000","last_clean":"2023-10-08T08:42:40.695382+0000","last_became_active":"2023-10-08T08:42:40.695009+0000","last_became_peered":"2023-10-08T08:42:40.695009+0000","last_unstale":"2023-10-08T08:42:40.695382+0000","last_undegraded":"2023-10-08T08:42:40.695382+0000","last_fullsized":"2023-10-08T08:42:40.695382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:35.298546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269706+0000","last_change":"2023-10-08T08:42:01.131992+0000","last_active":"2023-10-08T08:42:39.269706+0000","last_peered":"2023-10-08T08:42:39.269706+0000","last_clean":"2023-10-08T08:42:39.269706+0000","last_became_active":"2023-10-08T08:42:01.131633+0000","last_became_peered":"2023-10-08T08:42:01.131633+0000","last_unstale":"2023-10-08T08:42:39.269706+0000","last_undegraded":"2023-10-08T08:42:39.269706+0000","last_fullsized":"2023-10-08T08:42:39.269706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:40.653710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270531+0000","last_change":"2023-10-08T08:42:00.112987+0000","last_active":"2023-10-08T08:42:39.270531+0000","last_peered":"2023-10-08T08:42:39.270531+0000","last_clean":"2023-10-08T08:42:39.270531+0000","last_became_active":"2023-10-08T08:42:00.112276+0000","last_became_peered":"2023-10-08T08:42:00.112276+0000","last_unstale":"2023-10-08T08:42:39.270531+0000","last_undegraded":"2023-10-08T08:42:39.270531+0000","last_fullsized":"2023-10-08T08:42:39.270531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.193726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277082+0000","last_change":"2023-10-08T08:41:02.223132+0000","last_active":"2023-10-08T08:42:39.277082+0000","last_peered":"2023-10-08T08:42:39.277082+0000","last_clean":"2023-10-08T08:42:39.277082+0000","last_became_active":"2023-10-08T08:41:02.222688+0000","last_became_peered":"2023-10-08T08:41:02.222688+0000","last_unstale":"2023-10-08T08:42:39.277082+0000","last_undegraded":"2023-10-08T08:42:39.277082+0000","last_fullsized":"2023-10-08T08:42:39.277082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_clean_scrub_stamp":"2023-10-08T08:38:15.738972+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:27.673603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276236+0000","last_change":"2023-10-08T08:42:05.169025+0000","last_active":"2023-10-08T08:42:39.276236+0000","last_peered":"2023-10-08T08:42:39.276236+0000","last_clean":"2023-10-08T08:42:39.276236+0000","last_became_active":"2023-10-08T08:42:05.168100+0000","last_became_peered":"2023-10-08T08:42:05.168100+0000","last_unstale":"2023-10-08T08:42:39.276236+0000","last_undegraded":"2023-10-08T08:42:39.276236+0000","last_fullsized":"2023-10-08T08:42:39.276236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:30:40.830952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276572+0000","last_change":"2023-10-08T08:42:01.130878+0000","last_active":"2023-10-08T08:42:39.276572+0000","last_peered":"2023-10-08T08:42:39.276572+0000","last_clean":"2023-10-08T08:42:39.276572+0000","last_became_active":"2023-10-08T08:42:01.130649+0000","last_became_peered":"2023-10-08T08:42:01.130649+0000","last_unstale":"2023-10-08T08:42:39.276572+0000","last_undegraded":"2023-10-08T08:42:39.276572+0000","last_fullsized":"2023-10-08T08:42:39.276572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:15.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277371+0000","last_change":"2023-10-08T08:42:00.117747+0000","last_active":"2023-10-08T08:42:39.277371+0000","last_peered":"2023-10-08T08:42:39.277371+0000","last_clean":"2023-10-08T08:42:39.277371+0000","last_became_active":"2023-10-08T08:42:00.117437+0000","last_became_peered":"2023-10-08T08:42:00.117437+0000","last_unstale":"2023-10-08T08:42:39.277371+0000","last_undegraded":"2023-10-08T08:42:39.277371+0000","last_fullsized":"2023-10-08T08:42:39.277371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:13.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274614+0000","last_change":"2023-10-08T08:42:05.173175+0000","last_active":"2023-10-08T08:42:39.274614+0000","last_peered":"2023-10-08T08:42:39.274614+0000","last_clean":"2023-10-08T08:42:39.274614+0000","last_became_active":"2023-10-08T08:42:05.172754+0000","last_became_peered":"2023-10-08T08:42:05.172754+0000","last_unstale":"2023-10-08T08:42:39.274614+0000","last_undegraded":"2023-10-08T08:42:39.274614+0000","last_fullsized":"2023-10-08T08:42:39.274614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:48.900020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273546+0000","last_change":"2023-10-08T08:42:00.117094+0000","last_active":"2023-10-08T08:42:39.273546+0000","last_peered":"2023-10-08T08:42:39.273546+0000","last_clean":"2023-10-08T08:42:39.273546+0000","last_became_active":"2023-10-08T08:42:00.116773+0000","last_became_peered":"2023-10-08T08:42:00.116773+0000","last_unstale":"2023-10-08T08:42:39.273546+0000","last_undegraded":"2023-10-08T08:42:39.273546+0000","last_fullsized":"2023-10-08T08:42:39.273546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:28.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276460+0000","last_change":"2023-10-08T08:42:01.146290+0000","last_active":"2023-10-08T08:42:39.276460+0000","last_peered":"2023-10-08T08:42:39.276460+0000","last_clean":"2023-10-08T08:42:39.276460+0000","last_became_active":"2023-10-08T08:42:01.145585+0000","last_became_peered":"2023-10-08T08:42:01.145585+0000","last_unstale":"2023-10-08T08:42:39.276460+0000","last_undegraded":"2023-10-08T08:42:39.276460+0000","last_fullsized":"2023-10-08T08:42:39.276460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:16:15.140659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269495+0000","last_change":"2023-10-08T08:42:05.177611+0000","last_active":"2023-10-08T08:42:39.269495+0000","last_peered":"2023-10-08T08:42:39.269495+0000","last_clean":"2023-10-08T08:42:39.269495+0000","last_became_active":"2023-10-08T08:42:05.177027+0000","last_became_peered":"2023-10-08T08:42:05.177027+0000","last_unstale":"2023-10-08T08:42:39.269495+0000","last_undegraded":"2023-10-08T08:42:39.269495+0000","last_fullsized":"2023-10-08T08:42:39.269495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.846359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275664+0000","last_change":"2023-10-08T08:42:00.112453+0000","last_active":"2023-10-08T08:42:39.275664+0000","last_peered":"2023-10-08T08:42:39.275664+0000","last_clean":"2023-10-08T08:42:39.275664+0000","last_became_active":"2023-10-08T08:42:00.112159+0000","last_became_peered":"2023-10-08T08:42:00.112159+0000","last_unstale":"2023-10-08T08:42:39.275664+0000","last_undegraded":"2023-10-08T08:42:39.275664+0000","last_fullsized":"2023-10-08T08:42:39.275664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:27.713764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270602+0000","last_change":"2023-10-08T08:42:01.136743+0000","last_active":"2023-10-08T08:42:39.270602+0000","last_peered":"2023-10-08T08:42:39.270602+0000","last_clean":"2023-10-08T08:42:39.270602+0000","last_became_active":"2023-10-08T08:42:01.136442+0000","last_became_peered":"2023-10-08T08:42:01.136442+0000","last_unstale":"2023-10-08T08:42:39.270602+0000","last_undegraded":"2023-10-08T08:42:39.270602+0000","last_fullsized":"2023-10-08T08:42:39.270602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:50:41.937240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278976+0000","last_change":"2023-10-08T08:42:05.171945+0000","last_active":"2023-10-08T08:42:39.278976+0000","last_peered":"2023-10-08T08:42:39.278976+0000","last_clean":"2023-10-08T08:42:39.278976+0000","last_became_active":"2023-10-08T08:42:05.171573+0000","last_became_peered":"2023-10-08T08:42:05.171573+0000","last_unstale":"2023-10-08T08:42:39.278976+0000","last_undegraded":"2023-10-08T08:42:39.278976+0000","last_fullsized":"2023-10-08T08:42:39.278976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:03.677144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270977+0000","last_change":"2023-10-08T08:42:00.116005+0000","last_active":"2023-10-08T08:42:39.270977+0000","last_peered":"2023-10-08T08:42:39.270977+0000","last_clean":"2023-10-08T08:42:39.270977+0000","last_became_active":"2023-10-08T08:42:00.115701+0000","last_became_peered":"2023-10-08T08:42:00.115701+0000","last_unstale":"2023-10-08T08:42:39.270977+0000","last_undegraded":"2023-10-08T08:42:39.270977+0000","last_fullsized":"2023-10-08T08:42:39.270977+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:46.114324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273957+0000","last_change":"2023-10-08T08:42:01.140370+0000","last_active":"2023-10-08T08:42:39.273957+0000","last_peered":"2023-10-08T08:42:39.273957+0000","last_clean":"2023-10-08T08:42:39.273957+0000","last_became_active":"2023-10-08T08:42:01.139923+0000","last_became_peered":"2023-10-08T08:42:01.139923+0000","last_unstale":"2023-10-08T08:42:39.273957+0000","last_undegraded":"2023-10-08T08:42:39.273957+0000","last_fullsized":"2023-10-08T08:42:39.273957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:07.052821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270782+0000","last_change":"2023-10-08T08:42:05.177542+0000","last_active":"2023-10-08T08:42:39.270782+0000","last_peered":"2023-10-08T08:42:39.270782+0000","last_clean":"2023-10-08T08:42:39.270782+0000","last_became_active":"2023-10-08T08:42:05.176808+0000","last_became_peered":"2023-10-08T08:42:05.176808+0000","last_unstale":"2023-10-08T08:42:39.270782+0000","last_undegraded":"2023-10-08T08:42:39.270782+0000","last_fullsized":"2023-10-08T08:42:39.270782+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:44.845948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.284070+0000","last_change":"2023-10-08T08:42:40.284070+0000","last_active":"2023-10-08T08:42:40.284070+0000","last_peered":"2023-10-08T08:42:40.284070+0000","last_clean":"2023-10-08T08:42:40.284070+0000","last_became_active":"2023-10-08T08:42:40.280519+0000","last_became_peered":"2023-10-08T08:42:40.280519+0000","last_unstale":"2023-10-08T08:42:40.284070+0000","last_undegraded":"2023-10-08T08:42:40.284070+0000","last_fullsized":"2023-10-08T08:42:40.284070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:29.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272903+0000","last_change":"2023-10-08T08:42:01.139641+0000","last_active":"2023-10-08T08:42:39.272903+0000","last_peered":"2023-10-08T08:42:39.272903+0000","last_clean":"2023-10-08T08:42:39.272903+0000","last_became_active":"2023-10-08T08:42:01.139332+0000","last_became_peered":"2023-10-08T08:42:01.139332+0000","last_unstale":"2023-10-08T08:42:39.272903+0000","last_undegraded":"2023-10-08T08:42:39.272903+0000","last_fullsized":"2023-10-08T08:42:39.272903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:14.948944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278104+0000","last_change":"2023-10-08T08:42:05.180307+0000","last_active":"2023-10-08T08:42:39.278104+0000","last_peered":"2023-10-08T08:42:39.278104+0000","last_clean":"2023-10-08T08:42:39.278104+0000","last_became_active":"2023-10-08T08:42:05.179755+0000","last_became_peered":"2023-10-08T08:42:05.179755+0000","last_unstale":"2023-10-08T08:42:39.278104+0000","last_undegraded":"2023-10-08T08:42:39.278104+0000","last_fullsized":"2023-10-08T08:42:39.278104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:34.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269609+0000","last_change":"2023-10-08T08:42:00.112674+0000","last_active":"2023-10-08T08:42:39.269609+0000","last_peered":"2023-10-08T08:42:39.269609+0000","last_clean":"2023-10-08T08:42:39.269609+0000","last_became_active":"2023-10-08T08:42:00.110746+0000","last_became_peered":"2023-10-08T08:42:00.110746+0000","last_unstale":"2023-10-08T08:42:39.269609+0000","last_undegraded":"2023-10-08T08:42:39.269609+0000","last_fullsized":"2023-10-08T08:42:39.269609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:27.463811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274453+0000","last_change":"2023-10-08T08:42:01.150107+0000","last_active":"2023-10-08T08:42:39.274453+0000","last_peered":"2023-10-08T08:42:39.274453+0000","last_clean":"2023-10-08T08:42:39.274453+0000","last_became_active":"2023-10-08T08:42:01.149609+0000","last_became_peered":"2023-10-08T08:42:01.149609+0000","last_unstale":"2023-10-08T08:42:39.274453+0000","last_undegraded":"2023-10-08T08:42:39.274453+0000","last_fullsized":"2023-10-08T08:42:39.274453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:05.378286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270656+0000","last_change":"2023-10-08T08:42:05.177571+0000","last_active":"2023-10-08T08:42:39.270656+0000","last_peered":"2023-10-08T08:42:39.270656+0000","last_clean":"2023-10-08T08:42:39.270656+0000","last_became_active":"2023-10-08T08:42:05.177061+0000","last_became_peered":"2023-10-08T08:42:05.177061+0000","last_unstale":"2023-10-08T08:42:39.270656+0000","last_undegraded":"2023-10-08T08:42:39.270656+0000","last_fullsized":"2023-10-08T08:42:39.270656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:10.274262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.286517+0000","last_change":"2023-10-08T08:42:40.286517+0000","last_active":"2023-10-08T08:42:40.286517+0000","last_peered":"2023-10-08T08:42:40.286517+0000","last_clean":"2023-10-08T08:42:40.286517+0000","last_became_active":"2023-10-08T08:42:40.281562+0000","last_became_peered":"2023-10-08T08:42:40.281562+0000","last_unstale":"2023-10-08T08:42:40.286517+0000","last_undegraded":"2023-10-08T08:42:40.286517+0000","last_fullsized":"2023-10-08T08:42:40.286517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:23.313740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270339+0000","last_change":"2023-10-08T08:42:01.142209+0000","last_active":"2023-10-08T08:42:39.270339+0000","last_peered":"2023-10-08T08:42:39.270339+0000","last_clean":"2023-10-08T08:42:39.270339+0000","last_became_active":"2023-10-08T08:42:01.141911+0000","last_became_peered":"2023-10-08T08:42:01.141911+0000","last_unstale":"2023-10-08T08:42:39.270339+0000","last_undegraded":"2023-10-08T08:42:39.270339+0000","last_fullsized":"2023-10-08T08:42:39.270339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:00.066595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270619+0000","last_change":"2023-10-08T08:42:05.173463+0000","last_active":"2023-10-08T08:42:39.270619+0000","last_peered":"2023-10-08T08:42:39.270619+0000","last_clean":"2023-10-08T08:42:39.270619+0000","last_became_active":"2023-10-08T08:42:05.173045+0000","last_became_peered":"2023-10-08T08:42:05.173045+0000","last_unstale":"2023-10-08T08:42:39.270619+0000","last_undegraded":"2023-10-08T08:42:39.270619+0000","last_fullsized":"2023-10-08T08:42:39.270619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:10.774694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272997+0000","last_change":"2023-10-08T08:42:00.111005+0000","last_active":"2023-10-08T08:42:39.272997+0000","last_peered":"2023-10-08T08:42:39.272997+0000","last_clean":"2023-10-08T08:42:39.272997+0000","last_became_active":"2023-10-08T08:42:00.110687+0000","last_became_peered":"2023-10-08T08:42:00.110687+0000","last_unstale":"2023-10-08T08:42:39.272997+0000","last_undegraded":"2023-10-08T08:42:39.272997+0000","last_fullsized":"2023-10-08T08:42:39.272997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:38.682150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277572+0000","last_change":"2023-10-08T08:42:01.144443+0000","last_active":"2023-10-08T08:42:39.277572+0000","last_peered":"2023-10-08T08:42:39.277572+0000","last_clean":"2023-10-08T08:42:39.277572+0000","last_became_active":"2023-10-08T08:42:01.143960+0000","last_became_peered":"2023-10-08T08:42:01.143960+0000","last_unstale":"2023-10-08T08:42:39.277572+0000","last_undegraded":"2023-10-08T08:42:39.277572+0000","last_fullsized":"2023-10-08T08:42:39.277572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:46:57.209569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275843+0000","last_change":"2023-10-08T08:42:05.178212+0000","last_active":"2023-10-08T08:42:39.275843+0000","last_peered":"2023-10-08T08:42:39.275843+0000","last_clean":"2023-10-08T08:42:39.275843+0000","last_became_active":"2023-10-08T08:42:05.177751+0000","last_became_peered":"2023-10-08T08:42:05.177751+0000","last_unstale":"2023-10-08T08:42:39.275843+0000","last_undegraded":"2023-10-08T08:42:39.275843+0000","last_fullsized":"2023-10-08T08:42:39.275843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:10.128104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:03.155615+0000","last_change":"2023-10-08T08:42:00.115576+0000","last_active":"2023-10-08T08:43:03.155615+0000","last_peered":"2023-10-08T08:43:03.155615+0000","last_clean":"2023-10-08T08:43:03.155615+0000","last_became_active":"2023-10-08T08:42:00.115296+0000","last_became_peered":"2023-10-08T08:42:00.115296+0000","last_unstale":"2023-10-08T08:43:03.155615+0000","last_undegraded":"2023-10-08T08:43:03.155615+0000","last_fullsized":"2023-10-08T08:43:03.155615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:22.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278387+0000","last_change":"2023-10-08T08:42:01.139104+0000","last_active":"2023-10-08T08:42:39.278387+0000","last_peered":"2023-10-08T08:42:39.278387+0000","last_clean":"2023-10-08T08:42:39.278387+0000","last_became_active":"2023-10-08T08:42:01.138653+0000","last_became_peered":"2023-10-08T08:42:01.138653+0000","last_unstale":"2023-10-08T08:42:39.278387+0000","last_undegraded":"2023-10-08T08:42:39.278387+0000","last_fullsized":"2023-10-08T08:42:39.278387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:24.784017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273245+0000","last_change":"2023-10-08T08:42:05.186990+0000","last_active":"2023-10-08T08:42:39.273245+0000","last_peered":"2023-10-08T08:42:39.273245+0000","last_clean":"2023-10-08T08:42:39.273245+0000","last_became_active":"2023-10-08T08:42:05.186397+0000","last_became_peered":"2023-10-08T08:42:05.186397+0000","last_unstale":"2023-10-08T08:42:39.273245+0000","last_undegraded":"2023-10-08T08:42:39.273245+0000","last_fullsized":"2023-10-08T08:42:39.273245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:53.633137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276542+0000","last_change":"2023-10-08T08:42:00.114499+0000","last_active":"2023-10-08T08:42:39.276542+0000","last_peered":"2023-10-08T08:42:39.276542+0000","last_clean":"2023-10-08T08:42:39.276542+0000","last_became_active":"2023-10-08T08:42:00.114062+0000","last_became_peered":"2023-10-08T08:42:00.114062+0000","last_unstale":"2023-10-08T08:42:39.276542+0000","last_undegraded":"2023-10-08T08:42:39.276542+0000","last_fullsized":"2023-10-08T08:42:39.276542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:23.576889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277486+0000","last_change":"2023-10-08T08:42:01.139810+0000","last_active":"2023-10-08T08:42:39.277486+0000","last_peered":"2023-10-08T08:42:39.277486+0000","last_clean":"2023-10-08T08:42:39.277486+0000","last_became_active":"2023-10-08T08:42:01.139489+0000","last_became_peered":"2023-10-08T08:42:01.139489+0000","last_unstale":"2023-10-08T08:42:39.277486+0000","last_undegraded":"2023-10-08T08:42:39.277486+0000","last_fullsized":"2023-10-08T08:42:39.277486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:06.724645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278227+0000","last_change":"2023-10-08T08:42:05.172808+0000","last_active":"2023-10-08T08:42:39.278227+0000","last_peered":"2023-10-08T08:42:39.278227+0000","last_clean":"2023-10-08T08:42:39.278227+0000","last_became_active":"2023-10-08T08:42:05.172307+0000","last_became_peered":"2023-10-08T08:42:05.172307+0000","last_unstale":"2023-10-08T08:42:39.278227+0000","last_undegraded":"2023-10-08T08:42:39.278227+0000","last_fullsized":"2023-10-08T08:42:39.278227+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.031070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275490+0000","last_change":"2023-10-08T08:42:00.112423+0000","last_active":"2023-10-08T08:42:39.275490+0000","last_peered":"2023-10-08T08:42:39.275490+0000","last_clean":"2023-10-08T08:42:39.275490+0000","last_became_active":"2023-10-08T08:42:00.112130+0000","last_became_peered":"2023-10-08T08:42:00.112130+0000","last_unstale":"2023-10-08T08:42:39.275490+0000","last_undegraded":"2023-10-08T08:42:39.275490+0000","last_fullsized":"2023-10-08T08:42:39.275490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:54.898037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277793+0000","last_change":"2023-10-08T08:42:01.148404+0000","last_active":"2023-10-08T08:42:39.277793+0000","last_peered":"2023-10-08T08:42:39.277793+0000","last_clean":"2023-10-08T08:42:39.277793+0000","last_became_active":"2023-10-08T08:42:01.148087+0000","last_became_peered":"2023-10-08T08:42:01.148087+0000","last_unstale":"2023-10-08T08:42:39.277793+0000","last_undegraded":"2023-10-08T08:42:39.277793+0000","last_fullsized":"2023-10-08T08:42:39.277793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:12.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274525+0000","last_change":"2023-10-08T08:42:01.149762+0000","last_active":"2023-10-08T08:42:39.274525+0000","last_peered":"2023-10-08T08:42:39.274525+0000","last_clean":"2023-10-08T08:42:39.274525+0000","last_became_active":"2023-10-08T08:42:01.149392+0000","last_became_peered":"2023-10-08T08:42:01.149392+0000","last_unstale":"2023-10-08T08:42:39.274525+0000","last_undegraded":"2023-10-08T08:42:39.274525+0000","last_fullsized":"2023-10-08T08:42:39.274525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:22.487634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279392+0000","last_change":"2023-10-08T08:42:01.145106+0000","last_active":"2023-10-08T08:42:39.279392+0000","last_peered":"2023-10-08T08:42:39.279392+0000","last_clean":"2023-10-08T08:42:39.279392+0000","last_became_active":"2023-10-08T08:42:01.144709+0000","last_became_peered":"2023-10-08T08:42:01.144709+0000","last_unstale":"2023-10-08T08:42:39.279392+0000","last_undegraded":"2023-10-08T08:42:39.279392+0000","last_fullsized":"2023-10-08T08:42:39.279392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:24.248415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.280122+0000","last_change":"2023-10-08T08:42:01.148384+0000","last_active":"2023-10-08T08:42:39.280122+0000","last_peered":"2023-10-08T08:42:39.280122+0000","last_clean":"2023-10-08T08:42:39.280122+0000","last_became_active":"2023-10-08T08:42:01.148098+0000","last_became_peered":"2023-10-08T08:42:01.148098+0000","last_unstale":"2023-10-08T08:42:39.280122+0000","last_undegraded":"2023-10-08T08:42:39.280122+0000","last_fullsized":"2023-10-08T08:42:39.280122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:45.361279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.278516+0000","last_change":"2023-10-08T08:42:40.278516+0000","last_active":"2023-10-08T08:42:40.278516+0000","last_peered":"2023-10-08T08:42:40.278516+0000","last_clean":"2023-10-08T08:42:40.278516+0000","last_became_active":"2023-10-08T08:42:40.278111+0000","last_became_peered":"2023-10-08T08:42:40.278111+0000","last_unstale":"2023-10-08T08:42:40.278516+0000","last_undegraded":"2023-10-08T08:42:40.278516+0000","last_fullsized":"2023-10-08T08:42:40.278516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:32.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276507+0000","last_change":"2023-10-08T08:42:01.146486+0000","last_active":"2023-10-08T08:42:39.276507+0000","last_peered":"2023-10-08T08:42:39.276507+0000","last_clean":"2023-10-08T08:42:39.276507+0000","last_became_active":"2023-10-08T08:42:01.146002+0000","last_became_peered":"2023-10-08T08:42:01.146002+0000","last_unstale":"2023-10-08T08:42:39.276507+0000","last_undegraded":"2023-10-08T08:42:39.276507+0000","last_fullsized":"2023-10-08T08:42:39.276507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:28.217937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276175+0000","last_change":"2023-10-08T08:42:01.152380+0000","last_active":"2023-10-08T08:42:39.276175+0000","last_peered":"2023-10-08T08:42:39.276175+0000","last_clean":"2023-10-08T08:42:39.276175+0000","last_became_active":"2023-10-08T08:42:01.149760+0000","last_became_peered":"2023-10-08T08:42:01.149760+0000","last_unstale":"2023-10-08T08:42:39.276175+0000","last_undegraded":"2023-10-08T08:42:39.276175+0000","last_fullsized":"2023-10-08T08:42:39.276175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:47:58.326416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279642+0000","last_change":"2023-10-08T08:42:01.149593+0000","last_active":"2023-10-08T08:42:39.279642+0000","last_peered":"2023-10-08T08:42:39.279642+0000","last_clean":"2023-10-08T08:42:39.279642+0000","last_became_active":"2023-10-08T08:42:01.149235+0000","last_became_peered":"2023-10-08T08:42:01.149235+0000","last_unstale":"2023-10-08T08:42:39.279642+0000","last_undegraded":"2023-10-08T08:42:39.279642+0000","last_fullsized":"2023-10-08T08:42:39.279642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:51.379305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270673+0000","last_change":"2023-10-08T08:42:01.133460+0000","last_active":"2023-10-08T08:42:39.270673+0000","last_peered":"2023-10-08T08:42:39.270673+0000","last_clean":"2023-10-08T08:42:39.270673+0000","last_became_active":"2023-10-08T08:42:01.133132+0000","last_became_peered":"2023-10-08T08:42:01.133132+0000","last_unstale":"2023-10-08T08:42:39.270673+0000","last_undegraded":"2023-10-08T08:42:39.270673+0000","last_fullsized":"2023-10-08T08:42:39.270673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:29.047135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278661+0000","last_change":"2023-10-08T08:42:01.134274+0000","last_active":"2023-10-08T08:42:39.278661+0000","last_peered":"2023-10-08T08:42:39.278661+0000","last_clean":"2023-10-08T08:42:39.278661+0000","last_became_active":"2023-10-08T08:42:01.133040+0000","last_became_peered":"2023-10-08T08:42:01.133040+0000","last_unstale":"2023-10-08T08:42:39.278661+0000","last_undegraded":"2023-10-08T08:42:39.278661+0000","last_fullsized":"2023-10-08T08:42:39.278661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:18.054859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269663+0000","last_change":"2023-10-08T08:42:01.128333+0000","last_active":"2023-10-08T08:42:39.269663+0000","last_peered":"2023-10-08T08:42:39.269663+0000","last_clean":"2023-10-08T08:42:39.269663+0000","last_became_active":"2023-10-08T08:42:01.128076+0000","last_became_peered":"2023-10-08T08:42:01.128076+0000","last_unstale":"2023-10-08T08:42:39.269663+0000","last_undegraded":"2023-10-08T08:42:39.269663+0000","last_fullsized":"2023-10-08T08:42:39.269663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.675185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276377+0000","last_change":"2023-10-08T08:42:01.139518+0000","last_active":"2023-10-08T08:42:39.276377+0000","last_peered":"2023-10-08T08:42:39.276377+0000","last_clean":"2023-10-08T08:42:39.276377+0000","last_became_active":"2023-10-08T08:42:01.139217+0000","last_became_peered":"2023-10-08T08:42:01.139217+0000","last_unstale":"2023-10-08T08:42:39.276377+0000","last_undegraded":"2023-10-08T08:42:39.276377+0000","last_fullsized":"2023-10-08T08:42:39.276377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:05:02.485500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275263+0000","last_change":"2023-10-08T08:42:01.142664+0000","last_active":"2023-10-08T08:42:39.275263+0000","last_peered":"2023-10-08T08:42:39.275263+0000","last_clean":"2023-10-08T08:42:39.275263+0000","last_became_active":"2023-10-08T08:42:01.142136+0000","last_became_peered":"2023-10-08T08:42:01.142136+0000","last_unstale":"2023-10-08T08:42:39.275263+0000","last_undegraded":"2023-10-08T08:42:39.275263+0000","last_fullsized":"2023-10-08T08:42:39.275263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:18.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696535+0000","last_change":"2023-10-08T08:42:40.696535+0000","last_active":"2023-10-08T08:42:40.696535+0000","last_peered":"2023-10-08T08:42:40.696535+0000","last_clean":"2023-10-08T08:42:40.696535+0000","last_became_active":"2023-10-08T08:42:40.695973+0000","last_became_peered":"2023-10-08T08:42:40.695973+0000","last_unstale":"2023-10-08T08:42:40.696535+0000","last_undegraded":"2023-10-08T08:42:40.696535+0000","last_fullsized":"2023-10-08T08:42:40.696535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:50.008782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":399,"num_read_kb":218,"num_write":209,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":30792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481817,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":493809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50700000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.40200000000000002}]},{"osd":6,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.52600000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.45300000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57499999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56599999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.629},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.621}]}]},{"osd":10,"up_from":70,"seq":300647710748,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1638400,"data_stored":1088563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.317}]},{"osd":2,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82599999999999996,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.83699999999999997,"5min":0.87,"15min":0.87},"last":0.48799999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0489999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.432}]},{"osd":6,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93899999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.50800000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.50700000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.032,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.55500000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.95599999999999996,"5min":1.23,"15min":1.23},"last":0.55500000000000005}]},{"osd":9,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.998,"5min":1.208,"15min":1.208},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98399999999999999,"5min":1.173,"15min":1.173},"last":0.58699999999999997}]},{"osd":11,"last update":"Sun Oct 8 08:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.61599999999999999}]}]},{"osd":9,"up_from":65,"seq":279172874273,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":493739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.44400000000000001,"15min":0.45400000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.623,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52600000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.499,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68600000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.501}]},{"osd":2,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71999999999999997,"5min":1.022,"15min":1.022},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.53800000000000003,"15min":0.56100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.52400000000000002,"15min":0.54200000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61499999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65000000000000002}]},{"osd":4,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64700000000000002,"15min":0.65800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77900000000000003,"5min":1.028,"15min":1.028},"last":0.60799999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84099999999999997,"5min":0.995,"15min":0.995},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68400000000000005,"15min":0.69799999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39100000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81200000000000006,"5min":1.151,"15min":1.151},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.73599999999999999,"15min":0.75700000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82399999999999995,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.76400000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.68200000000000005},"min":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83699999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.751,"15min":0.76500000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86599999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.87}]},{"osd":10,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82499999999999996,"5min":1.216,"15min":1.216},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":8,"up_from":58,"seq":249108103206,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":494117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.61799999999999999,"15min":0.627},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84199999999999997,"5min":1.256,"15min":1.256},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59299999999999997,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92600000000000005,"5min":1.028,"15min":1.028},"last":0.55200000000000005}]},{"osd":2,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.443,"15min":0.439},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67100000000000004,"5min":0.748,"15min":0.748},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72799999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45700000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.625},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80500000000000005,"5min":1.288,"15min":1.288},"last":0.53100000000000003}]},{"osd":4,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66200000000000003}]},{"osd":5,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.372},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83399999999999996,"5min":0.87,"15min":0.87},"last":0.41099999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97399999999999998,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.073,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.754}]},{"osd":7,"last update":"Sun Oct 8 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.51100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1120000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.64900000000000002}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72799999999999998}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.76900000000000002,"15min":0.751},"min":{"1min":0.71799999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.052,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.78200000000000003,"15min":0.76500000000000001},"min":{"1min":0.73799999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.036,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.81999999999999995}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.78500000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332138,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1086127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41399999999999998,"15min":0.39700000000000002},"min":{"1min":0.312,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70299999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.432},"min":{"1min":0.33500000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73399999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.56499999999999995},"min":{"1min":0.51300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73799999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63600000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55100000000000005,"15min":0.52700000000000002},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81499999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.47099999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.41799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.502,"15min":0.49299999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45000000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.89800000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.64100000000000001,"15min":0.61499999999999999},"min":{"1min":0.52600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89900000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.64100000000000001},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96499999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.42099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.70599999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71599999999999997,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94499999999999995,"5min":1.234,"15min":1.234},"last":0.79800000000000004}]},{"osd":9,"last update":"Sun Oct 8 08:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0580000000000001,"5min":1.181,"15min":1.181},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.73499999999999999,"15min":0.73199999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95499999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.75700000000000001}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.55500000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98899999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.64900000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91500000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78200000000000003}]},{"osd":11,"last update":"Sun Oct 8 08:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.82399999999999995}]}]},{"osd":6,"up_from":46,"seq":197568495661,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":493339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.311,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57499999999999996,"5min":0.62,"15min":0.62},"last":0.379},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35999999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.745,"15min":0.745},"last":0.57499999999999996}]},{"osd":2,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.57099999999999995},"min":{"1min":0.46200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.88700000000000001,"5min":1.034,"15min":1.034},"last":0.55300000000000005}]},{"osd":3,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.434,"15min":0.42499999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70099999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.46400000000000002},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67400000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.318}]},{"osd":4,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.45900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.623}]},{"osd":5,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.60999999999999999},"min":{"1min":0.45700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":0.627},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89300000000000002,"5min":4.7670000000000003,"15min":4.7670000000000003},"last":0.53400000000000003}]},{"osd":7,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.442,"5min":0.379,"15min":0.379},"max":{"1min":0.95699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.49399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.96799999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68400000000000005}]},{"osd":8,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93999999999999995,"5min":1.087,"15min":1.087},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.78100000000000003}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96399999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.59899999999999998}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.72999999999999998}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76700000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542210,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":498211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.45400000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.75900000000000001,"5min":1.242,"15min":1.242},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.44600000000000001},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.71699999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.42599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.623},{"interface":"front","average":{"1min":0.627,"5min":0.52900000000000003,"15min":0.502},"min":{"1min":0.42399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70799999999999996}]},{"osd":3,"last update":"Sun Oct 8 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79100000000000004,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.39900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.42599999999999999},"min":{"1min":0.34300000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.40899999999999997},"min":{"1min":0.36599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.40699999999999997}]},{"osd":5,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.44700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.63,"15min":0.61499999999999999},"min":{"1min":0.53200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.61099999999999999,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0980000000000001,"5min":1.788,"15min":1.788},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.60699999999999998,"15min":0.57299999999999995},"min":{"1min":0.47999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.502,"5min":0.318,"15min":0.318},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.72499999999999998}]},{"osd":8,"last update":"Sun Oct 8 08:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67100000000000004,"15min":0.66400000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.78800000000000003}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82099999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.69399999999999995,"15min":0.67500000000000004},"min":{"1min":0.54800000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.50600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.80500000000000005}]},{"osd":11,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.878},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.83799999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":494795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 08:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.51500000000000001},"min":{"1min":0.40400000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81899999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55900000000000005,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64500000000000002}]},{"osd":2,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80800000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.375}]},{"osd":4,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52100000000000002,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.79300000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.50700000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52100000000000002}]},{"osd":6,"last update":"Sun Oct 8 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.376,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81999999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76100000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41299999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.58599999999999997}]},{"osd":8,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.53900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92400000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.51100000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65900000000000003}]},{"osd":9,"last update":"Sun Oct 8 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67700000000000005,"15min":0.68600000000000005},"min":{"1min":0.40799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90600000000000003,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.88900000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54000000000000004}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.53900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.753,"5min":0.755,"15min":0.755},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.006,"15min":1.006},"last":0.68200000000000005}]},{"osd":11,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.628}]}]},{"osd":2,"up_from":19,"seq":81604378686,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":498431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.505,"15min":0.46700000000000003},"min":{"1min":0.39300000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49199999999999999,"15min":0.47799999999999998},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64100000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52400000000000002,"15min":0.499},"min":{"1min":0.35399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76200000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.56299999999999994,"15min":0.52700000000000002},"min":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.51600000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.59199999999999997,"15min":0.54700000000000004},"min":{"1min":0.38700000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.6800000000000002,"5min":3.6800000000000002,"15min":3.6800000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.61299999999999999,"15min":0.55300000000000005},"min":{"1min":0.51500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.6970000000000001,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.442}]},{"osd":5,"last update":"Sun Oct 8 08:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.45200000000000001},"min":{"1min":0.34699999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.373},{"interface":"front","average":{"1min":0.624,"5min":0.52700000000000002,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.624,"15min":0.60199999999999998},"min":{"1min":0.46500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.48899999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.57599999999999996}]},{"osd":8,"last update":"Sun Oct 8 08:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.497},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98499999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.68700000000000006}]},{"osd":9,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.79300000000000004},"min":{"1min":0.59299999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.109,"15min":2.109},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.72299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.72299999999999998}]},{"osd":11,"last update":"Sun Oct 8 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.70399999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149753,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":492716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.371,"15min":0.34999999999999998},"min":{"1min":0.27000000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39200000000000002,"15min":0.36099999999999999},"min":{"1min":0.27400000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.74199999999999999,"5min":1.889,"15min":1.889},"last":0.29199999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.51600000000000001},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.996,"15min":0.996},"last":0.5},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57599999999999996,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.878,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78500000000000003,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70399999999999996,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":1.927,"15min":1.927},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":0.52800000000000002}]},{"osd":5,"last update":"Sun Oct 8 08:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57599999999999996,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.38900000000000001}]},{"osd":6,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48799999999999999,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83499999999999996,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.501,"15min":0.47799999999999998},"min":{"1min":0.34200000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80500000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93899999999999995,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.59399999999999997}]},{"osd":8,"last update":"Sun Oct 8 08:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]},{"osd":9,"last update":"Sun Oct 8 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.70899999999999996,"15min":0.73699999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89500000000000002,"5min":1.712,"15min":1.712},"last":0.749},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.753,"15min":0.77700000000000002},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91700000000000004,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.72399999999999998}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96199999999999997,"5min":2.339,"15min":2.339},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89800000000000002,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.71199999999999997}]},{"osd":11,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.68999999999999995}]}]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":493317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67700000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77000000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.35899999999999999},"min":{"1min":0.314,"5min":0.247,"15min":0.247},"max":{"1min":0.53800000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.371},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54300000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.309}]},{"osd":2,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.54000000000000004,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77500000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.51300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71299999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70399999999999996}]},{"osd":3,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.57399999999999995,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Sun Oct 8 08:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.45000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.85799999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61099999999999999,"15min":0.59299999999999997},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.82999999999999996,"5min":0.88,"15min":0.88},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76300000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.49099999999999999}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.441},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79900000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.42599999999999999}]},{"osd":8,"last update":"Sun Oct 8 08:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.68899999999999995}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89700000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.03,"15min":1.03},"last":0.56100000000000005}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.81699999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52200000000000002}]},{"osd":11,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72099999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1626112,"data_stored":1085805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.50800000000000001,"15min":0.48599999999999999},"min":{"1min":0.437,"5min":0.313,"15min":0.313},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.871,"15min":0.871},"last":0.499},{"interface":"front","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56200000000000006},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75900000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.38500000000000001},"min":{"1min":0.32100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.40300000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.35399999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52800000000000002,"15min":0.502},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.50900000000000001},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.43099999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.95399999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96999999999999997,"5min":1.006,"15min":1.006},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89800000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.68400000000000005,"15min":0.66400000000000003},"min":{"1min":0.55300000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53900000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.39000000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.51600000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.748,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.63100000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98699999999999999,"5min":1.038,"15min":1.038},"last":0.48899999999999999}]},{"osd":10,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77800000000000002,"15min":0.76500000000000001},"min":{"1min":0.57699999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.032},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.74399999999999999,"15min":0.73599999999999999},"min":{"1min":0.62,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93899999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T08:43:10.291 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-08T08:43:10.291 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T08:43:10.291 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-08T08:43:10.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph health --format=json 2023-10-08T08:43:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:10 smithi191 ceph-mon[104220]: pgmap v271: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:43:10.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:10 smithi070 ceph-mon[99513]: pgmap v271: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:43:10.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:10 smithi105 ceph-mon[103798]: pgmap v271: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:43:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:11.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:11 smithi070 ceph-mon[99513]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:11.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:11 smithi105 ceph-mon[103798]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:11.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:11 smithi191 ceph-mon[104220]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:12.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.056+0000 7f0eebc84700 1 -- 172.21.15.70:0/1275192030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee41057c0 msgr2=0x7f0ee4105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:12.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.056+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1275192030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee41057c0 0x7f0ee4105ba0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009990 tx=0x7f0ee0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.056+0000 7f0eebc84700 1 -- 172.21.15.70:0/1275192030 shutdown_connections 2023-10-08T08:43:12.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.056+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1275192030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee4101260 0x7f0ee410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.056+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1275192030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee41057c0 0x7f0ee4105ba0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.056+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1275192030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee41008a0 0x7f0ee4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.056+0000 7f0eebc84700 1 -- 172.21.15.70:0/1275192030 >> 172.21.15.70:0/1275192030 conn(0x7f0ee40779e0 msgr2=0x7f0ee4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:12.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.056+0000 7f0eebc84700 1 -- 172.21.15.70:0/1275192030 shutdown_connections 2023-10-08T08:43:12.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.056+0000 7f0eebc84700 1 -- 172.21.15.70:0/1275192030 wait complete. 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0eebc84700 1 Processor -- start 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0eebc84700 1 -- start start 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0eebc84700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee41008a0 0x7f0ee4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0eebc84700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101260 0x7f0ee4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0eebc84700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee41057c0 0x7f0ee4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0eebc84700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee41a4f60 con 0x7f0ee4101260 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0eebc84700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee41a50d0 con 0x7f0ee41057c0 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0eebc84700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee41a5290 con 0x7f0ee41008a0 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0ee921f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101260 0x7f0ee4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0ee921f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101260 0x7f0ee4073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49986/0 (socket says 172.21.15.70:49986) 2023-10-08T08:43:12.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0ee921f700 1 -- 172.21.15.70:0/1859332778 learned_addr learned my addr 172.21.15.70:0/1859332778 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0eea221700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee41057c0 0x7f0ee4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.057+0000 7f0ee9a20700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee41008a0 0x7f0ee4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ee921f700 1 -- 172.21.15.70:0/1859332778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee41008a0 msgr2=0x7f0ee4072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ee921f700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee41008a0 0x7f0ee4072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ee921f700 1 -- 172.21.15.70:0/1859332778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee41057c0 msgr2=0x7f0ee4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ee921f700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee41057c0 0x7f0ee4073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ee921f700 1 -- 172.21.15.70:0/1859332778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00095f0 con 0x7f0ee4101260 2023-10-08T08:43:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0eea221700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee41057c0 0x7f0ee4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:12.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ee9a20700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee41008a0 0x7f0ee4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:12.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ee921f700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101260 0x7f0ee4073030 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800c9b0 tx=0x7f0ed800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:12.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ed6ffd700 1 -- 172.21.15.70:0/1859332778 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8007b00 con 0x7f0ee4101260 2023-10-08T08:43:12.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ed6ffd700 1 -- 172.21.15.70:0/1859332778 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ed8007c60 con 0x7f0ee4101260 2023-10-08T08:43:12.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee41a5570 con 0x7f0ee4101260 2023-10-08T08:43:12.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0ed6ffd700 1 -- 172.21.15.70:0/1859332778 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8018660 con 0x7f0ee4101260 2023-10-08T08:43:12.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.058+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee41a5ac0 con 0x7f0ee4101260 2023-10-08T08:43:12.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.059+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee4108d80 con 0x7f0ee4101260 2023-10-08T08:43:12.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.060+0000 7f0ed6ffd700 1 -- 172.21.15.70:0/1859332778 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0ed8018880 con 0x7f0ee4101260 2023-10-08T08:43:12.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.060+0000 7f0ed6ffd700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0ed00a1550 0x7f0ed00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:12.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.061+0000 7f0ed6ffd700 1 -- 172.21.15.70:0/1859332778 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0ed80cd410 con 0x7f0ee4101260 2023-10-08T08:43:12.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.061+0000 7f0ee9a20700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0ed00a1550 0x7f0ed00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:12.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.061+0000 7f0ee9a20700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0ed00a1550 0x7f0ed00a3a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006010 tx=0x7f0ee001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:12.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.064+0000 7f0ed6ffd700 1 -- 172.21.15.70:0/1859332778 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0ed8096790 con 0x7f0ee4101260 2023-10-08T08:43:12.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.301+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0ee4073fd0 con 0x7f0ee4101260 2023-10-08T08:43:12.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.301+0000 7f0ed6ffd700 1 -- 172.21.15.70:0/1859332778 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0ed8099db0 con 0x7f0ee4101260 2023-10-08T08:43:12.303 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:12.303 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T08:43:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0ed00a1550 msgr2=0x7f0ed00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0ed00a1550 0x7f0ed00a3a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006010 tx=0x7f0ee001a040 comp rx=0 tx=0).stop 2023-10-08T08:43:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101260 msgr2=0x7f0ee4073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101260 0x7f0ee4073030 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800c9b0 tx=0x7f0ed800cd70 comp rx=0 tx=0).stop 2023-10-08T08:43:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 shutdown_connections 2023-10-08T08:43:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0ed00a1550 0x7f0ed00a3a10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee41057c0 0x7f0ee4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee41008a0 0x7f0ee4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 --2- 172.21.15.70:0/1859332778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ee4101260 0x7f0ee4073030 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.303+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 >> 172.21.15.70:0/1859332778 conn(0x7f0ee40779e0 msgr2=0x7f0ee40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.304+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 shutdown_connections 2023-10-08T08:43:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.304+0000 7f0eebc84700 1 -- 172.21.15.70:0/1859332778 wait complete. 2023-10-08T08:43:12.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:12 smithi070 ceph-mon[99513]: pgmap v272: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:43:12.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:12 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1859332778' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T08:43:12.701 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-08T08:43:12.701 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:12 smithi105 ceph-mon[103798]: pgmap v272: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:43:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:12 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1859332778' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T08:43:12.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 -- 172.21.15.70:0/84127827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c0ff560 msgr2=0x7f099c0ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:12.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 --2- 172.21.15.70:0/84127827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c0ff560 0x7f099c0ff9e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f098c0099c0 tx=0x7f098c009cd0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 -- 172.21.15.70:0/84127827 shutdown_connections 2023-10-08T08:43:12.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 --2- 172.21.15.70:0/84127827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f099c0fff20 0x7f099c10c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 --2- 172.21.15.70:0/84127827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f099c105620 0x7f099c105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 --2- 172.21.15.70:0/84127827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c0ff560 0x7f099c0ff9e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 -- 172.21.15.70:0/84127827 >> 172.21.15.70:0/84127827 conn(0x7f099c0fb050 msgr2=0x7f099c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 -- 172.21.15.70:0/84127827 shutdown_connections 2023-10-08T08:43:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 -- 172.21.15.70:0/84127827 wait complete. 2023-10-08T08:43:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.827+0000 7f09a216d700 1 Processor -- start 2023-10-08T08:43:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f09a216d700 1 -- start start 2023-10-08T08:43:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f09a216d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f099c0ff560 0x7f099c19b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f09a216d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f099c0fff20 0x7f099c19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f09a216d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c105620 0x7f099c195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f09a216d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c195d60 con 0x7f099c105620 2023-10-08T08:43:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f09a216d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c195ed0 con 0x7f099c0fff20 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f09a216d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c196090 con 0x7f099c0ff560 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c105620 0x7f099c195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c105620 0x7f099c195700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50000/0 (socket says 172.21.15.70:50000) 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099bfff700 1 -- 172.21.15.70:0/2250297449 learned_addr learned my addr 172.21.15.70:0/2250297449 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099affd700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f099c0fff20 0x7f099c19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099bfff700 1 -- 172.21.15.70:0/2250297449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f099c0ff560 msgr2=0x7f099c19b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099b7fe700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f099c0ff560 0x7f099c19b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099bfff700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f099c0ff560 0x7f099c19b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099bfff700 1 -- 172.21.15.70:0/2250297449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f099c0fff20 msgr2=0x7f099c19bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099bfff700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f099c0fff20 0x7f099c19bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099bfff700 1 -- 172.21.15.70:0/2250297449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c0095f0 con 0x7f099c105620 2023-10-08T08:43:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099b7fe700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f099c0ff560 0x7f099c19b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.828+0000 7f099affd700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f099c0fff20 0x7f099c19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.829+0000 7f099bfff700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c105620 0x7f099c195700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f099400ada0 tx=0x7f099400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.829+0000 7f0998ff9700 1 -- 172.21.15.70:0/2250297449 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400f070 con 0x7f099c105620 2023-10-08T08:43:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.829+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c196370 con 0x7f099c105620 2023-10-08T08:43:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.829+0000 7f0998ff9700 1 -- 172.21.15.70:0/2250297449 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0994007b30 con 0x7f099c105620 2023-10-08T08:43:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.829+0000 7f0998ff9700 1 -- 172.21.15.70:0/2250297449 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994005440 con 0x7f099c105620 2023-10-08T08:43:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.829+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c1a25c0 con 0x7f099c105620 2023-10-08T08:43:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.830+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c107ac0 con 0x7f099c105620 2023-10-08T08:43:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.831+0000 7f0998ff9700 1 -- 172.21.15.70:0/2250297449 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0994004ad0 con 0x7f099c105620 2023-10-08T08:43:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.831+0000 7f0998ff9700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f09880a14d0 0x7f09880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.832+0000 7f0998ff9700 1 -- 172.21.15.70:0/2250297449 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f09940ccdb0 con 0x7f099c105620 2023-10-08T08:43:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.831+0000 7f099b7fe700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f09880a14d0 0x7f09880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.832+0000 7f099b7fe700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f09880a14d0 0x7f09880a3990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0984005fd0 tx=0x7f0984005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:12.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:12.835+0000 7f0998ff9700 1 -- 172.21.15.70:0/2250297449 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f09940960b0 con 0x7f099c105620 2023-10-08T08:43:12.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:12 smithi191 ceph-mon[104220]: pgmap v272: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:43:12.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:12 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1859332778' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T08:43:13.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.028+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f099c100c80 con 0x7f099c105620 2023-10-08T08:43:13.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.030+0000 7f0998ff9700 1 -- 172.21.15.70:0/2250297449 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7f09940996d0 con 0x7f099c105620 2023-10-08T08:43:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:13.031 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f09880a14d0 msgr2=0x7f09880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f09880a14d0 0x7f09880a3990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0984005fd0 tx=0x7f0984005e20 comp rx=0 tx=0).stop 2023-10-08T08:43:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c105620 msgr2=0x7f099c195700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c105620 0x7f099c195700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f099400ada0 tx=0x7f099400c330 comp rx=0 tx=0).stop 2023-10-08T08:43:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 shutdown_connections 2023-10-08T08:43:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f09880a14d0 0x7f09880a3990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f099c105620 0x7f099c195700 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f099c0ff560 0x7f099c19b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 --2- 172.21.15.70:0/2250297449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f099c0fff20 0x7f099c19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 >> 172.21.15.70:0/2250297449 conn(0x7f099c0fb050 msgr2=0x7f099c0fc720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 shutdown_connections 2023-10-08T08:43:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.032+0000 7f09a216d700 1 -- 172.21.15.70:0/2250297449 wait complete. 2023-10-08T08:43:13.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:43:13.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:43:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.174+0000 7fc728f47700 1 -- 172.21.15.70:0/61689849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7240ff620 msgr2=0x7fc72410d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.174+0000 7fc728f47700 1 --2- 172.21.15.70:0/61689849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7240ff620 0x7fc72410d600 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00b0a0 tx=0x7fc71c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.174+0000 7fc728f47700 1 -- 172.21.15.70:0/61689849 shutdown_connections 2023-10-08T08:43:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.174+0000 7fc728f47700 1 --2- 172.21.15.70:0/61689849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7240ff620 0x7fc72410d600 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.174+0000 7fc728f47700 1 --2- 172.21.15.70:0/61689849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc724106740 0x7fc724106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.174+0000 7fc728f47700 1 --2- 172.21.15.70:0/61689849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7240fec80 0x7fc7240ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.174+0000 7fc728f47700 1 -- 172.21.15.70:0/61689849 >> 172.21.15.70:0/61689849 conn(0x7fc724075c20 msgr2=0x7fc7240fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.174+0000 7fc728f47700 1 -- 172.21.15.70:0/61689849 shutdown_connections 2023-10-08T08:43:13.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.174+0000 7fc728f47700 1 -- 172.21.15.70:0/61689849 wait complete. 2023-10-08T08:43:13.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.175+0000 7fc728f47700 1 Processor -- start 2023-10-08T08:43:13.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.175+0000 7fc728f47700 1 -- start start 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.175+0000 7fc728f47700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7240fec80 0x7fc72419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.175+0000 7fc728f47700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7240ff620 0x7fc72419cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.175+0000 7fc728f47700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106740 0x7fc724196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.175+0000 7fc728f47700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc724197200 con 0x7fc724106740 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.175+0000 7fc728f47700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc724197370 con 0x7fc7240fec80 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.175+0000 7fc728f47700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc724197530 con 0x7fc7240ff620 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.175+0000 7fc722d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106740 0x7fc724196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc722d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106740 0x7fc724196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50014/0 (socket says 172.21.15.70:50014) 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc722d9d700 1 -- 172.21.15.70:0/3069527333 learned_addr learned my addr 172.21.15.70:0/3069527333 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc72259c700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7240fec80 0x7fc72419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc721d9b700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7240ff620 0x7fc72419cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc722d9d700 1 -- 172.21.15.70:0/3069527333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7240ff620 msgr2=0x7fc72419cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc722d9d700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7240ff620 0x7fc72419cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc722d9d700 1 -- 172.21.15.70:0/3069527333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7240fec80 msgr2=0x7fc72419ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc722d9d700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7240fec80 0x7fc72419ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc722d9d700 1 -- 172.21.15.70:0/3069527333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c009d00 con 0x7fc724106740 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc721d9b700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7240ff620 0x7fc72419cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc722d9d700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106740 0x7fc724196ba0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc71c0077f0 tx=0x7fc71c007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc7137fe700 1 -- 172.21.15.70:0/3069527333 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00e040 con 0x7fc724106740 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7241977b0 con 0x7fc724106740 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc7137fe700 1 -- 172.21.15.70:0/3069527333 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc71c004c60 con 0x7fc724106740 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc7137fe700 1 -- 172.21.15.70:0/3069527333 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c005280 con 0x7fc724106740 2023-10-08T08:43:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.176+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7241a3a60 con 0x7fc724106740 2023-10-08T08:43:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.177+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc724108cc0 con 0x7fc724106740 2023-10-08T08:43:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.178+0000 7fc7137fe700 1 -- 172.21.15.70:0/3069527333 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc71c01b450 con 0x7fc724106740 2023-10-08T08:43:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.179+0000 7fc7137fe700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc70c0a14d0 0x7fc70c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.179+0000 7fc7137fe700 1 -- 172.21.15.70:0/3069527333 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc71c0ced40 con 0x7fc724106740 2023-10-08T08:43:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.179+0000 7fc72259c700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc70c0a14d0 0x7fc70c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.179+0000 7fc72259c700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc70c0a14d0 0x7fc70c0a3990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc718005950 tx=0x7fc71800a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.182+0000 7fc7137fe700 1 -- 172.21.15.70:0/3069527333 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc71c098040 con 0x7fc724106740 2023-10-08T08:43:13.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.378+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc724066ca0 con 0x7fc724106740 2023-10-08T08:43:13.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.378+0000 7fc7137fe700 1 -- 172.21.15.70:0/3069527333 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc71c0bb0a0 con 0x7fc724106740 2023-10-08T08:43:13.379 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:43:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc70c0a14d0 msgr2=0x7fc70c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc70c0a14d0 0x7fc70c0a3990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc718005950 tx=0x7fc71800a300 comp rx=0 tx=0).stop 2023-10-08T08:43:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106740 msgr2=0x7fc724196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106740 0x7fc724196ba0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc71c0077f0 tx=0x7fc71c007820 comp rx=0 tx=0).stop 2023-10-08T08:43:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 shutdown_connections 2023-10-08T08:43:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc70c0a14d0 0x7fc70c0a3990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106740 0x7fc724196ba0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7240fec80 0x7fc72419ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 --2- 172.21.15.70:0/3069527333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7240ff620 0x7fc72419cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 >> 172.21.15.70:0/3069527333 conn(0x7fc724075c20 msgr2=0x7fc7240fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 shutdown_connections 2023-10-08T08:43:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.380+0000 7fc728f47700 1 -- 172.21.15.70:0/3069527333 wait complete. 2023-10-08T08:43:13.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:43:13.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 -- 172.21.15.70:0/2206031037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8069470 msgr2=0x7f50b810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 --2- 172.21.15.70:0/2206031037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8069470 0x7f50b810d5c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f50b000b0a0 tx=0x7f50b000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 -- 172.21.15.70:0/2206031037 shutdown_connections 2023-10-08T08:43:13.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 --2- 172.21.15.70:0/2206031037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8069470 0x7f50b810d5c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 --2- 172.21.15.70:0/2206031037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50b8106770 0x7f50b8106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 --2- 172.21.15.70:0/2206031037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50b8068ab0 0x7f50b8068f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 -- 172.21.15.70:0/2206031037 >> 172.21.15.70:0/2206031037 conn(0x7f50b8076790 msgr2=0x7f50b8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 -- 172.21.15.70:0/2206031037 shutdown_connections 2023-10-08T08:43:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 -- 172.21.15.70:0/2206031037 wait complete. 2023-10-08T08:43:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 Processor -- start 2023-10-08T08:43:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.518+0000 7f50be6d9700 1 -- start start 2023-10-08T08:43:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50be6d9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8068ab0 0x7f50b8196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50be6d9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50b8069470 0x7f50b8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50be6d9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50b8106770 0x7f50b819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50be6d9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b819bcc0 con 0x7f50b8068ab0 2023-10-08T08:43:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50be6d9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b819be30 con 0x7f50b8106770 2023-10-08T08:43:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50be6d9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b819bff0 con 0x7f50b8069470 2023-10-08T08:43:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8068ab0 0x7f50b8196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8068ab0 0x7f50b8196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50024/0 (socket says 172.21.15.70:50024) 2023-10-08T08:43:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b7fff700 1 -- 172.21.15.70:0/371449663 learned_addr learned my addr 172.21.15.70:0/371449663 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b77fe700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50b8069470 0x7f50b8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b7fff700 1 -- 172.21.15.70:0/371449663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50b8069470 msgr2=0x7f50b8197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b7fff700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50b8069470 0x7f50b8197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b7fff700 1 -- 172.21.15.70:0/371449663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50b8106770 msgr2=0x7f50b819b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b7fff700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50b8106770 0x7f50b819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b7fff700 1 -- 172.21.15.70:0/371449663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009d00 con 0x7f50b8068ab0 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b77fe700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50b8069470 0x7f50b8197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b7fff700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8068ab0 0x7f50b8196df0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00b530 tx=0x7f50ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b57fa700 1 -- 172.21.15.70:0/371449663 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac011830 con 0x7f50b8068ab0 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50b57fa700 1 -- 172.21.15.70:0/371449663 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50ac011e50 con 0x7f50b8068ab0 2023-10-08T08:43:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.519+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b819c2d0 con 0x7f50b8068ab0 2023-10-08T08:43:13.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.520+0000 7f50b57fa700 1 -- 172.21.15.70:0/371449663 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00f2e0 con 0x7f50b8068ab0 2023-10-08T08:43:13.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.520+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b81a3b10 con 0x7f50b8068ab0 2023-10-08T08:43:13.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.520+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b8108ca0 con 0x7f50b8068ab0 2023-10-08T08:43:13.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.522+0000 7f50b57fa700 1 -- 172.21.15.70:0/371449663 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f50ac010580 con 0x7f50b8068ab0 2023-10-08T08:43:13.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.522+0000 7f50b57fa700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50a00a14d0 0x7f50a00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.522+0000 7f50b57fa700 1 -- 172.21.15.70:0/371449663 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f50ac0cd1f0 con 0x7f50b8068ab0 2023-10-08T08:43:13.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.522+0000 7f50b77fe700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50a00a14d0 0x7f50a00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.523+0000 7f50b77fe700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50a00a14d0 0x7f50a00a3990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f50b81982f0 tx=0x7f50a8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:13.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.526+0000 7f50b57fa700 1 -- 172.21.15.70:0/371449663 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f50ac096460 con 0x7f50b8068ab0 2023-10-08T08:43:13.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.715+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50b81980a0 con 0x7f50b8068ab0 2023-10-08T08:43:13.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.715+0000 7f50b57fa700 1 -- 172.21.15.70:0/371449663 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50ac015020 con 0x7f50b8068ab0 2023-10-08T08:43:13.716 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:13.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50a00a14d0 msgr2=0x7f50a00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50a00a14d0 0x7f50a00a3990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f50b81982f0 tx=0x7f50a8008040 comp rx=0 tx=0).stop 2023-10-08T08:43:13.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8068ab0 msgr2=0x7f50b8196df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8068ab0 0x7f50b8196df0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00b530 tx=0x7f50ac00b8f0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 shutdown_connections 2023-10-08T08:43:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50a00a14d0 0x7f50a00a3990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50b8106770 0x7f50b819b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b8068ab0 0x7f50b8196df0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 --2- 172.21.15.70:0/371449663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50b8069470 0x7f50b8197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 >> 172.21.15.70:0/371449663 conn(0x7f50b8076790 msgr2=0x7f50b80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 shutdown_connections 2023-10-08T08:43:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.717+0000 7f50be6d9700 1 -- 172.21.15.70:0/371449663 wait complete. 2023-10-08T08:43:13.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:13 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2250297449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:13.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:43:13.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:13 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2250297449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:13.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:13 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2250297449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/3393719789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41001c0 msgr2=0x7fd0c4100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/3393719789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41001c0 0x7fd0c4100640 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009990 tx=0x7fd0b4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/3393719789 shutdown_connections 2023-10-08T08:43:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/3393719789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c4100b80 0x7fd0c410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/3393719789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0c41046a0 0x7fd0c4104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/3393719789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41001c0 0x7fd0c4100640 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/3393719789 >> 172.21.15.70:0/3393719789 conn(0x7fd0c4074940 msgr2=0x7fd0c4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/3393719789 shutdown_connections 2023-10-08T08:43:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/3393719789 wait complete. 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 Processor -- start 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.855+0000 7fd0c8b0d700 1 -- start start 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c8b0d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0c41001c0 0x7fd0c41013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c8b0d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c4100b80 0x7fd0c41018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c8b0d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41046a0 0x7fd0c4101e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c8b0d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41a4f20 con 0x7fd0c41046a0 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c8b0d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41a5090 con 0x7fd0c41001c0 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c8b0d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41a5250 con 0x7fd0c4100b80 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c2d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41046a0 0x7fd0c4101e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c2d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41046a0 0x7fd0c4101e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50042/0 (socket says 172.21.15.70:50042) 2023-10-08T08:43:13.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c2d9d700 1 -- 172.21.15.70:0/634252086 learned_addr learned my addr 172.21.15.70:0/634252086 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:13.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c1d9b700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c4100b80 0x7fd0c41018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c259c700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0c41001c0 0x7fd0c41013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c2d9d700 1 -- 172.21.15.70:0/634252086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c4100b80 msgr2=0x7fd0c41018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c2d9d700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c4100b80 0x7fd0c41018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c2d9d700 1 -- 172.21.15.70:0/634252086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0c41001c0 msgr2=0x7fd0c41013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:13.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c2d9d700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0c41001c0 0x7fd0c41013b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:13.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c2d9d700 1 -- 172.21.15.70:0/634252086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b40095f0 con 0x7fd0c41046a0 2023-10-08T08:43:13.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c2d9d700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41046a0 0x7fd0c4101e30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00ada0 tx=0x7fd0bc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:13.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0b37fe700 1 -- 172.21.15.70:0/634252086 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc00f070 con 0x7fd0c41046a0 2023-10-08T08:43:13.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0b37fe700 1 -- 172.21.15.70:0/634252086 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0bc007b30 con 0x7fd0c41046a0 2023-10-08T08:43:13.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c41a5530 con 0x7fd0c41046a0 2023-10-08T08:43:13.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0b37fe700 1 -- 172.21.15.70:0/634252086 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc005440 con 0x7fd0c41046a0 2023-10-08T08:43:13.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.856+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c41a5a40 con 0x7fd0c41046a0 2023-10-08T08:43:13.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.857+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c4108c00 con 0x7fd0c41046a0 2023-10-08T08:43:13.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.859+0000 7fd0b37fe700 1 -- 172.21.15.70:0/634252086 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd0bc004ad0 con 0x7fd0c41046a0 2023-10-08T08:43:13.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.859+0000 7fd0b37fe700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0ac0a15d0 0x7fd0ac0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:13.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.859+0000 7fd0b37fe700 1 -- 172.21.15.70:0/634252086 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd0bc0cce10 con 0x7fd0c41046a0 2023-10-08T08:43:13.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.859+0000 7fd0c259c700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0ac0a15d0 0x7fd0ac0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:13.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.860+0000 7fd0c259c700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0ac0a15d0 0x7fd0ac0a3a90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8005fd0 tx=0x7fd0b8005dd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:13.863+0000 7fd0b37fe700 1 -- 172.21.15.70:0/634252086 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd0bc0960b0 con 0x7fd0c41046a0 2023-10-08T08:43:14.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.054+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0c4102840 con 0x7fd0c41046a0 2023-10-08T08:43:14.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.055+0000 7fd0b37fe700 1 -- 172.21.15.70:0/634252086 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0bc01a310 con 0x7fd0c41046a0 2023-10-08T08:43:14.056 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:43:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0ac0a15d0 msgr2=0x7fd0ac0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0ac0a15d0 0x7fd0ac0a3a90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8005fd0 tx=0x7fd0b8005dd0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41046a0 msgr2=0x7fd0c4101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41046a0 0x7fd0c4101e30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00ada0 tx=0x7fd0bc00c330 comp rx=0 tx=0).stop 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 shutdown_connections 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0ac0a15d0 0x7fd0ac0a3a90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c41046a0 0x7fd0c4101e30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0c41001c0 0x7fd0c41013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 --2- 172.21.15.70:0/634252086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c4100b80 0x7fd0c41018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 >> 172.21.15.70:0/634252086 conn(0x7fd0c4074940 msgr2=0x7fd0c40ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 shutdown_connections 2023-10-08T08:43:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.057+0000 7fd0c8b0d700 1 -- 172.21.15.70:0/634252086 wait complete. 2023-10-08T08:43:14.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:43:14.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 -- 172.21.15.70:0/1615141099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c0ff320 msgr2=0x7fd05c0ff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 --2- 172.21.15.70:0/1615141099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c0ff320 0x7fd05c0ff700 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd050009990 tx=0x7fd050009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 -- 172.21.15.70:0/1615141099 shutdown_connections 2023-10-08T08:43:14.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 --2- 172.21.15.70:0/1615141099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c105b30 0x7fd05c10d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 --2- 172.21.15.70:0/1615141099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c0ff320 0x7fd05c0ff700 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 --2- 172.21.15.70:0/1615141099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd05c0ffcd0 0x7fd05c105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 -- 172.21.15.70:0/1615141099 >> 172.21.15.70:0/1615141099 conn(0x7fd05c074940 msgr2=0x7fd05c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:14.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 -- 172.21.15.70:0/1615141099 shutdown_connections 2023-10-08T08:43:14.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 -- 172.21.15.70:0/1615141099 wait complete. 2023-10-08T08:43:14.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.196+0000 7fd06187b700 1 Processor -- start 2023-10-08T08:43:14.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd06187b700 1 -- start start 2023-10-08T08:43:14.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd06187b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0ff320 0x7fd05c196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd06187b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd05c105b30 0x7fd05c1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd06187b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c19a550 0x7fd05c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd06187b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c19af40 con 0x7fd05c19a550 2023-10-08T08:43:14.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd06187b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c19b0b0 con 0x7fd05c0ff320 2023-10-08T08:43:14.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd06187b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c19b270 con 0x7fd05c105b30 2023-10-08T08:43:14.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c19a550 0x7fd05c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c19a550 0x7fd05c19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50056/0 (socket says 172.21.15.70:50056) 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05b7fe700 1 -- 172.21.15.70:0/2466345217 learned_addr learned my addr 172.21.15.70:0/2466345217 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05affd700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0ff320 0x7fd05c196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05b7fe700 1 -- 172.21.15.70:0/2466345217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd05c105b30 msgr2=0x7fd05c1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05a7fc700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd05c105b30 0x7fd05c1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05b7fe700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd05c105b30 0x7fd05c1972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05b7fe700 1 -- 172.21.15.70:0/2466345217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0ff320 msgr2=0x7fd05c196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05b7fe700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0ff320 0x7fd05c196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05b7fe700 1 -- 172.21.15.70:0/2466345217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0500095f0 con 0x7fd05c19a550 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05affd700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0ff320 0x7fd05c196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:14.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd05b7fe700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c19a550 0x7fd05c19aa00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd054007ee0 tx=0x7fd05400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:14.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd060879700 1 -- 172.21.15.70:0/2466345217 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054017070 con 0x7fd05c19a550 2023-10-08T08:43:14.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd060879700 1 -- 172.21.15.70:0/2466345217 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd05400f040 con 0x7fd05c19a550 2023-10-08T08:43:14.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c1a38e0 con 0x7fd05c19a550 2023-10-08T08:43:14.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.197+0000 7fd060879700 1 -- 172.21.15.70:0/2466345217 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054005740 con 0x7fd05c19a550 2023-10-08T08:43:14.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.198+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c1a3e40 con 0x7fd05c19a550 2023-10-08T08:43:14.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.198+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c108d20 con 0x7fd05c19a550 2023-10-08T08:43:14.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.200+0000 7fd060879700 1 -- 172.21.15.70:0/2466345217 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd054022020 con 0x7fd05c19a550 2023-10-08T08:43:14.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.201+0000 7fd060879700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0440a1580 0x7fd0440a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.201+0000 7fd05affd700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0440a1580 0x7fd0440a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.201+0000 7fd060879700 1 -- 172.21.15.70:0/2466345217 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd0540cc750 con 0x7fd05c19a550 2023-10-08T08:43:14.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.201+0000 7fd05affd700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0440a1580 0x7fd0440a3a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd05000b5c0 tx=0x7fd050005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:14.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.204+0000 7fd060879700 1 -- 172.21.15.70:0/2466345217 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd0540959c0 con 0x7fd05c19a550 2023-10-08T08:43:14.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.398+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd05c197fe0 con 0x7fd05c19a550 2023-10-08T08:43:14.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.398+0000 7fd060879700 1 -- 172.21.15.70:0/2466345217 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd054098fe0 con 0x7fd05c19a550 2023-10-08T08:43:14.399 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:14.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0440a1580 msgr2=0x7fd0440a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0440a1580 0x7fd0440a3a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd05000b5c0 tx=0x7fd050005fb0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c19a550 msgr2=0x7fd05c19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c19a550 0x7fd05c19aa00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd054007ee0 tx=0x7fd05400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 shutdown_connections 2023-10-08T08:43:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd0440a1580 0x7fd0440a3a40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd05c19a550 0x7fd05c19aa00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0ff320 0x7fd05c196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 --2- 172.21.15.70:0/2466345217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd05c105b30 0x7fd05c1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 >> 172.21.15.70:0/2466345217 conn(0x7fd05c074940 msgr2=0x7fd05c0fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 shutdown_connections 2023-10-08T08:43:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.400+0000 7fd06187b700 1 -- 172.21.15.70:0/2466345217 wait complete. 2023-10-08T08:43:14.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:43:14.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 -- 172.21.15.70:0/3841722356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c0ffc80 msgr2=0x7ff22c100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 --2- 172.21.15.70:0/3841722356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c0ffc80 0x7ff22c100100 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0099c0 tx=0x7ff21c009cd0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 -- 172.21.15.70:0/3841722356 shutdown_connections 2023-10-08T08:43:14.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 --2- 172.21.15.70:0/3841722356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c100640 0x7ff22c10c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 --2- 172.21.15.70:0/3841722356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff22c105690 0x7ff22c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 --2- 172.21.15.70:0/3841722356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c0ffc80 0x7ff22c100100 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 -- 172.21.15.70:0/3841722356 >> 172.21.15.70:0/3841722356 conn(0x7ff22c075a90 msgr2=0x7ff22c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:14.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 -- 172.21.15.70:0/3841722356 shutdown_connections 2023-10-08T08:43:14.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 -- 172.21.15.70:0/3841722356 wait complete. 2023-10-08T08:43:14.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 Processor -- start 2023-10-08T08:43:14.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.534+0000 7ff2329a9700 1 -- start start 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff2329a9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c0ffc80 0x7ff22c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff2329a9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c100640 0x7ff22c195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff2329a9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff22c105690 0x7ff22c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff2329a9700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c19a940 con 0x7ff22c100640 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff2329a9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c19aab0 con 0x7ff22c0ffc80 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff2329a9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c19ac70 con 0x7ff22c105690 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c100640 0x7ff22c195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c100640 0x7ff22c195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50068/0 (socket says 172.21.15.70:50068) 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22b7fe700 1 -- 172.21.15.70:0/2315055017 learned_addr learned my addr 172.21.15.70:0/2315055017 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:14.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22bfff700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c0ffc80 0x7ff22c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff230f46700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff22c105690 0x7ff22c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22b7fe700 1 -- 172.21.15.70:0/2315055017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff22c105690 msgr2=0x7ff22c19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22b7fe700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff22c105690 0x7ff22c19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22b7fe700 1 -- 172.21.15.70:0/2315055017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c0ffc80 msgr2=0x7ff22c195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22b7fe700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c0ffc80 0x7ff22c195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22b7fe700 1 -- 172.21.15.70:0/2315055017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c0095f0 con 0x7ff22c100640 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22bfff700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c0ffc80 0x7ff22c195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff22b7fe700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c100640 0x7ff22c195fa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00b580 tx=0x7ff21c003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.535+0000 7ff2297fa700 1 -- 172.21.15.70:0/2315055017 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c01d070 con 0x7ff22c100640 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.536+0000 7ff2297fa700 1 -- 172.21.15.70:0/2315055017 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff21c00fda0 con 0x7ff22c100640 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.536+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c19aef0 con 0x7ff22c100640 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.536+0000 7ff2297fa700 1 -- 172.21.15.70:0/2315055017 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0037c0 con 0x7ff22c100640 2023-10-08T08:43:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.536+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c1a2800 con 0x7ff22c100640 2023-10-08T08:43:14.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.537+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c107b60 con 0x7ff22c100640 2023-10-08T08:43:14.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.537+0000 7ff2297fa700 1 -- 172.21.15.70:0/2315055017 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff21c022700 con 0x7ff22c100640 2023-10-08T08:43:14.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.538+0000 7ff2297fa700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff2140a1550 0x7ff2140a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.538+0000 7ff2297fa700 1 -- 172.21.15.70:0/2315055017 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ff21c0ce3c0 con 0x7ff22c100640 2023-10-08T08:43:14.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.538+0000 7ff22bfff700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff2140a1550 0x7ff2140a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.538+0000 7ff22bfff700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff2140a1550 0x7ff2140a3a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff22c072bb0 tx=0x7ff220008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:14.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.542+0000 7ff2297fa700 1 -- 172.21.15.70:0/2315055017 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff21c05d100 con 0x7ff22c100640 2023-10-08T08:43:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:14 smithi070 ceph-mon[99513]: pgmap v273: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-08T08:43:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:14 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3069527333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:14 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/371449663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:14 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/634252086' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:14 smithi105 ceph-mon[103798]: pgmap v273: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-08T08:43:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:14 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3069527333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:14 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/371449663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:14.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:14 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/634252086' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:14.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.778+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff22c196d60 con 0x7ff22c100640 2023-10-08T08:43:14.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.779+0000 7ff2297fa700 1 -- 172.21.15.70:0/2315055017 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11375 (secure 0 0 0) 0x7ff21c0976c0 con 0x7ff22c100640 2023-10-08T08:43:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:14.780 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:29.077123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24572":{"gid":24572,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:43:14.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff2140a1550 msgr2=0x7ff2140a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff2140a1550 0x7ff2140a3a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff22c072bb0 tx=0x7ff220008040 comp rx=0 tx=0).stop 2023-10-08T08:43:14.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c100640 msgr2=0x7ff22c195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c100640 0x7ff22c195fa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00b580 tx=0x7ff21c003710 comp rx=0 tx=0).stop 2023-10-08T08:43:14.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 shutdown_connections 2023-10-08T08:43:14.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff2140a1550 0x7ff2140a3a10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff22c105690 0x7ff22c19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c0ffc80 0x7ff22c195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 --2- 172.21.15.70:0/2315055017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22c100640 0x7ff22c195fa0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 >> 172.21.15.70:0/2315055017 conn(0x7ff22c075a90 msgr2=0x7ff22c0fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 shutdown_connections 2023-10-08T08:43:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.781+0000 7ff2329a9700 1 -- 172.21.15.70:0/2315055017 wait complete. 2023-10-08T08:43:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:43:14.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:14.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:14 smithi191 ceph-mon[104220]: pgmap v273: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-08T08:43:14.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:14 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3069527333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:14.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:14 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/371449663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:14.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:14 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/634252086' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:14.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.915+0000 7f68936c8700 1 -- 172.21.15.70:0/2401905343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 msgr2=0x7f688c10c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.915+0000 7f68936c8700 1 --2- 172.21.15.70:0/2401905343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 0x7f688c10c360 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f688400b0d0 tx=0x7f688400b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.915+0000 7f68936c8700 1 -- 172.21.15.70:0/2401905343 shutdown_connections 2023-10-08T08:43:14.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.915+0000 7f68936c8700 1 --2- 172.21.15.70:0/2401905343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 0x7f688c10c360 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.915+0000 7f68936c8700 1 --2- 172.21.15.70:0/2401905343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c105690 0x7f688c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.915+0000 7f68936c8700 1 --2- 172.21.15.70:0/2401905343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f688c0ffcc0 0x7f688c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.915+0000 7f68936c8700 1 -- 172.21.15.70:0/2401905343 >> 172.21.15.70:0/2401905343 conn(0x7f688c075a90 msgr2=0x7f688c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.915+0000 7f68936c8700 1 -- 172.21.15.70:0/2401905343 shutdown_connections 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.915+0000 7f68936c8700 1 -- 172.21.15.70:0/2401905343 wait complete. 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68936c8700 1 Processor -- start 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68936c8700 1 -- start start 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68936c8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f688c0ffcc0 0x7f688c19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68936c8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 0x7f688c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68936c8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c105690 0x7f688c196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68936c8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c1970c0 con 0x7f688c100660 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68936c8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c197230 con 0x7f688c105690 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68936c8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c1973f0 con 0x7f688c0ffcc0 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6890c63700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 0x7f688c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6890c63700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 0x7f688c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50082/0 (socket says 172.21.15.70:50082) 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6890c63700 1 -- 172.21.15.70:0/1692144900 learned_addr learned my addr 172.21.15.70:0/1692144900 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6891464700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f688c0ffcc0 0x7f688c19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6891c65700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c105690 0x7f688c196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6890c63700 1 -- 172.21.15.70:0/1692144900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f688c0ffcc0 msgr2=0x7f688c19c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6890c63700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f688c0ffcc0 0x7f688c19c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6890c63700 1 -- 172.21.15.70:0/1692144900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c105690 msgr2=0x7f688c196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6890c63700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c105690 0x7f688c196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6890c63700 1 -- 172.21.15.70:0/1692144900 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884009d00 con 0x7f688c100660 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6891c65700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c105690 0x7f688c196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f6890c63700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 0x7f688c19ce70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f688800c920 tx=0x7f688800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68827fc700 1 -- 172.21.15.70:0/1692144900 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888007b00 con 0x7f688c100660 2023-10-08T08:43:14.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68827fc700 1 -- 172.21.15.70:0/1692144900 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6888004cf0 con 0x7f688c100660 2023-10-08T08:43:14.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c1976d0 con 0x7f688c100660 2023-10-08T08:43:14.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.916+0000 7f68827fc700 1 -- 172.21.15.70:0/1692144900 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888005610 con 0x7f688c100660 2023-10-08T08:43:14.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.917+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c1a3920 con 0x7f688c100660 2023-10-08T08:43:14.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.917+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c100cd0 con 0x7f688c100660 2023-10-08T08:43:14.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.918+0000 7f68827fc700 1 -- 172.21.15.70:0/1692144900 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6888004750 con 0x7f688c100660 2023-10-08T08:43:14.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.919+0000 7f68827fc700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68780a1550 0x7f68780a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:14.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.919+0000 7f6891464700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68780a1550 0x7f68780a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:14.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.919+0000 7f68827fc700 1 -- 172.21.15.70:0/1692144900 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f68880cd090 con 0x7f688c100660 2023-10-08T08:43:14.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.919+0000 7f6891464700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68780a1550 0x7f68780a3a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f687c005950 tx=0x7f687c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:14.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:14.923+0000 7f68827fc700 1 -- 172.21.15.70:0/1692144900 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6888096300 con 0x7f688c100660 2023-10-08T08:43:15.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.118+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f688c197f20 con 0x7f688c100660 2023-10-08T08:43:15.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.120+0000 7f68827fc700 1 -- 172.21.15.70:0/1692144900 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7f688801d090 con 0x7f688c100660 2023-10-08T08:43:15.121 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:15.121 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68780a1550 msgr2=0x7f68780a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68780a1550 0x7f68780a3a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f687c005950 tx=0x7f687c0058e0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 msgr2=0x7f688c19ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 0x7f688c19ce70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f688800c920 tx=0x7f688800cce0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 shutdown_connections 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68780a1550 0x7f68780a3a10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c105690 0x7f688c196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f688c0ffcc0 0x7f688c19c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 --2- 172.21.15.70:0/1692144900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688c100660 0x7f688c19ce70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 >> 172.21.15.70:0/1692144900 conn(0x7f688c075a90 msgr2=0x7f688c103810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:15.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 shutdown_connections 2023-10-08T08:43:15.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.122+0000 7f68936c8700 1 -- 172.21.15.70:0/1692144900 wait complete. 2023-10-08T08:43:15.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:43:15.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:43:15.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 -- 172.21.15.70:0/1194350103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 msgr2=0x7fc55410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 --2- 172.21.15.70:0/1194350103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 0x7fc55410d610 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00b0a0 tx=0x7fc54c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 -- 172.21.15.70:0/1194350103 shutdown_connections 2023-10-08T08:43:15.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 --2- 172.21.15.70:0/1194350103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 0x7fc55410d610 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 --2- 172.21.15.70:0/1194350103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc554106750 0x7fc554106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 --2- 172.21.15.70:0/1194350103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc554100740 0x7fc554100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 -- 172.21.15.70:0/1194350103 >> 172.21.15.70:0/1194350103 conn(0x7fc5540fc230 msgr2=0x7fc5540fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:15.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 -- 172.21.15.70:0/1194350103 shutdown_connections 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 -- 172.21.15.70:0/1194350103 wait complete. 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.260+0000 7fc558f6c700 1 Processor -- start 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc558f6c700 1 -- start start 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc558f6c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc554100740 0x7fc55419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc558f6c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 0x7fc55419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc558f6c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc554106750 0x7fc554196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc558f6c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc554197140 con 0x7fc554101100 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc558f6c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5541972b0 con 0x7fc554100740 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc558f6c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc554197470 con 0x7fc554106750 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc551d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 0x7fc55419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc551d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 0x7fc55419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50094/0 (socket says 172.21.15.70:50094) 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc551d9b700 1 -- 172.21.15.70:0/3988637748 learned_addr learned my addr 172.21.15.70:0/3988637748 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc552d9d700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc554106750 0x7fc554196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc55259c700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc554100740 0x7fc55419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc551d9b700 1 -- 172.21.15.70:0/3988637748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc554106750 msgr2=0x7fc554196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc551d9b700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc554106750 0x7fc554196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc551d9b700 1 -- 172.21.15.70:0/3988637748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc554100740 msgr2=0x7fc55419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc551d9b700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc554100740 0x7fc55419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc551d9b700 1 -- 172.21.15.70:0/3988637748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c009d00 con 0x7fc554101100 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc552d9d700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc554106750 0x7fc554196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc551d9b700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 0x7fc55419ce10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc54800e9a0 tx=0x7fc54800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc5437fe700 1 -- 172.21.15.70:0/3988637748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548009790 con 0x7fc554101100 2023-10-08T08:43:15.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc5437fe700 1 -- 172.21.15.70:0/3988637748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc54800cbd0 con 0x7fc554101100 2023-10-08T08:43:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc554197750 con 0x7fc554101100 2023-10-08T08:43:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.261+0000 7fc5437fe700 1 -- 172.21.15.70:0/3988637748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548018680 con 0x7fc554101100 2023-10-08T08:43:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.262+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5541a3850 con 0x7fc554101100 2023-10-08T08:43:15.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.262+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc554108d40 con 0x7fc554101100 2023-10-08T08:43:15.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.264+0000 7fc5437fe700 1 -- 172.21.15.70:0/3988637748 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc54800cd40 con 0x7fc554101100 2023-10-08T08:43:15.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.264+0000 7fc5437fe700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc53c0a14d0 0x7fc53c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.264+0000 7fc55259c700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc53c0a14d0 0x7fc53c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.264+0000 7fc5437fe700 1 -- 172.21.15.70:0/3988637748 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc548014070 con 0x7fc554101100 2023-10-08T08:43:15.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.264+0000 7fc55259c700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc53c0a14d0 0x7fc53c0a3990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc544005950 tx=0x7fc5440058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:15.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.268+0000 7fc5437fe700 1 -- 172.21.15.70:0/3988637748 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc548096be0 con 0x7fc554101100 2023-10-08T08:43:15.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.462+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc554101e80 con 0x7fc554101100 2023-10-08T08:43:15.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.463+0000 7fc5437fe700 1 -- 172.21.15.70:0/3988637748 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc54809a200 con 0x7fc554101100 2023-10-08T08:43:15.464 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:43:15.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc53c0a14d0 msgr2=0x7fc53c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc53c0a14d0 0x7fc53c0a3990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc544005950 tx=0x7fc5440058e0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 msgr2=0x7fc55419ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 0x7fc55419ce10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc54800e9a0 tx=0x7fc54800ed60 comp rx=0 tx=0).stop 2023-10-08T08:43:15.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 shutdown_connections 2023-10-08T08:43:15.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc53c0a14d0 0x7fc53c0a3990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc554106750 0x7fc554196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc554100740 0x7fc55419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 --2- 172.21.15.70:0/3988637748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc554101100 0x7fc55419ce10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 >> 172.21.15.70:0/3988637748 conn(0x7fc5540fc230 msgr2=0x7fc5540fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:15.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 shutdown_connections 2023-10-08T08:43:15.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.465+0000 7fc558f6c700 1 -- 172.21.15.70:0/3988637748 wait complete. 2023-10-08T08:43:15.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:15 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2466345217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:15.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:15 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2315055017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:15.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:15 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1692144900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:15.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:43:15.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.602+0000 7fa839f77700 1 -- 172.21.15.70:0/833421183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 msgr2=0x7fa83410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.602+0000 7fa839f77700 1 --2- 172.21.15.70:0/833421183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 0x7fa83410d5f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00b0a0 tx=0x7fa82c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.602+0000 7fa839f77700 1 -- 172.21.15.70:0/833421183 shutdown_connections 2023-10-08T08:43:15.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.602+0000 7fa839f77700 1 --2- 172.21.15.70:0/833421183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 0x7fa83410d5f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.602+0000 7fa839f77700 1 --2- 172.21.15.70:0/833421183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa834106730 0x7fa834106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.602+0000 7fa839f77700 1 --2- 172.21.15.70:0/833421183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa834100720 0x7fa834100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.602+0000 7fa839f77700 1 -- 172.21.15.70:0/833421183 >> 172.21.15.70:0/833421183 conn(0x7fa8340fc230 msgr2=0x7fa8340fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:15.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.602+0000 7fa839f77700 1 -- 172.21.15.70:0/833421183 shutdown_connections 2023-10-08T08:43:15.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.602+0000 7fa839f77700 1 -- 172.21.15.70:0/833421183 wait complete. 2023-10-08T08:43:15.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.603+0000 7fa839f77700 1 Processor -- start 2023-10-08T08:43:15.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.603+0000 7fa839f77700 1 -- start start 2023-10-08T08:43:15.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.603+0000 7fa839f77700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa834100720 0x7fa83419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.603+0000 7fa839f77700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 0x7fa83419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.603+0000 7fa839f77700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa834106730 0x7fa8341968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.603+0000 7fa839f77700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa834196f00 con 0x7fa8341010e0 2023-10-08T08:43:15.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.603+0000 7fa839f77700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa834197070 con 0x7fa834100720 2023-10-08T08:43:15.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.603+0000 7fa839f77700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa834197230 con 0x7fa834106730 2023-10-08T08:43:15.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.603+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 0x7fa83419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 0x7fa83419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50108/0 (socket says 172.21.15.70:50108) 2023-10-08T08:43:15.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa832ffd700 1 -- 172.21.15.70:0/2658723888 learned_addr learned my addr 172.21.15.70:0/2658723888 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa8337fe700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa834100720 0x7fa83419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa833fff700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa834106730 0x7fa8341968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa832ffd700 1 -- 172.21.15.70:0/2658723888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa834106730 msgr2=0x7fa8341968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa832ffd700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa834106730 0x7fa8341968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa832ffd700 1 -- 172.21.15.70:0/2658723888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa834100720 msgr2=0x7fa83419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa832ffd700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa834100720 0x7fa83419c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa832ffd700 1 -- 172.21.15.70:0/2658723888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c009d00 con 0x7fa8341010e0 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa832ffd700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 0x7fa83419cc00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c9b0 tx=0x7fa82800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa830ff9700 1 -- 172.21.15.70:0/2658723888 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828007b00 con 0x7fa8341010e0 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa834197510 con 0x7fa8341010e0 2023-10-08T08:43:15.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa830ff9700 1 -- 172.21.15.70:0/2658723888 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa82800ce50 con 0x7fa8341010e0 2023-10-08T08:43:15.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa830ff9700 1 -- 172.21.15.70:0/2658723888 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828018660 con 0x7fa8341010e0 2023-10-08T08:43:15.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.604+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8341a3760 con 0x7fa8341010e0 2023-10-08T08:43:15.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.605+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa834108cb0 con 0x7fa8341010e0 2023-10-08T08:43:15.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.606+0000 7fa830ff9700 1 -- 172.21.15.70:0/2658723888 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa82800f450 con 0x7fa8341010e0 2023-10-08T08:43:15.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.607+0000 7fa830ff9700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa81c0a14d0 0x7fa81c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.607+0000 7fa8337fe700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa81c0a14d0 0x7fa81c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.607+0000 7fa830ff9700 1 -- 172.21.15.70:0/2658723888 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fa8280cd2d0 con 0x7fa8341010e0 2023-10-08T08:43:15.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.607+0000 7fa8337fe700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa81c0a14d0 0x7fa81c0a3990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa824005950 tx=0x7fa82400a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:15.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.610+0000 7fa830ff9700 1 -- 172.21.15.70:0/2658723888 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa8280965d0 con 0x7fa8341010e0 2023-10-08T08:43:15.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:15 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2466345217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:15.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:15 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2315055017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:15.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:15 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1692144900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:15.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.803+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa834197d30 con 0x7fa8341010e0 2023-10-08T08:43:15.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.803+0000 7fa830ff9700 1 -- 172.21.15.70:0/2658723888 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa828007e60 con 0x7fa8341010e0 2023-10-08T08:43:15.804 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:15.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa81c0a14d0 msgr2=0x7fa81c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa81c0a14d0 0x7fa81c0a3990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa824005950 tx=0x7fa82400a300 comp rx=0 tx=0).stop 2023-10-08T08:43:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 msgr2=0x7fa83419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 0x7fa83419cc00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c9b0 tx=0x7fa82800ccc0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 shutdown_connections 2023-10-08T08:43:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa81c0a14d0 0x7fa81c0a3990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa834106730 0x7fa8341968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa834100720 0x7fa83419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 --2- 172.21.15.70:0/2658723888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8341010e0 0x7fa83419cc00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 >> 172.21.15.70:0/2658723888 conn(0x7fa8340fc230 msgr2=0x7fa8340fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:15.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 shutdown_connections 2023-10-08T08:43:15.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.805+0000 7fa839f77700 1 -- 172.21.15.70:0/2658723888 wait complete. 2023-10-08T08:43:15.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:43:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:15 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2466345217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:15 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2315055017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:15.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:15 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1692144900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:15.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.942+0000 7f8387b5a700 1 -- 172.21.15.70:0/3109100479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 msgr2=0x7f83800ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.942+0000 7f8387b5a700 1 --2- 172.21.15.70:0/3109100479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 0x7f83800ffab0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f837c009990 tx=0x7f837c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.942+0000 7f8387b5a700 1 -- 172.21.15.70:0/3109100479 shutdown_connections 2023-10-08T08:43:15.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.942+0000 7f8387b5a700 1 --2- 172.21.15.70:0/3109100479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83800ffff0 0x7f838010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.942+0000 7f8387b5a700 1 --2- 172.21.15.70:0/3109100479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380105630 0x7f8380105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.942+0000 7f8387b5a700 1 --2- 172.21.15.70:0/3109100479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 0x7f83800ffab0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.942+0000 7f8387b5a700 1 -- 172.21.15.70:0/3109100479 >> 172.21.15.70:0/3109100479 conn(0x7f8380076790 msgr2=0x7f8380076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.942+0000 7f8387b5a700 1 -- 172.21.15.70:0/3109100479 shutdown_connections 2023-10-08T08:43:15.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.942+0000 7f8387b5a700 1 -- 172.21.15.70:0/3109100479 wait complete. 2023-10-08T08:43:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f8387b5a700 1 Processor -- start 2023-10-08T08:43:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f8387b5a700 1 -- start start 2023-10-08T08:43:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f8387b5a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 0x7f838019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f8387b5a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83800ffff0 0x7f838019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f8387b5a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380105630 0x7f83801958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f8387b5a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380195f30 con 0x7f83800ff630 2023-10-08T08:43:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f8387b5a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83801960a0 con 0x7f83800ffff0 2023-10-08T08:43:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f8387b5a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380196260 con 0x7f8380105630 2023-10-08T08:43:15.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f83858f6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 0x7f838019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f83858f6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 0x7f838019b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50118/0 (socket says 172.21.15.70:50118) 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f83858f6700 1 -- 172.21.15.70:0/4042186758 learned_addr learned my addr 172.21.15.70:0/4042186758 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f83858f6700 1 -- 172.21.15.70:0/4042186758 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380105630 msgr2=0x7f83801958d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f83858f6700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380105630 0x7f83801958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f83858f6700 1 -- 172.21.15.70:0/4042186758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83800ffff0 msgr2=0x7f838019bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f83858f6700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83800ffff0 0x7f838019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f83858f6700 1 -- 172.21.15.70:0/4042186758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0095f0 con 0x7f83800ff630 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.943+0000 7f83858f6700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 0x7f838019b7a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f837000d950 tx=0x7f837000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.944+0000 7f8376ffd700 1 -- 172.21.15.70:0/4042186758 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370009b40 con 0x7f83800ff630 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.944+0000 7f8376ffd700 1 -- 172.21.15.70:0/4042186758 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8370009ca0 con 0x7f83800ff630 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.944+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8380196540 con 0x7f83800ff630 2023-10-08T08:43:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.944+0000 7f8376ffd700 1 -- 172.21.15.70:0/4042186758 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837000f620 con 0x7f83800ff630 2023-10-08T08:43:15.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.944+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83801a2790 con 0x7f83800ff630 2023-10-08T08:43:15.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.945+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8380107c40 con 0x7f83800ff630 2023-10-08T08:43:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.946+0000 7f8376ffd700 1 -- 172.21.15.70:0/4042186758 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8370010460 con 0x7f83800ff630 2023-10-08T08:43:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.946+0000 7f8376ffd700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f836c0a14d0 0x7f836c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.947+0000 7f83850f5700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f836c0a14d0 0x7f836c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.947+0000 7f8376ffd700 1 -- 172.21.15.70:0/4042186758 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f83700cd3c0 con 0x7f83800ff630 2023-10-08T08:43:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.947+0000 7f83850f5700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f836c0a14d0 0x7f836c0a3990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f837c0098e0 tx=0x7f837c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:15.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:15.951+0000 7f8376ffd700 1 -- 172.21.15.70:0/4042186758 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f83700966d0 con 0x7f83800ff630 2023-10-08T08:43:16.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.143+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8380196d90 con 0x7f83800ff630 2023-10-08T08:43:16.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.143+0000 7f8376ffd700 1 -- 172.21.15.70:0/4042186758 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8370099cf0 con 0x7f83800ff630 2023-10-08T08:43:16.144 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:43:16.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.145+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f836c0a14d0 msgr2=0x7f836c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.145+0000 7f8387b5a700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f836c0a14d0 0x7f836c0a3990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f837c0098e0 tx=0x7f837c005fb0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 msgr2=0x7f838019b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 0x7f838019b7a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f837000d950 tx=0x7f837000dd10 comp rx=0 tx=0).stop 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 shutdown_connections 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f836c0a14d0 0x7f836c0a3990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8380105630 0x7f83801958d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83800ff630 0x7f838019b7a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 --2- 172.21.15.70:0/4042186758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83800ffff0 0x7f838019bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 >> 172.21.15.70:0/4042186758 conn(0x7f8380076790 msgr2=0x7f8380101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 shutdown_connections 2023-10-08T08:43:16.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.146+0000 7f8387b5a700 1 -- 172.21.15.70:0/4042186758 wait complete. 2023-10-08T08:43:16.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:43:16.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.282+0000 7ff86de2f700 1 -- 172.21.15.70:0/426891188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8680fffe0 msgr2=0x7ff86810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.282+0000 7ff86de2f700 1 --2- 172.21.15.70:0/426891188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8680fffe0 0x7ff86810c4e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff86000b0a0 tx=0x7ff86000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.283+0000 7ff86de2f700 1 -- 172.21.15.70:0/426891188 shutdown_connections 2023-10-08T08:43:16.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.283+0000 7ff86de2f700 1 --2- 172.21.15.70:0/426891188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8680fffe0 0x7ff86810c4e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.283+0000 7ff86de2f700 1 --2- 172.21.15.70:0/426891188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8681056b0 0x7ff868105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.283+0000 7ff86de2f700 1 --2- 172.21.15.70:0/426891188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8680ff620 0x7ff8680ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.283+0000 7ff86de2f700 1 -- 172.21.15.70:0/426891188 >> 172.21.15.70:0/426891188 conn(0x7ff868076780 msgr2=0x7ff868076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:16.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.283+0000 7ff86de2f700 1 -- 172.21.15.70:0/426891188 shutdown_connections 2023-10-08T08:43:16.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.283+0000 7ff86de2f700 1 -- 172.21.15.70:0/426891188 wait complete. 2023-10-08T08:43:16.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.283+0000 7ff86de2f700 1 Processor -- start 2023-10-08T08:43:16.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.283+0000 7ff86de2f700 1 -- start start 2023-10-08T08:43:16.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff86de2f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8680ff620 0x7ff868197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:16.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff86de2f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8680fffe0 0x7ff868197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:16.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff86de2f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8681056b0 0x7ff868198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:16.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff86de2f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681a2d70 con 0x7ff8681056b0 2023-10-08T08:43:16.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff86de2f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681a2ee0 con 0x7ff8680fffe0 2023-10-08T08:43:16.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff86de2f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681a30a0 con 0x7ff8680ff620 2023-10-08T08:43:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff867fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8681056b0 0x7ff868198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff867fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8681056b0 0x7ff868198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50136/0 (socket says 172.21.15.70:50136) 2023-10-08T08:43:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff867fff700 1 -- 172.21.15.70:0/4070244270 learned_addr learned my addr 172.21.15.70:0/4070244270 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff8677fe700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8680ff620 0x7ff868197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff866ffd700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8680fffe0 0x7ff868197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff867fff700 1 -- 172.21.15.70:0/4070244270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8680ff620 msgr2=0x7ff868197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff867fff700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8680ff620 0x7ff868197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff867fff700 1 -- 172.21.15.70:0/4070244270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8680fffe0 msgr2=0x7ff868197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff867fff700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8680fffe0 0x7ff868197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff867fff700 1 -- 172.21.15.70:0/4070244270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860009d00 con 0x7ff8681056b0 2023-10-08T08:43:16.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff866ffd700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8680fffe0 0x7ff868197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:16.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff867fff700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8681056b0 0x7ff868198520 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff86000b830 tx=0x7ff860005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:16.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff864ff9700 1 -- 172.21.15.70:0/4070244270 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000e040 con 0x7ff8681056b0 2023-10-08T08:43:16.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8681a3320 con 0x7ff8681056b0 2023-10-08T08:43:16.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff864ff9700 1 -- 172.21.15.70:0/4070244270 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff860012e40 con 0x7ff8681056b0 2023-10-08T08:43:16.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff864ff9700 1 -- 172.21.15.70:0/4070244270 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86001b450 con 0x7ff8681056b0 2023-10-08T08:43:16.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.284+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8681a37a0 con 0x7ff8681056b0 2023-10-08T08:43:16.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.285+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff868107c30 con 0x7ff8681056b0 2023-10-08T08:43:16.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.286+0000 7ff864ff9700 1 -- 172.21.15.70:0/4070244270 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff860012980 con 0x7ff8681056b0 2023-10-08T08:43:16.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.287+0000 7ff864ff9700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff8500a14d0 0x7ff8500a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:16.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.287+0000 7ff864ff9700 1 -- 172.21.15.70:0/4070244270 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ff8600cf4f0 con 0x7ff8681056b0 2023-10-08T08:43:16.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.287+0000 7ff8677fe700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff8500a14d0 0x7ff8500a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:16.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.287+0000 7ff8677fe700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff8500a14d0 0x7ff8500a3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff868077ab0 tx=0x7ff858009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:16.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.290+0000 7ff864ff9700 1 -- 172.21.15.70:0/4070244270 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff860098790 con 0x7ff8681056b0 2023-10-08T08:43:16.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:16 smithi070 ceph-mon[99513]: pgmap v274: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:16.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:16 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3988637748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:16.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:16 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2658723888' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:16.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:16 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4042186758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.485+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff868067e20 con 0x7ff8681056b0 2023-10-08T08:43:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.485+0000 7ff864ff9700 1 -- 172.21.15.70:0/4070244270 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff86009bdb0 con 0x7ff8681056b0 2023-10-08T08:43:16.486 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff8500a14d0 msgr2=0x7ff8500a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff8500a14d0 0x7ff8500a3990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff868077ab0 tx=0x7ff858009190 comp rx=0 tx=0).stop 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8681056b0 msgr2=0x7ff868198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8681056b0 0x7ff868198520 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff86000b830 tx=0x7ff860005ad0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 shutdown_connections 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff8500a14d0 0x7ff8500a3990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8681056b0 0x7ff868198520 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8680ff620 0x7ff868197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 --2- 172.21.15.70:0/4070244270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8680fffe0 0x7ff868197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 >> 172.21.15.70:0/4070244270 conn(0x7ff868076780 msgr2=0x7ff8680fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 shutdown_connections 2023-10-08T08:43:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.487+0000 7ff86de2f700 1 -- 172.21.15.70:0/4070244270 wait complete. 2023-10-08T08:43:16.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:43:16.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.621+0000 7faf0b2fd700 1 -- 172.21.15.70:0/3495338498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf040ff4f0 msgr2=0x7faf0410d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.621+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/3495338498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf040ff4f0 0x7faf0410d510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faefc00b0a0 tx=0x7faefc00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.621+0000 7faf0b2fd700 1 -- 172.21.15.70:0/3495338498 shutdown_connections 2023-10-08T08:43:16.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.621+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/3495338498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf040ff4f0 0x7faf0410d510 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.621+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/3495338498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf04106650 0x7faf04106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.621+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/3495338498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf040feb30 0x7faf040fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.621+0000 7faf0b2fd700 1 -- 172.21.15.70:0/3495338498 >> 172.21.15.70:0/3495338498 conn(0x7faf04075a60 msgr2=0x7faf040fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:16.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.621+0000 7faf0b2fd700 1 -- 172.21.15.70:0/3495338498 shutdown_connections 2023-10-08T08:43:16.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.621+0000 7faf0b2fd700 1 -- 172.21.15.70:0/3495338498 wait complete. 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0b2fd700 1 Processor -- start 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0b2fd700 1 -- start start 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0b2fd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf040feb30 0x7faf040ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0b2fd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf040ff4f0 0x7faf04100250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0b2fd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf04106650 0x7faf04100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0b2fd700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf041a4d30 con 0x7faf04106650 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0b2fd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf041a4ea0 con 0x7faf040feb30 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0b2fd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf041a5060 con 0x7faf040ff4f0 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0989a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf04106650 0x7faf04100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:16.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0989a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf04106650 0x7faf04100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50150/0 (socket says 172.21.15.70:50150) 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0989a700 1 -- 172.21.15.70:0/4165199621 learned_addr learned my addr 172.21.15.70:0/4165199621 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf09099700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf040feb30 0x7faf040ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf08898700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf040ff4f0 0x7faf04100250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0989a700 1 -- 172.21.15.70:0/4165199621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf040ff4f0 msgr2=0x7faf04100250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0989a700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf040ff4f0 0x7faf04100250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0989a700 1 -- 172.21.15.70:0/4165199621 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf040feb30 msgr2=0x7faf040ffd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0989a700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf040feb30 0x7faf040ffd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf0989a700 1 -- 172.21.15.70:0/4165199621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc009d00 con 0x7faf04106650 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.622+0000 7faf09099700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf040feb30 0x7faf040ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.623+0000 7faf0989a700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf04106650 0x7faf04100790 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faefc00b070 tx=0x7faefc007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.623+0000 7faefa7fc700 1 -- 172.21.15.70:0/4165199621 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc00e040 con 0x7faf04106650 2023-10-08T08:43:16.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.623+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf041a52e0 con 0x7faf04106650 2023-10-08T08:43:16.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.623+0000 7faefa7fc700 1 -- 172.21.15.70:0/4165199621 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faefc012e70 con 0x7faf04106650 2023-10-08T08:43:16.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.623+0000 7faefa7fc700 1 -- 172.21.15.70:0/4165199621 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc01c400 con 0x7faf04106650 2023-10-08T08:43:16.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.623+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf041a5760 con 0x7faf04106650 2023-10-08T08:43:16.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.624+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf04108c60 con 0x7faf04106650 2023-10-08T08:43:16.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.625+0000 7faefa7fc700 1 -- 172.21.15.70:0/4165199621 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7faefc01b6a0 con 0x7faf04106650 2023-10-08T08:43:16.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.625+0000 7faefa7fc700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faef00a14d0 0x7faef00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:16.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.625+0000 7faf09099700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faef00a14d0 0x7faef00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:16.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.625+0000 7faefa7fc700 1 -- 172.21.15.70:0/4165199621 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7faefc0cf3d0 con 0x7faf04106650 2023-10-08T08:43:16.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.626+0000 7faf09099700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faef00a14d0 0x7faef00a3990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf0000baa0 tx=0x7faf00005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.629+0000 7faefa7fc700 1 -- 172.21.15.70:0/4165199621 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faefc0986d0 con 0x7faf04106650 2023-10-08T08:43:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:16 smithi105 ceph-mon[103798]: pgmap v274: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:16 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3988637748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:16 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2658723888' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:16 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4042186758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:16.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:16 smithi191 ceph-mon[104220]: pgmap v274: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:16.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:16 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3988637748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:16.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:16 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2658723888' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:16.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:16 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4042186758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:16.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.862+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf04101240 con 0x7faf04106650 2023-10-08T08:43:16.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.863+0000 7faefa7fc700 1 -- 172.21.15.70:0/4165199621 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11375 (secure 0 0 0) 0x7faefc09bcf0 con 0x7faf04106650 2023-10-08T08:43:16.864 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:16.864 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:29.077123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24572":{"gid":24572,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:43:16.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faef00a14d0 msgr2=0x7faef00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faef00a14d0 0x7faef00a3990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf0000baa0 tx=0x7faf00005db0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf04106650 msgr2=0x7faf04100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf04106650 0x7faf04100790 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faefc00b070 tx=0x7faefc007b70 comp rx=0 tx=0).stop 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 shutdown_connections 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faef00a14d0 0x7faef00a3990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf04106650 0x7faf04100790 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf040feb30 0x7faf040ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 --2- 172.21.15.70:0/4165199621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf040ff4f0 0x7faf04100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 >> 172.21.15.70:0/4165199621 conn(0x7faf04075a60 msgr2=0x7faf041033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 shutdown_connections 2023-10-08T08:43:16.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:16.865+0000 7faf0b2fd700 1 -- 172.21.15.70:0/4165199621 wait complete. 2023-10-08T08:43:16.867 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:43:16.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.000+0000 7f041f275700 1 -- 172.21.15.70:0/3473165984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418100c60 msgr2=0x7f0418104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.000+0000 7f041f275700 1 --2- 172.21.15.70:0/3473165984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418100c60 0x7f0418104200 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0408009990 tx=0x7f0408009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.000+0000 7f041f275700 1 -- 172.21.15.70:0/3473165984 shutdown_connections 2023-10-08T08:43:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.000+0000 7f041f275700 1 --2- 172.21.15.70:0/3473165984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04181048e0 0x7f041810c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.000+0000 7f041f275700 1 --2- 172.21.15.70:0/3473165984 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04181002b0 0x7f0418100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.000+0000 7f041f275700 1 --2- 172.21.15.70:0/3473165984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418100c60 0x7f0418104200 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.000+0000 7f041f275700 1 -- 172.21.15.70:0/3473165984 >> 172.21.15.70:0/3473165984 conn(0x7f0418074820 msgr2=0x7f0418074c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.000+0000 7f041f275700 1 -- 172.21.15.70:0/3473165984 shutdown_connections 2023-10-08T08:43:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.000+0000 7f041f275700 1 -- 172.21.15.70:0/3473165984 wait complete. 2023-10-08T08:43:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.001+0000 7f041f275700 1 Processor -- start 2023-10-08T08:43:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.001+0000 7f041f275700 1 -- start start 2023-10-08T08:43:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.001+0000 7f041f275700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04181002b0 0x7f04181978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.001+0000 7f041f275700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04181048e0 0x7f0418197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.001+0000 7f041f275700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418198350 0x7f04181a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.001+0000 7f041f275700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04181a3030 con 0x7f0418198350 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.001+0000 7f041f275700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04181a31a0 con 0x7f04181048e0 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.001+0000 7f041f275700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04181a3360 con 0x7f04181002b0 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.001+0000 7f041d812700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418198350 0x7f04181a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041d812700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418198350 0x7f04181a2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50164/0 (socket says 172.21.15.70:50164) 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041d812700 1 -- 172.21.15.70:0/236939723 learned_addr learned my addr 172.21.15.70:0/236939723 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041c810700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04181048e0 0x7f0418197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041d812700 1 -- 172.21.15.70:0/236939723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04181002b0 msgr2=0x7f04181978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041d011700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04181002b0 0x7f04181978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041d812700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04181002b0 0x7f04181978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041d812700 1 -- 172.21.15.70:0/236939723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04181048e0 msgr2=0x7f0418197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041d812700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04181048e0 0x7f0418197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041d812700 1 -- 172.21.15.70:0/236939723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04080095f0 con 0x7f0418198350 2023-10-08T08:43:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041c810700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04181048e0 0x7f0418197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041d812700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418198350 0x7f04181a2950 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f041400d980 tx=0x7f041400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f040e7fc700 1 -- 172.21.15.70:0/236939723 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414009940 con 0x7f0418198350 2023-10-08T08:43:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f040e7fc700 1 -- 172.21.15.70:0/236939723 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0414004830 con 0x7f0418198350 2023-10-08T08:43:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04181a3640 con 0x7f0418198350 2023-10-08T08:43:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f040e7fc700 1 -- 172.21.15.70:0/236939723 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04140054e0 con 0x7f0418198350 2023-10-08T08:43:17.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.002+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04181a3b00 con 0x7f0418198350 2023-10-08T08:43:17.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.003+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0418107bc0 con 0x7f0418198350 2023-10-08T08:43:17.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.004+0000 7f040e7fc700 1 -- 172.21.15.70:0/236939723 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0414004ca0 con 0x7f0418198350 2023-10-08T08:43:17.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.005+0000 7f040e7fc700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04040a14d0 0x7f04040a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.005+0000 7f041d011700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04040a14d0 0x7f04040a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.005+0000 7f040e7fc700 1 -- 172.21.15.70:0/236939723 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f04140cd4f0 con 0x7f0418198350 2023-10-08T08:43:17.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.005+0000 7f041d011700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04040a14d0 0x7f04040a3990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f04100060b0 tx=0x7f0410008640 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.009+0000 7f040e7fc700 1 -- 172.21.15.70:0/236939723 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0414096760 con 0x7f0418198350 2023-10-08T08:43:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.206+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04180ff4f0 con 0x7f0418198350 2023-10-08T08:43:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.207+0000 7f040e7fc700 1 -- 172.21.15.70:0/236939723 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7f0414017070 con 0x7f0418198350 2023-10-08T08:43:17.208 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:17.209 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04040a14d0 msgr2=0x7f04040a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04040a14d0 0x7f04040a3990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f04100060b0 tx=0x7f0410008640 comp rx=0 tx=0).stop 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418198350 msgr2=0x7f04181a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418198350 0x7f04181a2950 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f041400d980 tx=0x7f041400dd40 comp rx=0 tx=0).stop 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 shutdown_connections 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04040a14d0 0x7f04040a3990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0418198350 0x7f04181a2950 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04181002b0 0x7f04181978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 --2- 172.21.15.70:0/236939723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04181048e0 0x7f0418197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.209+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 >> 172.21.15.70:0/236939723 conn(0x7f0418074820 msgr2=0x7f04180fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.210+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 shutdown_connections 2023-10-08T08:43:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.210+0000 7f041f275700 1 -- 172.21.15.70:0/236939723 wait complete. 2023-10-08T08:43:17.223 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:43:17.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 -- 172.21.15.70:0/3644964792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 msgr2=0x7ff4a410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/3644964792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 0x7ff4a410c3c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff49400b0d0 tx=0x7ff49400b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 -- 172.21.15.70:0/3644964792 shutdown_connections 2023-10-08T08:43:17.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/3644964792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 0x7ff4a410c3c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/3644964792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4a4105600 0x7ff4a41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/3644964792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a40ff540 0x7ff4a40ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 -- 172.21.15.70:0/3644964792 >> 172.21.15.70:0/3644964792 conn(0x7ff4a40fb050 msgr2=0x7ff4a40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 -- 172.21.15.70:0/3644964792 shutdown_connections 2023-10-08T08:43:17.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 -- 172.21.15.70:0/3644964792 wait complete. 2023-10-08T08:43:17.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.344+0000 7ff4a98b6700 1 Processor -- start 2023-10-08T08:43:17.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a98b6700 1 -- start start 2023-10-08T08:43:17.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a98b6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a40ff540 0x7ff4a419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a98b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 0x7ff4a419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a98b6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4a4105600 0x7ff4a4196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a98b6700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a4196ff0 con 0x7ff4a40fff00 2023-10-08T08:43:17.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a98b6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a4197160 con 0x7ff4a40ff540 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a98b6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a4197320 con 0x7ff4a4105600 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 0x7ff4a419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 0x7ff4a419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50176/0 (socket says 172.21.15.70:50176) 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a27fc700 1 -- 172.21.15.70:0/1679109536 learned_addr learned my addr 172.21.15.70:0/1679109536 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a37fe700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4a4105600 0x7ff4a4196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a2ffd700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a40ff540 0x7ff4a419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a27fc700 1 -- 172.21.15.70:0/1679109536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4a4105600 msgr2=0x7ff4a4196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a27fc700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4a4105600 0x7ff4a4196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a27fc700 1 -- 172.21.15.70:0/1679109536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a40ff540 msgr2=0x7ff4a419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a27fc700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a40ff540 0x7ff4a419c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.345+0000 7ff4a27fc700 1 -- 172.21.15.70:0/1679109536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff494009d00 con 0x7ff4a40fff00 2023-10-08T08:43:17.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.346+0000 7ff4a27fc700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 0x7ff4a419cd50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c920 tx=0x7ff48c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.346+0000 7ff4a88b4700 1 -- 172.21.15.70:0/1679109536 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c007b00 con 0x7ff4a40fff00 2023-10-08T08:43:17.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.346+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a4197600 con 0x7ff4a40fff00 2023-10-08T08:43:17.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.346+0000 7ff4a88b4700 1 -- 172.21.15.70:0/1679109536 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff48c00ce70 con 0x7ff4a40fff00 2023-10-08T08:43:17.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.346+0000 7ff4a88b4700 1 -- 172.21.15.70:0/1679109536 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c005460 con 0x7ff4a40fff00 2023-10-08T08:43:17.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.346+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a41a3800 con 0x7ff4a40fff00 2023-10-08T08:43:17.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.347+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a4107aa0 con 0x7ff4a40fff00 2023-10-08T08:43:17.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.348+0000 7ff4a88b4700 1 -- 172.21.15.70:0/1679109536 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff48c004750 con 0x7ff4a40fff00 2023-10-08T08:43:17.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.348+0000 7ff4a88b4700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff4900a14d0 0x7ff4900a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.348+0000 7ff4a88b4700 1 -- 172.21.15.70:0/1679109536 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ff48c0ccd90 con 0x7ff4a40fff00 2023-10-08T08:43:17.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.348+0000 7ff4a2ffd700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff4900a14d0 0x7ff4900a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.349+0000 7ff4a2ffd700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff4900a14d0 0x7ff4900a3990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00ba60 tx=0x7ff49c005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.353+0000 7ff4a88b4700 1 -- 172.21.15.70:0/1679109536 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff48c096000 con 0x7ff4a40fff00 2023-10-08T08:43:17.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.590+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4a4100c60 con 0x7ff4a40fff00 2023-10-08T08:43:17.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.591+0000 7ff4a88b4700 1 -- 172.21.15.70:0/1679109536 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11375 (secure 0 0 0) 0x7ff48c01d090 con 0x7ff4a40fff00 2023-10-08T08:43:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:17.592 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:29.077123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24572":{"gid":24572,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:43:17.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff4900a14d0 msgr2=0x7ff4900a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff4900a14d0 0x7ff4900a3990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00ba60 tx=0x7ff49c005d50 comp rx=0 tx=0).stop 2023-10-08T08:43:17.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 msgr2=0x7ff4a419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 0x7ff4a419cd50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c920 tx=0x7ff48c00cc30 comp rx=0 tx=0).stop 2023-10-08T08:43:17.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 shutdown_connections 2023-10-08T08:43:17.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff4900a14d0 0x7ff4900a3990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4a4105600 0x7ff4a4196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a40ff540 0x7ff4a419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 --2- 172.21.15.70:0/1679109536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4a40fff00 0x7ff4a419cd50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 >> 172.21.15.70:0/1679109536 conn(0x7ff4a40fb050 msgr2=0x7ff4a40fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 shutdown_connections 2023-10-08T08:43:17.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.593+0000 7ff4a98b6700 1 -- 172.21.15.70:0/1679109536 wait complete. 2023-10-08T08:43:17.596 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:43:17.606 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:17 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4070244270' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:17.606 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:17 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4165199621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:17.606 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:17 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/236939723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:17.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T08:42:00.508850+0000', 'modified': '2023-10-08T08:42:29.077123+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24638, 'mds_1': 24605, 'mds_2': 24604, 'mds_3': 24589, 'mds_4': 24577}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14781': {'gid': 14781, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/3288548320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 3288548320}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 3288548320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14793': {'gid': 14793, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/1499461306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 1499461306}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 1499461306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24541': {'gid': 24541, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/2360801114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 2360801114}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 2360801114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24554': {'gid': 24554, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6833/1292328490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 1292328490}, {'type': 'v1', 'addr': '172.21.15.105:6833', 'nonce': 1292328490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24572': {'gid': 24572, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6835/2412806046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 2412806046}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 2412806046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24577': {'gid': 24577, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.191:6835/2353311301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 2353311301}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 2353311301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24589': {'gid': 24589, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.191:6837/1080059379', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 1080059379}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 1080059379}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24604': {'gid': 24604, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.191:6839/502953702', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 502953702}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 502953702}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24605': {'gid': 24605, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.105:6837/1223332925', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6836', 'nonce': 1223332925}, {'type': 'v1', 'addr': '172.21.15.105:6837', 'nonce': 1223332925}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24638': {'gid': 24638, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6839/586756410', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6838', 'nonce': 586756410}, {'type': 'v1', 'addr': '172.21.15.105:6839', 'nonce': 586756410}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T08:43:17.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-08T08:43:17.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-08T08:43:17.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 -- 172.21.15.70:0/2717807621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 msgr2=0x7f4fa810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 --2- 172.21.15.70:0/2717807621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 0x7f4fa810c4e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000b0a0 tx=0x7f4fa000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 -- 172.21.15.70:0/2717807621 shutdown_connections 2023-10-08T08:43:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 --2- 172.21.15.70:0/2717807621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 0x7f4fa810c4e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 --2- 172.21.15.70:0/2717807621 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa81056b0 0x7f4fa8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 --2- 172.21.15.70:0/2717807621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fa80ff620 0x7f4fa80ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 -- 172.21.15.70:0/2717807621 >> 172.21.15.70:0/2717807621 conn(0x7f4fa8076780 msgr2=0x7f4fa8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 -- 172.21.15.70:0/2717807621 shutdown_connections 2023-10-08T08:43:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 -- 172.21.15.70:0/2717807621 wait complete. 2023-10-08T08:43:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 Processor -- start 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.729+0000 7f4fafd91700 1 -- start start 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fafd91700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fa80ff620 0x7f4fa81012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fafd91700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 0x7f4fa81017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fafd91700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa81056b0 0x7f4fa8101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fafd91700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81a4e80 con 0x7f4fa80fffe0 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fafd91700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81a4ff0 con 0x7f4fa81056b0 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fafd91700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81a51b0 con 0x7f4fa80ff620 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fad32c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 0x7f4fa81017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fad32c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 0x7f4fa81017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50190/0 (socket says 172.21.15.70:50190) 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fad32c700 1 -- 172.21.15.70:0/1853290829 learned_addr learned my addr 172.21.15.70:0/1853290829 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fa80ff620 0x7f4fa81012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fae32e700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa81056b0 0x7f4fa8101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fad32c700 1 -- 172.21.15.70:0/1853290829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fa80ff620 msgr2=0x7f4fa81012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fad32c700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fa80ff620 0x7f4fa81012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fad32c700 1 -- 172.21.15.70:0/1853290829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa81056b0 msgr2=0x7f4fa8101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fad32c700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa81056b0 0x7f4fa8101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fad32c700 1 -- 172.21.15.70:0/1853290829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa0009d00 con 0x7f4fa80fffe0 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fad32c700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 0x7f4fa81017f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800d980 tx=0x7f4f9800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4f9effd700 1 -- 172.21.15.70:0/1853290829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98004220 con 0x7f4fa80fffe0 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4f9effd700 1 -- 172.21.15.70:0/1853290829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f98007640 con 0x7f4fa80fffe0 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fafd91700 1 -- 172.21.15.70:0/1853290829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa81a5490 con 0x7f4fa80fffe0 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4f9effd700 1 -- 172.21.15.70:0/1853290829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98005610 con 0x7f4fa80fffe0 2023-10-08T08:43:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.730+0000 7f4fafd91700 1 -- 172.21.15.70:0/1853290829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa81a59a0 con 0x7f4fa80fffe0 2023-10-08T08:43:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.732+0000 7f4f9effd700 1 -- 172.21.15.70:0/1853290829 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f4f98004750 con 0x7f4fa80fffe0 2023-10-08T08:43:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.733+0000 7f4f9effd700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4f940a14d0 0x7f4f940a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.733+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4f940a14d0 0x7f4f940a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.733+0000 7f4f9effd700 1 -- 172.21.15.70:0/1853290829 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4f980cd060 con 0x7f4fa80fffe0 2023-10-08T08:43:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.733+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4f940a14d0 0x7f4f940a3990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8077ab0 tx=0x7f4fa400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fbbf7ab80 1 Processor -- start 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fbbf7ab80 1 -- start start 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd10210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd10750 0x55647cd1b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd1b600 0x55647cd1d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cc79410 con 0x55647cd0fe30 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cc6abd0 con 0x55647cd10750 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cc684f0 con 0x55647cd1b600 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fadb2d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd10210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fadb2d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd10210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50196/0 (socket says 172.21.15.70:50196) 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fadb2d700 1 -- 172.21.15.70:0/3071395140 learned_addr learned my addr 172.21.15.70:0/3071395140 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fad32c700 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd10750 0x55647cd1b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fae32e700 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd1b600 0x55647cd1d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.734+0000 7f4fadb2d700 1 -- 172.21.15.70:0/3071395140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd1b600 msgr2=0x55647cd1d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd1b600 0x55647cd1d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4fadb2d700 1 -- 172.21.15.70:0/3071395140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd10750 msgr2=0x55647cd1b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd10750 0x55647cd1b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4fadb2d700 1 -- 172.21.15.70:0/3071395140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55647ca8ed90 con 0x55647cd0fe30 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4fad32c700 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd10750 0x55647cd1b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd10210 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4010e30 tx=0x7f4fa4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f27c03218e0e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4f93fff700 1 -- 172.21.15.70:0/3071395140 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa401e620 con 0x55647cd0fe30 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4f93fff700 1 -- 172.21.15.70:0/3071395140 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa4015070 con 0x55647cd0fe30 2023-10-08T08:43:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4f93fff700 1 -- 172.21.15.70:0/3071395140 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa401c9f0 con 0x55647cd0fe30 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3071395140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 msgr2=0x55647cd10210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.735+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd10210 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4010e30 tx=0x7f4fa4013000 comp rx=0 tx=0).stop 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3071395140 shutdown_connections 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd1b600 0x55647cd1d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd10210 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3071395140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd10750 0x55647cd1b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3071395140 >> 172.21.15.70:0/3071395140 conn(0x55647cc85210 msgr2=0x55647cd0c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3071395140 shutdown_connections 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3071395140 wait complete. 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 -- start start 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 Processor -- start 2023-10-08T08:43:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd1afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 0x55647cd18400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 0x55647cd18a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cc63de0 con 0x55647cd0fe30 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cc006c0 con 0x55647cd1b600 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.736+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cc00360 con 0x55647cd10750 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fbbf7ab80 10 client.0 _ll_register_callbacks cb 0x55647ca5d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fadb2d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd1afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fadb2d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd1afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50202/0 (socket says 172.21.15.70:50202) 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fadb2d700 1 -- 172.21.15.70:0/2225438696 learned_addr learned my addr 172.21.15.70:0/2225438696 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fad32c700 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 0x55647cd18400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fae32e700 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 0x55647cd18a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fadb2d700 1 -- 172.21.15.70:0/2225438696 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 msgr2=0x55647cd18400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 0x55647cd18400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fadb2d700 1 -- 172.21.15.70:0/2225438696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 msgr2=0x55647cd18a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 0x55647cd18a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fadb2d700 1 -- 172.21.15.70:0/2225438696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa4010ae0 con 0x55647cd0fe30 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd1afd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400b680 tx=0x7f4fa4010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c5fc825373d43c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4f917fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4f917fa700 1 -- 172.21.15.70:0/2225438696 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa402c070 con 0x55647cd0fe30 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/2225438696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55647cc2be60 con 0x55647cd0fe30 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4f917fa700 1 -- 172.21.15.70:0/2225438696 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4fa4017070 con 0x55647cd0fe30 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4f917fa700 1 -- 172.21.15.70:0/2225438696 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fa4004020 con 0x55647cd0fe30 2023-10-08T08:43:17.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fbbf7ab80 10 client.15351 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.737+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/2225438696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55647ca77c10 con 0x55647cd0fe30 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4f917fa700 1 -- 172.21.15.70:0/2225438696 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55647cc2be60 con 0x55647cd0fe30 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4f917fa700 1 -- 172.21.15.70:0/2225438696 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4fa4003840 con 0x55647cd0fe30 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4fbbf7ab80 10 client.15351 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4fbbf7ab80 10 client.15351 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4fbbf7ab80 20 client.15351 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55647cd2b060 0x55647cd29b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4fbbf7ab80 4 client.15351 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/2225438696 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55647cc5cdc0 con 0x55647cd2b060 2023-10-08T08:43:17.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4fad32c700 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55647cd2b060 0x55647cd29b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4f917fa700 10 client.15351 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.738+0000 7f4fad32c700 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55647cd2b060 0x55647cd29b80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e8e08b82384f9a96 server_cookie=e8c407bd18a3b487 in_seq=0 out_seq=0 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4f917fa700 1 -- 172.21.15.70:0/2225438696 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55647cc5cdc0 con 0x55647cd2b060 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4f917fa700 10 client.15351 handle_command_reply: tid=0 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 client.15351 shutdown 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/2225438696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 msgr2=0x55647cd1afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd1afd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400b680 tx=0x7f4fa4010f30 comp rx=0 tx=0).stop 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/2225438696 shutdown_connections 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 0x55647cd18a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55647cd2b060 0x55647cd29b80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd0fe30 0x55647cd1afd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/2225438696 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 0x55647cd18400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4f917fa700 0 client.15351 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:43:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/2225438696 >> 172.21.15.70:0/2225438696 conn(0x55647cc85210 msgr2=0x55647cd0be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.739+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/2225438696 shutdown_connections 2023-10-08T08:43:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.740+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/2225438696 wait complete. 2023-10-08T08:43:17.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.740+0000 7f4fbbf7ab80 20 client.15351 trim_cache size 0 max 16384 2023-10-08T08:43:17.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fbbf7ab80 1 Processor -- start 2023-10-08T08:43:17.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fbbf7ab80 1 -- start start 2023-10-08T08:43:17.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd0fe30 0x55647cd12e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd10750 0x55647cd1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 0x55647cd29b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cae48d0 con 0x55647cd10750 2023-10-08T08:43:17.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647caf0de0 con 0x55647cd1b600 2023-10-08T08:43:17.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cc22590 con 0x55647cd0fe30 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fad32c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd10750 0x55647cd1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fad32c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd10750 0x55647cd1ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50212/0 (socket says 172.21.15.70:50212) 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fad32c700 1 -- 172.21.15.70:0/1372927021 learned_addr learned my addr 172.21.15.70:0/1372927021 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fad32c700 1 -- 172.21.15.70:0/1372927021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd0fe30 msgr2=0x55647cd12e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd0fe30 0x55647cd12e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fae32e700 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 0x55647cd29b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fad32c700 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd0fe30 0x55647cd12e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fad32c700 1 -- 172.21.15.70:0/1372927021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 msgr2=0x55647cd29b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.757+0000 7f4fad32c700 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 0x55647cd29b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fad32c700 1 -- 172.21.15.70:0/1372927021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55647cab5200 con 0x55647cd10750 2023-10-08T08:43:17.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fae32e700 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 0x55647cd29b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fad32c700 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd10750 0x55647cd1ab00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4f98096a00 tx=0x7f4f980ca640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b13f00a279c029 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4f9cff9700 1 -- 172.21.15.70:0/1372927021 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980b8200 con 0x55647cd10750 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4f9cff9700 1 -- 172.21.15.70:0/1372927021 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f98022e30 con 0x55647cd10750 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4f9cff9700 1 -- 172.21.15.70:0/1372927021 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98099680 con 0x55647cd10750 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/1372927021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd10750 msgr2=0x55647cd1ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd10750 0x55647cd1ab00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4f98096a00 tx=0x7f4f980ca640 comp rx=0 tx=0).stop 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/1372927021 shutdown_connections 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd1b600 0x55647cd29b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd0fe30 0x55647cd12e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/1372927021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd10750 0x55647cd1ab00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/1372927021 >> 172.21.15.70:0/1372927021 conn(0x55647cc85210 msgr2=0x55647cd16d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/1372927021 shutdown_connections 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.758+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/1372927021 wait complete. 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.759+0000 7f4fbbf7ab80 1 -- start start 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.759+0000 7f4fbbf7ab80 1 Processor -- start 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.759+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd0fe30 0x55647cd14e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.759+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 0x55647cd15380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.759+0000 7f4fbbf7ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd1b600 0x55647cd158c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.759+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cd7ea50 con 0x55647cd1b600 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.759+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cd7eb90 con 0x55647cd0fe30 2023-10-08T08:43:17.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.759+0000 7f4fbbf7ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55647cd7ecd0 con 0x55647cd10750 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.759+0000 7f4fbbf7ab80 10 client.0 _ll_register_callbacks cb 0x7f4fa4010d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fae32e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd1b600 0x55647cd158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fae32e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd1b600 0x55647cd158c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50220/0 (socket says 172.21.15.70:50220) 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fae32e700 1 -- 172.21.15.70:0/3787591857 learned_addr learned my addr 172.21.15.70:0/3787591857 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd0fe30 0x55647cd14e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fad32c700 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 0x55647cd15380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fae32e700 1 -- 172.21.15.70:0/3787591857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 msgr2=0x55647cd15380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fae32e700 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 0x55647cd15380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fae32e700 1 -- 172.21.15.70:0/3787591857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd0fe30 msgr2=0x55647cd14e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fae32e700 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd0fe30 0x55647cd14e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fae32e700 1 -- 172.21.15.70:0/3787591857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa81a59a0 con 0x55647cd1b600 2023-10-08T08:43:17.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fae32e700 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd1b600 0x55647cd158c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0015000 tx=0x7f4fa0004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07037d04d0243e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4f917fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4f917fa700 1 -- 172.21.15.70:0/3787591857 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000e040 con 0x55647cd1b600 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4f917fa700 1 -- 172.21.15.70:0/3787591857 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4fa0023070 con 0x55647cd1b600 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3787591857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fa4015070 con 0x55647cd1b600 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4f917fa700 1 -- 172.21.15.70:0/3787591857 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fa00078f0 con 0x55647cd1b600 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fbbf7ab80 10 client.15357 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3787591857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55647ca8d260 con 0x55647cd1b600 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.760+0000 7f4f917fa700 1 -- 172.21.15.70:0/3787591857 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa4015070 con 0x55647cd1b600 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4f917fa700 1 -- 172.21.15.70:0/3787591857 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4fa000b0d0 con 0x55647cd1b600 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4fbbf7ab80 10 client.15357 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4fbbf7ab80 10 client.15357 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T08:43:17.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4fbbf7ab80 20 client.15357 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55647cd83ff0 0x55647cd80470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4fbbf7ab80 4 client.15357 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3787591857 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55647cc5cae0 con 0x55647cd83ff0 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55647cd83ff0 0x55647cd80470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4f917fa700 10 client.15357 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.761+0000 7f4fadb2d700 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55647cd83ff0 0x55647cd80470 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ccd5f9f034c371f9 server_cookie=6f4bca43746abc6b in_seq=0 out_seq=0 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4f917fa700 1 -- 172.21.15.70:0/3787591857 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55647cc5cae0 con 0x55647cd83ff0 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4f917fa700 10 client.15357 handle_command_reply: tid=0 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 client.15357 shutdown 2023-10-08T08:43:17.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3787591857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd1b600 msgr2=0x55647cd158c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd1b600 0x55647cd158c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0015000 tx=0x7f4fa0004dc0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3787591857 shutdown_connections 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55647cd83ff0 0x55647cd80470 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55647cd1b600 0x55647cd158c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55647cd0fe30 0x55647cd14e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 --2- 172.21.15.70:0/3787591857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55647cd10750 0x55647cd15380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4f917fa700 0 client.15357 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3787591857 >> 172.21.15.70:0/3787591857 conn(0x55647cc85210 msgr2=0x55647cd29b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3787591857 shutdown_connections 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 1 -- 172.21.15.70:0/3787591857 wait complete. 2023-10-08T08:43:17.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fbbf7ab80 20 client.15357 trim_cache size 0 max 16384 2023-10-08T08:43:17.772 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:17.772 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:17.772 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2023-10-08T08:43:17.772 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24577, 2023-10-08T08:43:17.772 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:17.772 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:17.772 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:17.772 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 49.521163512000001, 2023-10-08T08:43:17.772 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:17.773 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:17.773 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:17.773 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 96.265948956000003 2023-10-08T08:43:17.773 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 -- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4f940a14d0 msgr2=0x7f4f940a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4f940a14d0 0x7f4f940a3990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8077ab0 tx=0x7f4fa400b410 comp rx=0 tx=0).stop 2023-10-08T08:43:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 -- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 msgr2=0x7f4fa81017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 0x7f4fa81017f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800d980 tx=0x7f4f9800dc90 comp rx=0 tx=0).stop 2023-10-08T08:43:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 -- 172.21.15.70:0/1853290829 shutdown_connections 2023-10-08T08:43:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4f940a14d0 0x7f4f940a3990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa81056b0 0x7f4fa8101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fa80ff620 0x7f4fa81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 --2- 172.21.15.70:0/1853290829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fa80fffe0 0x7f4fa81017f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.762+0000 7f4fafd91700 1 -- 172.21.15.70:0/1853290829 >> 172.21.15.70:0/1853290829 conn(0x7f4fa8076780 msgr2=0x7f4fa8067b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.763+0000 7f4fafd91700 1 -- 172.21.15.70:0/1853290829 shutdown_connections 2023-10-08T08:43:17.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.763+0000 7f4fafd91700 1 -- 172.21.15.70:0/1853290829 wait complete. 2023-10-08T08:43:17.776 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:17 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4070244270' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:17.776 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:17 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4165199621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:17.776 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:17 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/236939723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:17.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T08:43:17.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:17 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4070244270' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:17.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:17 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4165199621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:17.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:17 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/236939723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:17.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.897+0000 7f71f7df7700 1 -- 172.21.15.70:0/605397934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 msgr2=0x7f71f0106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.897+0000 7f71f7df7700 1 --2- 172.21.15.70:0/605397934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 0x7f71f0106b60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009990 tx=0x7f71e0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.897+0000 7f71f7df7700 1 -- 172.21.15.70:0/605397934 shutdown_connections 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.897+0000 7f71f7df7700 1 --2- 172.21.15.70:0/605397934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0069410 0x7f71f010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.897+0000 7f71f7df7700 1 --2- 172.21.15.70:0/605397934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 0x7f71f0106b60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.897+0000 7f71f7df7700 1 --2- 172.21.15.70:0/605397934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71f0068a50 0x7f71f0068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.897+0000 7f71f7df7700 1 -- 172.21.15.70:0/605397934 >> 172.21.15.70:0/605397934 conn(0x7f71f00767c0 msgr2=0x7f71f0076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.897+0000 7f71f7df7700 1 -- 172.21.15.70:0/605397934 shutdown_connections 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.897+0000 7f71f7df7700 1 -- 172.21.15.70:0/605397934 wait complete. 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f7df7700 1 Processor -- start 2023-10-08T08:43:17.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f7df7700 1 -- start start 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f7df7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71f0068a50 0x7f71f0198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f7df7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0069410 0x7f71f0199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f7df7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 0x7f71f019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f7df7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f019dd50 con 0x7f71f0106780 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f7df7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f019dec0 con 0x7f71f0068a50 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f7df7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f019e080 con 0x7f71f0069410 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f6394700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 0x7f71f019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f6394700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 0x7f71f019d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50234/0 (socket says 172.21.15.70:50234) 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f6394700 1 -- 172.21.15.70:0/2573224108 learned_addr learned my addr 172.21.15.70:0/2573224108 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f5392700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0069410 0x7f71f0199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f5b93700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71f0068a50 0x7f71f0198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f6394700 1 -- 172.21.15.70:0/2573224108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0069410 msgr2=0x7f71f0199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f6394700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0069410 0x7f71f0199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f6394700 1 -- 172.21.15.70:0/2573224108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71f0068a50 msgr2=0x7f71f0198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f6394700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71f0068a50 0x7f71f0198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.898+0000 7f71f6394700 1 -- 172.21.15.70:0/2573224108 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00095f0 con 0x7f71f0106780 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.899+0000 7f71f6394700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 0x7f71f019d710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f71e8007ee0 tx=0x7f71e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.899+0000 7f71e6ffd700 1 -- 172.21.15.70:0/2573224108 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8017070 con 0x7f71f0106780 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.899+0000 7f71e6ffd700 1 -- 172.21.15.70:0/2573224108 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e800f040 con 0x7f71f0106780 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.899+0000 7f71f7df7700 1 -- 172.21.15.70:0/2573224108 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f019e360 con 0x7f71f0106780 2023-10-08T08:43:17.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.899+0000 7f71e6ffd700 1 -- 172.21.15.70:0/2573224108 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8005580 con 0x7f71f0106780 2023-10-08T08:43:17.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.899+0000 7f71f7df7700 1 -- 172.21.15.70:0/2573224108 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f01a5ba0 con 0x7f71f0106780 2023-10-08T08:43:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.901+0000 7f71e6ffd700 1 -- 172.21.15.70:0/2573224108 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f71e800db20 con 0x7f71f0106780 2023-10-08T08:43:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.902+0000 7f71e6ffd700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71dc0a14d0 0x7f71dc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.902+0000 7f71f5b93700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71dc0a14d0 0x7f71dc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.902+0000 7f71e6ffd700 1 -- 172.21.15.70:0/2573224108 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f71e80cc7f0 con 0x7f71f0106780 2023-10-08T08:43:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.902+0000 7f71f5b93700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71dc0a14d0 0x7f71dc0a3990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f71e000b5c0 tx=0x7f71e0005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.902+0000 7f7203fe0b80 1 Processor -- start 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f7203fe0b80 1 -- start start 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e46210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e46750 0x555ad6e510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e51600 0x555ad6e539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6daf410 con 0x555ad6e45e30 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6da0bd0 con 0x555ad6e51600 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6d9e4f0 con 0x555ad6e46750 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f5b93700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e46210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f5b93700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e46210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50238/0 (socket says 172.21.15.70:50238) 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f5b93700 1 -- 172.21.15.70:0/4210083635 learned_addr learned my addr 172.21.15.70:0/4210083635 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f5392700 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e46750 0x555ad6e510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f6394700 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e51600 0x555ad6e539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f5b93700 1 -- 172.21.15.70:0/4210083635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e46750 msgr2=0x555ad6e510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f5b93700 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e46750 0x555ad6e510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f5b93700 1 -- 172.21.15.70:0/4210083635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e51600 msgr2=0x555ad6e539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f5b93700 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e51600 0x555ad6e539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f5b93700 1 -- 172.21.15.70:0/4210083635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ad6bc4d90 con 0x555ad6e45e30 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.903+0000 7f71f6394700 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e51600 0x555ad6e539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f71f5b93700 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e46210 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009990 tx=0x7f71e001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3762ef75a6fb8d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f71dbfff700 1 -- 172.21.15.70:0/4210083635 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0029070 con 0x555ad6e45e30 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f71dbfff700 1 -- 172.21.15.70:0/4210083635 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e001e040 con 0x555ad6e45e30 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f71dbfff700 1 -- 172.21.15.70:0/4210083635 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e000f820 con 0x555ad6e45e30 2023-10-08T08:43:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f7203fe0b80 1 -- 172.21.15.70:0/4210083635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 msgr2=0x555ad6e46210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e46210 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009990 tx=0x7f71e001f000 comp rx=0 tx=0).stop 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f7203fe0b80 1 -- 172.21.15.70:0/4210083635 shutdown_connections 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e51600 0x555ad6e539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e46210 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/4210083635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e46750 0x555ad6e510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.904+0000 7f7203fe0b80 1 -- 172.21.15.70:0/4210083635 >> 172.21.15.70:0/4210083635 conn(0x555ad6dbb210 msgr2=0x555ad6e42280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 -- 172.21.15.70:0/4210083635 shutdown_connections 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 -- 172.21.15.70:0/4210083635 wait complete. 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 -- start start 2023-10-08T08:43:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 Processor -- start 2023-10-08T08:43:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e51010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e4e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6d99de0 con 0x555ad6e51600 2023-10-08T08:43:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6d366c0 con 0x555ad6e46750 2023-10-08T08:43:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6d36360 con 0x555ad6e45e30 2023-10-08T08:43:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.905+0000 7f7203fe0b80 10 client.0 _ll_register_callbacks cb 0x555ad6b937b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f5b93700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e51010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f6394700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f5b93700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e51010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:37822/0 (socket says 172.21.15.70:37822) 2023-10-08T08:43:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f6394700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50248/0 (socket says 172.21.15.70:50248) 2023-10-08T08:43:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f5b93700 1 -- 172.21.15.70:0/2583367894 learned_addr learned my addr 172.21.15.70:0/2583367894 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f5392700 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e4e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f6394700 1 -- 172.21.15.70:0/2583367894 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 msgr2=0x555ad6e51010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f6394700 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e51010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f6394700 1 -- 172.21.15.70:0/2583367894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 msgr2=0x555ad6e4e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f6394700 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e4e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f6394700 1 -- 172.21.15.70:0/2583367894 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f010dec0 con 0x555ad6e51600 2023-10-08T08:43:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f5392700 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e4e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f5b93700 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e51010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:43:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71f6394700 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4e8c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f71e80c9f50 tx=0x7f71e8099ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4174baafa7470ef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71d97fa700 1 -- 172.21.15.70:0/2583367894 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80b90c0 con 0x555ad6e51600 2023-10-08T08:43:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71d97fa700 1 -- 172.21.15.70:0/2583367894 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f71e80a1ab0 con 0x555ad6e51600 2023-10-08T08:43:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f7203fe0b80 1 -- 172.21.15.70:0/2583367894 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ad6d61e60 con 0x555ad6e51600 2023-10-08T08:43:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71d97fa700 1 -- 172.21.15.70:0/2583367894 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71e8004c40 con 0x555ad6e51600 2023-10-08T08:43:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f7203fe0b80 10 client.15369 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f7203fe0b80 1 -- 172.21.15.70:0/2583367894 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555ad6badc10 con 0x555ad6e51600 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.906+0000 7f71d97fa700 1 -- 172.21.15.70:0/2583367894 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555ad6d61e60 con 0x555ad6e51600 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f71d97fa700 1 -- 172.21.15.70:0/2583367894 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f71e8098c10 con 0x555ad6e51600 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f7203fe0b80 10 client.15369 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f7203fe0b80 10 client.15369 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f7203fe0b80 20 client.15369 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x555ad6e60fc0 0x555ad6e5fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f7203fe0b80 4 client.15369 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f7203fe0b80 1 -- 172.21.15.70:0/2583367894 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ad6d92dc0 con 0x555ad6e60fc0 2023-10-08T08:43:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f71f5b93700 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x555ad6e60fc0 0x555ad6e5fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f71f5b93700 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x555ad6e60fc0 0x555ad6e5fae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5ff7fd1724339855 server_cookie=5891e2d1413e2682 in_seq=0 out_seq=0 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.907+0000 7f71d97fa700 10 client.15369 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f71d97fa700 1 -- 172.21.15.70:0/2583367894 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555ad6d92dc0 con 0x555ad6e60fc0 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f71d97fa700 10 client.15369 handle_command_reply: tid=0 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f7203fe0b80 1 client.15369 shutdown 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f7203fe0b80 1 -- 172.21.15.70:0/2583367894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 msgr2=0x555ad6e4e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4e8c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f71e80c9f50 tx=0x7f71e8099ea0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f7203fe0b80 1 -- 172.21.15.70:0/2583367894 shutdown_connections 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4e8c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x555ad6e60fc0 0x555ad6e5fae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e51010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f71d97fa700 0 client.15369 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:43:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/2583367894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e4e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.908+0000 7f7203fe0b80 1 -- 172.21.15.70:0/2583367894 >> 172.21.15.70:0/2583367894 conn(0x555ad6dbb210 msgr2=0x555ad6e41e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.909+0000 7f7203fe0b80 1 -- 172.21.15.70:0/2583367894 shutdown_connections 2023-10-08T08:43:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.909+0000 7f7203fe0b80 1 -- 172.21.15.70:0/2583367894 wait complete. 2023-10-08T08:43:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.909+0000 7f7203fe0b80 20 client.15369 trim_cache size 0 max 16384 2023-10-08T08:43:17.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f7203fe0b80 1 Processor -- start 2023-10-08T08:43:17.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f7203fe0b80 1 -- start start 2023-10-08T08:43:17.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e48d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e5d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e51600 0x555ad6e601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6c1a8d0 con 0x555ad6e45e30 2023-10-08T08:43:17.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6d9b070 con 0x555ad6e46750 2023-10-08T08:43:17.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6d95ed0 con 0x555ad6e51600 2023-10-08T08:43:17.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f71f5b93700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e48d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f71f5b93700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e48d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50252/0 (socket says 172.21.15.70:50252) 2023-10-08T08:43:17.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f71f5b93700 1 -- 172.21.15.70:0/1202794024 learned_addr learned my addr 172.21.15.70:0/1202794024 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f71f6394700 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e51600 0x555ad6e601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f71f5392700 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e5d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.926+0000 7f71f5b93700 1 -- 172.21.15.70:0/1202794024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e51600 msgr2=0x555ad6e601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f71f5b93700 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e51600 0x555ad6e601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f71f5b93700 1 -- 172.21.15.70:0/1202794024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 msgr2=0x555ad6e5d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f71f5b93700 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e5d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f71f5b93700 1 -- 172.21.15.70:0/1202794024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ad6beb200 con 0x555ad6e45e30 2023-10-08T08:43:17.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f71f6394700 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e51600 0x555ad6e601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:17.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f71f5b93700 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e48d60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005040 tx=0x7f71e000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e8dc0045e54ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f71e4ff9700 1 -- 172.21.15.70:0/1202794024 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0029040 con 0x555ad6e45e30 2023-10-08T08:43:17.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f71e4ff9700 1 -- 172.21.15.70:0/1202794024 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e002a040 con 0x555ad6e45e30 2023-10-08T08:43:17.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f71e4ff9700 1 -- 172.21.15.70:0/1202794024 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e000f4d0 con 0x555ad6e45e30 2023-10-08T08:43:17.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f7203fe0b80 1 -- 172.21.15.70:0/1202794024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 msgr2=0x555ad6e48d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e48d60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005040 tx=0x7f71e000be00 comp rx=0 tx=0).stop 2023-10-08T08:43:17.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f7203fe0b80 1 -- 172.21.15.70:0/1202794024 shutdown_connections 2023-10-08T08:43:17.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e51600 0x555ad6e601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e45e30 0x555ad6e48d60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/1202794024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e5d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f7203fe0b80 1 -- 172.21.15.70:0/1202794024 >> 172.21.15.70:0/1202794024 conn(0x555ad6dbb210 msgr2=0x555ad6e5fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f7203fe0b80 1 -- 172.21.15.70:0/1202794024 shutdown_connections 2023-10-08T08:43:17.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.927+0000 7f7203fe0b80 1 -- 172.21.15.70:0/1202794024 wait complete. 2023-10-08T08:43:17.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f7203fe0b80 1 -- start start 2023-10-08T08:43:17.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f7203fe0b80 1 Processor -- start 2023-10-08T08:43:17.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e69940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e4a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f7203fe0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6e4b1a0 con 0x555ad6e51600 2023-10-08T08:43:17.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6e4b310 con 0x555ad6e46750 2023-10-08T08:43:17.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f7203fe0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ad6e4b4d0 con 0x555ad6e45e30 2023-10-08T08:43:17.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f7203fe0b80 10 client.0 _ll_register_callbacks cb 0x7f71e8099080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:17.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f71f6394700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f71f5b93700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e69940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f71f5b93700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e69940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:37836/0 (socket says 172.21.15.70:37836) 2023-10-08T08:43:17.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f71f6394700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50262/0 (socket says 172.21.15.70:50262) 2023-10-08T08:43:17.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f71f5b93700 1 -- 172.21.15.70:0/3805264934 learned_addr learned my addr 172.21.15.70:0/3805264934 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:17.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.928+0000 7f71f5392700 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e4a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71f6394700 1 -- 172.21.15.70:0/3805264934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 msgr2=0x555ad6e69940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71f6394700 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e69940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71f6394700 1 -- 172.21.15.70:0/3805264934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 msgr2=0x555ad6e4a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:17.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71f6394700 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e4a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71f6394700 1 -- 172.21.15.70:0/3805264934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ad6bc4d90 con 0x555ad6e51600 2023-10-08T08:43:17.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71f5b93700 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e69940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:43:17.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71f6394700 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4ac60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f71e80ca270 tx=0x7f71e8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9886fdbd2b5c5b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:17.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:17.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71d97fa700 1 -- 172.21.15.70:0/3805264934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80a16c0 con 0x555ad6e51600 2023-10-08T08:43:17.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f7203fe0b80 1 -- 172.21.15.70:0/3805264934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71e001e040 con 0x555ad6e51600 2023-10-08T08:43:17.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71d97fa700 1 -- 172.21.15.70:0/3805264934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f71e80b90b0 con 0x555ad6e51600 2023-10-08T08:43:17.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71d97fa700 1 -- 172.21.15.70:0/3805264934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71e80994f0 con 0x555ad6e51600 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f7203fe0b80 10 client.15375 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f7203fe0b80 1 -- 172.21.15.70:0/3805264934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555ad6bc3260 con 0x555ad6e51600 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71d97fa700 1 -- 172.21.15.70:0/3805264934 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e001e040 con 0x555ad6e51600 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f71d97fa700 1 -- 172.21.15.70:0/3805264934 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f71e8099980 con 0x555ad6e51600 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f7203fe0b80 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f7203fe0b80 10 client.15375 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f7203fe0b80 20 client.15375 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x555ad6eb9520 0x555ad6eb5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f7203fe0b80 4 client.15375 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.929+0000 7f7203fe0b80 1 -- 172.21.15.70:0/3805264934 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555ad6d92ae0 con 0x555ad6eb9520 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.930+0000 7f71f5b93700 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x555ad6eb9520 0x555ad6eb5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.930+0000 7f71d97fa700 10 client.15375 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.930+0000 7f71f5b93700 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x555ad6eb9520 0x555ad6eb5a50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f1e8d7a413ab0bae server_cookie=502c619062c27e1b in_seq=0 out_seq=0 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.930+0000 7f71d97fa700 1 -- 172.21.15.70:0/3805264934 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x555ad6d92ae0 con 0x555ad6eb9520 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.930+0000 7f71d97fa700 10 client.15375 handle_command_reply: tid=0 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.930+0000 7f7203fe0b80 1 client.15375 shutdown 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.930+0000 7f7203fe0b80 1 -- 172.21.15.70:0/3805264934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 msgr2=0x555ad6e4ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4ac60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f71e80ca270 tx=0x7f71e8005020 comp rx=0 tx=0).stop 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 1 -- 172.21.15.70:0/3805264934 shutdown_connections 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad6e51600 0x555ad6e4ac60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x555ad6eb9520 0x555ad6eb5a50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555ad6e45e30 0x555ad6e69940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 1 --2- 172.21.15.70:0/3805264934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555ad6e46750 0x555ad6e4a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71d97fa700 0 client.15375 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:43:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 1 -- 172.21.15.70:0/3805264934 >> 172.21.15.70:0/3805264934 conn(0x555ad6dbb210 msgr2=0x555ad6e4d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 1 -- 172.21.15.70:0/3805264934 shutdown_connections 2023-10-08T08:43:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 1 -- 172.21.15.70:0/3805264934 wait complete. 2023-10-08T08:43:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f7203fe0b80 20 client.15375 trim_cache size 0 max 16384 2023-10-08T08:43:17.942 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24589, 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 50.695625436, 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 94.247998468999995 2023-10-08T08:43:17.943 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 -- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71dc0a14d0 msgr2=0x7f71dc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71dc0a14d0 0x7f71dc0a3990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f71e000b5c0 tx=0x7f71e0005960 comp rx=0 tx=0).stop 2023-10-08T08:43:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 -- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 msgr2=0x7f71f019d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 0x7f71f019d710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f71e8007ee0 tx=0x7f71e800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 -- 172.21.15.70:0/2573224108 shutdown_connections 2023-10-08T08:43:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71dc0a14d0 0x7f71dc0a3990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71f0106780 0x7f71f019d710 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71f0068a50 0x7f71f0198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 --2- 172.21.15.70:0/2573224108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f0069410 0x7f71f0199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 -- 172.21.15.70:0/2573224108 >> 172.21.15.70:0/2573224108 conn(0x7f71f00767c0 msgr2=0x7f71f010b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 -- 172.21.15.70:0/2573224108 shutdown_connections 2023-10-08T08:43:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:17.931+0000 7f71f7df7700 1 -- 172.21.15.70:0/2573224108 wait complete. 2023-10-08T08:43:17.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T08:43:18.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.068+0000 7f721759e700 1 -- 172.21.15.70:0/1642333800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ff460 msgr2=0x7f72180ff8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.068+0000 7f721759e700 1 --2- 172.21.15.70:0/1642333800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ff460 0x7f72180ff8e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7208009990 tx=0x7f7208009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.068+0000 7f721759e700 1 -- 172.21.15.70:0/1642333800 shutdown_connections 2023-10-08T08:43:18.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.068+0000 7f721759e700 1 --2- 172.21.15.70:0/1642333800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72180ffe20 0x7f721810c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.068+0000 7f721759e700 1 --2- 172.21.15.70:0/1642333800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7218105500 0x7f72181058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.068+0000 7f721759e700 1 --2- 172.21.15.70:0/1642333800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ff460 0x7f72180ff8e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.068+0000 7f721759e700 1 -- 172.21.15.70:0/1642333800 >> 172.21.15.70:0/1642333800 conn(0x7f72180faf50 msgr2=0x7f72180fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.068+0000 7f721759e700 1 -- 172.21.15.70:0/1642333800 shutdown_connections 2023-10-08T08:43:18.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.068+0000 7f721759e700 1 -- 172.21.15.70:0/1642333800 wait complete. 2023-10-08T08:43:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f721759e700 1 Processor -- start 2023-10-08T08:43:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f721759e700 1 -- start start 2023-10-08T08:43:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f721759e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72180ff460 0x7f721819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f721759e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ffe20 0x7f721819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f721759e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7218105500 0x7f72181967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f721759e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218196e40 con 0x7f72180ffe20 2023-10-08T08:43:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f721759e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218196fb0 con 0x7f7218105500 2023-10-08T08:43:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f721759e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218197170 con 0x7f72180ff460 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f7215d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ffe20 0x7f721819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f7215d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ffe20 0x7f721819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50274/0 (socket says 172.21.15.70:50274) 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f7215d9b700 1 -- 172.21.15.70:0/2591921865 learned_addr learned my addr 172.21.15.70:0/2591921865 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f721659c700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72180ff460 0x7f721819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f7216d9d700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7218105500 0x7f72181967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f7215d9b700 1 -- 172.21.15.70:0/2591921865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72180ff460 msgr2=0x7f721819c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f7215d9b700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72180ff460 0x7f721819c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f7215d9b700 1 -- 172.21.15.70:0/2591921865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7218105500 msgr2=0x7f72181967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f7215d9b700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7218105500 0x7f72181967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.069+0000 7f7215d9b700 1 -- 172.21.15.70:0/2591921865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72080095f0 con 0x7f72180ffe20 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.070+0000 7f7215d9b700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ffe20 0x7f721819cbe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7208000c00 tx=0x7f7208004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.070+0000 7f72077fe700 1 -- 172.21.15.70:0/2591921865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720801d070 con 0x7f72180ffe20 2023-10-08T08:43:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.070+0000 7f72077fe700 1 -- 172.21.15.70:0/2591921865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7208022470 con 0x7f72180ffe20 2023-10-08T08:43:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.070+0000 7f721759e700 1 -- 172.21.15.70:0/2591921865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72181973f0 con 0x7f72180ffe20 2023-10-08T08:43:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.070+0000 7f72077fe700 1 -- 172.21.15.70:0/2591921865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208017650 con 0x7f72180ffe20 2023-10-08T08:43:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.070+0000 7f721759e700 1 -- 172.21.15.70:0/2591921865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72181a3690 con 0x7f72180ffe20 2023-10-08T08:43:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.072+0000 7f72077fe700 1 -- 172.21.15.70:0/2591921865 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f72080225e0 con 0x7f72180ffe20 2023-10-08T08:43:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.072+0000 7f72077fe700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72000a14d0 0x7f72000a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.072+0000 7f721659c700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72000a14d0 0x7f72000a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.072+0000 7f72077fe700 1 -- 172.21.15.70:0/2591921865 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f72080ce3b0 con 0x7f72180ffe20 2023-10-08T08:43:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.073+0000 7f721659c700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72000a14d0 0x7f72000a3990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f720c009be0 tx=0x7f720c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.073+0000 7f7228bedb80 1 Processor -- start 2023-10-08T08:43:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.073+0000 7f7228bedb80 1 -- start start 2023-10-08T08:43:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 0x55bf88c913e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c9c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7228bedb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88bfa410 con 0x55bf88c91920 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7228bedb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88bebbd0 con 0x55bf88c91000 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7228bedb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88be94f0 con 0x55bf88c9c7b0 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7215d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c9c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7215d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c9c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50282/0 (socket says 172.21.15.70:50282) 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7215d9b700 1 -- 172.21.15.70:0/3291279724 learned_addr learned my addr 172.21.15.70:0/3291279724 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7216d9d700 1 --2- 172.21.15.70:0/3291279724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f721659c700 1 --2- 172.21.15.70:0/3291279724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 0x55bf88c913e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7215d9b700 1 -- 172.21.15.70:0/3291279724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 msgr2=0x55bf88c9eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7215d9b700 1 --2- 172.21.15.70:0/3291279724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7215d9b700 1 -- 172.21.15.70:0/3291279724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 msgr2=0x55bf88c913e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7215d9b700 1 --2- 172.21.15.70:0/3291279724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 0x55bf88c913e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7215d9b700 1 -- 172.21.15.70:0/3291279724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf88a0fd90 con 0x55bf88c91920 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7215d9b700 1 --2- 172.21.15.70:0/3291279724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c9c270 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7208097870 tx=0x7f7208022c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7581504723ef90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7204ff9700 1 -- 172.21.15.70:0/3291279724 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720809ba70 con 0x55bf88c91920 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7204ff9700 1 -- 172.21.15.70:0/3291279724 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f720809b370 con 0x55bf88c91920 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.074+0000 7f7204ff9700 1 -- 172.21.15.70:0/3291279724 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72080997a0 con 0x55bf88c91920 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 -- 172.21.15.70:0/3291279724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 msgr2=0x55bf88c9c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3291279724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c9c270 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7208097870 tx=0x7f7208022c80 comp rx=0 tx=0).stop 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 -- 172.21.15.70:0/3291279724 shutdown_connections 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3291279724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3291279724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 0x55bf88c913e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3291279724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c9c270 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 -- 172.21.15.70:0/3291279724 >> 172.21.15.70:0/3291279724 conn(0x55bf88c06210 msgr2=0x55bf88c8d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 -- 172.21.15.70:0/3291279724 shutdown_connections 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 -- 172.21.15.70:0/3291279724 wait complete. 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.075+0000 7f7228bedb80 1 -- start start 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7228bedb80 1 Processor -- start 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91000 0x55bf88c9cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91920 0x55bf88c9d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c9c7b0 0x55bf88ca7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7228bedb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88be4de0 con 0x55bf88c91000 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7228bedb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88b816c0 con 0x55bf88c9c7b0 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7228bedb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88b81360 con 0x55bf88c91920 2023-10-08T08:43:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7228bedb80 10 client.0 _ll_register_callbacks cb 0x55bf889de7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f721659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91000 0x55bf88c9cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f721659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91000 0x55bf88c9cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50286/0 (socket says 172.21.15.70:50286) 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f721659c700 1 -- 172.21.15.70:0/3813478679 learned_addr learned my addr 172.21.15.70:0/3813478679 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7215d9b700 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91920 0x55bf88c9d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f7216d9d700 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c9c7b0 0x55bf88ca7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f721659c700 1 -- 172.21.15.70:0/3813478679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91920 msgr2=0x55bf88c9d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f721659c700 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91920 0x55bf88c9d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f721659c700 1 -- 172.21.15.70:0/3813478679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c9c7b0 msgr2=0x55bf88ca7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f721659c700 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c9c7b0 0x55bf88ca7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f721659c700 1 -- 172.21.15.70:0/3813478679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72181a3690 con 0x55bf88c91000 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f721659c700 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91000 0x55bf88c9cb90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f720c0046e0 tx=0x7f720c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1aa1f076934ba9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.076+0000 7f71fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f71fdffb700 1 -- 172.21.15.70:0/3813478679 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c01d780 con 0x55bf88c91000 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f71fdffb700 1 -- 172.21.15.70:0/3813478679 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f720c01d8e0 con 0x55bf88c91000 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7228bedb80 1 -- 172.21.15.70:0/3813478679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf88bace60 con 0x55bf88c91000 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f71fdffb700 1 -- 172.21.15.70:0/3813478679 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f720c01daa0 con 0x55bf88c91000 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7228bedb80 10 client.15387 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7228bedb80 1 -- 172.21.15.70:0/3813478679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bf889f8c10 con 0x55bf88c91000 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f71fdffb700 1 -- 172.21.15.70:0/3813478679 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bf88bace60 con 0x55bf88c91000 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f71fdffb700 1 -- 172.21.15.70:0/3813478679 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f720c027ca0 con 0x55bf88c91000 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7228bedb80 10 client.15387 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7228bedb80 10 client.15387 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7228bedb80 20 client.15387 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55bf88cac0e0 0x55bf88caab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7228bedb80 4 client.15387 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7228bedb80 1 -- 172.21.15.70:0/3813478679 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf88bdddc0 con 0x55bf88cac0e0 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.077+0000 7f7215d9b700 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55bf88cac0e0 0x55bf88caab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.078+0000 7f7215d9b700 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55bf88cac0e0 0x55bf88caab90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d78d7283b08013c0 server_cookie=b441c968451777cc in_seq=0 out_seq=0 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.078+0000 7f71fdffb700 10 client.15387 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f71fdffb700 1 -- 172.21.15.70:0/3813478679 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bf88bdddc0 con 0x55bf88cac0e0 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f71fdffb700 10 client.15387 handle_command_reply: tid=0 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 client.15387 shutdown 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 -- 172.21.15.70:0/3813478679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91000 msgr2=0x55bf88c9cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91000 0x55bf88c9cb90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f720c0046e0 tx=0x7f720c0047c0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 -- 172.21.15.70:0/3813478679 shutdown_connections 2023-10-08T08:43:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55bf88cac0e0 0x55bf88caab90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c9c7b0 0x55bf88ca7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f71fdffb700 0 client.15387 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:43:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91000 0x55bf88c9cb90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 --2- 172.21.15.70:0/3813478679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91920 0x55bf88c9d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 -- 172.21.15.70:0/3813478679 >> 172.21.15.70:0/3813478679 conn(0x55bf88c06210 msgr2=0x55bf88c93050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 -- 172.21.15.70:0/3813478679 shutdown_connections 2023-10-08T08:43:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 1 -- 172.21.15.70:0/3813478679 wait complete. 2023-10-08T08:43:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.079+0000 7f7228bedb80 20 client.15387 trim_cache size 0 max 16384 2023-10-08T08:43:18.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.096+0000 7f7228bedb80 1 Processor -- start 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7228bedb80 1 -- start start 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91000 0x55bf88ca7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91920 0x55bf88ca7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7228bedb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88a658d0 con 0x55bf88c9c7b0 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7228bedb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88ca96d0 con 0x55bf88c91920 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7228bedb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88be6070 con 0x55bf88c91000 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7216d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7216d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50298/0 (socket says 172.21.15.70:50298) 2023-10-08T08:43:18.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7216d9d700 1 -- 172.21.15.70:0/1309899554 learned_addr learned my addr 172.21.15.70:0/1309899554 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f721659c700 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91000 0x55bf88ca7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7215d9b700 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91920 0x55bf88ca7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7216d9d700 1 -- 172.21.15.70:0/1309899554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91000 msgr2=0x55bf88ca7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7216d9d700 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91000 0x55bf88ca7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7216d9d700 1 -- 172.21.15.70:0/1309899554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91920 msgr2=0x55bf88ca7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7216d9d700 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91920 0x55bf88ca7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7216d9d700 1 -- 172.21.15.70:0/1309899554 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf88a36200 con 0x55bf88c9c7b0 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7215d9b700 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91920 0x55bf88ca7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f7216d9d700 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9a2e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7210009b80 tx=0x7f7210009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a67f80d55fdffbc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f72057fa700 1 -- 172.21.15.70:0/1309899554 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210003a00 con 0x55bf88c9c7b0 2023-10-08T08:43:18.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f72057fa700 1 -- 172.21.15.70:0/1309899554 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7210007dd0 con 0x55bf88c9c7b0 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.097+0000 7f72057fa700 1 -- 172.21.15.70:0/1309899554 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210004800 con 0x55bf88c9c7b0 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 -- 172.21.15.70:0/1309899554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c9c7b0 msgr2=0x55bf88c9a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9a2e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7210009b80 tx=0x7f7210009040 comp rx=0 tx=0).stop 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 -- 172.21.15.70:0/1309899554 shutdown_connections 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c9c7b0 0x55bf88c9a2e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c91000 0x55bf88ca7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 --2- 172.21.15.70:0/1309899554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91920 0x55bf88ca7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 -- 172.21.15.70:0/1309899554 >> 172.21.15.70:0/1309899554 conn(0x55bf88c06210 msgr2=0x55bf88c96d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 -- 172.21.15.70:0/1309899554 shutdown_connections 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 -- 172.21.15.70:0/1309899554 wait complete. 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 -- start start 2023-10-08T08:43:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.098+0000 7f7228bedb80 1 Processor -- start 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 0x55bf88c86b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c98c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 0x55bf88c991d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88c998a0 con 0x55bf88c91920 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88c99a10 con 0x55bf88c91000 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88cf9db0 con 0x55bf88c9c7b0 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 10 client.0 _ll_register_callbacks cb 0x55bf889de7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7215d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c98c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7215d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c98c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50302/0 (socket says 172.21.15.70:50302) 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7215d9b700 1 -- 172.21.15.70:0/739464954 learned_addr learned my addr 172.21.15.70:0/739464954 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7216d9d700 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 0x55bf88c991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f721659c700 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 0x55bf88c86b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7215d9b700 1 -- 172.21.15.70:0/739464954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 msgr2=0x55bf88c991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7215d9b700 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 0x55bf88c991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7215d9b700 1 -- 172.21.15.70:0/739464954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 msgr2=0x55bf88c86b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7215d9b700 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 0x55bf88c86b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7215d9b700 1 -- 172.21.15.70:0/739464954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7210011040 con 0x55bf88c91920 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7215d9b700 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c98c90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f720809b070 tx=0x7f720809acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7472a121d198b985 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f71fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f71fdffb700 1 -- 172.21.15.70:0/739464954 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72080ce170 con 0x55bf88c91920 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f71fdffb700 1 -- 172.21.15.70:0/739464954 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f72080a3670 con 0x55bf88c91920 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 1 -- 172.21.15.70:0/739464954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f720809b370 con 0x55bf88c91920 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f71fdffb700 1 -- 172.21.15.70:0/739464954 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f720809f120 con 0x55bf88c91920 2023-10-08T08:43:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 10 client.15393 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.099+0000 7f7228bedb80 1 -- 172.21.15.70:0/739464954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bf88a0e260 con 0x55bf88c91920 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f71fdffb700 1 -- 172.21.15.70:0/739464954 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f720809b370 con 0x55bf88c91920 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f71fdffb700 1 -- 172.21.15.70:0/739464954 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f720809a980 con 0x55bf88c91920 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f7228bedb80 10 client.15393 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f7228bedb80 10 client.15393 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f7228bedb80 20 client.15393 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f7228bedb80 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55bf88d08d20 0x55bf88d051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f7228bedb80 4 client.15393 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f7228bedb80 1 -- 172.21.15.70:0/739464954 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bf88bddae0 con 0x55bf88d08d20 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f721659c700 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55bf88d08d20 0x55bf88d051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f71fdffb700 10 client.15393 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:43:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.100+0000 7f721659c700 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55bf88d08d20 0x55bf88d051a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f86670613922319e server_cookie=b3dc237da3ce4075 in_seq=0 out_seq=0 2023-10-08T08:43:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f71fdffb700 1 -- 172.21.15.70:0/739464954 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55bf88bddae0 con 0x55bf88d08d20 2023-10-08T08:43:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f71fdffb700 10 client.15393 handle_command_reply: tid=0 2023-10-08T08:43:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 client.15393 shutdown 2023-10-08T08:43:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 -- 172.21.15.70:0/739464954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 msgr2=0x55bf88c98c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c98c90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f720809b070 tx=0x7f720809acd0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 -- 172.21.15.70:0/739464954 shutdown_connections 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55bf88d08d20 0x55bf88d051a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bf88c9c7b0 0x55bf88c991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bf88c91000 0x55bf88c86b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f71fdffb700 0 client.15393 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 --2- 172.21.15.70:0/739464954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf88c91920 0x55bf88c98c90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 -- 172.21.15.70:0/739464954 >> 172.21.15.70:0/739464954 conn(0x55bf88c06210 msgr2=0x55bf88c96d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 -- 172.21.15.70:0/739464954 shutdown_connections 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 1 -- 172.21.15.70:0/739464954 wait complete. 2023-10-08T08:43:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.101+0000 7f7228bedb80 20 client.15393 trim_cache size 0 max 16384 2023-10-08T08:43:18.110 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2023-10-08T08:43:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24604, 2023-10-08T08:43:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 51.871651151999998, 2023-10-08T08:43:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 89.922270077999997 2023-10-08T08:43:18.111 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 -- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72000a14d0 msgr2=0x7f72000a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72000a14d0 0x7f72000a3990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f720c009be0 tx=0x7f720c009260 comp rx=0 tx=0).stop 2023-10-08T08:43:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 -- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ffe20 msgr2=0x7f721819cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ffe20 0x7f721819cbe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7208000c00 tx=0x7f7208004730 comp rx=0 tx=0).stop 2023-10-08T08:43:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 -- 172.21.15.70:0/2591921865 shutdown_connections 2023-10-08T08:43:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f72000a14d0 0x7f72000a3990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7218105500 0x7f72181967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72180ff460 0x7f721819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 --2- 172.21.15.70:0/2591921865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72180ffe20 0x7f721819cbe0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 -- 172.21.15.70:0/2591921865 >> 172.21.15.70:0/2591921865 conn(0x7f72180faf50 msgr2=0x7f7218067b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 -- 172.21.15.70:0/2591921865 shutdown_connections 2023-10-08T08:43:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.102+0000 7f721759e700 1 -- 172.21.15.70:0/2591921865 wait complete. 2023-10-08T08:43:18.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-08T08:43:18.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.236+0000 7f5114771700 1 -- 172.21.15.70:0/1158484045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 msgr2=0x7f510c106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.236+0000 7f5114771700 1 --2- 172.21.15.70:0/1158484045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 0x7f510c106b30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009990 tx=0x7f50fc009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.236+0000 7f5114771700 1 -- 172.21.15.70:0/1158484045 shutdown_connections 2023-10-08T08:43:18.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.236+0000 7f5114771700 1 --2- 172.21.15.70:0/1158484045 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f510c101100 0x7f510c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.236+0000 7f5114771700 1 --2- 172.21.15.70:0/1158484045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 0x7f510c106b30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.236+0000 7f5114771700 1 --2- 172.21.15.70:0/1158484045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f510c100740 0x7f510c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.236+0000 7f5114771700 1 -- 172.21.15.70:0/1158484045 >> 172.21.15.70:0/1158484045 conn(0x7f510c0fc230 msgr2=0x7f510c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.236+0000 7f5114771700 1 -- 172.21.15.70:0/1158484045 shutdown_connections 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.236+0000 7f5114771700 1 -- 172.21.15.70:0/1158484045 wait complete. 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5114771700 1 Processor -- start 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5114771700 1 -- start start 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5114771700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f510c100740 0x7f510c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5114771700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f510c101100 0x7f510c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5114771700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 0x7f510c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5114771700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c19dca0 con 0x7f510c106750 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5114771700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c19de10 con 0x7f510c100740 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5114771700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c19dfd0 con 0x7f510c101100 2023-10-08T08:43:18.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5112d0e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 0x7f510c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5112d0e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 0x7f510c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50318/0 (socket says 172.21.15.70:50318) 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f5112d0e700 1 -- 172.21.15.70:0/1077083012 learned_addr learned my addr 172.21.15.70:0/1077083012 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.237+0000 7f511250d700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f510c100740 0x7f510c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f5111d0c700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f510c101100 0x7f510c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f5112d0e700 1 -- 172.21.15.70:0/1077083012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f510c101100 msgr2=0x7f510c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f5112d0e700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f510c101100 0x7f510c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f5112d0e700 1 -- 172.21.15.70:0/1077083012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f510c100740 msgr2=0x7f510c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f5112d0e700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f510c100740 0x7f510c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f5112d0e700 1 -- 172.21.15.70:0/1077083012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0095f0 con 0x7f510c106750 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f5112d0e700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 0x7f510c19d660 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f510400ada0 tx=0x7f510400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f51037fe700 1 -- 172.21.15.70:0/1077083012 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400f070 con 0x7f510c106750 2023-10-08T08:43:18.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f51037fe700 1 -- 172.21.15.70:0/1077083012 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5104007b30 con 0x7f510c106750 2023-10-08T08:43:18.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f5114771700 1 -- 172.21.15.70:0/1077083012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c19e2b0 con 0x7f510c106750 2023-10-08T08:43:18.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f51037fe700 1 -- 172.21.15.70:0/1077083012 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040053e0 con 0x7f510c106750 2023-10-08T08:43:18.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.238+0000 7f5114771700 1 -- 172.21.15.70:0/1077083012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c1a5af0 con 0x7f510c106750 2023-10-08T08:43:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.241+0000 7f51037fe700 1 -- 172.21.15.70:0/1077083012 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f510400c980 con 0x7f510c106750 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.241+0000 7f51037fe700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50f80a14d0 0x7f50f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.241+0000 7f511250d700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50f80a14d0 0x7f50f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.241+0000 7f51037fe700 1 -- 172.21.15.70:0/1077083012 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f51040cc6c0 con 0x7f510c106750 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f511250d700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50f80a14d0 0x7f50f80a3990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b5c0 tx=0x7f50fc005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f512095ab80 1 Processor -- start 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f512095ab80 1 -- start start 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f512095ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc18d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f512095ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f512095ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f512095ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc0f6410 con 0x559cfc18d750 2023-10-08T08:43:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f512095ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc0e7bd0 con 0x559cfc18ce30 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f512095ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc0e54f0 con 0x559cfc198600 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f5111d0c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f5111d0c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50324/0 (socket says 172.21.15.70:50324) 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f5111d0c700 1 -- 172.21.15.70:0/1682419826 learned_addr learned my addr 172.21.15.70:0/1682419826 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f511250d700 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc18d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f5112d0e700 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.242+0000 7f5111d0c700 1 -- 172.21.15.70:0/1682419826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 msgr2=0x559cfc19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f5111d0c700 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f5111d0c700 1 -- 172.21.15.70:0/1682419826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 msgr2=0x559cfc18d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f5111d0c700 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc18d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f5111d0c700 1 -- 172.21.15.70:0/1682419826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cfbf0bd90 con 0x559cfc18d750 2023-10-08T08:43:18.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f511250d700 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc18d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f5112d0e700 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f5111d0c700 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1980c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f510800dc40 tx=0x7f510800df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6327d3700e8553 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f5100ff9700 1 -- 172.21.15.70:0/1682419826 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510800fc20 con 0x559cfc18d750 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f5100ff9700 1 -- 172.21.15.70:0/1682419826 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f510800fd80 con 0x559cfc18d750 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.243+0000 7f5100ff9700 1 -- 172.21.15.70:0/1682419826 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108011440 con 0x559cfc18d750 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 -- 172.21.15.70:0/1682419826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 msgr2=0x559cfc1980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1980c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f510800dc40 tx=0x7f510800df50 comp rx=0 tx=0).stop 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 -- 172.21.15.70:0/1682419826 shutdown_connections 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc18d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 --2- 172.21.15.70:0/1682419826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1980c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 -- 172.21.15.70:0/1682419826 >> 172.21.15.70:0/1682419826 conn(0x559cfc102210 msgr2=0x559cfc189280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 -- 172.21.15.70:0/1682419826 shutdown_connections 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 -- 172.21.15.70:0/1682419826 wait complete. 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 -- start start 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 Processor -- start 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc197f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18d750 0x559cfc195250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc195830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc0e0de0 con 0x559cfc18ce30 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc07d6c0 con 0x559cfc18d750 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc07d360 con 0x559cfc198600 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f512095ab80 10 client.0 _ll_register_callbacks cb 0x559cfbeda7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f511250d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.244+0000 7f511250d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50328/0 (socket says 172.21.15.70:50328) 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f511250d700 1 -- 172.21.15.70:0/388331826 learned_addr learned my addr 172.21.15.70:0/388331826 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f5111d0c700 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18d750 0x559cfc195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f511250d700 1 -- 172.21.15.70:0/388331826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 msgr2=0x559cfc195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f5112d0e700 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f511250d700 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f511250d700 1 -- 172.21.15.70:0/388331826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18d750 msgr2=0x559cfc195250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f511250d700 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18d750 0x559cfc195250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f511250d700 1 -- 172.21.15.70:0/388331826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510800d8a0 con 0x559cfc18ce30 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f5111d0c700 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18d750 0x559cfc195250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f5112d0e700 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f511250d700 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc197f60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009990 tx=0x7f50fc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6348455dae64939c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f50f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f50f5ffb700 1 -- 172.21.15.70:0/388331826 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00f660 con 0x559cfc18ce30 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f50f5ffb700 1 -- 172.21.15.70:0/388331826 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f50fc00f7c0 con 0x559cfc18ce30 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f512095ab80 1 -- 172.21.15.70:0/388331826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559cfc0a8e60 con 0x559cfc18ce30 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f50f5ffb700 1 -- 172.21.15.70:0/388331826 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50fc00f980 con 0x559cfc18ce30 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f512095ab80 10 client.15405 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f512095ab80 1 -- 172.21.15.70:0/388331826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559cfbef4c10 con 0x559cfc18ce30 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.245+0000 7f50f5ffb700 1 -- 172.21.15.70:0/388331826 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559cfc0a8e60 con 0x559cfc18ce30 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f50f5ffb700 1 -- 172.21.15.70:0/388331826 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f50fc02db70 con 0x559cfc18ce30 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f512095ab80 10 client.15405 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f512095ab80 10 client.15405 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f512095ab80 20 client.15405 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f512095ab80 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x559cfc1a8130 0x559cfc1a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f512095ab80 4 client.15405 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f512095ab80 1 -- 172.21.15.70:0/388331826 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559cfc0d9dc0 con 0x559cfc1a8130 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f5111d0c700 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x559cfc1a8130 0x559cfc1a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f50f5ffb700 10 client.15405 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.246+0000 7f5111d0c700 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x559cfc1a8130 0x559cfc1a6bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ad373d87568a9d8 server_cookie=a7ad080c032530a7 in_seq=0 out_seq=0 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f50f5ffb700 1 -- 172.21.15.70:0/388331826 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559cfc0d9dc0 con 0x559cfc1a8130 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f50f5ffb700 10 client.15405 handle_command_reply: tid=0 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f512095ab80 1 client.15405 shutdown 2023-10-08T08:43:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f512095ab80 1 -- 172.21.15.70:0/388331826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 msgr2=0x559cfc197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f512095ab80 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc197f60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009990 tx=0x7f50fc009310 comp rx=0 tx=0).stop 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f512095ab80 1 -- 172.21.15.70:0/388331826 shutdown_connections 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f512095ab80 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x559cfc1a8130 0x559cfc1a6bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f512095ab80 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f512095ab80 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc197f60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f512095ab80 1 --2- 172.21.15.70:0/388331826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18d750 0x559cfc195250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f50f5ffb700 0 client.15405 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.247+0000 7f512095ab80 1 -- 172.21.15.70:0/388331826 >> 172.21.15.70:0/388331826 conn(0x559cfc102210 msgr2=0x559cfc188e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.248+0000 7f512095ab80 1 -- 172.21.15.70:0/388331826 shutdown_connections 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.248+0000 7f512095ab80 1 -- 172.21.15.70:0/388331826 wait complete. 2023-10-08T08:43:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.248+0000 7f512095ab80 20 client.15405 trim_cache size 0 max 16384 2023-10-08T08:43:18.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f512095ab80 1 Processor -- start 2023-10-08T08:43:18.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f512095ab80 1 -- start start 2023-10-08T08:43:18.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f512095ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc1a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f512095ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f512095ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc1a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f512095ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfbf618d0 con 0x559cfc18d750 2023-10-08T08:43:18.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f512095ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc0dced0 con 0x559cfc18ce30 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f512095ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc0874d0 con 0x559cfc198600 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5111d0c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5111d0c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50338/0 (socket says 172.21.15.70:50338) 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5111d0c700 1 -- 172.21.15.70:0/1557546209 learned_addr learned my addr 172.21.15.70:0/1557546209 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5112d0e700 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc1a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5111d0c700 1 -- 172.21.15.70:0/1557546209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 msgr2=0x559cfc1a6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5111d0c700 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc1a6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f511250d700 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc1a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5111d0c700 1 -- 172.21.15.70:0/1557546209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 msgr2=0x559cfc1a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5111d0c700 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc1a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5111d0c700 1 -- 172.21.15.70:0/1557546209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cfbf32200 con 0x559cfc18d750 2023-10-08T08:43:18.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f5112d0e700 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc1a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.265+0000 7f511250d700 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f5111d0c700 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1b0a90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5108018000 tx=0x7f5108005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fcb884197a3ee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f51017fa700 1 -- 172.21.15.70:0/1557546209 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108020040 con 0x559cfc18d750 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f51017fa700 1 -- 172.21.15.70:0/1557546209 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51080044f0 con 0x559cfc18d750 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f51017fa700 1 -- 172.21.15.70:0/1557546209 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108024730 con 0x559cfc18d750 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f512095ab80 1 -- 172.21.15.70:0/1557546209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 msgr2=0x559cfc1b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f512095ab80 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1b0a90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5108018000 tx=0x7f5108005370 comp rx=0 tx=0).stop 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f512095ab80 1 -- 172.21.15.70:0/1557546209 shutdown_connections 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f512095ab80 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc198600 0x559cfc1a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f512095ab80 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc18ce30 0x559cfc1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f512095ab80 1 --2- 172.21.15.70:0/1557546209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18d750 0x559cfc1b0a90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f512095ab80 1 -- 172.21.15.70:0/1557546209 >> 172.21.15.70:0/1557546209 conn(0x559cfc102210 msgr2=0x559cfc193b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f512095ab80 1 -- 172.21.15.70:0/1557546209 shutdown_connections 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.266+0000 7f512095ab80 1 -- 172.21.15.70:0/1557546209 wait complete. 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f512095ab80 1 -- start start 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f512095ab80 1 Processor -- start 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f512095ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc199170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f512095ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc18d750 0x559cfc1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f512095ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc198600 0x559cfc199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f512095ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc1fbbc0 con 0x559cfc18ce30 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f512095ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc1fbd00 con 0x559cfc198600 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f512095ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cfc1fbec0 con 0x559cfc18d750 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f512095ab80 10 client.0 _ll_register_callbacks cb 0x7f50fc0050d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f511250d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f511250d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50342/0 (socket says 172.21.15.70:50342) 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f511250d700 1 -- 172.21.15.70:0/2912986625 learned_addr learned my addr 172.21.15.70:0/2912986625 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f5112d0e700 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc198600 0x559cfc199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f5111d0c700 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc18d750 0x559cfc1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f511250d700 1 -- 172.21.15.70:0/2912986625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc18d750 msgr2=0x559cfc1996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f511250d700 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc18d750 0x559cfc1996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f511250d700 1 -- 172.21.15.70:0/2912986625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc198600 msgr2=0x559cfc199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f511250d700 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc198600 0x559cfc199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f511250d700 1 -- 172.21.15.70:0/2912986625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559cfbf0bd90 con 0x559cfc18ce30 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.267+0000 7f5111d0c700 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc18d750 0x559cfc1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f511250d700 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc199170 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f50fc005ef0 tx=0x7f50fc0059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518713402fe6aab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f50f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f50f5ffb700 1 -- 172.21.15.70:0/2912986625 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc022cf0 con 0x559cfc18ce30 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f50f5ffb700 1 -- 172.21.15.70:0/2912986625 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f50fc02d440 con 0x559cfc18ce30 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f512095ab80 1 -- 172.21.15.70:0/2912986625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f510800fd80 con 0x559cfc18ce30 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f50f5ffb700 1 -- 172.21.15.70:0/2912986625 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50fc022e50 con 0x559cfc18ce30 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f512095ab80 10 client.15411 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f512095ab80 1 -- 172.21.15.70:0/2912986625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559cfbf0a260 con 0x559cfc18ce30 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f50f5ffb700 1 -- 172.21.15.70:0/2912986625 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f510800fd80 con 0x559cfc18ce30 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f50f5ffb700 1 -- 172.21.15.70:0/2912986625 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f50fc035070 con 0x559cfc18ce30 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f512095ab80 10 client.15411 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f512095ab80 10 client.15411 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f512095ab80 20 client.15411 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f512095ab80 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x559cfc200de0 0x559cfc1fd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f512095ab80 4 client.15411 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f512095ab80 1 -- 172.21.15.70:0/2912986625 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559cfc0d9ae0 con 0x559cfc200de0 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.268+0000 7f5111d0c700 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x559cfc200de0 0x559cfc1fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f50f5ffb700 10 client.15411 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f5111d0c700 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x559cfc200de0 0x559cfc1fd280 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=64a25f37adaa9c03 server_cookie=a538f76669136c26 in_seq=0 out_seq=0 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f50f5ffb700 1 -- 172.21.15.70:0/2912986625 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x559cfc0d9ae0 con 0x559cfc200de0 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f50f5ffb700 10 client.15411 handle_command_reply: tid=0 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 client.15411 shutdown 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 -- 172.21.15.70:0/2912986625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 msgr2=0x559cfc199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc199170 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f50fc005ef0 tx=0x7f50fc0059d0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 -- 172.21.15.70:0/2912986625 shutdown_connections 2023-10-08T08:43:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x559cfc200de0 0x559cfc1fd280 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559cfc198600 0x559cfc199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cfc18ce30 0x559cfc199170 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f50f5ffb700 0 client.15411 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 --2- 172.21.15.70:0/2912986625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559cfc18d750 0x559cfc1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 -- 172.21.15.70:0/2912986625 >> 172.21.15.70:0/2912986625 conn(0x559cfc102210 msgr2=0x559cfc1a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 -- 172.21.15.70:0/2912986625 shutdown_connections 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 1 -- 172.21.15.70:0/2912986625 wait complete. 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.269+0000 7f512095ab80 20 client.15411 trim_cache size 0 max 16384 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:18.278 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24605, 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 53.048662389, 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 92.365905884 2023-10-08T08:43:18.279 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:18.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 -- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50f80a14d0 msgr2=0x7f50f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50f80a14d0 0x7f50f80a3990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b5c0 tx=0x7f50fc005960 comp rx=0 tx=0).stop 2023-10-08T08:43:18.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 -- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 msgr2=0x7f510c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 0x7f510c19d660 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f510400ada0 tx=0x7f510400c330 comp rx=0 tx=0).stop 2023-10-08T08:43:18.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 -- 172.21.15.70:0/1077083012 shutdown_connections 2023-10-08T08:43:18.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f50f80a14d0 0x7f50f80a3990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f510c106750 0x7f510c19d660 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f510c100740 0x7f510c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 --2- 172.21.15.70:0/1077083012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f510c101100 0x7f510c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 -- 172.21.15.70:0/1077083012 >> 172.21.15.70:0/1077083012 conn(0x7f510c0fc230 msgr2=0x7f510c10bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 -- 172.21.15.70:0/1077083012 shutdown_connections 2023-10-08T08:43:18.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.270+0000 7f5114771700 1 -- 172.21.15.70:0/1077083012 wait complete. 2023-10-08T08:43:18.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T08:43:18.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.406+0000 7f35f75e7700 1 -- 172.21.15.70:0/3302196504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f0106720 msgr2=0x7f35f0106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.406+0000 7f35f75e7700 1 --2- 172.21.15.70:0/3302196504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f0106720 0x7f35f0106b00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f35e00099c0 tx=0x7f35e0009cd0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.406+0000 7f35f75e7700 1 -- 172.21.15.70:0/3302196504 shutdown_connections 2023-10-08T08:43:18.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.406+0000 7f35f75e7700 1 --2- 172.21.15.70:0/3302196504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f00ff620 0x7f35f010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.406+0000 7f35f75e7700 1 --2- 172.21.15.70:0/3302196504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f0106720 0x7f35f0106b00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.406+0000 7f35f75e7700 1 --2- 172.21.15.70:0/3302196504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35f00fec60 0x7f35f00ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.406+0000 7f35f75e7700 1 -- 172.21.15.70:0/3302196504 >> 172.21.15.70:0/3302196504 conn(0x7f35f0075c20 msgr2=0x7f35f00fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 -- 172.21.15.70:0/3302196504 shutdown_connections 2023-10-08T08:43:18.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 -- 172.21.15.70:0/3302196504 wait complete. 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 Processor -- start 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 -- start start 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35f00fec60 0x7f35f019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ff620 0x7f35f019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f0106720 0x7f35f0196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0196fb0 con 0x7f35f00ff620 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0197120 con 0x7f35f0106720 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f75e7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f01972e0 con 0x7f35f00fec60 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.407+0000 7f35f4b82700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ff620 0x7f35f019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f4b82700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ff620 0x7f35f019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50356/0 (socket says 172.21.15.70:50356) 2023-10-08T08:43:18.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f4b82700 1 -- 172.21.15.70:0/95721484 learned_addr learned my addr 172.21.15.70:0/95721484 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f5b84700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f0106720 0x7f35f0196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f5383700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35f00fec60 0x7f35f019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f4b82700 1 -- 172.21.15.70:0/95721484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35f00fec60 msgr2=0x7f35f019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f4b82700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35f00fec60 0x7f35f019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f4b82700 1 -- 172.21.15.70:0/95721484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f0106720 msgr2=0x7f35f0196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f4b82700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f0106720 0x7f35f0196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f4b82700 1 -- 172.21.15.70:0/95721484 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e00095f0 con 0x7f35f00ff620 2023-10-08T08:43:18.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f4b82700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ff620 0x7f35f019cd60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c9b0 tx=0x7f35ec00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35e67fc700 1 -- 172.21.15.70:0/95721484 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec007b00 con 0x7f35f00ff620 2023-10-08T08:43:18.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35e67fc700 1 -- 172.21.15.70:0/95721484 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35ec007c60 con 0x7f35f00ff620 2023-10-08T08:43:18.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f75e7700 1 -- 172.21.15.70:0/95721484 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f01975c0 con 0x7f35f00ff620 2023-10-08T08:43:18.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35e67fc700 1 -- 172.21.15.70:0/95721484 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec018660 con 0x7f35f00ff620 2023-10-08T08:43:18.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.408+0000 7f35f75e7700 1 -- 172.21.15.70:0/95721484 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f01a3810 con 0x7f35f00ff620 2023-10-08T08:43:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.410+0000 7f35e67fc700 1 -- 172.21.15.70:0/95721484 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f35ec00f450 con 0x7f35f00ff620 2023-10-08T08:43:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.411+0000 7f35e67fc700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f35dc0a14d0 0x7f35dc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.411+0000 7f35f5383700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f35dc0a14d0 0x7f35dc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.411+0000 7f35e67fc700 1 -- 172.21.15.70:0/95721484 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f35ec0cd100 con 0x7f35f00ff620 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.411+0000 7f35f5383700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f35dc0a14d0 0x7f35dc0a3990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f35e0006010 tx=0x7f35e0009f10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f36037d0b80 1 Processor -- start 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f36037d0b80 1 -- start start 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb613210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb61e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb61e600 0x55e2cb6209f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f36037d0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb57c410 con 0x55e2cb612e30 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f36037d0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb56dbd0 con 0x55e2cb613750 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f36037d0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb56b4f0 con 0x55e2cb61e600 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f35f5383700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb613210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f35f5383700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb613210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50362/0 (socket says 172.21.15.70:50362) 2023-10-08T08:43:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f35f5383700 1 -- 172.21.15.70:0/111219488 learned_addr learned my addr 172.21.15.70:0/111219488 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f35f4b82700 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb61e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.412+0000 7f35f5b84700 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb61e600 0x55e2cb6209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35f5383700 1 -- 172.21.15.70:0/111219488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb61e600 msgr2=0x55e2cb6209f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35f5383700 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb61e600 0x55e2cb6209f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35f5383700 1 -- 172.21.15.70:0/111219488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 msgr2=0x55e2cb61e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35f5383700 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb61e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35f5383700 1 -- 172.21.15.70:0/111219488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2cb391d90 con 0x55e2cb612e30 2023-10-08T08:43:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35f5b84700 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb61e600 0x55e2cb6209f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35f5383700 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb613210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f35e00052a0 tx=0x7f35e001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65abe05d5780226a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35db7fe700 1 -- 172.21.15.70:0/111219488 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e001e070 con 0x55e2cb612e30 2023-10-08T08:43:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35db7fe700 1 -- 172.21.15.70:0/111219488 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35e00055b0 con 0x55e2cb612e30 2023-10-08T08:43:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.413+0000 7f35db7fe700 1 -- 172.21.15.70:0/111219488 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e000f460 con 0x55e2cb612e30 2023-10-08T08:43:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 -- 172.21.15.70:0/111219488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 msgr2=0x55e2cb613210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb613210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f35e00052a0 tx=0x7f35e001e000 comp rx=0 tx=0).stop 2023-10-08T08:43:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 -- 172.21.15.70:0/111219488 shutdown_connections 2023-10-08T08:43:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb61e600 0x55e2cb6209f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb613210 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 --2- 172.21.15.70:0/111219488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb61e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 -- 172.21.15.70:0/111219488 >> 172.21.15.70:0/111219488 conn(0x55e2cb588210 msgr2=0x55e2cb60f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 -- 172.21.15.70:0/111219488 shutdown_connections 2023-10-08T08:43:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 -- 172.21.15.70:0/111219488 wait complete. 2023-10-08T08:43:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 -- start start 2023-10-08T08:43:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 Processor -- start 2023-10-08T08:43:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.414+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 0x55e2cb61e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb61b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f36037d0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb566de0 con 0x55e2cb61e600 2023-10-08T08:43:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f36037d0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb5036c0 con 0x55e2cb613750 2023-10-08T08:43:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f36037d0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb503360 con 0x55e2cb612e30 2023-10-08T08:43:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f36037d0b80 10 client.0 _ll_register_callbacks cb 0x55e2cb3607b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5b84700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5b84700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50372/0 (socket says 172.21.15.70:50372) 2023-10-08T08:43:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5b84700 1 -- 172.21.15.70:0/519127211 learned_addr learned my addr 172.21.15.70:0/519127211 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5383700 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 0x55e2cb61e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f4b82700 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb61b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5b84700 1 -- 172.21.15.70:0/519127211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 msgr2=0x55e2cb61e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5b84700 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 0x55e2cb61e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5b84700 1 -- 172.21.15.70:0/519127211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 msgr2=0x55e2cb61b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5b84700 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb61b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5b84700 1 -- 172.21.15.70:0/519127211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f010de90 con 0x55e2cb61e600 2023-10-08T08:43:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5383700 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 0x55e2cb61e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35f5b84700 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61bb10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f35e8004130 tx=0x7f35e80044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe05ecb9f5dd7277 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35d8ff9700 1 -- 172.21.15.70:0/519127211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8007990 con 0x55e2cb61e600 2023-10-08T08:43:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f36037d0b80 1 -- 172.21.15.70:0/519127211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2cb52ee60 con 0x55e2cb61e600 2023-10-08T08:43:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35d8ff9700 1 -- 172.21.15.70:0/519127211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f35e8007af0 con 0x55e2cb61e600 2023-10-08T08:43:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f35d8ff9700 1 -- 172.21.15.70:0/519127211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35e8007cb0 con 0x55e2cb61e600 2023-10-08T08:43:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f36037d0b80 10 client.15423 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.415+0000 7f36037d0b80 1 -- 172.21.15.70:0/519127211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e2cb37ac10 con 0x55e2cb61e600 2023-10-08T08:43:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f35d8ff9700 1 -- 172.21.15.70:0/519127211 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e2cb52ee60 con 0x55e2cb61e600 2023-10-08T08:43:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f35d8ff9700 1 -- 172.21.15.70:0/519127211 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f35e8014040 con 0x55e2cb61e600 2023-10-08T08:43:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f36037d0b80 10 client.15423 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f36037d0b80 10 client.15423 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T08:43:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f36037d0b80 20 client.15423 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:18.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f36037d0b80 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e2cb62e230 0x55e2cb62ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f36037d0b80 4 client.15423 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:18.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f36037d0b80 1 -- 172.21.15.70:0/519127211 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2cb55fdc0 con 0x55e2cb62e230 2023-10-08T08:43:18.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f35f5383700 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e2cb62e230 0x55e2cb62ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f35f5383700 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e2cb62e230 0x55e2cb62ccb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c51e81ba97374a18 server_cookie=6d402545679f0ee6 in_seq=0 out_seq=0 2023-10-08T08:43:18.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.416+0000 7f35d8ff9700 10 client.15423 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:18.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f35d8ff9700 1 -- 172.21.15.70:0/519127211 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e2cb55fdc0 con 0x55e2cb62e230 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f35d8ff9700 10 client.15423 handle_command_reply: tid=0 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 client.15423 shutdown 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 -- 172.21.15.70:0/519127211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 msgr2=0x55e2cb61bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61bb10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f35e8004130 tx=0x7f35e80044f0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 -- 172.21.15.70:0/519127211 shutdown_connections 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61bb10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 0x55e2cb61e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e2cb62e230 0x55e2cb62ccb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 --2- 172.21.15.70:0/519127211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb61b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 -- 172.21.15.70:0/519127211 >> 172.21.15.70:0/519127211 conn(0x55e2cb588210 msgr2=0x55e2cb60ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f35d8ff9700 0 client.15423 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:18.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 -- 172.21.15.70:0/519127211 shutdown_connections 2023-10-08T08:43:18.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.417+0000 7f36037d0b80 1 -- 172.21.15.70:0/519127211 wait complete. 2023-10-08T08:43:18.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.418+0000 7f36037d0b80 20 client.15423 trim_cache size 0 max 16384 2023-10-08T08:43:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f36037d0b80 1 Processor -- start 2023-10-08T08:43:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f36037d0b80 1 -- start start 2023-10-08T08:43:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 0x55e2cb6209f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb60f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f36037d0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb3e78d0 con 0x55e2cb61e600 2023-10-08T08:43:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f36037d0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb613b30 con 0x55e2cb613750 2023-10-08T08:43:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f36037d0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb606b90 con 0x55e2cb612e30 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f35f5b84700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f35f5b84700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50380/0 (socket says 172.21.15.70:50380) 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f35f5b84700 1 -- 172.21.15.70:0/2518501142 learned_addr learned my addr 172.21.15.70:0/2518501142 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.435+0000 7f35f4b82700 1 --2- 172.21.15.70:0/2518501142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb60f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35f5383700 1 --2- 172.21.15.70:0/2518501142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 0x55e2cb6209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35f5b84700 1 -- 172.21.15.70:0/2518501142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 msgr2=0x55e2cb6209f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35f5b84700 1 --2- 172.21.15.70:0/2518501142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 0x55e2cb6209f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35f5b84700 1 -- 172.21.15.70:0/2518501142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 msgr2=0x55e2cb60f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35f5b84700 1 --2- 172.21.15.70:0/2518501142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb60f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35f5b84700 1 -- 172.21.15.70:0/2518501142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2cb3b8200 con 0x55e2cb61e600 2023-10-08T08:43:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35f5b84700 1 --2- 172.21.15.70:0/2518501142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61db70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f35e8000f80 tx=0x7f35e8009170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3a7007ae3d174 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35dbfff700 1 -- 172.21.15.70:0/2518501142 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8004af0 con 0x55e2cb61e600 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35dbfff700 1 -- 172.21.15.70:0/2518501142 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35e800f040 con 0x55e2cb61e600 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f35dbfff700 1 -- 172.21.15.70:0/2518501142 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8015a00 con 0x55e2cb61e600 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f36037d0b80 1 -- 172.21.15.70:0/2518501142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 msgr2=0x55e2cb61db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.436+0000 7f36037d0b80 1 --2- 172.21.15.70:0/2518501142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61db70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f35e8000f80 tx=0x7f35e8009170 comp rx=0 tx=0).stop 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 -- 172.21.15.70:0/2518501142 shutdown_connections 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 --2- 172.21.15.70:0/2518501142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb61e600 0x55e2cb61db70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 --2- 172.21.15.70:0/2518501142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb612e30 0x55e2cb6209f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 --2- 172.21.15.70:0/2518501142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb613750 0x55e2cb60f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 -- 172.21.15.70:0/2518501142 >> 172.21.15.70:0/2518501142 conn(0x55e2cb588210 msgr2=0x55e2cb60ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 -- 172.21.15.70:0/2518501142 shutdown_connections 2023-10-08T08:43:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 -- 172.21.15.70:0/2518501142 wait complete. 2023-10-08T08:43:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 -- start start 2023-10-08T08:43:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 Processor -- start 2023-10-08T08:43:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb618d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb613750 0x55e2cb617740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb61e600 0x55e2cb617c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb619480 con 0x55e2cb612e30 2023-10-08T08:43:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb6181c0 con 0x55e2cb61e600 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb618380 con 0x55e2cb613750 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f36037d0b80 10 client.0 _ll_register_callbacks cb 0x7f35e8009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f35f5383700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb618d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f35f5383700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb618d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50382/0 (socket says 172.21.15.70:50382) 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.437+0000 7f35f5383700 1 -- 172.21.15.70:0/4256943306 learned_addr learned my addr 172.21.15.70:0/4256943306 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35f5b84700 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb61e600 0x55e2cb617c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35f4b82700 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb613750 0x55e2cb617740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35f5383700 1 -- 172.21.15.70:0/4256943306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb613750 msgr2=0x55e2cb617740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35f5383700 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb613750 0x55e2cb617740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35f5383700 1 -- 172.21.15.70:0/4256943306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb61e600 msgr2=0x55e2cb617c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35f5383700 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb61e600 0x55e2cb617c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35f5383700 1 -- 172.21.15.70:0/4256943306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e2cb37ac10 con 0x55e2cb612e30 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35f5383700 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb618d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f35e0004b60 tx=0x7f35e0004b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f8ab57118fb24b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35d8ff9700 1 -- 172.21.15.70:0/4256943306 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e001e040 con 0x55e2cb612e30 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35d8ff9700 1 -- 172.21.15.70:0/4256943306 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f35e0035070 con 0x55e2cb612e30 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f36037d0b80 1 -- 172.21.15.70:0/4256943306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35e00055b0 con 0x55e2cb612e30 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35d8ff9700 1 -- 172.21.15.70:0/4256943306 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35e0004c00 con 0x55e2cb612e30 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f36037d0b80 10 client.15429 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f36037d0b80 1 -- 172.21.15.70:0/4256943306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e2cb390260 con 0x55e2cb612e30 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.438+0000 7f35d8ff9700 1 -- 172.21.15.70:0/4256943306 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35e00055b0 con 0x55e2cb612e30 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f35d8ff9700 1 -- 172.21.15.70:0/4256943306 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f35e0037b40 con 0x55e2cb612e30 2023-10-08T08:43:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f36037d0b80 10 client.15429 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f36037d0b80 10 client.15429 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f36037d0b80 20 client.15429 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f36037d0b80 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e2cb6865b0 0x55e2cb682a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f36037d0b80 4 client.15429 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f36037d0b80 1 -- 172.21.15.70:0/4256943306 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e2cb55fae0 con 0x55e2cb6865b0 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f35f4b82700 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e2cb6865b0 0x55e2cb682a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f35d8ff9700 10 client.15429 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.439+0000 7f35f4b82700 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e2cb6865b0 0x55e2cb682a40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a837a8331b2b717b server_cookie=ad70db35e2cebeb5 in_seq=0 out_seq=0 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f35d8ff9700 1 -- 172.21.15.70:0/4256943306 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e2cb55fae0 con 0x55e2cb6865b0 2023-10-08T08:43:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f35d8ff9700 10 client.15429 handle_command_reply: tid=0 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 client.15429 shutdown 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 -- 172.21.15.70:0/4256943306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 msgr2=0x55e2cb618d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb618d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f35e0004b60 tx=0x7f35e0004b90 comp rx=0 tx=0).stop 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 -- 172.21.15.70:0/4256943306 shutdown_connections 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e2cb6865b0 0x55e2cb682a40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2cb61e600 0x55e2cb617c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f35d8ff9700 0 client.15429 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cb612e30 0x55e2cb618d90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 --2- 172.21.15.70:0/4256943306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e2cb613750 0x55e2cb617740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 -- 172.21.15.70:0/4256943306 >> 172.21.15.70:0/4256943306 conn(0x55e2cb588210 msgr2=0x55e2cb62ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 -- 172.21.15.70:0/4256943306 shutdown_connections 2023-10-08T08:43:18.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 1 -- 172.21.15.70:0/4256943306 wait complete. 2023-10-08T08:43:18.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.440+0000 7f36037d0b80 20 client.15429 trim_cache size 0 max 16384 2023-10-08T08:43:18.454 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:18.454 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24638, 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 77.323495808999994, 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:18.455 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 83.682553315000007 2023-10-08T08:43:18.456 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 -- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f35dc0a14d0 msgr2=0x7f35dc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f35dc0a14d0 0x7f35dc0a3990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f35e0006010 tx=0x7f35e0009f10 comp rx=0 tx=0).stop 2023-10-08T08:43:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 -- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ff620 msgr2=0x7f35f019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ff620 0x7f35f019cd60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c9b0 tx=0x7f35ec00ccc0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 -- 172.21.15.70:0/95721484 shutdown_connections 2023-10-08T08:43:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f35dc0a14d0 0x7f35dc0a3990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f0106720 0x7f35f0196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35f00fec60 0x7f35f019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 --2- 172.21.15.70:0/95721484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f00ff620 0x7f35f019cd60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:18.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 -- 172.21.15.70:0/95721484 >> 172.21.15.70:0/95721484 conn(0x7f35f0075c20 msgr2=0x7f35f00fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:18.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 -- 172.21.15.70:0/95721484 shutdown_connections 2023-10-08T08:43:18.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:18.441+0000 7f35f75e7700 1 -- 172.21.15.70:0/95721484 wait complete. 2023-10-08T08:43:18.458 INFO:tasks.cephadm:Setup complete, yielding 2023-10-08T08:43:18.458 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T08:43:18.469 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:43:18.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-08T08:43:18.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:18 smithi070 ceph-mon[99513]: pgmap v275: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-10-08T08:43:18.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:18 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1679109536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:18 smithi105 ceph-mon[103798]: pgmap v275: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-10-08T08:43:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:18 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1679109536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:18.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:18 smithi191 ceph-mon[104220]: pgmap v275: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-10-08T08:43:18.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:18 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1679109536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:19.026 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:20.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 -- 172.21.15.70:0/1933680379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 msgr2=0x7f76d4104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:20.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/1933680379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 0x7f76d4104990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009990 tx=0x7f76c8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 -- 172.21.15.70:0/1933680379 shutdown_connections 2023-10-08T08:43:20.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/1933680379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d41000a0 0x7f76d410c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/1933680379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 0x7f76d4104990 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/1933680379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d40ff6e0 0x7f76d40ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 -- 172.21.15.70:0/1933680379 >> 172.21.15.70:0/1933680379 conn(0x7f76d40766c0 msgr2=0x7f76d4076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 -- 172.21.15.70:0/1933680379 shutdown_connections 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 -- 172.21.15.70:0/1933680379 wait complete. 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.217+0000 7f76d9eaf700 1 Processor -- start 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d9eaf700 1 -- start start 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d9eaf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d40ff6e0 0x7f76d419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d9eaf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d41000a0 0x7f76d419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d9eaf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 0x7f76d4195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d9eaf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4195ff0 con 0x7f76d41045b0 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d9eaf700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4196160 con 0x7f76d41000a0 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d9eaf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4196320 con 0x7f76d40ff6e0 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 0x7f76d4195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:20.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d3fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 0x7f76d4195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50400/0 (socket says 172.21.15.70:50400) 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d3fff700 1 -- 172.21.15.70:0/39690558 learned_addr learned my addr 172.21.15.70:0/39690558 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d37fe700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d40ff6e0 0x7f76d419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d2ffd700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d41000a0 0x7f76d419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d3fff700 1 -- 172.21.15.70:0/39690558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d40ff6e0 msgr2=0x7f76d419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d3fff700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d40ff6e0 0x7f76d419b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d3fff700 1 -- 172.21.15.70:0/39690558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d41000a0 msgr2=0x7f76d419bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d3fff700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d41000a0 0x7f76d419bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d3fff700 1 -- 172.21.15.70:0/39690558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80095f0 con 0x7f76d41045b0 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.218+0000 7f76d2ffd700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d41000a0 0x7f76d419bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.219+0000 7f76d3fff700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 0x7f76d4195990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f76cc007f10 tx=0x7f76cc00f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.219+0000 7f76d0ff9700 1 -- 172.21.15.70:0/39690558 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00fde0 con 0x7f76d41045b0 2023-10-08T08:43:20.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.219+0000 7f76d0ff9700 1 -- 172.21.15.70:0/39690558 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76cc004bb0 con 0x7f76d41045b0 2023-10-08T08:43:20.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.219+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d4196600 con 0x7f76d41045b0 2023-10-08T08:43:20.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.219+0000 7f76d0ff9700 1 -- 172.21.15.70:0/39690558 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc005020 con 0x7f76d41045b0 2023-10-08T08:43:20.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.219+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d4068c30 con 0x7f76d41045b0 2023-10-08T08:43:20.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.220+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d4100dd0 con 0x7f76d41045b0 2023-10-08T08:43:20.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.222+0000 7f76d0ff9700 1 -- 172.21.15.70:0/39690558 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f76cc004d20 con 0x7f76d41045b0 2023-10-08T08:43:20.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.222+0000 7f76d0ff9700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f76bc0a1550 0x7f76bc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:20.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.222+0000 7f76d37fe700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f76bc0a1550 0x7f76bc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:20.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.222+0000 7f76d0ff9700 1 -- 172.21.15.70:0/39690558 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f76cc0cf7b0 con 0x7f76d41045b0 2023-10-08T08:43:20.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.223+0000 7f76d37fe700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f76bc0a1550 0x7f76bc0a3a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f76c800b5c0 tx=0x7f76c8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:20.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.226+0000 7f76d0ff9700 1 -- 172.21.15.70:0/39690558 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f76cc098a20 con 0x7f76d41045b0 2023-10-08T08:43:20.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.431+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76d410f690 con 0x7f76bc0a1550 2023-10-08T08:43:20.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.432+0000 7f76d0ff9700 1 -- 172.21.15.70:0/39690558 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f76d410f690 con 0x7f76bc0a1550 2023-10-08T08:43:20.433 INFO:teuthology.orchestra.run.smithi070.stdout:Backend: cephadm 2023-10-08T08:43:20.434 INFO:teuthology.orchestra.run.smithi070.stdout:Available: Yes 2023-10-08T08:43:20.434 INFO:teuthology.orchestra.run.smithi070.stdout:Paused: No 2023-10-08T08:43:20.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f76bc0a1550 msgr2=0x7f76bc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:20.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f76bc0a1550 0x7f76bc0a3a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f76c800b5c0 tx=0x7f76c8005960 comp rx=0 tx=0).stop 2023-10-08T08:43:20.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 msgr2=0x7f76d4195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:20.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 0x7f76d4195990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f76cc007f10 tx=0x7f76cc00f5c0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 shutdown_connections 2023-10-08T08:43:20.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f76bc0a1550 0x7f76bc0a3a10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76d41045b0 0x7f76d4195990 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76d40ff6e0 0x7f76d419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 --2- 172.21.15.70:0/39690558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d41000a0 0x7f76d419bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 >> 172.21.15.70:0/39690558 conn(0x7f76d40766c0 msgr2=0x7f76d40fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 shutdown_connections 2023-10-08T08:43:20.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:20.434+0000 7f76d9eaf700 1 -- 172.21.15.70:0/39690558 wait complete. 2023-10-08T08:43:20.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:20 smithi070 ceph-mon[99513]: pgmap v276: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-08T08:43:20.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:20 smithi105 ceph-mon[103798]: pgmap v276: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-08T08:43:20.775 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-08T08:43:20.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:20 smithi191 ceph-mon[104220]: pgmap v276: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-08T08:43:21.335 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:21.704 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:21 smithi070 ceph-mon[99513]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:21.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:21 smithi105 ceph-mon[103798]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:21.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:21 smithi191 ceph-mon[104220]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.536+0000 7f867412f700 1 -- 172.21.15.70:0/2839742021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c100110 msgr2=0x7f866c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.536+0000 7f867412f700 1 --2- 172.21.15.70:0/2839742021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c100110 0x7f866c10c580 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f866400b0a0 tx=0x7f866400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.536+0000 7f867412f700 1 -- 172.21.15.70:0/2839742021 shutdown_connections 2023-10-08T08:43:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.536+0000 7f867412f700 1 --2- 172.21.15.70:0/2839742021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c100110 0x7f866c10c580 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.536+0000 7f867412f700 1 --2- 172.21.15.70:0/2839742021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f866c1056b0 0x7f866c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.536+0000 7f867412f700 1 --2- 172.21.15.70:0/2839742021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f866c0ff750 0x7f866c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.536+0000 7f867412f700 1 -- 172.21.15.70:0/2839742021 >> 172.21.15.70:0/2839742021 conn(0x7f866c075790 msgr2=0x7f866c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.536+0000 7f867412f700 1 -- 172.21.15.70:0/2839742021 shutdown_connections 2023-10-08T08:43:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.536+0000 7f867412f700 1 -- 172.21.15.70:0/2839742021 wait complete. 2023-10-08T08:43:22.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f867412f700 1 Processor -- start 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f867412f700 1 -- start start 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f867412f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f866c0ff750 0x7f866c101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f867412f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f866c100110 0x7f866c1017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f867412f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1056b0 0x7f866c101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f867412f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1a5140 con 0x7f866c1056b0 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f867412f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1a52b0 con 0x7f866c100110 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f867412f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1a5470 con 0x7f866c0ff750 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86726cc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1056b0 0x7f866c101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86726cc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1056b0 0x7f866c101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50414/0 (socket says 172.21.15.70:50414) 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86726cc700 1 -- 172.21.15.70:0/3042600515 learned_addr learned my addr 172.21.15.70:0/3042600515 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86716ca700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f866c100110 0x7f866c1017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f8671ecb700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f866c0ff750 0x7f866c101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86726cc700 1 -- 172.21.15.70:0/3042600515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f866c0ff750 msgr2=0x7f866c101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86726cc700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f866c0ff750 0x7f866c101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86726cc700 1 -- 172.21.15.70:0/3042600515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f866c100110 msgr2=0x7f866c1017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86726cc700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f866c100110 0x7f866c1017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86726cc700 1 -- 172.21.15.70:0/3042600515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664009d00 con 0x7f866c1056b0 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.537+0000 7f86726cc700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1056b0 0x7f866c101d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f866400b070 tx=0x7f8664007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.538+0000 7f8662ffd700 1 -- 172.21.15.70:0/3042600515 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866400e040 con 0x7f866c1056b0 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.538+0000 7f8662ffd700 1 -- 172.21.15.70:0/3042600515 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8664009440 con 0x7f866c1056b0 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.538+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c1a56f0 con 0x7f866c1056b0 2023-10-08T08:43:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.538+0000 7f8662ffd700 1 -- 172.21.15.70:0/3042600515 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866401b450 con 0x7f866c1056b0 2023-10-08T08:43:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.538+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c1a5b10 con 0x7f866c1056b0 2023-10-08T08:43:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.539+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c108cc0 con 0x7f866c1056b0 2023-10-08T08:43:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.540+0000 7f8662ffd700 1 -- 172.21.15.70:0/3042600515 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f8664004cf0 con 0x7f866c1056b0 2023-10-08T08:43:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.540+0000 7f8662ffd700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f86580a14d0 0x7f86580a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.540+0000 7f8671ecb700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f86580a14d0 0x7f86580a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.540+0000 7f8662ffd700 1 -- 172.21.15.70:0/3042600515 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f86640cf200 con 0x7f866c1056b0 2023-10-08T08:43:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.541+0000 7f8671ecb700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f86580a14d0 0x7f86580a3990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f865c005fd0 tx=0x7f865c005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.544+0000 7f8662ffd700 1 -- 172.21.15.70:0/3042600515 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8664098620 con 0x7f866c1056b0 2023-10-08T08:43:22.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:22 smithi070 ceph-mon[99513]: pgmap v277: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:22.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.741+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f866c102710 con 0x7f86580a14d0 2023-10-08T08:43:22.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.754+0000 7f8662ffd700 1 -- 172.21.15.70:0/3042600515 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f866c102710 con 0x7f86580a14d0 2023-10-08T08:43:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-08T08:43:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:mds.a smithi070 running (90s) 14s ago 90s 18.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 72be340a28df 2023-10-08T08:43:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:mds.b smithi105 running (88s) 18s ago 87s 24.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d b170da3262a9 2023-10-08T08:43:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:mds.c smithi191 running (99s) 18s ago 99s 18.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 8bd7de6160bd 2023-10-08T08:43:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:mds.d smithi070 running (105s) 14s ago 105s 13.8M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 4402fc9b64a2 2023-10-08T08:43:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:mds.e smithi105 running (103s) 18s ago 103s 18.6M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 4b2fcf6cec29 2023-10-08T08:43:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:mds.f smithi191 running (101s) 18s ago 101s 20.7M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 7c2e3a480c7b 2023-10-08T08:43:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:mds.g smithi070 running (92s) 14s ago 92s 16.7M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 1f4d954e355e 2023-10-08T08:43:22.756 INFO:teuthology.orchestra.run.smithi070.stdout:mds.h smithi105 running (97s) 18s ago 96s 17.4M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 04e6d38f3538 2023-10-08T08:43:22.757 INFO:teuthology.orchestra.run.smithi070.stdout:mds.i smithi191 running (94s) 18s ago 94s 19.6M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 4467f85e0385 2023-10-08T08:43:22.757 INFO:teuthology.orchestra.run.smithi070.stdout:mds.j smithi070 running (108s) 14s ago 107s 17.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 9d3a3005020f 2023-10-08T08:43:22.757 INFO:teuthology.orchestra.run.smithi070.stdout:mds.k smithi105 running (110s) 18s ago 109s 19.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 61a7e5c1cd15 2023-10-08T08:43:22.757 INFO:teuthology.orchestra.run.smithi070.stdout:mds.l smithi191 running (112s) 18s ago 111s 16.7M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 4ad3b79fbdd6 2023-10-08T08:43:22.757 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.x smithi070 *:9283,8765 running (8m) 14s ago 8m 519M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 8f39cc3ff62c 2023-10-08T08:43:22.757 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.y smithi105 *:8443,8765 running (6m) 18s ago 6m 451M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 200683b90f8a 2023-10-08T08:43:22.757 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.z smithi191 *:8443,8765 running (6m) 18s ago 6m 451M - 18.0.0-6639-g7b3143ba 09a1f3752b5d a80e5e0a9887 2023-10-08T08:43:22.757 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a smithi070 running (8m) 14s ago 8m 101M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d d56d3f038ba9 2023-10-08T08:43:22.757 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b smithi105 running (7m) 18s ago 7m 63.7M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d a49747bf2ca6 2023-10-08T08:43:22.758 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c smithi191 running (7m) 18s ago 7m 63.4M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d 029a1ca63d3e 2023-10-08T08:43:22.758 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 smithi070 running (5m) 14s ago 5m 71.8M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 904ad48835a1 2023-10-08T08:43:22.758 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 smithi105 running (5m) 18s ago 5m 76.1M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d c481909c5768 2023-10-08T08:43:22.758 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 smithi191 running (5m) 18s ago 5m 73.8M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d b7e351ab92f1 2023-10-08T08:43:22.759 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 smithi070 running (4m) 14s ago 4m 68.5M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 93a0a3c500ed 2023-10-08T08:43:22.759 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 smithi105 running (4m) 18s ago 4m 63.2M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 37328b63ce0f 2023-10-08T08:43:22.759 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 smithi191 running (4m) 18s ago 4m 71.0M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 68446734b08b 2023-10-08T08:43:22.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 smithi070 running (3m) 14s ago 3m 64.2M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d aee0efcdbfc3 2023-10-08T08:43:22.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 smithi105 running (3m) 18s ago 3m 66.2M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 3240faaca59d 2023-10-08T08:43:22.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 smithi191 running (3m) 18s ago 3m 63.3M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d cd118ff57e13 2023-10-08T08:43:22.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 smithi070 running (2m) 14s ago 2m 60.7M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 9d5c0b7f89c7 2023-10-08T08:43:22.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 smithi105 running (2m) 18s ago 2m 62.3M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d cefa7f4e3105 2023-10-08T08:43:22.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 smithi191 running (2m) 18s ago 2m 55.4M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d abbc67b86852 2023-10-08T08:43:22.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.756+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f86580a14d0 msgr2=0x7f86580a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:22.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.756+0000 7f867412f700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f86580a14d0 0x7f86580a3990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f865c005fd0 tx=0x7f865c005db0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.756+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1056b0 msgr2=0x7f866c101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:22.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.756+0000 7f867412f700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1056b0 0x7f866c101d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f866400b070 tx=0x7f8664007870 comp rx=0 tx=0).stop 2023-10-08T08:43:22.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.757+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 shutdown_connections 2023-10-08T08:43:22.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.757+0000 7f867412f700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f86580a14d0 0x7f86580a3990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.757+0000 7f867412f700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f866c1056b0 0x7f866c101d00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.757+0000 7f867412f700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f866c0ff750 0x7f866c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.757+0000 7f867412f700 1 --2- 172.21.15.70:0/3042600515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f866c100110 0x7f866c1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:22.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.757+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 >> 172.21.15.70:0/3042600515 conn(0x7f866c075790 msgr2=0x7f866c068570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:22.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.757+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 shutdown_connections 2023-10-08T08:43:22.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:22.757+0000 7f867412f700 1 -- 172.21.15.70:0/3042600515 wait complete. 2023-10-08T08:43:22.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:22 smithi105 ceph-mon[103798]: pgmap v277: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:22.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:22 smithi191 ceph-mon[104220]: pgmap v277: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:23.095 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-08T08:43:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:24.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:24 smithi070 ceph-mon[99513]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:24.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:24 smithi070 ceph-mon[99513]: pgmap v278: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-08T08:43:24.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:24 smithi105 ceph-mon[103798]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:24.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:24 smithi105 ceph-mon[103798]: pgmap v278: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-08T08:43:24.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:24 smithi191 ceph-mon[104220]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:24.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:24 smithi191 ceph-mon[104220]: pgmap v278: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-08T08:43:24.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.876+0000 7fd5ebe25700 1 -- 172.21.15.70:0/3404423359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 msgr2=0x7fd5e41043b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:24.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.876+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/3404423359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 0x7fd5e41043b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009990 tx=0x7fd5d4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:24.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.876+0000 7fd5ebe25700 1 -- 172.21.15.70:0/3404423359 shutdown_connections 2023-10-08T08:43:24.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.876+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/3404423359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e4104ae0 0x7fd5e410c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:24.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.876+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/3404423359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41004c0 0x7fd5e41008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:24.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.876+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/3404423359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 0x7fd5e41043b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:24.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.876+0000 7fd5ebe25700 1 -- 172.21.15.70:0/3404423359 >> 172.21.15.70:0/3404423359 conn(0x7fd5e4074aa0 msgr2=0x7fd5e4074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:24.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.876+0000 7fd5ebe25700 1 -- 172.21.15.70:0/3404423359 shutdown_connections 2023-10-08T08:43:24.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.876+0000 7fd5ebe25700 1 -- 172.21.15.70:0/3404423359 wait complete. 2023-10-08T08:43:24.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5ebe25700 1 Processor -- start 2023-10-08T08:43:24.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5ebe25700 1 -- start start 2023-10-08T08:43:24.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5ebe25700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41004c0 0x7fd5e4197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:24.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5ebe25700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 0x7fd5e4198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:24.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5ebe25700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e4104ae0 0x7fd5e41a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:24.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5ebe25700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e41988d0 con 0x7fd5e4100e70 2023-10-08T08:43:24.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5ebe25700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e41a3100 con 0x7fd5e4104ae0 2023-10-08T08:43:24.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5ebe25700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e41a3240 con 0x7fd5e41004c0 2023-10-08T08:43:24.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5e93c0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 0x7fd5e4198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:24.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5e93c0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 0x7fd5e4198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50422/0 (socket says 172.21.15.70:50422) 2023-10-08T08:43:24.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5e93c0700 1 -- 172.21.15.70:0/1771284589 learned_addr learned my addr 172.21.15.70:0/1771284589 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:24.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5ea3c2700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e4104ae0 0x7fd5e41a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:24.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.877+0000 7fd5e9bc1700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41004c0 0x7fd5e4197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5e93c0700 1 -- 172.21.15.70:0/1771284589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41004c0 msgr2=0x7fd5e4197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5e93c0700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41004c0 0x7fd5e4197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5e93c0700 1 -- 172.21.15.70:0/1771284589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e4104ae0 msgr2=0x7fd5e41a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5e93c0700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e4104ae0 0x7fd5e41a2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5e93c0700 1 -- 172.21.15.70:0/1771284589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d40095f0 con 0x7fd5e4100e70 2023-10-08T08:43:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5e93c0700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 0x7fd5e4198080 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40059d0 tx=0x7fd5d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5daffd700 1 -- 172.21.15.70:0/1771284589 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d401d070 con 0x7fd5e4100e70 2023-10-08T08:43:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5daffd700 1 -- 172.21.15.70:0/1771284589 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5d4022470 con 0x7fd5e4100e70 2023-10-08T08:43:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e41a3440 con 0x7fd5e4100e70 2023-10-08T08:43:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5daffd700 1 -- 172.21.15.70:0/1771284589 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4017650 con 0x7fd5e4100e70 2023-10-08T08:43:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.878+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e41a3850 con 0x7fd5e4100e70 2023-10-08T08:43:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.879+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e4107d20 con 0x7fd5e4100e70 2023-10-08T08:43:24.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.880+0000 7fd5daffd700 1 -- 172.21.15.70:0/1771284589 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd5d400fad0 con 0x7fd5e4100e70 2023-10-08T08:43:24.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.881+0000 7fd5daffd700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5d00a14d0 0x7fd5d00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:24.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.881+0000 7fd5e9bc1700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5d00a14d0 0x7fd5d00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:24.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.881+0000 7fd5daffd700 1 -- 172.21.15.70:0/1771284589 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd5d40ce240 con 0x7fd5e4100e70 2023-10-08T08:43:24.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.881+0000 7fd5e9bc1700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5d00a14d0 0x7fd5d00a3990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009c60 tx=0x7fd5e0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:24.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:24.885+0000 7fd5daffd700 1 -- 172.21.15.70:0/1771284589 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd5d405d100 con 0x7fd5e4100e70 2023-10-08T08:43:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.082+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5e40ff6f0 con 0x7fd5d00a14d0 2023-10-08T08:43:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.088+0000 7fd5daffd700 1 -- 172.21.15.70:0/1771284589 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7fd5e40ff6f0 con 0x7fd5d00a14d0 2023-10-08T08:43:25.089 INFO:teuthology.orchestra.run.smithi070.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-08T08:43:25.089 INFO:teuthology.orchestra.run.smithi070.stdout:mds.all 12/12 21s ago 116s smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2023-10-08T08:43:25.089 INFO:teuthology.orchestra.run.smithi070.stdout:mgr 3/3 21s ago 6m smithi070=x;smithi105=y;smithi191=z;count:3 2023-10-08T08:43:25.090 INFO:teuthology.orchestra.run.smithi070.stdout:mon 3/3 21s ago 7m smithi070:172.21.15.70=a;smithi105:172.21.15.105=b;smithi191:172.21.15.191=c;count:3 2023-10-08T08:43:25.090 INFO:teuthology.orchestra.run.smithi070.stdout:osd 12 21s ago - 2023-10-08T08:43:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.090+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5d00a14d0 msgr2=0x7fd5d00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.090+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5d00a14d0 0x7fd5d00a3990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009c60 tx=0x7fd5e0009260 comp rx=0 tx=0).stop 2023-10-08T08:43:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.090+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 msgr2=0x7fd5e4198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.090+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 0x7fd5e4198080 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40059d0 tx=0x7fd5d4004730 comp rx=0 tx=0).stop 2023-10-08T08:43:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.091+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 shutdown_connections 2023-10-08T08:43:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.091+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd5d00a14d0 0x7fd5d00a3990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.091+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e4104ae0 0x7fd5e41a2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.091+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5e41004c0 0x7fd5e4197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:25.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.091+0000 7fd5ebe25700 1 --2- 172.21.15.70:0/1771284589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5e4100e70 0x7fd5e4198080 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:25.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.091+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 >> 172.21.15.70:0/1771284589 conn(0x7fd5e4074aa0 msgr2=0x7fd5e40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:25.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.091+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 shutdown_connections 2023-10-08T08:43:25.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:25.091+0000 7fd5ebe25700 1 -- 172.21.15.70:0/1771284589 wait complete. 2023-10-08T08:43:25.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-08T08:43:25.981 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:26.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:26 smithi070 ceph-mon[99513]: pgmap v279: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-10-08T08:43:26.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:26 smithi070 ceph-mon[99513]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:26.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:26 smithi105 ceph-mon[103798]: pgmap v279: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-10-08T08:43:26.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:26 smithi105 ceph-mon[103798]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:26.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:26 smithi191 ceph-mon[104220]: pgmap v279: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-10-08T08:43:26.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:26 smithi191 ceph-mon[104220]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 -- 172.21.15.70:0/1805250832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c100c60 msgr2=0x7f153c10c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1805250832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c100c60 0x7f153c10c5c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f153400b0a0 tx=0x7f153400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 -- 172.21.15.70:0/1805250832 shutdown_connections 2023-10-08T08:43:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1805250832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c100c60 0x7f153c10c5c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1805250832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f153c104720 0x7f153c104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1805250832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f153c1002a0 0x7f153c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 -- 172.21.15.70:0/1805250832 >> 172.21.15.70:0/1805250832 conn(0x7f153c074a10 msgr2=0x7f153c074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 -- 172.21.15.70:0/1805250832 shutdown_connections 2023-10-08T08:43:27.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 -- 172.21.15.70:0/1805250832 wait complete. 2023-10-08T08:43:27.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.215+0000 7f1541e8e700 1 Processor -- start 2023-10-08T08:43:27.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f1541e8e700 1 -- start start 2023-10-08T08:43:27.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f1541e8e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f153c1002a0 0x7f153c197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:27.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f1541e8e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f153c100c60 0x7f153c198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:27.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f1541e8e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c104720 0x7f153c1a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f1541e8e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c1989e0 con 0x7f153c104720 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f1541e8e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c1a31a0 con 0x7f153c1002a0 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f1541e8e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c1a32e0 con 0x7f153c100c60 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c104720 0x7f153c1a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c104720 0x7f153c1a2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50434/0 (socket says 172.21.15.70:50434) 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153bfff700 1 -- 172.21.15.70:0/1871079646 learned_addr learned my addr 172.21.15.70:0/1871079646 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153affd700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f153c100c60 0x7f153c198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153b7fe700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f153c1002a0 0x7f153c197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153bfff700 1 -- 172.21.15.70:0/1871079646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f153c100c60 msgr2=0x7f153c198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153bfff700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f153c100c60 0x7f153c198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153bfff700 1 -- 172.21.15.70:0/1871079646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f153c1002a0 msgr2=0x7f153c197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153bfff700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f153c1002a0 0x7f153c197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153bfff700 1 -- 172.21.15.70:0/1871079646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534009d00 con 0x7f153c104720 2023-10-08T08:43:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f153bfff700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c104720 0x7f153c1a2c60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f153400b070 tx=0x7f1534007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f1538ff9700 1 -- 172.21.15.70:0/1871079646 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153400e040 con 0x7f153c104720 2023-10-08T08:43:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.216+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c1a3500 con 0x7f153c104720 2023-10-08T08:43:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.217+0000 7f1538ff9700 1 -- 172.21.15.70:0/1871079646 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1534009440 con 0x7f153c104720 2023-10-08T08:43:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.217+0000 7f1538ff9700 1 -- 172.21.15.70:0/1871079646 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153401b6b0 con 0x7f153c104720 2023-10-08T08:43:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.217+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c1a3920 con 0x7f153c104720 2023-10-08T08:43:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.217+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c107c60 con 0x7f153c104720 2023-10-08T08:43:27.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.218+0000 7f1538ff9700 1 -- 172.21.15.70:0/1871079646 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f153401d480 con 0x7f153c104720 2023-10-08T08:43:27.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.219+0000 7f1538ff9700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15240a14d0 0x7f15240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:27.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.219+0000 7f153b7fe700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15240a14d0 0x7f15240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:27.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.219+0000 7f1538ff9700 1 -- 172.21.15.70:0/1871079646 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f15340ceef0 con 0x7f153c104720 2023-10-08T08:43:27.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.219+0000 7f153b7fe700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15240a14d0 0x7f15240a3990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f152c005fd0 tx=0x7f152c005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:27.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.222+0000 7f1538ff9700 1 -- 172.21.15.70:0/1871079646 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f15340981f0 con 0x7f153c104720 2023-10-08T08:43:27.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.418+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f153c0ff750 con 0x7f15240a14d0 2023-10-08T08:43:27.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.419+0000 7f1538ff9700 1 -- 172.21.15.70:0/1871079646 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f153c0ff750 con 0x7f15240a14d0 2023-10-08T08:43:27.420 INFO:teuthology.orchestra.run.smithi070.stdout:HOST ADDR LABELS STATUS 2023-10-08T08:43:27.421 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 172.21.15.70 2023-10-08T08:43:27.421 INFO:teuthology.orchestra.run.smithi070.stdout:smithi105 172.21.15.105 2023-10-08T08:43:27.421 INFO:teuthology.orchestra.run.smithi070.stdout:smithi191 172.21.15.191 2023-10-08T08:43:27.421 INFO:teuthology.orchestra.run.smithi070.stdout:3 hosts in cluster 2023-10-08T08:43:27.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15240a14d0 msgr2=0x7f15240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:27.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15240a14d0 0x7f15240a3990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f152c005fd0 tx=0x7f152c005db0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c104720 msgr2=0x7f153c1a2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:27.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c104720 0x7f153c1a2c60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f153400b070 tx=0x7f1534007920 comp rx=0 tx=0).stop 2023-10-08T08:43:27.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 shutdown_connections 2023-10-08T08:43:27.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f15240a14d0 0x7f15240a3990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f153c104720 0x7f153c1a2c60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f153c1002a0 0x7f153c197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 --2- 172.21.15.70:0/1871079646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f153c100c60 0x7f153c198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:27.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 >> 172.21.15.70:0/1871079646 conn(0x7f153c074a10 msgr2=0x7f153c0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:27.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 shutdown_connections 2023-10-08T08:43:27.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:27.422+0000 7f1541e8e700 1 -- 172.21.15.70:0/1871079646 wait complete. 2023-10-08T08:43:27.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-08T08:43:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:28.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:28 smithi070 ceph-mon[99513]: pgmap v280: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-10-08T08:43:28.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:28 smithi070 ceph-mon[99513]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:28.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:28 smithi105 ceph-mon[103798]: pgmap v280: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-10-08T08:43:28.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:28 smithi105 ceph-mon[103798]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:28.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:28 smithi191 ceph-mon[104220]: pgmap v280: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-10-08T08:43:28.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:28 smithi191 ceph-mon[104220]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:29.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.619+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3503384434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1008a0 msgr2=0x7f07cc100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:29.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.619+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3503384434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1008a0 0x7f07cc100d20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009990 tx=0x7f07bc009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.619+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3503384434 shutdown_connections 2023-10-08T08:43:29.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.619+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3503384434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07cc101260 0x7f07cc10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.619+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3503384434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07cc1057c0 0x7f07cc105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.619+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3503384434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1008a0 0x7f07cc100d20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.619+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3503384434 >> 172.21.15.70:0/3503384434 conn(0x7f07cc0779e0 msgr2=0x7f07cc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:29.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.619+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3503384434 shutdown_connections 2023-10-08T08:43:29.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.619+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3503384434 wait complete. 2023-10-08T08:43:29.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d3cdc700 1 Processor -- start 2023-10-08T08:43:29.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d3cdc700 1 -- start start 2023-10-08T08:43:29.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d3cdc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07cc1008a0 0x7f07cc19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:29.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d3cdc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07cc101260 0x7f07cc19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d3cdc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1057c0 0x7f07cc196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d3cdc700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc197150 con 0x7f07cc1057c0 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d3cdc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc1972c0 con 0x7f07cc101260 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d3cdc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc197480 con 0x7f07cc1008a0 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d2279700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1057c0 0x7f07cc196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d2279700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1057c0 0x7f07cc196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50448/0 (socket says 172.21.15.70:50448) 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d2279700 1 -- 172.21.15.70:0/3680734528 learned_addr learned my addr 172.21.15.70:0/3680734528 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d1277700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07cc101260 0x7f07cc19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d1a78700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07cc1008a0 0x7f07cc19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:29.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d2279700 1 -- 172.21.15.70:0/3680734528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07cc1008a0 msgr2=0x7f07cc19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d2279700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07cc1008a0 0x7f07cc19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d2279700 1 -- 172.21.15.70:0/3680734528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07cc101260 msgr2=0x7f07cc19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d2279700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07cc101260 0x7f07cc19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.620+0000 7f07d2279700 1 -- 172.21.15.70:0/3680734528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc0095f0 con 0x7f07cc1057c0 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.621+0000 7f07d2279700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1057c0 0x7f07cc196af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f07c4007f10 tx=0x7f07c400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.621+0000 7f07c2ffd700 1 -- 172.21.15.70:0/3680734528 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c4017070 con 0x7f07cc1057c0 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.621+0000 7f07c2ffd700 1 -- 172.21.15.70:0/3680734528 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07c400f040 con 0x7f07cc1057c0 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.621+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07cc197760 con 0x7f07cc1057c0 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.621+0000 7f07c2ffd700 1 -- 172.21.15.70:0/3680734528 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c4005740 con 0x7f07cc1057c0 2023-10-08T08:43:29.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.621+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc1a39a0 con 0x7f07cc1057c0 2023-10-08T08:43:29.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.622+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07cc108da0 con 0x7f07cc1057c0 2023-10-08T08:43:29.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.623+0000 7f07c2ffd700 1 -- 172.21.15.70:0/3680734528 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f07c400dc60 con 0x7f07cc1057c0 2023-10-08T08:43:29.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.624+0000 7f07c2ffd700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f07b80a14d0 0x7f07b80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:29.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.624+0000 7f07d1a78700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f07b80a14d0 0x7f07b80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:29.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.624+0000 7f07c2ffd700 1 -- 172.21.15.70:0/3680734528 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f07c40ccf40 con 0x7f07cc1057c0 2023-10-08T08:43:29.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.624+0000 7f07d1a78700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f07b80a14d0 0x7f07b80a3990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07c8006fd0 tx=0x7f07c8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:29.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.627+0000 7f07c2ffd700 1 -- 172.21.15.70:0/3680734528 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f07c40961b0 con 0x7f07cc1057c0 2023-10-08T08:43:29.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.826+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f07cc197fb0 con 0x7f07b80a14d0 2023-10-08T08:43:29.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.827+0000 7f07c2ffd700 1 -- 172.21.15.70:0/3680734528 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f07cc197fb0 con 0x7f07b80a14d0 2023-10-08T08:43:29.828 INFO:teuthology.orchestra.run.smithi070.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-08T08:43:29.829 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002P480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-08T08:43:29.829 INFO:teuthology.orchestra.run.smithi070.stdout:smithi105 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400TR400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-08T08:43:29.829 INFO:teuthology.orchestra.run.smithi070.stdout:smithi191 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303008M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-08T08:43:29.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f07b80a14d0 msgr2=0x7f07b80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:29.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f07b80a14d0 0x7f07b80a3990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07c8006fd0 tx=0x7f07c8008040 comp rx=0 tx=0).stop 2023-10-08T08:43:29.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1057c0 msgr2=0x7f07cc196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:29.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1057c0 0x7f07cc196af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f07c4007f10 tx=0x7f07c400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 shutdown_connections 2023-10-08T08:43:29.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f07b80a14d0 0x7f07b80a3990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07cc1057c0 0x7f07cc196af0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07cc1008a0 0x7f07cc19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 --2- 172.21.15.70:0/3680734528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07cc101260 0x7f07cc19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:29.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 >> 172.21.15.70:0/3680734528 conn(0x7f07cc0779e0 msgr2=0x7f07cc0fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:29.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 shutdown_connections 2023-10-08T08:43:29.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:29.829+0000 7f07d3cdc700 1 -- 172.21.15.70:0/3680734528 wait complete. 2023-10-08T08:43:30.164 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T08:43:30.173 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:43:30.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-08T08:43:30.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:30 smithi070 ceph-mon[99513]: pgmap v281: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-10-08T08:43:30.730 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:30.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:30 smithi105 ceph-mon[103798]: pgmap v281: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-10-08T08:43:30.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:30 smithi191 ceph-mon[104220]: pgmap v281: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-10-08T08:43:31.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:31 smithi070 ceph-mon[99513]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:31.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:31 smithi105 ceph-mon[103798]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:31.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:31 smithi191 ceph-mon[104220]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:31.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.970+0000 7f16a4b9f700 1 -- 172.21.15.70:0/1189343771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01015c0 msgr2=0x7f16a01019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.970+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/1189343771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01015c0 0x7f16a01019a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1690009990 tx=0x7f1690009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.970+0000 7f16a4b9f700 1 -- 172.21.15.70:0/1189343771 shutdown_connections 2023-10-08T08:43:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.970+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/1189343771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a0100a70 0x7f16a010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.970+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/1189343771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01015c0 0x7f16a01019a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.970+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/1189343771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16a01000b0 0x7f16a0100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.970+0000 7f16a4b9f700 1 -- 172.21.15.70:0/1189343771 >> 172.21.15.70:0/1189343771 conn(0x7f16a00748d0 msgr2=0x7f16a0074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.970+0000 7f16a4b9f700 1 -- 172.21.15.70:0/1189343771 shutdown_connections 2023-10-08T08:43:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.970+0000 7f16a4b9f700 1 -- 172.21.15.70:0/1189343771 wait complete. 2023-10-08T08:43:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.971+0000 7f16a4b9f700 1 Processor -- start 2023-10-08T08:43:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.971+0000 7f16a4b9f700 1 -- start start 2023-10-08T08:43:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.971+0000 7f16a4b9f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01000b0 0x7f16a0198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f16a4b9f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a0100a70 0x7f16a0199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f16a4b9f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16a01015c0 0x7f16a019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f16a4b9f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a019dde0 con 0x7f16a01000b0 2023-10-08T08:43:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f16a4b9f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a019df50 con 0x7f16a01015c0 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f16a4b9f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a019e110 con 0x7f16a0100a70 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01000b0 0x7f16a0198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01000b0 0x7f16a0198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50458/0 (socket says 172.21.15.70:50458) 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169f7fe700 1 -- 172.21.15.70:0/4290400815 learned_addr learned my addr 172.21.15.70:0/4290400815 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169effd700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a0100a70 0x7f16a0199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169ffff700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16a01015c0 0x7f16a019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169f7fe700 1 -- 172.21.15.70:0/4290400815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a0100a70 msgr2=0x7f16a0199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169f7fe700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a0100a70 0x7f16a0199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169f7fe700 1 -- 172.21.15.70:0/4290400815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16a01015c0 msgr2=0x7f16a019d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169f7fe700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16a01015c0 0x7f16a019d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169f7fe700 1 -- 172.21.15.70:0/4290400815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16900095f0 con 0x7f16a01000b0 2023-10-08T08:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169ffff700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16a01015c0 0x7f16a019d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169f7fe700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01000b0 0x7f16a0198ee0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1690005910 tx=0x7f1690009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169cff9700 1 -- 172.21.15.70:0/4290400815 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169001d070 con 0x7f16a01000b0 2023-10-08T08:43:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a019e390 con 0x7f16a01000b0 2023-10-08T08:43:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169cff9700 1 -- 172.21.15.70:0/4290400815 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1690004cf0 con 0x7f16a01000b0 2023-10-08T08:43:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f169cff9700 1 -- 172.21.15.70:0/4290400815 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000f950 con 0x7f16a01000b0 2023-10-08T08:43:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.972+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a01a5a80 con 0x7f16a01000b0 2023-10-08T08:43:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.973+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a00fe730 con 0x7f16a01000b0 2023-10-08T08:43:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.974+0000 7f169cff9700 1 -- 172.21.15.70:0/4290400815 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f1690005120 con 0x7f16a01000b0 2023-10-08T08:43:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.975+0000 7f169cff9700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f168c0a14d0 0x7f168c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.975+0000 7f169effd700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f168c0a14d0 0x7f168c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.975+0000 7f169cff9700 1 -- 172.21.15.70:0/4290400815 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f16900ce1c0 con 0x7f16a01000b0 2023-10-08T08:43:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.976+0000 7f169effd700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f168c0a14d0 0x7f168c0a3990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1688005950 tx=0x7f16880058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:31.980+0000 7f169cff9700 1 -- 172.21.15.70:0/4290400815 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f169005c100 con 0x7f16a01000b0 2023-10-08T08:43:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.210+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f16a0067d30 con 0x7f16a01000b0 2023-10-08T08:43:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.210+0000 7f169cff9700 1 -- 172.21.15.70:0/4290400815 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2977 (secure 0 0 0) 0x7f16900974c0 con 0x7f16a01000b0 2023-10-08T08:43:32.212 INFO:teuthology.orchestra.run.smithi070.stdout:e27 2023-10-08T08:43:32.212 INFO:teuthology.orchestra.run.smithi070.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T08:43:32.212 INFO:teuthology.orchestra.run.smithi070.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T08:43:32.212 INFO:teuthology.orchestra.run.smithi070.stdout:legacy client fscid: 1 2023-10-08T08:43:32.212 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:32.212 INFO:teuthology.orchestra.run.smithi070.stdout:Filesystem 'cephfs' (1) 2023-10-08T08:43:32.212 INFO:teuthology.orchestra.run.smithi070.stdout:fs_name cephfs 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 27 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:created 2023-10-08T08:42:00.508850+0000 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2023-10-08T08:42:29.077123+0000 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:tableserver 0 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:root 0 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:session_timeout 300 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:session_autoclose 300 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:max_file_size 1099511627776 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:max_xattr_size 65536 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:required_client_features {} 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure 0 2023-10-08T08:43:32.213 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure_osd_epoch 0 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:max_mds 5 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:in 0,1,2,3,4 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:up {0=24638,1=24605,2=24604,3=24589,4=24577} 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:failed 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:damaged 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:stopped 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:data_pools [3,4] 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:metadata_pool 2 2023-10-08T08:43:32.214 INFO:teuthology.orchestra.run.smithi070.stdout:inline_data disabled 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:balancer 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:bal_rank_mask -1 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:standby_count_wanted 0 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b{0:24638} state up:active seq 3 addr [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.e{0:24572} state up:standby-replay seq 1 addr [v2:172.21.15.105:6834/2412806046,v1:172.21.15.105:6835/2412806046] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.h{1:24605} state up:active seq 11 addr [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.k{1:24554} state up:standby-replay seq 1 addr [v2:172.21.15.105:6832/1292328490,v1:172.21.15.105:6833/1292328490] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.i{2:24604} state up:active seq 11 addr [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.l{2:24541} state up:standby-replay seq 1 addr [v2:172.21.15.191:6832/2360801114,v1:172.21.15.191:6833/2360801114] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c{3:24589} state up:active seq 12 addr [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.216 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a{3:14793} state up:standby-replay seq 1 addr [v2:172.21.15.70:6840/1499461306,v1:172.21.15.70:6841/1499461306] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.216 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.f{4:24577} state up:active seq 13 addr [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.216 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.g{4:14781} state up:standby-replay seq 1 addr [v2:172.21.15.70:6838/3288548320,v1:172.21.15.70:6839/3288548320] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:32.216 INFO:teuthology.orchestra.run.smithi070.stdout:Standby daemons: 2023-10-08T08:43:32.216 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:32.216 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.j{-1:14721} state up:standby seq 1 addr [v2:172.21.15.70:6834/915276133,v1:172.21.15.70:6835/915276133] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.216 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d{-1:14727} state up:standby seq 1 addr [v2:172.21.15.70:6836/3566538223,v1:172.21.15.70:6837/3566538223] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T08:43:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f168c0a14d0 msgr2=0x7f168c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f168c0a14d0 0x7f168c0a3990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1688005950 tx=0x7f16880058e0 comp rx=0 tx=0).stop 2023-10-08T08:43:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01000b0 msgr2=0x7f16a0198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01000b0 0x7f16a0198ee0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1690005910 tx=0x7f1690009510 comp rx=0 tx=0).stop 2023-10-08T08:43:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 shutdown_connections 2023-10-08T08:43:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f168c0a14d0 0x7f168c0a3990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16a01015c0 0x7f16a019d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a01000b0 0x7f16a0198ee0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 --2- 172.21.15.70:0/4290400815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a0100a70 0x7f16a0199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.212+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 >> 172.21.15.70:0/4290400815 conn(0x7f16a00748d0 msgr2=0x7f16a0102410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.213+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 shutdown_connections 2023-10-08T08:43:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:32.213+0000 7f16a4b9f700 1 -- 172.21.15.70:0/4290400815 wait complete. 2023-10-08T08:43:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:43:32.547 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:32 smithi070 ceph-mon[99513]: pgmap v282: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:32.547 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:32 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4290400815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T08:43:32.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-08T08:43:32.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:32 smithi105 ceph-mon[103798]: pgmap v282: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:32.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:32 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4290400815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T08:43:32.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:32 smithi191 ceph-mon[104220]: pgmap v282: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:32.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:32 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4290400815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T08:43:33.152 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:34.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.312+0000 7fafbc7da700 1 -- 172.21.15.70:0/1662178078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb4100110 msgr2=0x7fafb410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:34.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.312+0000 7fafbc7da700 1 --2- 172.21.15.70:0/1662178078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb4100110 0x7fafb410c580 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fafac00b0a0 tx=0x7fafac00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.312+0000 7fafbc7da700 1 -- 172.21.15.70:0/1662178078 shutdown_connections 2023-10-08T08:43:34.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.312+0000 7fafbc7da700 1 --2- 172.21.15.70:0/1662178078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb4100110 0x7fafb410c580 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.312+0000 7fafbc7da700 1 --2- 172.21.15.70:0/1662178078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafb41056b0 0x7fafb4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.312+0000 7fafbc7da700 1 --2- 172.21.15.70:0/1662178078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb40ff750 0x7fafb40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.312+0000 7fafbc7da700 1 -- 172.21.15.70:0/1662178078 >> 172.21.15.70:0/1662178078 conn(0x7fafb4075790 msgr2=0x7fafb4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:34.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.312+0000 7fafbc7da700 1 -- 172.21.15.70:0/1662178078 shutdown_connections 2023-10-08T08:43:34.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.312+0000 7fafbc7da700 1 -- 172.21.15.70:0/1662178078 wait complete. 2023-10-08T08:43:34.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafbc7da700 1 Processor -- start 2023-10-08T08:43:34.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafbc7da700 1 -- start start 2023-10-08T08:43:34.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafbc7da700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb40ff750 0x7fafb4101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:34.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafbc7da700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb4100110 0x7fafb41017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:34.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafbc7da700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafb41056b0 0x7fafb4101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:34.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafbc7da700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb41a5200 con 0x7fafb40ff750 2023-10-08T08:43:34.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafbc7da700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb41a5370 con 0x7fafb4100110 2023-10-08T08:43:34.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafbc7da700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb41a5530 con 0x7fafb41056b0 2023-10-08T08:43:34.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafba576700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb40ff750 0x7fafb4101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:34.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafba576700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb40ff750 0x7fafb4101280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50472/0 (socket says 172.21.15.70:50472) 2023-10-08T08:43:34.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafba576700 1 -- 172.21.15.70:0/4092878573 learned_addr learned my addr 172.21.15.70:0/4092878573 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:34.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.313+0000 7fafb9d75700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb4100110 0x7fafb41017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:34.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafbad77700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafb41056b0 0x7fafb4101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:34.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafba576700 1 -- 172.21.15.70:0/4092878573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafb41056b0 msgr2=0x7fafb4101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:34.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafba576700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafb41056b0 0x7fafb4101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafba576700 1 -- 172.21.15.70:0/4092878573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb4100110 msgr2=0x7fafb41017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:34.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafba576700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb4100110 0x7fafb41017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafba576700 1 -- 172.21.15.70:0/4092878573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac009d00 con 0x7fafb40ff750 2023-10-08T08:43:34.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafba576700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb40ff750 0x7fafb4101280 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b530 tx=0x7fafb000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:34.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafab7fe700 1 -- 172.21.15.70:0/4092878573 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0011830 con 0x7fafb40ff750 2023-10-08T08:43:34.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafab7fe700 1 -- 172.21.15.70:0/4092878573 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafb0011e50 con 0x7fafb40ff750 2023-10-08T08:43:34.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb41a5810 con 0x7fafb40ff750 2023-10-08T08:43:34.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafab7fe700 1 -- 172.21.15.70:0/4092878573 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000f2e0 con 0x7fafb40ff750 2023-10-08T08:43:34.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.314+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb41a5d10 con 0x7fafb40ff750 2023-10-08T08:43:34.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.315+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb4108ce0 con 0x7fafb40ff750 2023-10-08T08:43:34.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.316+0000 7fafab7fe700 1 -- 172.21.15.70:0/4092878573 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fafb0010380 con 0x7fafb40ff750 2023-10-08T08:43:34.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.317+0000 7fafab7fe700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fafa00a14d0 0x7fafa00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:34.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.317+0000 7fafb9d75700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fafa00a14d0 0x7fafa00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:34.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.317+0000 7fafab7fe700 1 -- 172.21.15.70:0/4092878573 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fafb00cd2d0 con 0x7fafb40ff750 2023-10-08T08:43:34.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.317+0000 7fafb9d75700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fafa00a14d0 0x7fafa00a3990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fafb4102960 tx=0x7fafa4009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:34.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.320+0000 7fafab7fe700 1 -- 172.21.15.70:0/4092878573 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fafb00964e0 con 0x7fafb40ff750 2023-10-08T08:43:34.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.510+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fafb4102710 con 0x7fafb40ff750 2023-10-08T08:43:34.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.511+0000 7fafab7fe700 1 -- 172.21.15.70:0/4092878573 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5987 (secure 0 0 0) 0x7fafb0099b00 con 0x7fafb40ff750 2023-10-08T08:43:34.512 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 88 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:created 2023-10-08T08:34:39.696066+0000 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2023-10-08T08:42:40.267583+0000 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 27 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2023-10-08T08:43:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client luminous 2023-10-08T08:43:34.514 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release reef 2023-10-08T08:43:34.514 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2023-10-08T08:43:34.514 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-08T08:43:34.514 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2023-10-08T08:43:34.514 INFO:teuthology.orchestra.run.smithi070.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2023-10-08T08:43:34.514 INFO:teuthology.orchestra.run.smithi070.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 12 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 9 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6802/2462488428,v1:172.21.15.70:6803/2462488428] [v2:172.21.15.70:6804/2462488428,v1:172.21.15.70:6805/2462488428] exists,up e8cad845-82ee-41e7-ac3e-d24a2ee07b70 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 14 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6800/898277124,v1:172.21.15.105:6801/898277124] [v2:172.21.15.105:6802/898277124,v1:172.21.15.105:6803/898277124] exists,up b3b37cb8-fe51-4f85-9ffc-5519bc4556c4 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 19 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6800/1578654309,v1:172.21.15.191:6801/1578654309] [v2:172.21.15.191:6802/1578654309,v1:172.21.15.191:6803/1578654309] exists,up f582afa9-c586-4006-b266-e0bbb3976b53 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6810/2319296502,v1:172.21.15.70:6811/2319296502] [v2:172.21.15.70:6812/2319296502,v1:172.21.15.70:6813/2319296502] exists,up c4bbfa87-a5af-4322-bc0e-f5f97d3fe053 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 up in weight 1 up_from 33 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6808/2528806135,v1:172.21.15.105:6809/2528806135] [v2:172.21.15.105:6810/2528806135,v1:172.21.15.105:6811/2528806135] exists,up e75c81f9-f784-47dd-8db2-cc0c3da2ea42 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 up in weight 1 up_from 38 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6808/3480587463,v1:172.21.15.191:6809/3480587463] [v2:172.21.15.191:6810/3480587463,v1:172.21.15.191:6811/3480587463] exists,up fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 up in weight 1 up_from 46 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6818/2512675210,v1:172.21.15.70:6819/2512675210] [v2:172.21.15.70:6820/2512675210,v1:172.21.15.70:6821/2512675210] exists,up a61e4df7-535c-4870-9f56-828ead178a58 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 up in weight 1 up_from 51 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6816/591750025,v1:172.21.15.105:6817/591750025] [v2:172.21.15.105:6818/591750025,v1:172.21.15.105:6819/591750025] exists,up acd9b422-1496-46dd-b947-fc8f8bab8398 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 up in weight 1 up_from 58 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6816/1026056491,v1:172.21.15.191:6817/1026056491] [v2:172.21.15.191:6818/1026056491,v1:172.21.15.191:6819/1026056491] exists,up fffb4528-d810-483d-a63b-744ae1ab17fd 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 up in weight 1 up_from 65 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6826/4105424601,v1:172.21.15.70:6827/4105424601] [v2:172.21.15.70:6828/4105424601,v1:172.21.15.70:6829/4105424601] exists,up 7ff2f169-52f3-4b84-91ac-ae5b97b27bab 2023-10-08T08:43:34.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 up in weight 1 up_from 70 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6824/911786652,v1:172.21.15.105:6825/911786652] [v2:172.21.15.105:6826/911786652,v1:172.21.15.105:6827/911786652] exists,up 4a718b26-f154-454f-8756-acebf09a6e05 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 up in weight 1 up_from 77 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6824/1547082968,v1:172.21.15.191:6825/1547082968] [v2:172.21.15.191:6826/1547082968,v1:172.21.15.191:6827/1547082968] exists,up b2d38075-48f4-4e3d-9886-8b1fcf7162dd 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.8 [2,11] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.a [2,11] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.3 [4,9] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.23 [4,8] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.2c [4,9] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.33 [5,9] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.2 [9,1] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.5 [5,8] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.17 [9,8] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.1c [9,10] 2023-10-08T08:43:34.516 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/3825871538 expires 2023-10-09T08:36:38.980084+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3658176342 expires 2023-10-09T08:36:38.980084+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3301361990 expires 2023-10-09T08:36:38.980084+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3846422459 expires 2023-10-09T08:36:38.980084+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/4070856372 expires 2023-10-09T08:35:35.987952+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/1873815706 expires 2023-10-09T08:35:35.987952+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/2782530370 expires 2023-10-09T08:35:35.987952+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/1161134171 expires 2023-10-09T08:35:13.093969+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/741640578 expires 2023-10-09T08:35:13.093969+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/2321306431 expires 2023-10-09T08:35:13.093969+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/1852102021 expires 2023-10-09T08:35:13.093969+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/3825871538 expires 2023-10-09T08:36:38.980084+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/1161134171 expires 2023-10-09T08:35:13.093969+0000 2023-10-08T08:43:34.517 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/1882565327 expires 2023-10-09T08:35:35.987952+0000 2023-10-08T08:43:34.518 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/2782530370 expires 2023-10-09T08:35:35.987952+0000 2023-10-08T08:43:34.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fafa00a14d0 msgr2=0x7fafa00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:34.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fafa00a14d0 0x7fafa00a3990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fafb4102960 tx=0x7fafa4009190 comp rx=0 tx=0).stop 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb40ff750 msgr2=0x7fafb4101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb40ff750 0x7fafb4101280 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b530 tx=0x7fafb000b840 comp rx=0 tx=0).stop 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 shutdown_connections 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fafa00a14d0 0x7fafa00a3990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafb41056b0 0x7fafb4101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafb40ff750 0x7fafb4101280 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 --2- 172.21.15.70:0/4092878573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb4100110 0x7fafb41017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 >> 172.21.15.70:0/4092878573 conn(0x7fafb4075790 msgr2=0x7fafb4068570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 shutdown_connections 2023-10-08T08:43:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:34.513+0000 7fafbc7da700 1 -- 172.21.15.70:0/4092878573 wait complete. 2023-10-08T08:43:34.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:34 smithi070 ceph-mon[99513]: pgmap v283: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-10-08T08:43:34.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:34 smithi105 ceph-mon[103798]: pgmap v283: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-10-08T08:43:34.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:34 smithi191 ceph-mon[104220]: pgmap v283: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-10-08T08:43:34.915 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-08T08:43:34.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:35.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.052+0000 7f57b3875700 1 -- 172.21.15.70:0/3937701460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 msgr2=0x7f57ac106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.052+0000 7f57b3875700 1 --2- 172.21.15.70:0/3937701460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 0x7f57ac106a10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f579c009990 tx=0x7f579c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.052+0000 7f57b3875700 1 -- 172.21.15.70:0/3937701460 shutdown_connections 2023-10-08T08:43:35.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.052+0000 7f57b3875700 1 --2- 172.21.15.70:0/3937701460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac0ff510 0x7f57ac10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.052+0000 7f57b3875700 1 --2- 172.21.15.70:0/3937701460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 0x7f57ac106a10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.052+0000 7f57b3875700 1 --2- 172.21.15.70:0/3937701460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57ac0feb50 0x7f57ac0fefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.052+0000 7f57b3875700 1 -- 172.21.15.70:0/3937701460 >> 172.21.15.70:0/3937701460 conn(0x7f57ac075a90 msgr2=0x7f57ac0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:35.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.052+0000 7f57b3875700 1 -- 172.21.15.70:0/3937701460 shutdown_connections 2023-10-08T08:43:35.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.052+0000 7f57b3875700 1 -- 172.21.15.70:0/3937701460 wait complete. 2023-10-08T08:43:35.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b3875700 1 Processor -- start 2023-10-08T08:43:35.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b3875700 1 -- start start 2023-10-08T08:43:35.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b3875700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac0feb50 0x7f57ac0ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b3875700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57ac0ff510 0x7f57ac100270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b3875700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 0x7f57ac1007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b3875700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac1a4e10 con 0x7f57ac106630 2023-10-08T08:43:35.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b3875700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac1a4f80 con 0x7f57ac0feb50 2023-10-08T08:43:35.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b3875700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac1a5140 con 0x7f57ac0ff510 2023-10-08T08:43:35.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1e12700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 0x7f57ac1007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1e12700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 0x7f57ac1007b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50488/0 (socket says 172.21.15.70:50488) 2023-10-08T08:43:35.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1e12700 1 -- 172.21.15.70:0/2939328418 learned_addr learned my addr 172.21.15.70:0/2939328418 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:35.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b0e10700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57ac0ff510 0x7f57ac100270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1611700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac0feb50 0x7f57ac0ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1e12700 1 -- 172.21.15.70:0/2939328418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57ac0ff510 msgr2=0x7f57ac100270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1e12700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57ac0ff510 0x7f57ac100270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1e12700 1 -- 172.21.15.70:0/2939328418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac0feb50 msgr2=0x7f57ac0ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1e12700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac0feb50 0x7f57ac0ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1e12700 1 -- 172.21.15.70:0/2939328418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0095f0 con 0x7f57ac106630 2023-10-08T08:43:35.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.053+0000 7f57b1e12700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 0x7f57ac1007b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f57a400ef30 tx=0x7f57a400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:35.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.054+0000 7f57a27fc700 1 -- 172.21.15.70:0/2939328418 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4018070 con 0x7f57ac106630 2023-10-08T08:43:35.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.054+0000 7f57a27fc700 1 -- 172.21.15.70:0/2939328418 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57a400f040 con 0x7f57ac106630 2023-10-08T08:43:35.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.054+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac1a53c0 con 0x7f57ac106630 2023-10-08T08:43:35.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.054+0000 7f57a27fc700 1 -- 172.21.15.70:0/2939328418 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4003dc0 con 0x7f57ac106630 2023-10-08T08:43:35.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.054+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac1a5880 con 0x7f57ac106630 2023-10-08T08:43:35.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.054+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac108bb0 con 0x7f57ac106630 2023-10-08T08:43:35.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.056+0000 7f57a27fc700 1 -- 172.21.15.70:0/2939328418 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f57a400caa0 con 0x7f57ac106630 2023-10-08T08:43:35.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.056+0000 7f57a27fc700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57980a14d0 0x7f57980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.056+0000 7f57b1611700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57980a14d0 0x7f57980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.057+0000 7f57a27fc700 1 -- 172.21.15.70:0/2939328418 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f57a40cd760 con 0x7f57ac106630 2023-10-08T08:43:35.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.057+0000 7f57b1611700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57980a14d0 0x7f57980a3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f579c006010 tx=0x7f579c00b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:35.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.060+0000 7f57a27fc700 1 -- 172.21.15.70:0/2939328418 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f57a4096a60 con 0x7f57ac106630 2023-10-08T08:43:35.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.256+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57ac066bc0 con 0x7f57ac106630 2023-10-08T08:43:35.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.258+0000 7f57a27fc700 1 -- 172.21.15.70:0/2939328418 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7f57a409a080 con 0x7f57ac106630 2023-10-08T08:43:35.259 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:35.259 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57980a14d0 msgr2=0x7f57980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57980a14d0 0x7f57980a3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f579c006010 tx=0x7f579c00b260 comp rx=0 tx=0).stop 2023-10-08T08:43:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 msgr2=0x7f57ac1007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 0x7f57ac1007b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f57a400ef30 tx=0x7f57a400c450 comp rx=0 tx=0).stop 2023-10-08T08:43:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 shutdown_connections 2023-10-08T08:43:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f57980a14d0 0x7f57980a3990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57ac106630 0x7f57ac1007b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac0feb50 0x7f57ac0ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 --2- 172.21.15.70:0/2939328418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57ac0ff510 0x7f57ac100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 >> 172.21.15.70:0/2939328418 conn(0x7f57ac075a90 msgr2=0x7f57ac0fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:35.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 shutdown_connections 2023-10-08T08:43:35.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.260+0000 7f57b3875700 1 -- 172.21.15.70:0/2939328418 wait complete. 2023-10-08T08:43:35.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:43:35.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 -- 172.21.15.70:0/2226120209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 msgr2=0x7fcef010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 --2- 172.21.15.70:0/2226120209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 0x7fcef010d590 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcee800b0d0 tx=0x7fcee800b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 -- 172.21.15.70:0/2226120209 shutdown_connections 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 --2- 172.21.15.70:0/2226120209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 0x7fcef010d590 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 --2- 172.21.15.70:0/2226120209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef0067ce0 0x7fcef00680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 --2- 172.21.15.70:0/2226120209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcef01051c0 0x7fcef0105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 -- 172.21.15.70:0/2226120209 >> 172.21.15.70:0/2226120209 conn(0x7fcef0076780 msgr2=0x7fcef0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 -- 172.21.15.70:0/2226120209 shutdown_connections 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 -- 172.21.15.70:0/2226120209 wait complete. 2023-10-08T08:43:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 Processor -- start 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 -- start start 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.398+0000 7fcef8431700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef0067ce0 0x7fcef00ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef8431700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcef01051c0 0x7fcef00ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef8431700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 0x7fcef0100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef8431700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef01a50a0 con 0x7fcef0105b80 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef8431700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef01a5210 con 0x7fcef0067ce0 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef8431700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef01a53d0 con 0x7fcef01051c0 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef69ce700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 0x7fcef0100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef69ce700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 0x7fcef0100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50500/0 (socket says 172.21.15.70:50500) 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef69ce700 1 -- 172.21.15.70:0/4090574536 learned_addr learned my addr 172.21.15.70:0/4090574536 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef59cc700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcef01051c0 0x7fcef00ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef61cd700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef0067ce0 0x7fcef00ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef69ce700 1 -- 172.21.15.70:0/4090574536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcef01051c0 msgr2=0x7fcef00ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef69ce700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcef01051c0 0x7fcef00ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef69ce700 1 -- 172.21.15.70:0/4090574536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef0067ce0 msgr2=0x7fcef00ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef69ce700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef0067ce0 0x7fcef00ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef69ce700 1 -- 172.21.15.70:0/4090574536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8009d00 con 0x7fcef0105b80 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef69ce700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 0x7fcef0100130 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcee800bd50 tx=0x7fcee800bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcee77fe700 1 -- 172.21.15.70:0/4090574536 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee800e040 con 0x7fcef0105b80 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcee77fe700 1 -- 172.21.15.70:0/4090574536 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcee801b8e0 con 0x7fcef0105b80 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcee77fe700 1 -- 172.21.15.70:0/4090574536 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80128f0 con 0x7fcef0105b80 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef01a5650 con 0x7fcef0105b80 2023-10-08T08:43:35.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.399+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef01a5a80 con 0x7fcef0105b80 2023-10-08T08:43:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.400+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef0108c70 con 0x7fcef0105b80 2023-10-08T08:43:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.401+0000 7fcee77fe700 1 -- 172.21.15.70:0/4090574536 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fcee801ba50 con 0x7fcef0105b80 2023-10-08T08:43:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.402+0000 7fcee77fe700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcedc0a1550 0x7fcedc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.402+0000 7fcee77fe700 1 -- 172.21.15.70:0/4090574536 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcee80ce860 con 0x7fcef0105b80 2023-10-08T08:43:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.402+0000 7fcef61cd700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcedc0a1550 0x7fcedc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.402+0000 7fcef61cd700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcedc0a1550 0x7fcedc0a3a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcee0005950 tx=0x7fcee000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:35.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.405+0000 7fcee77fe700 1 -- 172.21.15.70:0/4090574536 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcee8097b60 con 0x7fcef0105b80 2023-10-08T08:43:35.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.594+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcef0100b90 con 0x7fcef0105b80 2023-10-08T08:43:35.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.594+0000 7fcee77fe700 1 -- 172.21.15.70:0/4090574536 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcee809b180 con 0x7fcef0105b80 2023-10-08T08:43:35.596 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:43:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.596+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcedc0a1550 msgr2=0x7fcedc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.596+0000 7fcef8431700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcedc0a1550 0x7fcedc0a3a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcee0005950 tx=0x7fcee000b410 comp rx=0 tx=0).stop 2023-10-08T08:43:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.596+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 msgr2=0x7fcef0100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.596+0000 7fcef8431700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 0x7fcef0100130 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcee800bd50 tx=0x7fcee800bd80 comp rx=0 tx=0).stop 2023-10-08T08:43:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.597+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 shutdown_connections 2023-10-08T08:43:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.597+0000 7fcef8431700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcedc0a1550 0x7fcedc0a3a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.597+0000 7fcef8431700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcef0105b80 0x7fcef0100130 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.597+0000 7fcef8431700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef0067ce0 0x7fcef00ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.597+0000 7fcef8431700 1 --2- 172.21.15.70:0/4090574536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcef01051c0 0x7fcef00ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.597+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 >> 172.21.15.70:0/4090574536 conn(0x7fcef0076780 msgr2=0x7fcef00fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:35.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.597+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 shutdown_connections 2023-10-08T08:43:35.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.597+0000 7fcef8431700 1 -- 172.21.15.70:0/4090574536 wait complete. 2023-10-08T08:43:35.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:35 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4092878573' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T08:43:35.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:35 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2939328418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:35.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:43:35.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.733+0000 7fcd65773700 1 -- 172.21.15.70:0/273612829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd600ff640 msgr2=0x7fcd600ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.733+0000 7fcd65773700 1 --2- 172.21.15.70:0/273612829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd600ff640 0x7fcd600ffac0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009990 tx=0x7fcd48009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.733+0000 7fcd65773700 1 -- 172.21.15.70:0/273612829 shutdown_connections 2023-10-08T08:43:35.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.733+0000 7fcd65773700 1 --2- 172.21.15.70:0/273612829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd60100000 0x7fcd6010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.733+0000 7fcd65773700 1 --2- 172.21.15.70:0/273612829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60105650 0x7fcd60105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.733+0000 7fcd65773700 1 --2- 172.21.15.70:0/273612829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd600ff640 0x7fcd600ffac0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.733+0000 7fcd65773700 1 -- 172.21.15.70:0/273612829 >> 172.21.15.70:0/273612829 conn(0x7fcd600767c0 msgr2=0x7fcd60076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:35.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.733+0000 7fcd65773700 1 -- 172.21.15.70:0/273612829 shutdown_connections 2023-10-08T08:43:35.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.733+0000 7fcd65773700 1 -- 172.21.15.70:0/273612829 wait complete. 2023-10-08T08:43:35.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd65773700 1 Processor -- start 2023-10-08T08:43:35.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd65773700 1 -- start start 2023-10-08T08:43:35.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd65773700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd600ff640 0x7fcd6019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd65773700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd60100000 0x7fcd6019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd65773700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60105650 0x7fcd60195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd65773700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60195f70 con 0x7fcd60100000 2023-10-08T08:43:35.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd65773700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd601960e0 con 0x7fcd600ff640 2023-10-08T08:43:35.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd65773700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd601962a0 con 0x7fcd60105650 2023-10-08T08:43:35.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd5e7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd60100000 0x7fcd6019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd5e7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd60100000 0x7fcd6019bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50512/0 (socket says 172.21.15.70:50512) 2023-10-08T08:43:35.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd5e7fc700 1 -- 172.21.15.70:0/1220021832 learned_addr learned my addr 172.21.15.70:0/1220021832 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:35.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd5f7fe700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60105650 0x7fcd60195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.734+0000 7fcd5effd700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd600ff640 0x7fcd6019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd5e7fc700 1 -- 172.21.15.70:0/1220021832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60105650 msgr2=0x7fcd60195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd5e7fc700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60105650 0x7fcd60195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd5e7fc700 1 -- 172.21.15.70:0/1220021832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd600ff640 msgr2=0x7fcd6019b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd5e7fc700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd600ff640 0x7fcd6019b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd5e7fc700 1 -- 172.21.15.70:0/1220021832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd480095f0 con 0x7fcd60100000 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd5e7fc700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd60100000 0x7fcd6019bd20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcd480095c0 tx=0x7fcd4800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd57fff700 1 -- 172.21.15.70:0/1220021832 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4801d070 con 0x7fcd60100000 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd57fff700 1 -- 172.21.15.70:0/1220021832 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd48005030 con 0x7fcd60100000 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd60196520 con 0x7fcd60100000 2023-10-08T08:43:35.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd57fff700 1 -- 172.21.15.70:0/1220021832 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48004a90 con 0x7fcd60100000 2023-10-08T08:43:35.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.735+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd601a27d0 con 0x7fcd60100000 2023-10-08T08:43:35.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.736+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd60107bd0 con 0x7fcd60100000 2023-10-08T08:43:35.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.737+0000 7fcd57fff700 1 -- 172.21.15.70:0/1220021832 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fcd48005410 con 0x7fcd60100000 2023-10-08T08:43:35.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.737+0000 7fcd57fff700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:35.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.737+0000 7fcd5effd700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:35.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.737+0000 7fcd57fff700 1 -- 172.21.15.70:0/1220021832 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcd480ce2d0 con 0x7fcd60100000 2023-10-08T08:43:35.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.738+0000 7fcd5effd700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009550 tx=0x7fcd500091b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:35.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.741+0000 7fcd57fff700 1 -- 172.21.15.70:0/1220021832 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcd480975d0 con 0x7fcd60100000 2023-10-08T08:43:35.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:35 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4092878573' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T08:43:35.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:35 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2939328418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:35.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:35 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4092878573' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T08:43:35.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:35 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2939328418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:35.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.931+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd60066d00 con 0x7fcd60100000 2023-10-08T08:43:35.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.931+0000 7fcd57fff700 1 -- 172.21.15.70:0/1220021832 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd4809abf0 con 0x7fcd60100000 2023-10-08T08:43:35.933 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd4c0a14d0 msgr2=0x7fcd4c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009550 tx=0x7fcd500091b0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd60100000 msgr2=0x7fcd6019bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd60100000 0x7fcd6019bd20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcd480095c0 tx=0x7fcd4800f690 comp rx=0 tx=0).stop 2023-10-08T08:43:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 shutdown_connections 2023-10-08T08:43:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd60105650 0x7fcd60195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd600ff640 0x7fcd6019b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 --2- 172.21.15.70:0/1220021832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd60100000 0x7fcd6019bd20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.933+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 >> 172.21.15.70:0/1220021832 conn(0x7fcd600767c0 msgr2=0x7fcd600fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.934+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 shutdown_connections 2023-10-08T08:43:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:35.934+0000 7fcd65773700 1 -- 172.21.15.70:0/1220021832 wait complete. 2023-10-08T08:43:35.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:43:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.070+0000 7f0de440e700 1 -- 172.21.15.70:0/3770662029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0ff620 msgr2=0x7f0ddc0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.070+0000 7f0de440e700 1 --2- 172.21.15.70:0/3770662029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0ff620 0x7f0ddc0ffaa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009990 tx=0x7f0dd8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.070+0000 7f0de440e700 1 -- 172.21.15.70:0/3770662029 shutdown_connections 2023-10-08T08:43:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.070+0000 7f0de440e700 1 --2- 172.21.15.70:0/3770662029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ddc0fffe0 0x7f0ddc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.070+0000 7f0de440e700 1 --2- 172.21.15.70:0/3770662029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ddc1056b0 0x7f0ddc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.070+0000 7f0de440e700 1 --2- 172.21.15.70:0/3770662029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0ff620 0x7f0ddc0ffaa0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.070+0000 7f0de440e700 1 -- 172.21.15.70:0/3770662029 >> 172.21.15.70:0/3770662029 conn(0x7f0ddc076780 msgr2=0x7f0ddc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.070+0000 7f0de440e700 1 -- 172.21.15.70:0/3770662029 shutdown_connections 2023-10-08T08:43:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.070+0000 7f0de440e700 1 -- 172.21.15.70:0/3770662029 wait complete. 2023-10-08T08:43:36.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de440e700 1 Processor -- start 2023-10-08T08:43:36.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de440e700 1 -- start start 2023-10-08T08:43:36.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de440e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ddc0ff620 0x7f0ddc19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de440e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0fffe0 0x7f0ddc19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de440e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ddc1056b0 0x7f0ddc1957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de440e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc195e60 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de440e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc195fd0 con 0x7f0ddc1056b0 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de440e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc196190 con 0x7f0ddc0ff620 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de19a9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0fffe0 0x7f0ddc19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de19a9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0fffe0 0x7f0ddc19bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50524/0 (socket says 172.21.15.70:50524) 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de19a9700 1 -- 172.21.15.70:0/1891973695 learned_addr learned my addr 172.21.15.70:0/1891973695 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.071+0000 7f0de21aa700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ddc0ff620 0x7f0ddc19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de19a9700 1 -- 172.21.15.70:0/1891973695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ddc0ff620 msgr2=0x7f0ddc19b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de29ab700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ddc1056b0 0x7f0ddc1957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de19a9700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ddc0ff620 0x7f0ddc19b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de19a9700 1 -- 172.21.15.70:0/1891973695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ddc1056b0 msgr2=0x7f0ddc1957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de19a9700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ddc1056b0 0x7f0ddc1957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de19a9700 1 -- 172.21.15.70:0/1891973695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80095f0 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de29ab700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ddc1056b0 0x7f0ddc1957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de19a9700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0fffe0 0x7f0ddc19bc00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009fd0 tx=0x7f0dd800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0dd37fe700 1 -- 172.21.15.70:0/1891973695 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd801d070 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0dd37fe700 1 -- 172.21.15.70:0/1891973695 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0dd8005510 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc196470 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0dd37fe700 1 -- 172.21.15.70:0/1891973695 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8004a90 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.072+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc1a26b0 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.073+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc107c30 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.074+0000 7f0dd37fe700 1 -- 172.21.15.70:0/1891973695 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0dd8004bf0 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.075+0000 7f0dd37fe700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0dc80a14d0 0x7f0dc80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.075+0000 7f0de21aa700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0dc80a14d0 0x7f0dc80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.075+0000 7f0dd37fe700 1 -- 172.21.15.70:0/1891973695 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0dd80ce290 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.076+0000 7f0de21aa700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0dc80a14d0 0x7f0dc80a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc077ab0 tx=0x7f0dcc00a3b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.079+0000 7f0dd37fe700 1 -- 172.21.15.70:0/1891973695 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0dd8097590 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.273+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ddc196cb0 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.273+0000 7f0dd37fe700 1 -- 172.21.15.70:0/1891973695 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0dd8026020 con 0x7f0ddc0fffe0 2023-10-08T08:43:36.275 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:43:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.275+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0dc80a14d0 msgr2=0x7f0dc80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.275+0000 7f0de440e700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0dc80a14d0 0x7f0dc80a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc077ab0 tx=0x7f0dcc00a3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.275+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0fffe0 msgr2=0x7f0ddc19bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.275+0000 7f0de440e700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0fffe0 0x7f0ddc19bc00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009fd0 tx=0x7f0dd800f670 comp rx=0 tx=0).stop 2023-10-08T08:43:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.275+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 shutdown_connections 2023-10-08T08:43:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.275+0000 7f0de440e700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0dc80a14d0 0x7f0dc80a3990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.275+0000 7f0de440e700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ddc1056b0 0x7f0ddc1957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.276+0000 7f0de440e700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ddc0ff620 0x7f0ddc19b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.276+0000 7f0de440e700 1 --2- 172.21.15.70:0/1891973695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ddc0fffe0 0x7f0ddc19bc00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.276+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 >> 172.21.15.70:0/1891973695 conn(0x7f0ddc076780 msgr2=0x7f0ddc0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.276+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 shutdown_connections 2023-10-08T08:43:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.276+0000 7f0de440e700 1 -- 172.21.15.70:0/1891973695 wait complete. 2023-10-08T08:43:36.289 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:43:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 -- 172.21.15.70:0/1893696855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 msgr2=0x7efd94105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/1893696855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 0x7efd94105640 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efd840099c0 tx=0x7efd84009cd0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 -- 172.21.15.70:0/1893696855 shutdown_connections 2023-10-08T08:43:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/1893696855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd94105b80 0x7efd9410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/1893696855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd94067ce0 0x7efd940680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/1893696855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 0x7efd94105640 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 -- 172.21.15.70:0/1893696855 >> 172.21.15.70:0/1893696855 conn(0x7efd94076780 msgr2=0x7efd94076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 -- 172.21.15.70:0/1893696855 shutdown_connections 2023-10-08T08:43:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 -- 172.21.15.70:0/1893696855 wait complete. 2023-10-08T08:43:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 Processor -- start 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.415+0000 7efd9b7ee700 1 -- start start 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd9b7ee700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd94067ce0 0x7efd94194a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd9b7ee700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 0x7efd94194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd9b7ee700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd94105b80 0x7efd94199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd9b7ee700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94199900 con 0x7efd941051c0 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd9b7ee700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94199a70 con 0x7efd94105b80 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd9b7ee700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94199c30 con 0x7efd94067ce0 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd98d89700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 0x7efd94194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd98d89700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 0x7efd94194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50538/0 (socket says 172.21.15.70:50538) 2023-10-08T08:43:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd98d89700 1 -- 172.21.15.70:0/3615335130 learned_addr learned my addr 172.21.15.70:0/3615335130 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd9958a700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd94067ce0 0x7efd94194a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd99d8b700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd94105b80 0x7efd94199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd98d89700 1 -- 172.21.15.70:0/3615335130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd94067ce0 msgr2=0x7efd94194a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd98d89700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd94067ce0 0x7efd94194a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd98d89700 1 -- 172.21.15.70:0/3615335130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd94105b80 msgr2=0x7efd94199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd98d89700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd94105b80 0x7efd94199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd98d89700 1 -- 172.21.15.70:0/3615335130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840095f0 con 0x7efd941051c0 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd98d89700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 0x7efd94194f60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efd84005f50 tx=0x7efd8400bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd8a7fc700 1 -- 172.21.15.70:0/3615335130 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84003940 con 0x7efd941051c0 2023-10-08T08:43:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd94199eb0 con 0x7efd941051c0 2023-10-08T08:43:36.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd8a7fc700 1 -- 172.21.15.70:0/3615335130 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd840050d0 con 0x7efd941051c0 2023-10-08T08:43:36.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd8a7fc700 1 -- 172.21.15.70:0/3615335130 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8401c8f0 con 0x7efd941051c0 2023-10-08T08:43:36.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.416+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd941a17c0 con 0x7efd941051c0 2023-10-08T08:43:36.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.417+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd94108c50 con 0x7efd941051c0 2023-10-08T08:43:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.418+0000 7efd8a7fc700 1 -- 172.21.15.70:0/3615335130 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7efd84003aa0 con 0x7efd941051c0 2023-10-08T08:43:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.419+0000 7efd8a7fc700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efd800a14d0 0x7efd800a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.419+0000 7efd9958a700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efd800a14d0 0x7efd800a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.419+0000 7efd8a7fc700 1 -- 172.21.15.70:0/3615335130 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7efd840d7360 con 0x7efd941051c0 2023-10-08T08:43:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.419+0000 7efd9958a700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efd800a14d0 0x7efd800a3990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efd9000f660 tx=0x7efd90011040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.422+0000 7efd8a7fc700 1 -- 172.21.15.70:0/3615335130 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efd840a0660 con 0x7efd941051c0 2023-10-08T08:43:36.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.613+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efd94067530 con 0x7efd941051c0 2023-10-08T08:43:36.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.613+0000 7efd8a7fc700 1 -- 172.21.15.70:0/3615335130 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7efd840a3c80 con 0x7efd941051c0 2023-10-08T08:43:36.614 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efd800a14d0 msgr2=0x7efd800a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efd800a14d0 0x7efd800a3990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efd9000f660 tx=0x7efd90011040 comp rx=0 tx=0).stop 2023-10-08T08:43:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 msgr2=0x7efd94194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 0x7efd94194f60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efd84005f50 tx=0x7efd8400bee0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 shutdown_connections 2023-10-08T08:43:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efd800a14d0 0x7efd800a3990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd94105b80 0x7efd94199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd94067ce0 0x7efd94194a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 --2- 172.21.15.70:0/3615335130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd941051c0 0x7efd94194f60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 >> 172.21.15.70:0/3615335130 conn(0x7efd94076780 msgr2=0x7efd940fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:36.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 shutdown_connections 2023-10-08T08:43:36.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.615+0000 7efd9b7ee700 1 -- 172.21.15.70:0/3615335130 wait complete. 2023-10-08T08:43:36.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:36 smithi070 ceph-mon[99513]: pgmap v284: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:36.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:36 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4090574536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:36 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1220021832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:36 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1891973695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:36.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:43:36.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.749+0000 7f59e36b0700 1 -- 172.21.15.70:0/82553751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 msgr2=0x7f59dc10c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.749+0000 7f59e36b0700 1 --2- 172.21.15.70:0/82553751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 0x7f59dc10c3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f59d400b0d0 tx=0x7f59d400b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.749+0000 7f59e36b0700 1 -- 172.21.15.70:0/82553751 shutdown_connections 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.749+0000 7f59e36b0700 1 --2- 172.21.15.70:0/82553751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 0x7f59dc10c3c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.749+0000 7f59e36b0700 1 --2- 172.21.15.70:0/82553751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59dc105600 0x7f59dc1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.749+0000 7f59e36b0700 1 --2- 172.21.15.70:0/82553751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59dc0ff540 0x7f59dc0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.749+0000 7f59e36b0700 1 -- 172.21.15.70:0/82553751 >> 172.21.15.70:0/82553751 conn(0x7f59dc0fb030 msgr2=0x7f59dc0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.749+0000 7f59e36b0700 1 -- 172.21.15.70:0/82553751 shutdown_connections 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.749+0000 7f59e36b0700 1 -- 172.21.15.70:0/82553751 wait complete. 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e36b0700 1 Processor -- start 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e36b0700 1 -- start start 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e36b0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59dc0ff540 0x7f59dc195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e36b0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 0x7f59dc195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e36b0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59dc105600 0x7f59dc19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e36b0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc19a950 con 0x7f59dc0fff00 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e36b0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc19aac0 con 0x7f59dc105600 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e36b0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc19ac80 con 0x7f59dc0ff540 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e0c4b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 0x7f59dc195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e0c4b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 0x7f59dc195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50552/0 (socket says 172.21.15.70:50552) 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e0c4b700 1 -- 172.21.15.70:0/3961542405 learned_addr learned my addr 172.21.15.70:0/3961542405 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e144c700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59dc0ff540 0x7f59dc195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.750+0000 7f59e1c4d700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59dc105600 0x7f59dc19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59e0c4b700 1 -- 172.21.15.70:0/3961542405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59dc0ff540 msgr2=0x7f59dc195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59e0c4b700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59dc0ff540 0x7f59dc195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59e0c4b700 1 -- 172.21.15.70:0/3961542405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59dc105600 msgr2=0x7f59dc19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59e0c4b700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59dc105600 0x7f59dc19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59e0c4b700 1 -- 172.21.15.70:0/3961542405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4009d00 con 0x7f59dc0fff00 2023-10-08T08:43:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59e0c4b700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 0x7f59dc195fb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f59d800d980 tx=0x7f59d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59ce7fc700 1 -- 172.21.15.70:0/3961542405 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8004a30 con 0x7f59dc0fff00 2023-10-08T08:43:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59ce7fc700 1 -- 172.21.15.70:0/3961542405 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59d80054e0 con 0x7f59dc0fff00 2023-10-08T08:43:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc19af60 con 0x7f59dc0fff00 2023-10-08T08:43:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59ce7fc700 1 -- 172.21.15.70:0/3961542405 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d800fbc0 con 0x7f59dc0fff00 2023-10-08T08:43:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.751+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc1a2810 con 0x7f59dc0fff00 2023-10-08T08:43:36.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.752+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc107aa0 con 0x7f59dc0fff00 2023-10-08T08:43:36.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.753+0000 7f59ce7fc700 1 -- 172.21.15.70:0/3961542405 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f59d8004c20 con 0x7f59dc0fff00 2023-10-08T08:43:36.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.753+0000 7f59ce7fc700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f59c80a1550 0x7f59c80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:36.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.754+0000 7f59e144c700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f59c80a1550 0x7f59c80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:36.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.754+0000 7f59ce7fc700 1 -- 172.21.15.70:0/3961542405 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f59d80ccf20 con 0x7f59dc0fff00 2023-10-08T08:43:36.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.754+0000 7f59e144c700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f59c80a1550 0x7f59c80a3a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59d0005950 tx=0x7f59d000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:36.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.758+0000 7f59ce7fc700 1 -- 172.21.15.70:0/3961542405 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f59d8096190 con 0x7f59dc0fff00 2023-10-08T08:43:36.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:36 smithi105 ceph-mon[103798]: pgmap v284: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:36 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4090574536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:36 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1220021832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:36 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1891973695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:36 smithi191 ceph-mon[104220]: pgmap v284: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:43:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:36 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4090574536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:36 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1220021832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:36.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:36 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1891973695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:36.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.993+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59dc196d70 con 0x7f59dc0fff00 2023-10-08T08:43:36.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.993+0000 7f59ce7fc700 1 -- 172.21.15.70:0/3961542405 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11375 (secure 0 0 0) 0x7f59d8017090 con 0x7f59dc0fff00 2023-10-08T08:43:36.995 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:36.995 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:29.077123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24572":{"gid":24572,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:43:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f59c80a1550 msgr2=0x7f59c80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f59c80a1550 0x7f59c80a3a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59d0005950 tx=0x7f59d000b410 comp rx=0 tx=0).stop 2023-10-08T08:43:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 msgr2=0x7f59dc195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 0x7f59dc195fb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f59d800d980 tx=0x7f59d800dc90 comp rx=0 tx=0).stop 2023-10-08T08:43:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 shutdown_connections 2023-10-08T08:43:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f59c80a1550 0x7f59c80a3a10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59dc105600 0x7f59dc19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59dc0ff540 0x7f59dc195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 --2- 172.21.15.70:0/3961542405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59dc0fff00 0x7f59dc195fb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 >> 172.21.15.70:0/3961542405 conn(0x7f59dc0fb030 msgr2=0x7f59dc0fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 shutdown_connections 2023-10-08T08:43:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:36.996+0000 7f59e36b0700 1 -- 172.21.15.70:0/3961542405 wait complete. 2023-10-08T08:43:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:43:37.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:37.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.131+0000 7f3598d9e700 1 -- 172.21.15.70:0/1527505489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f359410abd0 msgr2=0x7f359410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.131+0000 7f3598d9e700 1 --2- 172.21.15.70:0/1527505489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f359410abd0 0x7f359410d090 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f358c00b0a0 tx=0x7f358c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.131+0000 7f3598d9e700 1 -- 172.21.15.70:0/1527505489 shutdown_connections 2023-10-08T08:43:37.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.131+0000 7f3598d9e700 1 --2- 172.21.15.70:0/1527505489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f359410abd0 0x7f359410d090 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.131+0000 7f3598d9e700 1 --2- 172.21.15.70:0/1527505489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35941017b0 0x7f3594101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.131+0000 7f3598d9e700 1 --2- 172.21.15.70:0/1527505489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35941020d0 0x7f359410a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.131+0000 7f3598d9e700 1 -- 172.21.15.70:0/1527505489 >> 172.21.15.70:0/1527505489 conn(0x7f35940fafd0 msgr2=0x7f35940fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:37.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.131+0000 7f3598d9e700 1 -- 172.21.15.70:0/1527505489 shutdown_connections 2023-10-08T08:43:37.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.131+0000 7f3598d9e700 1 -- 172.21.15.70:0/1527505489 wait complete. 2023-10-08T08:43:37.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3598d9e700 1 Processor -- start 2023-10-08T08:43:37.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3598d9e700 1 -- start start 2023-10-08T08:43:37.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3598d9e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35941017b0 0x7f359419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3598d9e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35941020d0 0x7f359419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3598d9e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359410abd0 0x7f3594196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3598d9e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35941970a0 con 0x7f35941017b0 2023-10-08T08:43:37.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3598d9e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594197210 con 0x7f359410abd0 2023-10-08T08:43:37.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3598d9e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35941973d0 con 0x7f35941020d0 2023-10-08T08:43:37.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f35937fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35941017b0 0x7f359419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f35937fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35941017b0 0x7f359419c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50564/0 (socket says 172.21.15.70:50564) 2023-10-08T08:43:37.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f35937fe700 1 -- 172.21.15.70:0/3563354275 learned_addr learned my addr 172.21.15.70:0/3563354275 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:37.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3592ffd700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35941020d0 0x7f359419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.132+0000 7f3593fff700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359410abd0 0x7f3594196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f35937fe700 1 -- 172.21.15.70:0/3563354275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35941020d0 msgr2=0x7f359419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f35937fe700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35941020d0 0x7f359419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f35937fe700 1 -- 172.21.15.70:0/3563354275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359410abd0 msgr2=0x7f3594196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f35937fe700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359410abd0 0x7f3594196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f35937fe700 1 -- 172.21.15.70:0/3563354275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c009d00 con 0x7f35941017b0 2023-10-08T08:43:37.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f35937fe700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35941017b0 0x7f359419c8c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f358800d980 tx=0x7f358800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:37.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f3590ff9700 1 -- 172.21.15.70:0/3563354275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3588004220 con 0x7f35941017b0 2023-10-08T08:43:37.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f3590ff9700 1 -- 172.21.15.70:0/3563354275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3588007640 con 0x7f35941017b0 2023-10-08T08:43:37.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35941976b0 con 0x7f35941017b0 2023-10-08T08:43:37.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f3590ff9700 1 -- 172.21.15.70:0/3563354275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3588005690 con 0x7f35941017b0 2023-10-08T08:43:37.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.133+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35941a38b0 con 0x7f35941017b0 2023-10-08T08:43:37.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.134+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594105d00 con 0x7f35941017b0 2023-10-08T08:43:37.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.135+0000 7f3590ff9700 1 -- 172.21.15.70:0/3563354275 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3588004750 con 0x7f35941017b0 2023-10-08T08:43:37.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.136+0000 7f3590ff9700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a1550 0x7f357c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.136+0000 7f3592ffd700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a1550 0x7f357c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.136+0000 7f3590ff9700 1 -- 172.21.15.70:0/3563354275 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f35880cce80 con 0x7f35941017b0 2023-10-08T08:43:37.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.136+0000 7f3592ffd700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a1550 0x7f357c0a3a10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3594197bb0 tx=0x7f358400b360 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:37.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.141+0000 7f3590ff9700 1 -- 172.21.15.70:0/3563354275 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f35880960f0 con 0x7f35941017b0 2023-10-08T08:43:37.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.336+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3594068110 con 0x7f35941017b0 2023-10-08T08:43:37.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.337+0000 7f3590ff9700 1 -- 172.21.15.70:0/3563354275 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7f3588016020 con 0x7f35941017b0 2023-10-08T08:43:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:37.341 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:37.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a1550 msgr2=0x7f357c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a1550 0x7f357c0a3a10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3594197bb0 tx=0x7f358400b360 comp rx=0 tx=0).stop 2023-10-08T08:43:37.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35941017b0 msgr2=0x7f359419c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35941017b0 0x7f359419c8c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f358800d980 tx=0x7f358800dc90 comp rx=0 tx=0).stop 2023-10-08T08:43:37.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 shutdown_connections 2023-10-08T08:43:37.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f357c0a1550 0x7f357c0a3a10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359410abd0 0x7f3594196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35941017b0 0x7f359419c8c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 --2- 172.21.15.70:0/3563354275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35941020d0 0x7f359419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.339+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 >> 172.21.15.70:0/3563354275 conn(0x7f35940fafd0 msgr2=0x7f35940fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.340+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 shutdown_connections 2023-10-08T08:43:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.340+0000 7f3598d9e700 1 -- 172.21.15.70:0/3563354275 wait complete. 2023-10-08T08:43:37.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:43:37.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:43:37.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.480+0000 7f95eeb08700 1 -- 172.21.15.70:0/1288324434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8100720 msgr2=0x7f95e8100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.480+0000 7f95eeb08700 1 --2- 172.21.15.70:0/1288324434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8100720 0x7f95e8100ba0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009990 tx=0x7f95d4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.480+0000 7f95eeb08700 1 -- 172.21.15.70:0/1288324434 shutdown_connections 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.480+0000 7f95eeb08700 1 --2- 172.21.15.70:0/1288324434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95e81010e0 0x7f95e810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.480+0000 7f95eeb08700 1 --2- 172.21.15.70:0/1288324434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e8106730 0x7f95e8106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.480+0000 7f95eeb08700 1 --2- 172.21.15.70:0/1288324434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8100720 0x7f95e8100ba0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.480+0000 7f95eeb08700 1 -- 172.21.15.70:0/1288324434 >> 172.21.15.70:0/1288324434 conn(0x7f95e80fc230 msgr2=0x7f95e80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.480+0000 7f95eeb08700 1 -- 172.21.15.70:0/1288324434 shutdown_connections 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.480+0000 7f95eeb08700 1 -- 172.21.15.70:0/1288324434 wait complete. 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95eeb08700 1 Processor -- start 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95eeb08700 1 -- start start 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95eeb08700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95e8100720 0x7f95e819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95eeb08700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e81010e0 0x7f95e819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95eeb08700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8106730 0x7f95e81969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95eeb08700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8197020 con 0x7f95e8106730 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95eeb08700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8197190 con 0x7f95e81010e0 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95eeb08700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8197350 con 0x7f95e8100720 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ed0a5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8106730 0x7f95e81969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ed0a5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8106730 0x7f95e81969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50582/0 (socket says 172.21.15.70:50582) 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ed0a5700 1 -- 172.21.15.70:0/3147844485 learned_addr learned my addr 172.21.15.70:0/3147844485 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ec8a4700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95e8100720 0x7f95e819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95e7fff700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e81010e0 0x7f95e819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ed0a5700 1 -- 172.21.15.70:0/3147844485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95e8100720 msgr2=0x7f95e819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ed0a5700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95e8100720 0x7f95e819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ed0a5700 1 -- 172.21.15.70:0/3147844485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e81010e0 msgr2=0x7f95e819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ed0a5700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e81010e0 0x7f95e819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ed0a5700 1 -- 172.21.15.70:0/3147844485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40095f0 con 0x7f95e8106730 2023-10-08T08:43:37.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95e7fff700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e81010e0 0x7f95e819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:37.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ec8a4700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95e8100720 0x7f95e819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:37.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.481+0000 7f95ed0a5700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8106730 0x7f95e81969c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f95e000ada0 tx=0x7f95e000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:37.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.482+0000 7f95e5ffb700 1 -- 172.21.15.70:0/3147844485 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000f070 con 0x7f95e8106730 2023-10-08T08:43:37.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.482+0000 7f95e5ffb700 1 -- 172.21.15.70:0/3147844485 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f95e0007b30 con 0x7f95e8106730 2023-10-08T08:43:37.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.482+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e8197630 con 0x7f95e8106730 2023-10-08T08:43:37.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.482+0000 7f95e5ffb700 1 -- 172.21.15.70:0/3147844485 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0005440 con 0x7f95e8106730 2023-10-08T08:43:37.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.482+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e81a3880 con 0x7f95e8106730 2023-10-08T08:43:37.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.483+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e8108cb0 con 0x7f95e8106730 2023-10-08T08:43:37.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.484+0000 7f95e5ffb700 1 -- 172.21.15.70:0/3147844485 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f95e0004ad0 con 0x7f95e8106730 2023-10-08T08:43:37.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.484+0000 7f95e5ffb700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95d80a14d0 0x7f95d80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.484+0000 7f95ec8a4700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95d80a14d0 0x7f95d80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.484+0000 7f95e5ffb700 1 -- 172.21.15.70:0/3147844485 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f95e00cc7e0 con 0x7f95e8106730 2023-10-08T08:43:37.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.485+0000 7f95ec8a4700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95d80a14d0 0x7f95d80a3990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f95dc005e10 tx=0x7f95dc005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:37.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.488+0000 7f95e5ffb700 1 -- 172.21.15.70:0/3147844485 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f95e0095ae0 con 0x7f95e8106730 2023-10-08T08:43:37.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.680+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95e8197e80 con 0x7f95e8106730 2023-10-08T08:43:37.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.681+0000 7f95e5ffb700 1 -- 172.21.15.70:0/3147844485 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95e0099100 con 0x7f95e8106730 2023-10-08T08:43:37.683 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:43:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95d80a14d0 msgr2=0x7f95d80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95d80a14d0 0x7f95d80a3990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f95dc005e10 tx=0x7f95dc005d60 comp rx=0 tx=0).stop 2023-10-08T08:43:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8106730 msgr2=0x7f95e81969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8106730 0x7f95e81969c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f95e000ada0 tx=0x7f95e000c330 comp rx=0 tx=0).stop 2023-10-08T08:43:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 shutdown_connections 2023-10-08T08:43:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95d80a14d0 0x7f95d80a3990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e8106730 0x7f95e81969c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95e8100720 0x7f95e819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 --2- 172.21.15.70:0/3147844485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e81010e0 0x7f95e819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 >> 172.21.15.70:0/3147844485 conn(0x7f95e80fc230 msgr2=0x7f95e80fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 shutdown_connections 2023-10-08T08:43:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.683+0000 7f95eeb08700 1 -- 172.21.15.70:0/3147844485 wait complete. 2023-10-08T08:43:37.696 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:37 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3615335130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:37.696 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:37 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3961542405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:37.696 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:37 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3563354275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:37.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:43:37.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:37 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3615335130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:37 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3961542405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:37.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:37 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3563354275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:37.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.820+0000 7fdbb9051700 1 -- 172.21.15.70:0/2492423982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40ff620 msgr2=0x7fdbb40ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.820+0000 7fdbb9051700 1 --2- 172.21.15.70:0/2492423982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40ff620 0x7fdbb40ffaa0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009990 tx=0x7fdba4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.820+0000 7fdbb9051700 1 -- 172.21.15.70:0/2492423982 shutdown_connections 2023-10-08T08:43:37.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.820+0000 7fdbb9051700 1 --2- 172.21.15.70:0/2492423982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40fffe0 0x7fdbb410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.820+0000 7fdbb9051700 1 --2- 172.21.15.70:0/2492423982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb41056b0 0x7fdbb4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.820+0000 7fdbb9051700 1 --2- 172.21.15.70:0/2492423982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40ff620 0x7fdbb40ffaa0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.820+0000 7fdbb9051700 1 -- 172.21.15.70:0/2492423982 >> 172.21.15.70:0/2492423982 conn(0x7fdbb4076780 msgr2=0x7fdbb4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:37.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.820+0000 7fdbb9051700 1 -- 172.21.15.70:0/2492423982 shutdown_connections 2023-10-08T08:43:37.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.820+0000 7fdbb9051700 1 -- 172.21.15.70:0/2492423982 wait complete. 2023-10-08T08:43:37.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb9051700 1 Processor -- start 2023-10-08T08:43:37.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb9051700 1 -- start start 2023-10-08T08:43:37.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb9051700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40ff620 0x7fdbb41012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb9051700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40fffe0 0x7fdbb4101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb9051700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb41056b0 0x7fdbb4101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb9051700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb41a4ec0 con 0x7fdbb40fffe0 2023-10-08T08:43:37.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb9051700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb41a5030 con 0x7fdbb40ff620 2023-10-08T08:43:37.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb9051700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb41a51f0 con 0x7fdbb41056b0 2023-10-08T08:43:37.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40fffe0 0x7fdbb4101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40fffe0 0x7fdbb4101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50592/0 (socket says 172.21.15.70:50592) 2023-10-08T08:43:37.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb259c700 1 -- 172.21.15.70:0/3027274365 learned_addr learned my addr 172.21.15.70:0/3027274365 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:37.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb359e700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb41056b0 0x7fdbb4101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb2d9d700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40ff620 0x7fdbb41012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb259c700 1 -- 172.21.15.70:0/3027274365 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb41056b0 msgr2=0x7fdbb4101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb259c700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb41056b0 0x7fdbb4101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb259c700 1 -- 172.21.15.70:0/3027274365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40ff620 msgr2=0x7fdbb41012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb259c700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40ff620 0x7fdbb41012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.821+0000 7fdbb259c700 1 -- 172.21.15.70:0/3027274365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40095f0 con 0x7fdbb40fffe0 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.822+0000 7fdbb259c700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40fffe0 0x7fdbb4101810 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdba40098e0 tx=0x7fdba400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.822+0000 7fdb9bfff700 1 -- 172.21.15.70:0/3027274365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba401d070 con 0x7fdbb40fffe0 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.822+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb41a5470 con 0x7fdbb40fffe0 2023-10-08T08:43:37.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.822+0000 7fdb9bfff700 1 -- 172.21.15.70:0/3027274365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdba4022470 con 0x7fdbb40fffe0 2023-10-08T08:43:37.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.822+0000 7fdb9bfff700 1 -- 172.21.15.70:0/3027274365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4017650 con 0x7fdbb40fffe0 2023-10-08T08:43:37.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.822+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb41a5950 con 0x7fdbb40fffe0 2023-10-08T08:43:37.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.823+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb4100d50 con 0x7fdbb40fffe0 2023-10-08T08:43:37.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.824+0000 7fdb9bfff700 1 -- 172.21.15.70:0/3027274365 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fdba40225e0 con 0x7fdbb40fffe0 2023-10-08T08:43:37.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.824+0000 7fdb9bfff700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:37.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.825+0000 7fdbb2d9d700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:37.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.825+0000 7fdb9bfff700 1 -- 172.21.15.70:0/3027274365 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fdba40ce4f0 con 0x7fdbb40fffe0 2023-10-08T08:43:37.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.825+0000 7fdbb2d9d700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdba8005950 tx=0x7fdba80058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:37.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:37.828+0000 7fdb9bfff700 1 -- 172.21.15.70:0/3027274365 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdba40977f0 con 0x7fdbb40fffe0 2023-10-08T08:43:37.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:37 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3615335130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:37.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:37 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3961542405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:37.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:37 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3563354275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:38.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.022+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbb4102720 con 0x7fdbb40fffe0 2023-10-08T08:43:38.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.022+0000 7fdb9bfff700 1 -- 172.21.15.70:0/3027274365 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdba409ae10 con 0x7fdbb40fffe0 2023-10-08T08:43:38.027 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:38.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 msgr2=0x7fdb9c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdba8005950 tx=0x7fdba80058e0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40fffe0 msgr2=0x7fdbb4101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40fffe0 0x7fdbb4101810 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdba40098e0 tx=0x7fdba400f670 comp rx=0 tx=0).stop 2023-10-08T08:43:38.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 shutdown_connections 2023-10-08T08:43:38.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdb9c0a14d0 0x7fdb9c0a3990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbb41056b0 0x7fdbb4101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40ff620 0x7fdbb41012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 --2- 172.21.15.70:0/3027274365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbb40fffe0 0x7fdbb4101810 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.024+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 >> 172.21.15.70:0/3027274365 conn(0x7fdbb4076780 msgr2=0x7fdbb40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:38.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.025+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 shutdown_connections 2023-10-08T08:43:38.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.025+0000 7fdbb9051700 1 -- 172.21.15.70:0/3027274365 wait complete. 2023-10-08T08:43:38.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:43:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.166+0000 7f9ac04ed700 1 -- 172.21.15.70:0/3254585651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 msgr2=0x7f9ab8105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.166+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/3254585651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 0x7f9ab8105a10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009990 tx=0x7f9aa8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.166+0000 7f9ac04ed700 1 -- 172.21.15.70:0/3254585651 shutdown_connections 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.166+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/3254585651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab8100000 0x7f9ab810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.166+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/3254585651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 0x7f9ab8105a10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.166+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/3254585651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ab80ff640 0x7f9ab80ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.166+0000 7f9ac04ed700 1 -- 172.21.15.70:0/3254585651 >> 172.21.15.70:0/3254585651 conn(0x7f9ab8076790 msgr2=0x7f9ab8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.166+0000 7f9ac04ed700 1 -- 172.21.15.70:0/3254585651 shutdown_connections 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.166+0000 7f9ac04ed700 1 -- 172.21.15.70:0/3254585651 wait complete. 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9ac04ed700 1 Processor -- start 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9ac04ed700 1 -- start start 2023-10-08T08:43:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9ac04ed700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab80ff640 0x7f9ab819b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9ac04ed700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ab8100000 0x7f9ab819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9ac04ed700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 0x7f9ab81958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9ac04ed700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8195f40 con 0x7f9ab8105630 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9ac04ed700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81960b0 con 0x7f9ab80ff640 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9ac04ed700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8196270 con 0x7f9ab8100000 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abea8a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 0x7f9ab81958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abea8a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 0x7f9ab81958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50608/0 (socket says 172.21.15.70:50608) 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abea8a700 1 -- 172.21.15.70:0/1301921866 learned_addr learned my addr 172.21.15.70:0/1301921866 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abe289700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab80ff640 0x7f9ab819b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abda88700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ab8100000 0x7f9ab819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abea8a700 1 -- 172.21.15.70:0/1301921866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ab8100000 msgr2=0x7f9ab819bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abea8a700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ab8100000 0x7f9ab819bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abea8a700 1 -- 172.21.15.70:0/1301921866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab80ff640 msgr2=0x7f9ab819b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abea8a700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab80ff640 0x7f9ab819b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abea8a700 1 -- 172.21.15.70:0/1301921866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80095f0 con 0x7f9ab8105630 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9abea8a700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 0x7f9ab81958e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000ef30 tx=0x7f9ab000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.167+0000 7f9aaf7fe700 1 -- 172.21.15.70:0/1301921866 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0018070 con 0x7f9ab8105630 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.168+0000 7f9aaf7fe700 1 -- 172.21.15.70:0/1301921866 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ab000f040 con 0x7f9ab8105630 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.168+0000 7f9aaf7fe700 1 -- 172.21.15.70:0/1301921866 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0003dc0 con 0x7f9ab8105630 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.168+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab81964f0 con 0x7f9ab8105630 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.168+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab81a27a0 con 0x7f9ab8105630 2023-10-08T08:43:38.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.169+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab8107c20 con 0x7f9ab8105630 2023-10-08T08:43:38.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.170+0000 7f9aaf7fe700 1 -- 172.21.15.70:0/1301921866 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f9ab000caa0 con 0x7f9ab8105630 2023-10-08T08:43:38.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.171+0000 7f9aaf7fe700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9aa40a14d0 0x7f9aa40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.171+0000 7f9abe289700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9aa40a14d0 0x7f9aa40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.171+0000 7f9aaf7fe700 1 -- 172.21.15.70:0/1301921866 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9ab00cd7c0 con 0x7f9ab8105630 2023-10-08T08:43:38.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.171+0000 7f9abe289700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9aa40a14d0 0x7f9aa40a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b2e0 tx=0x7f9aa8005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:38.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.174+0000 7f9aaf7fe700 1 -- 172.21.15.70:0/1301921866 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ab0096a60 con 0x7f9ab8105630 2023-10-08T08:43:38.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.367+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ab8196da0 con 0x7f9ab8105630 2023-10-08T08:43:38.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.368+0000 7f9aaf7fe700 1 -- 172.21.15.70:0/1301921866 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ab009a080 con 0x7f9ab8105630 2023-10-08T08:43:38.370 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:43:38.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9aa40a14d0 msgr2=0x7f9aa40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9aa40a14d0 0x7f9aa40a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b2e0 tx=0x7f9aa8005fd0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 msgr2=0x7f9ab81958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 0x7f9ab81958e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000ef30 tx=0x7f9ab000c450 comp rx=0 tx=0).stop 2023-10-08T08:43:38.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 shutdown_connections 2023-10-08T08:43:38.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9aa40a14d0 0x7f9aa40a3990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab8105630 0x7f9ab81958e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab80ff640 0x7f9ab819b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 --2- 172.21.15.70:0/1301921866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ab8100000 0x7f9ab819bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 >> 172.21.15.70:0/1301921866 conn(0x7f9ab8076790 msgr2=0x7f9ab80fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:38.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 shutdown_connections 2023-10-08T08:43:38.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.370+0000 7f9ac04ed700 1 -- 172.21.15.70:0/1301921866 wait complete. 2023-10-08T08:43:38.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:43:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.506+0000 7fdd449b2700 1 -- 172.21.15.70:0/2790261145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40100730 msgr2=0x7fdd40100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.506+0000 7fdd449b2700 1 --2- 172.21.15.70:0/2790261145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40100730 0x7fdd40100bb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009990 tx=0x7fdd34009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.507+0000 7fdd449b2700 1 -- 172.21.15.70:0/2790261145 shutdown_connections 2023-10-08T08:43:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.507+0000 7fdd449b2700 1 --2- 172.21.15.70:0/2790261145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd401010f0 0x7fdd4010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.507+0000 7fdd449b2700 1 --2- 172.21.15.70:0/2790261145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd40106740 0x7fdd40106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.507+0000 7fdd449b2700 1 --2- 172.21.15.70:0/2790261145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40100730 0x7fdd40100bb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.507+0000 7fdd449b2700 1 -- 172.21.15.70:0/2790261145 >> 172.21.15.70:0/2790261145 conn(0x7fdd400fc200 msgr2=0x7fdd400fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.507+0000 7fdd449b2700 1 -- 172.21.15.70:0/2790261145 shutdown_connections 2023-10-08T08:43:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.507+0000 7fdd449b2700 1 -- 172.21.15.70:0/2790261145 wait complete. 2023-10-08T08:43:38.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.507+0000 7fdd449b2700 1 Processor -- start 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.507+0000 7fdd449b2700 1 -- start start 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd449b2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd40100730 0x7fdd4019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd449b2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd401010f0 0x7fdd4019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd449b2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40106740 0x7fdd401969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd449b2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40197010 con 0x7fdd40106740 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd449b2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40197180 con 0x7fdd401010f0 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd449b2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40197340 con 0x7fdd40100730 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40106740 0x7fdd401969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40106740 0x7fdd401969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50622/0 (socket says 172.21.15.70:50622) 2023-10-08T08:43:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3ed9d700 1 -- 172.21.15.70:0/1975586401 learned_addr learned my addr 172.21.15.70:0/1975586401 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3e59c700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd40100730 0x7fdd4019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3dd9b700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd401010f0 0x7fdd4019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3ed9d700 1 -- 172.21.15.70:0/1975586401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd40100730 msgr2=0x7fdd4019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3ed9d700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd40100730 0x7fdd4019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3ed9d700 1 -- 172.21.15.70:0/1975586401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd401010f0 msgr2=0x7fdd4019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3ed9d700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd401010f0 0x7fdd4019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3ed9d700 1 -- 172.21.15.70:0/1975586401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340095f0 con 0x7fdd40106740 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd3ed9d700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40106740 0x7fdd401969b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd38007ee0 tx=0x7fdd3800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd2f7fe700 1 -- 172.21.15.70:0/1975586401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38017070 con 0x7fdd40106740 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd2f7fe700 1 -- 172.21.15.70:0/1975586401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd3800f040 con 0x7fdd40106740 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd2f7fe700 1 -- 172.21.15.70:0/1975586401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38005740 con 0x7fdd40106740 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd40197620 con 0x7fdd40106740 2023-10-08T08:43:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.508+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd401a3870 con 0x7fdd40106740 2023-10-08T08:43:38.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.509+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd40108cc0 con 0x7fdd40106740 2023-10-08T08:43:38.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.510+0000 7fdd2f7fe700 1 -- 172.21.15.70:0/1975586401 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fdd3800dc60 con 0x7fdd40106740 2023-10-08T08:43:38.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.511+0000 7fdd2f7fe700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdd280a1550 0x7fdd280a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.511+0000 7fdd3e59c700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdd280a1550 0x7fdd280a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.511+0000 7fdd2f7fe700 1 -- 172.21.15.70:0/1975586401 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fdd380ccf40 con 0x7fdd40106740 2023-10-08T08:43:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.511+0000 7fdd3e59c700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdd280a1550 0x7fdd280a3a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdd30005950 tx=0x7fdd3000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:38.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.514+0000 7fdd2f7fe700 1 -- 172.21.15.70:0/1975586401 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdd380961b0 con 0x7fdd40106740 2023-10-08T08:43:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.703+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdd40197e70 con 0x7fdd40106740 2023-10-08T08:43:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.704+0000 7fdd2f7fe700 1 -- 172.21.15.70:0/1975586401 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdd380997d0 con 0x7fdd40106740 2023-10-08T08:43:38.706 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdd280a1550 msgr2=0x7fdd280a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdd280a1550 0x7fdd280a3a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdd30005950 tx=0x7fdd3000b410 comp rx=0 tx=0).stop 2023-10-08T08:43:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40106740 msgr2=0x7fdd401969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40106740 0x7fdd401969b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd38007ee0 tx=0x7fdd3800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 shutdown_connections 2023-10-08T08:43:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fdd280a1550 0x7fdd280a3a10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdd40106740 0x7fdd401969b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd40100730 0x7fdd4019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 --2- 172.21.15.70:0/1975586401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd401010f0 0x7fdd4019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 >> 172.21.15.70:0/1975586401 conn(0x7fdd400fc200 msgr2=0x7fdd400fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:38.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 shutdown_connections 2023-10-08T08:43:38.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.706+0000 7fdd449b2700 1 -- 172.21.15.70:0/1975586401 wait complete. 2023-10-08T08:43:38.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:38 smithi070 ceph-mon[99513]: pgmap v285: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T08:43:38.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:38 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3147844485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:38.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:38 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3027274365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:38.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:38 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1301921866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:38.720 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:43:38.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:38 smithi105 ceph-mon[103798]: pgmap v285: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T08:43:38.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:38 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3147844485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:38.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:38 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3027274365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:38.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:38 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1301921866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:38.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.840+0000 7f26b098a700 1 -- 172.21.15.70:0/349553759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 msgr2=0x7f26ac0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.840+0000 7f26b098a700 1 --2- 172.21.15.70:0/349553759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 0x7f26ac0ff9c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f26940099c0 tx=0x7f2694009cd0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.840+0000 7f26b098a700 1 -- 172.21.15.70:0/349553759 shutdown_connections 2023-10-08T08:43:38.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.840+0000 7f26b098a700 1 --2- 172.21.15.70:0/349553759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26ac0fff00 0x7f26ac10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.840+0000 7f26b098a700 1 --2- 172.21.15.70:0/349553759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac105600 0x7f26ac1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.840+0000 7f26b098a700 1 --2- 172.21.15.70:0/349553759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 0x7f26ac0ff9c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.840+0000 7f26b098a700 1 -- 172.21.15.70:0/349553759 >> 172.21.15.70:0/349553759 conn(0x7f26ac0fb030 msgr2=0x7f26ac0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:38.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.840+0000 7f26b098a700 1 -- 172.21.15.70:0/349553759 shutdown_connections 2023-10-08T08:43:38.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.840+0000 7f26b098a700 1 -- 172.21.15.70:0/349553759 wait complete. 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26b098a700 1 Processor -- start 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26b098a700 1 -- start start 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26b098a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 0x7f26ac1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26b098a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0fff00 0x7f26ac197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26b098a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26ac105600 0x7f26ac1a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26b098a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac1986a0 con 0x7f26ac0ff540 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26b098a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac1a2e60 con 0x7f26ac0fff00 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26b098a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac1a2fa0 con 0x7f26ac105600 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aa59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 0x7f26ac1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aa59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 0x7f26ac1978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50632/0 (socket says 172.21.15.70:50632) 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aa59c700 1 -- 172.21.15.70:0/1870051983 learned_addr learned my addr 172.21.15.70:0/1870051983 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aad9d700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26ac105600 0x7f26ac1a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26a9d9b700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0fff00 0x7f26ac197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aa59c700 1 -- 172.21.15.70:0/1870051983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26ac105600 msgr2=0x7f26ac1a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aa59c700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26ac105600 0x7f26ac1a2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aa59c700 1 -- 172.21.15.70:0/1870051983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0fff00 msgr2=0x7f26ac197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aa59c700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0fff00 0x7f26ac197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aa59c700 1 -- 172.21.15.70:0/1870051983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26940095f0 con 0x7f26ac0ff540 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26aa59c700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 0x7f26ac1978a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f26a40060b0 tx=0x7f26a400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.841+0000 7f26a37fe700 1 -- 172.21.15.70:0/1870051983 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a400ddd0 con 0x7f26ac0ff540 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.842+0000 7f26a37fe700 1 -- 172.21.15.70:0/1870051983 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26a400f040 con 0x7f26ac0ff540 2023-10-08T08:43:38.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.842+0000 7f26a37fe700 1 -- 172.21.15.70:0/1870051983 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4014690 con 0x7f26ac0ff540 2023-10-08T08:43:38.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.842+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac1a3280 con 0x7f26ac0ff540 2023-10-08T08:43:38.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.842+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac1a3740 con 0x7f26ac0ff540 2023-10-08T08:43:38.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.842+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac107aa0 con 0x7f26ac0ff540 2023-10-08T08:43:38.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:38 smithi191 ceph-mon[104220]: pgmap v285: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T08:43:38.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:38 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3147844485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:38.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:38 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3027274365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:38.848 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:38 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1301921866' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:38.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.843+0000 7f26a37fe700 1 -- 172.21.15.70:0/1870051983 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f26a4015400 con 0x7f26ac0ff540 2023-10-08T08:43:38.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.844+0000 7f26a37fe700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26980a14d0 0x7f26980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:38.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.844+0000 7f26a9d9b700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26980a14d0 0x7f26980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:38.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.844+0000 7f26a37fe700 1 -- 172.21.15.70:0/1870051983 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f26a40ccfc0 con 0x7f26ac0ff540 2023-10-08T08:43:38.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.845+0000 7f26a9d9b700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26980a14d0 0x7f26980a3990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2694006010 tx=0x7f2694000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:38.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:38.848+0000 7f26a37fe700 1 -- 172.21.15.70:0/1870051983 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f26a4096230 con 0x7f26ac0ff540 2023-10-08T08:43:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.085+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26ac100c60 con 0x7f26ac0ff540 2023-10-08T08:43:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.085+0000 7f26a37fe700 1 -- 172.21.15.70:0/1870051983 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11375 (secure 0 0 0) 0x7f26a4024090 con 0x7f26ac0ff540 2023-10-08T08:43:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:39.088 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:29.077123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24572":{"gid":24572,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:43:39.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.087+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26980a14d0 msgr2=0x7f26980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.087+0000 7f26b098a700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26980a14d0 0x7f26980a3990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2694006010 tx=0x7f2694000bc0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.087+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 msgr2=0x7f26ac1978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.087+0000 7f26b098a700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 0x7f26ac1978a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f26a40060b0 tx=0x7f26a400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.088+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 shutdown_connections 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.088+0000 7f26b098a700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26980a14d0 0x7f26980a3990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.088+0000 7f26b098a700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26ac105600 0x7f26ac1a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.088+0000 7f26b098a700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26ac0ff540 0x7f26ac1978a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.088+0000 7f26b098a700 1 --2- 172.21.15.70:0/1870051983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0fff00 0x7f26ac197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.088+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 >> 172.21.15.70:0/1870051983 conn(0x7f26ac0fb030 msgr2=0x7f26ac0fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.088+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 shutdown_connections 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.088+0000 7f26b098a700 1 -- 172.21.15.70:0/1870051983 wait complete. 2023-10-08T08:43:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:43:39.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:39.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.223+0000 7efc2139d700 1 -- 172.21.15.70:0/1486702327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ffec0 msgr2=0x7efc1c10c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.223+0000 7efc2139d700 1 --2- 172.21.15.70:0/1486702327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ffec0 0x7efc1c10c380 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efc1400b0d0 tx=0x7efc1400b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.223+0000 7efc2139d700 1 -- 172.21.15.70:0/1486702327 shutdown_connections 2023-10-08T08:43:39.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.223+0000 7efc2139d700 1 --2- 172.21.15.70:0/1486702327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ffec0 0x7efc1c10c380 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.223+0000 7efc2139d700 1 --2- 172.21.15.70:0/1486702327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc1c1055c0 0x7efc1c1059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.223+0000 7efc2139d700 1 --2- 172.21.15.70:0/1486702327 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc1c0ff500 0x7efc1c0ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.223+0000 7efc2139d700 1 -- 172.21.15.70:0/1486702327 >> 172.21.15.70:0/1486702327 conn(0x7efc1c0fafd0 msgr2=0x7efc1c0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.223+0000 7efc2139d700 1 -- 172.21.15.70:0/1486702327 shutdown_connections 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.223+0000 7efc2139d700 1 -- 172.21.15.70:0/1486702327 wait complete. 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc2139d700 1 Processor -- start 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc2139d700 1 -- start start 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc2139d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ff500 0x7efc1c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc2139d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc1c0ffec0 0x7efc1c101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc2139d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc1c1055c0 0x7efc1c101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc2139d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c1a4f00 con 0x7efc1c0ff500 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc2139d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c1a5070 con 0x7efc1c1055c0 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc2139d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c1a5230 con 0x7efc1c0ffec0 2023-10-08T08:43:39.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc1bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ff500 0x7efc1c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc1bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ff500 0x7efc1c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50646/0 (socket says 172.21.15.70:50646) 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc1bfff700 1 -- 172.21.15.70:0/3150059625 learned_addr learned my addr 172.21.15.70:0/3150059625 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc13fff700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc1c0ffec0 0x7efc1c101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc1bfff700 1 -- 172.21.15.70:0/3150059625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc1c0ffec0 msgr2=0x7efc1c101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc1bfff700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc1c0ffec0 0x7efc1c101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc1bfff700 1 -- 172.21.15.70:0/3150059625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc1c1055c0 msgr2=0x7efc1c101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc20b9c700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc1c1055c0 0x7efc1c101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc1bfff700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc1c1055c0 0x7efc1c101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc1bfff700 1 -- 172.21.15.70:0/3150059625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14009d00 con 0x7efc1c0ff500 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.224+0000 7efc1bfff700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ff500 0x7efc1c101410 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00d950 tx=0x7efc0c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.225+0000 7efc19ffb700 1 -- 172.21.15.70:0/3150059625 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c009b40 con 0x7efc1c0ff500 2023-10-08T08:43:39.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.225+0000 7efc19ffb700 1 -- 172.21.15.70:0/3150059625 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc0c009ca0 con 0x7efc1c0ff500 2023-10-08T08:43:39.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.225+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c1a5510 con 0x7efc1c0ff500 2023-10-08T08:43:39.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.225+0000 7efc19ffb700 1 -- 172.21.15.70:0/3150059625 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00f620 con 0x7efc1c0ff500 2023-10-08T08:43:39.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.225+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c1a5a20 con 0x7efc1c0ff500 2023-10-08T08:43:39.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.225+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c100c20 con 0x7efc1c0ff500 2023-10-08T08:43:39.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.227+0000 7efc19ffb700 1 -- 172.21.15.70:0/3150059625 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7efc0c010460 con 0x7efc1c0ff500 2023-10-08T08:43:39.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.227+0000 7efc19ffb700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efc080a14d0 0x7efc080a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.227+0000 7efc13fff700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efc080a14d0 0x7efc080a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.227+0000 7efc19ffb700 1 -- 172.21.15.70:0/3150059625 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7efc0c0cd510 con 0x7efc1c0ff500 2023-10-08T08:43:39.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.228+0000 7efc13fff700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efc080a14d0 0x7efc080a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efc1c102b40 tx=0x7efc04009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.232+0000 7efc19ffb700 1 -- 172.21.15.70:0/3150059625 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efc0c096780 con 0x7efc1c0ff500 2023-10-08T08:43:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.430+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc1c0673e0 con 0x7efc1c0ff500 2023-10-08T08:43:39.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.432+0000 7efc19ffb700 1 -- 172.21.15.70:0/3150059625 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7efc0c016090 con 0x7efc1c0ff500 2023-10-08T08:43:39.434 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:39.434 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efc080a14d0 msgr2=0x7efc080a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efc080a14d0 0x7efc080a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efc1c102b40 tx=0x7efc04009260 comp rx=0 tx=0).stop 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ff500 msgr2=0x7efc1c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ff500 0x7efc1c101410 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00d950 tx=0x7efc0c00dd10 comp rx=0 tx=0).stop 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 shutdown_connections 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efc080a14d0 0x7efc080a3990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc1c1055c0 0x7efc1c101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc1c0ff500 0x7efc1c101410 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 --2- 172.21.15.70:0/3150059625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efc1c0ffec0 0x7efc1c101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 >> 172.21.15.70:0/3150059625 conn(0x7efc1c0fafd0 msgr2=0x7efc1c103690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 shutdown_connections 2023-10-08T08:43:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.434+0000 7efc2139d700 1 -- 172.21.15.70:0/3150059625 wait complete. 2023-10-08T08:43:39.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T08:42:00.508850+0000', 'modified': '2023-10-08T08:42:29.077123+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24638, 'mds_1': 24605, 'mds_2': 24604, 'mds_3': 24589, 'mds_4': 24577}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14781': {'gid': 14781, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/3288548320', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 3288548320}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 3288548320}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14793': {'gid': 14793, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/1499461306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 1499461306}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 1499461306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24541': {'gid': 24541, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/2360801114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 2360801114}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 2360801114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24554': {'gid': 24554, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6833/1292328490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 1292328490}, {'type': 'v1', 'addr': '172.21.15.105:6833', 'nonce': 1292328490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24572': {'gid': 24572, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6835/2412806046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 2412806046}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 2412806046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24577': {'gid': 24577, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.191:6835/2353311301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 2353311301}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 2353311301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24589': {'gid': 24589, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.191:6837/1080059379', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 1080059379}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 1080059379}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24604': {'gid': 24604, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.191:6839/502953702', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 502953702}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 502953702}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24605': {'gid': 24605, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.105:6837/1223332925', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6836', 'nonce': 1223332925}, {'type': 'v1', 'addr': '172.21.15.105:6837', 'nonce': 1223332925}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24638': {'gid': 24638, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6839/586756410', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6838', 'nonce': 586756410}, {'type': 'v1', 'addr': '172.21.15.105:6839', 'nonce': 586756410}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T08:43:39.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-08T08:43:39.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-08T08:43:39.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.572+0000 7fb25363e700 1 -- 172.21.15.70:0/2680222169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 msgr2=0x7fb24c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.572+0000 7fb25363e700 1 --2- 172.21.15.70:0/2680222169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 0x7fb24c105a90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009990 tx=0x7fb23c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.572+0000 7fb25363e700 1 -- 172.21.15.70:0/2680222169 shutdown_connections 2023-10-08T08:43:39.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.572+0000 7fb25363e700 1 --2- 172.21.15.70:0/2680222169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c0fffe0 0x7fb24c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.572+0000 7fb25363e700 1 --2- 172.21.15.70:0/2680222169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 0x7fb24c105a90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.572+0000 7fb25363e700 1 --2- 172.21.15.70:0/2680222169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb24c0ff620 0x7fb24c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.572+0000 7fb25363e700 1 -- 172.21.15.70:0/2680222169 >> 172.21.15.70:0/2680222169 conn(0x7fb24c076780 msgr2=0x7fb24c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.572+0000 7fb25363e700 1 -- 172.21.15.70:0/2680222169 shutdown_connections 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.572+0000 7fb25363e700 1 -- 172.21.15.70:0/2680222169 wait complete. 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb25363e700 1 Processor -- start 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb25363e700 1 -- start start 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb25363e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb24c0ff620 0x7fb24c195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb25363e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c0fffe0 0x7fb24c195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb25363e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 0x7fb24c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb25363e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c19a900 con 0x7fb24c1056b0 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb25363e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c19aa70 con 0x7fb24c0fffe0 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb25363e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c19ac30 con 0x7fb24c0ff620 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb251bdb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 0x7fb24c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb251bdb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 0x7fb24c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50664/0 (socket says 172.21.15.70:50664) 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb251bdb700 1 -- 172.21.15.70:0/1803277269 learned_addr learned my addr 172.21.15.70:0/1803277269 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb2513da700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb24c0ff620 0x7fb24c195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb250bd9700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c0fffe0 0x7fb24c195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb251bdb700 1 -- 172.21.15.70:0/1803277269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb24c0ff620 msgr2=0x7fb24c195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb251bdb700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb24c0ff620 0x7fb24c195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb251bdb700 1 -- 172.21.15.70:0/1803277269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c0fffe0 msgr2=0x7fb24c195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb251bdb700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c0fffe0 0x7fb24c195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb251bdb700 1 -- 172.21.15.70:0/1803277269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c0095f0 con 0x7fb24c1056b0 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb2513da700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb24c0ff620 0x7fb24c195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.573+0000 7fb251bdb700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 0x7fb24c19a330 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb244007d70 tx=0x7fb24400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.574+0000 7fb2427fc700 1 -- 172.21.15.70:0/1803277269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400ad40 con 0x7fb24c1056b0 2023-10-08T08:43:39.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.574+0000 7fb2427fc700 1 -- 172.21.15.70:0/1803277269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2440128e0 con 0x7fb24c1056b0 2023-10-08T08:43:39.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.574+0000 7fb2427fc700 1 -- 172.21.15.70:0/1803277269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244011780 con 0x7fb24c1056b0 2023-10-08T08:43:39.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.574+0000 7fb25363e700 1 -- 172.21.15.70:0/1803277269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c19af10 con 0x7fb24c1056b0 2023-10-08T08:43:39.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.574+0000 7fb25363e700 1 -- 172.21.15.70:0/1803277269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c1a27c0 con 0x7fb24c1056b0 2023-10-08T08:43:39.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.576+0000 7fb2427fc700 1 -- 172.21.15.70:0/1803277269 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb244012a50 con 0x7fb24c1056b0 2023-10-08T08:43:39.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.577+0000 7fb2427fc700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2380a1550 0x7fb2380a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.577+0000 7fb2513da700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2380a1550 0x7fb2380a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.577+0000 7fb2427fc700 1 -- 172.21.15.70:0/1803277269 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fb2440cd420 con 0x7fb24c1056b0 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.577+0000 7fb2513da700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2380a1550 0x7fb2380a3a10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb23c006010 tx=0x7fb23c00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb25f827b80 1 Processor -- start 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb25f827b80 1 -- start start 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce33e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce34b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 0x5559ce34dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb25f827b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce2a7410 con 0x5559ce33e750 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb25f827b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce298bd0 con 0x5559ce33de30 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb25f827b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce2964f0 con 0x5559ce34b810 2023-10-08T08:43:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb250bd9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce34b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb250bd9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce34b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50670/0 (socket says 172.21.15.70:50670) 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb250bd9700 1 -- 172.21.15.70:0/3074435756 learned_addr learned my addr 172.21.15.70:0/3074435756 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb2513da700 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce33e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb251bdb700 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 0x5559ce34dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb250bd9700 1 -- 172.21.15.70:0/3074435756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 msgr2=0x5559ce34dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb250bd9700 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 0x5559ce34dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb250bd9700 1 -- 172.21.15.70:0/3074435756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 msgr2=0x5559ce33e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb250bd9700 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce33e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb250bd9700 1 -- 172.21.15.70:0/3074435756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ce0bcd90 con 0x5559ce33e750 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.578+0000 7fb2513da700 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce33e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb250bd9700 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce34b2d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb24800a950 tx=0x7fb24800ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae641f55a4fc8f49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb2377fe700 1 -- 172.21.15.70:0/3074435756 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24800aea0 con 0x5559ce33e750 2023-10-08T08:43:39.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb2377fe700 1 -- 172.21.15.70:0/3074435756 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2480113f0 con 0x5559ce33e750 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb2377fe700 1 -- 172.21.15.70:0/3074435756 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248018560 con 0x5559ce33e750 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb25f827b80 1 -- 172.21.15.70:0/3074435756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 msgr2=0x5559ce34b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce34b2d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb24800a950 tx=0x7fb24800ac60 comp rx=0 tx=0).stop 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb25f827b80 1 -- 172.21.15.70:0/3074435756 shutdown_connections 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 0x5559ce34dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce33e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3074435756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce34b2d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb25f827b80 1 -- 172.21.15.70:0/3074435756 >> 172.21.15.70:0/3074435756 conn(0x5559ce2b3210 msgr2=0x5559ce33a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb25f827b80 1 -- 172.21.15.70:0/3074435756 shutdown_connections 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.579+0000 7fb25f827b80 1 -- 172.21.15.70:0/3074435756 wait complete. 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb25f827b80 1 -- start start 2023-10-08T08:43:39.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb25f827b80 1 Processor -- start 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33de30 0x5559ce34b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 0x5559ce3484b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce34b810 0x5559ce348a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb25f827b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce291de0 con 0x5559ce33de30 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb25f827b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce22e6c0 con 0x5559ce34b810 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb25f827b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce22e360 con 0x5559ce33e750 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb25f827b80 10 client.0 _ll_register_callbacks cb 0x5559ce08b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb2513da700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33de30 0x5559ce34b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb2513da700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33de30 0x5559ce34b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50674/0 (socket says 172.21.15.70:50674) 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb2513da700 1 -- 172.21.15.70:0/3058569343 learned_addr learned my addr 172.21.15.70:0/3058569343 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb251bdb700 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce34b810 0x5559ce348a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.580+0000 7fb250bd9700 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 0x5559ce3484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb2513da700 1 -- 172.21.15.70:0/3058569343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 msgr2=0x5559ce3484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb2513da700 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 0x5559ce3484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb2513da700 1 -- 172.21.15.70:0/3058569343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce34b810 msgr2=0x5559ce348a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb2513da700 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce34b810 0x5559ce348a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb2513da700 1 -- 172.21.15.70:0/3058569343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24800a580 con 0x5559ce33de30 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb2513da700 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33de30 0x5559ce34b170 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb24c077ab0 tx=0x7fb23c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c538321dc3e6efd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb234ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb234ff9700 1 -- 172.21.15.70:0/3058569343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c024610 con 0x5559ce33de30 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb234ff9700 1 -- 172.21.15.70:0/3058569343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fb23c024770 con 0x5559ce33de30 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb25f827b80 1 -- 172.21.15.70:0/3058569343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559ce259e60 con 0x5559ce33de30 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb234ff9700 1 -- 172.21.15.70:0/3058569343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb23c024930 con 0x5559ce33de30 2023-10-08T08:43:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb25f827b80 10 client.15561 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb25f827b80 1 -- 172.21.15.70:0/3058569343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5559ce0a5c10 con 0x5559ce33de30 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb234ff9700 1 -- 172.21.15.70:0/3058569343 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5559ce259e60 con 0x5559ce33de30 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.581+0000 7fb234ff9700 1 -- 172.21.15.70:0/3058569343 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb23c02fb70 con 0x5559ce33de30 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.582+0000 7fb25f827b80 10 client.15561 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.582+0000 7fb25f827b80 10 client.15561 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.582+0000 7fb25f827b80 20 client.15561 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.582+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5559ce35b330 0x5559ce359e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.582+0000 7fb25f827b80 4 client.15561 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.582+0000 7fb25f827b80 1 -- 172.21.15.70:0/3058569343 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559ce28adc0 con 0x5559ce35b330 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.582+0000 7fb250bd9700 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5559ce35b330 0x5559ce359e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.582+0000 7fb234ff9700 10 client.15561 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.582+0000 7fb250bd9700 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5559ce35b330 0x5559ce359e20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dee4121423312c8c server_cookie=bcc63f8f03d75b29 in_seq=0 out_seq=0 2023-10-08T08:43:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb234ff9700 1 -- 172.21.15.70:0/3058569343 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5559ce28adc0 con 0x5559ce35b330 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb234ff9700 10 client.15561 handle_command_reply: tid=0 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 client.15561 shutdown 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 -- 172.21.15.70:0/3058569343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33de30 msgr2=0x5559ce34b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33de30 0x5559ce34b170 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb24c077ab0 tx=0x7fb23c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 -- 172.21.15.70:0/3058569343 shutdown_connections 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce34b810 0x5559ce348a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5559ce35b330 0x5559ce359e20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33de30 0x5559ce34b170 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 --2- 172.21.15.70:0/3058569343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 0x5559ce3484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb234ff9700 0 client.15561 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 -- 172.21.15.70:0/3058569343 >> 172.21.15.70:0/3058569343 conn(0x5559ce2b3210 msgr2=0x5559ce339e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 -- 172.21.15.70:0/3058569343 shutdown_connections 2023-10-08T08:43:39.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 1 -- 172.21.15.70:0/3058569343 wait complete. 2023-10-08T08:43:39.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.583+0000 7fb25f827b80 20 client.15561 trim_cache size 0 max 16384 2023-10-08T08:43:39.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.600+0000 7fb25f827b80 1 Processor -- start 2023-10-08T08:43:39.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb25f827b80 1 -- start start 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce33e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce363ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 0x5559ce346dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb25f827b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce1128d0 con 0x5559ce33e750 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb25f827b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce293070 con 0x5559ce33de30 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb25f827b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce2384d0 con 0x5559ce34b810 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb250bd9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce363ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb250bd9700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce363ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50684/0 (socket says 172.21.15.70:50684) 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb250bd9700 1 -- 172.21.15.70:0/2925206560 learned_addr learned my addr 172.21.15.70:0/2925206560 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb251bdb700 1 --2- 172.21.15.70:0/2925206560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 0x5559ce346dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb2513da700 1 --2- 172.21.15.70:0/2925206560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce33e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb250bd9700 1 -- 172.21.15.70:0/2925206560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 msgr2=0x5559ce346dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb250bd9700 1 --2- 172.21.15.70:0/2925206560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 0x5559ce346dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb250bd9700 1 -- 172.21.15.70:0/2925206560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 msgr2=0x5559ce33e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb250bd9700 1 --2- 172.21.15.70:0/2925206560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce33e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb250bd9700 1 -- 172.21.15.70:0/2925206560 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ce0e3200 con 0x5559ce33e750 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb250bd9700 1 --2- 172.21.15.70:0/2925206560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce363ca0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb248011e20 tx=0x7fb24801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0feae851cefd7e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb237fff700 1 -- 172.21.15.70:0/2925206560 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248028d10 con 0x5559ce33e750 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb237fff700 1 -- 172.21.15.70:0/2925206560 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb248028e70 con 0x5559ce33e750 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.601+0000 7fb237fff700 1 -- 172.21.15.70:0/2925206560 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248011560 con 0x5559ce33e750 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 -- 172.21.15.70:0/2925206560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 msgr2=0x5559ce363ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 --2- 172.21.15.70:0/2925206560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce363ca0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb248011e20 tx=0x7fb24801c040 comp rx=0 tx=0).stop 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 -- 172.21.15.70:0/2925206560 shutdown_connections 2023-10-08T08:43:39.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 --2- 172.21.15.70:0/2925206560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce34b810 0x5559ce346dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 --2- 172.21.15.70:0/2925206560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce33e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 --2- 172.21.15.70:0/2925206560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce33e750 0x5559ce363ca0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 -- 172.21.15.70:0/2925206560 >> 172.21.15.70:0/2925206560 conn(0x5559ce2b3210 msgr2=0x5559ce343810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 -- 172.21.15.70:0/2925206560 shutdown_connections 2023-10-08T08:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 -- 172.21.15.70:0/2925206560 wait complete. 2023-10-08T08:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 -- start start 2023-10-08T08:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.602+0000 7fb25f827b80 1 Processor -- start 2023-10-08T08:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce363cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 0x5559ce344960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb25f827b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce34b810 0x5559ce344ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb25f827b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce3453e0 con 0x5559ce34b810 2023-10-08T08:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb25f827b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce345550 con 0x5559ce33de30 2023-10-08T08:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb25f827b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ce345710 con 0x5559ce33e750 2023-10-08T08:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb25f827b80 10 client.0 _ll_register_callbacks cb 0x7fb23c00f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb251bdb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce34b810 0x5559ce344ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb251bdb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce34b810 0x5559ce344ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50692/0 (socket says 172.21.15.70:50692) 2023-10-08T08:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb251bdb700 1 -- 172.21.15.70:0/501230223 learned_addr learned my addr 172.21.15.70:0/501230223 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb250bd9700 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 0x5559ce344960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb2513da700 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce363cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb251bdb700 1 -- 172.21.15.70:0/501230223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 msgr2=0x5559ce344960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb251bdb700 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 0x5559ce344960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb251bdb700 1 -- 172.21.15.70:0/501230223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 msgr2=0x5559ce363cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb251bdb700 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce363cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb251bdb700 1 -- 172.21.15.70:0/501230223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559ce0bcd90 con 0x5559ce34b810 2023-10-08T08:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb250bd9700 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 0x5559ce344960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb2513da700 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce363cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb251bdb700 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce34b810 0x5559ce344ea0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb244096e00 tx=0x7fb244007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb39006029aeff2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.603+0000 7fb234ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb234ff9700 1 -- 172.21.15.70:0/501230223 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440a2720 con 0x5559ce34b810 2023-10-08T08:43:39.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb234ff9700 1 -- 172.21.15.70:0/501230223 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fb24409e1b0 con 0x5559ce34b810 2023-10-08T08:43:39.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb25f827b80 1 -- 172.21.15.70:0/501230223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2480113f0 con 0x5559ce34b810 2023-10-08T08:43:39.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb234ff9700 1 -- 172.21.15.70:0/501230223 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2440cd0b0 con 0x5559ce34b810 2023-10-08T08:43:39.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb25f827b80 10 client.15567 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:39.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb25f827b80 1 -- 172.21.15.70:0/501230223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5559ce0bb260 con 0x5559ce34b810 2023-10-08T08:43:39.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb234ff9700 1 -- 172.21.15.70:0/501230223 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2480113f0 con 0x5559ce34b810 2023-10-08T08:43:39.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb234ff9700 1 -- 172.21.15.70:0/501230223 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb2440a2290 con 0x5559ce34b810 2023-10-08T08:43:39.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb25f827b80 10 client.15567 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:39.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb25f827b80 10 client.15567 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T08:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb25f827b80 20 client.15567 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb25f827b80 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5559ce3b3e40 0x5559ce3b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb25f827b80 4 client.15567 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb25f827b80 1 -- 172.21.15.70:0/501230223 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5559ce28aae0 con 0x5559ce3b3e40 2023-10-08T08:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.604+0000 7fb2513da700 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5559ce3b3e40 0x5559ce3b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb234ff9700 10 client.15567 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb2513da700 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5559ce3b3e40 0x5559ce3b0240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4a0053808ed43726 server_cookie=577b39a0d81d6bdf in_seq=0 out_seq=0 2023-10-08T08:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb234ff9700 1 -- 172.21.15.70:0/501230223 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5559ce28aae0 con 0x5559ce3b3e40 2023-10-08T08:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb234ff9700 10 client.15567 handle_command_reply: tid=0 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 client.15567 shutdown 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 -- 172.21.15.70:0/501230223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce34b810 msgr2=0x5559ce344ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce34b810 0x5559ce344ea0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb244096e00 tx=0x7fb244007f70 comp rx=0 tx=0).stop 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 -- 172.21.15.70:0/501230223 shutdown_connections 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5559ce3b3e40 0x5559ce3b0240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559ce34b810 0x5559ce344ea0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb234ff9700 0 client.15567 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ce33de30 0x5559ce363cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 --2- 172.21.15.70:0/501230223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559ce33e750 0x5559ce344960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 -- 172.21.15.70:0/501230223 >> 172.21.15.70:0/501230223 conn(0x5559ce2b3210 msgr2=0x5559ce346d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 -- 172.21.15.70:0/501230223 shutdown_connections 2023-10-08T08:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 1 -- 172.21.15.70:0/501230223 wait complete. 2023-10-08T08:43:39.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.605+0000 7fb25f827b80 20 client.15567 trim_cache size 0 max 16384 2023-10-08T08:43:39.619 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2023-10-08T08:43:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24577, 2023-10-08T08:43:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 71.364486658000004, 2023-10-08T08:43:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 118.10927408400001 2023-10-08T08:43:39.620 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:39.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 -- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2380a1550 msgr2=0x7fb2380a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2380a1550 0x7fb2380a3a10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb23c006010 tx=0x7fb23c00b540 comp rx=0 tx=0).stop 2023-10-08T08:43:39.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 -- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 msgr2=0x7fb24c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 0x7fb24c19a330 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb244007d70 tx=0x7fb24400a340 comp rx=0 tx=0).stop 2023-10-08T08:43:39.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 -- 172.21.15.70:0/1803277269 shutdown_connections 2023-10-08T08:43:39.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb2380a1550 0x7fb2380a3a10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb24c1056b0 0x7fb24c19a330 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb24c0ff620 0x7fb24c195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 --2- 172.21.15.70:0/1803277269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c0fffe0 0x7fb24c195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 -- 172.21.15.70:0/1803277269 >> 172.21.15.70:0/1803277269 conn(0x7fb24c076780 msgr2=0x7fb24c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 -- 172.21.15.70:0/1803277269 shutdown_connections 2023-10-08T08:43:39.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.606+0000 7fb25363e700 1 -- 172.21.15.70:0/1803277269 wait complete. 2023-10-08T08:43:39.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T08:43:39.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:39 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1975586401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:39.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:39 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1870051983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.744+0000 7fd014ff1700 1 -- 172.21.15.70:0/1795899626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100fffe0 msgr2=0x7fd01010c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.744+0000 7fd014ff1700 1 --2- 172.21.15.70:0/1795899626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100fffe0 0x7fd01010c4e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd00800b0a0 tx=0x7fd00800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.744+0000 7fd014ff1700 1 -- 172.21.15.70:0/1795899626 shutdown_connections 2023-10-08T08:43:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.744+0000 7fd014ff1700 1 --2- 172.21.15.70:0/1795899626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100fffe0 0x7fd01010c4e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.744+0000 7fd014ff1700 1 --2- 172.21.15.70:0/1795899626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0101056b0 0x7fd010105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.744+0000 7fd014ff1700 1 --2- 172.21.15.70:0/1795899626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0100ff620 0x7fd0100ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.744+0000 7fd014ff1700 1 -- 172.21.15.70:0/1795899626 >> 172.21.15.70:0/1795899626 conn(0x7fd010076780 msgr2=0x7fd010076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.744+0000 7fd014ff1700 1 -- 172.21.15.70:0/1795899626 shutdown_connections 2023-10-08T08:43:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.744+0000 7fd014ff1700 1 -- 172.21.15.70:0/1795899626 wait complete. 2023-10-08T08:43:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd014ff1700 1 Processor -- start 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd014ff1700 1 -- start start 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd014ff1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100ff620 0x7fd0101012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd014ff1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0100fffe0 0x7fd0101017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd014ff1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0101056b0 0x7fd010101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd014ff1700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0101a4ea0 con 0x7fd0100ff620 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd014ff1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0101a5010 con 0x7fd0101056b0 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd014ff1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0101a51d0 con 0x7fd0100fffe0 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd00e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100ff620 0x7fd0101012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd00e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100ff620 0x7fd0101012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50702/0 (socket says 172.21.15.70:50702) 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd00e59c700 1 -- 172.21.15.70:0/3616786061 learned_addr learned my addr 172.21.15.70:0/3616786061 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0100fffe0 0x7fd0101017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.745+0000 7fd00ed9d700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0101056b0 0x7fd010101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd00e59c700 1 -- 172.21.15.70:0/3616786061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0100fffe0 msgr2=0x7fd0101017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd00e59c700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0100fffe0 0x7fd0101017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd00e59c700 1 -- 172.21.15.70:0/3616786061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0101056b0 msgr2=0x7fd010101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd00e59c700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0101056b0 0x7fd010101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd00e59c700 1 -- 172.21.15.70:0/3616786061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd008009d00 con 0x7fd0100ff620 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd00ed9d700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0101056b0 0x7fd010101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0100fffe0 0x7fd0101017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd00e59c700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100ff620 0x7fd0101012b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd00400d980 tx=0x7fd00400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fcfff7fe700 1 -- 172.21.15.70:0/3616786061 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400de60 con 0x7fd0100ff620 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fcfff7fe700 1 -- 172.21.15.70:0/3616786061 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0040044e0 con 0x7fd0100ff620 2023-10-08T08:43:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd014ff1700 1 -- 172.21.15.70:0/3616786061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0101a54b0 con 0x7fd0100ff620 2023-10-08T08:43:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fcfff7fe700 1 -- 172.21.15.70:0/3616786061 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004003be0 con 0x7fd0100ff620 2023-10-08T08:43:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.746+0000 7fd014ff1700 1 -- 172.21.15.70:0/3616786061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0101a59c0 con 0x7fd0100ff620 2023-10-08T08:43:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.748+0000 7fcfff7fe700 1 -- 172.21.15.70:0/3616786061 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd004009bb0 con 0x7fd0100ff620 2023-10-08T08:43:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.749+0000 7fcfff7fe700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcff80a14d0 0x7fcff80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.749+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcff80a14d0 0x7fcff80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.749+0000 7fcfff7fe700 1 -- 172.21.15.70:0/3616786061 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd0040ccf40 con 0x7fd0100ff620 2023-10-08T08:43:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.749+0000 7fd0211dab80 1 Processor -- start 2023-10-08T08:43:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.749+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcff80a14d0 0x7fcff80a3990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd0101029e0 tx=0x7fd000005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd0211dab80 1 -- start start 2023-10-08T08:43:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 0x556b33eac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd0211dab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33e15410 con 0x556b33eac750 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd0211dab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33e06bd0 con 0x556b33eb7600 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd0211dab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33e044f0 con 0x556b33eabe30 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00dd9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00dd9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50712/0 (socket says 172.21.15.70:50712) 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00dd9b700 1 -- 172.21.15.70:0/2264372025 learned_addr learned my addr 172.21.15.70:0/2264372025 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00e59c700 1 --2- 172.21.15.70:0/2264372025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 0x556b33eac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00ed9d700 1 --2- 172.21.15.70:0/2264372025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00dd9b700 1 -- 172.21.15.70:0/2264372025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 msgr2=0x556b33eac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/2264372025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 0x556b33eac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00dd9b700 1 -- 172.21.15.70:0/2264372025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 msgr2=0x556b33eb99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/2264372025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00dd9b700 1 -- 172.21.15.70:0/2264372025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b33c2ad90 con 0x556b33eac750 2023-10-08T08:43:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.750+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/2264372025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb70c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd00000ed00 tx=0x7fd000011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f586376aa74c255 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fcffcff9700 1 -- 172.21.15.70:0/2264372025 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000010d50 con 0x556b33eac750 2023-10-08T08:43:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fcffcff9700 1 -- 172.21.15.70:0/2264372025 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd000004cf0 con 0x556b33eac750 2023-10-08T08:43:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fcffcff9700 1 -- 172.21.15.70:0/2264372025 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00001d6b0 con 0x556b33eac750 2023-10-08T08:43:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fd0211dab80 1 -- 172.21.15.70:0/2264372025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 msgr2=0x556b33eb70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2264372025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb70c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd00000ed00 tx=0x7fd000011000 comp rx=0 tx=0).stop 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fd0211dab80 1 -- 172.21.15.70:0/2264372025 shutdown_connections 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2264372025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2264372025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 0x556b33eac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2264372025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb70c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fd0211dab80 1 -- 172.21.15.70:0/2264372025 >> 172.21.15.70:0/2264372025 conn(0x556b33e21210 msgr2=0x556b33ea8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.751+0000 7fd0211dab80 1 -- 172.21.15.70:0/2264372025 shutdown_connections 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 1 -- 172.21.15.70:0/2264372025 wait complete. 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 1 -- start start 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 1 Processor -- start 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33eb7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eac750 0x556b33eb43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eb7600 0x556b33eb4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33dffde0 con 0x556b33eabe30 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33d9c6c0 con 0x556b33eac750 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33d9c360 con 0x556b33eb7600 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd0211dab80 10 client.0 _ll_register_callbacks cb 0x556b33bf97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd00e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33eb7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd00e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33eb7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50716/0 (socket says 172.21.15.70:50716) 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.752+0000 7fd00e59c700 1 -- 172.21.15.70:0/2545766706 learned_addr learned my addr 172.21.15.70:0/2545766706 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eac750 0x556b33eb43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd00ed9d700 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eb7600 0x556b33eb4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd00e59c700 1 -- 172.21.15.70:0/2545766706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eb7600 msgr2=0x556b33eb4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd00e59c700 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eb7600 0x556b33eb4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd00e59c700 1 -- 172.21.15.70:0/2545766706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eac750 msgr2=0x556b33eb43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd00e59c700 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eac750 0x556b33eb43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd00e59c700 1 -- 172.21.15.70:0/2545766706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00000e9e0 con 0x556b33eabe30 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd00e59c700 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33eb7070 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd0040a1c70 tx=0x7fd00409a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56f55b96b0f7b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fcff5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fcff5ffb700 1 -- 172.21.15.70:0/2545766706 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004099500 con 0x556b33eabe30 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fcff5ffb700 1 -- 172.21.15.70:0/2545766706 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd00409df60 con 0x556b33eabe30 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd0211dab80 1 -- 172.21.15.70:0/2545766706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b33dc7e60 con 0x556b33eabe30 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fcff5ffb700 1 -- 172.21.15.70:0/2545766706 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0040b8120 con 0x556b33eabe30 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd0211dab80 10 client.15579 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd0211dab80 1 -- 172.21.15.70:0/2545766706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556b33c13c10 con 0x556b33eabe30 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fcff5ffb700 1 -- 172.21.15.70:0/2545766706 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556b33dc7e60 con 0x556b33eabe30 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fcff5ffb700 1 -- 172.21.15.70:0/2545766706 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd00405fb90 con 0x556b33eabe30 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.753+0000 7fd0211dab80 10 client.15579 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.754+0000 7fd0211dab80 10 client.15579 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.754+0000 7fd0211dab80 20 client.15579 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.754+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x556b33ec7140 0x556b33ec5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.754+0000 7fd0211dab80 4 client.15579 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.754+0000 7fd0211dab80 1 -- 172.21.15.70:0/2545766706 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b33df8dc0 con 0x556b33ec7140 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.754+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x556b33ec7140 0x556b33ec5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.754+0000 7fcff5ffb700 10 client.15579 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.754+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x556b33ec7140 0x556b33ec5c90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6ea3df31d696d430 server_cookie=337af8124e7de4f4 in_seq=0 out_seq=0 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fcff5ffb700 1 -- 172.21.15.70:0/2545766706 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556b33df8dc0 con 0x556b33ec7140 2023-10-08T08:43:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fcff5ffb700 10 client.15579 handle_command_reply: tid=0 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 client.15579 shutdown 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 -- 172.21.15.70:0/2545766706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 msgr2=0x556b33eb7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33eb7070 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd0040a1c70 tx=0x7fd00409a510 comp rx=0 tx=0).stop 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 -- 172.21.15.70:0/2545766706 shutdown_connections 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x556b33ec7140 0x556b33ec5c90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eb7600 0x556b33eb4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fcff5ffb700 0 client.15579 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33eb7070 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 --2- 172.21.15.70:0/2545766706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eac750 0x556b33eb43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 -- 172.21.15.70:0/2545766706 >> 172.21.15.70:0/2545766706 conn(0x556b33e21210 msgr2=0x556b33ea7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 -- 172.21.15.70:0/2545766706 shutdown_connections 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 1 -- 172.21.15.70:0/2545766706 wait complete. 2023-10-08T08:43:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.755+0000 7fd0211dab80 20 client.15579 trim_cache size 0 max 16384 2023-10-08T08:43:39.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:39 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1975586401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:39.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:39 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1870051983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:39.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.772+0000 7fd0211dab80 1 Processor -- start 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd0211dab80 1 -- start start 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33ec3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eac750 0x556b33ecfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd0211dab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33c808d0 con 0x556b33eabe30 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd0211dab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33ec7ed0 con 0x556b33eb7600 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd0211dab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33e01070 con 0x556b33eac750 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd00e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33ec3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd00e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33ec3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50724/0 (socket says 172.21.15.70:50724) 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd00e59c700 1 -- 172.21.15.70:0/3980795734 learned_addr learned my addr 172.21.15.70:0/3980795734 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd00e59c700 1 -- 172.21.15.70:0/3980795734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eac750 msgr2=0x556b33ecfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd00e59c700 1 --2- 172.21.15.70:0/3980795734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eac750 0x556b33ecfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd00e59c700 1 -- 172.21.15.70:0/3980795734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 msgr2=0x556b33eb6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd00e59c700 1 --2- 172.21.15.70:0/3980795734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd00e59c700 1 -- 172.21.15.70:0/3980795734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b33c51200 con 0x556b33eabe30 2023-10-08T08:43:39.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fd00e59c700 1 --2- 172.21.15.70:0/3980795734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33ec3170 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd004099b10 tx=0x7fd0040983c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72296d1fb2d266f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fcffd7fa700 1 -- 172.21.15.70:0/3980795734 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040b8120 con 0x556b33eabe30 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fcffd7fa700 1 -- 172.21.15.70:0/3980795734 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd00409c070 con 0x556b33eabe30 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.773+0000 7fcffd7fa700 1 -- 172.21.15.70:0/3980795734 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040a1f70 con 0x556b33eabe30 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 -- 172.21.15.70:0/3980795734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 msgr2=0x556b33ec3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 --2- 172.21.15.70:0/3980795734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33ec3170 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd004099b10 tx=0x7fd0040983c0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 -- 172.21.15.70:0/3980795734 shutdown_connections 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 --2- 172.21.15.70:0/3980795734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 --2- 172.21.15.70:0/3980795734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eabe30 0x556b33ec3170 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 --2- 172.21.15.70:0/3980795734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eac750 0x556b33ecfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 -- 172.21.15.70:0/3980795734 >> 172.21.15.70:0/3980795734 conn(0x556b33e21210 msgr2=0x556b33ea7480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 -- 172.21.15.70:0/3980795734 shutdown_connections 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 -- 172.21.15.70:0/3980795734 wait complete. 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 -- start start 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.774+0000 7fd0211dab80 1 Processor -- start 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 0x556b33eb1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33eb0bf0 con 0x556b33eac750 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33eb0d60 con 0x556b33eb7600 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b33eb0f20 con 0x556b33eabe30 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 10 client.0 _ll_register_callbacks cb 0x7fd004099770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00dd9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00dd9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50732/0 (socket says 172.21.15.70:50732) 2023-10-08T08:43:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00dd9b700 1 -- 172.21.15.70:0/4015848644 learned_addr learned my addr 172.21.15.70:0/4015848644 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00e59c700 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 0x556b33eb1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00ed9d700 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00dd9b700 1 -- 172.21.15.70:0/4015848644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 msgr2=0x556b33eb1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 0x556b33eb1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00dd9b700 1 -- 172.21.15.70:0/4015848644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 msgr2=0x556b33eb0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00dd9b700 1 -- 172.21.15.70:0/4015848644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b33c13c10 con 0x556b33eac750 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00e59c700 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 0x556b33eb1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00ed9d700 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd00dd9b700 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb2020 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd00000ecd0 tx=0x7fd0000050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635313f8b93d9d75 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fcff5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fcff5ffb700 1 -- 172.21.15.70:0/4015848644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000054c0 con 0x556b33eac750 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fcff5ffb700 1 -- 172.21.15.70:0/4015848644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd000005620 con 0x556b33eac750 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 1 -- 172.21.15.70:0/4015848644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd000004cf0 con 0x556b33eac750 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fcff5ffb700 1 -- 172.21.15.70:0/4015848644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd000010b50 con 0x556b33eac750 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 10 client.15585 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.775+0000 7fd0211dab80 1 -- 172.21.15.70:0/4015848644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556b33c29260 con 0x556b33eac750 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.776+0000 7fcff5ffb700 1 -- 172.21.15.70:0/4015848644 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd000004cf0 con 0x556b33eac750 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.776+0000 7fcff5ffb700 1 -- 172.21.15.70:0/4015848644 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd000030070 con 0x556b33eac750 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.776+0000 7fd0211dab80 10 client.15585 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.776+0000 7fd0211dab80 10 client.15585 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.776+0000 7fd0211dab80 20 client.15585 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.776+0000 7fd0211dab80 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x556b33ec7140 0x556b33f1bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.776+0000 7fd0211dab80 4 client.15585 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.776+0000 7fd0211dab80 1 -- 172.21.15.70:0/4015848644 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556b33df8ae0 con 0x556b33ec7140 2023-10-08T08:43:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.776+0000 7fd00e59c700 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x556b33ec7140 0x556b33f1bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fcff5ffb700 10 client.15585 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:43:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd00e59c700 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x556b33ec7140 0x556b33f1bb90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=34013d0e2a9a88b0 server_cookie=cebffbe301675d2e in_seq=0 out_seq=0 2023-10-08T08:43:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fcff5ffb700 1 -- 172.21.15.70:0/4015848644 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x556b33df8ae0 con 0x556b33ec7140 2023-10-08T08:43:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fcff5ffb700 10 client.15585 handle_command_reply: tid=0 2023-10-08T08:43:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 client.15585 shutdown 2023-10-08T08:43:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 -- 172.21.15.70:0/4015848644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 msgr2=0x556b33eb2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb2020 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd00000ecd0 tx=0x7fd0000050e0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 -- 172.21.15.70:0/4015848644 shutdown_connections 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b33eb7600 0x556b33eb0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x556b33ec7140 0x556b33f1bb90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b33eabe30 0x556b33eb1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 --2- 172.21.15.70:0/4015848644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b33eac750 0x556b33eb2020 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fcff5ffb700 0 client.15585 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 -- 172.21.15.70:0/4015848644 >> 172.21.15.70:0/4015848644 conn(0x556b33e21210 msgr2=0x556b33ec5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 -- 172.21.15.70:0/4015848644 shutdown_connections 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 1 -- 172.21.15.70:0/4015848644 wait complete. 2023-10-08T08:43:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.777+0000 7fd0211dab80 20 client.15585 trim_cache size 0 max 16384 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24589, 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 72.542033641000003, 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:39.789 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 116.09441689499999 2023-10-08T08:43:39.789 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 -- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcff80a14d0 msgr2=0x7fcff80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcff80a14d0 0x7fcff80a3990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd0101029e0 tx=0x7fd000005f50 comp rx=0 tx=0).stop 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 -- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100ff620 msgr2=0x7fd0101012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100ff620 0x7fd0101012b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd00400d980 tx=0x7fd00400dd40 comp rx=0 tx=0).stop 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 -- 172.21.15.70:0/3616786061 shutdown_connections 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcff80a14d0 0x7fcff80a3990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0101056b0 0x7fd010101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0100ff620 0x7fd0101012b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 --2- 172.21.15.70:0/3616786061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0100fffe0 0x7fd0101017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 -- 172.21.15.70:0/3616786061 >> 172.21.15.70:0/3616786061 conn(0x7fd010076780 msgr2=0x7fd010067b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 -- 172.21.15.70:0/3616786061 shutdown_connections 2023-10-08T08:43:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.778+0000 7fd014ff1700 1 -- 172.21.15.70:0/3616786061 wait complete. 2023-10-08T08:43:39.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T08:43:39.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:39 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1975586401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:39.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:39 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1870051983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.913+0000 7f6855e40700 1 -- 172.21.15.70:0/2879845879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68500ff640 msgr2=0x7f68500ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.913+0000 7f6855e40700 1 --2- 172.21.15.70:0/2879845879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68500ff640 0x7f68500ffac0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6840009990 tx=0x7f6840009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.913+0000 7f6855e40700 1 -- 172.21.15.70:0/2879845879 shutdown_connections 2023-10-08T08:43:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.913+0000 7f6855e40700 1 --2- 172.21.15.70:0/2879845879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6850100000 0x7f685010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.913+0000 7f6855e40700 1 --2- 172.21.15.70:0/2879845879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6850105630 0x7f6850105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.913+0000 7f6855e40700 1 --2- 172.21.15.70:0/2879845879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68500ff640 0x7f68500ffac0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.913+0000 7f6855e40700 1 -- 172.21.15.70:0/2879845879 >> 172.21.15.70:0/2879845879 conn(0x7f6850076790 msgr2=0x7f6850076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.913+0000 7f6855e40700 1 -- 172.21.15.70:0/2879845879 shutdown_connections 2023-10-08T08:43:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.914+0000 7f6855e40700 1 -- 172.21.15.70:0/2879845879 wait complete. 2023-10-08T08:43:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.914+0000 7f6855e40700 1 Processor -- start 2023-10-08T08:43:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.914+0000 7f6855e40700 1 -- start start 2023-10-08T08:43:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.914+0000 7f6855e40700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68500ff640 0x7f685019c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.914+0000 7f6855e40700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6850100000 0x7f685019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.914+0000 7f6855e40700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6850105630 0x7f6850196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.914+0000 7f6855e40700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501971f0 con 0x7f6850105630 2023-10-08T08:43:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.914+0000 7f6855e40700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6850197360 con 0x7f68500ff640 2023-10-08T08:43:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.914+0000 7f6855e40700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6850197520 con 0x7f6850100000 2023-10-08T08:43:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6850105630 0x7f6850196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6850105630 0x7f6850196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50748/0 (socket says 172.21.15.70:50748) 2023-10-08T08:43:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684ffff700 1 -- 172.21.15.70:0/4165589668 learned_addr learned my addr 172.21.15.70:0/4165589668 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684effd700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6850100000 0x7f685019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684f7fe700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68500ff640 0x7f685019c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684ffff700 1 -- 172.21.15.70:0/4165589668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6850100000 msgr2=0x7f685019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684ffff700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6850100000 0x7f685019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684ffff700 1 -- 172.21.15.70:0/4165589668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68500ff640 msgr2=0x7f685019c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684ffff700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68500ff640 0x7f685019c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684ffff700 1 -- 172.21.15.70:0/4165589668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68400095f0 con 0x7f6850105630 2023-10-08T08:43:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684f7fe700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68500ff640 0x7f685019c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684ffff700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6850105630 0x7f6850196a20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f684800ef30 tx=0x7f684800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684cff9700 1 -- 172.21.15.70:0/4165589668 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848018070 con 0x7f6850105630 2023-10-08T08:43:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f6855e40700 1 -- 172.21.15.70:0/4165589668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68501977a0 con 0x7f6850105630 2023-10-08T08:43:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684cff9700 1 -- 172.21.15.70:0/4165589668 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f684800f040 con 0x7f6850105630 2023-10-08T08:43:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f684cff9700 1 -- 172.21.15.70:0/4165589668 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684800cdb0 con 0x7f6850105630 2023-10-08T08:43:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.915+0000 7f6855e40700 1 -- 172.21.15.70:0/4165589668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68501a38b0 con 0x7f6850105630 2023-10-08T08:43:39.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.917+0000 7f684cff9700 1 -- 172.21.15.70:0/4165589668 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f6848003a00 con 0x7f6850105630 2023-10-08T08:43:39.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.918+0000 7f684cff9700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68380a14d0 0x7f68380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.918+0000 7f684cff9700 1 -- 172.21.15.70:0/4165589668 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f68480ccd60 con 0x7f6850105630 2023-10-08T08:43:39.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.918+0000 7f684f7fe700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68380a14d0 0x7f68380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f684f7fe700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68380a14d0 0x7f68380a3990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6844005e10 tx=0x7f6844005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f6862029b80 1 Processor -- start 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f6862029b80 1 -- start start 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f6862029b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 0x55766f034210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f6862029b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f034750 0x55766f03f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f6862029b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f03f600 0x55766f0419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f6862029b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766ef9d410 con 0x55766f03f600 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f6862029b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766ef8ebd0 con 0x55766f033e30 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f6862029b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766ef8c4f0 con 0x55766f034750 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f684ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f03f600 0x55766f0419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f684f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 0x55766f034210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f684ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f03f600 0x55766f0419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50756/0 (socket says 172.21.15.70:50756) 2023-10-08T08:43:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f684ffff700 1 -- 172.21.15.70:0/572335637 learned_addr learned my addr 172.21.15.70:0/572335637 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.919+0000 7f684effd700 1 --2- 172.21.15.70:0/572335637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f034750 0x55766f03f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.920+0000 7f684ffff700 1 -- 172.21.15.70:0/572335637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f034750 msgr2=0x55766f03f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.920+0000 7f684ffff700 1 --2- 172.21.15.70:0/572335637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f034750 0x55766f03f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.920+0000 7f684ffff700 1 -- 172.21.15.70:0/572335637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 msgr2=0x55766f034210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.920+0000 7f684ffff700 1 --2- 172.21.15.70:0/572335637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 0x55766f034210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.920+0000 7f684ffff700 1 -- 172.21.15.70:0/572335637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55766edb2d90 con 0x55766f03f600 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.920+0000 7f684ffff700 1 --2- 172.21.15.70:0/572335637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f03f600 0x55766f0419f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6848096790 tx=0x7f6848099b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27997ffc7edde068 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.920+0000 7f6835ffb700 1 -- 172.21.15.70:0/572335637 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848004ad0 con 0x55766f03f600 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.920+0000 7f6835ffb700 1 -- 172.21.15.70:0/572335637 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f684801b320 con 0x55766f03f600 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.920+0000 7f6835ffb700 1 -- 172.21.15.70:0/572335637 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848099f80 con 0x55766f03f600 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 -- 172.21.15.70:0/572335637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f03f600 msgr2=0x55766f0419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 --2- 172.21.15.70:0/572335637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f03f600 0x55766f0419f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6848096790 tx=0x7f6848099b70 comp rx=0 tx=0).stop 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 -- 172.21.15.70:0/572335637 shutdown_connections 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 --2- 172.21.15.70:0/572335637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f03f600 0x55766f0419f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 --2- 172.21.15.70:0/572335637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 0x55766f034210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 --2- 172.21.15.70:0/572335637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f034750 0x55766f03f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 -- 172.21.15.70:0/572335637 >> 172.21.15.70:0/572335637 conn(0x55766efa9210 msgr2=0x55766f030280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 -- 172.21.15.70:0/572335637 shutdown_connections 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 -- 172.21.15.70:0/572335637 wait complete. 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 -- start start 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 Processor -- start 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 0x55766f03efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 0x55766f03c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766ef87de0 con 0x55766f034750 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766ef246c0 con 0x55766f03f600 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.921+0000 7f6862029b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766ef24360 con 0x55766f033e30 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f6862029b80 10 client.0 _ll_register_callbacks cb 0x55766ed817b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50760/0 (socket says 172.21.15.70:50760) 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684effd700 1 -- 172.21.15.70:0/1906694773 learned_addr learned my addr 172.21.15.70:0/1906694773 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684f7fe700 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 0x55766f03efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684ffff700 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 0x55766f03c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684effd700 1 -- 172.21.15.70:0/1906694773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 msgr2=0x55766f03efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684effd700 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 0x55766f03efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684effd700 1 -- 172.21.15.70:0/1906694773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 msgr2=0x55766f03c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684effd700 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 0x55766f03c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684effd700 1 -- 172.21.15.70:0/1906694773 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68501a38b0 con 0x55766f034750 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684ffff700 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 0x55766f03c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f684effd700 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6840000c00 tx=0x7f6840005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e782da38e50c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f682effd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f682effd700 1 -- 172.21.15.70:0/1906694773 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684001d070 con 0x55766f034750 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f682effd700 1 -- 172.21.15.70:0/1906694773 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6840004500 con 0x55766f034750 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f6862029b80 1 -- 172.21.15.70:0/1906694773 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55766ef4fe60 con 0x55766f034750 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f682effd700 1 -- 172.21.15.70:0/1906694773 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68400046c0 con 0x55766f034750 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f6862029b80 10 client.15597 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:39.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f6862029b80 1 -- 172.21.15.70:0/1906694773 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55766ed9bc10 con 0x55766f034750 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.922+0000 7f682effd700 1 -- 172.21.15.70:0/1906694773 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55766ef4fe60 con 0x55766f034750 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f682effd700 1 -- 172.21.15.70:0/1906694773 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f684000f910 con 0x55766f034750 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f6862029b80 10 client.15597 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f6862029b80 10 client.15597 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f6862029b80 20 client.15597 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f6862029b80 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55766f04f220 0x55766f04dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f6862029b80 4 client.15597 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f6862029b80 1 -- 172.21.15.70:0/1906694773 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55766ef80dc0 con 0x55766f04f220 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f684f7fe700 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55766f04f220 0x55766f04dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f682effd700 10 client.15597 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:43:39.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.923+0000 7f684f7fe700 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55766f04f220 0x55766f04dcb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82ec4539bfbac0f5 server_cookie=56eecd0053efe36a in_seq=0 out_seq=0 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f682effd700 1 -- 172.21.15.70:0/1906694773 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55766ef80dc0 con 0x55766f04f220 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f682effd700 10 client.15597 handle_command_reply: tid=0 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 client.15597 shutdown 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 -- 172.21.15.70:0/1906694773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 msgr2=0x55766f03c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6840000c00 tx=0x7f6840005800 comp rx=0 tx=0).stop 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 -- 172.21.15.70:0/1906694773 shutdown_connections 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55766f04f220 0x55766f04dcb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 0x55766f03c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 0x55766f03efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f682effd700 0 client.15597 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:43:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 --2- 172.21.15.70:0/1906694773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c300 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 -- 172.21.15.70:0/1906694773 >> 172.21.15.70:0/1906694773 conn(0x55766efa9210 msgr2=0x55766f02fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 -- 172.21.15.70:0/1906694773 shutdown_connections 2023-10-08T08:43:39.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 1 -- 172.21.15.70:0/1906694773 wait complete. 2023-10-08T08:43:39.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.924+0000 7f6862029b80 20 client.15597 trim_cache size 0 max 16384 2023-10-08T08:43:39.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f6862029b80 1 Processor -- start 2023-10-08T08:43:39.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f6862029b80 1 -- start start 2023-10-08T08:43:39.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f6862029b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 0x55766f04b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f6862029b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f6862029b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f03f600 0x55766f057b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f6862029b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766ee088d0 con 0x55766f034750 2023-10-08T08:43:39.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f6862029b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766ee14de0 con 0x55766f033e30 2023-10-08T08:43:39.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f6862029b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766f035080 con 0x55766f03f600 2023-10-08T08:43:39.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50768/0 (socket says 172.21.15.70:50768) 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684effd700 1 -- 172.21.15.70:0/4179370202 learned_addr learned my addr 172.21.15.70:0/4179370202 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684ffff700 1 --2- 172.21.15.70:0/4179370202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f03f600 0x55766f057b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684f7fe700 1 --2- 172.21.15.70:0/4179370202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 0x55766f04b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684effd700 1 -- 172.21.15.70:0/4179370202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f03f600 msgr2=0x55766f057b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684effd700 1 --2- 172.21.15.70:0/4179370202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f03f600 0x55766f057b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684effd700 1 -- 172.21.15.70:0/4179370202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 msgr2=0x55766f04b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684effd700 1 --2- 172.21.15.70:0/4179370202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 0x55766f04b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684effd700 1 -- 172.21.15.70:0/4179370202 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55766edd9200 con 0x55766f034750 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.942+0000 7f684effd700 1 --2- 172.21.15.70:0/4179370202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c2c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f68400098e0 tx=0x7f684000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463f38f2286b9a9b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f68367fc700 1 -- 172.21.15.70:0/4179370202 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684001d070 con 0x55766f034750 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f68367fc700 1 -- 172.21.15.70:0/4179370202 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f684001e040 con 0x55766f034750 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f68367fc700 1 -- 172.21.15.70:0/4179370202 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840024a40 con 0x55766f034750 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 -- 172.21.15.70:0/4179370202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 msgr2=0x55766f03c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 --2- 172.21.15.70:0/4179370202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c2c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f68400098e0 tx=0x7f684000b610 comp rx=0 tx=0).stop 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 -- 172.21.15.70:0/4179370202 shutdown_connections 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 --2- 172.21.15.70:0/4179370202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f03f600 0x55766f057b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 --2- 172.21.15.70:0/4179370202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f033e30 0x55766f04b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 --2- 172.21.15.70:0/4179370202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f03c2c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 -- 172.21.15.70:0/4179370202 >> 172.21.15.70:0/4179370202 conn(0x55766efa9210 msgr2=0x55766f03b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 -- 172.21.15.70:0/4179370202 shutdown_connections 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 -- 172.21.15.70:0/4179370202 wait complete. 2023-10-08T08:43:39.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.943+0000 7f6862029b80 1 -- start start 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f6862029b80 1 Processor -- start 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f6862029b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 0x55766f0522e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f6862029b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f052820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f6862029b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 0x55766f052d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f6862029b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766f0a2c50 con 0x55766f034750 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f6862029b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766f0a2d90 con 0x55766f03f600 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f6862029b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766f0a2f50 con 0x55766f033e30 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f6862029b80 10 client.0 _ll_register_callbacks cb 0x7f6840005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f052820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f052820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50774/0 (socket says 172.21.15.70:50774) 2023-10-08T08:43:39.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684effd700 1 -- 172.21.15.70:0/1691605383 learned_addr learned my addr 172.21.15.70:0/1691605383 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684f7fe700 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 0x55766f0522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684effd700 1 -- 172.21.15.70:0/1691605383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 msgr2=0x55766f0522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684effd700 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 0x55766f0522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684effd700 1 -- 172.21.15.70:0/1691605383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 msgr2=0x55766f052d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684effd700 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 0x55766f052d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684effd700 1 -- 172.21.15.70:0/1691605383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55766ed9bc10 con 0x55766f034750 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f684effd700 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f052820 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6840009990 tx=0x7f6840009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5af42edd3ec3c6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.944+0000 7f682effd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f682effd700 1 -- 172.21.15.70:0/1691605383 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840004500 con 0x55766f034750 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f682effd700 1 -- 172.21.15.70:0/1691605383 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6840000e40 con 0x55766f034750 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f6862029b80 1 -- 172.21.15.70:0/1691605383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f684801b320 con 0x55766f034750 2023-10-08T08:43:39.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f682effd700 1 -- 172.21.15.70:0/1691605383 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6840004660 con 0x55766f034750 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f6862029b80 10 client.15603 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f6862029b80 1 -- 172.21.15.70:0/1691605383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55766edb1260 con 0x55766f034750 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f682effd700 1 -- 172.21.15.70:0/1691605383 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f684801b320 con 0x55766f034750 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f682effd700 1 -- 172.21.15.70:0/1691605383 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f68400247c0 con 0x55766f034750 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f6862029b80 10 client.15603 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f6862029b80 10 client.15603 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f6862029b80 20 client.15603 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f6862029b80 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55766f0a7e80 0x55766f0a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f6862029b80 4 client.15603 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f6862029b80 1 -- 172.21.15.70:0/1691605383 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55766ef80ae0 con 0x55766f0a7e80 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.945+0000 7f684f7fe700 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55766f0a7e80 0x55766f0a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:39.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f682effd700 10 client.15603 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f684f7fe700 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55766f0a7e80 0x55766f0a42c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a3a4bba299a51985 server_cookie=20a2cdad3e4f9fc8 in_seq=0 out_seq=0 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f682effd700 1 -- 172.21.15.70:0/1691605383 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55766ef80ae0 con 0x55766f0a7e80 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f682effd700 10 client.15603 handle_command_reply: tid=0 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 client.15603 shutdown 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 -- 172.21.15.70:0/1691605383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 msgr2=0x55766f052820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f052820 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6840009990 tx=0x7f6840009290 comp rx=0 tx=0).stop 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 -- 172.21.15.70:0/1691605383 shutdown_connections 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55766f0a7e80 0x55766f0a42c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55766f03f600 0x55766f052d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55766f033e30 0x55766f0522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 --2- 172.21.15.70:0/1691605383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55766f034750 0x55766f052820 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f682effd700 0 client.15603 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:43:39.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 -- 172.21.15.70:0/1691605383 >> 172.21.15.70:0/1691605383 conn(0x55766efa9210 msgr2=0x55766f02fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 -- 172.21.15.70:0/1691605383 shutdown_connections 2023-10-08T08:43:39.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 1 -- 172.21.15.70:0/1691605383 wait complete. 2023-10-08T08:43:39.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.946+0000 7f6862029b80 20 client.15603 trim_cache size 0 max 16384 2023-10-08T08:43:39.956 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:39.956 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24604, 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 73.717011083000003, 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 111.767514177 2023-10-08T08:43:39.957 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:39.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 -- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68380a14d0 msgr2=0x7f68380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68380a14d0 0x7f68380a3990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6844005e10 tx=0x7f6844005d60 comp rx=0 tx=0).stop 2023-10-08T08:43:39.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 -- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6850105630 msgr2=0x7f6850196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:39.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6850105630 0x7f6850196a20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f684800ef30 tx=0x7f684800c3a0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 -- 172.21.15.70:0/4165589668 shutdown_connections 2023-10-08T08:43:39.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f68380a14d0 0x7f68380a3990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6850105630 0x7f6850196a20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68500ff640 0x7f685019c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 --2- 172.21.15.70:0/4165589668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6850100000 0x7f685019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:39.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 -- 172.21.15.70:0/4165589668 >> 172.21.15.70:0/4165589668 conn(0x7f6850076790 msgr2=0x7f68500fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:39.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 -- 172.21.15.70:0/4165589668 shutdown_connections 2023-10-08T08:43:39.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:39.947+0000 7f6855e40700 1 -- 172.21.15.70:0/4165589668 wait complete. 2023-10-08T08:43:39.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-08T08:43:40.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.082+0000 7f19a0c5c700 1 -- 172.21.15.70:0/3230771535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c1056b0 msgr2=0x7f199c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.082+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/3230771535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c1056b0 0x7f199c105a90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1990009990 tx=0x7f1990009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.082+0000 7f19a0c5c700 1 -- 172.21.15.70:0/3230771535 shutdown_connections 2023-10-08T08:43:40.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.082+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/3230771535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f199c0fffe0 0x7f199c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.082+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/3230771535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c1056b0 0x7f199c105a90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.082+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/3230771535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f199c0ff620 0x7f199c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.082+0000 7f19a0c5c700 1 -- 172.21.15.70:0/3230771535 >> 172.21.15.70:0/3230771535 conn(0x7f199c076780 msgr2=0x7f199c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.082+0000 7f19a0c5c700 1 -- 172.21.15.70:0/3230771535 shutdown_connections 2023-10-08T08:43:40.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.082+0000 7f19a0c5c700 1 -- 172.21.15.70:0/3230771535 wait complete. 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.083+0000 7f19a0c5c700 1 Processor -- start 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.083+0000 7f19a0c5c700 1 -- start start 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f19a0c5c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c0ff620 0x7f199c195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f19a0c5c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f199c0fffe0 0x7f199c195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f19a0c5c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f199c1056b0 0x7f199c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f19a0c5c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19a900 con 0x7f199c0ff620 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f19a0c5c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19aa70 con 0x7f199c0fffe0 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f19a0c5c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c19ac30 con 0x7f199c1056b0 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c0ff620 0x7f199c195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c0ff620 0x7f199c195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50786/0 (socket says 172.21.15.70:50786) 2023-10-08T08:43:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199a59c700 1 -- 172.21.15.70:0/1234702607 learned_addr learned my addr 172.21.15.70:0/1234702607 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199ad9d700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f199c1056b0 0x7f199c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f1999d9b700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f199c0fffe0 0x7f199c195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199a59c700 1 -- 172.21.15.70:0/1234702607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f199c1056b0 msgr2=0x7f199c19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199a59c700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f199c1056b0 0x7f199c19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199a59c700 1 -- 172.21.15.70:0/1234702607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f199c0fffe0 msgr2=0x7f199c195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199a59c700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f199c0fffe0 0x7f199c195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199a59c700 1 -- 172.21.15.70:0/1234702607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900095f0 con 0x7f199c0ff620 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f1999d9b700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f199c0fffe0 0x7f199c195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199ad9d700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f199c1056b0 0x7f199c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f199a59c700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c0ff620 0x7f199c195a20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1990000c00 tx=0x7f1990005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f198b7fe700 1 -- 172.21.15.70:0/1234702607 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199001d070 con 0x7f199c0ff620 2023-10-08T08:43:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f19a0c5c700 1 -- 172.21.15.70:0/1234702607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c19aeb0 con 0x7f199c0ff620 2023-10-08T08:43:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f198b7fe700 1 -- 172.21.15.70:0/1234702607 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1990022470 con 0x7f199c0ff620 2023-10-08T08:43:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f198b7fe700 1 -- 172.21.15.70:0/1234702607 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990017650 con 0x7f199c0ff620 2023-10-08T08:43:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.084+0000 7f19a0c5c700 1 -- 172.21.15.70:0/1234702607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c19b1b0 con 0x7f199c0ff620 2023-10-08T08:43:40.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.086+0000 7f198b7fe700 1 -- 172.21.15.70:0/1234702607 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f19900225e0 con 0x7f199c0ff620 2023-10-08T08:43:40.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.087+0000 7f198b7fe700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f19840a14d0 0x7f19840a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.087+0000 7f198b7fe700 1 -- 172.21.15.70:0/1234702607 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f19900ce710 con 0x7f199c0ff620 2023-10-08T08:43:40.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.087+0000 7f1999d9b700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f19840a14d0 0x7f19840a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.087+0000 7f1999d9b700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f19840a14d0 0x7f19840a3990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f198c005fd0 tx=0x7f198c005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f19ace45b80 1 Processor -- start 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f19ace45b80 1 -- start start 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96007e30 0x55fb96008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96008750 0x55fb960152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb96017c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f19ace45b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb95f71410 con 0x55fb96015810 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f19ace45b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb95f62bd0 con 0x55fb96007e30 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f19ace45b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb95f604f0 con 0x55fb96008750 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb96017c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb96017c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50798/0 (socket says 172.21.15.70:50798) 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f199ad9d700 1 -- 172.21.15.70:0/2253203451 learned_addr learned my addr 172.21.15.70:0/2253203451 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f1999d9b700 1 --2- 172.21.15.70:0/2253203451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96008750 0x55fb960152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.088+0000 7f199a59c700 1 --2- 172.21.15.70:0/2253203451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96007e30 0x55fb96008210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.089+0000 7f199ad9d700 1 -- 172.21.15.70:0/2253203451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96008750 msgr2=0x55fb960152d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.089+0000 7f199ad9d700 1 --2- 172.21.15.70:0/2253203451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96008750 0x55fb960152d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.089+0000 7f199ad9d700 1 -- 172.21.15.70:0/2253203451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96007e30 msgr2=0x55fb96008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.089+0000 7f199ad9d700 1 --2- 172.21.15.70:0/2253203451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96007e30 0x55fb96008210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.089+0000 7f199ad9d700 1 -- 172.21.15.70:0/2253203451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb95d86d90 con 0x55fb96015810 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.089+0000 7f199ad9d700 1 --2- 172.21.15.70:0/2253203451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb96017c00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1994009440 tx=0x7f1994009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cad98247f09fd4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.089+0000 7f1988ff9700 1 -- 172.21.15.70:0/2253203451 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400e070 con 0x55fb96015810 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.089+0000 7f1988ff9700 1 -- 172.21.15.70:0/2253203451 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f199400f040 con 0x55fb96015810 2023-10-08T08:43:40.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.089+0000 7f1988ff9700 1 -- 172.21.15.70:0/2253203451 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994015b90 con 0x55fb96015810 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 -- 172.21.15.70:0/2253203451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 msgr2=0x55fb96017c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2253203451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb96017c00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1994009440 tx=0x7f1994009920 comp rx=0 tx=0).stop 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 -- 172.21.15.70:0/2253203451 shutdown_connections 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2253203451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb96017c00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2253203451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96007e30 0x55fb96008210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2253203451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96008750 0x55fb960152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 -- 172.21.15.70:0/2253203451 >> 172.21.15.70:0/2253203451 conn(0x55fb95f7d210 msgr2=0x55fb96004280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 -- 172.21.15.70:0/2253203451 shutdown_connections 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 -- 172.21.15.70:0/2253203451 wait complete. 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 -- start start 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 Processor -- start 2023-10-08T08:43:40.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb960151d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb960124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 0x55fb96012b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb95f5bde0 con 0x55fb96007e30 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb95ef86c0 con 0x55fb96008750 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb95ef8360 con 0x55fb96015810 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f199a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb960151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f19ace45b80 10 client.0 _ll_register_callbacks cb 0x55fb95d557b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f199a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb960151d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50800/0 (socket says 172.21.15.70:50800) 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f199a59c700 1 -- 172.21.15.70:0/2116004228 learned_addr learned my addr 172.21.15.70:0/2116004228 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.090+0000 7f1999d9b700 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb960124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f199ad9d700 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 0x55fb96012b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f199a59c700 1 -- 172.21.15.70:0/2116004228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 msgr2=0x55fb96012b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f199a59c700 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 0x55fb96012b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f199a59c700 1 -- 172.21.15.70:0/2116004228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 msgr2=0x55fb960124c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f199a59c700 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb960124c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f199a59c700 1 -- 172.21.15.70:0/2116004228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19940090f0 con 0x55fb96007e30 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f1999d9b700 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb960124c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f199a59c700 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb960151d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f19900cbe20 tx=0x7f199009c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92989b26f7843030 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f1981ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f1981ffb700 1 -- 172.21.15.70:0/2116004228 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900a3af0 con 0x55fb96007e30 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f1981ffb700 1 -- 172.21.15.70:0/2116004228 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f199009ba50 con 0x55fb96007e30 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f19ace45b80 1 -- 172.21.15.70:0/2116004228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb95f23e60 con 0x55fb96007e30 2023-10-08T08:43:40.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f1981ffb700 1 -- 172.21.15.70:0/2116004228 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19900671a0 con 0x55fb96007e30 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f19ace45b80 10 client.15615 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f19ace45b80 1 -- 172.21.15.70:0/2116004228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fb95d6fc10 con 0x55fb96007e30 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f1981ffb700 1 -- 172.21.15.70:0/2116004228 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fb95f23e60 con 0x55fb96007e30 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f1981ffb700 1 -- 172.21.15.70:0/2116004228 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f19900a3660 con 0x55fb96007e30 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f19ace45b80 10 client.15615 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.091+0000 7f19ace45b80 10 client.15615 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.092+0000 7f19ace45b80 20 client.15615 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.092+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55fb96025050 0x55fb96023c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.092+0000 7f19ace45b80 4 client.15615 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.092+0000 7f19ace45b80 1 -- 172.21.15.70:0/2116004228 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb95f54dc0 con 0x55fb96025050 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.092+0000 7f1999d9b700 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55fb96025050 0x55fb96023c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.092+0000 7f1981ffb700 10 client.15615 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.092+0000 7f1999d9b700 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55fb96025050 0x55fb96023c90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fef2da58f7f28060 server_cookie=3b1ad9f1534a543c in_seq=0 out_seq=0 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f1981ffb700 1 -- 172.21.15.70:0/2116004228 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fb95f54dc0 con 0x55fb96025050 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f1981ffb700 10 client.15615 handle_command_reply: tid=0 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 client.15615 shutdown 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 -- 172.21.15.70:0/2116004228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 msgr2=0x55fb960151d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb960151d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f19900cbe20 tx=0x7f199009c020 comp rx=0 tx=0).stop 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 -- 172.21.15.70:0/2116004228 shutdown_connections 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55fb96025050 0x55fb96023c90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 0x55fb96012b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f1981ffb700 0 client.15615 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:43:40.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb960151d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2116004228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb960124c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 -- 172.21.15.70:0/2116004228 >> 172.21.15.70:0/2116004228 conn(0x55fb95f7d210 msgr2=0x55fb96003e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 -- 172.21.15.70:0/2116004228 shutdown_connections 2023-10-08T08:43:40.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.093+0000 7f19ace45b80 1 -- 172.21.15.70:0/2116004228 wait complete. 2023-10-08T08:43:40.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.094+0000 7f19ace45b80 20 client.15615 trim_cache size 0 max 16384 2023-10-08T08:43:40.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f19ace45b80 1 Processor -- start 2023-10-08T08:43:40.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f19ace45b80 1 -- start start 2023-10-08T08:43:40.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96007e30 0x55fb9600cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb9600dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f19ace45b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb95ddc8d0 con 0x55fb96015810 2023-10-08T08:43:40.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f19ace45b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb95f23e60 con 0x55fb96008750 2023-10-08T08:43:40.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f19ace45b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb95f5d070 con 0x55fb96007e30 2023-10-08T08:43:40.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb9600dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb9600dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50812/0 (socket says 172.21.15.70:50812) 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199ad9d700 1 -- 172.21.15.70:0/2804029829 learned_addr learned my addr 172.21.15.70:0/2804029829 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199a59c700 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96007e30 0x55fb9600cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f1999d9b700 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199ad9d700 1 -- 172.21.15.70:0/2804029829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96007e30 msgr2=0x55fb9600cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199ad9d700 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96007e30 0x55fb9600cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199ad9d700 1 -- 172.21.15.70:0/2804029829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 msgr2=0x55fb9600d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199ad9d700 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199ad9d700 1 -- 172.21.15.70:0/2804029829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb95dad200 con 0x55fb96015810 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f1999d9b700 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.111+0000 7f199ad9d700 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb9600dd10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1994006130 tx=0x7f1994009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e0bb8e74f077b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19897fa700 1 -- 172.21.15.70:0/2804029829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400e040 con 0x55fb96015810 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19897fa700 1 -- 172.21.15.70:0/2804029829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1994015740 con 0x55fb96015810 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19897fa700 1 -- 172.21.15.70:0/2804029829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940137b0 con 0x55fb96015810 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19ace45b80 1 -- 172.21.15.70:0/2804029829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 msgr2=0x55fb9600dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb9600dd10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1994006130 tx=0x7f1994009b60 comp rx=0 tx=0).stop 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19ace45b80 1 -- 172.21.15.70:0/2804029829 shutdown_connections 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96015810 0x55fb9600dd10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96007e30 0x55fb9600cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19ace45b80 1 --2- 172.21.15.70:0/2804029829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19ace45b80 1 -- 172.21.15.70:0/2804029829 >> 172.21.15.70:0/2804029829 conn(0x55fb95f7d210 msgr2=0x55fb96011a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19ace45b80 1 -- 172.21.15.70:0/2804029829 shutdown_connections 2023-10-08T08:43:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.112+0000 7f19ace45b80 1 -- 172.21.15.70:0/2804029829 wait complete. 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f19ace45b80 1 -- start start 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f19ace45b80 1 Processor -- start 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb96009cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f19ace45b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 0x55fb9600a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f19ace45b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9607aaf0 con 0x55fb96007e30 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f19ace45b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9607ac30 con 0x55fb96008750 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f19ace45b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9607adf0 con 0x55fb96015810 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f19ace45b80 10 client.0 _ll_register_callbacks cb 0x7f199009b150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:40.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb96009cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb96009cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50814/0 (socket says 172.21.15.70:50814) 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199a59c700 1 -- 172.21.15.70:0/1907559476 learned_addr learned my addr 172.21.15.70:0/1907559476 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199ad9d700 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 0x55fb9600a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f1999d9b700 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199a59c700 1 -- 172.21.15.70:0/1907559476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 msgr2=0x55fb9600a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199a59c700 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 0x55fb9600a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199a59c700 1 -- 172.21.15.70:0/1907559476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 msgr2=0x55fb9600a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199a59c700 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199a59c700 1 -- 172.21.15.70:0/1907559476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb95d86d90 con 0x55fb96007e30 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f1999d9b700 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:40.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f199a59c700 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb96009cf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f19900a39f0 tx=0x7f1990009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1659f5b77ebe461f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f1981ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.113+0000 7f1981ffb700 1 -- 172.21.15.70:0/1907559476 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900671a0 con 0x55fb96007e30 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f1981ffb700 1 -- 172.21.15.70:0/1907559476 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f19900a3af0 con 0x55fb96007e30 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f19ace45b80 1 -- 172.21.15.70:0/1907559476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f199400f040 con 0x55fb96007e30 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f1981ffb700 1 -- 172.21.15.70:0/1907559476 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1990097700 con 0x55fb96007e30 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f19ace45b80 10 client.15621 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f19ace45b80 1 -- 172.21.15.70:0/1907559476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fb95d85260 con 0x55fb96007e30 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f1981ffb700 1 -- 172.21.15.70:0/1907559476 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f199400f040 con 0x55fb96007e30 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f1981ffb700 1 -- 172.21.15.70:0/1907559476 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f199009ba50 con 0x55fb96007e30 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f19ace45b80 10 client.15621 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f19ace45b80 10 client.15621 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T08:43:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f19ace45b80 20 client.15621 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f19ace45b80 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55fb9607fbc0 0x55fb9607c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f19ace45b80 4 client.15621 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f19ace45b80 1 -- 172.21.15.70:0/1907559476 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fb95f54ae0 con 0x55fb9607fbc0 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.114+0000 7f1999d9b700 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55fb9607fbc0 0x55fb9607c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f1999d9b700 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55fb9607fbc0 0x55fb9607c030 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90c413592e9682c3 server_cookie=8d342033fd8e476a in_seq=0 out_seq=0 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f1981ffb700 10 client.15621 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f1981ffb700 1 -- 172.21.15.70:0/1907559476 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55fb95f54ae0 con 0x55fb9607fbc0 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f1981ffb700 10 client.15621 handle_command_reply: tid=0 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 client.15621 shutdown 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 -- 172.21.15.70:0/1907559476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 msgr2=0x55fb96009cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb96009cf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f19900a39f0 tx=0x7f1990009310 comp rx=0 tx=0).stop 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 -- 172.21.15.70:0/1907559476 shutdown_connections 2023-10-08T08:43:40.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55fb9607fbc0 0x55fb9607c030 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb96015810 0x55fb9600a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb96007e30 0x55fb96009cf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 --2- 172.21.15.70:0/1907559476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fb96008750 0x55fb9600a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f1981ffb700 0 client.15621 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:43:40.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 -- 172.21.15.70:0/1907559476 >> 172.21.15.70:0/1907559476 conn(0x55fb95f7d210 msgr2=0x55fb9600d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 -- 172.21.15.70:0/1907559476 shutdown_connections 2023-10-08T08:43:40.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 1 -- 172.21.15.70:0/1907559476 wait complete. 2023-10-08T08:43:40.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.115+0000 7f19ace45b80 20 client.15621 trim_cache size 0 max 16384 2023-10-08T08:43:40.124 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24605, 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 74.894437893000003, 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 114.211683526 2023-10-08T08:43:40.125 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 -- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f19840a14d0 msgr2=0x7f19840a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f19840a14d0 0x7f19840a3990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f198c005fd0 tx=0x7f198c005f60 comp rx=0 tx=0).stop 2023-10-08T08:43:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 -- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c0ff620 msgr2=0x7f199c195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c0ff620 0x7f199c195a20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1990000c00 tx=0x7f1990005ef0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 -- 172.21.15.70:0/1234702607 shutdown_connections 2023-10-08T08:43:40.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f19840a14d0 0x7f19840a3990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f199c1056b0 0x7f199c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f199c0ff620 0x7f199c195a20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 --2- 172.21.15.70:0/1234702607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f199c0fffe0 0x7f199c195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 -- 172.21.15.70:0/1234702607 >> 172.21.15.70:0/1234702607 conn(0x7f199c076780 msgr2=0x7f199c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 -- 172.21.15.70:0/1234702607 shutdown_connections 2023-10-08T08:43:40.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.116+0000 7f19a0c5c700 1 -- 172.21.15.70:0/1234702607 wait complete. 2023-10-08T08:43:40.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T08:43:40.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.251+0000 7fd85fd19700 1 -- 172.21.15.70:0/734580799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8580ff620 msgr2=0x7fd8580ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.251+0000 7fd85fd19700 1 --2- 172.21.15.70:0/734580799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8580ff620 0x7fd8580ffaa0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd854009990 tx=0x7fd854009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.251+0000 7fd85fd19700 1 -- 172.21.15.70:0/734580799 shutdown_connections 2023-10-08T08:43:40.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.251+0000 7fd85fd19700 1 --2- 172.21.15.70:0/734580799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8580fffe0 0x7fd85810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.251+0000 7fd85fd19700 1 --2- 172.21.15.70:0/734580799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8581056b0 0x7fd858105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.251+0000 7fd85fd19700 1 --2- 172.21.15.70:0/734580799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8580ff620 0x7fd8580ffaa0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.251+0000 7fd85fd19700 1 -- 172.21.15.70:0/734580799 >> 172.21.15.70:0/734580799 conn(0x7fd858076780 msgr2=0x7fd858076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.251+0000 7fd85fd19700 1 -- 172.21.15.70:0/734580799 shutdown_connections 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.251+0000 7fd85fd19700 1 -- 172.21.15.70:0/734580799 wait complete. 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85fd19700 1 Processor -- start 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85fd19700 1 -- start start 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85fd19700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580ff620 0x7fd85819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85fd19700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8580fffe0 0x7fd85819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85fd19700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8581056b0 0x7fd858195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85fd19700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858195ec0 con 0x7fd8581056b0 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85fd19700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858196030 con 0x7fd8580fffe0 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85fd19700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8581961f0 con 0x7fd8580ff620 2023-10-08T08:43:40.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85e2b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8581056b0 0x7fd858195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85e2b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8581056b0 0x7fd858195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50832/0 (socket says 172.21.15.70:50832) 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1563809256 learned_addr learned my addr 172.21.15.70:0/1563809256 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85dab5700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580ff620 0x7fd85819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1563809256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580ff620 msgr2=0x7fd85819b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85d2b4700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8580fffe0 0x7fd85819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580ff620 0x7fd85819b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1563809256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8580fffe0 msgr2=0x7fd85819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8580fffe0 0x7fd85819bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1563809256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8540095f0 con 0x7fd8581056b0 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.252+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8581056b0 0x7fd858195850 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd85000ef30 tx=0x7fd85000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.253+0000 7fd84effd700 1 -- 172.21.15.70:0/1563809256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850018070 con 0x7fd8581056b0 2023-10-08T08:43:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.253+0000 7fd84effd700 1 -- 172.21.15.70:0/1563809256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd85000f040 con 0x7fd8581056b0 2023-10-08T08:43:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.253+0000 7fd84effd700 1 -- 172.21.15.70:0/1563809256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000cdb0 con 0x7fd8581056b0 2023-10-08T08:43:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.253+0000 7fd85fd19700 1 -- 172.21.15.70:0/1563809256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd858196470 con 0x7fd8581056b0 2023-10-08T08:43:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.253+0000 7fd85fd19700 1 -- 172.21.15.70:0/1563809256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8581a2710 con 0x7fd8581056b0 2023-10-08T08:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.255+0000 7fd84effd700 1 -- 172.21.15.70:0/1563809256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd850003a00 con 0x7fd8581056b0 2023-10-08T08:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.255+0000 7fd84effd700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8440a15d0 0x7fd8440a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.255+0000 7fd85dab5700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8440a15d0 0x7fd8440a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.255+0000 7fd84effd700 1 -- 172.21.15.70:0/1563809256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd8500ccd40 con 0x7fd8581056b0 2023-10-08T08:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.256+0000 7fd85dab5700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8440a15d0 0x7fd8440a3a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd858077ab0 tx=0x7fd84800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.256+0000 7fd86bf02b80 1 Processor -- start 2023-10-08T08:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.256+0000 7fd86bf02b80 1 -- start start 2023-10-08T08:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.256+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b988ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.256+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ffef0 0x559b98903e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.256+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b989047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.256+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b98863410 con 0x559b98904380 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.256+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b98854bd0 con 0x559b988ff5d0 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.256+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b988524f0 con 0x559b988ffef0 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85e2b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b989047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85e2b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b989047e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50840/0 (socket says 172.21.15.70:50840) 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1846297057 learned_addr learned my addr 172.21.15.70:0/1846297057 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85dab5700 1 --2- 172.21.15.70:0/1846297057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b988ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1846297057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ffef0 msgr2=0x559b98903e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/1846297057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ffef0 0x559b98903e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1846297057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 msgr2=0x559b988ff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/1846297057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b988ff9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1846297057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b98678d90 con 0x559b98904380 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/1846297057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b989047e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd8500961a0 tx=0x7fd850099af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa93ada6008ff726 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd843fff700 1 -- 172.21.15.70:0/1846297057 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850004ad0 con 0x559b98904380 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd843fff700 1 -- 172.21.15.70:0/1846297057 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd85001b320 con 0x559b98904380 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.257+0000 7fd843fff700 1 -- 172.21.15.70:0/1846297057 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850099f00 con 0x559b98904380 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1846297057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 msgr2=0x559b989047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/1846297057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b989047e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd8500961a0 tx=0x7fd850099af0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1846297057 shutdown_connections 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/1846297057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b989047e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/1846297057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b988ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/1846297057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ffef0 0x559b98903e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1846297057 >> 172.21.15.70:0/1846297057 conn(0x559b9886f210 msgr2=0x559b988f6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1846297057 shutdown_connections 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1846297057 wait complete. 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 -- start start 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.258+0000 7fd86bf02b80 1 Processor -- start 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ff5d0 0x559b9890bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b98908f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b98904380 0x559b98909670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b9884dde0 con 0x559b988ffef0 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b987ea6c0 con 0x559b98904380 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b987ea360 con 0x559b988ff5d0 2023-10-08T08:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd86bf02b80 10 client.0 _ll_register_callbacks cb 0x559b986477b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85d2b4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b98908f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85d2b4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b98908f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50844/0 (socket says 172.21.15.70:50844) 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85d2b4700 1 -- 172.21.15.70:0/2814423529 learned_addr learned my addr 172.21.15.70:0/2814423529 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85dab5700 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ff5d0 0x559b9890bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b98904380 0x559b98909670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85d2b4700 1 -- 172.21.15.70:0/2814423529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ff5d0 msgr2=0x559b9890bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85d2b4700 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ff5d0 0x559b9890bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85d2b4700 1 -- 172.21.15.70:0/2814423529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b98904380 msgr2=0x559b98909670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85d2b4700 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b98904380 0x559b98909670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85d2b4700 1 -- 172.21.15.70:0/2814423529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8581a2710 con 0x559b988ffef0 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd85d2b4700 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b98908f30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd8540095c0 tx=0x7fd854005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c280143d436468a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd8417fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:40.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd8417fa700 1 -- 172.21.15.70:0/2814423529 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85401e070 con 0x559b988ffef0 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd8417fa700 1 -- 172.21.15.70:0/2814423529 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd85400bd40 con 0x559b988ffef0 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.259+0000 7fd86bf02b80 1 -- 172.21.15.70:0/2814423529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b98815e60 con 0x559b988ffef0 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd8417fa700 1 -- 172.21.15.70:0/2814423529 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd854029630 con 0x559b988ffef0 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd86bf02b80 10 client.15633 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd86bf02b80 1 -- 172.21.15.70:0/2814423529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559b98661c10 con 0x559b988ffef0 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd8417fa700 1 -- 172.21.15.70:0/2814423529 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559b98815e60 con 0x559b988ffef0 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd8417fa700 1 -- 172.21.15.70:0/2814423529 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd854029c50 con 0x559b988ffef0 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd86bf02b80 10 client.15633 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd86bf02b80 10 client.15633 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd86bf02b80 20 client.15633 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:40.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559b989194b0 0x559b98917ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd86bf02b80 4 client.15633 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd86bf02b80 1 -- 172.21.15.70:0/2814423529 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b98846dc0 con 0x559b989194b0 2023-10-08T08:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.260+0000 7fd85dab5700 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559b989194b0 0x559b98917ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd8417fa700 10 client.15633 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd85dab5700 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559b989194b0 0x559b98917ff0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b77d6bea389e92b server_cookie=517852231ed10148 in_seq=0 out_seq=0 2023-10-08T08:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd8417fa700 1 -- 172.21.15.70:0/2814423529 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559b98846dc0 con 0x559b989194b0 2023-10-08T08:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd8417fa700 10 client.15633 handle_command_reply: tid=0 2023-10-08T08:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd86bf02b80 1 client.15633 shutdown 2023-10-08T08:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd86bf02b80 1 -- 172.21.15.70:0/2814423529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 msgr2=0x559b98908f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b98908f30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd8540095c0 tx=0x7fd854005790 comp rx=0 tx=0).stop 2023-10-08T08:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd86bf02b80 1 -- 172.21.15.70:0/2814423529 shutdown_connections 2023-10-08T08:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559b989194b0 0x559b98917ff0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b98904380 0x559b98909670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ff5d0 0x559b9890bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd8417fa700 0 client.15633 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/2814423529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b98908f30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.261+0000 7fd86bf02b80 1 -- 172.21.15.70:0/2814423529 >> 172.21.15.70:0/2814423529 conn(0x559b9886f210 msgr2=0x559b988f5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.262+0000 7fd86bf02b80 1 -- 172.21.15.70:0/2814423529 shutdown_connections 2023-10-08T08:43:40.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.262+0000 7fd86bf02b80 1 -- 172.21.15.70:0/2814423529 wait complete. 2023-10-08T08:43:40.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.262+0000 7fd86bf02b80 20 client.15633 trim_cache size 0 max 16384 2023-10-08T08:43:40.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd86bf02b80 1 Processor -- start 2023-10-08T08:43:40.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd86bf02b80 1 -- start start 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b9890b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ffef0 0x559b98921e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b98917ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b986ce8d0 con 0x559b98904380 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b98849ed0 con 0x559b988ff5d0 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b986dade0 con 0x559b988ffef0 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85e2b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b98917ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85e2b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b98917ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50854/0 (socket says 172.21.15.70:50854) 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1958755917 learned_addr learned my addr 172.21.15.70:0/1958755917 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85d2b4700 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ffef0 0x559b98921e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85dab5700 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b9890b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1958755917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ffef0 msgr2=0x559b98921e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ffef0 0x559b98921e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1958755917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 msgr2=0x559b9890b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b9890b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.279+0000 7fd85e2b6700 1 -- 172.21.15.70:0/1958755917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b9869f200 con 0x559b98904380 2023-10-08T08:43:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd85dab5700 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b9890b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd85e2b6700 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b98917ff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd850096710 tx=0x7fd85001b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28ab9ed5941af9b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd84cff9700 1 -- 172.21.15.70:0/1958755917 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8500a1fa0 con 0x559b98904380 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd84cff9700 1 -- 172.21.15.70:0/1958755917 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd85009a3a0 con 0x559b98904380 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd84cff9700 1 -- 172.21.15.70:0/1958755917 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850099190 con 0x559b98904380 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1958755917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 msgr2=0x559b98917ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b98917ff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd850096710 tx=0x7fd85001b490 comp rx=0 tx=0).stop 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1958755917 shutdown_connections 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b98904380 0x559b98917ff0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b9890b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/1958755917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b988ffef0 0x559b98921e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1958755917 >> 172.21.15.70:0/1958755917 conn(0x559b9886f210 msgr2=0x559b98902540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1958755917 shutdown_connections 2023-10-08T08:43:40.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.280+0000 7fd86bf02b80 1 -- 172.21.15.70:0/1958755917 wait complete. 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd86bf02b80 1 -- start start 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd86bf02b80 1 Processor -- start 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b989067a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b9890b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd86bf02b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b98904380 0x559b98914460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b98906da0 con 0x559b988ffef0 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b98906f10 con 0x559b988ff5d0 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd86bf02b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b9890bce0 con 0x559b98904380 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd86bf02b80 10 client.0 _ll_register_callbacks cb 0x7fd8500097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:40.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd85d2b4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b9890b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd85d2b4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b9890b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50860/0 (socket says 172.21.15.70:50860) 2023-10-08T08:43:40.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd85d2b4700 1 -- 172.21.15.70:0/976147763 learned_addr learned my addr 172.21.15.70:0/976147763 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:40.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd85dab5700 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b989067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd85d2b4700 1 -- 172.21.15.70:0/976147763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b98904380 msgr2=0x559b98914460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd85d2b4700 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b98904380 0x559b98914460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd85d2b4700 1 -- 172.21.15.70:0/976147763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 msgr2=0x559b989067a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:40.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.281+0000 7fd85d2b4700 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b989067a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd85d2b4700 1 -- 172.21.15.70:0/976147763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b98678d90 con 0x559b988ffef0 2023-10-08T08:43:40.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd85dab5700 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b989067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:40.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd85d2b4700 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b9890b720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd8540098e0 tx=0x7fd85400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a172766cbdb273a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:40.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd8417fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:40.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd8417fa700 1 -- 172.21.15.70:0/976147763 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85401e040 con 0x559b988ffef0 2023-10-08T08:43:40.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd8417fa700 1 -- 172.21.15.70:0/976147763 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd85400bd40 con 0x559b988ffef0 2023-10-08T08:43:40.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd86bf02b80 1 -- 172.21.15.70:0/976147763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd85001b320 con 0x559b988ffef0 2023-10-08T08:43:40.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd8417fa700 1 -- 172.21.15.70:0/976147763 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd854004b00 con 0x559b988ffef0 2023-10-08T08:43:40.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd86bf02b80 10 client.15639 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:40.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd86bf02b80 1 -- 172.21.15.70:0/976147763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559b98677260 con 0x559b988ffef0 2023-10-08T08:43:40.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd8417fa700 1 -- 172.21.15.70:0/976147763 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd85001b320 con 0x559b988ffef0 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd8417fa700 1 -- 172.21.15.70:0/976147763 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd85403a070 con 0x559b988ffef0 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd86bf02b80 10 client.15639 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd86bf02b80 10 client.15639 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd86bf02b80 20 client.15639 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559b98971dd0 0x559b989211a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd86bf02b80 4 client.15639 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.282+0000 7fd86bf02b80 1 -- 172.21.15.70:0/976147763 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559b98846ae0 con 0x559b98971dd0 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd85dab5700 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559b98971dd0 0x559b989211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd8417fa700 10 client.15639 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd85dab5700 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559b98971dd0 0x559b989211a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaef652769fa370a server_cookie=9a4eba456415d26a in_seq=0 out_seq=0 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd8417fa700 1 -- 172.21.15.70:0/976147763 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x559b98846ae0 con 0x559b98971dd0 2023-10-08T08:43:40.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd8417fa700 10 client.15639 handle_command_reply: tid=0 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd86bf02b80 1 client.15639 shutdown 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd86bf02b80 1 -- 172.21.15.70:0/976147763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 msgr2=0x559b9890b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b9890b720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd8540098e0 tx=0x7fd85400b690 comp rx=0 tx=0).stop 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd86bf02b80 1 -- 172.21.15.70:0/976147763 shutdown_connections 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b98904380 0x559b98914460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559b98971dd0 0x559b989211a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559b988ff5d0 0x559b989067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd86bf02b80 1 --2- 172.21.15.70:0/976147763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b988ffef0 0x559b9890b720 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd8417fa700 0 client.15639 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.283+0000 7fd86bf02b80 1 -- 172.21.15.70:0/976147763 >> 172.21.15.70:0/976147763 conn(0x559b9886f210 msgr2=0x559b98917ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd86bf02b80 1 -- 172.21.15.70:0/976147763 shutdown_connections 2023-10-08T08:43:40.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd86bf02b80 1 -- 172.21.15.70:0/976147763 wait complete. 2023-10-08T08:43:40.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd86bf02b80 20 client.15639 trim_cache size 0 max 16384 2023-10-08T08:43:40.294 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "6a2c3394-65b5-11ee-8db5-212e2dc638e7", 2023-10-08T08:43:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2023-10-08T08:43:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24638, 2023-10-08T08:43:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-10-08T08:43:40.294 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-10-08T08:43:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-10-08T08:43:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 99.167126510000003, 2023-10-08T08:43:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2023-10-08T08:43:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2023-10-08T08:43:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T08:43:40.295 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 105.52618205900001 2023-10-08T08:43:40.295 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:40.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 -- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8440a15d0 msgr2=0x7fd8440a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8440a15d0 0x7fd8440a3a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd858077ab0 tx=0x7fd84800b410 comp rx=0 tx=0).stop 2023-10-08T08:43:40.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 -- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8581056b0 msgr2=0x7fd858195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:40.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8581056b0 0x7fd858195850 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd85000ef30 tx=0x7fd85000c3a0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 -- 172.21.15.70:0/1563809256 shutdown_connections 2023-10-08T08:43:40.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8440a15d0 0x7fd8440a3a90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8581056b0 0x7fd858195850 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580ff620 0x7fd85819b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 --2- 172.21.15.70:0/1563809256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8580fffe0 0x7fd85819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 -- 172.21.15.70:0/1563809256 >> 172.21.15.70:0/1563809256 conn(0x7fd858076780 msgr2=0x7fd8580fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 -- 172.21.15.70:0/1563809256 shutdown_connections 2023-10-08T08:43:40.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:40.284+0000 7fd85fd19700 1 -- 172.21.15.70:0/1563809256 wait complete. 2023-10-08T08:43:40.298 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T08:43:40.312 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T08:43:40.312 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-08T08:43:40.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:40.312 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-10-08T08:43:40.330 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-08T08:43:40.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:40.331 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T08:43:40.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:40.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2023-10-08T08:43:40.504 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v1'} 2023-10-08T08:43:40.504 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T08:43:40.504 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T08:43:40.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-08T08:43:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:40 smithi070 ceph-mon[99513]: pgmap v286: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:43:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:40 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3150059625' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:40.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:40 smithi105 ceph-mon[103798]: pgmap v286: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:43:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:40 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3150059625' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:40.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:40 smithi191 ceph-mon[104220]: pgmap v286: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:43:40.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:40 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3150059625' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:41.063 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:43:42.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.308+0000 7f1c70515700 1 -- 172.21.15.70:0/553888700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c680ffb10 msgr2=0x7f1c6810bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:42.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.308+0000 7f1c70515700 1 --2- 172.21.15.70:0/553888700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c680ffb10 0x7f1c6810bd30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000b0d0 tx=0x7f1c6000b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.308+0000 7f1c70515700 1 -- 172.21.15.70:0/553888700 shutdown_connections 2023-10-08T08:43:42.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.308+0000 7f1c70515700 1 --2- 172.21.15.70:0/553888700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c680ffb10 0x7f1c6810bd30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.308+0000 7f1c70515700 1 --2- 172.21.15.70:0/553888700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c68104f10 0x7f1c681052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.308+0000 7f1c70515700 1 --2- 172.21.15.70:0/553888700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c680ff150 0x7f1c680ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.308+0000 7f1c70515700 1 -- 172.21.15.70:0/553888700 >> 172.21.15.70:0/553888700 conn(0x7f1c68074aa0 msgr2=0x7f1c68074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:42.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.308+0000 7f1c70515700 1 -- 172.21.15.70:0/553888700 shutdown_connections 2023-10-08T08:43:42.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.308+0000 7f1c70515700 1 -- 172.21.15.70:0/553888700 wait complete. 2023-10-08T08:43:42.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c70515700 1 Processor -- start 2023-10-08T08:43:42.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c70515700 1 -- start start 2023-10-08T08:43:42.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c70515700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c680ff150 0x7f1c68195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:42.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c70515700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c680ffb10 0x7f1c681962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:42.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c70515700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c68104f10 0x7f1c6819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c70515700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6819ac90 con 0x7f1c68104f10 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c70515700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6819ae00 con 0x7f1c680ff150 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c70515700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6819afc0 con 0x7f1c680ffb10 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c6eab2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c68104f10 0x7f1c6819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c6eab2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c68104f10 0x7f1c6819a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50874/0 (socket says 172.21.15.70:50874) 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c6eab2700 1 -- 172.21.15.70:0/2292728450 learned_addr learned my addr 172.21.15.70:0/2292728450 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c6e2b1700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c680ff150 0x7f1c68195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.309+0000 7f1c6dab0700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c680ffb10 0x7f1c681962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c6eab2700 1 -- 172.21.15.70:0/2292728450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c680ffb10 msgr2=0x7f1c681962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c6eab2700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c680ffb10 0x7f1c681962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c6eab2700 1 -- 172.21.15.70:0/2292728450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c680ff150 msgr2=0x7f1c68195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c6eab2700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c680ff150 0x7f1c68195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c6eab2700 1 -- 172.21.15.70:0/2292728450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c60009d00 con 0x7f1c68104f10 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c6dab0700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c680ffb10 0x7f1c681962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c6eab2700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c68104f10 0x7f1c6819a680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1c60007fd0 tx=0x7f1c600094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c5f7fe700 1 -- 172.21.15.70:0/2292728450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000e040 con 0x7f1c68104f10 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c5f7fe700 1 -- 172.21.15.70:0/2292728450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c60007950 con 0x7f1c68104f10 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6819b240 con 0x7f1c68104f10 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c5f7fe700 1 -- 172.21.15.70:0/2292728450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6001b6b0 con 0x7f1c68104f10 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.310+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c681a2b00 con 0x7f1c68104f10 2023-10-08T08:43:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.311+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c68107410 con 0x7f1c68104f10 2023-10-08T08:43:42.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.312+0000 7f1c5f7fe700 1 -- 172.21.15.70:0/2292728450 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f1c60005050 con 0x7f1c68104f10 2023-10-08T08:43:42.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.312+0000 7f1c5f7fe700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1c540a1550 0x7f1c540a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:42.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.313+0000 7f1c6e2b1700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1c540a1550 0x7f1c540a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:42.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.313+0000 7f1c5f7fe700 1 -- 172.21.15.70:0/2292728450 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1c600cebb0 con 0x7f1c68104f10 2023-10-08T08:43:42.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.313+0000 7f1c6e2b1700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1c540a1550 0x7f1c540a3a10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009a10 tx=0x7f1c64009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:42.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.316+0000 7f1c5f7fe700 1 -- 172.21.15.70:0/2292728450 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1c60097e50 con 0x7f1c68104f10 2023-10-08T08:43:42.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.549+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c6804e4f0 con 0x7f1c68104f10 2023-10-08T08:43:42.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.550+0000 7f1c5f7fe700 1 -- 172.21.15.70:0/2292728450 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1c6009b470 con 0x7f1c68104f10 2023-10-08T08:43:42.551 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1c540a1550 msgr2=0x7f1c540a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1c540a1550 0x7f1c540a3a10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009a10 tx=0x7f1c64009190 comp rx=0 tx=0).stop 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c68104f10 msgr2=0x7f1c6819a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c68104f10 0x7f1c6819a680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1c60007fd0 tx=0x7f1c600094c0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 shutdown_connections 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1c540a1550 0x7f1c540a3a10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c68104f10 0x7f1c6819a680 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c680ff150 0x7f1c68195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 --2- 172.21.15.70:0/2292728450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c680ffb10 0x7f1c681962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:42.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 >> 172.21.15.70:0/2292728450 conn(0x7f1c68074aa0 msgr2=0x7f1c680fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:42.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 shutdown_connections 2023-10-08T08:43:42.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:42.552+0000 7f1c70515700 1 -- 172.21.15.70:0/2292728450 wait complete. 2023-10-08T08:43:42.679 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:42 smithi070 ceph-mon[99513]: pgmap v287: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:43:42.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:42 smithi105 ceph-mon[103798]: pgmap v287: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:43:42.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:42 smithi191 ceph-mon[104220]: pgmap v287: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:43:42.923 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T08:43:42.923 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T08:43:42.923 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2023-10-08T08:43:42.923 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T08:43:42.923 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T08:43:42.923 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T08:43:42.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T08:43:42.923 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T08:43:42.923 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T08:43:42.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:42.924 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2023-10-08T08:43:42.943 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T08:43:42.943 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T08:43:42.943 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T08:43:42.943 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-10-08T08:43:42.943 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-10-08T08:43:42.943 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-10-08T08:43:42.943 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T08:43:42.943 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 41804sec preferred_lft 41804sec 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::5cfd:8641:c68e:a723/64 scope link noprefixroute 2023-10-08T08:43:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-10-08T08:43:42.945 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T08:43:42.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:42.945 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:43:42.945 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:43:42.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2023-10-08T08:43:42.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2023-10-08T08:43:42.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2023-10-08T08:43:42.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T08:43:42.945 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:43:43.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:43.063 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T08:43:43.090 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-10-08T08:43:43.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:43.092 DEBUG:teuthology.orchestra.run.smithi070:> route 2023-10-08T08:43:43.159 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2023-10-08T08:43:43.161 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T08:43:43.162 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T08:43:43.162 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T08:43:43.163 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T08:43:43.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:43.165 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:43:43.166 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:43:43.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T08:43:43.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T08:43:43.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T08:43:43.169 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:43:43.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:43.271 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-10-08T08:43:43.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:43.295 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2023-10-08T08:43:43.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:43.359 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:43:43.359 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:43:43.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T08:43:43.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T08:43:43.360 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:43:43.458 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T08:43:43.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:43.459 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:43:43.459 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:43:43.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T08:43:43.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T08:43:43.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T08:43:43.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T08:43:43.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T08:43:43.459 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:43:43.500 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:43 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2292728450' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T08:43:43.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:43.647 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-10-08T08:43:43.647 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-10-08T08:43:43.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2023-10-08T08:43:43.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T08:43:43.647 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-10-08T08:43:43.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:43 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2292728450' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T08:43:43.796 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T08:43:43.796 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T08:43:43.815 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T08:43:43.816 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T08:43:43.816 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T08:43:43.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:43 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2292728450' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T08:43:43.873 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-08T08:43:43.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:43.874 DEBUG:teuthology.orchestra.run.smithi070:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2023-10-08T08:43:43.956 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2023-10-08T08:43:43.956 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2023-10-08T08:43:43.956 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2023-10-08T08:43:44.140 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2023-10-08T08:43:44.140 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2023-10-08T08:43:44.140 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2023-10-08T08:43:44.140 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.105:3300,172.21.15.191:3300" 2023-10-08T08:43:44.140 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.70:3300,172.21.15.105:3300,172.21.15.191:3300:/ 2023-10-08T08:43:44.140 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=6a2c3394-65b5-11ee-8db5-212e2dc638e7" will pass to kernel 2023-10-08T08:43:44.143 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T08:43:44.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:44.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T08:43:44.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:44.169 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T08:43:44.242 INFO:teuthology.orchestra.run.smithi070.stdout:client15648 2023-10-08T08:43:44.243 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:43:44.243 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T08:43:44.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:44.301 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T08:43:44.373 INFO:teuthology.orchestra.run.smithi070.stdout:client15648 2023-10-08T08:43:44.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:44.373 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T08:43:44.445 INFO:teuthology.orchestra.run.smithi070.stdout:client15648 2023-10-08T08:43:44.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:43:44.445 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7.client15648/status') 2023-10-08T08:43:44.526 INFO:teuthology.orchestra.run.smithi070.stdout:instance: client.15648 (3)192.168.0.1:0/2894367917 2023-10-08T08:43:44.526 INFO:teuthology.orchestra.run.smithi070.stdout:blocklisted: false 2023-10-08T08:43:44.527 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records in 2023-10-08T08:43:44.527 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records out 2023-10-08T08:43:44.527 INFO:teuthology.orchestra.run.smithi070.stderr:70 bytes copied, 2.0404e-05 s, 3.4 MB/s 2023-10-08T08:43:44.528 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-08T08:43:44.541 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-08T08:43:44.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:44.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.689+0000 7fe385665700 1 -- 172.21.15.70:0/950109363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801048e0 msgr2=0x7fe38010c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.689+0000 7fe385665700 1 --2- 172.21.15.70:0/950109363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801048e0 0x7fe38010c470 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe37800b0a0 tx=0x7fe37800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.689+0000 7fe385665700 1 -- 172.21.15.70:0/950109363 shutdown_connections 2023-10-08T08:43:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.689+0000 7fe385665700 1 --2- 172.21.15.70:0/950109363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801048e0 0x7fe38010c470 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.689+0000 7fe385665700 1 --2- 172.21.15.70:0/950109363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3801002b0 0x7fe380100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.689+0000 7fe385665700 1 --2- 172.21.15.70:0/950109363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe380100c60 0x7fe380104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.689+0000 7fe385665700 1 -- 172.21.15.70:0/950109363 >> 172.21.15.70:0/950109363 conn(0x7fe380074820 msgr2=0x7fe380074c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.689+0000 7fe385665700 1 -- 172.21.15.70:0/950109363 shutdown_connections 2023-10-08T08:43:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.689+0000 7fe385665700 1 -- 172.21.15.70:0/950109363 wait complete. 2023-10-08T08:43:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe385665700 1 Processor -- start 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe385665700 1 -- start start 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe385665700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801002b0 0x7fe380195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe385665700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3801048e0 0x7fe380195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe385665700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe380196310 0x7fe3801a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe385665700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801a5450 con 0x7fe3801002b0 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe385665700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801a5590 con 0x7fe3801048e0 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe385665700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801a5720 con 0x7fe380196310 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe37effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801002b0 0x7fe380195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe37effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801002b0 0x7fe380195890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50886/0 (socket says 172.21.15.70:50886) 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe37effd700 1 -- 172.21.15.70:0/2326405150 learned_addr learned my addr 172.21.15.70:0/2326405150 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe37f7fe700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe380196310 0x7fe3801a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.690+0000 7fe37e7fc700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3801048e0 0x7fe380195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe37effd700 1 -- 172.21.15.70:0/2326405150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe380196310 msgr2=0x7fe3801a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe37effd700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe380196310 0x7fe3801a4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe37effd700 1 -- 172.21.15.70:0/2326405150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3801048e0 msgr2=0x7fe380195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe37effd700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3801048e0 0x7fe380195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe37effd700 1 -- 172.21.15.70:0/2326405150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009d00 con 0x7fe3801002b0 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe37e7fc700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3801048e0 0x7fe380195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe37effd700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801002b0 0x7fe380195890 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe37400c950 tx=0x7fe37400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe367fff700 1 -- 172.21.15.70:0/2326405150 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37400cea0 con 0x7fe3801002b0 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe367fff700 1 -- 172.21.15.70:0/2326405150 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe374004830 con 0x7fe3801002b0 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3801a5a00 con 0x7fe3801002b0 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe367fff700 1 -- 172.21.15.70:0/2326405150 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740054e0 con 0x7fe3801002b0 2023-10-08T08:43:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.691+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3801a5f10 con 0x7fe3801002b0 2023-10-08T08:43:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.692+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe380107bc0 con 0x7fe3801002b0 2023-10-08T08:43:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.693+0000 7fe367fff700 1 -- 172.21.15.70:0/2326405150 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe3740049a0 con 0x7fe3801002b0 2023-10-08T08:43:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.694+0000 7fe367fff700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe3680a14d0 0x7fe3680a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.694+0000 7fe37e7fc700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe3680a14d0 0x7fe3680a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.694+0000 7fe367fff700 1 -- 172.21.15.70:0/2326405150 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe3740cd1c0 con 0x7fe3801002b0 2023-10-08T08:43:44.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.694+0000 7fe37e7fc700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe3680a14d0 0x7fe3680a3990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe370005e10 tx=0x7fe370005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:44.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.698+0000 7fe367fff700 1 -- 172.21.15.70:0/2326405150 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe3740963d0 con 0x7fe3801002b0 2023-10-08T08:43:44.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:44 smithi070 ceph-mon[99513]: pgmap v288: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-08T08:43:44.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:44 smithi105 ceph-mon[103798]: pgmap v288: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-08T08:43:44.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:44 smithi191 ceph-mon[104220]: pgmap v288: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-08T08:43:44.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.891+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe380068880 con 0x7fe3801002b0 2023-10-08T08:43:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.893+0000 7fe367fff700 1 -- 172.21.15.70:0/2326405150 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7fe37401d020 con 0x7fe3801002b0 2023-10-08T08:43:44.894 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:44.894 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:44.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe3680a14d0 msgr2=0x7fe3680a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:44.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe3680a14d0 0x7fe3680a3990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe370005e10 tx=0x7fe370005d60 comp rx=0 tx=0).stop 2023-10-08T08:43:44.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801002b0 msgr2=0x7fe380195890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:44.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801002b0 0x7fe380195890 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe37400c950 tx=0x7fe37400cc60 comp rx=0 tx=0).stop 2023-10-08T08:43:44.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 shutdown_connections 2023-10-08T08:43:44.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe3680a14d0 0x7fe3680a3990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe380196310 0x7fe3801a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3801002b0 0x7fe380195890 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 --2- 172.21.15.70:0/2326405150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3801048e0 0x7fe380195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:44.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 >> 172.21.15.70:0/2326405150 conn(0x7fe380074820 msgr2=0x7fe3800fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:44.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 shutdown_connections 2023-10-08T08:43:44.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:44.895+0000 7fe385665700 1 -- 172.21.15.70:0/2326405150 wait complete. 2023-10-08T08:43:44.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:43:44.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:43:45.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 -- 172.21.15.70:0/2381309510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b400ff620 msgr2=0x7f4b400ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/2381309510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b400ff620 0x7f4b400ffaa0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009990 tx=0x7f4b3c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 -- 172.21.15.70:0/2381309510 shutdown_connections 2023-10-08T08:43:45.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/2381309510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b400fffe0 0x7f4b4010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/2381309510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b401056b0 0x7f4b40105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/2381309510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b400ff620 0x7f4b400ffaa0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 -- 172.21.15.70:0/2381309510 >> 172.21.15.70:0/2381309510 conn(0x7f4b40076780 msgr2=0x7f4b40076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:45.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 -- 172.21.15.70:0/2381309510 shutdown_connections 2023-10-08T08:43:45.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 -- 172.21.15.70:0/2381309510 wait complete. 2023-10-08T08:43:45.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 Processor -- start 2023-10-08T08:43:45.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.034+0000 7f4b47c6a700 1 -- start start 2023-10-08T08:43:45.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b47c6a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b400ff620 0x7f4b401979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b47c6a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b400fffe0 0x7f4b40197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b47c6a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b401056b0 0x7f4b401a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b47c6a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b40198750 con 0x7f4b401056b0 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b47c6a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b401a2f60 con 0x7f4b400ff620 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b47c6a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b401a30a0 con 0x7f4b400fffe0 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b46207700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b401056b0 0x7f4b401a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b46207700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b401056b0 0x7f4b401a2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50904/0 (socket says 172.21.15.70:50904) 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b46207700 1 -- 172.21.15.70:0/607374374 learned_addr learned my addr 172.21.15.70:0/607374374 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b45a06700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b400ff620 0x7f4b401979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b45205700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b400fffe0 0x7f4b40197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b46207700 1 -- 172.21.15.70:0/607374374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b400fffe0 msgr2=0x7f4b40197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b46207700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b400fffe0 0x7f4b40197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b46207700 1 -- 172.21.15.70:0/607374374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b400ff620 msgr2=0x7f4b401979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b46207700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b400ff620 0x7f4b401979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b46207700 1 -- 172.21.15.70:0/607374374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c0095f0 con 0x7f4b401056b0 2023-10-08T08:43:45.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b45205700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b400fffe0 0x7f4b40197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:45.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b46207700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b401056b0 0x7f4b401a2a20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800ada0 tx=0x7f4b3800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:45.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b36ffd700 1 -- 172.21.15.70:0/607374374 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800f070 con 0x7f4b401056b0 2023-10-08T08:43:45.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b36ffd700 1 -- 172.21.15.70:0/607374374 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b38007b30 con 0x7f4b401056b0 2023-10-08T08:43:45.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b401a3330 con 0x7f4b401056b0 2023-10-08T08:43:45.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b36ffd700 1 -- 172.21.15.70:0/607374374 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380053e0 con 0x7f4b401056b0 2023-10-08T08:43:45.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.035+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b401a3840 con 0x7f4b401056b0 2023-10-08T08:43:45.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.036+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b40107c30 con 0x7f4b401056b0 2023-10-08T08:43:45.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.037+0000 7f4b36ffd700 1 -- 172.21.15.70:0/607374374 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f4b3800c980 con 0x7f4b401056b0 2023-10-08T08:43:45.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.038+0000 7f4b36ffd700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b2c0a14d0 0x7f4b2c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.038+0000 7f4b45a06700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b2c0a14d0 0x7f4b2c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.038+0000 7f4b36ffd700 1 -- 172.21.15.70:0/607374374 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4b380cccf0 con 0x7f4b401056b0 2023-10-08T08:43:45.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.038+0000 7f4b45a06700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b2c0a14d0 0x7f4b2c0a3990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b40077ab0 tx=0x7f4b3000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:45.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.041+0000 7f4b36ffd700 1 -- 172.21.15.70:0/607374374 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4b38095ff0 con 0x7f4b401056b0 2023-10-08T08:43:45.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.241+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b40067df0 con 0x7f4b401056b0 2023-10-08T08:43:45.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.241+0000 7f4b36ffd700 1 -- 172.21.15.70:0/607374374 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b38099610 con 0x7f4b401056b0 2023-10-08T08:43:45.242 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:43:45.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b2c0a14d0 msgr2=0x7f4b2c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b2c0a14d0 0x7f4b2c0a3990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b40077ab0 tx=0x7f4b3000a380 comp rx=0 tx=0).stop 2023-10-08T08:43:45.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b401056b0 msgr2=0x7f4b401a2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b401056b0 0x7f4b401a2a20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800ada0 tx=0x7f4b3800c330 comp rx=0 tx=0).stop 2023-10-08T08:43:45.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 shutdown_connections 2023-10-08T08:43:45.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b2c0a14d0 0x7f4b2c0a3990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b401056b0 0x7f4b401a2a20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b400ff620 0x7f4b401979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 --2- 172.21.15.70:0/607374374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b400fffe0 0x7f4b40197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 >> 172.21.15.70:0/607374374 conn(0x7f4b40076780 msgr2=0x7f4b400fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:45.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 shutdown_connections 2023-10-08T08:43:45.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.244+0000 7f4b47c6a700 1 -- 172.21.15.70:0/607374374 wait complete. 2023-10-08T08:43:45.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:43:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.381+0000 7f083b9e8700 1 -- 172.21.15.70:0/2525329303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834068ab0 msgr2=0x7f0834068f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.381+0000 7f083b9e8700 1 --2- 172.21.15.70:0/2525329303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834068ab0 0x7f0834068f30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0830009990 tx=0x7f0830009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.381+0000 7f083b9e8700 1 -- 172.21.15.70:0/2525329303 shutdown_connections 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.381+0000 7f083b9e8700 1 --2- 172.21.15.70:0/2525329303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0834069470 0x7f083410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.381+0000 7f083b9e8700 1 --2- 172.21.15.70:0/2525329303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0834106770 0x7f0834106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.381+0000 7f083b9e8700 1 --2- 172.21.15.70:0/2525329303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834068ab0 0x7f0834068f30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.381+0000 7f083b9e8700 1 -- 172.21.15.70:0/2525329303 >> 172.21.15.70:0/2525329303 conn(0x7f0834076790 msgr2=0x7f0834076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.381+0000 7f083b9e8700 1 -- 172.21.15.70:0/2525329303 shutdown_connections 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.381+0000 7f083b9e8700 1 -- 172.21.15.70:0/2525329303 wait complete. 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f083b9e8700 1 Processor -- start 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f083b9e8700 1 -- start start 2023-10-08T08:43:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f083b9e8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0834068ab0 0x7f083419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f083b9e8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834069470 0x7f083419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f083b9e8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0834106770 0x7f0834196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f083b9e8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08341970d0 con 0x7f0834069470 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f083b9e8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0834197240 con 0x7f0834106770 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f083b9e8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0834197400 con 0x7f0834068ab0 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f0838f83700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834069470 0x7f083419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f0838f83700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834069470 0x7f083419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50916/0 (socket says 172.21.15.70:50916) 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f0838f83700 1 -- 172.21.15.70:0/136148709 learned_addr learned my addr 172.21.15.70:0/136148709 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f0839784700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0834068ab0 0x7f083419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.382+0000 7f0839f85700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0834106770 0x7f0834196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f0838f83700 1 -- 172.21.15.70:0/136148709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0834068ab0 msgr2=0x7f083419c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f0838f83700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0834068ab0 0x7f083419c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f0838f83700 1 -- 172.21.15.70:0/136148709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0834106770 msgr2=0x7f0834196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f0838f83700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0834106770 0x7f0834196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f0838f83700 1 -- 172.21.15.70:0/136148709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08300095f0 con 0x7f0834069470 2023-10-08T08:43:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f0839f85700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0834106770 0x7f0834196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f0838f83700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834069470 0x7f083419ce80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0830000c00 tx=0x7f083000f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f082a7fc700 1 -- 172.21.15.70:0/136148709 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083001d070 con 0x7f0834069470 2023-10-08T08:43:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0834197680 con 0x7f0834069470 2023-10-08T08:43:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f082a7fc700 1 -- 172.21.15.70:0/136148709 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f083000fd30 con 0x7f0834069470 2023-10-08T08:43:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f082a7fc700 1 -- 172.21.15.70:0/136148709 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830017630 con 0x7f0834069470 2023-10-08T08:43:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.383+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08341a3930 con 0x7f0834069470 2023-10-08T08:43:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.384+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0834108ca0 con 0x7f0834069470 2023-10-08T08:43:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.385+0000 7f082a7fc700 1 -- 172.21.15.70:0/136148709 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f08300177b0 con 0x7f0834069470 2023-10-08T08:43:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.385+0000 7f082a7fc700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08200a14d0 0x7f08200a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.386+0000 7f082a7fc700 1 -- 172.21.15.70:0/136148709 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f08300ce520 con 0x7f0834069470 2023-10-08T08:43:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.386+0000 7f0839784700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08200a14d0 0x7f08200a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.386+0000 7f0839784700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08200a14d0 0x7f08200a3990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0824005950 tx=0x7f082400a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.390+0000 7f082a7fc700 1 -- 172.21.15.70:0/136148709 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f083005d100 con 0x7f0834069470 2023-10-08T08:43:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.585+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0834197f30 con 0x7f0834069470 2023-10-08T08:43:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.585+0000 7f082a7fc700 1 -- 172.21.15.70:0/136148709 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0830027020 con 0x7f0834069470 2023-10-08T08:43:45.586 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:45.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08200a14d0 msgr2=0x7f08200a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08200a14d0 0x7f08200a3990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0824005950 tx=0x7f082400a300 comp rx=0 tx=0).stop 2023-10-08T08:43:45.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834069470 msgr2=0x7f083419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834069470 0x7f083419ce80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0830000c00 tx=0x7f083000f7d0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 shutdown_connections 2023-10-08T08:43:45.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08200a14d0 0x7f08200a3990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0834106770 0x7f0834196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0834068ab0 0x7f083419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 --2- 172.21.15.70:0/136148709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0834069470 0x7f083419ce80 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.587+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 >> 172.21.15.70:0/136148709 conn(0x7f0834076790 msgr2=0x7f08340fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:45.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.588+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 shutdown_connections 2023-10-08T08:43:45.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.588+0000 7f083b9e8700 1 -- 172.21.15.70:0/136148709 wait complete. 2023-10-08T08:43:45.600 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:45 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2326405150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:45.600 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:45 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/607374374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:45.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:43:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.724+0000 7f089abdb700 1 -- 172.21.15.70:0/415786587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0894100730 msgr2=0x7f0894100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.724+0000 7f089abdb700 1 --2- 172.21.15.70:0/415786587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0894100730 0x7f0894100bb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0880009990 tx=0x7f0880009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.724+0000 7f089abdb700 1 -- 172.21.15.70:0/415786587 shutdown_connections 2023-10-08T08:43:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.724+0000 7f089abdb700 1 --2- 172.21.15.70:0/415786587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08941010f0 0x7f089410d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.724+0000 7f089abdb700 1 --2- 172.21.15.70:0/415786587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894106740 0x7f0894106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.724+0000 7f089abdb700 1 --2- 172.21.15.70:0/415786587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0894100730 0x7f0894100bb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.724+0000 7f089abdb700 1 -- 172.21.15.70:0/415786587 >> 172.21.15.70:0/415786587 conn(0x7f08940fc200 msgr2=0x7f08940fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:45.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.724+0000 7f089abdb700 1 -- 172.21.15.70:0/415786587 shutdown_connections 2023-10-08T08:43:45.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.724+0000 7f089abdb700 1 -- 172.21.15.70:0/415786587 wait complete. 2023-10-08T08:43:45.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f089abdb700 1 Processor -- start 2023-10-08T08:43:45.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f089abdb700 1 -- start start 2023-10-08T08:43:45.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f089abdb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894100730 0x7f089419c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f089abdb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08941010f0 0x7f089419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f089abdb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0894106740 0x7f08941969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f089abdb700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0894197010 con 0x7f08941010f0 2023-10-08T08:43:45.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f089abdb700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0894197180 con 0x7f0894100730 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f089abdb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0894197340 con 0x7f0894106740 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0893fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08941010f0 0x7f089419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0893fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08941010f0 0x7f089419cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50930/0 (socket says 172.21.15.70:50930) 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0893fff700 1 -- 172.21.15.70:0/979324921 learned_addr learned my addr 172.21.15.70:0/979324921 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0899178700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0894106740 0x7f08941969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0898977700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894100730 0x7f089419c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0893fff700 1 -- 172.21.15.70:0/979324921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0894106740 msgr2=0x7f08941969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0893fff700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0894106740 0x7f08941969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0893fff700 1 -- 172.21.15.70:0/979324921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894100730 msgr2=0x7f089419c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0893fff700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894100730 0x7f089419c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0893fff700 1 -- 172.21.15.70:0/979324921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08800095f0 con 0x7f08941010f0 2023-10-08T08:43:45.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.725+0000 7f0893fff700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08941010f0 0x7f089419cdc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f08800098e0 tx=0x7f088000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.726+0000 7f0891ffb700 1 -- 172.21.15.70:0/979324921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088001d070 con 0x7f08941010f0 2023-10-08T08:43:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.726+0000 7f0891ffb700 1 -- 172.21.15.70:0/979324921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f088000fb90 con 0x7f08941010f0 2023-10-08T08:43:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.726+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08941975c0 con 0x7f08941010f0 2023-10-08T08:43:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.726+0000 7f0891ffb700 1 -- 172.21.15.70:0/979324921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880017650 con 0x7f08941010f0 2023-10-08T08:43:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.726+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08941a3870 con 0x7f08941010f0 2023-10-08T08:43:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.727+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0894108cc0 con 0x7f08941010f0 2023-10-08T08:43:45.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.728+0000 7f0891ffb700 1 -- 172.21.15.70:0/979324921 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f088000fd00 con 0x7f08941010f0 2023-10-08T08:43:45.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.728+0000 7f0891ffb700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08840a14d0 0x7f08840a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:45.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.728+0000 7f0891ffb700 1 -- 172.21.15.70:0/979324921 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f08800ce280 con 0x7f08941010f0 2023-10-08T08:43:45.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.728+0000 7f0898977700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08840a14d0 0x7f08840a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:45.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.729+0000 7f0898977700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08840a14d0 0x7f08840a3990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0888005950 tx=0x7f0888005c70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:45.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.733+0000 7f0891ffb700 1 -- 172.21.15.70:0/979324921 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0880097520 con 0x7f08941010f0 2023-10-08T08:43:45.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:45 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2326405150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:45.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:45 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/607374374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:45.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:45 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2326405150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:45.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:45 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/607374374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:45.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.923+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0894197e70 con 0x7f08941010f0 2023-10-08T08:43:45.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.924+0000 7f0891ffb700 1 -- 172.21.15.70:0/979324921 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0880022470 con 0x7f08941010f0 2023-10-08T08:43:45.925 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:43:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08840a14d0 msgr2=0x7f08840a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08840a14d0 0x7f08840a3990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0888005950 tx=0x7f0888005c70 comp rx=0 tx=0).stop 2023-10-08T08:43:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08941010f0 msgr2=0x7f089419cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08941010f0 0x7f089419cdc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f08800098e0 tx=0x7f088000f720 comp rx=0 tx=0).stop 2023-10-08T08:43:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 shutdown_connections 2023-10-08T08:43:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08840a14d0 0x7f08840a3990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0894106740 0x7f08941969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0894100730 0x7f089419c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 --2- 172.21.15.70:0/979324921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08941010f0 0x7f089419cdc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 >> 172.21.15.70:0/979324921 conn(0x7f08940fc200 msgr2=0x7f08940fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 shutdown_connections 2023-10-08T08:43:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:45.926+0000 7f089abdb700 1 -- 172.21.15.70:0/979324921 wait complete. 2023-10-08T08:43:45.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:43:46.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.063+0000 7fc3a4057700 1 -- 172.21.15.70:0/3711416054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c100720 msgr2=0x7fc39c100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.063+0000 7fc3a4057700 1 --2- 172.21.15.70:0/3711416054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c100720 0x7fc39c100ba0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc398009990 tx=0x7fc398009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.063+0000 7fc3a4057700 1 -- 172.21.15.70:0/3711416054 shutdown_connections 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.063+0000 7fc3a4057700 1 --2- 172.21.15.70:0/3711416054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39c1010e0 0x7fc39c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.063+0000 7fc3a4057700 1 --2- 172.21.15.70:0/3711416054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc39c106730 0x7fc39c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.063+0000 7fc3a4057700 1 --2- 172.21.15.70:0/3711416054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c100720 0x7fc39c100ba0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.063+0000 7fc3a4057700 1 -- 172.21.15.70:0/3711416054 >> 172.21.15.70:0/3711416054 conn(0x7fc39c0fc230 msgr2=0x7fc39c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.063+0000 7fc3a4057700 1 -- 172.21.15.70:0/3711416054 shutdown_connections 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.063+0000 7fc3a4057700 1 -- 172.21.15.70:0/3711416054 wait complete. 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a4057700 1 Processor -- start 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a4057700 1 -- start start 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a4057700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39c100720 0x7fc39c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a4057700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc39c1010e0 0x7fc39c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a4057700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c106730 0x7fc39c1969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a4057700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c197020 con 0x7fc39c106730 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a4057700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c197190 con 0x7fc39c100720 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a4057700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c197350 con 0x7fc39c1010e0 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a25f4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c106730 0x7fc39c1969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a25f4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c106730 0x7fc39c1969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50946/0 (socket says 172.21.15.70:50946) 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a25f4700 1 -- 172.21.15.70:0/1816095386 learned_addr learned my addr 172.21.15.70:0/1816095386 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a1df3700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39c100720 0x7fc39c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a15f2700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc39c1010e0 0x7fc39c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a25f4700 1 -- 172.21.15.70:0/1816095386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc39c1010e0 msgr2=0x7fc39c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a25f4700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc39c1010e0 0x7fc39c19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a25f4700 1 -- 172.21.15.70:0/1816095386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39c100720 msgr2=0x7fc39c19c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a25f4700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39c100720 0x7fc39c19c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.064+0000 7fc3a25f4700 1 -- 172.21.15.70:0/1816095386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980095f0 con 0x7fc39c106730 2023-10-08T08:43:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.065+0000 7fc3a25f4700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c106730 0x7fc39c1969c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc394007ee0 tx=0x7fc39400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.065+0000 7fc392ffd700 1 -- 172.21.15.70:0/1816095386 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394017070 con 0x7fc39c106730 2023-10-08T08:43:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.065+0000 7fc392ffd700 1 -- 172.21.15.70:0/1816095386 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc39400f040 con 0x7fc39c106730 2023-10-08T08:43:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.065+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c197630 con 0x7fc39c106730 2023-10-08T08:43:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.065+0000 7fc392ffd700 1 -- 172.21.15.70:0/1816095386 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394005580 con 0x7fc39c106730 2023-10-08T08:43:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.065+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c1a3880 con 0x7fc39c106730 2023-10-08T08:43:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.066+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c108cb0 con 0x7fc39c106730 2023-10-08T08:43:46.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.067+0000 7fc392ffd700 1 -- 172.21.15.70:0/1816095386 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fc39400db20 con 0x7fc39c106730 2023-10-08T08:43:46.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.067+0000 7fc392ffd700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3880a14d0 0x7fc3880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.068+0000 7fc3a1df3700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3880a14d0 0x7fc3880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.068+0000 7fc392ffd700 1 -- 172.21.15.70:0/1816095386 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc3940ccf20 con 0x7fc39c106730 2023-10-08T08:43:46.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.068+0000 7fc3a1df3700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3880a14d0 0x7fc3880a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005950 tx=0x7fc38c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.071+0000 7fc392ffd700 1 -- 172.21.15.70:0/1816095386 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc394096190 con 0x7fc39c106730 2023-10-08T08:43:46.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.266+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc39c197e80 con 0x7fc39c106730 2023-10-08T08:43:46.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.267+0000 7fc392ffd700 1 -- 172.21.15.70:0/1816095386 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc3940997b0 con 0x7fc39c106730 2023-10-08T08:43:46.268 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:46.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3880a14d0 msgr2=0x7fc3880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3880a14d0 0x7fc3880a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005950 tx=0x7fc38c00b410 comp rx=0 tx=0).stop 2023-10-08T08:43:46.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c106730 msgr2=0x7fc39c1969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c106730 0x7fc39c1969c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc394007ee0 tx=0x7fc39400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 shutdown_connections 2023-10-08T08:43:46.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3880a14d0 0x7fc3880a3990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc39c106730 0x7fc39c1969c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39c100720 0x7fc39c19c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 --2- 172.21.15.70:0/1816095386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc39c1010e0 0x7fc39c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 >> 172.21.15.70:0/1816095386 conn(0x7fc39c0fc230 msgr2=0x7fc39c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:46.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 shutdown_connections 2023-10-08T08:43:46.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.269+0000 7fc3a4057700 1 -- 172.21.15.70:0/1816095386 wait complete. 2023-10-08T08:43:46.282 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:46.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 -- 172.21.15.70:0/2320889302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5410105600 msgr2=0x7f54101059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 --2- 172.21.15.70:0/2320889302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5410105600 0x7f54101059e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f54000099c0 tx=0x7f5400009cd0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 -- 172.21.15.70:0/2320889302 shutdown_connections 2023-10-08T08:43:46.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 --2- 172.21.15.70:0/2320889302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54100fff00 0x7f541010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 --2- 172.21.15.70:0/2320889302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5410105600 0x7f54101059e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 --2- 172.21.15.70:0/2320889302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54100ff540 0x7f54100ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 -- 172.21.15.70:0/2320889302 >> 172.21.15.70:0/2320889302 conn(0x7f54100fb030 msgr2=0x7f54100fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:46.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 -- 172.21.15.70:0/2320889302 shutdown_connections 2023-10-08T08:43:46.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 -- 172.21.15.70:0/2320889302 wait complete. 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 Processor -- start 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.402+0000 7f54186de700 1 -- start start 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54186de700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54100ff540 0x7f54101011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54186de700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54100fff00 0x7f54101016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54186de700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5410105600 0x7f5410101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54186de700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54101a4dd0 con 0x7f54100fff00 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54186de700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54101a4f40 con 0x7f5410105600 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54186de700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54101a5100 con 0x7f54100ff540 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5415c79700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54100fff00 0x7f54101016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5415c79700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54100fff00 0x7f54101016f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50958/0 (socket says 172.21.15.70:50958) 2023-10-08T08:43:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5415c79700 1 -- 172.21.15.70:0/3232085793 learned_addr learned my addr 172.21.15.70:0/3232085793 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5416c7b700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5410105600 0x7f5410101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f541647a700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54100ff540 0x7f54101011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5415c79700 1 -- 172.21.15.70:0/3232085793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54100ff540 msgr2=0x7f54101011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5415c79700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54100ff540 0x7f54101011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5415c79700 1 -- 172.21.15.70:0/3232085793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5410105600 msgr2=0x7f5410101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5415c79700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5410105600 0x7f5410101c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5415c79700 1 -- 172.21.15.70:0/3232085793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54000095f0 con 0x7f54100fff00 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f5415c79700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54100fff00 0x7f54101016f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f540c00d950 tx=0x7f540c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54077fe700 1 -- 172.21.15.70:0/3232085793 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c00f890 con 0x7f54100fff00 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54101a53e0 con 0x7f54100fff00 2023-10-08T08:43:46.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54077fe700 1 -- 172.21.15.70:0/3232085793 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f540c010460 con 0x7f54100fff00 2023-10-08T08:43:46.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.403+0000 7f54077fe700 1 -- 172.21.15.70:0/3232085793 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c00e610 con 0x7f54100fff00 2023-10-08T08:43:46.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.404+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54101a58f0 con 0x7f54100fff00 2023-10-08T08:43:46.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.404+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5410100c60 con 0x7f54100fff00 2023-10-08T08:43:46.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.405+0000 7f54077fe700 1 -- 172.21.15.70:0/3232085793 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f540c0108d0 con 0x7f54100fff00 2023-10-08T08:43:46.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.406+0000 7f54077fe700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53fc0a14d0 0x7f53fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.406+0000 7f541647a700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53fc0a14d0 0x7f53fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.406+0000 7f54077fe700 1 -- 172.21.15.70:0/3232085793 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f540c0ccee0 con 0x7f54100fff00 2023-10-08T08:43:46.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.406+0000 7f541647a700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53fc0a14d0 0x7f53fc0a3990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5400009990 tx=0x7f5400003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:46.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.410+0000 7f54077fe700 1 -- 172.21.15.70:0/3232085793 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f540c096150 con 0x7f54100fff00 2023-10-08T08:43:46.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.602+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f541010f460 con 0x7f54100fff00 2023-10-08T08:43:46.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.604+0000 7f54077fe700 1 -- 172.21.15.70:0/3232085793 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7f540c016090 con 0x7f54100fff00 2023-10-08T08:43:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:46.605 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:46.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53fc0a14d0 msgr2=0x7f53fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53fc0a14d0 0x7f53fc0a3990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5400009990 tx=0x7f5400003680 comp rx=0 tx=0).stop 2023-10-08T08:43:46.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54100fff00 msgr2=0x7f54101016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54100fff00 0x7f54101016f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f540c00d950 tx=0x7f540c00dc60 comp rx=0 tx=0).stop 2023-10-08T08:43:46.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 shutdown_connections 2023-10-08T08:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53fc0a14d0 0x7f53fc0a3990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5410105600 0x7f5410101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54100ff540 0x7f54101011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 --2- 172.21.15.70:0/3232085793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54100fff00 0x7f54101016f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 >> 172.21.15.70:0/3232085793 conn(0x7f54100fb030 msgr2=0x7f54100fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:46.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 shutdown_connections 2023-10-08T08:43:46.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.606+0000 7f54186de700 1 -- 172.21.15.70:0/3232085793 wait complete. 2023-10-08T08:43:46.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:46 smithi070 ceph-mon[99513]: pgmap v289: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:43:46.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:46 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/136148709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:46.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:46 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/979324921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:46.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:46 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1816095386' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:46.620 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:43:46.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:43:46.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.743+0000 7f98b5114700 1 -- 172.21.15.70:0/91126190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b0100b80 msgr2=0x7f98b010c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.743+0000 7f98b5114700 1 --2- 172.21.15.70:0/91126190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b0100b80 0x7f98b010c510 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f98a800b0a0 tx=0x7f98a800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.743+0000 7f98b5114700 1 -- 172.21.15.70:0/91126190 shutdown_connections 2023-10-08T08:43:46.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.743+0000 7f98b5114700 1 --2- 172.21.15.70:0/91126190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b0100b80 0x7f98b010c510 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.743+0000 7f98b5114700 1 --2- 172.21.15.70:0/91126190 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98b01046a0 0x7f98b0104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.743+0000 7f98b5114700 1 --2- 172.21.15.70:0/91126190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b01001c0 0x7f98b0100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.743+0000 7f98b5114700 1 -- 172.21.15.70:0/91126190 >> 172.21.15.70:0/91126190 conn(0x7f98b0074940 msgr2=0x7f98b0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:46.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.744+0000 7f98b5114700 1 -- 172.21.15.70:0/91126190 shutdown_connections 2023-10-08T08:43:46.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.744+0000 7f98b5114700 1 -- 172.21.15.70:0/91126190 wait complete. 2023-10-08T08:43:46.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.744+0000 7f98b5114700 1 Processor -- start 2023-10-08T08:43:46.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.744+0000 7f98b5114700 1 -- start start 2023-10-08T08:43:46.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98b5114700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b01001c0 0x7f98b0197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98b5114700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b0100b80 0x7f98b0198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98b5114700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98b01046a0 0x7f98b01a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98b5114700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b0198910 con 0x7f98b01001c0 2023-10-08T08:43:46.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98b5114700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b01a30c0 con 0x7f98b0100b80 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98b5114700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b01a3200 con 0x7f98b01046a0 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98aed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b01001c0 0x7f98b0197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98aed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b01001c0 0x7f98b0197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50970/0 (socket says 172.21.15.70:50970) 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98aed9d700 1 -- 172.21.15.70:0/1383291230 learned_addr learned my addr 172.21.15.70:0/1383291230 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98af59e700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98b01046a0 0x7f98b01a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98ae59c700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b0100b80 0x7f98b0198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98aed9d700 1 -- 172.21.15.70:0/1383291230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98b01046a0 msgr2=0x7f98b01a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98aed9d700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98b01046a0 0x7f98b01a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98aed9d700 1 -- 172.21.15.70:0/1383291230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b0100b80 msgr2=0x7f98b0198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98aed9d700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b0100b80 0x7f98b0198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98aed9d700 1 -- 172.21.15.70:0/1383291230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8009d00 con 0x7f98b01001c0 2023-10-08T08:43:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98ae59c700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b0100b80 0x7f98b0198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98aed9d700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b01001c0 0x7f98b0197b00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f98a000d9b0 tx=0x7f98a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f9897fff700 1 -- 172.21.15.70:0/1383291230 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a0004020 con 0x7f98b01001c0 2023-10-08T08:43:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b01a34e0 con 0x7f98b01001c0 2023-10-08T08:43:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f9897fff700 1 -- 172.21.15.70:0/1383291230 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98a0009730 con 0x7f98b01001c0 2023-10-08T08:43:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f9897fff700 1 -- 172.21.15.70:0/1383291230 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a0003a40 con 0x7f98b01001c0 2023-10-08T08:43:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.745+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b01a39f0 con 0x7f98b01001c0 2023-10-08T08:43:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.746+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b0107c40 con 0x7f98b01001c0 2023-10-08T08:43:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.747+0000 7f9897fff700 1 -- 172.21.15.70:0/1383291230 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f98a00098a0 con 0x7f98b01001c0 2023-10-08T08:43:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.748+0000 7f9897fff700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f98980a14d0 0x7f98980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.748+0000 7f9897fff700 1 -- 172.21.15.70:0/1383291230 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f98a00cd130 con 0x7f98b01001c0 2023-10-08T08:43:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.748+0000 7f98ae59c700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f98980a14d0 0x7f98980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.748+0000 7f98ae59c700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f98980a14d0 0x7f98980a3990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f98a4005fd0 tx=0x7f98a4005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.751+0000 7f9897fff700 1 -- 172.21.15.70:0/1383291230 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f98a00963a0 con 0x7f98b01001c0 2023-10-08T08:43:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:46 smithi105 ceph-mon[103798]: pgmap v289: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:43:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:46 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/136148709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:46 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/979324921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:46 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1816095386' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:46.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:46 smithi191 ceph-mon[104220]: pgmap v289: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:43:46.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:46 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/136148709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:46.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:46 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/979324921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:46.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:46 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1816095386' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:46.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.942+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98b00ff650 con 0x7f98b01001c0 2023-10-08T08:43:46.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.942+0000 7f9897fff700 1 -- 172.21.15.70:0/1383291230 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98a00999c0 con 0x7f98b01001c0 2023-10-08T08:43:46.945 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:43:46.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.944+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f98980a14d0 msgr2=0x7f98980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.944+0000 7f98b5114700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f98980a14d0 0x7f98980a3990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f98a4005fd0 tx=0x7f98a4005ee0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.944+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b01001c0 msgr2=0x7f98b0197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:46.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.944+0000 7f98b5114700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b01001c0 0x7f98b0197b00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f98a000d9b0 tx=0x7f98a000dcc0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.944+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 shutdown_connections 2023-10-08T08:43:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.944+0000 7f98b5114700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f98980a14d0 0x7f98980a3990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.944+0000 7f98b5114700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98b01046a0 0x7f98b01a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.944+0000 7f98b5114700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98b01001c0 0x7f98b0197b00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.944+0000 7f98b5114700 1 --2- 172.21.15.70:0/1383291230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b0100b80 0x7f98b0198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.945+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 >> 172.21.15.70:0/1383291230 conn(0x7f98b0074940 msgr2=0x7f98b00fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.945+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 shutdown_connections 2023-10-08T08:43:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:46.945+0000 7f98b5114700 1 -- 172.21.15.70:0/1383291230 wait complete. 2023-10-08T08:43:46.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:43:47.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.082+0000 7f55b3577700 1 -- 172.21.15.70:0/1896910529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac106730 msgr2=0x7f55ac106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.082+0000 7f55b3577700 1 --2- 172.21.15.70:0/1896910529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac106730 0x7f55ac106b10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009990 tx=0x7f55a0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.082+0000 7f55b3577700 1 -- 172.21.15.70:0/1896910529 shutdown_connections 2023-10-08T08:43:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.082+0000 7f55b3577700 1 --2- 172.21.15.70:0/1896910529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac1010e0 0x7f55ac10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.082+0000 7f55b3577700 1 --2- 172.21.15.70:0/1896910529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac106730 0x7f55ac106b10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.082+0000 7f55b3577700 1 --2- 172.21.15.70:0/1896910529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55ac100720 0x7f55ac100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.082+0000 7f55b3577700 1 -- 172.21.15.70:0/1896910529 >> 172.21.15.70:0/1896910529 conn(0x7f55ac0fc230 msgr2=0x7f55ac0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.082+0000 7f55b3577700 1 -- 172.21.15.70:0/1896910529 shutdown_connections 2023-10-08T08:43:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.082+0000 7f55b3577700 1 -- 172.21.15.70:0/1896910529 wait complete. 2023-10-08T08:43:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.083+0000 7f55b3577700 1 Processor -- start 2023-10-08T08:43:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.083+0000 7f55b3577700 1 -- start start 2023-10-08T08:43:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b3577700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55ac100720 0x7f55ac19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b3577700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac1010e0 0x7f55ac19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b3577700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac106730 0x7f55ac196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b3577700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac197060 con 0x7f55ac1010e0 2023-10-08T08:43:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b3577700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac1971d0 con 0x7f55ac100720 2023-10-08T08:43:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b3577700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac197390 con 0x7f55ac106730 2023-10-08T08:43:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b0b12700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac1010e0 0x7f55ac19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b0b12700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac1010e0 0x7f55ac19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50986/0 (socket says 172.21.15.70:50986) 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b0b12700 1 -- 172.21.15.70:0/3058050751 learned_addr learned my addr 172.21.15.70:0/3058050751 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b1b14700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac106730 0x7f55ac196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b1313700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55ac100720 0x7f55ac19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b0b12700 1 -- 172.21.15.70:0/3058050751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac106730 msgr2=0x7f55ac196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b0b12700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac106730 0x7f55ac196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b0b12700 1 -- 172.21.15.70:0/3058050751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55ac100720 msgr2=0x7f55ac19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b0b12700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55ac100720 0x7f55ac19c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b0b12700 1 -- 172.21.15.70:0/3058050751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a00095f0 con 0x7f55ac1010e0 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b1b14700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac106730 0x7f55ac196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b0b12700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac1010e0 0x7f55ac19ce10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f55a800b530 tx=0x7f55a800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f559e7fc700 1 -- 172.21.15.70:0/3058050751 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8011830 con 0x7f55ac1010e0 2023-10-08T08:43:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f559e7fc700 1 -- 172.21.15.70:0/3058050751 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55a8011e50 con 0x7f55ac1010e0 2023-10-08T08:43:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac197670 con 0x7f55ac1010e0 2023-10-08T08:43:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f559e7fc700 1 -- 172.21.15.70:0/3058050751 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a800f2e0 con 0x7f55ac1010e0 2023-10-08T08:43:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.084+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac1a38c0 con 0x7f55ac1010e0 2023-10-08T08:43:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.085+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac108d20 con 0x7f55ac1010e0 2023-10-08T08:43:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.086+0000 7f559e7fc700 1 -- 172.21.15.70:0/3058050751 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f55a8010580 con 0x7f55ac1010e0 2023-10-08T08:43:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.087+0000 7f559e7fc700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f55980a14d0 0x7f55980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.087+0000 7f55b1313700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f55980a14d0 0x7f55980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.087+0000 7f559e7fc700 1 -- 172.21.15.70:0/3058050751 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f55a80cd1f0 con 0x7f55ac1010e0 2023-10-08T08:43:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.088+0000 7f55b1313700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f55980a14d0 0x7f55980a3990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55a0003730 tx=0x7f55a00036c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.091+0000 7f559e7fc700 1 -- 172.21.15.70:0/3058050751 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f55a8096460 con 0x7f55ac1010e0 2023-10-08T08:43:47.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.286+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55ac197ec0 con 0x7f55ac1010e0 2023-10-08T08:43:47.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.287+0000 7f559e7fc700 1 -- 172.21.15.70:0/3058050751 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55a8015020 con 0x7f55ac1010e0 2023-10-08T08:43:47.288 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:47.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f55980a14d0 msgr2=0x7f55980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f55980a14d0 0x7f55980a3990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55a0003730 tx=0x7f55a00036c0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac1010e0 msgr2=0x7f55ac19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac1010e0 0x7f55ac19ce10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f55a800b530 tx=0x7f55a800b8f0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 shutdown_connections 2023-10-08T08:43:47.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f55980a14d0 0x7f55980a3990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac106730 0x7f55ac196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55ac100720 0x7f55ac19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 --2- 172.21.15.70:0/3058050751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55ac1010e0 0x7f55ac19ce10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 >> 172.21.15.70:0/3058050751 conn(0x7f55ac0fc230 msgr2=0x7f55ac0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:47.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 shutdown_connections 2023-10-08T08:43:47.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.289+0000 7f55b3577700 1 -- 172.21.15.70:0/3058050751 wait complete. 2023-10-08T08:43:47.302 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:43:47.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.425+0000 7fb9540c2700 1 -- 172.21.15.70:0/3517253459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 msgr2=0x7fb94c100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.425+0000 7fb9540c2700 1 --2- 172.21.15.70:0/3517253459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 0x7fb94c100bc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb948009990 tx=0x7fb948009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.425+0000 7fb9540c2700 1 -- 172.21.15.70:0/3517253459 shutdown_connections 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.425+0000 7fb9540c2700 1 --2- 172.21.15.70:0/3517253459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb94c101100 0x7fb94c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.425+0000 7fb9540c2700 1 --2- 172.21.15.70:0/3517253459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb94c106750 0x7fb94c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.425+0000 7fb9540c2700 1 --2- 172.21.15.70:0/3517253459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 0x7fb94c100bc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.425+0000 7fb9540c2700 1 -- 172.21.15.70:0/3517253459 >> 172.21.15.70:0/3517253459 conn(0x7fb94c0fc230 msgr2=0x7fb94c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.425+0000 7fb9540c2700 1 -- 172.21.15.70:0/3517253459 shutdown_connections 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.425+0000 7fb9540c2700 1 -- 172.21.15.70:0/3517253459 wait complete. 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb9540c2700 1 Processor -- start 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb9540c2700 1 -- start start 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb9540c2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 0x7fb94c19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb9540c2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb94c101100 0x7fb94c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb9540c2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb94c106750 0x7fb94c1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb9540c2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c197040 con 0x7fb94c100740 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb9540c2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c1971b0 con 0x7fb94c101100 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb9540c2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c197370 con 0x7fb94c106750 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb951e5e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 0x7fb94c19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb951e5e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 0x7fb94c19c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50998/0 (socket says 172.21.15.70:50998) 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb951e5e700 1 -- 172.21.15.70:0/1211807687 learned_addr learned my addr 172.21.15.70:0/1211807687 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb95165d700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb94c101100 0x7fb94c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.426+0000 7fb95265f700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb94c106750 0x7fb94c1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb951e5e700 1 -- 172.21.15.70:0/1211807687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb94c106750 msgr2=0x7fb94c1969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb951e5e700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb94c106750 0x7fb94c1969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb951e5e700 1 -- 172.21.15.70:0/1211807687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb94c101100 msgr2=0x7fb94c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb951e5e700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb94c101100 0x7fb94c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb951e5e700 1 -- 172.21.15.70:0/1211807687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480095f0 con 0x7fb94c100740 2023-10-08T08:43:47.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb951e5e700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 0x7fb94c19c8b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d950 tx=0x7fb93c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:47.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb942ffd700 1 -- 172.21.15.70:0/1211807687 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c009b40 con 0x7fb94c100740 2023-10-08T08:43:47.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c197650 con 0x7fb94c100740 2023-10-08T08:43:47.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb942ffd700 1 -- 172.21.15.70:0/1211807687 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb93c009ca0 con 0x7fb94c100740 2023-10-08T08:43:47.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb942ffd700 1 -- 172.21.15.70:0/1211807687 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c00f620 con 0x7fb94c100740 2023-10-08T08:43:47.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.427+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c1a38a0 con 0x7fb94c100740 2023-10-08T08:43:47.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.428+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c108cd0 con 0x7fb94c100740 2023-10-08T08:43:47.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.429+0000 7fb942ffd700 1 -- 172.21.15.70:0/1211807687 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb93c010460 con 0x7fb94c100740 2023-10-08T08:43:47.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.430+0000 7fb942ffd700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb9380a14d0 0x7fb9380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.430+0000 7fb95165d700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb9380a14d0 0x7fb9380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.430+0000 7fb942ffd700 1 -- 172.21.15.70:0/1211807687 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fb93c0cd4e0 con 0x7fb94c100740 2023-10-08T08:43:47.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.430+0000 7fb95165d700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb9380a14d0 0x7fb9380a3990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb948006010 tx=0x7fb94800b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:47.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.433+0000 7fb942ffd700 1 -- 172.21.15.70:0/1211807687 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb93c0966f0 con 0x7fb94c100740 2023-10-08T08:43:47.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.626+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb94c197840 con 0x7fb94c100740 2023-10-08T08:43:47.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.626+0000 7fb942ffd700 1 -- 172.21.15.70:0/1211807687 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb93c016020 con 0x7fb94c100740 2023-10-08T08:43:47.627 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:43:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.628+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb9380a14d0 msgr2=0x7fb9380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.628+0000 7fb9540c2700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb9380a14d0 0x7fb9380a3990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb948006010 tx=0x7fb94800b260 comp rx=0 tx=0).stop 2023-10-08T08:43:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.628+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 msgr2=0x7fb94c19c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.628+0000 7fb9540c2700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 0x7fb94c19c8b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d950 tx=0x7fb93c00dd10 comp rx=0 tx=0).stop 2023-10-08T08:43:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.629+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 shutdown_connections 2023-10-08T08:43:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.629+0000 7fb9540c2700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb9380a14d0 0x7fb9380a3990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.629+0000 7fb9540c2700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb94c106750 0x7fb94c1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.629+0000 7fb9540c2700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb94c100740 0x7fb94c19c8b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.629+0000 7fb9540c2700 1 --2- 172.21.15.70:0/1211807687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb94c101100 0x7fb94c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.629+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 >> 172.21.15.70:0/1211807687 conn(0x7fb94c0fc230 msgr2=0x7fb94c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.629+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 shutdown_connections 2023-10-08T08:43:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.629+0000 7fb9540c2700 1 -- 172.21.15.70:0/1211807687 wait complete. 2023-10-08T08:43:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:47 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3232085793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:47.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:47 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1383291230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:47.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:47 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3058050751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:47.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:43:47.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.765+0000 7fb316c85700 1 -- 172.21.15.70:0/4282595337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3100696d0 msgr2=0x7fb31010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.765+0000 7fb316c85700 1 --2- 172.21.15.70:0/4282595337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3100696d0 0x7fb31010d5c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb30800b0a0 tx=0x7fb30800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.765+0000 7fb316c85700 1 -- 172.21.15.70:0/4282595337 shutdown_connections 2023-10-08T08:43:47.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.765+0000 7fb316c85700 1 --2- 172.21.15.70:0/4282595337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3100696d0 0x7fb31010d5c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.765+0000 7fb316c85700 1 --2- 172.21.15.70:0/4282595337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb310106770 0x7fb310106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.765+0000 7fb316c85700 1 --2- 172.21.15.70:0/4282595337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb310068d10 0x7fb310069190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.765+0000 7fb316c85700 1 -- 172.21.15.70:0/4282595337 >> 172.21.15.70:0/4282595337 conn(0x7fb310076790 msgr2=0x7fb310076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.765+0000 7fb316c85700 1 -- 172.21.15.70:0/4282595337 shutdown_connections 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.765+0000 7fb316c85700 1 -- 172.21.15.70:0/4282595337 wait complete. 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb316c85700 1 Processor -- start 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb316c85700 1 -- start start 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb316c85700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb310068d10 0x7fb310196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb316c85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3100696d0 0x7fb310197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb316c85700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb310106770 0x7fb31019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb316c85700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31019ab40 con 0x7fb310106770 2023-10-08T08:43:47.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb316c85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31019acb0 con 0x7fb3100696d0 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb316c85700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31019ae70 con 0x7fb310068d10 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb315222700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb310106770 0x7fb31019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb315222700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb310106770 0x7fb31019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51016/0 (socket says 172.21.15.70:51016) 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb315222700 1 -- 172.21.15.70:0/237838273 learned_addr learned my addr 172.21.15.70:0/237838273 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb30ffff700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3100696d0 0x7fb310197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb314a21700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb310068d10 0x7fb310196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb315222700 1 -- 172.21.15.70:0/237838273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb310068d10 msgr2=0x7fb310196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb315222700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb310068d10 0x7fb310196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb315222700 1 -- 172.21.15.70:0/237838273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3100696d0 msgr2=0x7fb310197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb315222700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3100696d0 0x7fb310197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb315222700 1 -- 172.21.15.70:0/237838273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308009d00 con 0x7fb310106770 2023-10-08T08:43:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb30ffff700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3100696d0 0x7fb310197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.766+0000 7fb315222700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb310106770 0x7fb31019a540 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb30800b070 tx=0x7fb308007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.767+0000 7fb30dffb700 1 -- 172.21.15.70:0/237838273 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30800e040 con 0x7fb310106770 2023-10-08T08:43:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.767+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31019b0f0 con 0x7fb310106770 2023-10-08T08:43:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.767+0000 7fb30dffb700 1 -- 172.21.15.70:0/237838273 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb308009440 con 0x7fb310106770 2023-10-08T08:43:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.767+0000 7fb30dffb700 1 -- 172.21.15.70:0/237838273 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30801b6b0 con 0x7fb310106770 2023-10-08T08:43:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.767+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3101a3ab0 con 0x7fb310106770 2023-10-08T08:43:47.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:47 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3232085793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:47.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:47 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1383291230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:47.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:47 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3058050751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.768+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb310108ca0 con 0x7fb310106770 2023-10-08T08:43:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.769+0000 7fb30dffb700 1 -- 172.21.15.70:0/237838273 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fb30801d480 con 0x7fb310106770 2023-10-08T08:43:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.769+0000 7fb30dffb700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb3000a1550 0x7fb3000a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.769+0000 7fb30dffb700 1 -- 172.21.15.70:0/237838273 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fb3080cee00 con 0x7fb310106770 2023-10-08T08:43:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.770+0000 7fb314a21700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb3000a1550 0x7fb3000a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.770+0000 7fb314a21700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb3000a1550 0x7fb3000a3a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb304005fd0 tx=0x7fb304005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:47.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.773+0000 7fb30dffb700 1 -- 172.21.15.70:0/237838273 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb3080980a0 con 0x7fb310106770 2023-10-08T08:43:47.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:47 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3232085793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:47.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:47 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1383291230' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:47.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:47 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3058050751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:47.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.965+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb310067980 con 0x7fb310106770 2023-10-08T08:43:47.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.965+0000 7fb30dffb700 1 -- 172.21.15.70:0/237838273 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb30801de60 con 0x7fb310106770 2023-10-08T08:43:47.967 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:47.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.967+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb3000a1550 msgr2=0x7fb3000a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.967+0000 7fb316c85700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb3000a1550 0x7fb3000a3a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb304005fd0 tx=0x7fb304005db0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.967+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb310106770 msgr2=0x7fb31019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.967+0000 7fb316c85700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb310106770 0x7fb31019a540 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb30800b070 tx=0x7fb308007920 comp rx=0 tx=0).stop 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.968+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 shutdown_connections 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.968+0000 7fb316c85700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fb3000a1550 0x7fb3000a3a10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.968+0000 7fb316c85700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb310106770 0x7fb31019a540 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.968+0000 7fb316c85700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb310068d10 0x7fb310196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.968+0000 7fb316c85700 1 --2- 172.21.15.70:0/237838273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3100696d0 0x7fb310197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.968+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 >> 172.21.15.70:0/237838273 conn(0x7fb310076790 msgr2=0x7fb3100fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:47.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.968+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 shutdown_connections 2023-10-08T08:43:47.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:47.968+0000 7fb316c85700 1 -- 172.21.15.70:0/237838273 wait complete. 2023-10-08T08:43:47.981 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-08T08:43:47.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:43:48.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.101+0000 7f5365dc8700 1 -- 172.21.15.70:0/4080840624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53600ffc60 msgr2=0x7f53601000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.101+0000 7f5365dc8700 1 --2- 172.21.15.70:0/4080840624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53600ffc60 0x7f53601000e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5350009990 tx=0x7f5350009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.101+0000 7f5365dc8700 1 -- 172.21.15.70:0/4080840624 shutdown_connections 2023-10-08T08:43:48.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.101+0000 7f5365dc8700 1 --2- 172.21.15.70:0/4080840624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5360100620 0x7f536010c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.101+0000 7f5365dc8700 1 --2- 172.21.15.70:0/4080840624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53601057e0 0x7f5360105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.101+0000 7f5365dc8700 1 --2- 172.21.15.70:0/4080840624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53600ffc60 0x7f53601000e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.101+0000 7f5365dc8700 1 -- 172.21.15.70:0/4080840624 >> 172.21.15.70:0/4080840624 conn(0x7f5360075a90 msgr2=0x7f53600fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:48.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.101+0000 7f5365dc8700 1 -- 172.21.15.70:0/4080840624 shutdown_connections 2023-10-08T08:43:48.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.101+0000 7f5365dc8700 1 -- 172.21.15.70:0/4080840624 wait complete. 2023-10-08T08:43:48.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.102+0000 7f5365dc8700 1 Processor -- start 2023-10-08T08:43:48.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.102+0000 7f5365dc8700 1 -- start start 2023-10-08T08:43:48.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.102+0000 7f5365dc8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53600ffc60 0x7f5360197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.102+0000 7f5365dc8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5360100620 0x7f5360197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.102+0000 7f5365dc8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53601057e0 0x7f53601a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.102+0000 7f5365dc8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360198820 con 0x7f5360100620 2023-10-08T08:43:48.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.102+0000 7f5365dc8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53601a2fe0 con 0x7f53601057e0 2023-10-08T08:43:48.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.102+0000 7f5365dc8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53601a3120 con 0x7f53600ffc60 2023-10-08T08:43:48.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5360100620 0x7f5360197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5360100620 0x7f5360197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51028/0 (socket says 172.21.15.70:51028) 2023-10-08T08:43:48.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535effd700 1 -- 172.21.15.70:0/1077347797 learned_addr learned my addr 172.21.15.70:0/1077347797 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:48.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535f7fe700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53600ffc60 0x7f5360197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535effd700 1 -- 172.21.15.70:0/1077347797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53600ffc60 msgr2=0x7f5360197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535effd700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53600ffc60 0x7f5360197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535effd700 1 -- 172.21.15.70:0/1077347797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53601057e0 msgr2=0x7f53601a2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535ffff700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53601057e0 0x7f53601a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535effd700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53601057e0 0x7f53601a2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535effd700 1 -- 172.21.15.70:0/1077347797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500095f0 con 0x7f5360100620 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535effd700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5360100620 0x7f5360197f60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f53500098e0 tx=0x7f535000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535cff9700 1 -- 172.21.15.70:0/1077347797 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535001d070 con 0x7f5360100620 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53601a33a0 con 0x7f5360100620 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535cff9700 1 -- 172.21.15.70:0/1077347797 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5350022470 con 0x7f5360100620 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f535cff9700 1 -- 172.21.15.70:0/1077347797 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350017650 con 0x7f5360100620 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.103+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53601a38d0 con 0x7f5360100620 2023-10-08T08:43:48.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.104+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5360107cd0 con 0x7f5360100620 2023-10-08T08:43:48.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.105+0000 7f535cff9700 1 -- 172.21.15.70:0/1077347797 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f53500225e0 con 0x7f5360100620 2023-10-08T08:43:48.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.106+0000 7f535cff9700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53480a14d0 0x7f53480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.106+0000 7f535f7fe700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53480a14d0 0x7f53480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.106+0000 7f535cff9700 1 -- 172.21.15.70:0/1077347797 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f53500ce1e0 con 0x7f5360100620 2023-10-08T08:43:48.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.106+0000 7f535f7fe700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53480a14d0 0x7f53480a3990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5360067220 tx=0x7f535400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:48.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.110+0000 7f535cff9700 1 -- 172.21.15.70:0/1077347797 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5350097480 con 0x7f5360100620 2023-10-08T08:43:48.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.345+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5360100f10 con 0x7f5360100620 2023-10-08T08:43:48.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.346+0000 7f535cff9700 1 -- 172.21.15.70:0/1077347797 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11375 (secure 0 0 0) 0x7f535009aaa0 con 0x7f5360100620 2023-10-08T08:43:48.347 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:48.347 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:29.077123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24572":{"gid":24572,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:43:48.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53480a14d0 msgr2=0x7f53480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53480a14d0 0x7f53480a3990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5360067220 tx=0x7f535400b410 comp rx=0 tx=0).stop 2023-10-08T08:43:48.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5360100620 msgr2=0x7f5360197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5360100620 0x7f5360197f60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f53500098e0 tx=0x7f535000f670 comp rx=0 tx=0).stop 2023-10-08T08:43:48.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 shutdown_connections 2023-10-08T08:43:48.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f53480a14d0 0x7f53480a3990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53601057e0 0x7f53601a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53600ffc60 0x7f5360197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 --2- 172.21.15.70:0/1077347797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5360100620 0x7f5360197f60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 >> 172.21.15.70:0/1077347797 conn(0x7f5360075a90 msgr2=0x7f53600fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:48.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 shutdown_connections 2023-10-08T08:43:48.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.348+0000 7f5365dc8700 1 -- 172.21.15.70:0/1077347797 wait complete. 2023-10-08T08:43:48.351 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:43:48.361 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-08T08:43:48.362 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-08T08:43:48.362 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T08:43:48.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 -- 172.21.15.70:0/2732370200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb00105620 msgr2=0x7fcb00105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2732370200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb00105620 0x7fcb00105a00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40099c0 tx=0x7fcaf4009cd0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 -- 172.21.15.70:0/2732370200 shutdown_connections 2023-10-08T08:43:48.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2732370200 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb000fff20 0x7fcb0010c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2732370200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb00105620 0x7fcb00105a00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2732370200 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb000ff560 0x7fcb000ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 -- 172.21.15.70:0/2732370200 >> 172.21.15.70:0/2732370200 conn(0x7fcb000fb050 msgr2=0x7fcb000fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 -- 172.21.15.70:0/2732370200 shutdown_connections 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 -- 172.21.15.70:0/2732370200 wait complete. 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 Processor -- start 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.483+0000 7fcb055b0700 1 -- start start 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcb055b0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb000ff560 0x7fcb00195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcb055b0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb000fff20 0x7fcb00195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcb055b0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb00105620 0x7fcb00196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcb055b0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb001a4ea0 con 0x7fcb000fff20 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcb055b0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb001a5010 con 0x7fcb00105620 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcb055b0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb001a51d0 con 0x7fcb000ff560 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafe7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb000fff20 0x7fcb00195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafe7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb000fff20 0x7fcb00195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51042/0 (socket says 172.21.15.70:51042) 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafe7fc700 1 -- 172.21.15.70:0/2535956334 learned_addr learned my addr 172.21.15.70:0/2535956334 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafeffd700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb000ff560 0x7fcb00195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcaff7fe700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb00105620 0x7fcb00196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafe7fc700 1 -- 172.21.15.70:0/2535956334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb000ff560 msgr2=0x7fcb00195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafe7fc700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb000ff560 0x7fcb00195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafe7fc700 1 -- 172.21.15.70:0/2535956334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb00105620 msgr2=0x7fcb00196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafe7fc700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb00105620 0x7fcb00196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafe7fc700 1 -- 172.21.15.70:0/2535956334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40095f0 con 0x7fcb000fff20 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcafe7fc700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb000fff20 0x7fcb00195c40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000d980 tx=0x7fcaf000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcae7fff700 1 -- 172.21.15.70:0/2535956334 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0004a30 con 0x7fcb000fff20 2023-10-08T08:43:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcae7fff700 1 -- 172.21.15.70:0/2535956334 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaf00054e0 con 0x7fcb000fff20 2023-10-08T08:43:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb001a54b0 con 0x7fcb000fff20 2023-10-08T08:43:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcae7fff700 1 -- 172.21.15.70:0/2535956334 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000fbc0 con 0x7fcb000fff20 2023-10-08T08:43:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.484+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb001a5970 con 0x7fcb000fff20 2023-10-08T08:43:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.485+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb00107aa0 con 0x7fcb000fff20 2023-10-08T08:43:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.486+0000 7fcae7fff700 1 -- 172.21.15.70:0/2535956334 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fcaf0004c20 con 0x7fcb000fff20 2023-10-08T08:43:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.487+0000 7fcae7fff700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcae80a14d0 0x7fcae80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.487+0000 7fcae7fff700 1 -- 172.21.15.70:0/2535956334 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcaf00ccf40 con 0x7fcb000fff20 2023-10-08T08:43:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.487+0000 7fcafeffd700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcae80a14d0 0x7fcae80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.487+0000 7fcafeffd700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcae80a14d0 0x7fcae80a3990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009990 tx=0x7fcaf4003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:48.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.491+0000 7fcae7fff700 1 -- 172.21.15.70:0/2535956334 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcaf00961b0 con 0x7fcb000fff20 2023-10-08T08:43:48.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:48 smithi105 ceph-mon[103798]: pgmap v290: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-08T08:43:48.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:48 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1211807687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:48.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:48 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/237838273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:48.798 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:48 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1077347797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:48.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.680+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb000691f0 con 0x7fcae80a14d0 2023-10-08T08:43:48.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.693+0000 7fcae7fff700 1 -- 172.21.15.70:0/2535956334 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427586 (secure 0 0 0) 0x7fcb000691f0 con 0x7fcae80a14d0 2023-10-08T08:43:48.807 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:48.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:48 smithi070 ceph-mon[99513]: pgmap v290: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-08T08:43:48.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:48 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1211807687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:48.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:48 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/237838273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:48.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:48 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1077347797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:48.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcae80a14d0 msgr2=0x7fcae80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcae80a14d0 0x7fcae80a3990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009990 tx=0x7fcaf4003680 comp rx=0 tx=0).stop 2023-10-08T08:43:48.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb000fff20 msgr2=0x7fcb00195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb000fff20 0x7fcb00195c40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000d980 tx=0x7fcaf000dc90 comp rx=0 tx=0).stop 2023-10-08T08:43:48.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 shutdown_connections 2023-10-08T08:43:48.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcae80a14d0 0x7fcae80a3990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb00105620 0x7fcb00196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb000ff560 0x7fcb00195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 --2- 172.21.15.70:0/2535956334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb000fff20 0x7fcb00195c40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 >> 172.21.15.70:0/2535956334 conn(0x7fcb000fb050 msgr2=0x7fcb000fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:48.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 shutdown_connections 2023-10-08T08:43:48.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.696+0000 7fcb055b0700 1 -- 172.21.15.70:0/2535956334 wait complete. 2023-10-08T08:43:48.815 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-10-08T08:43:48.816 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2023-10-08T08:43:47.075802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600892,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":920,"num_read_kb":529,"num_write":392,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337964,"kb_used_data":13688,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603860,"statfs":{"total":1151940427776,"available":1151594352640,"internally_reserved":0,"allocated":14016512,"data_stored":7713489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":260,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002957"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275511+0000","last_change":"2023-10-08T08:42:01.146976+0000","last_active":"2023-10-08T08:42:39.275511+0000","last_peered":"2023-10-08T08:42:39.275511+0000","last_clean":"2023-10-08T08:42:39.275511+0000","last_became_active":"2023-10-08T08:42:01.146184+0000","last_became_peered":"2023-10-08T08:42:01.146184+0000","last_unstale":"2023-10-08T08:42:39.275511+0000","last_undegraded":"2023-10-08T08:42:39.275511+0000","last_fullsized":"2023-10-08T08:42:39.275511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:35.571911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273896+0000","last_change":"2023-10-08T08:42:01.142007+0000","last_active":"2023-10-08T08:42:39.273896+0000","last_peered":"2023-10-08T08:42:39.273896+0000","last_clean":"2023-10-08T08:42:39.273896+0000","last_became_active":"2023-10-08T08:42:01.141630+0000","last_became_peered":"2023-10-08T08:42:01.141630+0000","last_unstale":"2023-10-08T08:42:39.273896+0000","last_undegraded":"2023-10-08T08:42:39.273896+0000","last_fullsized":"2023-10-08T08:42:39.273896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:53.307828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272914+0000","last_change":"2023-10-08T08:42:01.154742+0000","last_active":"2023-10-08T08:42:39.272914+0000","last_peered":"2023-10-08T08:42:39.272914+0000","last_clean":"2023-10-08T08:42:39.272914+0000","last_became_active":"2023-10-08T08:42:01.154439+0000","last_became_peered":"2023-10-08T08:42:01.154439+0000","last_unstale":"2023-10-08T08:42:39.272914+0000","last_undegraded":"2023-10-08T08:42:39.272914+0000","last_fullsized":"2023-10-08T08:42:39.272914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:23.990594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270927+0000","last_change":"2023-10-08T08:42:01.149940+0000","last_active":"2023-10-08T08:42:39.270927+0000","last_peered":"2023-10-08T08:42:39.270927+0000","last_clean":"2023-10-08T08:42:39.270927+0000","last_became_active":"2023-10-08T08:42:01.149628+0000","last_became_peered":"2023-10-08T08:42:01.149628+0000","last_unstale":"2023-10-08T08:42:39.270927+0000","last_undegraded":"2023-10-08T08:42:39.270927+0000","last_fullsized":"2023-10-08T08:42:39.270927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:38.961102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272780+0000","last_change":"2023-10-08T08:42:01.145396+0000","last_active":"2023-10-08T08:42:39.272780+0000","last_peered":"2023-10-08T08:42:39.272780+0000","last_clean":"2023-10-08T08:42:39.272780+0000","last_became_active":"2023-10-08T08:42:01.140511+0000","last_became_peered":"2023-10-08T08:42:01.140511+0000","last_unstale":"2023-10-08T08:42:39.272780+0000","last_undegraded":"2023-10-08T08:42:39.272780+0000","last_fullsized":"2023-10-08T08:42:39.272780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:38.079768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273059+0000","last_change":"2023-10-08T08:42:01.128798+0000","last_active":"2023-10-08T08:42:39.273059+0000","last_peered":"2023-10-08T08:42:39.273059+0000","last_clean":"2023-10-08T08:42:39.273059+0000","last_became_active":"2023-10-08T08:42:01.128485+0000","last_became_peered":"2023-10-08T08:42:01.128485+0000","last_unstale":"2023-10-08T08:42:39.273059+0000","last_undegraded":"2023-10-08T08:42:39.273059+0000","last_fullsized":"2023-10-08T08:42:39.273059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:33:59.121551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277231+0000","last_change":"2023-10-08T08:42:01.136315+0000","last_active":"2023-10-08T08:42:39.277231+0000","last_peered":"2023-10-08T08:42:39.277231+0000","last_clean":"2023-10-08T08:42:39.277231+0000","last_became_active":"2023-10-08T08:42:01.136025+0000","last_became_peered":"2023-10-08T08:42:01.136025+0000","last_unstale":"2023-10-08T08:42:39.277231+0000","last_undegraded":"2023-10-08T08:42:39.277231+0000","last_fullsized":"2023-10-08T08:42:39.277231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:35.675920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269573+0000","last_change":"2023-10-08T08:42:01.129839+0000","last_active":"2023-10-08T08:42:39.269573+0000","last_peered":"2023-10-08T08:42:39.269573+0000","last_clean":"2023-10-08T08:42:39.269573+0000","last_became_active":"2023-10-08T08:42:01.129524+0000","last_became_peered":"2023-10-08T08:42:01.129524+0000","last_unstale":"2023-10-08T08:42:39.269573+0000","last_undegraded":"2023-10-08T08:42:39.269573+0000","last_fullsized":"2023-10-08T08:42:39.269573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:44.463024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276906+0000","last_change":"2023-10-08T08:42:01.135304+0000","last_active":"2023-10-08T08:42:39.276906+0000","last_peered":"2023-10-08T08:42:39.276906+0000","last_clean":"2023-10-08T08:42:39.276906+0000","last_became_active":"2023-10-08T08:42:01.134978+0000","last_became_peered":"2023-10-08T08:42:01.134978+0000","last_unstale":"2023-10-08T08:42:39.276906+0000","last_undegraded":"2023-10-08T08:42:39.276906+0000","last_fullsized":"2023-10-08T08:42:39.276906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:46:03.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273758+0000","last_change":"2023-10-08T08:42:01.134686+0000","last_active":"2023-10-08T08:42:39.273758+0000","last_peered":"2023-10-08T08:42:39.273758+0000","last_clean":"2023-10-08T08:42:39.273758+0000","last_became_active":"2023-10-08T08:42:01.134360+0000","last_became_peered":"2023-10-08T08:42:01.134360+0000","last_unstale":"2023-10-08T08:42:39.273758+0000","last_undegraded":"2023-10-08T08:42:39.273758+0000","last_fullsized":"2023-10-08T08:42:39.273758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:56.814182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278374+0000","last_change":"2023-10-08T08:42:01.148309+0000","last_active":"2023-10-08T08:42:39.278374+0000","last_peered":"2023-10-08T08:42:39.278374+0000","last_clean":"2023-10-08T08:42:39.278374+0000","last_became_active":"2023-10-08T08:42:01.147964+0000","last_became_peered":"2023-10-08T08:42:01.147964+0000","last_unstale":"2023-10-08T08:42:39.278374+0000","last_undegraded":"2023-10-08T08:42:39.278374+0000","last_fullsized":"2023-10-08T08:42:39.278374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:45.418572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270831+0000","last_change":"2023-10-08T08:42:01.148141+0000","last_active":"2023-10-08T08:42:39.270831+0000","last_peered":"2023-10-08T08:42:39.270831+0000","last_clean":"2023-10-08T08:42:39.270831+0000","last_became_active":"2023-10-08T08:42:01.147788+0000","last_became_peered":"2023-10-08T08:42:01.147788+0000","last_unstale":"2023-10-08T08:42:39.270831+0000","last_undegraded":"2023-10-08T08:42:39.270831+0000","last_fullsized":"2023-10-08T08:42:39.270831+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:37.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696516+0000","last_change":"2023-10-08T08:42:40.696516+0000","last_active":"2023-10-08T08:42:40.696516+0000","last_peered":"2023-10-08T08:42:40.696516+0000","last_clean":"2023-10-08T08:42:40.696516+0000","last_became_active":"2023-10-08T08:42:40.696193+0000","last_became_peered":"2023-10-08T08:42:40.696193+0000","last_unstale":"2023-10-08T08:42:40.696516+0000","last_undegraded":"2023-10-08T08:42:40.696516+0000","last_fullsized":"2023-10-08T08:42:40.696516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:40:57.843021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:01.148031+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:01.147785+0000","last_became_peered":"2023-10-08T08:42:01.147785+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:43.702638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272901+0000","last_change":"2023-10-08T08:42:01.154669+0000","last_active":"2023-10-08T08:42:39.272901+0000","last_peered":"2023-10-08T08:42:39.272901+0000","last_clean":"2023-10-08T08:42:39.272901+0000","last_became_active":"2023-10-08T08:42:01.154385+0000","last_became_peered":"2023-10-08T08:42:01.154385+0000","last_unstale":"2023-10-08T08:42:39.272901+0000","last_undegraded":"2023-10-08T08:42:39.272901+0000","last_fullsized":"2023-10-08T08:42:39.272901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:41.654979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275659+0000","last_change":"2023-10-08T08:42:01.143017+0000","last_active":"2023-10-08T08:42:39.275659+0000","last_peered":"2023-10-08T08:42:39.275659+0000","last_clean":"2023-10-08T08:42:39.275659+0000","last_became_active":"2023-10-08T08:42:01.142728+0000","last_became_peered":"2023-10-08T08:42:01.142728+0000","last_unstale":"2023-10-08T08:42:39.275659+0000","last_undegraded":"2023-10-08T08:42:39.275659+0000","last_fullsized":"2023-10-08T08:42:39.275659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.303212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275414+0000","last_change":"2023-10-08T08:42:01.147335+0000","last_active":"2023-10-08T08:42:39.275414+0000","last_peered":"2023-10-08T08:42:39.275414+0000","last_clean":"2023-10-08T08:42:39.275414+0000","last_became_active":"2023-10-08T08:42:01.146641+0000","last_became_peered":"2023-10-08T08:42:01.146641+0000","last_unstale":"2023-10-08T08:42:39.275414+0000","last_undegraded":"2023-10-08T08:42:39.275414+0000","last_fullsized":"2023-10-08T08:42:39.275414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:27.274207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275754+0000","last_change":"2023-10-08T08:42:01.132417+0000","last_active":"2023-10-08T08:42:39.275754+0000","last_peered":"2023-10-08T08:42:39.275754+0000","last_clean":"2023-10-08T08:42:39.275754+0000","last_became_active":"2023-10-08T08:42:01.132135+0000","last_became_peered":"2023-10-08T08:42:01.132135+0000","last_unstale":"2023-10-08T08:42:39.275754+0000","last_undegraded":"2023-10-08T08:42:39.275754+0000","last_fullsized":"2023-10-08T08:42:39.275754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:11.916677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279495+0000","last_change":"2023-10-08T08:42:01.136100+0000","last_active":"2023-10-08T08:42:39.279495+0000","last_peered":"2023-10-08T08:42:39.279495+0000","last_clean":"2023-10-08T08:42:39.279495+0000","last_became_active":"2023-10-08T08:42:01.135826+0000","last_became_peered":"2023-10-08T08:42:01.135826+0000","last_unstale":"2023-10-08T08:42:39.279495+0000","last_undegraded":"2023-10-08T08:42:39.279495+0000","last_fullsized":"2023-10-08T08:42:39.279495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:03.734296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279138+0000","last_change":"2023-10-08T08:42:05.177765+0000","last_active":"2023-10-08T08:42:39.279138+0000","last_peered":"2023-10-08T08:42:39.279138+0000","last_clean":"2023-10-08T08:42:39.279138+0000","last_became_active":"2023-10-08T08:42:05.177362+0000","last_became_peered":"2023-10-08T08:42:05.177362+0000","last_unstale":"2023-10-08T08:42:39.279138+0000","last_undegraded":"2023-10-08T08:42:39.279138+0000","last_fullsized":"2023-10-08T08:42:39.279138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:21.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":109,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.197326+0000","last_change":"2023-10-08T08:42:00.111581+0000","last_active":"2023-10-08T08:43:43.197326+0000","last_peered":"2023-10-08T08:43:43.197326+0000","last_clean":"2023-10-08T08:43:43.197326+0000","last_became_active":"2023-10-08T08:42:00.111298+0000","last_became_peered":"2023-10-08T08:42:00.111298+0000","last_unstale":"2023-10-08T08:43:43.197326+0000","last_undegraded":"2023-10-08T08:43:43.197326+0000","last_fullsized":"2023-10-08T08:43:43.197326+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:52:39.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270526+0000","last_change":"2023-10-08T08:42:01.134630+0000","last_active":"2023-10-08T08:42:39.270526+0000","last_peered":"2023-10-08T08:42:39.270526+0000","last_clean":"2023-10-08T08:42:39.270526+0000","last_became_active":"2023-10-08T08:42:01.134347+0000","last_became_peered":"2023-10-08T08:42:01.134347+0000","last_unstale":"2023-10-08T08:42:39.270526+0000","last_undegraded":"2023-10-08T08:42:39.270526+0000","last_fullsized":"2023-10-08T08:42:39.270526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:51:14.364756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270287+0000","last_change":"2023-10-08T08:42:05.177223+0000","last_active":"2023-10-08T08:42:39.270287+0000","last_peered":"2023-10-08T08:42:39.270287+0000","last_clean":"2023-10-08T08:42:39.270287+0000","last_became_active":"2023-10-08T08:42:05.176811+0000","last_became_peered":"2023-10-08T08:42:05.176811+0000","last_unstale":"2023-10-08T08:42:39.270287+0000","last_undegraded":"2023-10-08T08:42:39.270287+0000","last_fullsized":"2023-10-08T08:42:39.270287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:41.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270575+0000","last_change":"2023-10-08T08:42:00.115860+0000","last_active":"2023-10-08T08:42:39.270575+0000","last_peered":"2023-10-08T08:42:39.270575+0000","last_clean":"2023-10-08T08:42:39.270575+0000","last_became_active":"2023-10-08T08:42:00.115601+0000","last_became_peered":"2023-10-08T08:42:00.115601+0000","last_unstale":"2023-10-08T08:42:39.270575+0000","last_undegraded":"2023-10-08T08:42:39.270575+0000","last_fullsized":"2023-10-08T08:42:39.270575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:20.071545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274100+0000","last_change":"2023-10-08T08:42:01.146648+0000","last_active":"2023-10-08T08:42:39.274100+0000","last_peered":"2023-10-08T08:42:39.274100+0000","last_clean":"2023-10-08T08:42:39.274100+0000","last_became_active":"2023-10-08T08:42:01.145978+0000","last_became_peered":"2023-10-08T08:42:01.145978+0000","last_unstale":"2023-10-08T08:42:39.274100+0000","last_undegraded":"2023-10-08T08:42:39.274100+0000","last_fullsized":"2023-10-08T08:42:39.274100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:55.768519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270396+0000","last_change":"2023-10-08T08:42:05.185079+0000","last_active":"2023-10-08T08:42:39.270396+0000","last_peered":"2023-10-08T08:42:39.270396+0000","last_clean":"2023-10-08T08:42:39.270396+0000","last_became_active":"2023-10-08T08:42:05.184521+0000","last_became_peered":"2023-10-08T08:42:05.184521+0000","last_unstale":"2023-10-08T08:42:39.270396+0000","last_undegraded":"2023-10-08T08:42:39.270396+0000","last_fullsized":"2023-10-08T08:42:39.270396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:39:17.457051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273959+0000","last_change":"2023-10-08T08:42:00.112111+0000","last_active":"2023-10-08T08:42:39.273959+0000","last_peered":"2023-10-08T08:42:39.273959+0000","last_clean":"2023-10-08T08:42:39.273959+0000","last_became_active":"2023-10-08T08:42:00.111808+0000","last_became_peered":"2023-10-08T08:42:00.111808+0000","last_unstale":"2023-10-08T08:42:39.273959+0000","last_undegraded":"2023-10-08T08:42:39.273959+0000","last_fullsized":"2023-10-08T08:42:39.273959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:03.022378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276049+0000","last_change":"2023-10-08T08:42:01.133308+0000","last_active":"2023-10-08T08:42:39.276049+0000","last_peered":"2023-10-08T08:42:39.276049+0000","last_clean":"2023-10-08T08:42:39.276049+0000","last_became_active":"2023-10-08T08:42:01.131649+0000","last_became_peered":"2023-10-08T08:42:01.131649+0000","last_unstale":"2023-10-08T08:42:39.276049+0000","last_undegraded":"2023-10-08T08:42:39.276049+0000","last_fullsized":"2023-10-08T08:42:39.276049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:05.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270293+0000","last_change":"2023-10-08T08:42:05.182409+0000","last_active":"2023-10-08T08:42:39.270293+0000","last_peered":"2023-10-08T08:42:39.270293+0000","last_clean":"2023-10-08T08:42:39.270293+0000","last_became_active":"2023-10-08T08:42:05.181974+0000","last_became_peered":"2023-10-08T08:42:05.181974+0000","last_unstale":"2023-10-08T08:42:39.270293+0000","last_undegraded":"2023-10-08T08:42:39.270293+0000","last_fullsized":"2023-10-08T08:42:39.270293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:05.821339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273251+0000","last_change":"2023-10-08T08:42:00.113287+0000","last_active":"2023-10-08T08:42:39.273251+0000","last_peered":"2023-10-08T08:42:39.273251+0000","last_clean":"2023-10-08T08:42:39.273251+0000","last_became_active":"2023-10-08T08:42:00.112996+0000","last_became_peered":"2023-10-08T08:42:00.112996+0000","last_unstale":"2023-10-08T08:42:39.273251+0000","last_undegraded":"2023-10-08T08:42:39.273251+0000","last_fullsized":"2023-10-08T08:42:39.273251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:42.559360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276426+0000","last_change":"2023-10-08T08:42:01.139763+0000","last_active":"2023-10-08T08:42:39.276426+0000","last_peered":"2023-10-08T08:42:39.276426+0000","last_clean":"2023-10-08T08:42:39.276426+0000","last_became_active":"2023-10-08T08:42:01.139451+0000","last_became_peered":"2023-10-08T08:42:01.139451+0000","last_unstale":"2023-10-08T08:42:39.276426+0000","last_undegraded":"2023-10-08T08:42:39.276426+0000","last_fullsized":"2023-10-08T08:42:39.276426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:10.166151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279067+0000","last_change":"2023-10-08T08:42:05.174612+0000","last_active":"2023-10-08T08:42:39.279067+0000","last_peered":"2023-10-08T08:42:39.279067+0000","last_clean":"2023-10-08T08:42:39.279067+0000","last_became_active":"2023-10-08T08:42:05.174174+0000","last_became_peered":"2023-10-08T08:42:05.174174+0000","last_unstale":"2023-10-08T08:42:39.279067+0000","last_undegraded":"2023-10-08T08:42:39.279067+0000","last_fullsized":"2023-10-08T08:42:39.279067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:07.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.192622+0000","last_change":"2023-10-08T08:42:00.112537+0000","last_active":"2023-10-08T08:43:43.192622+0000","last_peered":"2023-10-08T08:43:43.192622+0000","last_clean":"2023-10-08T08:43:43.192622+0000","last_became_active":"2023-10-08T08:42:00.112060+0000","last_became_peered":"2023-10-08T08:42:00.112060+0000","last_unstale":"2023-10-08T08:43:43.192622+0000","last_undegraded":"2023-10-08T08:43:43.192622+0000","last_fullsized":"2023-10-08T08:43:43.192622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:41.878960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273799+0000","last_change":"2023-10-08T08:42:01.146929+0000","last_active":"2023-10-08T08:42:39.273799+0000","last_peered":"2023-10-08T08:42:39.273799+0000","last_clean":"2023-10-08T08:42:39.273799+0000","last_became_active":"2023-10-08T08:42:01.145980+0000","last_became_peered":"2023-10-08T08:42:01.145980+0000","last_unstale":"2023-10-08T08:42:39.273799+0000","last_undegraded":"2023-10-08T08:42:39.273799+0000","last_fullsized":"2023-10-08T08:42:39.273799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:37.411832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.443543+0000","last_change":"2023-10-08T08:42:40.443543+0000","last_active":"2023-10-08T08:42:40.443543+0000","last_peered":"2023-10-08T08:42:40.443543+0000","last_clean":"2023-10-08T08:42:40.443543+0000","last_became_active":"2023-10-08T08:42:40.443041+0000","last_became_peered":"2023-10-08T08:42:40.443041+0000","last_unstale":"2023-10-08T08:42:40.443543+0000","last_undegraded":"2023-10-08T08:42:40.443543+0000","last_fullsized":"2023-10-08T08:42:40.443543+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:21:35.827659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:00.115656+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:00.115342+0000","last_became_peered":"2023-10-08T08:42:00.115342+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:32.630853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277813+0000","last_change":"2023-10-08T08:42:01.139137+0000","last_active":"2023-10-08T08:42:39.277813+0000","last_peered":"2023-10-08T08:42:39.277813+0000","last_clean":"2023-10-08T08:42:39.277813+0000","last_became_active":"2023-10-08T08:42:01.138510+0000","last_became_peered":"2023-10-08T08:42:01.138510+0000","last_unstale":"2023-10-08T08:42:39.277813+0000","last_undegraded":"2023-10-08T08:42:39.277813+0000","last_fullsized":"2023-10-08T08:42:39.277813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:16:28.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275308+0000","last_change":"2023-10-08T08:42:05.179770+0000","last_active":"2023-10-08T08:42:39.275308+0000","last_peered":"2023-10-08T08:42:39.275308+0000","last_clean":"2023-10-08T08:42:39.275308+0000","last_became_active":"2023-10-08T08:42:05.179312+0000","last_became_peered":"2023-10-08T08:42:05.179312+0000","last_unstale":"2023-10-08T08:42:39.275308+0000","last_undegraded":"2023-10-08T08:42:39.275308+0000","last_fullsized":"2023-10-08T08:42:39.275308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.947270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276681+0000","last_change":"2023-10-08T08:42:00.111299+0000","last_active":"2023-10-08T08:42:39.276681+0000","last_peered":"2023-10-08T08:42:39.276681+0000","last_clean":"2023-10-08T08:42:39.276681+0000","last_became_active":"2023-10-08T08:42:00.110966+0000","last_became_peered":"2023-10-08T08:42:00.110966+0000","last_unstale":"2023-10-08T08:42:39.276681+0000","last_undegraded":"2023-10-08T08:42:39.276681+0000","last_fullsized":"2023-10-08T08:42:39.276681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:34.211598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269504+0000","last_change":"2023-10-08T08:42:01.134205+0000","last_active":"2023-10-08T08:42:39.269504+0000","last_peered":"2023-10-08T08:42:39.269504+0000","last_clean":"2023-10-08T08:42:39.269504+0000","last_became_active":"2023-10-08T08:42:01.133887+0000","last_became_peered":"2023-10-08T08:42:01.133887+0000","last_unstale":"2023-10-08T08:42:39.269504+0000","last_undegraded":"2023-10-08T08:42:39.269504+0000","last_fullsized":"2023-10-08T08:42:39.269504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:01.807150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273842+0000","last_change":"2023-10-08T08:42:05.179119+0000","last_active":"2023-10-08T08:42:39.273842+0000","last_peered":"2023-10-08T08:42:39.273842+0000","last_clean":"2023-10-08T08:42:39.273842+0000","last_became_active":"2023-10-08T08:42:05.178712+0000","last_became_peered":"2023-10-08T08:42:05.178712+0000","last_unstale":"2023-10-08T08:42:39.273842+0000","last_undegraded":"2023-10-08T08:42:39.273842+0000","last_fullsized":"2023-10-08T08:42:39.273842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:54:38.514047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278470+0000","last_change":"2023-10-08T08:42:00.116426+0000","last_active":"2023-10-08T08:42:39.278470+0000","last_peered":"2023-10-08T08:42:39.278470+0000","last_clean":"2023-10-08T08:42:39.278470+0000","last_became_active":"2023-10-08T08:42:00.115313+0000","last_became_peered":"2023-10-08T08:42:00.115313+0000","last_unstale":"2023-10-08T08:42:39.278470+0000","last_undegraded":"2023-10-08T08:42:39.278470+0000","last_fullsized":"2023-10-08T08:42:39.278470+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:42.989380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275493+0000","last_change":"2023-10-08T08:42:01.129719+0000","last_active":"2023-10-08T08:42:39.275493+0000","last_peered":"2023-10-08T08:42:39.275493+0000","last_clean":"2023-10-08T08:42:39.275493+0000","last_became_active":"2023-10-08T08:42:01.129293+0000","last_became_peered":"2023-10-08T08:42:01.129293+0000","last_unstale":"2023-10-08T08:42:39.275493+0000","last_undegraded":"2023-10-08T08:42:39.275493+0000","last_fullsized":"2023-10-08T08:42:39.275493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:35.463614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269587+0000","last_change":"2023-10-08T08:42:05.172880+0000","last_active":"2023-10-08T08:42:39.269587+0000","last_peered":"2023-10-08T08:42:39.269587+0000","last_clean":"2023-10-08T08:42:39.269587+0000","last_became_active":"2023-10-08T08:42:05.172485+0000","last_became_peered":"2023-10-08T08:42:05.172485+0000","last_unstale":"2023-10-08T08:42:39.269587+0000","last_undegraded":"2023-10-08T08:42:39.269587+0000","last_fullsized":"2023-10-08T08:42:39.269587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:29.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.214391+0000","last_change":"2023-10-08T08:42:00.115206+0000","last_active":"2023-10-08T08:43:43.214391+0000","last_peered":"2023-10-08T08:43:43.214391+0000","last_clean":"2023-10-08T08:43:43.214391+0000","last_became_active":"2023-10-08T08:42:00.114905+0000","last_became_peered":"2023-10-08T08:42:00.114905+0000","last_unstale":"2023-10-08T08:43:43.214391+0000","last_undegraded":"2023-10-08T08:43:43.214391+0000","last_fullsized":"2023-10-08T08:43:43.214391+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:09.275317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276638+0000","last_change":"2023-10-08T08:42:01.141422+0000","last_active":"2023-10-08T08:42:39.276638+0000","last_peered":"2023-10-08T08:42:39.276638+0000","last_clean":"2023-10-08T08:42:39.276638+0000","last_became_active":"2023-10-08T08:42:01.140979+0000","last_became_peered":"2023-10-08T08:42:01.140979+0000","last_unstale":"2023-10-08T08:42:39.276638+0000","last_undegraded":"2023-10-08T08:42:39.276638+0000","last_fullsized":"2023-10-08T08:42:39.276638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:14.018786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275152+0000","last_change":"2023-10-08T08:42:05.184358+0000","last_active":"2023-10-08T08:42:39.275152+0000","last_peered":"2023-10-08T08:42:39.275152+0000","last_clean":"2023-10-08T08:42:39.275152+0000","last_became_active":"2023-10-08T08:42:05.183994+0000","last_became_peered":"2023-10-08T08:42:05.183994+0000","last_unstale":"2023-10-08T08:42:39.275152+0000","last_undegraded":"2023-10-08T08:42:39.275152+0000","last_fullsized":"2023-10-08T08:42:39.275152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:46.465110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277535+0000","last_change":"2023-10-08T08:42:00.115765+0000","last_active":"2023-10-08T08:42:39.277535+0000","last_peered":"2023-10-08T08:42:39.277535+0000","last_clean":"2023-10-08T08:42:39.277535+0000","last_became_active":"2023-10-08T08:42:00.115288+0000","last_became_peered":"2023-10-08T08:42:00.115288+0000","last_unstale":"2023-10-08T08:42:39.277535+0000","last_undegraded":"2023-10-08T08:42:39.277535+0000","last_fullsized":"2023-10-08T08:42:39.277535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:20.973280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273767+0000","last_change":"2023-10-08T08:42:01.143290+0000","last_active":"2023-10-08T08:42:39.273767+0000","last_peered":"2023-10-08T08:42:39.273767+0000","last_clean":"2023-10-08T08:42:39.273767+0000","last_became_active":"2023-10-08T08:42:01.143034+0000","last_became_peered":"2023-10-08T08:42:01.143034+0000","last_unstale":"2023-10-08T08:42:39.273767+0000","last_undegraded":"2023-10-08T08:42:39.273767+0000","last_fullsized":"2023-10-08T08:42:39.273767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:45.784275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.271060+0000","last_change":"2023-10-08T08:42:05.185022+0000","last_active":"2023-10-08T08:42:39.271060+0000","last_peered":"2023-10-08T08:42:39.271060+0000","last_clean":"2023-10-08T08:42:39.271060+0000","last_became_active":"2023-10-08T08:42:05.184476+0000","last_became_peered":"2023-10-08T08:42:05.184476+0000","last_unstale":"2023-10-08T08:42:39.271060+0000","last_undegraded":"2023-10-08T08:42:39.271060+0000","last_fullsized":"2023-10-08T08:42:39.271060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:14:04.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276317+0000","last_change":"2023-10-08T08:42:00.115556+0000","last_active":"2023-10-08T08:42:39.276317+0000","last_peered":"2023-10-08T08:42:39.276317+0000","last_clean":"2023-10-08T08:42:39.276317+0000","last_became_active":"2023-10-08T08:42:00.115251+0000","last_became_peered":"2023-10-08T08:42:00.115251+0000","last_unstale":"2023-10-08T08:42:39.276317+0000","last_undegraded":"2023-10-08T08:42:39.276317+0000","last_fullsized":"2023-10-08T08:42:39.276317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:55.439502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276120+0000","last_change":"2023-10-08T08:42:01.135969+0000","last_active":"2023-10-08T08:42:39.276120+0000","last_peered":"2023-10-08T08:42:39.276120+0000","last_clean":"2023-10-08T08:42:39.276120+0000","last_became_active":"2023-10-08T08:42:01.135615+0000","last_became_peered":"2023-10-08T08:42:01.135615+0000","last_unstale":"2023-10-08T08:42:39.276120+0000","last_undegraded":"2023-10-08T08:42:39.276120+0000","last_fullsized":"2023-10-08T08:42:39.276120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:23.153920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276151+0000","last_change":"2023-10-08T08:42:05.177904+0000","last_active":"2023-10-08T08:42:39.276151+0000","last_peered":"2023-10-08T08:42:39.276151+0000","last_clean":"2023-10-08T08:42:39.276151+0000","last_became_active":"2023-10-08T08:42:05.176397+0000","last_became_peered":"2023-10-08T08:42:05.176397+0000","last_unstale":"2023-10-08T08:42:39.276151+0000","last_undegraded":"2023-10-08T08:42:39.276151+0000","last_fullsized":"2023-10-08T08:42:39.276151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:50.134974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'14","reported_seq":185,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.192090+0000","last_change":"2023-10-08T08:42:00.114485+0000","last_active":"2023-10-08T08:43:43.192090+0000","last_peered":"2023-10-08T08:43:43.192090+0000","last_clean":"2023-10-08T08:43:43.192090+0000","last_became_active":"2023-10-08T08:42:00.114186+0000","last_became_peered":"2023-10-08T08:42:00.114186+0000","last_unstale":"2023-10-08T08:43:43.192090+0000","last_undegraded":"2023-10-08T08:43:43.192090+0000","last_fullsized":"2023-10-08T08:43:43.192090+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:30.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":80,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273394+0000","last_change":"2023-10-08T08:42:01.146627+0000","last_active":"2023-10-08T08:42:39.273394+0000","last_peered":"2023-10-08T08:42:39.273394+0000","last_clean":"2023-10-08T08:42:39.273394+0000","last_became_active":"2023-10-08T08:42:01.146332+0000","last_became_peered":"2023-10-08T08:42:01.146332+0000","last_unstale":"2023-10-08T08:42:39.273394+0000","last_undegraded":"2023-10-08T08:42:39.273394+0000","last_fullsized":"2023-10-08T08:42:39.273394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:00.825191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278530+0000","last_change":"2023-10-08T08:42:05.173257+0000","last_active":"2023-10-08T08:42:39.278530+0000","last_peered":"2023-10-08T08:42:39.278530+0000","last_clean":"2023-10-08T08:42:39.278530+0000","last_became_active":"2023-10-08T08:42:05.172891+0000","last_became_peered":"2023-10-08T08:42:05.172891+0000","last_unstale":"2023-10-08T08:42:39.278530+0000","last_undegraded":"2023-10-08T08:42:39.278530+0000","last_fullsized":"2023-10-08T08:42:39.278530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:32.802194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279368+0000","last_change":"2023-10-08T08:42:00.113330+0000","last_active":"2023-10-08T08:42:39.279368+0000","last_peered":"2023-10-08T08:42:39.279368+0000","last_clean":"2023-10-08T08:42:39.279368+0000","last_became_active":"2023-10-08T08:42:00.112183+0000","last_became_peered":"2023-10-08T08:42:00.112183+0000","last_unstale":"2023-10-08T08:42:39.279368+0000","last_undegraded":"2023-10-08T08:42:39.279368+0000","last_fullsized":"2023-10-08T08:42:39.279368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:13.158570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275089+0000","last_change":"2023-10-08T08:42:01.133854+0000","last_active":"2023-10-08T08:42:39.275089+0000","last_peered":"2023-10-08T08:42:39.275089+0000","last_clean":"2023-10-08T08:42:39.275089+0000","last_became_active":"2023-10-08T08:42:01.133540+0000","last_became_peered":"2023-10-08T08:42:01.133540+0000","last_unstale":"2023-10-08T08:42:39.275089+0000","last_undegraded":"2023-10-08T08:42:39.275089+0000","last_fullsized":"2023-10-08T08:42:39.275089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:50.011909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275437+0000","last_change":"2023-10-08T08:42:05.180359+0000","last_active":"2023-10-08T08:42:39.275437+0000","last_peered":"2023-10-08T08:42:39.275437+0000","last_clean":"2023-10-08T08:42:39.275437+0000","last_became_active":"2023-10-08T08:42:05.179877+0000","last_became_peered":"2023-10-08T08:42:05.179877+0000","last_unstale":"2023-10-08T08:42:39.275437+0000","last_undegraded":"2023-10-08T08:42:39.275437+0000","last_fullsized":"2023-10-08T08:42:39.275437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:52.926297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276709+0000","last_change":"2023-10-08T08:42:00.112036+0000","last_active":"2023-10-08T08:42:39.276709+0000","last_peered":"2023-10-08T08:42:39.276709+0000","last_clean":"2023-10-08T08:42:39.276709+0000","last_became_active":"2023-10-08T08:42:00.111710+0000","last_became_peered":"2023-10-08T08:42:00.111710+0000","last_unstale":"2023-10-08T08:42:39.276709+0000","last_undegraded":"2023-10-08T08:42:39.276709+0000","last_fullsized":"2023-10-08T08:42:39.276709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:58:16.004802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277573+0000","last_change":"2023-10-08T08:42:01.135245+0000","last_active":"2023-10-08T08:42:39.277573+0000","last_peered":"2023-10-08T08:42:39.277573+0000","last_clean":"2023-10-08T08:42:39.277573+0000","last_became_active":"2023-10-08T08:42:01.134941+0000","last_became_peered":"2023-10-08T08:42:01.134941+0000","last_unstale":"2023-10-08T08:42:39.277573+0000","last_undegraded":"2023-10-08T08:42:39.277573+0000","last_fullsized":"2023-10-08T08:42:39.277573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:13.745895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.282736+0000","last_change":"2023-10-08T08:42:40.281786+0000","last_active":"2023-10-08T08:42:40.282736+0000","last_peered":"2023-10-08T08:42:40.282736+0000","last_clean":"2023-10-08T08:42:40.282736+0000","last_became_active":"2023-10-08T08:42:40.280780+0000","last_became_peered":"2023-10-08T08:42:40.280780+0000","last_unstale":"2023-10-08T08:42:40.282736+0000","last_undegraded":"2023-10-08T08:42:40.282736+0000","last_fullsized":"2023-10-08T08:42:40.282736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:49.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":103,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:44.194302+0000","last_change":"2023-10-08T08:42:00.112610+0000","last_active":"2023-10-08T08:43:44.194302+0000","last_peered":"2023-10-08T08:43:44.194302+0000","last_clean":"2023-10-08T08:43:44.194302+0000","last_became_active":"2023-10-08T08:42:00.112313+0000","last_became_peered":"2023-10-08T08:42:00.112313+0000","last_unstale":"2023-10-08T08:43:44.194302+0000","last_undegraded":"2023-10-08T08:43:44.194302+0000","last_fullsized":"2023-10-08T08:43:44.194302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:35.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277060+0000","last_change":"2023-10-08T08:42:01.141538+0000","last_active":"2023-10-08T08:42:39.277060+0000","last_peered":"2023-10-08T08:42:39.277060+0000","last_clean":"2023-10-08T08:42:39.277060+0000","last_became_active":"2023-10-08T08:42:01.141241+0000","last_became_peered":"2023-10-08T08:42:01.141241+0000","last_unstale":"2023-10-08T08:42:39.277060+0000","last_undegraded":"2023-10-08T08:42:39.277060+0000","last_fullsized":"2023-10-08T08:42:39.277060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:41.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275573+0000","last_change":"2023-10-08T08:42:05.181949+0000","last_active":"2023-10-08T08:42:39.275573+0000","last_peered":"2023-10-08T08:42:39.275573+0000","last_clean":"2023-10-08T08:42:39.275573+0000","last_became_active":"2023-10-08T08:42:05.181532+0000","last_became_peered":"2023-10-08T08:42:05.181532+0000","last_unstale":"2023-10-08T08:42:39.275573+0000","last_undegraded":"2023-10-08T08:42:39.275573+0000","last_fullsized":"2023-10-08T08:42:39.275573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:44.035004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272872+0000","last_change":"2023-10-08T08:42:00.111175+0000","last_active":"2023-10-08T08:42:39.272872+0000","last_peered":"2023-10-08T08:42:39.272872+0000","last_clean":"2023-10-08T08:42:39.272872+0000","last_became_active":"2023-10-08T08:42:00.109672+0000","last_became_peered":"2023-10-08T08:42:00.109672+0000","last_unstale":"2023-10-08T08:42:39.272872+0000","last_undegraded":"2023-10-08T08:42:39.272872+0000","last_fullsized":"2023-10-08T08:42:39.272872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:42.715127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278596+0000","last_change":"2023-10-08T08:42:01.133910+0000","last_active":"2023-10-08T08:42:39.278596+0000","last_peered":"2023-10-08T08:42:39.278596+0000","last_clean":"2023-10-08T08:42:39.278596+0000","last_became_active":"2023-10-08T08:42:01.132738+0000","last_became_peered":"2023-10-08T08:42:01.132738+0000","last_unstale":"2023-10-08T08:42:39.278596+0000","last_undegraded":"2023-10-08T08:42:39.278596+0000","last_fullsized":"2023-10-08T08:42:39.278596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:19.966595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276206+0000","last_change":"2023-10-08T08:42:05.177048+0000","last_active":"2023-10-08T08:42:39.276206+0000","last_peered":"2023-10-08T08:42:39.276206+0000","last_clean":"2023-10-08T08:42:39.276206+0000","last_became_active":"2023-10-08T08:42:05.176654+0000","last_became_peered":"2023-10-08T08:42:05.176654+0000","last_unstale":"2023-10-08T08:42:39.276206+0000","last_undegraded":"2023-10-08T08:42:39.276206+0000","last_fullsized":"2023-10-08T08:42:39.276206+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:22.424769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274788+0000","last_change":"2023-10-08T08:42:00.112684+0000","last_active":"2023-10-08T08:42:39.274788+0000","last_peered":"2023-10-08T08:42:39.274788+0000","last_clean":"2023-10-08T08:42:39.274788+0000","last_became_active":"2023-10-08T08:42:00.112235+0000","last_became_peered":"2023-10-08T08:42:00.112235+0000","last_unstale":"2023-10-08T08:42:39.274788+0000","last_undegraded":"2023-10-08T08:42:39.274788+0000","last_fullsized":"2023-10-08T08:42:39.274788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:47.984940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276005+0000","last_change":"2023-10-08T08:42:01.133393+0000","last_active":"2023-10-08T08:42:39.276005+0000","last_peered":"2023-10-08T08:42:39.276005+0000","last_clean":"2023-10-08T08:42:39.276005+0000","last_became_active":"2023-10-08T08:42:01.133121+0000","last_became_peered":"2023-10-08T08:42:01.133121+0000","last_unstale":"2023-10-08T08:42:39.276005+0000","last_undegraded":"2023-10-08T08:42:39.276005+0000","last_fullsized":"2023-10-08T08:42:39.276005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:54.542269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.281572+0000","last_change":"2023-10-08T08:42:40.281572+0000","last_active":"2023-10-08T08:42:40.281572+0000","last_peered":"2023-10-08T08:42:40.281572+0000","last_clean":"2023-10-08T08:42:40.281572+0000","last_became_active":"2023-10-08T08:42:40.280996+0000","last_became_peered":"2023-10-08T08:42:40.280996+0000","last_unstale":"2023-10-08T08:42:40.281572+0000","last_undegraded":"2023-10-08T08:42:40.281572+0000","last_fullsized":"2023-10-08T08:42:40.281572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:11:34.435906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277067+0000","last_change":"2023-10-08T08:42:00.110059+0000","last_active":"2023-10-08T08:42:39.277067+0000","last_peered":"2023-10-08T08:42:39.277067+0000","last_clean":"2023-10-08T08:42:39.277067+0000","last_became_active":"2023-10-08T08:42:00.109743+0000","last_became_peered":"2023-10-08T08:42:00.109743+0000","last_unstale":"2023-10-08T08:42:39.277067+0000","last_undegraded":"2023-10-08T08:42:39.277067+0000","last_fullsized":"2023-10-08T08:42:39.277067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:03:40.950213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273339+0000","last_change":"2023-10-08T08:42:01.133595+0000","last_active":"2023-10-08T08:42:39.273339+0000","last_peered":"2023-10-08T08:42:39.273339+0000","last_clean":"2023-10-08T08:42:39.273339+0000","last_became_active":"2023-10-08T08:42:01.133268+0000","last_became_peered":"2023-10-08T08:42:01.133268+0000","last_unstale":"2023-10-08T08:42:39.273339+0000","last_undegraded":"2023-10-08T08:42:39.273339+0000","last_fullsized":"2023-10-08T08:42:39.273339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:49.571517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276328+0000","last_change":"2023-10-08T08:42:05.174472+0000","last_active":"2023-10-08T08:42:39.276328+0000","last_peered":"2023-10-08T08:42:39.276328+0000","last_clean":"2023-10-08T08:42:39.276328+0000","last_became_active":"2023-10-08T08:42:05.174073+0000","last_became_peered":"2023-10-08T08:42:05.174073+0000","last_unstale":"2023-10-08T08:42:39.276328+0000","last_undegraded":"2023-10-08T08:42:39.276328+0000","last_fullsized":"2023-10-08T08:42:39.276328+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:36.208008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:41.195592+0000","last_change":"2023-10-08T08:42:00.115978+0000","last_active":"2023-10-08T08:43:41.195592+0000","last_peered":"2023-10-08T08:43:41.195592+0000","last_clean":"2023-10-08T08:43:41.195592+0000","last_became_active":"2023-10-08T08:42:00.115670+0000","last_became_peered":"2023-10-08T08:42:00.115670+0000","last_unstale":"2023-10-08T08:43:41.195592+0000","last_undegraded":"2023-10-08T08:43:41.195592+0000","last_fullsized":"2023-10-08T08:43:41.195592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:11:41.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696927+0000","last_change":"2023-10-08T08:42:40.696927+0000","last_active":"2023-10-08T08:42:40.696927+0000","last_peered":"2023-10-08T08:42:40.696927+0000","last_clean":"2023-10-08T08:42:40.696927+0000","last_became_active":"2023-10-08T08:42:40.696534+0000","last_became_peered":"2023-10-08T08:42:40.696534+0000","last_unstale":"2023-10-08T08:42:40.696927+0000","last_undegraded":"2023-10-08T08:42:40.696927+0000","last_fullsized":"2023-10-08T08:42:40.696927+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:05.888834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275650+0000","last_change":"2023-10-08T08:42:05.177922+0000","last_active":"2023-10-08T08:42:39.275650+0000","last_peered":"2023-10-08T08:42:39.275650+0000","last_clean":"2023-10-08T08:42:39.275650+0000","last_became_active":"2023-10-08T08:42:05.177504+0000","last_became_peered":"2023-10-08T08:42:05.177504+0000","last_unstale":"2023-10-08T08:42:39.275650+0000","last_undegraded":"2023-10-08T08:42:39.275650+0000","last_fullsized":"2023-10-08T08:42:39.275650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:02.602437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278640+0000","last_change":"2023-10-08T08:42:01.139125+0000","last_active":"2023-10-08T08:42:39.278640+0000","last_peered":"2023-10-08T08:42:39.278640+0000","last_clean":"2023-10-08T08:42:39.278640+0000","last_became_active":"2023-10-08T08:42:01.138769+0000","last_became_peered":"2023-10-08T08:42:01.138769+0000","last_unstale":"2023-10-08T08:42:39.278640+0000","last_undegraded":"2023-10-08T08:42:39.278640+0000","last_fullsized":"2023-10-08T08:42:39.278640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:31:57.717833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:41.189895+0000","last_change":"2023-10-08T08:42:00.115528+0000","last_active":"2023-10-08T08:43:41.189895+0000","last_peered":"2023-10-08T08:43:41.189895+0000","last_clean":"2023-10-08T08:43:41.189895+0000","last_became_active":"2023-10-08T08:42:00.115189+0000","last_became_peered":"2023-10-08T08:42:00.115189+0000","last_unstale":"2023-10-08T08:43:41.189895+0000","last_undegraded":"2023-10-08T08:43:41.189895+0000","last_fullsized":"2023-10-08T08:43:41.189895+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.254073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.695382+0000","last_change":"2023-10-08T08:42:40.695382+0000","last_active":"2023-10-08T08:42:40.695382+0000","last_peered":"2023-10-08T08:42:40.695382+0000","last_clean":"2023-10-08T08:42:40.695382+0000","last_became_active":"2023-10-08T08:42:40.695009+0000","last_became_peered":"2023-10-08T08:42:40.695009+0000","last_unstale":"2023-10-08T08:42:40.695382+0000","last_undegraded":"2023-10-08T08:42:40.695382+0000","last_fullsized":"2023-10-08T08:42:40.695382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:35.298546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269706+0000","last_change":"2023-10-08T08:42:01.131992+0000","last_active":"2023-10-08T08:42:39.269706+0000","last_peered":"2023-10-08T08:42:39.269706+0000","last_clean":"2023-10-08T08:42:39.269706+0000","last_became_active":"2023-10-08T08:42:01.131633+0000","last_became_peered":"2023-10-08T08:42:01.131633+0000","last_unstale":"2023-10-08T08:42:39.269706+0000","last_undegraded":"2023-10-08T08:42:39.269706+0000","last_fullsized":"2023-10-08T08:42:39.269706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:40.653710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270531+0000","last_change":"2023-10-08T08:42:00.112987+0000","last_active":"2023-10-08T08:42:39.270531+0000","last_peered":"2023-10-08T08:42:39.270531+0000","last_clean":"2023-10-08T08:42:39.270531+0000","last_became_active":"2023-10-08T08:42:00.112276+0000","last_became_peered":"2023-10-08T08:42:00.112276+0000","last_unstale":"2023-10-08T08:42:39.270531+0000","last_undegraded":"2023-10-08T08:42:39.270531+0000","last_fullsized":"2023-10-08T08:42:39.270531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.193726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277082+0000","last_change":"2023-10-08T08:41:02.223132+0000","last_active":"2023-10-08T08:42:39.277082+0000","last_peered":"2023-10-08T08:42:39.277082+0000","last_clean":"2023-10-08T08:42:39.277082+0000","last_became_active":"2023-10-08T08:41:02.222688+0000","last_became_peered":"2023-10-08T08:41:02.222688+0000","last_unstale":"2023-10-08T08:42:39.277082+0000","last_undegraded":"2023-10-08T08:42:39.277082+0000","last_fullsized":"2023-10-08T08:42:39.277082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_clean_scrub_stamp":"2023-10-08T08:38:15.738972+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:27.673603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276236+0000","last_change":"2023-10-08T08:42:05.169025+0000","last_active":"2023-10-08T08:42:39.276236+0000","last_peered":"2023-10-08T08:42:39.276236+0000","last_clean":"2023-10-08T08:42:39.276236+0000","last_became_active":"2023-10-08T08:42:05.168100+0000","last_became_peered":"2023-10-08T08:42:05.168100+0000","last_unstale":"2023-10-08T08:42:39.276236+0000","last_undegraded":"2023-10-08T08:42:39.276236+0000","last_fullsized":"2023-10-08T08:42:39.276236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:30:40.830952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276572+0000","last_change":"2023-10-08T08:42:01.130878+0000","last_active":"2023-10-08T08:42:39.276572+0000","last_peered":"2023-10-08T08:42:39.276572+0000","last_clean":"2023-10-08T08:42:39.276572+0000","last_became_active":"2023-10-08T08:42:01.130649+0000","last_became_peered":"2023-10-08T08:42:01.130649+0000","last_unstale":"2023-10-08T08:42:39.276572+0000","last_undegraded":"2023-10-08T08:42:39.276572+0000","last_fullsized":"2023-10-08T08:42:39.276572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:15.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277371+0000","last_change":"2023-10-08T08:42:00.117747+0000","last_active":"2023-10-08T08:42:39.277371+0000","last_peered":"2023-10-08T08:42:39.277371+0000","last_clean":"2023-10-08T08:42:39.277371+0000","last_became_active":"2023-10-08T08:42:00.117437+0000","last_became_peered":"2023-10-08T08:42:00.117437+0000","last_unstale":"2023-10-08T08:42:39.277371+0000","last_undegraded":"2023-10-08T08:42:39.277371+0000","last_fullsized":"2023-10-08T08:42:39.277371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:13.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274614+0000","last_change":"2023-10-08T08:42:05.173175+0000","last_active":"2023-10-08T08:42:39.274614+0000","last_peered":"2023-10-08T08:42:39.274614+0000","last_clean":"2023-10-08T08:42:39.274614+0000","last_became_active":"2023-10-08T08:42:05.172754+0000","last_became_peered":"2023-10-08T08:42:05.172754+0000","last_unstale":"2023-10-08T08:42:39.274614+0000","last_undegraded":"2023-10-08T08:42:39.274614+0000","last_fullsized":"2023-10-08T08:42:39.274614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:48.900020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273546+0000","last_change":"2023-10-08T08:42:00.117094+0000","last_active":"2023-10-08T08:42:39.273546+0000","last_peered":"2023-10-08T08:42:39.273546+0000","last_clean":"2023-10-08T08:42:39.273546+0000","last_became_active":"2023-10-08T08:42:00.116773+0000","last_became_peered":"2023-10-08T08:42:00.116773+0000","last_unstale":"2023-10-08T08:42:39.273546+0000","last_undegraded":"2023-10-08T08:42:39.273546+0000","last_fullsized":"2023-10-08T08:42:39.273546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:28.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276460+0000","last_change":"2023-10-08T08:42:01.146290+0000","last_active":"2023-10-08T08:42:39.276460+0000","last_peered":"2023-10-08T08:42:39.276460+0000","last_clean":"2023-10-08T08:42:39.276460+0000","last_became_active":"2023-10-08T08:42:01.145585+0000","last_became_peered":"2023-10-08T08:42:01.145585+0000","last_unstale":"2023-10-08T08:42:39.276460+0000","last_undegraded":"2023-10-08T08:42:39.276460+0000","last_fullsized":"2023-10-08T08:42:39.276460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:16:15.140659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269495+0000","last_change":"2023-10-08T08:42:05.177611+0000","last_active":"2023-10-08T08:42:39.269495+0000","last_peered":"2023-10-08T08:42:39.269495+0000","last_clean":"2023-10-08T08:42:39.269495+0000","last_became_active":"2023-10-08T08:42:05.177027+0000","last_became_peered":"2023-10-08T08:42:05.177027+0000","last_unstale":"2023-10-08T08:42:39.269495+0000","last_undegraded":"2023-10-08T08:42:39.269495+0000","last_fullsized":"2023-10-08T08:42:39.269495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.846359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275664+0000","last_change":"2023-10-08T08:42:00.112453+0000","last_active":"2023-10-08T08:42:39.275664+0000","last_peered":"2023-10-08T08:42:39.275664+0000","last_clean":"2023-10-08T08:42:39.275664+0000","last_became_active":"2023-10-08T08:42:00.112159+0000","last_became_peered":"2023-10-08T08:42:00.112159+0000","last_unstale":"2023-10-08T08:42:39.275664+0000","last_undegraded":"2023-10-08T08:42:39.275664+0000","last_fullsized":"2023-10-08T08:42:39.275664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:27.713764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270602+0000","last_change":"2023-10-08T08:42:01.136743+0000","last_active":"2023-10-08T08:42:39.270602+0000","last_peered":"2023-10-08T08:42:39.270602+0000","last_clean":"2023-10-08T08:42:39.270602+0000","last_became_active":"2023-10-08T08:42:01.136442+0000","last_became_peered":"2023-10-08T08:42:01.136442+0000","last_unstale":"2023-10-08T08:42:39.270602+0000","last_undegraded":"2023-10-08T08:42:39.270602+0000","last_fullsized":"2023-10-08T08:42:39.270602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:50:41.937240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278976+0000","last_change":"2023-10-08T08:42:05.171945+0000","last_active":"2023-10-08T08:42:39.278976+0000","last_peered":"2023-10-08T08:42:39.278976+0000","last_clean":"2023-10-08T08:42:39.278976+0000","last_became_active":"2023-10-08T08:42:05.171573+0000","last_became_peered":"2023-10-08T08:42:05.171573+0000","last_unstale":"2023-10-08T08:42:39.278976+0000","last_undegraded":"2023-10-08T08:42:39.278976+0000","last_fullsized":"2023-10-08T08:42:39.278976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:03.677144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270977+0000","last_change":"2023-10-08T08:42:00.116005+0000","last_active":"2023-10-08T08:42:39.270977+0000","last_peered":"2023-10-08T08:42:39.270977+0000","last_clean":"2023-10-08T08:42:39.270977+0000","last_became_active":"2023-10-08T08:42:00.115701+0000","last_became_peered":"2023-10-08T08:42:00.115701+0000","last_unstale":"2023-10-08T08:42:39.270977+0000","last_undegraded":"2023-10-08T08:42:39.270977+0000","last_fullsized":"2023-10-08T08:42:39.270977+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:46.114324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273957+0000","last_change":"2023-10-08T08:42:01.140370+0000","last_active":"2023-10-08T08:42:39.273957+0000","last_peered":"2023-10-08T08:42:39.273957+0000","last_clean":"2023-10-08T08:42:39.273957+0000","last_became_active":"2023-10-08T08:42:01.139923+0000","last_became_peered":"2023-10-08T08:42:01.139923+0000","last_unstale":"2023-10-08T08:42:39.273957+0000","last_undegraded":"2023-10-08T08:42:39.273957+0000","last_fullsized":"2023-10-08T08:42:39.273957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:07.052821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270782+0000","last_change":"2023-10-08T08:42:05.177542+0000","last_active":"2023-10-08T08:42:39.270782+0000","last_peered":"2023-10-08T08:42:39.270782+0000","last_clean":"2023-10-08T08:42:39.270782+0000","last_became_active":"2023-10-08T08:42:05.176808+0000","last_became_peered":"2023-10-08T08:42:05.176808+0000","last_unstale":"2023-10-08T08:42:39.270782+0000","last_undegraded":"2023-10-08T08:42:39.270782+0000","last_fullsized":"2023-10-08T08:42:39.270782+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:44.845948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.284070+0000","last_change":"2023-10-08T08:42:40.284070+0000","last_active":"2023-10-08T08:42:40.284070+0000","last_peered":"2023-10-08T08:42:40.284070+0000","last_clean":"2023-10-08T08:42:40.284070+0000","last_became_active":"2023-10-08T08:42:40.280519+0000","last_became_peered":"2023-10-08T08:42:40.280519+0000","last_unstale":"2023-10-08T08:42:40.284070+0000","last_undegraded":"2023-10-08T08:42:40.284070+0000","last_fullsized":"2023-10-08T08:42:40.284070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:29.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272903+0000","last_change":"2023-10-08T08:42:01.139641+0000","last_active":"2023-10-08T08:42:39.272903+0000","last_peered":"2023-10-08T08:42:39.272903+0000","last_clean":"2023-10-08T08:42:39.272903+0000","last_became_active":"2023-10-08T08:42:01.139332+0000","last_became_peered":"2023-10-08T08:42:01.139332+0000","last_unstale":"2023-10-08T08:42:39.272903+0000","last_undegraded":"2023-10-08T08:42:39.272903+0000","last_fullsized":"2023-10-08T08:42:39.272903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:14.948944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278104+0000","last_change":"2023-10-08T08:42:05.180307+0000","last_active":"2023-10-08T08:42:39.278104+0000","last_peered":"2023-10-08T08:42:39.278104+0000","last_clean":"2023-10-08T08:42:39.278104+0000","last_became_active":"2023-10-08T08:42:05.179755+0000","last_became_peered":"2023-10-08T08:42:05.179755+0000","last_unstale":"2023-10-08T08:42:39.278104+0000","last_undegraded":"2023-10-08T08:42:39.278104+0000","last_fullsized":"2023-10-08T08:42:39.278104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:34.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269609+0000","last_change":"2023-10-08T08:42:00.112674+0000","last_active":"2023-10-08T08:42:39.269609+0000","last_peered":"2023-10-08T08:42:39.269609+0000","last_clean":"2023-10-08T08:42:39.269609+0000","last_became_active":"2023-10-08T08:42:00.110746+0000","last_became_peered":"2023-10-08T08:42:00.110746+0000","last_unstale":"2023-10-08T08:42:39.269609+0000","last_undegraded":"2023-10-08T08:42:39.269609+0000","last_fullsized":"2023-10-08T08:42:39.269609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:27.463811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274453+0000","last_change":"2023-10-08T08:42:01.150107+0000","last_active":"2023-10-08T08:42:39.274453+0000","last_peered":"2023-10-08T08:42:39.274453+0000","last_clean":"2023-10-08T08:42:39.274453+0000","last_became_active":"2023-10-08T08:42:01.149609+0000","last_became_peered":"2023-10-08T08:42:01.149609+0000","last_unstale":"2023-10-08T08:42:39.274453+0000","last_undegraded":"2023-10-08T08:42:39.274453+0000","last_fullsized":"2023-10-08T08:42:39.274453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:05.378286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270656+0000","last_change":"2023-10-08T08:42:05.177571+0000","last_active":"2023-10-08T08:42:39.270656+0000","last_peered":"2023-10-08T08:42:39.270656+0000","last_clean":"2023-10-08T08:42:39.270656+0000","last_became_active":"2023-10-08T08:42:05.177061+0000","last_became_peered":"2023-10-08T08:42:05.177061+0000","last_unstale":"2023-10-08T08:42:39.270656+0000","last_undegraded":"2023-10-08T08:42:39.270656+0000","last_fullsized":"2023-10-08T08:42:39.270656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:10.274262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.286517+0000","last_change":"2023-10-08T08:42:40.286517+0000","last_active":"2023-10-08T08:42:40.286517+0000","last_peered":"2023-10-08T08:42:40.286517+0000","last_clean":"2023-10-08T08:42:40.286517+0000","last_became_active":"2023-10-08T08:42:40.281562+0000","last_became_peered":"2023-10-08T08:42:40.281562+0000","last_unstale":"2023-10-08T08:42:40.286517+0000","last_undegraded":"2023-10-08T08:42:40.286517+0000","last_fullsized":"2023-10-08T08:42:40.286517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:23.313740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270339+0000","last_change":"2023-10-08T08:42:01.142209+0000","last_active":"2023-10-08T08:42:39.270339+0000","last_peered":"2023-10-08T08:42:39.270339+0000","last_clean":"2023-10-08T08:42:39.270339+0000","last_became_active":"2023-10-08T08:42:01.141911+0000","last_became_peered":"2023-10-08T08:42:01.141911+0000","last_unstale":"2023-10-08T08:42:39.270339+0000","last_undegraded":"2023-10-08T08:42:39.270339+0000","last_fullsized":"2023-10-08T08:42:39.270339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:00.066595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270619+0000","last_change":"2023-10-08T08:42:05.173463+0000","last_active":"2023-10-08T08:42:39.270619+0000","last_peered":"2023-10-08T08:42:39.270619+0000","last_clean":"2023-10-08T08:42:39.270619+0000","last_became_active":"2023-10-08T08:42:05.173045+0000","last_became_peered":"2023-10-08T08:42:05.173045+0000","last_unstale":"2023-10-08T08:42:39.270619+0000","last_undegraded":"2023-10-08T08:42:39.270619+0000","last_fullsized":"2023-10-08T08:42:39.270619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:10.774694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272997+0000","last_change":"2023-10-08T08:42:00.111005+0000","last_active":"2023-10-08T08:42:39.272997+0000","last_peered":"2023-10-08T08:42:39.272997+0000","last_clean":"2023-10-08T08:42:39.272997+0000","last_became_active":"2023-10-08T08:42:00.110687+0000","last_became_peered":"2023-10-08T08:42:00.110687+0000","last_unstale":"2023-10-08T08:42:39.272997+0000","last_undegraded":"2023-10-08T08:42:39.272997+0000","last_fullsized":"2023-10-08T08:42:39.272997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:38.682150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277572+0000","last_change":"2023-10-08T08:42:01.144443+0000","last_active":"2023-10-08T08:42:39.277572+0000","last_peered":"2023-10-08T08:42:39.277572+0000","last_clean":"2023-10-08T08:42:39.277572+0000","last_became_active":"2023-10-08T08:42:01.143960+0000","last_became_peered":"2023-10-08T08:42:01.143960+0000","last_unstale":"2023-10-08T08:42:39.277572+0000","last_undegraded":"2023-10-08T08:42:39.277572+0000","last_fullsized":"2023-10-08T08:42:39.277572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:46:57.209569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275843+0000","last_change":"2023-10-08T08:42:05.178212+0000","last_active":"2023-10-08T08:42:39.275843+0000","last_peered":"2023-10-08T08:42:39.275843+0000","last_clean":"2023-10-08T08:42:39.275843+0000","last_became_active":"2023-10-08T08:42:05.177751+0000","last_became_peered":"2023-10-08T08:42:05.177751+0000","last_unstale":"2023-10-08T08:42:39.275843+0000","last_undegraded":"2023-10-08T08:42:39.275843+0000","last_fullsized":"2023-10-08T08:42:39.275843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:10.128104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.214954+0000","last_change":"2023-10-08T08:42:00.115576+0000","last_active":"2023-10-08T08:43:43.214954+0000","last_peered":"2023-10-08T08:43:43.214954+0000","last_clean":"2023-10-08T08:43:43.214954+0000","last_became_active":"2023-10-08T08:42:00.115296+0000","last_became_peered":"2023-10-08T08:42:00.115296+0000","last_unstale":"2023-10-08T08:43:43.214954+0000","last_undegraded":"2023-10-08T08:43:43.214954+0000","last_fullsized":"2023-10-08T08:43:43.214954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:22.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278387+0000","last_change":"2023-10-08T08:42:01.139104+0000","last_active":"2023-10-08T08:42:39.278387+0000","last_peered":"2023-10-08T08:42:39.278387+0000","last_clean":"2023-10-08T08:42:39.278387+0000","last_became_active":"2023-10-08T08:42:01.138653+0000","last_became_peered":"2023-10-08T08:42:01.138653+0000","last_unstale":"2023-10-08T08:42:39.278387+0000","last_undegraded":"2023-10-08T08:42:39.278387+0000","last_fullsized":"2023-10-08T08:42:39.278387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:24.784017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273245+0000","last_change":"2023-10-08T08:42:05.186990+0000","last_active":"2023-10-08T08:42:39.273245+0000","last_peered":"2023-10-08T08:42:39.273245+0000","last_clean":"2023-10-08T08:42:39.273245+0000","last_became_active":"2023-10-08T08:42:05.186397+0000","last_became_peered":"2023-10-08T08:42:05.186397+0000","last_unstale":"2023-10-08T08:42:39.273245+0000","last_undegraded":"2023-10-08T08:42:39.273245+0000","last_fullsized":"2023-10-08T08:42:39.273245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:53.633137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276542+0000","last_change":"2023-10-08T08:42:00.114499+0000","last_active":"2023-10-08T08:42:39.276542+0000","last_peered":"2023-10-08T08:42:39.276542+0000","last_clean":"2023-10-08T08:42:39.276542+0000","last_became_active":"2023-10-08T08:42:00.114062+0000","last_became_peered":"2023-10-08T08:42:00.114062+0000","last_unstale":"2023-10-08T08:42:39.276542+0000","last_undegraded":"2023-10-08T08:42:39.276542+0000","last_fullsized":"2023-10-08T08:42:39.276542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:23.576889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277486+0000","last_change":"2023-10-08T08:42:01.139810+0000","last_active":"2023-10-08T08:42:39.277486+0000","last_peered":"2023-10-08T08:42:39.277486+0000","last_clean":"2023-10-08T08:42:39.277486+0000","last_became_active":"2023-10-08T08:42:01.139489+0000","last_became_peered":"2023-10-08T08:42:01.139489+0000","last_unstale":"2023-10-08T08:42:39.277486+0000","last_undegraded":"2023-10-08T08:42:39.277486+0000","last_fullsized":"2023-10-08T08:42:39.277486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:06.724645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278227+0000","last_change":"2023-10-08T08:42:05.172808+0000","last_active":"2023-10-08T08:42:39.278227+0000","last_peered":"2023-10-08T08:42:39.278227+0000","last_clean":"2023-10-08T08:42:39.278227+0000","last_became_active":"2023-10-08T08:42:05.172307+0000","last_became_peered":"2023-10-08T08:42:05.172307+0000","last_unstale":"2023-10-08T08:42:39.278227+0000","last_undegraded":"2023-10-08T08:42:39.278227+0000","last_fullsized":"2023-10-08T08:42:39.278227+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.031070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275490+0000","last_change":"2023-10-08T08:42:00.112423+0000","last_active":"2023-10-08T08:42:39.275490+0000","last_peered":"2023-10-08T08:42:39.275490+0000","last_clean":"2023-10-08T08:42:39.275490+0000","last_became_active":"2023-10-08T08:42:00.112130+0000","last_became_peered":"2023-10-08T08:42:00.112130+0000","last_unstale":"2023-10-08T08:42:39.275490+0000","last_undegraded":"2023-10-08T08:42:39.275490+0000","last_fullsized":"2023-10-08T08:42:39.275490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:54.898037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277793+0000","last_change":"2023-10-08T08:42:01.148404+0000","last_active":"2023-10-08T08:42:39.277793+0000","last_peered":"2023-10-08T08:42:39.277793+0000","last_clean":"2023-10-08T08:42:39.277793+0000","last_became_active":"2023-10-08T08:42:01.148087+0000","last_became_peered":"2023-10-08T08:42:01.148087+0000","last_unstale":"2023-10-08T08:42:39.277793+0000","last_undegraded":"2023-10-08T08:42:39.277793+0000","last_fullsized":"2023-10-08T08:42:39.277793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:12.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274525+0000","last_change":"2023-10-08T08:42:01.149762+0000","last_active":"2023-10-08T08:42:39.274525+0000","last_peered":"2023-10-08T08:42:39.274525+0000","last_clean":"2023-10-08T08:42:39.274525+0000","last_became_active":"2023-10-08T08:42:01.149392+0000","last_became_peered":"2023-10-08T08:42:01.149392+0000","last_unstale":"2023-10-08T08:42:39.274525+0000","last_undegraded":"2023-10-08T08:42:39.274525+0000","last_fullsized":"2023-10-08T08:42:39.274525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:22.487634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279392+0000","last_change":"2023-10-08T08:42:01.145106+0000","last_active":"2023-10-08T08:42:39.279392+0000","last_peered":"2023-10-08T08:42:39.279392+0000","last_clean":"2023-10-08T08:42:39.279392+0000","last_became_active":"2023-10-08T08:42:01.144709+0000","last_became_peered":"2023-10-08T08:42:01.144709+0000","last_unstale":"2023-10-08T08:42:39.279392+0000","last_undegraded":"2023-10-08T08:42:39.279392+0000","last_fullsized":"2023-10-08T08:42:39.279392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:24.248415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.280122+0000","last_change":"2023-10-08T08:42:01.148384+0000","last_active":"2023-10-08T08:42:39.280122+0000","last_peered":"2023-10-08T08:42:39.280122+0000","last_clean":"2023-10-08T08:42:39.280122+0000","last_became_active":"2023-10-08T08:42:01.148098+0000","last_became_peered":"2023-10-08T08:42:01.148098+0000","last_unstale":"2023-10-08T08:42:39.280122+0000","last_undegraded":"2023-10-08T08:42:39.280122+0000","last_fullsized":"2023-10-08T08:42:39.280122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:45.361279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.278516+0000","last_change":"2023-10-08T08:42:40.278516+0000","last_active":"2023-10-08T08:42:40.278516+0000","last_peered":"2023-10-08T08:42:40.278516+0000","last_clean":"2023-10-08T08:42:40.278516+0000","last_became_active":"2023-10-08T08:42:40.278111+0000","last_became_peered":"2023-10-08T08:42:40.278111+0000","last_unstale":"2023-10-08T08:42:40.278516+0000","last_undegraded":"2023-10-08T08:42:40.278516+0000","last_fullsized":"2023-10-08T08:42:40.278516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:32.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276507+0000","last_change":"2023-10-08T08:42:01.146486+0000","last_active":"2023-10-08T08:42:39.276507+0000","last_peered":"2023-10-08T08:42:39.276507+0000","last_clean":"2023-10-08T08:42:39.276507+0000","last_became_active":"2023-10-08T08:42:01.146002+0000","last_became_peered":"2023-10-08T08:42:01.146002+0000","last_unstale":"2023-10-08T08:42:39.276507+0000","last_undegraded":"2023-10-08T08:42:39.276507+0000","last_fullsized":"2023-10-08T08:42:39.276507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:28.217937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276175+0000","last_change":"2023-10-08T08:42:01.152380+0000","last_active":"2023-10-08T08:42:39.276175+0000","last_peered":"2023-10-08T08:42:39.276175+0000","last_clean":"2023-10-08T08:42:39.276175+0000","last_became_active":"2023-10-08T08:42:01.149760+0000","last_became_peered":"2023-10-08T08:42:01.149760+0000","last_unstale":"2023-10-08T08:42:39.276175+0000","last_undegraded":"2023-10-08T08:42:39.276175+0000","last_fullsized":"2023-10-08T08:42:39.276175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:47:58.326416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279642+0000","last_change":"2023-10-08T08:42:01.149593+0000","last_active":"2023-10-08T08:42:39.279642+0000","last_peered":"2023-10-08T08:42:39.279642+0000","last_clean":"2023-10-08T08:42:39.279642+0000","last_became_active":"2023-10-08T08:42:01.149235+0000","last_became_peered":"2023-10-08T08:42:01.149235+0000","last_unstale":"2023-10-08T08:42:39.279642+0000","last_undegraded":"2023-10-08T08:42:39.279642+0000","last_fullsized":"2023-10-08T08:42:39.279642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:51.379305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270673+0000","last_change":"2023-10-08T08:42:01.133460+0000","last_active":"2023-10-08T08:42:39.270673+0000","last_peered":"2023-10-08T08:42:39.270673+0000","last_clean":"2023-10-08T08:42:39.270673+0000","last_became_active":"2023-10-08T08:42:01.133132+0000","last_became_peered":"2023-10-08T08:42:01.133132+0000","last_unstale":"2023-10-08T08:42:39.270673+0000","last_undegraded":"2023-10-08T08:42:39.270673+0000","last_fullsized":"2023-10-08T08:42:39.270673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:29.047135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278661+0000","last_change":"2023-10-08T08:42:01.134274+0000","last_active":"2023-10-08T08:42:39.278661+0000","last_peered":"2023-10-08T08:42:39.278661+0000","last_clean":"2023-10-08T08:42:39.278661+0000","last_became_active":"2023-10-08T08:42:01.133040+0000","last_became_peered":"2023-10-08T08:42:01.133040+0000","last_unstale":"2023-10-08T08:42:39.278661+0000","last_undegraded":"2023-10-08T08:42:39.278661+0000","last_fullsized":"2023-10-08T08:42:39.278661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:18.054859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269663+0000","last_change":"2023-10-08T08:42:01.128333+0000","last_active":"2023-10-08T08:42:39.269663+0000","last_peered":"2023-10-08T08:42:39.269663+0000","last_clean":"2023-10-08T08:42:39.269663+0000","last_became_active":"2023-10-08T08:42:01.128076+0000","last_became_peered":"2023-10-08T08:42:01.128076+0000","last_unstale":"2023-10-08T08:42:39.269663+0000","last_undegraded":"2023-10-08T08:42:39.269663+0000","last_fullsized":"2023-10-08T08:42:39.269663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.675185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276377+0000","last_change":"2023-10-08T08:42:01.139518+0000","last_active":"2023-10-08T08:42:39.276377+0000","last_peered":"2023-10-08T08:42:39.276377+0000","last_clean":"2023-10-08T08:42:39.276377+0000","last_became_active":"2023-10-08T08:42:01.139217+0000","last_became_peered":"2023-10-08T08:42:01.139217+0000","last_unstale":"2023-10-08T08:42:39.276377+0000","last_undegraded":"2023-10-08T08:42:39.276377+0000","last_fullsized":"2023-10-08T08:42:39.276377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:05:02.485500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275263+0000","last_change":"2023-10-08T08:42:01.142664+0000","last_active":"2023-10-08T08:42:39.275263+0000","last_peered":"2023-10-08T08:42:39.275263+0000","last_clean":"2023-10-08T08:42:39.275263+0000","last_became_active":"2023-10-08T08:42:01.142136+0000","last_became_peered":"2023-10-08T08:42:01.142136+0000","last_unstale":"2023-10-08T08:42:39.275263+0000","last_undegraded":"2023-10-08T08:42:39.275263+0000","last_fullsized":"2023-10-08T08:42:39.275263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:18.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696535+0000","last_change":"2023-10-08T08:42:40.696535+0000","last_active":"2023-10-08T08:42:40.696535+0000","last_peered":"2023-10-08T08:42:40.696535+0000","last_clean":"2023-10-08T08:42:40.696535+0000","last_became_active":"2023-10-08T08:42:40.695973+0000","last_became_peered":"2023-10-08T08:42:40.695973+0000","last_unstale":"2023-10-08T08:42:40.696535+0000","last_undegraded":"2023-10-08T08:42:40.696535+0000","last_fullsized":"2023-10-08T08:42:40.696535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:50.008782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10524,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":784,"num_read_kb":410,"num_write":211,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":31572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481825,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":494069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.60899999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.64400000000000002,"15min":0.63900000000000001},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88600000000000001,"5min":1.161,"15min":1.161},"last":0.73799999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.496},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73799999999999999,"5min":1.254,"15min":1.254},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Oct 8 08:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.622,"15min":0.60499999999999998},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.876},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67000000000000004,"15min":0.66200000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70299999999999996}]},{"osd":5,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.58399999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93000000000000005,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.747},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.52600000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.024,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.72499999999999998,"15min":0.70799999999999996},"min":{"1min":0.53800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97999999999999998,"5min":1.196,"15min":1.196},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0449999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79000000000000004}]},{"osd":8,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.79900000000000004}]},{"osd":9,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.60399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.107,"5min":1.413,"15min":1.413},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.91700000000000004}]},{"osd":10,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.629,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0860000000000001,"5min":1.214,"15min":1.214},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.81299999999999994,"15min":0.80300000000000005},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0629999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.86499999999999999}]}]},{"osd":10,"up_from":70,"seq":300647710756,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1638400,"data_stored":1088563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.51200000000000001}]},{"osd":1,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.372}]},{"osd":2,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82599999999999996,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.83699999999999997,"5min":0.87,"15min":0.87},"last":0.44700000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0489999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93899999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.50700000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.032,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.55500000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.95599999999999996,"5min":1.23,"15min":1.23},"last":0.57999999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.998,"5min":1.208,"15min":1.208},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98399999999999999,"5min":1.173,"15min":1.173},"last":0.69699999999999995}]},{"osd":11,"last update":"Sun Oct 8 08:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82799999999999996,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97199999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.61599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.069},"last":0.75}]}]},{"osd":9,"up_from":65,"seq":279172874281,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":493739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.41899999999999998,"15min":0.42899999999999999},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.42699999999999999,"15min":0.44900000000000001},"min":{"1min":0.27000000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54900000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.33400000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72499999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81699999999999995,"5min":1.022,"15min":1.022},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2,"5min":2,"15min":2},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.51300000000000001,"15min":0.53800000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.433}]},{"osd":4,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.498},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78000000000000003,"5min":1.028,"15min":1.028},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94499999999999995,"5min":0.995,"15min":0.995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.621}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39100000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.69899999999999995,"15min":0.73299999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85599999999999998,"5min":1.151,"15min":1.151},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.70699999999999996,"15min":0.747},"min":{"1min":0.45800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.64500000000000002}]},{"osd":8,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73099999999999998,"15min":0.75800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.70299999999999996}]},{"osd":10,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82499999999999996,"5min":1.216,"15min":1.216},"last":0.67400000000000004}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66400000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103213,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":494117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":1.256,"15min":1.256},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63700000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.497}]},{"osd":1,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.60599999999999998,"15min":0.57799999999999996},"min":{"1min":0.58399999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63900000000000001,"15min":0.622},"min":{"1min":0.502,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.028,"15min":1.028},"last":0.67500000000000004}]},{"osd":2,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.441},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.626,"5min":0.748,"15min":0.748},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67100000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46300000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78600000000000003,"5min":1.288,"15min":1.288},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.47099999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.67700000000000005,"15min":0.66000000000000003},"min":{"1min":0.66200000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73099999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58199999999999996,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.312,"15min":0.312},"max":{"1min":0.85199999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.87,"15min":0.87},"last":0.76100000000000001}]},{"osd":6,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.75900000000000001},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.90000000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.93300000000000005}]},{"osd":7,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.67600000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.64600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85699999999999998,"5min":1.026,"15min":1.026},"last":0.81999999999999995}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.90600000000000003}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.76900000000000002,"15min":0.751},"min":{"1min":0.71799999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.052,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.78200000000000003,"15min":0.76500000000000001},"min":{"1min":0.73799999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.036,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.95999999999999996}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.879}]}]},{"osd":7,"up_from":51,"seq":219043332145,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1086127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41399999999999998,"15min":0.39700000000000002},"min":{"1min":0.312,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70299999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.441},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.432},"min":{"1min":0.33500000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73399999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.56499999999999995},"min":{"1min":0.51300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73799999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.754}]},{"osd":3,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55100000000000005,"15min":0.52700000000000002},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81499999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.41799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.502,"15min":0.49299999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.36599999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.89800000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.64100000000000001,"15min":0.61499999999999999},"min":{"1min":0.52600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89900000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.64100000000000001},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96499999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.42099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.50800000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70699999999999996,"15min":0.69499999999999995},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.623},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73299999999999998,"15min":0.71799999999999997},"min":{"1min":0.60099999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":1.234,"15min":1.234},"last":0.72499999999999998}]},{"osd":9,"last update":"Sun Oct 8 08:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0580000000000001,"5min":1.181,"15min":1.181},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.73499999999999999,"15min":0.73199999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95499999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67400000000000004}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.55500000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98899999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.64900000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91500000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78000000000000003}]},{"osd":11,"last update":"Sun Oct 8 08:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.80300000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":493339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.311,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57499999999999996,"5min":0.62,"15min":0.62},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38100000000000001}]},{"osd":1,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.745,"15min":0.745},"last":0.52700000000000002}]},{"osd":2,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.57099999999999995},"min":{"1min":0.46200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.88700000000000001,"5min":1.034,"15min":1.034},"last":0.77800000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.434,"15min":0.42499999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70099999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47499999999999998,"15min":0.46400000000000002},"min":{"1min":0.36399999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67400000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.436}]},{"osd":4,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.45900000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.60999999999999999},"min":{"1min":0.45700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":0.627},"min":{"1min":0.42999999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89300000000000002,"5min":4.7670000000000003,"15min":4.7670000000000003},"last":0.63200000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.442,"5min":0.379,"15min":0.379},"max":{"1min":0.95699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.623},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.49399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.96799999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69399999999999995}]},{"osd":8,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79700000000000004,"5min":1.087,"15min":1.087},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.47999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78100000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70499999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96399999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.46400000000000002}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.64300000000000002}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79800000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542217,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":498211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.45400000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.75900000000000001,"5min":1.242,"15min":1.242},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.44600000000000001},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.71699999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.55600000000000005,"15min":0.502},"min":{"1min":0.48899999999999999,"5min":0.246,"15min":0.246},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.56899999999999995,"15min":0.51500000000000001},"min":{"1min":0.33400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Sun Oct 8 08:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.45300000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.59599999999999997},"min":{"1min":0.41499999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81699999999999995,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.54300000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.42599999999999999},"min":{"1min":0.34300000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.40899999999999997},"min":{"1min":0.36599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48299999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.624,"15min":0.58299999999999996},"min":{"1min":0.54600000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.66500000000000004,"15min":0.627},"min":{"1min":0.46700000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.78000000000000003}]},{"osd":6,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.61099999999999999,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0980000000000001,"5min":1.788,"15min":1.788},"last":0.51900000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.60699999999999998,"15min":0.57299999999999995},"min":{"1min":0.47999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.502,"5min":0.318,"15min":0.318},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.60199999999999998}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.67100000000000004,"15min":0.64100000000000001},"min":{"1min":0.59999999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.99299999999999999,"5min":1.002,"15min":1.002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.70599999999999996,"15min":0.67600000000000005},"min":{"1min":0.67400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.76600000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:42:42 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.51500000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.72499999999999998}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.69399999999999995,"15min":0.67500000000000004},"min":{"1min":0.54800000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.50600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.81799999999999995}]},{"osd":11,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.84699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":495055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 08:43:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.52300000000000002},"min":{"1min":0.46000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.53800000000000003},"min":{"1min":0.439,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55000000000000004}]},{"osd":2,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.433,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66900000000000004,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56899999999999995}]},{"osd":3,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.379},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52100000000000002,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.79300000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.66600000000000004}]},{"osd":6,"last update":"Sun Oct 8 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65900000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41799999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.47499999999999998}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.61299999999999999}]},{"osd":9,"last update":"Sun Oct 8 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66100000000000003,"15min":0.68100000000000005},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0860000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.63400000000000001}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.53900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.755,"15min":0.755},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.006,"15min":1.006},"last":0.624}]},{"osd":11,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.82199999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68799999999999994}]}]},{"osd":2,"up_from":19,"seq":81604378694,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":498431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.46999999999999997},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63400000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.48199999999999998},"min":{"1min":0.42899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.71599999999999997}]},{"osd":1,"last update":"Sun Oct 8 08:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54900000000000004,"15min":0.50700000000000001},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.86299999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59799999999999998,"15min":0.53800000000000003},"min":{"1min":0.47999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89800000000000002,"5min":2.097,"15min":2.097},"last":0.77600000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.55200000000000005},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80500000000000005,"5min":3.6800000000000002,"15min":3.6800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.56000000000000005},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.50600000000000001,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.56399999999999995,"15min":0.51200000000000001},"min":{"1min":0.53800000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.60499999999999998},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82799999999999996,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63400000000000001,"15min":0.60399999999999998},"min":{"1min":0.52200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73099999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.874}]},{"osd":8,"last update":"Sun Oct 8 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.61499999999999999,"15min":0.58299999999999996},"min":{"1min":0.497,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88400000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95899999999999996,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80300000000000005}]},{"osd":9,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.76400000000000001,"15min":0.74099999999999999},"min":{"1min":0.70299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.995,"5min":1.02,"15min":1.02},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.77700000000000002,"15min":0.745},"min":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97299999999999998,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.90200000000000002}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.79300000000000004},"min":{"1min":0.59299999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.109,"15min":2.109},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.72299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.92100000000000004}]},{"osd":11,"last update":"Sun Oct 8 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.95399999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":492716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.35299999999999998},"min":{"1min":0.27000000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.39300000000000002,"15min":0.36099999999999999},"min":{"1min":0.26200000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51700000000000002,"5min":1.889,"15min":1.889},"last":2.5449999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71599999999999997,"5min":0.996,"15min":0.996},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59599999999999997,"15min":0.52600000000000002},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":3.6930000000000001}]},{"osd":2,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57199999999999995,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82499999999999996,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.86299999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":1.927,"15min":1.927},"last":5.2539999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":0.94099999999999995}]},{"osd":5,"last update":"Sun Oct 8 08:43:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":1.992,"15min":1.992},"last":5.827},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81699999999999995,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":5.6360000000000001}]},{"osd":6,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48299999999999998,"15min":0.47499999999999998},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69499999999999995,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.014},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52000000000000002,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93899999999999995,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":6.2300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.92300000000000004}]},{"osd":8,"last update":"Sun Oct 8 08:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]},{"osd":9,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.66000000000000003,"15min":0.71999999999999997},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":1.712,"15min":1.712},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71199999999999997,"15min":0.76300000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":6.5209999999999999}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96199999999999997,"5min":2.339,"15min":2.339},"last":6.915},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89800000000000002,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.96499999999999997}]},{"osd":11,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.0329999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920830,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":493317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67700000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77000000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.35899999999999999},"min":{"1min":0.314,"5min":0.247,"15min":0.247},"max":{"1min":0.53800000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.37},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.371},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54300000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.41899999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.54000000000000004,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77500000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.62},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.51300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71299999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.57399999999999995,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.52000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.61099999999999999},"min":{"1min":0.52500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.874,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sun Oct 8 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84099999999999997,"5min":0.88,"15min":0.88},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83499999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79900000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69199999999999995}]},{"osd":8,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.55100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85799999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72899999999999998,"15min":0.71199999999999997},"min":{"1min":0.63800000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99099999999999999,"5min":1.05,"15min":1.05},"last":0.76100000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.50900000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":1.03,"15min":1.03},"last":0.72199999999999998}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.81699999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.748}]},{"osd":11,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79300000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757305,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1626112,"data_stored":1085805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":0.871,"15min":0.871},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.47199999999999998},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86899999999999999,"5min":0.871,"15min":0.871},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75800000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42299999999999999,"15min":0.39100000000000001},"min":{"1min":0.35799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.438,"15min":0.40999999999999998},"min":{"1min":0.35399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64700000000000002,"5min":0.748,"15min":0.748},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.50600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.51500000000000001},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.752,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.623,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81899999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91300000000000003,"5min":1.006,"15min":1.006},"last":0.72899999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89800000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.68400000000000005,"15min":0.66400000000000003},"min":{"1min":0.55300000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78000000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.436,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.629},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95499999999999996,"5min":1.006,"15min":1.006},"last":0.61299999999999999}]},{"osd":9,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.748,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.63100000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98699999999999999,"5min":1.038,"15min":1.038},"last":0.93000000000000005}]},{"osd":10,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77800000000000002,"15min":0.76500000000000001},"min":{"1min":0.57699999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.032},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.74399999999999999,"15min":0.73599999999999999},"min":{"1min":0.62,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93899999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T08:43:48.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T08:43:48.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:48 smithi191 ceph-mon[104220]: pgmap v290: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-08T08:43:48.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:48 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1211807687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:48.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:48 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/237838273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:48.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:48 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1077347797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:48.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.948+0000 7ff736523700 1 -- 172.21.15.70:0/1005348299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300fff00 msgr2=0x7ff73010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.948+0000 7ff736523700 1 --2- 172.21.15.70:0/1005348299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300fff00 0x7ff73010c3c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff72800b0d0 tx=0x7ff72800b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.949+0000 7ff736523700 1 -- 172.21.15.70:0/1005348299 shutdown_connections 2023-10-08T08:43:48.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.949+0000 7ff736523700 1 --2- 172.21.15.70:0/1005348299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300fff00 0x7ff73010c3c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.949+0000 7ff736523700 1 --2- 172.21.15.70:0/1005348299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff730105600 0x7ff7301059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.949+0000 7ff736523700 1 --2- 172.21.15.70:0/1005348299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7300ff540 0x7ff7300ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.949+0000 7ff736523700 1 -- 172.21.15.70:0/1005348299 >> 172.21.15.70:0/1005348299 conn(0x7ff7300fb030 msgr2=0x7ff7300fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:48.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.949+0000 7ff736523700 1 -- 172.21.15.70:0/1005348299 shutdown_connections 2023-10-08T08:43:48.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.949+0000 7ff736523700 1 -- 172.21.15.70:0/1005348299 wait complete. 2023-10-08T08:43:48.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.949+0000 7ff736523700 1 Processor -- start 2023-10-08T08:43:48.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.949+0000 7ff736523700 1 -- start start 2023-10-08T08:43:48.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff736523700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300ff540 0x7ff730195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff736523700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7300fff00 0x7ff730195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff736523700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff730105600 0x7ff73019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff736523700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73019a910 con 0x7ff7300ff540 2023-10-08T08:43:48.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff736523700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73019aa80 con 0x7ff730105600 2023-10-08T08:43:48.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff736523700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73019ac40 con 0x7ff7300fff00 2023-10-08T08:43:48.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff72ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300ff540 0x7ff730195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff72ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300ff540 0x7ff730195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51052/0 (socket says 172.21.15.70:51052) 2023-10-08T08:43:48.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff72ffff700 1 -- 172.21.15.70:0/2644448522 learned_addr learned my addr 172.21.15.70:0/2644448522 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:48.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff72ffff700 1 -- 172.21.15.70:0/2644448522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7300fff00 msgr2=0x7ff730195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff72ffff700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7300fff00 0x7ff730195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff72ffff700 1 -- 172.21.15.70:0/2644448522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff730105600 msgr2=0x7ff73019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:48.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff72ffff700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff730105600 0x7ff73019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff72ffff700 1 -- 172.21.15.70:0/2644448522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff728009d00 con 0x7ff7300ff540 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.950+0000 7ff72ffff700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300ff540 0x7ff730195a80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff72000d950 tx=0x7ff72000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.951+0000 7ff72d7fa700 1 -- 172.21.15.70:0/2644448522 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720009b40 con 0x7ff7300ff540 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.951+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73019af20 con 0x7ff7300ff540 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.951+0000 7ff72d7fa700 1 -- 172.21.15.70:0/2644448522 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff720009ca0 con 0x7ff7300ff540 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.951+0000 7ff72d7fa700 1 -- 172.21.15.70:0/2644448522 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000f620 con 0x7ff7300ff540 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.951+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7301a27d0 con 0x7ff7300ff540 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.951+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff730100c60 con 0x7ff7300ff540 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.953+0000 7ff72d7fa700 1 -- 172.21.15.70:0/2644448522 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7ff720010460 con 0x7ff7300ff540 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.953+0000 7ff72d7fa700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7180a14d0 0x7ff7180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.953+0000 7ff72d7fa700 1 -- 172.21.15.70:0/2644448522 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ff7200cd510 con 0x7ff7300ff540 2023-10-08T08:43:48.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.953+0000 7ff72f7fe700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7180a14d0 0x7ff7180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:48.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.954+0000 7ff72f7fe700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7180a14d0 0x7ff7180a3990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff730196f80 tx=0x7ff724005c80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:48.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:48.957+0000 7ff72d7fa700 1 -- 172.21.15.70:0/2644448522 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff720096780 con 0x7ff7300ff540 2023-10-08T08:43:49.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.145+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff73010f460 con 0x7ff7180a14d0 2023-10-08T08:43:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.157+0000 7ff72d7fa700 1 -- 172.21.15.70:0/2644448522 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427787 (secure 0 0 0) 0x7ff73010f460 con 0x7ff7180a14d0 2023-10-08T08:43:49.163 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:49.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7180a14d0 msgr2=0x7ff7180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7180a14d0 0x7ff7180a3990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff730196f80 tx=0x7ff724005c80 comp rx=0 tx=0).stop 2023-10-08T08:43:49.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300ff540 msgr2=0x7ff730195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300ff540 0x7ff730195a80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff72000d950 tx=0x7ff72000dd10 comp rx=0 tx=0).stop 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 shutdown_connections 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7ff7180a14d0 0x7ff7180a3990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff730105600 0x7ff73019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7300ff540 0x7ff730195a80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 --2- 172.21.15.70:0/2644448522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7300fff00 0x7ff730195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 >> 172.21.15.70:0/2644448522 conn(0x7ff7300fb030 msgr2=0x7ff7300fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 shutdown_connections 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.161+0000 7ff736523700 1 -- 172.21.15.70:0/2644448522 wait complete. 2023-10-08T08:43:49.168 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-10-08T08:43:49.174 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-10-08T08:43:49.076259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600892,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":930,"num_read_kb":534,"num_write":392,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337964,"kb_used_data":13688,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603860,"statfs":{"total":1151940427776,"available":1151594352640,"internally_reserved":0,"allocated":14016512,"data_stored":7713489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":260,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002843"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275511+0000","last_change":"2023-10-08T08:42:01.146976+0000","last_active":"2023-10-08T08:42:39.275511+0000","last_peered":"2023-10-08T08:42:39.275511+0000","last_clean":"2023-10-08T08:42:39.275511+0000","last_became_active":"2023-10-08T08:42:01.146184+0000","last_became_peered":"2023-10-08T08:42:01.146184+0000","last_unstale":"2023-10-08T08:42:39.275511+0000","last_undegraded":"2023-10-08T08:42:39.275511+0000","last_fullsized":"2023-10-08T08:42:39.275511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:35.571911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273896+0000","last_change":"2023-10-08T08:42:01.142007+0000","last_active":"2023-10-08T08:42:39.273896+0000","last_peered":"2023-10-08T08:42:39.273896+0000","last_clean":"2023-10-08T08:42:39.273896+0000","last_became_active":"2023-10-08T08:42:01.141630+0000","last_became_peered":"2023-10-08T08:42:01.141630+0000","last_unstale":"2023-10-08T08:42:39.273896+0000","last_undegraded":"2023-10-08T08:42:39.273896+0000","last_fullsized":"2023-10-08T08:42:39.273896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:53.307828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272914+0000","last_change":"2023-10-08T08:42:01.154742+0000","last_active":"2023-10-08T08:42:39.272914+0000","last_peered":"2023-10-08T08:42:39.272914+0000","last_clean":"2023-10-08T08:42:39.272914+0000","last_became_active":"2023-10-08T08:42:01.154439+0000","last_became_peered":"2023-10-08T08:42:01.154439+0000","last_unstale":"2023-10-08T08:42:39.272914+0000","last_undegraded":"2023-10-08T08:42:39.272914+0000","last_fullsized":"2023-10-08T08:42:39.272914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:23.990594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270927+0000","last_change":"2023-10-08T08:42:01.149940+0000","last_active":"2023-10-08T08:42:39.270927+0000","last_peered":"2023-10-08T08:42:39.270927+0000","last_clean":"2023-10-08T08:42:39.270927+0000","last_became_active":"2023-10-08T08:42:01.149628+0000","last_became_peered":"2023-10-08T08:42:01.149628+0000","last_unstale":"2023-10-08T08:42:39.270927+0000","last_undegraded":"2023-10-08T08:42:39.270927+0000","last_fullsized":"2023-10-08T08:42:39.270927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:38.961102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272780+0000","last_change":"2023-10-08T08:42:01.145396+0000","last_active":"2023-10-08T08:42:39.272780+0000","last_peered":"2023-10-08T08:42:39.272780+0000","last_clean":"2023-10-08T08:42:39.272780+0000","last_became_active":"2023-10-08T08:42:01.140511+0000","last_became_peered":"2023-10-08T08:42:01.140511+0000","last_unstale":"2023-10-08T08:42:39.272780+0000","last_undegraded":"2023-10-08T08:42:39.272780+0000","last_fullsized":"2023-10-08T08:42:39.272780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:38.079768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273059+0000","last_change":"2023-10-08T08:42:01.128798+0000","last_active":"2023-10-08T08:42:39.273059+0000","last_peered":"2023-10-08T08:42:39.273059+0000","last_clean":"2023-10-08T08:42:39.273059+0000","last_became_active":"2023-10-08T08:42:01.128485+0000","last_became_peered":"2023-10-08T08:42:01.128485+0000","last_unstale":"2023-10-08T08:42:39.273059+0000","last_undegraded":"2023-10-08T08:42:39.273059+0000","last_fullsized":"2023-10-08T08:42:39.273059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:33:59.121551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277231+0000","last_change":"2023-10-08T08:42:01.136315+0000","last_active":"2023-10-08T08:42:39.277231+0000","last_peered":"2023-10-08T08:42:39.277231+0000","last_clean":"2023-10-08T08:42:39.277231+0000","last_became_active":"2023-10-08T08:42:01.136025+0000","last_became_peered":"2023-10-08T08:42:01.136025+0000","last_unstale":"2023-10-08T08:42:39.277231+0000","last_undegraded":"2023-10-08T08:42:39.277231+0000","last_fullsized":"2023-10-08T08:42:39.277231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:35.675920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269573+0000","last_change":"2023-10-08T08:42:01.129839+0000","last_active":"2023-10-08T08:42:39.269573+0000","last_peered":"2023-10-08T08:42:39.269573+0000","last_clean":"2023-10-08T08:42:39.269573+0000","last_became_active":"2023-10-08T08:42:01.129524+0000","last_became_peered":"2023-10-08T08:42:01.129524+0000","last_unstale":"2023-10-08T08:42:39.269573+0000","last_undegraded":"2023-10-08T08:42:39.269573+0000","last_fullsized":"2023-10-08T08:42:39.269573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:44.463024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276906+0000","last_change":"2023-10-08T08:42:01.135304+0000","last_active":"2023-10-08T08:42:39.276906+0000","last_peered":"2023-10-08T08:42:39.276906+0000","last_clean":"2023-10-08T08:42:39.276906+0000","last_became_active":"2023-10-08T08:42:01.134978+0000","last_became_peered":"2023-10-08T08:42:01.134978+0000","last_unstale":"2023-10-08T08:42:39.276906+0000","last_undegraded":"2023-10-08T08:42:39.276906+0000","last_fullsized":"2023-10-08T08:42:39.276906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:46:03.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273758+0000","last_change":"2023-10-08T08:42:01.134686+0000","last_active":"2023-10-08T08:42:39.273758+0000","last_peered":"2023-10-08T08:42:39.273758+0000","last_clean":"2023-10-08T08:42:39.273758+0000","last_became_active":"2023-10-08T08:42:01.134360+0000","last_became_peered":"2023-10-08T08:42:01.134360+0000","last_unstale":"2023-10-08T08:42:39.273758+0000","last_undegraded":"2023-10-08T08:42:39.273758+0000","last_fullsized":"2023-10-08T08:42:39.273758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:56.814182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278374+0000","last_change":"2023-10-08T08:42:01.148309+0000","last_active":"2023-10-08T08:42:39.278374+0000","last_peered":"2023-10-08T08:42:39.278374+0000","last_clean":"2023-10-08T08:42:39.278374+0000","last_became_active":"2023-10-08T08:42:01.147964+0000","last_became_peered":"2023-10-08T08:42:01.147964+0000","last_unstale":"2023-10-08T08:42:39.278374+0000","last_undegraded":"2023-10-08T08:42:39.278374+0000","last_fullsized":"2023-10-08T08:42:39.278374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:45.418572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270831+0000","last_change":"2023-10-08T08:42:01.148141+0000","last_active":"2023-10-08T08:42:39.270831+0000","last_peered":"2023-10-08T08:42:39.270831+0000","last_clean":"2023-10-08T08:42:39.270831+0000","last_became_active":"2023-10-08T08:42:01.147788+0000","last_became_peered":"2023-10-08T08:42:01.147788+0000","last_unstale":"2023-10-08T08:42:39.270831+0000","last_undegraded":"2023-10-08T08:42:39.270831+0000","last_fullsized":"2023-10-08T08:42:39.270831+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:37.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696516+0000","last_change":"2023-10-08T08:42:40.696516+0000","last_active":"2023-10-08T08:42:40.696516+0000","last_peered":"2023-10-08T08:42:40.696516+0000","last_clean":"2023-10-08T08:42:40.696516+0000","last_became_active":"2023-10-08T08:42:40.696193+0000","last_became_peered":"2023-10-08T08:42:40.696193+0000","last_unstale":"2023-10-08T08:42:40.696516+0000","last_undegraded":"2023-10-08T08:42:40.696516+0000","last_fullsized":"2023-10-08T08:42:40.696516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:40:57.843021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:01.148031+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:01.147785+0000","last_became_peered":"2023-10-08T08:42:01.147785+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:43.702638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272901+0000","last_change":"2023-10-08T08:42:01.154669+0000","last_active":"2023-10-08T08:42:39.272901+0000","last_peered":"2023-10-08T08:42:39.272901+0000","last_clean":"2023-10-08T08:42:39.272901+0000","last_became_active":"2023-10-08T08:42:01.154385+0000","last_became_peered":"2023-10-08T08:42:01.154385+0000","last_unstale":"2023-10-08T08:42:39.272901+0000","last_undegraded":"2023-10-08T08:42:39.272901+0000","last_fullsized":"2023-10-08T08:42:39.272901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:41.654979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275659+0000","last_change":"2023-10-08T08:42:01.143017+0000","last_active":"2023-10-08T08:42:39.275659+0000","last_peered":"2023-10-08T08:42:39.275659+0000","last_clean":"2023-10-08T08:42:39.275659+0000","last_became_active":"2023-10-08T08:42:01.142728+0000","last_became_peered":"2023-10-08T08:42:01.142728+0000","last_unstale":"2023-10-08T08:42:39.275659+0000","last_undegraded":"2023-10-08T08:42:39.275659+0000","last_fullsized":"2023-10-08T08:42:39.275659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.303212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275414+0000","last_change":"2023-10-08T08:42:01.147335+0000","last_active":"2023-10-08T08:42:39.275414+0000","last_peered":"2023-10-08T08:42:39.275414+0000","last_clean":"2023-10-08T08:42:39.275414+0000","last_became_active":"2023-10-08T08:42:01.146641+0000","last_became_peered":"2023-10-08T08:42:01.146641+0000","last_unstale":"2023-10-08T08:42:39.275414+0000","last_undegraded":"2023-10-08T08:42:39.275414+0000","last_fullsized":"2023-10-08T08:42:39.275414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:27.274207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275754+0000","last_change":"2023-10-08T08:42:01.132417+0000","last_active":"2023-10-08T08:42:39.275754+0000","last_peered":"2023-10-08T08:42:39.275754+0000","last_clean":"2023-10-08T08:42:39.275754+0000","last_became_active":"2023-10-08T08:42:01.132135+0000","last_became_peered":"2023-10-08T08:42:01.132135+0000","last_unstale":"2023-10-08T08:42:39.275754+0000","last_undegraded":"2023-10-08T08:42:39.275754+0000","last_fullsized":"2023-10-08T08:42:39.275754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:11.916677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279495+0000","last_change":"2023-10-08T08:42:01.136100+0000","last_active":"2023-10-08T08:42:39.279495+0000","last_peered":"2023-10-08T08:42:39.279495+0000","last_clean":"2023-10-08T08:42:39.279495+0000","last_became_active":"2023-10-08T08:42:01.135826+0000","last_became_peered":"2023-10-08T08:42:01.135826+0000","last_unstale":"2023-10-08T08:42:39.279495+0000","last_undegraded":"2023-10-08T08:42:39.279495+0000","last_fullsized":"2023-10-08T08:42:39.279495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:03.734296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279138+0000","last_change":"2023-10-08T08:42:05.177765+0000","last_active":"2023-10-08T08:42:39.279138+0000","last_peered":"2023-10-08T08:42:39.279138+0000","last_clean":"2023-10-08T08:42:39.279138+0000","last_became_active":"2023-10-08T08:42:05.177362+0000","last_became_peered":"2023-10-08T08:42:05.177362+0000","last_unstale":"2023-10-08T08:42:39.279138+0000","last_undegraded":"2023-10-08T08:42:39.279138+0000","last_fullsized":"2023-10-08T08:42:39.279138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:21.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":109,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.197326+0000","last_change":"2023-10-08T08:42:00.111581+0000","last_active":"2023-10-08T08:43:43.197326+0000","last_peered":"2023-10-08T08:43:43.197326+0000","last_clean":"2023-10-08T08:43:43.197326+0000","last_became_active":"2023-10-08T08:42:00.111298+0000","last_became_peered":"2023-10-08T08:42:00.111298+0000","last_unstale":"2023-10-08T08:43:43.197326+0000","last_undegraded":"2023-10-08T08:43:43.197326+0000","last_fullsized":"2023-10-08T08:43:43.197326+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:52:39.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270526+0000","last_change":"2023-10-08T08:42:01.134630+0000","last_active":"2023-10-08T08:42:39.270526+0000","last_peered":"2023-10-08T08:42:39.270526+0000","last_clean":"2023-10-08T08:42:39.270526+0000","last_became_active":"2023-10-08T08:42:01.134347+0000","last_became_peered":"2023-10-08T08:42:01.134347+0000","last_unstale":"2023-10-08T08:42:39.270526+0000","last_undegraded":"2023-10-08T08:42:39.270526+0000","last_fullsized":"2023-10-08T08:42:39.270526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:51:14.364756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270287+0000","last_change":"2023-10-08T08:42:05.177223+0000","last_active":"2023-10-08T08:42:39.270287+0000","last_peered":"2023-10-08T08:42:39.270287+0000","last_clean":"2023-10-08T08:42:39.270287+0000","last_became_active":"2023-10-08T08:42:05.176811+0000","last_became_peered":"2023-10-08T08:42:05.176811+0000","last_unstale":"2023-10-08T08:42:39.270287+0000","last_undegraded":"2023-10-08T08:42:39.270287+0000","last_fullsized":"2023-10-08T08:42:39.270287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:41.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270575+0000","last_change":"2023-10-08T08:42:00.115860+0000","last_active":"2023-10-08T08:42:39.270575+0000","last_peered":"2023-10-08T08:42:39.270575+0000","last_clean":"2023-10-08T08:42:39.270575+0000","last_became_active":"2023-10-08T08:42:00.115601+0000","last_became_peered":"2023-10-08T08:42:00.115601+0000","last_unstale":"2023-10-08T08:42:39.270575+0000","last_undegraded":"2023-10-08T08:42:39.270575+0000","last_fullsized":"2023-10-08T08:42:39.270575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:20.071545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274100+0000","last_change":"2023-10-08T08:42:01.146648+0000","last_active":"2023-10-08T08:42:39.274100+0000","last_peered":"2023-10-08T08:42:39.274100+0000","last_clean":"2023-10-08T08:42:39.274100+0000","last_became_active":"2023-10-08T08:42:01.145978+0000","last_became_peered":"2023-10-08T08:42:01.145978+0000","last_unstale":"2023-10-08T08:42:39.274100+0000","last_undegraded":"2023-10-08T08:42:39.274100+0000","last_fullsized":"2023-10-08T08:42:39.274100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:55.768519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270396+0000","last_change":"2023-10-08T08:42:05.185079+0000","last_active":"2023-10-08T08:42:39.270396+0000","last_peered":"2023-10-08T08:42:39.270396+0000","last_clean":"2023-10-08T08:42:39.270396+0000","last_became_active":"2023-10-08T08:42:05.184521+0000","last_became_peered":"2023-10-08T08:42:05.184521+0000","last_unstale":"2023-10-08T08:42:39.270396+0000","last_undegraded":"2023-10-08T08:42:39.270396+0000","last_fullsized":"2023-10-08T08:42:39.270396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:39:17.457051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273959+0000","last_change":"2023-10-08T08:42:00.112111+0000","last_active":"2023-10-08T08:42:39.273959+0000","last_peered":"2023-10-08T08:42:39.273959+0000","last_clean":"2023-10-08T08:42:39.273959+0000","last_became_active":"2023-10-08T08:42:00.111808+0000","last_became_peered":"2023-10-08T08:42:00.111808+0000","last_unstale":"2023-10-08T08:42:39.273959+0000","last_undegraded":"2023-10-08T08:42:39.273959+0000","last_fullsized":"2023-10-08T08:42:39.273959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:03.022378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276049+0000","last_change":"2023-10-08T08:42:01.133308+0000","last_active":"2023-10-08T08:42:39.276049+0000","last_peered":"2023-10-08T08:42:39.276049+0000","last_clean":"2023-10-08T08:42:39.276049+0000","last_became_active":"2023-10-08T08:42:01.131649+0000","last_became_peered":"2023-10-08T08:42:01.131649+0000","last_unstale":"2023-10-08T08:42:39.276049+0000","last_undegraded":"2023-10-08T08:42:39.276049+0000","last_fullsized":"2023-10-08T08:42:39.276049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:05.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270293+0000","last_change":"2023-10-08T08:42:05.182409+0000","last_active":"2023-10-08T08:42:39.270293+0000","last_peered":"2023-10-08T08:42:39.270293+0000","last_clean":"2023-10-08T08:42:39.270293+0000","last_became_active":"2023-10-08T08:42:05.181974+0000","last_became_peered":"2023-10-08T08:42:05.181974+0000","last_unstale":"2023-10-08T08:42:39.270293+0000","last_undegraded":"2023-10-08T08:42:39.270293+0000","last_fullsized":"2023-10-08T08:42:39.270293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:05.821339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273251+0000","last_change":"2023-10-08T08:42:00.113287+0000","last_active":"2023-10-08T08:42:39.273251+0000","last_peered":"2023-10-08T08:42:39.273251+0000","last_clean":"2023-10-08T08:42:39.273251+0000","last_became_active":"2023-10-08T08:42:00.112996+0000","last_became_peered":"2023-10-08T08:42:00.112996+0000","last_unstale":"2023-10-08T08:42:39.273251+0000","last_undegraded":"2023-10-08T08:42:39.273251+0000","last_fullsized":"2023-10-08T08:42:39.273251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:42.559360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276426+0000","last_change":"2023-10-08T08:42:01.139763+0000","last_active":"2023-10-08T08:42:39.276426+0000","last_peered":"2023-10-08T08:42:39.276426+0000","last_clean":"2023-10-08T08:42:39.276426+0000","last_became_active":"2023-10-08T08:42:01.139451+0000","last_became_peered":"2023-10-08T08:42:01.139451+0000","last_unstale":"2023-10-08T08:42:39.276426+0000","last_undegraded":"2023-10-08T08:42:39.276426+0000","last_fullsized":"2023-10-08T08:42:39.276426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:10.166151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279067+0000","last_change":"2023-10-08T08:42:05.174612+0000","last_active":"2023-10-08T08:42:39.279067+0000","last_peered":"2023-10-08T08:42:39.279067+0000","last_clean":"2023-10-08T08:42:39.279067+0000","last_became_active":"2023-10-08T08:42:05.174174+0000","last_became_peered":"2023-10-08T08:42:05.174174+0000","last_unstale":"2023-10-08T08:42:39.279067+0000","last_undegraded":"2023-10-08T08:42:39.279067+0000","last_fullsized":"2023-10-08T08:42:39.279067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:07.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.192622+0000","last_change":"2023-10-08T08:42:00.112537+0000","last_active":"2023-10-08T08:43:43.192622+0000","last_peered":"2023-10-08T08:43:43.192622+0000","last_clean":"2023-10-08T08:43:43.192622+0000","last_became_active":"2023-10-08T08:42:00.112060+0000","last_became_peered":"2023-10-08T08:42:00.112060+0000","last_unstale":"2023-10-08T08:43:43.192622+0000","last_undegraded":"2023-10-08T08:43:43.192622+0000","last_fullsized":"2023-10-08T08:43:43.192622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:41.878960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273799+0000","last_change":"2023-10-08T08:42:01.146929+0000","last_active":"2023-10-08T08:42:39.273799+0000","last_peered":"2023-10-08T08:42:39.273799+0000","last_clean":"2023-10-08T08:42:39.273799+0000","last_became_active":"2023-10-08T08:42:01.145980+0000","last_became_peered":"2023-10-08T08:42:01.145980+0000","last_unstale":"2023-10-08T08:42:39.273799+0000","last_undegraded":"2023-10-08T08:42:39.273799+0000","last_fullsized":"2023-10-08T08:42:39.273799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:37.411832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.443543+0000","last_change":"2023-10-08T08:42:40.443543+0000","last_active":"2023-10-08T08:42:40.443543+0000","last_peered":"2023-10-08T08:42:40.443543+0000","last_clean":"2023-10-08T08:42:40.443543+0000","last_became_active":"2023-10-08T08:42:40.443041+0000","last_became_peered":"2023-10-08T08:42:40.443041+0000","last_unstale":"2023-10-08T08:42:40.443543+0000","last_undegraded":"2023-10-08T08:42:40.443543+0000","last_fullsized":"2023-10-08T08:42:40.443543+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:21:35.827659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:00.115656+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:00.115342+0000","last_became_peered":"2023-10-08T08:42:00.115342+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:32.630853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277813+0000","last_change":"2023-10-08T08:42:01.139137+0000","last_active":"2023-10-08T08:42:39.277813+0000","last_peered":"2023-10-08T08:42:39.277813+0000","last_clean":"2023-10-08T08:42:39.277813+0000","last_became_active":"2023-10-08T08:42:01.138510+0000","last_became_peered":"2023-10-08T08:42:01.138510+0000","last_unstale":"2023-10-08T08:42:39.277813+0000","last_undegraded":"2023-10-08T08:42:39.277813+0000","last_fullsized":"2023-10-08T08:42:39.277813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:16:28.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275308+0000","last_change":"2023-10-08T08:42:05.179770+0000","last_active":"2023-10-08T08:42:39.275308+0000","last_peered":"2023-10-08T08:42:39.275308+0000","last_clean":"2023-10-08T08:42:39.275308+0000","last_became_active":"2023-10-08T08:42:05.179312+0000","last_became_peered":"2023-10-08T08:42:05.179312+0000","last_unstale":"2023-10-08T08:42:39.275308+0000","last_undegraded":"2023-10-08T08:42:39.275308+0000","last_fullsized":"2023-10-08T08:42:39.275308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.947270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276681+0000","last_change":"2023-10-08T08:42:00.111299+0000","last_active":"2023-10-08T08:42:39.276681+0000","last_peered":"2023-10-08T08:42:39.276681+0000","last_clean":"2023-10-08T08:42:39.276681+0000","last_became_active":"2023-10-08T08:42:00.110966+0000","last_became_peered":"2023-10-08T08:42:00.110966+0000","last_unstale":"2023-10-08T08:42:39.276681+0000","last_undegraded":"2023-10-08T08:42:39.276681+0000","last_fullsized":"2023-10-08T08:42:39.276681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:34.211598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269504+0000","last_change":"2023-10-08T08:42:01.134205+0000","last_active":"2023-10-08T08:42:39.269504+0000","last_peered":"2023-10-08T08:42:39.269504+0000","last_clean":"2023-10-08T08:42:39.269504+0000","last_became_active":"2023-10-08T08:42:01.133887+0000","last_became_peered":"2023-10-08T08:42:01.133887+0000","last_unstale":"2023-10-08T08:42:39.269504+0000","last_undegraded":"2023-10-08T08:42:39.269504+0000","last_fullsized":"2023-10-08T08:42:39.269504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:01.807150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273842+0000","last_change":"2023-10-08T08:42:05.179119+0000","last_active":"2023-10-08T08:42:39.273842+0000","last_peered":"2023-10-08T08:42:39.273842+0000","last_clean":"2023-10-08T08:42:39.273842+0000","last_became_active":"2023-10-08T08:42:05.178712+0000","last_became_peered":"2023-10-08T08:42:05.178712+0000","last_unstale":"2023-10-08T08:42:39.273842+0000","last_undegraded":"2023-10-08T08:42:39.273842+0000","last_fullsized":"2023-10-08T08:42:39.273842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:54:38.514047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278470+0000","last_change":"2023-10-08T08:42:00.116426+0000","last_active":"2023-10-08T08:42:39.278470+0000","last_peered":"2023-10-08T08:42:39.278470+0000","last_clean":"2023-10-08T08:42:39.278470+0000","last_became_active":"2023-10-08T08:42:00.115313+0000","last_became_peered":"2023-10-08T08:42:00.115313+0000","last_unstale":"2023-10-08T08:42:39.278470+0000","last_undegraded":"2023-10-08T08:42:39.278470+0000","last_fullsized":"2023-10-08T08:42:39.278470+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:42.989380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275493+0000","last_change":"2023-10-08T08:42:01.129719+0000","last_active":"2023-10-08T08:42:39.275493+0000","last_peered":"2023-10-08T08:42:39.275493+0000","last_clean":"2023-10-08T08:42:39.275493+0000","last_became_active":"2023-10-08T08:42:01.129293+0000","last_became_peered":"2023-10-08T08:42:01.129293+0000","last_unstale":"2023-10-08T08:42:39.275493+0000","last_undegraded":"2023-10-08T08:42:39.275493+0000","last_fullsized":"2023-10-08T08:42:39.275493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:35.463614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269587+0000","last_change":"2023-10-08T08:42:05.172880+0000","last_active":"2023-10-08T08:42:39.269587+0000","last_peered":"2023-10-08T08:42:39.269587+0000","last_clean":"2023-10-08T08:42:39.269587+0000","last_became_active":"2023-10-08T08:42:05.172485+0000","last_became_peered":"2023-10-08T08:42:05.172485+0000","last_unstale":"2023-10-08T08:42:39.269587+0000","last_undegraded":"2023-10-08T08:42:39.269587+0000","last_fullsized":"2023-10-08T08:42:39.269587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:29.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.214391+0000","last_change":"2023-10-08T08:42:00.115206+0000","last_active":"2023-10-08T08:43:43.214391+0000","last_peered":"2023-10-08T08:43:43.214391+0000","last_clean":"2023-10-08T08:43:43.214391+0000","last_became_active":"2023-10-08T08:42:00.114905+0000","last_became_peered":"2023-10-08T08:42:00.114905+0000","last_unstale":"2023-10-08T08:43:43.214391+0000","last_undegraded":"2023-10-08T08:43:43.214391+0000","last_fullsized":"2023-10-08T08:43:43.214391+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:09.275317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276638+0000","last_change":"2023-10-08T08:42:01.141422+0000","last_active":"2023-10-08T08:42:39.276638+0000","last_peered":"2023-10-08T08:42:39.276638+0000","last_clean":"2023-10-08T08:42:39.276638+0000","last_became_active":"2023-10-08T08:42:01.140979+0000","last_became_peered":"2023-10-08T08:42:01.140979+0000","last_unstale":"2023-10-08T08:42:39.276638+0000","last_undegraded":"2023-10-08T08:42:39.276638+0000","last_fullsized":"2023-10-08T08:42:39.276638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:14.018786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275152+0000","last_change":"2023-10-08T08:42:05.184358+0000","last_active":"2023-10-08T08:42:39.275152+0000","last_peered":"2023-10-08T08:42:39.275152+0000","last_clean":"2023-10-08T08:42:39.275152+0000","last_became_active":"2023-10-08T08:42:05.183994+0000","last_became_peered":"2023-10-08T08:42:05.183994+0000","last_unstale":"2023-10-08T08:42:39.275152+0000","last_undegraded":"2023-10-08T08:42:39.275152+0000","last_fullsized":"2023-10-08T08:42:39.275152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:46.465110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277535+0000","last_change":"2023-10-08T08:42:00.115765+0000","last_active":"2023-10-08T08:42:39.277535+0000","last_peered":"2023-10-08T08:42:39.277535+0000","last_clean":"2023-10-08T08:42:39.277535+0000","last_became_active":"2023-10-08T08:42:00.115288+0000","last_became_peered":"2023-10-08T08:42:00.115288+0000","last_unstale":"2023-10-08T08:42:39.277535+0000","last_undegraded":"2023-10-08T08:42:39.277535+0000","last_fullsized":"2023-10-08T08:42:39.277535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:20.973280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273767+0000","last_change":"2023-10-08T08:42:01.143290+0000","last_active":"2023-10-08T08:42:39.273767+0000","last_peered":"2023-10-08T08:42:39.273767+0000","last_clean":"2023-10-08T08:42:39.273767+0000","last_became_active":"2023-10-08T08:42:01.143034+0000","last_became_peered":"2023-10-08T08:42:01.143034+0000","last_unstale":"2023-10-08T08:42:39.273767+0000","last_undegraded":"2023-10-08T08:42:39.273767+0000","last_fullsized":"2023-10-08T08:42:39.273767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:45.784275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.271060+0000","last_change":"2023-10-08T08:42:05.185022+0000","last_active":"2023-10-08T08:42:39.271060+0000","last_peered":"2023-10-08T08:42:39.271060+0000","last_clean":"2023-10-08T08:42:39.271060+0000","last_became_active":"2023-10-08T08:42:05.184476+0000","last_became_peered":"2023-10-08T08:42:05.184476+0000","last_unstale":"2023-10-08T08:42:39.271060+0000","last_undegraded":"2023-10-08T08:42:39.271060+0000","last_fullsized":"2023-10-08T08:42:39.271060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:14:04.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276317+0000","last_change":"2023-10-08T08:42:00.115556+0000","last_active":"2023-10-08T08:42:39.276317+0000","last_peered":"2023-10-08T08:42:39.276317+0000","last_clean":"2023-10-08T08:42:39.276317+0000","last_became_active":"2023-10-08T08:42:00.115251+0000","last_became_peered":"2023-10-08T08:42:00.115251+0000","last_unstale":"2023-10-08T08:42:39.276317+0000","last_undegraded":"2023-10-08T08:42:39.276317+0000","last_fullsized":"2023-10-08T08:42:39.276317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:55.439502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276120+0000","last_change":"2023-10-08T08:42:01.135969+0000","last_active":"2023-10-08T08:42:39.276120+0000","last_peered":"2023-10-08T08:42:39.276120+0000","last_clean":"2023-10-08T08:42:39.276120+0000","last_became_active":"2023-10-08T08:42:01.135615+0000","last_became_peered":"2023-10-08T08:42:01.135615+0000","last_unstale":"2023-10-08T08:42:39.276120+0000","last_undegraded":"2023-10-08T08:42:39.276120+0000","last_fullsized":"2023-10-08T08:42:39.276120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:23.153920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276151+0000","last_change":"2023-10-08T08:42:05.177904+0000","last_active":"2023-10-08T08:42:39.276151+0000","last_peered":"2023-10-08T08:42:39.276151+0000","last_clean":"2023-10-08T08:42:39.276151+0000","last_became_active":"2023-10-08T08:42:05.176397+0000","last_became_peered":"2023-10-08T08:42:05.176397+0000","last_unstale":"2023-10-08T08:42:39.276151+0000","last_undegraded":"2023-10-08T08:42:39.276151+0000","last_fullsized":"2023-10-08T08:42:39.276151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:50.134974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'14","reported_seq":185,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.192090+0000","last_change":"2023-10-08T08:42:00.114485+0000","last_active":"2023-10-08T08:43:43.192090+0000","last_peered":"2023-10-08T08:43:43.192090+0000","last_clean":"2023-10-08T08:43:43.192090+0000","last_became_active":"2023-10-08T08:42:00.114186+0000","last_became_peered":"2023-10-08T08:42:00.114186+0000","last_unstale":"2023-10-08T08:43:43.192090+0000","last_undegraded":"2023-10-08T08:43:43.192090+0000","last_fullsized":"2023-10-08T08:43:43.192090+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:30.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":80,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273394+0000","last_change":"2023-10-08T08:42:01.146627+0000","last_active":"2023-10-08T08:42:39.273394+0000","last_peered":"2023-10-08T08:42:39.273394+0000","last_clean":"2023-10-08T08:42:39.273394+0000","last_became_active":"2023-10-08T08:42:01.146332+0000","last_became_peered":"2023-10-08T08:42:01.146332+0000","last_unstale":"2023-10-08T08:42:39.273394+0000","last_undegraded":"2023-10-08T08:42:39.273394+0000","last_fullsized":"2023-10-08T08:42:39.273394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:00.825191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278530+0000","last_change":"2023-10-08T08:42:05.173257+0000","last_active":"2023-10-08T08:42:39.278530+0000","last_peered":"2023-10-08T08:42:39.278530+0000","last_clean":"2023-10-08T08:42:39.278530+0000","last_became_active":"2023-10-08T08:42:05.172891+0000","last_became_peered":"2023-10-08T08:42:05.172891+0000","last_unstale":"2023-10-08T08:42:39.278530+0000","last_undegraded":"2023-10-08T08:42:39.278530+0000","last_fullsized":"2023-10-08T08:42:39.278530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:32.802194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279368+0000","last_change":"2023-10-08T08:42:00.113330+0000","last_active":"2023-10-08T08:42:39.279368+0000","last_peered":"2023-10-08T08:42:39.279368+0000","last_clean":"2023-10-08T08:42:39.279368+0000","last_became_active":"2023-10-08T08:42:00.112183+0000","last_became_peered":"2023-10-08T08:42:00.112183+0000","last_unstale":"2023-10-08T08:42:39.279368+0000","last_undegraded":"2023-10-08T08:42:39.279368+0000","last_fullsized":"2023-10-08T08:42:39.279368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:13.158570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275089+0000","last_change":"2023-10-08T08:42:01.133854+0000","last_active":"2023-10-08T08:42:39.275089+0000","last_peered":"2023-10-08T08:42:39.275089+0000","last_clean":"2023-10-08T08:42:39.275089+0000","last_became_active":"2023-10-08T08:42:01.133540+0000","last_became_peered":"2023-10-08T08:42:01.133540+0000","last_unstale":"2023-10-08T08:42:39.275089+0000","last_undegraded":"2023-10-08T08:42:39.275089+0000","last_fullsized":"2023-10-08T08:42:39.275089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:50.011909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275437+0000","last_change":"2023-10-08T08:42:05.180359+0000","last_active":"2023-10-08T08:42:39.275437+0000","last_peered":"2023-10-08T08:42:39.275437+0000","last_clean":"2023-10-08T08:42:39.275437+0000","last_became_active":"2023-10-08T08:42:05.179877+0000","last_became_peered":"2023-10-08T08:42:05.179877+0000","last_unstale":"2023-10-08T08:42:39.275437+0000","last_undegraded":"2023-10-08T08:42:39.275437+0000","last_fullsized":"2023-10-08T08:42:39.275437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:52.926297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276709+0000","last_change":"2023-10-08T08:42:00.112036+0000","last_active":"2023-10-08T08:42:39.276709+0000","last_peered":"2023-10-08T08:42:39.276709+0000","last_clean":"2023-10-08T08:42:39.276709+0000","last_became_active":"2023-10-08T08:42:00.111710+0000","last_became_peered":"2023-10-08T08:42:00.111710+0000","last_unstale":"2023-10-08T08:42:39.276709+0000","last_undegraded":"2023-10-08T08:42:39.276709+0000","last_fullsized":"2023-10-08T08:42:39.276709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:58:16.004802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277573+0000","last_change":"2023-10-08T08:42:01.135245+0000","last_active":"2023-10-08T08:42:39.277573+0000","last_peered":"2023-10-08T08:42:39.277573+0000","last_clean":"2023-10-08T08:42:39.277573+0000","last_became_active":"2023-10-08T08:42:01.134941+0000","last_became_peered":"2023-10-08T08:42:01.134941+0000","last_unstale":"2023-10-08T08:42:39.277573+0000","last_undegraded":"2023-10-08T08:42:39.277573+0000","last_fullsized":"2023-10-08T08:42:39.277573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:13.745895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.282736+0000","last_change":"2023-10-08T08:42:40.281786+0000","last_active":"2023-10-08T08:42:40.282736+0000","last_peered":"2023-10-08T08:42:40.282736+0000","last_clean":"2023-10-08T08:42:40.282736+0000","last_became_active":"2023-10-08T08:42:40.280780+0000","last_became_peered":"2023-10-08T08:42:40.280780+0000","last_unstale":"2023-10-08T08:42:40.282736+0000","last_undegraded":"2023-10-08T08:42:40.282736+0000","last_fullsized":"2023-10-08T08:42:40.282736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:49.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":103,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:44.194302+0000","last_change":"2023-10-08T08:42:00.112610+0000","last_active":"2023-10-08T08:43:44.194302+0000","last_peered":"2023-10-08T08:43:44.194302+0000","last_clean":"2023-10-08T08:43:44.194302+0000","last_became_active":"2023-10-08T08:42:00.112313+0000","last_became_peered":"2023-10-08T08:42:00.112313+0000","last_unstale":"2023-10-08T08:43:44.194302+0000","last_undegraded":"2023-10-08T08:43:44.194302+0000","last_fullsized":"2023-10-08T08:43:44.194302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:35.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277060+0000","last_change":"2023-10-08T08:42:01.141538+0000","last_active":"2023-10-08T08:42:39.277060+0000","last_peered":"2023-10-08T08:42:39.277060+0000","last_clean":"2023-10-08T08:42:39.277060+0000","last_became_active":"2023-10-08T08:42:01.141241+0000","last_became_peered":"2023-10-08T08:42:01.141241+0000","last_unstale":"2023-10-08T08:42:39.277060+0000","last_undegraded":"2023-10-08T08:42:39.277060+0000","last_fullsized":"2023-10-08T08:42:39.277060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:41.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275573+0000","last_change":"2023-10-08T08:42:05.181949+0000","last_active":"2023-10-08T08:42:39.275573+0000","last_peered":"2023-10-08T08:42:39.275573+0000","last_clean":"2023-10-08T08:42:39.275573+0000","last_became_active":"2023-10-08T08:42:05.181532+0000","last_became_peered":"2023-10-08T08:42:05.181532+0000","last_unstale":"2023-10-08T08:42:39.275573+0000","last_undegraded":"2023-10-08T08:42:39.275573+0000","last_fullsized":"2023-10-08T08:42:39.275573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:44.035004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272872+0000","last_change":"2023-10-08T08:42:00.111175+0000","last_active":"2023-10-08T08:42:39.272872+0000","last_peered":"2023-10-08T08:42:39.272872+0000","last_clean":"2023-10-08T08:42:39.272872+0000","last_became_active":"2023-10-08T08:42:00.109672+0000","last_became_peered":"2023-10-08T08:42:00.109672+0000","last_unstale":"2023-10-08T08:42:39.272872+0000","last_undegraded":"2023-10-08T08:42:39.272872+0000","last_fullsized":"2023-10-08T08:42:39.272872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:42.715127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278596+0000","last_change":"2023-10-08T08:42:01.133910+0000","last_active":"2023-10-08T08:42:39.278596+0000","last_peered":"2023-10-08T08:42:39.278596+0000","last_clean":"2023-10-08T08:42:39.278596+0000","last_became_active":"2023-10-08T08:42:01.132738+0000","last_became_peered":"2023-10-08T08:42:01.132738+0000","last_unstale":"2023-10-08T08:42:39.278596+0000","last_undegraded":"2023-10-08T08:42:39.278596+0000","last_fullsized":"2023-10-08T08:42:39.278596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:19.966595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276206+0000","last_change":"2023-10-08T08:42:05.177048+0000","last_active":"2023-10-08T08:42:39.276206+0000","last_peered":"2023-10-08T08:42:39.276206+0000","last_clean":"2023-10-08T08:42:39.276206+0000","last_became_active":"2023-10-08T08:42:05.176654+0000","last_became_peered":"2023-10-08T08:42:05.176654+0000","last_unstale":"2023-10-08T08:42:39.276206+0000","last_undegraded":"2023-10-08T08:42:39.276206+0000","last_fullsized":"2023-10-08T08:42:39.276206+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:22.424769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274788+0000","last_change":"2023-10-08T08:42:00.112684+0000","last_active":"2023-10-08T08:42:39.274788+0000","last_peered":"2023-10-08T08:42:39.274788+0000","last_clean":"2023-10-08T08:42:39.274788+0000","last_became_active":"2023-10-08T08:42:00.112235+0000","last_became_peered":"2023-10-08T08:42:00.112235+0000","last_unstale":"2023-10-08T08:42:39.274788+0000","last_undegraded":"2023-10-08T08:42:39.274788+0000","last_fullsized":"2023-10-08T08:42:39.274788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:47.984940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276005+0000","last_change":"2023-10-08T08:42:01.133393+0000","last_active":"2023-10-08T08:42:39.276005+0000","last_peered":"2023-10-08T08:42:39.276005+0000","last_clean":"2023-10-08T08:42:39.276005+0000","last_became_active":"2023-10-08T08:42:01.133121+0000","last_became_peered":"2023-10-08T08:42:01.133121+0000","last_unstale":"2023-10-08T08:42:39.276005+0000","last_undegraded":"2023-10-08T08:42:39.276005+0000","last_fullsized":"2023-10-08T08:42:39.276005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:54.542269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.281572+0000","last_change":"2023-10-08T08:42:40.281572+0000","last_active":"2023-10-08T08:42:40.281572+0000","last_peered":"2023-10-08T08:42:40.281572+0000","last_clean":"2023-10-08T08:42:40.281572+0000","last_became_active":"2023-10-08T08:42:40.280996+0000","last_became_peered":"2023-10-08T08:42:40.280996+0000","last_unstale":"2023-10-08T08:42:40.281572+0000","last_undegraded":"2023-10-08T08:42:40.281572+0000","last_fullsized":"2023-10-08T08:42:40.281572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:11:34.435906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277067+0000","last_change":"2023-10-08T08:42:00.110059+0000","last_active":"2023-10-08T08:42:39.277067+0000","last_peered":"2023-10-08T08:42:39.277067+0000","last_clean":"2023-10-08T08:42:39.277067+0000","last_became_active":"2023-10-08T08:42:00.109743+0000","last_became_peered":"2023-10-08T08:42:00.109743+0000","last_unstale":"2023-10-08T08:42:39.277067+0000","last_undegraded":"2023-10-08T08:42:39.277067+0000","last_fullsized":"2023-10-08T08:42:39.277067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:03:40.950213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273339+0000","last_change":"2023-10-08T08:42:01.133595+0000","last_active":"2023-10-08T08:42:39.273339+0000","last_peered":"2023-10-08T08:42:39.273339+0000","last_clean":"2023-10-08T08:42:39.273339+0000","last_became_active":"2023-10-08T08:42:01.133268+0000","last_became_peered":"2023-10-08T08:42:01.133268+0000","last_unstale":"2023-10-08T08:42:39.273339+0000","last_undegraded":"2023-10-08T08:42:39.273339+0000","last_fullsized":"2023-10-08T08:42:39.273339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:49.571517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276328+0000","last_change":"2023-10-08T08:42:05.174472+0000","last_active":"2023-10-08T08:42:39.276328+0000","last_peered":"2023-10-08T08:42:39.276328+0000","last_clean":"2023-10-08T08:42:39.276328+0000","last_became_active":"2023-10-08T08:42:05.174073+0000","last_became_peered":"2023-10-08T08:42:05.174073+0000","last_unstale":"2023-10-08T08:42:39.276328+0000","last_undegraded":"2023-10-08T08:42:39.276328+0000","last_fullsized":"2023-10-08T08:42:39.276328+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:36.208008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":104,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:46.201935+0000","last_change":"2023-10-08T08:42:00.115978+0000","last_active":"2023-10-08T08:43:46.201935+0000","last_peered":"2023-10-08T08:43:46.201935+0000","last_clean":"2023-10-08T08:43:46.201935+0000","last_became_active":"2023-10-08T08:42:00.115670+0000","last_became_peered":"2023-10-08T08:42:00.115670+0000","last_unstale":"2023-10-08T08:43:46.201935+0000","last_undegraded":"2023-10-08T08:43:46.201935+0000","last_fullsized":"2023-10-08T08:43:46.201935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:11:41.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696927+0000","last_change":"2023-10-08T08:42:40.696927+0000","last_active":"2023-10-08T08:42:40.696927+0000","last_peered":"2023-10-08T08:42:40.696927+0000","last_clean":"2023-10-08T08:42:40.696927+0000","last_became_active":"2023-10-08T08:42:40.696534+0000","last_became_peered":"2023-10-08T08:42:40.696534+0000","last_unstale":"2023-10-08T08:42:40.696927+0000","last_undegraded":"2023-10-08T08:42:40.696927+0000","last_fullsized":"2023-10-08T08:42:40.696927+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:05.888834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275650+0000","last_change":"2023-10-08T08:42:05.177922+0000","last_active":"2023-10-08T08:42:39.275650+0000","last_peered":"2023-10-08T08:42:39.275650+0000","last_clean":"2023-10-08T08:42:39.275650+0000","last_became_active":"2023-10-08T08:42:05.177504+0000","last_became_peered":"2023-10-08T08:42:05.177504+0000","last_unstale":"2023-10-08T08:42:39.275650+0000","last_undegraded":"2023-10-08T08:42:39.275650+0000","last_fullsized":"2023-10-08T08:42:39.275650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:02.602437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278640+0000","last_change":"2023-10-08T08:42:01.139125+0000","last_active":"2023-10-08T08:42:39.278640+0000","last_peered":"2023-10-08T08:42:39.278640+0000","last_clean":"2023-10-08T08:42:39.278640+0000","last_became_active":"2023-10-08T08:42:01.138769+0000","last_became_peered":"2023-10-08T08:42:01.138769+0000","last_unstale":"2023-10-08T08:42:39.278640+0000","last_undegraded":"2023-10-08T08:42:39.278640+0000","last_fullsized":"2023-10-08T08:42:39.278640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:31:57.717833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":104,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:46.196245+0000","last_change":"2023-10-08T08:42:00.115528+0000","last_active":"2023-10-08T08:43:46.196245+0000","last_peered":"2023-10-08T08:43:46.196245+0000","last_clean":"2023-10-08T08:43:46.196245+0000","last_became_active":"2023-10-08T08:42:00.115189+0000","last_became_peered":"2023-10-08T08:42:00.115189+0000","last_unstale":"2023-10-08T08:43:46.196245+0000","last_undegraded":"2023-10-08T08:43:46.196245+0000","last_fullsized":"2023-10-08T08:43:46.196245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.254073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.695382+0000","last_change":"2023-10-08T08:42:40.695382+0000","last_active":"2023-10-08T08:42:40.695382+0000","last_peered":"2023-10-08T08:42:40.695382+0000","last_clean":"2023-10-08T08:42:40.695382+0000","last_became_active":"2023-10-08T08:42:40.695009+0000","last_became_peered":"2023-10-08T08:42:40.695009+0000","last_unstale":"2023-10-08T08:42:40.695382+0000","last_undegraded":"2023-10-08T08:42:40.695382+0000","last_fullsized":"2023-10-08T08:42:40.695382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:35.298546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269706+0000","last_change":"2023-10-08T08:42:01.131992+0000","last_active":"2023-10-08T08:42:39.269706+0000","last_peered":"2023-10-08T08:42:39.269706+0000","last_clean":"2023-10-08T08:42:39.269706+0000","last_became_active":"2023-10-08T08:42:01.131633+0000","last_became_peered":"2023-10-08T08:42:01.131633+0000","last_unstale":"2023-10-08T08:42:39.269706+0000","last_undegraded":"2023-10-08T08:42:39.269706+0000","last_fullsized":"2023-10-08T08:42:39.269706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:40.653710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270531+0000","last_change":"2023-10-08T08:42:00.112987+0000","last_active":"2023-10-08T08:42:39.270531+0000","last_peered":"2023-10-08T08:42:39.270531+0000","last_clean":"2023-10-08T08:42:39.270531+0000","last_became_active":"2023-10-08T08:42:00.112276+0000","last_became_peered":"2023-10-08T08:42:00.112276+0000","last_unstale":"2023-10-08T08:42:39.270531+0000","last_undegraded":"2023-10-08T08:42:39.270531+0000","last_fullsized":"2023-10-08T08:42:39.270531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.193726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277082+0000","last_change":"2023-10-08T08:41:02.223132+0000","last_active":"2023-10-08T08:42:39.277082+0000","last_peered":"2023-10-08T08:42:39.277082+0000","last_clean":"2023-10-08T08:42:39.277082+0000","last_became_active":"2023-10-08T08:41:02.222688+0000","last_became_peered":"2023-10-08T08:41:02.222688+0000","last_unstale":"2023-10-08T08:42:39.277082+0000","last_undegraded":"2023-10-08T08:42:39.277082+0000","last_fullsized":"2023-10-08T08:42:39.277082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_clean_scrub_stamp":"2023-10-08T08:38:15.738972+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:27.673603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276236+0000","last_change":"2023-10-08T08:42:05.169025+0000","last_active":"2023-10-08T08:42:39.276236+0000","last_peered":"2023-10-08T08:42:39.276236+0000","last_clean":"2023-10-08T08:42:39.276236+0000","last_became_active":"2023-10-08T08:42:05.168100+0000","last_became_peered":"2023-10-08T08:42:05.168100+0000","last_unstale":"2023-10-08T08:42:39.276236+0000","last_undegraded":"2023-10-08T08:42:39.276236+0000","last_fullsized":"2023-10-08T08:42:39.276236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:30:40.830952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276572+0000","last_change":"2023-10-08T08:42:01.130878+0000","last_active":"2023-10-08T08:42:39.276572+0000","last_peered":"2023-10-08T08:42:39.276572+0000","last_clean":"2023-10-08T08:42:39.276572+0000","last_became_active":"2023-10-08T08:42:01.130649+0000","last_became_peered":"2023-10-08T08:42:01.130649+0000","last_unstale":"2023-10-08T08:42:39.276572+0000","last_undegraded":"2023-10-08T08:42:39.276572+0000","last_fullsized":"2023-10-08T08:42:39.276572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:15.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277371+0000","last_change":"2023-10-08T08:42:00.117747+0000","last_active":"2023-10-08T08:42:39.277371+0000","last_peered":"2023-10-08T08:42:39.277371+0000","last_clean":"2023-10-08T08:42:39.277371+0000","last_became_active":"2023-10-08T08:42:00.117437+0000","last_became_peered":"2023-10-08T08:42:00.117437+0000","last_unstale":"2023-10-08T08:42:39.277371+0000","last_undegraded":"2023-10-08T08:42:39.277371+0000","last_fullsized":"2023-10-08T08:42:39.277371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:13.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274614+0000","last_change":"2023-10-08T08:42:05.173175+0000","last_active":"2023-10-08T08:42:39.274614+0000","last_peered":"2023-10-08T08:42:39.274614+0000","last_clean":"2023-10-08T08:42:39.274614+0000","last_became_active":"2023-10-08T08:42:05.172754+0000","last_became_peered":"2023-10-08T08:42:05.172754+0000","last_unstale":"2023-10-08T08:42:39.274614+0000","last_undegraded":"2023-10-08T08:42:39.274614+0000","last_fullsized":"2023-10-08T08:42:39.274614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:48.900020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273546+0000","last_change":"2023-10-08T08:42:00.117094+0000","last_active":"2023-10-08T08:42:39.273546+0000","last_peered":"2023-10-08T08:42:39.273546+0000","last_clean":"2023-10-08T08:42:39.273546+0000","last_became_active":"2023-10-08T08:42:00.116773+0000","last_became_peered":"2023-10-08T08:42:00.116773+0000","last_unstale":"2023-10-08T08:42:39.273546+0000","last_undegraded":"2023-10-08T08:42:39.273546+0000","last_fullsized":"2023-10-08T08:42:39.273546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:28.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276460+0000","last_change":"2023-10-08T08:42:01.146290+0000","last_active":"2023-10-08T08:42:39.276460+0000","last_peered":"2023-10-08T08:42:39.276460+0000","last_clean":"2023-10-08T08:42:39.276460+0000","last_became_active":"2023-10-08T08:42:01.145585+0000","last_became_peered":"2023-10-08T08:42:01.145585+0000","last_unstale":"2023-10-08T08:42:39.276460+0000","last_undegraded":"2023-10-08T08:42:39.276460+0000","last_fullsized":"2023-10-08T08:42:39.276460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:16:15.140659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269495+0000","last_change":"2023-10-08T08:42:05.177611+0000","last_active":"2023-10-08T08:42:39.269495+0000","last_peered":"2023-10-08T08:42:39.269495+0000","last_clean":"2023-10-08T08:42:39.269495+0000","last_became_active":"2023-10-08T08:42:05.177027+0000","last_became_peered":"2023-10-08T08:42:05.177027+0000","last_unstale":"2023-10-08T08:42:39.269495+0000","last_undegraded":"2023-10-08T08:42:39.269495+0000","last_fullsized":"2023-10-08T08:42:39.269495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.846359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275664+0000","last_change":"2023-10-08T08:42:00.112453+0000","last_active":"2023-10-08T08:42:39.275664+0000","last_peered":"2023-10-08T08:42:39.275664+0000","last_clean":"2023-10-08T08:42:39.275664+0000","last_became_active":"2023-10-08T08:42:00.112159+0000","last_became_peered":"2023-10-08T08:42:00.112159+0000","last_unstale":"2023-10-08T08:42:39.275664+0000","last_undegraded":"2023-10-08T08:42:39.275664+0000","last_fullsized":"2023-10-08T08:42:39.275664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:27.713764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270602+0000","last_change":"2023-10-08T08:42:01.136743+0000","last_active":"2023-10-08T08:42:39.270602+0000","last_peered":"2023-10-08T08:42:39.270602+0000","last_clean":"2023-10-08T08:42:39.270602+0000","last_became_active":"2023-10-08T08:42:01.136442+0000","last_became_peered":"2023-10-08T08:42:01.136442+0000","last_unstale":"2023-10-08T08:42:39.270602+0000","last_undegraded":"2023-10-08T08:42:39.270602+0000","last_fullsized":"2023-10-08T08:42:39.270602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:50:41.937240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278976+0000","last_change":"2023-10-08T08:42:05.171945+0000","last_active":"2023-10-08T08:42:39.278976+0000","last_peered":"2023-10-08T08:42:39.278976+0000","last_clean":"2023-10-08T08:42:39.278976+0000","last_became_active":"2023-10-08T08:42:05.171573+0000","last_became_peered":"2023-10-08T08:42:05.171573+0000","last_unstale":"2023-10-08T08:42:39.278976+0000","last_undegraded":"2023-10-08T08:42:39.278976+0000","last_fullsized":"2023-10-08T08:42:39.278976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:03.677144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270977+0000","last_change":"2023-10-08T08:42:00.116005+0000","last_active":"2023-10-08T08:42:39.270977+0000","last_peered":"2023-10-08T08:42:39.270977+0000","last_clean":"2023-10-08T08:42:39.270977+0000","last_became_active":"2023-10-08T08:42:00.115701+0000","last_became_peered":"2023-10-08T08:42:00.115701+0000","last_unstale":"2023-10-08T08:42:39.270977+0000","last_undegraded":"2023-10-08T08:42:39.270977+0000","last_fullsized":"2023-10-08T08:42:39.270977+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:46.114324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273957+0000","last_change":"2023-10-08T08:42:01.140370+0000","last_active":"2023-10-08T08:42:39.273957+0000","last_peered":"2023-10-08T08:42:39.273957+0000","last_clean":"2023-10-08T08:42:39.273957+0000","last_became_active":"2023-10-08T08:42:01.139923+0000","last_became_peered":"2023-10-08T08:42:01.139923+0000","last_unstale":"2023-10-08T08:42:39.273957+0000","last_undegraded":"2023-10-08T08:42:39.273957+0000","last_fullsized":"2023-10-08T08:42:39.273957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:07.052821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270782+0000","last_change":"2023-10-08T08:42:05.177542+0000","last_active":"2023-10-08T08:42:39.270782+0000","last_peered":"2023-10-08T08:42:39.270782+0000","last_clean":"2023-10-08T08:42:39.270782+0000","last_became_active":"2023-10-08T08:42:05.176808+0000","last_became_peered":"2023-10-08T08:42:05.176808+0000","last_unstale":"2023-10-08T08:42:39.270782+0000","last_undegraded":"2023-10-08T08:42:39.270782+0000","last_fullsized":"2023-10-08T08:42:39.270782+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:44.845948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.284070+0000","last_change":"2023-10-08T08:42:40.284070+0000","last_active":"2023-10-08T08:42:40.284070+0000","last_peered":"2023-10-08T08:42:40.284070+0000","last_clean":"2023-10-08T08:42:40.284070+0000","last_became_active":"2023-10-08T08:42:40.280519+0000","last_became_peered":"2023-10-08T08:42:40.280519+0000","last_unstale":"2023-10-08T08:42:40.284070+0000","last_undegraded":"2023-10-08T08:42:40.284070+0000","last_fullsized":"2023-10-08T08:42:40.284070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:29.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272903+0000","last_change":"2023-10-08T08:42:01.139641+0000","last_active":"2023-10-08T08:42:39.272903+0000","last_peered":"2023-10-08T08:42:39.272903+0000","last_clean":"2023-10-08T08:42:39.272903+0000","last_became_active":"2023-10-08T08:42:01.139332+0000","last_became_peered":"2023-10-08T08:42:01.139332+0000","last_unstale":"2023-10-08T08:42:39.272903+0000","last_undegraded":"2023-10-08T08:42:39.272903+0000","last_fullsized":"2023-10-08T08:42:39.272903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:14.948944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278104+0000","last_change":"2023-10-08T08:42:05.180307+0000","last_active":"2023-10-08T08:42:39.278104+0000","last_peered":"2023-10-08T08:42:39.278104+0000","last_clean":"2023-10-08T08:42:39.278104+0000","last_became_active":"2023-10-08T08:42:05.179755+0000","last_became_peered":"2023-10-08T08:42:05.179755+0000","last_unstale":"2023-10-08T08:42:39.278104+0000","last_undegraded":"2023-10-08T08:42:39.278104+0000","last_fullsized":"2023-10-08T08:42:39.278104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:34.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269609+0000","last_change":"2023-10-08T08:42:00.112674+0000","last_active":"2023-10-08T08:42:39.269609+0000","last_peered":"2023-10-08T08:42:39.269609+0000","last_clean":"2023-10-08T08:42:39.269609+0000","last_became_active":"2023-10-08T08:42:00.110746+0000","last_became_peered":"2023-10-08T08:42:00.110746+0000","last_unstale":"2023-10-08T08:42:39.269609+0000","last_undegraded":"2023-10-08T08:42:39.269609+0000","last_fullsized":"2023-10-08T08:42:39.269609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:27.463811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274453+0000","last_change":"2023-10-08T08:42:01.150107+0000","last_active":"2023-10-08T08:42:39.274453+0000","last_peered":"2023-10-08T08:42:39.274453+0000","last_clean":"2023-10-08T08:42:39.274453+0000","last_became_active":"2023-10-08T08:42:01.149609+0000","last_became_peered":"2023-10-08T08:42:01.149609+0000","last_unstale":"2023-10-08T08:42:39.274453+0000","last_undegraded":"2023-10-08T08:42:39.274453+0000","last_fullsized":"2023-10-08T08:42:39.274453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:05.378286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270656+0000","last_change":"2023-10-08T08:42:05.177571+0000","last_active":"2023-10-08T08:42:39.270656+0000","last_peered":"2023-10-08T08:42:39.270656+0000","last_clean":"2023-10-08T08:42:39.270656+0000","last_became_active":"2023-10-08T08:42:05.177061+0000","last_became_peered":"2023-10-08T08:42:05.177061+0000","last_unstale":"2023-10-08T08:42:39.270656+0000","last_undegraded":"2023-10-08T08:42:39.270656+0000","last_fullsized":"2023-10-08T08:42:39.270656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:10.274262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.286517+0000","last_change":"2023-10-08T08:42:40.286517+0000","last_active":"2023-10-08T08:42:40.286517+0000","last_peered":"2023-10-08T08:42:40.286517+0000","last_clean":"2023-10-08T08:42:40.286517+0000","last_became_active":"2023-10-08T08:42:40.281562+0000","last_became_peered":"2023-10-08T08:42:40.281562+0000","last_unstale":"2023-10-08T08:42:40.286517+0000","last_undegraded":"2023-10-08T08:42:40.286517+0000","last_fullsized":"2023-10-08T08:42:40.286517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:23.313740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270339+0000","last_change":"2023-10-08T08:42:01.142209+0000","last_active":"2023-10-08T08:42:39.270339+0000","last_peered":"2023-10-08T08:42:39.270339+0000","last_clean":"2023-10-08T08:42:39.270339+0000","last_became_active":"2023-10-08T08:42:01.141911+0000","last_became_peered":"2023-10-08T08:42:01.141911+0000","last_unstale":"2023-10-08T08:42:39.270339+0000","last_undegraded":"2023-10-08T08:42:39.270339+0000","last_fullsized":"2023-10-08T08:42:39.270339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:00.066595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270619+0000","last_change":"2023-10-08T08:42:05.173463+0000","last_active":"2023-10-08T08:42:39.270619+0000","last_peered":"2023-10-08T08:42:39.270619+0000","last_clean":"2023-10-08T08:42:39.270619+0000","last_became_active":"2023-10-08T08:42:05.173045+0000","last_became_peered":"2023-10-08T08:42:05.173045+0000","last_unstale":"2023-10-08T08:42:39.270619+0000","last_undegraded":"2023-10-08T08:42:39.270619+0000","last_fullsized":"2023-10-08T08:42:39.270619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:10.774694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272997+0000","last_change":"2023-10-08T08:42:00.111005+0000","last_active":"2023-10-08T08:42:39.272997+0000","last_peered":"2023-10-08T08:42:39.272997+0000","last_clean":"2023-10-08T08:42:39.272997+0000","last_became_active":"2023-10-08T08:42:00.110687+0000","last_became_peered":"2023-10-08T08:42:00.110687+0000","last_unstale":"2023-10-08T08:42:39.272997+0000","last_undegraded":"2023-10-08T08:42:39.272997+0000","last_fullsized":"2023-10-08T08:42:39.272997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:38.682150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277572+0000","last_change":"2023-10-08T08:42:01.144443+0000","last_active":"2023-10-08T08:42:39.277572+0000","last_peered":"2023-10-08T08:42:39.277572+0000","last_clean":"2023-10-08T08:42:39.277572+0000","last_became_active":"2023-10-08T08:42:01.143960+0000","last_became_peered":"2023-10-08T08:42:01.143960+0000","last_unstale":"2023-10-08T08:42:39.277572+0000","last_undegraded":"2023-10-08T08:42:39.277572+0000","last_fullsized":"2023-10-08T08:42:39.277572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:46:57.209569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275843+0000","last_change":"2023-10-08T08:42:05.178212+0000","last_active":"2023-10-08T08:42:39.275843+0000","last_peered":"2023-10-08T08:42:39.275843+0000","last_clean":"2023-10-08T08:42:39.275843+0000","last_became_active":"2023-10-08T08:42:05.177751+0000","last_became_peered":"2023-10-08T08:42:05.177751+0000","last_unstale":"2023-10-08T08:42:39.275843+0000","last_undegraded":"2023-10-08T08:42:39.275843+0000","last_fullsized":"2023-10-08T08:42:39.275843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:10.128104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.214954+0000","last_change":"2023-10-08T08:42:00.115576+0000","last_active":"2023-10-08T08:43:43.214954+0000","last_peered":"2023-10-08T08:43:43.214954+0000","last_clean":"2023-10-08T08:43:43.214954+0000","last_became_active":"2023-10-08T08:42:00.115296+0000","last_became_peered":"2023-10-08T08:42:00.115296+0000","last_unstale":"2023-10-08T08:43:43.214954+0000","last_undegraded":"2023-10-08T08:43:43.214954+0000","last_fullsized":"2023-10-08T08:43:43.214954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:22.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278387+0000","last_change":"2023-10-08T08:42:01.139104+0000","last_active":"2023-10-08T08:42:39.278387+0000","last_peered":"2023-10-08T08:42:39.278387+0000","last_clean":"2023-10-08T08:42:39.278387+0000","last_became_active":"2023-10-08T08:42:01.138653+0000","last_became_peered":"2023-10-08T08:42:01.138653+0000","last_unstale":"2023-10-08T08:42:39.278387+0000","last_undegraded":"2023-10-08T08:42:39.278387+0000","last_fullsized":"2023-10-08T08:42:39.278387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:24.784017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273245+0000","last_change":"2023-10-08T08:42:05.186990+0000","last_active":"2023-10-08T08:42:39.273245+0000","last_peered":"2023-10-08T08:42:39.273245+0000","last_clean":"2023-10-08T08:42:39.273245+0000","last_became_active":"2023-10-08T08:42:05.186397+0000","last_became_peered":"2023-10-08T08:42:05.186397+0000","last_unstale":"2023-10-08T08:42:39.273245+0000","last_undegraded":"2023-10-08T08:42:39.273245+0000","last_fullsized":"2023-10-08T08:42:39.273245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:53.633137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276542+0000","last_change":"2023-10-08T08:42:00.114499+0000","last_active":"2023-10-08T08:42:39.276542+0000","last_peered":"2023-10-08T08:42:39.276542+0000","last_clean":"2023-10-08T08:42:39.276542+0000","last_became_active":"2023-10-08T08:42:00.114062+0000","last_became_peered":"2023-10-08T08:42:00.114062+0000","last_unstale":"2023-10-08T08:42:39.276542+0000","last_undegraded":"2023-10-08T08:42:39.276542+0000","last_fullsized":"2023-10-08T08:42:39.276542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:23.576889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277486+0000","last_change":"2023-10-08T08:42:01.139810+0000","last_active":"2023-10-08T08:42:39.277486+0000","last_peered":"2023-10-08T08:42:39.277486+0000","last_clean":"2023-10-08T08:42:39.277486+0000","last_became_active":"2023-10-08T08:42:01.139489+0000","last_became_peered":"2023-10-08T08:42:01.139489+0000","last_unstale":"2023-10-08T08:42:39.277486+0000","last_undegraded":"2023-10-08T08:42:39.277486+0000","last_fullsized":"2023-10-08T08:42:39.277486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:06.724645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278227+0000","last_change":"2023-10-08T08:42:05.172808+0000","last_active":"2023-10-08T08:42:39.278227+0000","last_peered":"2023-10-08T08:42:39.278227+0000","last_clean":"2023-10-08T08:42:39.278227+0000","last_became_active":"2023-10-08T08:42:05.172307+0000","last_became_peered":"2023-10-08T08:42:05.172307+0000","last_unstale":"2023-10-08T08:42:39.278227+0000","last_undegraded":"2023-10-08T08:42:39.278227+0000","last_fullsized":"2023-10-08T08:42:39.278227+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.031070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275490+0000","last_change":"2023-10-08T08:42:00.112423+0000","last_active":"2023-10-08T08:42:39.275490+0000","last_peered":"2023-10-08T08:42:39.275490+0000","last_clean":"2023-10-08T08:42:39.275490+0000","last_became_active":"2023-10-08T08:42:00.112130+0000","last_became_peered":"2023-10-08T08:42:00.112130+0000","last_unstale":"2023-10-08T08:42:39.275490+0000","last_undegraded":"2023-10-08T08:42:39.275490+0000","last_fullsized":"2023-10-08T08:42:39.275490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:54.898037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277793+0000","last_change":"2023-10-08T08:42:01.148404+0000","last_active":"2023-10-08T08:42:39.277793+0000","last_peered":"2023-10-08T08:42:39.277793+0000","last_clean":"2023-10-08T08:42:39.277793+0000","last_became_active":"2023-10-08T08:42:01.148087+0000","last_became_peered":"2023-10-08T08:42:01.148087+0000","last_unstale":"2023-10-08T08:42:39.277793+0000","last_undegraded":"2023-10-08T08:42:39.277793+0000","last_fullsized":"2023-10-08T08:42:39.277793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:12.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274525+0000","last_change":"2023-10-08T08:42:01.149762+0000","last_active":"2023-10-08T08:42:39.274525+0000","last_peered":"2023-10-08T08:42:39.274525+0000","last_clean":"2023-10-08T08:42:39.274525+0000","last_became_active":"2023-10-08T08:42:01.149392+0000","last_became_peered":"2023-10-08T08:42:01.149392+0000","last_unstale":"2023-10-08T08:42:39.274525+0000","last_undegraded":"2023-10-08T08:42:39.274525+0000","last_fullsized":"2023-10-08T08:42:39.274525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:22.487634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279392+0000","last_change":"2023-10-08T08:42:01.145106+0000","last_active":"2023-10-08T08:42:39.279392+0000","last_peered":"2023-10-08T08:42:39.279392+0000","last_clean":"2023-10-08T08:42:39.279392+0000","last_became_active":"2023-10-08T08:42:01.144709+0000","last_became_peered":"2023-10-08T08:42:01.144709+0000","last_unstale":"2023-10-08T08:42:39.279392+0000","last_undegraded":"2023-10-08T08:42:39.279392+0000","last_fullsized":"2023-10-08T08:42:39.279392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:24.248415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.280122+0000","last_change":"2023-10-08T08:42:01.148384+0000","last_active":"2023-10-08T08:42:39.280122+0000","last_peered":"2023-10-08T08:42:39.280122+0000","last_clean":"2023-10-08T08:42:39.280122+0000","last_became_active":"2023-10-08T08:42:01.148098+0000","last_became_peered":"2023-10-08T08:42:01.148098+0000","last_unstale":"2023-10-08T08:42:39.280122+0000","last_undegraded":"2023-10-08T08:42:39.280122+0000","last_fullsized":"2023-10-08T08:42:39.280122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:45.361279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.278516+0000","last_change":"2023-10-08T08:42:40.278516+0000","last_active":"2023-10-08T08:42:40.278516+0000","last_peered":"2023-10-08T08:42:40.278516+0000","last_clean":"2023-10-08T08:42:40.278516+0000","last_became_active":"2023-10-08T08:42:40.278111+0000","last_became_peered":"2023-10-08T08:42:40.278111+0000","last_unstale":"2023-10-08T08:42:40.278516+0000","last_undegraded":"2023-10-08T08:42:40.278516+0000","last_fullsized":"2023-10-08T08:42:40.278516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:32.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276507+0000","last_change":"2023-10-08T08:42:01.146486+0000","last_active":"2023-10-08T08:42:39.276507+0000","last_peered":"2023-10-08T08:42:39.276507+0000","last_clean":"2023-10-08T08:42:39.276507+0000","last_became_active":"2023-10-08T08:42:01.146002+0000","last_became_peered":"2023-10-08T08:42:01.146002+0000","last_unstale":"2023-10-08T08:42:39.276507+0000","last_undegraded":"2023-10-08T08:42:39.276507+0000","last_fullsized":"2023-10-08T08:42:39.276507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:28.217937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276175+0000","last_change":"2023-10-08T08:42:01.152380+0000","last_active":"2023-10-08T08:42:39.276175+0000","last_peered":"2023-10-08T08:42:39.276175+0000","last_clean":"2023-10-08T08:42:39.276175+0000","last_became_active":"2023-10-08T08:42:01.149760+0000","last_became_peered":"2023-10-08T08:42:01.149760+0000","last_unstale":"2023-10-08T08:42:39.276175+0000","last_undegraded":"2023-10-08T08:42:39.276175+0000","last_fullsized":"2023-10-08T08:42:39.276175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:47:58.326416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279642+0000","last_change":"2023-10-08T08:42:01.149593+0000","last_active":"2023-10-08T08:42:39.279642+0000","last_peered":"2023-10-08T08:42:39.279642+0000","last_clean":"2023-10-08T08:42:39.279642+0000","last_became_active":"2023-10-08T08:42:01.149235+0000","last_became_peered":"2023-10-08T08:42:01.149235+0000","last_unstale":"2023-10-08T08:42:39.279642+0000","last_undegraded":"2023-10-08T08:42:39.279642+0000","last_fullsized":"2023-10-08T08:42:39.279642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:51.379305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270673+0000","last_change":"2023-10-08T08:42:01.133460+0000","last_active":"2023-10-08T08:42:39.270673+0000","last_peered":"2023-10-08T08:42:39.270673+0000","last_clean":"2023-10-08T08:42:39.270673+0000","last_became_active":"2023-10-08T08:42:01.133132+0000","last_became_peered":"2023-10-08T08:42:01.133132+0000","last_unstale":"2023-10-08T08:42:39.270673+0000","last_undegraded":"2023-10-08T08:42:39.270673+0000","last_fullsized":"2023-10-08T08:42:39.270673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:29.047135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278661+0000","last_change":"2023-10-08T08:42:01.134274+0000","last_active":"2023-10-08T08:42:39.278661+0000","last_peered":"2023-10-08T08:42:39.278661+0000","last_clean":"2023-10-08T08:42:39.278661+0000","last_became_active":"2023-10-08T08:42:01.133040+0000","last_became_peered":"2023-10-08T08:42:01.133040+0000","last_unstale":"2023-10-08T08:42:39.278661+0000","last_undegraded":"2023-10-08T08:42:39.278661+0000","last_fullsized":"2023-10-08T08:42:39.278661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:18.054859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269663+0000","last_change":"2023-10-08T08:42:01.128333+0000","last_active":"2023-10-08T08:42:39.269663+0000","last_peered":"2023-10-08T08:42:39.269663+0000","last_clean":"2023-10-08T08:42:39.269663+0000","last_became_active":"2023-10-08T08:42:01.128076+0000","last_became_peered":"2023-10-08T08:42:01.128076+0000","last_unstale":"2023-10-08T08:42:39.269663+0000","last_undegraded":"2023-10-08T08:42:39.269663+0000","last_fullsized":"2023-10-08T08:42:39.269663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.675185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276377+0000","last_change":"2023-10-08T08:42:01.139518+0000","last_active":"2023-10-08T08:42:39.276377+0000","last_peered":"2023-10-08T08:42:39.276377+0000","last_clean":"2023-10-08T08:42:39.276377+0000","last_became_active":"2023-10-08T08:42:01.139217+0000","last_became_peered":"2023-10-08T08:42:01.139217+0000","last_unstale":"2023-10-08T08:42:39.276377+0000","last_undegraded":"2023-10-08T08:42:39.276377+0000","last_fullsized":"2023-10-08T08:42:39.276377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:05:02.485500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275263+0000","last_change":"2023-10-08T08:42:01.142664+0000","last_active":"2023-10-08T08:42:39.275263+0000","last_peered":"2023-10-08T08:42:39.275263+0000","last_clean":"2023-10-08T08:42:39.275263+0000","last_became_active":"2023-10-08T08:42:01.142136+0000","last_became_peered":"2023-10-08T08:42:01.142136+0000","last_unstale":"2023-10-08T08:42:39.275263+0000","last_undegraded":"2023-10-08T08:42:39.275263+0000","last_fullsized":"2023-10-08T08:42:39.275263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:18.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696535+0000","last_change":"2023-10-08T08:42:40.696535+0000","last_active":"2023-10-08T08:42:40.696535+0000","last_peered":"2023-10-08T08:42:40.696535+0000","last_clean":"2023-10-08T08:42:40.696535+0000","last_became_active":"2023-10-08T08:42:40.695973+0000","last_became_peered":"2023-10-08T08:42:40.695973+0000","last_unstale":"2023-10-08T08:42:40.696535+0000","last_undegraded":"2023-10-08T08:42:40.696535+0000","last_fullsized":"2023-10-08T08:42:40.696535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:50.008782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10524,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":794,"num_read_kb":415,"num_write":211,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":31572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481825,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":494069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.60899999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.64400000000000002,"15min":0.63900000000000001},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88600000000000001,"5min":1.161,"15min":1.161},"last":0.73799999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.496},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73799999999999999,"5min":1.254,"15min":1.254},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Oct 8 08:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.622,"15min":0.60499999999999998},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.876},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67000000000000004,"15min":0.66200000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70299999999999996}]},{"osd":5,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.58399999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93000000000000005,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.747},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.52600000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.024,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.72499999999999998,"15min":0.70799999999999996},"min":{"1min":0.53800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97999999999999998,"5min":1.196,"15min":1.196},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0449999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79000000000000004}]},{"osd":8,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.79900000000000004}]},{"osd":9,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.60399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.107,"5min":1.413,"15min":1.413},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.91700000000000004}]},{"osd":10,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.629,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0860000000000001,"5min":1.214,"15min":1.214},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.81299999999999994,"15min":0.80300000000000005},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0629999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.86499999999999999}]}]},{"osd":10,"up_from":70,"seq":300647710756,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1638400,"data_stored":1088563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.51200000000000001}]},{"osd":1,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.372}]},{"osd":2,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82599999999999996,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.83699999999999997,"5min":0.87,"15min":0.87},"last":0.44700000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0489999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93899999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.50700000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.032,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.55500000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.95599999999999996,"5min":1.23,"15min":1.23},"last":0.57999999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.998,"5min":1.208,"15min":1.208},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98399999999999999,"5min":1.173,"15min":1.173},"last":0.69699999999999995}]},{"osd":11,"last update":"Sun Oct 8 08:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82799999999999996,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97199999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.61599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.069},"last":0.75}]}]},{"osd":9,"up_from":65,"seq":279172874281,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":493739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.41899999999999998,"15min":0.42899999999999999},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.42699999999999999,"15min":0.44900000000000001},"min":{"1min":0.27000000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54900000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.33400000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72499999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81699999999999995,"5min":1.022,"15min":1.022},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2,"5min":2,"15min":2},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.51300000000000001,"15min":0.53800000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.433}]},{"osd":4,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.498},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78000000000000003,"5min":1.028,"15min":1.028},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94499999999999995,"5min":0.995,"15min":0.995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.621}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39100000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.69899999999999995,"15min":0.73299999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85599999999999998,"5min":1.151,"15min":1.151},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.70699999999999996,"15min":0.747},"min":{"1min":0.45800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.64500000000000002}]},{"osd":8,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73099999999999998,"15min":0.75800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.70299999999999996}]},{"osd":10,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82499999999999996,"5min":1.216,"15min":1.216},"last":0.67400000000000004}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66400000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103214,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":494117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":1.256,"15min":1.256},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63700000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.51400000000000001}]},{"osd":1,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.60599999999999998,"15min":0.57799999999999996},"min":{"1min":0.58399999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63900000000000001,"15min":0.622},"min":{"1min":0.502,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.028,"15min":1.028},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.441},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.626,"5min":0.748,"15min":0.748},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67100000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63600000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78600000000000003,"5min":1.288,"15min":1.288},"last":0.54300000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.47099999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.67700000000000005,"15min":0.66000000000000003},"min":{"1min":0.66200000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72399999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58199999999999996,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.312,"15min":0.312},"max":{"1min":0.85199999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.87,"15min":0.87},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.75900000000000001},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.90000000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.67600000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.64600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85699999999999998,"5min":1.026,"15min":1.026},"last":0.80500000000000005}]},{"osd":9,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.73199999999999998},"min":{"1min":0.60899999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.76300000000000001,"15min":0.73599999999999999},"min":{"1min":0.61399999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77100000000000002}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.76900000000000002,"15min":0.751},"min":{"1min":0.71799999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.052,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.78200000000000003,"15min":0.76500000000000001},"min":{"1min":0.73799999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.036,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.88}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.83199999999999996}]}]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1086127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41399999999999998,"15min":0.39700000000000002},"min":{"1min":0.312,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70299999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.432},"min":{"1min":0.33500000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73399999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.46800000000000003}]},{"osd":2,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.56499999999999995},"min":{"1min":0.51300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73799999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63100000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55100000000000005,"15min":0.52700000000000002},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81499999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.41799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.502,"15min":0.49299999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.434}]},{"osd":5,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.89800000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.747},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.64100000000000001,"15min":0.61499999999999999},"min":{"1min":0.52600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89900000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.64100000000000001},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96499999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.42099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52700000000000002}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70699999999999996,"15min":0.69499999999999995},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73299999999999998,"15min":0.71799999999999997},"min":{"1min":0.60099999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":1.234,"15min":1.234},"last":0.77700000000000002}]},{"osd":9,"last update":"Sun Oct 8 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.497,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84199999999999997,"5min":1.181,"15min":1.181},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.61099999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.86799999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68899999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.55500000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98899999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.64900000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91500000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73199999999999998}]},{"osd":11,"last update":"Sun Oct 8 08:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76300000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495669,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":493339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38,"15min":0.35699999999999998},"min":{"1min":0.27000000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52600000000000002,"5min":0.62,"15min":0.62},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46200000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.53700000000000003},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.625}]},{"osd":2,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.55800000000000005},"min":{"1min":0.441,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80200000000000005,"5min":1.034,"15min":1.034},"last":0.69499999999999995}]},{"osd":3,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54300000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.432},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.46500000000000002,"15min":0.46100000000000002},"min":{"1min":0.315,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56299999999999994,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57399999999999995,"15min":0.55800000000000005},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.75700000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73799999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61799999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.66900000000000004,"15min":0.627},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79200000000000004,"5min":4.7670000000000003,"15min":4.7670000000000003},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.442,"5min":0.379,"15min":0.379},"max":{"1min":0.95699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.49399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.96799999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68300000000000005}]},{"osd":8,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79700000000000004,"5min":1.087,"15min":1.087},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.47999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78100000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.71499999999999997}]},{"osd":9,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.65600000000000003,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81200000000000006,"5min":1.012,"15min":1.012},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.66800000000000004,"15min":0.70399999999999996},"min":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82199999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56000000000000005}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.65300000000000002}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542218,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":498211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.45400000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.75900000000000001,"5min":1.242,"15min":1.242},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.44600000000000001},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.71699999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.55600000000000005,"15min":0.502},"min":{"1min":0.48899999999999999,"5min":0.246,"15min":0.246},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.56899999999999995,"15min":0.51500000000000001},"min":{"1min":0.33400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.45300000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.59599999999999997},"min":{"1min":0.41499999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81699999999999995,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.42599999999999999},"min":{"1min":0.34300000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.40899999999999997},"min":{"1min":0.36599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.624,"15min":0.58299999999999996},"min":{"1min":0.54600000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.66500000000000004,"15min":0.627},"min":{"1min":0.46700000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.63900000000000001,"15min":0.59099999999999997},"min":{"1min":0.436,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.99299999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64900000000000002,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93300000000000005,"5min":1.788,"15min":1.788},"last":0.65600000000000003}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.60699999999999998,"15min":0.57299999999999995},"min":{"1min":0.47999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.502,"5min":0.318,"15min":0.318},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.76600000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.67100000000000004,"15min":0.64100000000000001},"min":{"1min":0.59999999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.99299999999999999,"5min":1.002,"15min":1.002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.70599999999999996,"15min":0.67600000000000005},"min":{"1min":0.67400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70799999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72399999999999998,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.73499999999999999,"15min":0.70599999999999996},"min":{"1min":0.63600000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95899999999999996,"5min":1.044,"15min":1.044},"last":0.74399999999999999}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.69399999999999995,"15min":0.67500000000000004},"min":{"1min":0.54800000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.50600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.86099999999999999}]},{"osd":11,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.88600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":495055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 08:43:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.52300000000000002},"min":{"1min":0.46000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.53800000000000003},"min":{"1min":0.439,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55000000000000004}]},{"osd":2,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.433,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66900000000000004,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56899999999999995}]},{"osd":3,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.379},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52100000000000002,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.79300000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.66600000000000004}]},{"osd":6,"last update":"Sun Oct 8 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65900000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41799999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.47499999999999998}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.61299999999999999}]},{"osd":9,"last update":"Sun Oct 8 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66100000000000003,"15min":0.68100000000000005},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0860000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.63400000000000001}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.53900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.755,"15min":0.755},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.006,"15min":1.006},"last":0.624}]},{"osd":11,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.82199999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68799999999999994}]}]},{"osd":2,"up_from":19,"seq":81604378694,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":498431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.46999999999999997},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63400000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.48199999999999998},"min":{"1min":0.42899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.71599999999999997}]},{"osd":1,"last update":"Sun Oct 8 08:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54900000000000004,"15min":0.50700000000000001},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.86299999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59799999999999998,"15min":0.53800000000000003},"min":{"1min":0.47999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89800000000000002,"5min":2.097,"15min":2.097},"last":0.77600000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.55200000000000005},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80500000000000005,"5min":3.6800000000000002,"15min":3.6800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.56000000000000005},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.50600000000000001,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.56399999999999995,"15min":0.51200000000000001},"min":{"1min":0.53800000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.60499999999999998},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82799999999999996,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63400000000000001,"15min":0.60399999999999998},"min":{"1min":0.52200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73099999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.874}]},{"osd":8,"last update":"Sun Oct 8 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.61499999999999999,"15min":0.58299999999999996},"min":{"1min":0.497,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88400000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95899999999999996,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80300000000000005}]},{"osd":9,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.76400000000000001,"15min":0.74099999999999999},"min":{"1min":0.70299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.995,"5min":1.02,"15min":1.02},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.77700000000000002,"15min":0.745},"min":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97299999999999998,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.90200000000000002}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.79300000000000004},"min":{"1min":0.59299999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.109,"15min":2.109},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.72299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.92100000000000004}]},{"osd":11,"last update":"Sun Oct 8 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.95399999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":492716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.35299999999999998},"min":{"1min":0.27000000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.39300000000000002,"15min":0.36099999999999999},"min":{"1min":0.26200000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51700000000000002,"5min":1.889,"15min":1.889},"last":2.5449999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71599999999999997,"5min":0.996,"15min":0.996},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59599999999999997,"15min":0.52600000000000002},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":3.6930000000000001}]},{"osd":2,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57199999999999995,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82499999999999996,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.86299999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":1.927,"15min":1.927},"last":5.2539999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":0.94099999999999995}]},{"osd":5,"last update":"Sun Oct 8 08:43:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":1.992,"15min":1.992},"last":5.827},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81699999999999995,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":5.6360000000000001}]},{"osd":6,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48299999999999998,"15min":0.47499999999999998},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69499999999999995,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.014},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52000000000000002,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93899999999999995,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":6.2300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.92300000000000004}]},{"osd":8,"last update":"Sun Oct 8 08:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]},{"osd":9,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.66000000000000003,"15min":0.71999999999999997},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":1.712,"15min":1.712},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71199999999999997,"15min":0.76300000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":6.5209999999999999}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96199999999999997,"5min":2.339,"15min":2.339},"last":6.915},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89800000000000002,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.96499999999999997}]},{"osd":11,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.0329999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920830,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":493317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67700000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77000000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.35899999999999999},"min":{"1min":0.314,"5min":0.247,"15min":0.247},"max":{"1min":0.53800000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.37},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.371},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54300000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.41899999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.54000000000000004,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77500000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.62},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.51300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71299999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.57399999999999995,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.52000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.61099999999999999},"min":{"1min":0.52500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.874,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sun Oct 8 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84099999999999997,"5min":0.88,"15min":0.88},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83499999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79900000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69199999999999995}]},{"osd":8,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.55100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85799999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72899999999999998,"15min":0.71199999999999997},"min":{"1min":0.63800000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99099999999999999,"5min":1.05,"15min":1.05},"last":0.76100000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.50900000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":1.03,"15min":1.03},"last":0.72199999999999998}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.81699999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.748}]},{"osd":11,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79300000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757305,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1626112,"data_stored":1085805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":0.871,"15min":0.871},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.47199999999999998},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86899999999999999,"5min":0.871,"15min":0.871},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75800000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42299999999999999,"15min":0.39100000000000001},"min":{"1min":0.35799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.438,"15min":0.40999999999999998},"min":{"1min":0.35399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64700000000000002,"5min":0.748,"15min":0.748},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.50600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.51500000000000001},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.752,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.623,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81899999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91300000000000003,"5min":1.006,"15min":1.006},"last":0.72899999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89800000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.68400000000000005,"15min":0.66400000000000003},"min":{"1min":0.55300000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78000000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.436,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.629},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95499999999999996,"5min":1.006,"15min":1.006},"last":0.61299999999999999}]},{"osd":9,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.748,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.63100000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98699999999999999,"5min":1.038,"15min":1.038},"last":0.93000000000000005}]},{"osd":10,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77800000000000002,"15min":0.76500000000000001},"min":{"1min":0.57699999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.032},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.74399999999999999,"15min":0.73599999999999999},"min":{"1min":0.62,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93899999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T08:43:49.185 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-08T08:43:49.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T08:43:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.335+0000 7fed204b6700 1 -- 172.21.15.70:0/4137522890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed180fff30 msgr2=0x7fed1810c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.335+0000 7fed204b6700 1 --2- 172.21.15.70:0/4137522890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed180fff30 0x7fed1810c3f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fed1000b0d0 tx=0x7fed1000b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.335+0000 7fed204b6700 1 -- 172.21.15.70:0/4137522890 shutdown_connections 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.335+0000 7fed204b6700 1 --2- 172.21.15.70:0/4137522890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed180fff30 0x7fed1810c3f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.335+0000 7fed204b6700 1 --2- 172.21.15.70:0/4137522890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed18105630 0x7fed18105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.335+0000 7fed204b6700 1 --2- 172.21.15.70:0/4137522890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed180ff570 0x7fed180ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.335+0000 7fed204b6700 1 -- 172.21.15.70:0/4137522890 >> 172.21.15.70:0/4137522890 conn(0x7fed180fb060 msgr2=0x7fed180fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 -- 172.21.15.70:0/4137522890 shutdown_connections 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 -- 172.21.15.70:0/4137522890 wait complete. 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 Processor -- start 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 -- start start 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed180ff570 0x7fed18197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed180fff30 0x7fed18197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed18105630 0x7fed181a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed18198700 con 0x7fed18105630 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed181a2f10 con 0x7fed180ff570 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed204b6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed181a3050 con 0x7fed180fff30 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.336+0000 7fed1ea53700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed18105630 0x7fed181a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1ea53700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed18105630 0x7fed181a29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51070/0 (socket says 172.21.15.70:51070) 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1ea53700 1 -- 172.21.15.70:0/163458892 learned_addr learned my addr 172.21.15.70:0/163458892 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1da51700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed180fff30 0x7fed18197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1e252700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed180ff570 0x7fed18197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1ea53700 1 -- 172.21.15.70:0/163458892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed180fff30 msgr2=0x7fed18197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1ea53700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed180fff30 0x7fed18197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1ea53700 1 -- 172.21.15.70:0/163458892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed180ff570 msgr2=0x7fed18197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1ea53700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed180ff570 0x7fed18197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1ea53700 1 -- 172.21.15.70:0/163458892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009d00 con 0x7fed18105630 2023-10-08T08:43:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1e252700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed180ff570 0x7fed18197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed1ea53700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed18105630 0x7fed181a29d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fed100094c0 tx=0x7fed100094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed0b7fe700 1 -- 172.21.15.70:0/163458892 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1000e040 con 0x7fed18105630 2023-10-08T08:43:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed0b7fe700 1 -- 172.21.15.70:0/163458892 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed1001d940 con 0x7fed18105630 2023-10-08T08:43:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed181a3280 con 0x7fed18105630 2023-10-08T08:43:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed0b7fe700 1 -- 172.21.15.70:0/163458892 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1001b9e0 con 0x7fed18105630 2023-10-08T08:43:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.337+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed181a3700 con 0x7fed18105630 2023-10-08T08:43:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.338+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed18107ad0 con 0x7fed18105630 2023-10-08T08:43:49.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.339+0000 7fed0b7fe700 1 -- 172.21.15.70:0/163458892 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fed1001d480 con 0x7fed18105630 2023-10-08T08:43:49.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.340+0000 7fed0b7fe700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed040a1550 0x7fed040a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:49.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.340+0000 7fed1e252700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed040a1550 0x7fed040a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:49.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.340+0000 7fed0b7fe700 1 -- 172.21.15.70:0/163458892 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fed100cf040 con 0x7fed18105630 2023-10-08T08:43:49.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.340+0000 7fed1e252700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed040a1550 0x7fed040a3a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed0c005e90 tx=0x7fed0c005d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:49.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.344+0000 7fed0b7fe700 1 -- 172.21.15.70:0/163458892 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fed10060100 con 0x7fed18105630 2023-10-08T08:43:49.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.531+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed1810f490 con 0x7fed040a1550 2023-10-08T08:43:49.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.543+0000 7fed0b7fe700 1 -- 172.21.15.70:0/163458892 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427787 (secure 0 0 0) 0x7fed1810f490 con 0x7fed040a1550 2023-10-08T08:43:49.549 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:49.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed040a1550 msgr2=0x7fed040a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed040a1550 0x7fed040a3a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed0c005e90 tx=0x7fed0c005d20 comp rx=0 tx=0).stop 2023-10-08T08:43:49.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed18105630 msgr2=0x7fed181a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed18105630 0x7fed181a29d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fed100094c0 tx=0x7fed100094f0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 shutdown_connections 2023-10-08T08:43:49.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fed040a1550 0x7fed040a3a10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed18105630 0x7fed181a29d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed180ff570 0x7fed18197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 --2- 172.21.15.70:0/163458892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed180fff30 0x7fed18197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 >> 172.21.15.70:0/163458892 conn(0x7fed180fb060 msgr2=0x7fed180fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:49.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 shutdown_connections 2023-10-08T08:43:49.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.547+0000 7fed204b6700 1 -- 172.21.15.70:0/163458892 wait complete. 2023-10-08T08:43:49.555 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-10-08T08:43:49.560 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-10-08T08:43:49.076259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600892,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":930,"num_read_kb":534,"num_write":392,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337964,"kb_used_data":13688,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603860,"statfs":{"total":1151940427776,"available":1151594352640,"internally_reserved":0,"allocated":14016512,"data_stored":7713489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":331855175},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":260,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002843"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275511+0000","last_change":"2023-10-08T08:42:01.146976+0000","last_active":"2023-10-08T08:42:39.275511+0000","last_peered":"2023-10-08T08:42:39.275511+0000","last_clean":"2023-10-08T08:42:39.275511+0000","last_became_active":"2023-10-08T08:42:01.146184+0000","last_became_peered":"2023-10-08T08:42:01.146184+0000","last_unstale":"2023-10-08T08:42:39.275511+0000","last_undegraded":"2023-10-08T08:42:39.275511+0000","last_fullsized":"2023-10-08T08:42:39.275511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:35.571911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273896+0000","last_change":"2023-10-08T08:42:01.142007+0000","last_active":"2023-10-08T08:42:39.273896+0000","last_peered":"2023-10-08T08:42:39.273896+0000","last_clean":"2023-10-08T08:42:39.273896+0000","last_became_active":"2023-10-08T08:42:01.141630+0000","last_became_peered":"2023-10-08T08:42:01.141630+0000","last_unstale":"2023-10-08T08:42:39.273896+0000","last_undegraded":"2023-10-08T08:42:39.273896+0000","last_fullsized":"2023-10-08T08:42:39.273896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:00:53.307828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272914+0000","last_change":"2023-10-08T08:42:01.154742+0000","last_active":"2023-10-08T08:42:39.272914+0000","last_peered":"2023-10-08T08:42:39.272914+0000","last_clean":"2023-10-08T08:42:39.272914+0000","last_became_active":"2023-10-08T08:42:01.154439+0000","last_became_peered":"2023-10-08T08:42:01.154439+0000","last_unstale":"2023-10-08T08:42:39.272914+0000","last_undegraded":"2023-10-08T08:42:39.272914+0000","last_fullsized":"2023-10-08T08:42:39.272914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:23.990594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270927+0000","last_change":"2023-10-08T08:42:01.149940+0000","last_active":"2023-10-08T08:42:39.270927+0000","last_peered":"2023-10-08T08:42:39.270927+0000","last_clean":"2023-10-08T08:42:39.270927+0000","last_became_active":"2023-10-08T08:42:01.149628+0000","last_became_peered":"2023-10-08T08:42:01.149628+0000","last_unstale":"2023-10-08T08:42:39.270927+0000","last_undegraded":"2023-10-08T08:42:39.270927+0000","last_fullsized":"2023-10-08T08:42:39.270927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:38.961102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272780+0000","last_change":"2023-10-08T08:42:01.145396+0000","last_active":"2023-10-08T08:42:39.272780+0000","last_peered":"2023-10-08T08:42:39.272780+0000","last_clean":"2023-10-08T08:42:39.272780+0000","last_became_active":"2023-10-08T08:42:01.140511+0000","last_became_peered":"2023-10-08T08:42:01.140511+0000","last_unstale":"2023-10-08T08:42:39.272780+0000","last_undegraded":"2023-10-08T08:42:39.272780+0000","last_fullsized":"2023-10-08T08:42:39.272780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:38.079768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273059+0000","last_change":"2023-10-08T08:42:01.128798+0000","last_active":"2023-10-08T08:42:39.273059+0000","last_peered":"2023-10-08T08:42:39.273059+0000","last_clean":"2023-10-08T08:42:39.273059+0000","last_became_active":"2023-10-08T08:42:01.128485+0000","last_became_peered":"2023-10-08T08:42:01.128485+0000","last_unstale":"2023-10-08T08:42:39.273059+0000","last_undegraded":"2023-10-08T08:42:39.273059+0000","last_fullsized":"2023-10-08T08:42:39.273059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:33:59.121551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277231+0000","last_change":"2023-10-08T08:42:01.136315+0000","last_active":"2023-10-08T08:42:39.277231+0000","last_peered":"2023-10-08T08:42:39.277231+0000","last_clean":"2023-10-08T08:42:39.277231+0000","last_became_active":"2023-10-08T08:42:01.136025+0000","last_became_peered":"2023-10-08T08:42:01.136025+0000","last_unstale":"2023-10-08T08:42:39.277231+0000","last_undegraded":"2023-10-08T08:42:39.277231+0000","last_fullsized":"2023-10-08T08:42:39.277231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:35.675920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269573+0000","last_change":"2023-10-08T08:42:01.129839+0000","last_active":"2023-10-08T08:42:39.269573+0000","last_peered":"2023-10-08T08:42:39.269573+0000","last_clean":"2023-10-08T08:42:39.269573+0000","last_became_active":"2023-10-08T08:42:01.129524+0000","last_became_peered":"2023-10-08T08:42:01.129524+0000","last_unstale":"2023-10-08T08:42:39.269573+0000","last_undegraded":"2023-10-08T08:42:39.269573+0000","last_fullsized":"2023-10-08T08:42:39.269573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:44.463024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276906+0000","last_change":"2023-10-08T08:42:01.135304+0000","last_active":"2023-10-08T08:42:39.276906+0000","last_peered":"2023-10-08T08:42:39.276906+0000","last_clean":"2023-10-08T08:42:39.276906+0000","last_became_active":"2023-10-08T08:42:01.134978+0000","last_became_peered":"2023-10-08T08:42:01.134978+0000","last_unstale":"2023-10-08T08:42:39.276906+0000","last_undegraded":"2023-10-08T08:42:39.276906+0000","last_fullsized":"2023-10-08T08:42:39.276906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:46:03.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273758+0000","last_change":"2023-10-08T08:42:01.134686+0000","last_active":"2023-10-08T08:42:39.273758+0000","last_peered":"2023-10-08T08:42:39.273758+0000","last_clean":"2023-10-08T08:42:39.273758+0000","last_became_active":"2023-10-08T08:42:01.134360+0000","last_became_peered":"2023-10-08T08:42:01.134360+0000","last_unstale":"2023-10-08T08:42:39.273758+0000","last_undegraded":"2023-10-08T08:42:39.273758+0000","last_fullsized":"2023-10-08T08:42:39.273758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:56.814182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278374+0000","last_change":"2023-10-08T08:42:01.148309+0000","last_active":"2023-10-08T08:42:39.278374+0000","last_peered":"2023-10-08T08:42:39.278374+0000","last_clean":"2023-10-08T08:42:39.278374+0000","last_became_active":"2023-10-08T08:42:01.147964+0000","last_became_peered":"2023-10-08T08:42:01.147964+0000","last_unstale":"2023-10-08T08:42:39.278374+0000","last_undegraded":"2023-10-08T08:42:39.278374+0000","last_fullsized":"2023-10-08T08:42:39.278374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:45.418572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270831+0000","last_change":"2023-10-08T08:42:01.148141+0000","last_active":"2023-10-08T08:42:39.270831+0000","last_peered":"2023-10-08T08:42:39.270831+0000","last_clean":"2023-10-08T08:42:39.270831+0000","last_became_active":"2023-10-08T08:42:01.147788+0000","last_became_peered":"2023-10-08T08:42:01.147788+0000","last_unstale":"2023-10-08T08:42:39.270831+0000","last_undegraded":"2023-10-08T08:42:39.270831+0000","last_fullsized":"2023-10-08T08:42:39.270831+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:37.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696516+0000","last_change":"2023-10-08T08:42:40.696516+0000","last_active":"2023-10-08T08:42:40.696516+0000","last_peered":"2023-10-08T08:42:40.696516+0000","last_clean":"2023-10-08T08:42:40.696516+0000","last_became_active":"2023-10-08T08:42:40.696193+0000","last_became_peered":"2023-10-08T08:42:40.696193+0000","last_unstale":"2023-10-08T08:42:40.696516+0000","last_undegraded":"2023-10-08T08:42:40.696516+0000","last_fullsized":"2023-10-08T08:42:40.696516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:40:57.843021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:01.148031+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:01.147785+0000","last_became_peered":"2023-10-08T08:42:01.147785+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:43.702638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272901+0000","last_change":"2023-10-08T08:42:01.154669+0000","last_active":"2023-10-08T08:42:39.272901+0000","last_peered":"2023-10-08T08:42:39.272901+0000","last_clean":"2023-10-08T08:42:39.272901+0000","last_became_active":"2023-10-08T08:42:01.154385+0000","last_became_peered":"2023-10-08T08:42:01.154385+0000","last_unstale":"2023-10-08T08:42:39.272901+0000","last_undegraded":"2023-10-08T08:42:39.272901+0000","last_fullsized":"2023-10-08T08:42:39.272901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:41.654979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275659+0000","last_change":"2023-10-08T08:42:01.143017+0000","last_active":"2023-10-08T08:42:39.275659+0000","last_peered":"2023-10-08T08:42:39.275659+0000","last_clean":"2023-10-08T08:42:39.275659+0000","last_became_active":"2023-10-08T08:42:01.142728+0000","last_became_peered":"2023-10-08T08:42:01.142728+0000","last_unstale":"2023-10-08T08:42:39.275659+0000","last_undegraded":"2023-10-08T08:42:39.275659+0000","last_fullsized":"2023-10-08T08:42:39.275659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.303212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275414+0000","last_change":"2023-10-08T08:42:01.147335+0000","last_active":"2023-10-08T08:42:39.275414+0000","last_peered":"2023-10-08T08:42:39.275414+0000","last_clean":"2023-10-08T08:42:39.275414+0000","last_became_active":"2023-10-08T08:42:01.146641+0000","last_became_peered":"2023-10-08T08:42:01.146641+0000","last_unstale":"2023-10-08T08:42:39.275414+0000","last_undegraded":"2023-10-08T08:42:39.275414+0000","last_fullsized":"2023-10-08T08:42:39.275414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:27.274207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275754+0000","last_change":"2023-10-08T08:42:01.132417+0000","last_active":"2023-10-08T08:42:39.275754+0000","last_peered":"2023-10-08T08:42:39.275754+0000","last_clean":"2023-10-08T08:42:39.275754+0000","last_became_active":"2023-10-08T08:42:01.132135+0000","last_became_peered":"2023-10-08T08:42:01.132135+0000","last_unstale":"2023-10-08T08:42:39.275754+0000","last_undegraded":"2023-10-08T08:42:39.275754+0000","last_fullsized":"2023-10-08T08:42:39.275754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:11.916677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279495+0000","last_change":"2023-10-08T08:42:01.136100+0000","last_active":"2023-10-08T08:42:39.279495+0000","last_peered":"2023-10-08T08:42:39.279495+0000","last_clean":"2023-10-08T08:42:39.279495+0000","last_became_active":"2023-10-08T08:42:01.135826+0000","last_became_peered":"2023-10-08T08:42:01.135826+0000","last_unstale":"2023-10-08T08:42:39.279495+0000","last_undegraded":"2023-10-08T08:42:39.279495+0000","last_fullsized":"2023-10-08T08:42:39.279495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:03.734296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279138+0000","last_change":"2023-10-08T08:42:05.177765+0000","last_active":"2023-10-08T08:42:39.279138+0000","last_peered":"2023-10-08T08:42:39.279138+0000","last_clean":"2023-10-08T08:42:39.279138+0000","last_became_active":"2023-10-08T08:42:05.177362+0000","last_became_peered":"2023-10-08T08:42:05.177362+0000","last_unstale":"2023-10-08T08:42:39.279138+0000","last_undegraded":"2023-10-08T08:42:39.279138+0000","last_fullsized":"2023-10-08T08:42:39.279138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:21.921686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":109,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.197326+0000","last_change":"2023-10-08T08:42:00.111581+0000","last_active":"2023-10-08T08:43:43.197326+0000","last_peered":"2023-10-08T08:43:43.197326+0000","last_clean":"2023-10-08T08:43:43.197326+0000","last_became_active":"2023-10-08T08:42:00.111298+0000","last_became_peered":"2023-10-08T08:42:00.111298+0000","last_unstale":"2023-10-08T08:43:43.197326+0000","last_undegraded":"2023-10-08T08:43:43.197326+0000","last_fullsized":"2023-10-08T08:43:43.197326+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:52:39.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270526+0000","last_change":"2023-10-08T08:42:01.134630+0000","last_active":"2023-10-08T08:42:39.270526+0000","last_peered":"2023-10-08T08:42:39.270526+0000","last_clean":"2023-10-08T08:42:39.270526+0000","last_became_active":"2023-10-08T08:42:01.134347+0000","last_became_peered":"2023-10-08T08:42:01.134347+0000","last_unstale":"2023-10-08T08:42:39.270526+0000","last_undegraded":"2023-10-08T08:42:39.270526+0000","last_fullsized":"2023-10-08T08:42:39.270526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:51:14.364756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270287+0000","last_change":"2023-10-08T08:42:05.177223+0000","last_active":"2023-10-08T08:42:39.270287+0000","last_peered":"2023-10-08T08:42:39.270287+0000","last_clean":"2023-10-08T08:42:39.270287+0000","last_became_active":"2023-10-08T08:42:05.176811+0000","last_became_peered":"2023-10-08T08:42:05.176811+0000","last_unstale":"2023-10-08T08:42:39.270287+0000","last_undegraded":"2023-10-08T08:42:39.270287+0000","last_fullsized":"2023-10-08T08:42:39.270287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:41.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270575+0000","last_change":"2023-10-08T08:42:00.115860+0000","last_active":"2023-10-08T08:42:39.270575+0000","last_peered":"2023-10-08T08:42:39.270575+0000","last_clean":"2023-10-08T08:42:39.270575+0000","last_became_active":"2023-10-08T08:42:00.115601+0000","last_became_peered":"2023-10-08T08:42:00.115601+0000","last_unstale":"2023-10-08T08:42:39.270575+0000","last_undegraded":"2023-10-08T08:42:39.270575+0000","last_fullsized":"2023-10-08T08:42:39.270575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:20.071545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274100+0000","last_change":"2023-10-08T08:42:01.146648+0000","last_active":"2023-10-08T08:42:39.274100+0000","last_peered":"2023-10-08T08:42:39.274100+0000","last_clean":"2023-10-08T08:42:39.274100+0000","last_became_active":"2023-10-08T08:42:01.145978+0000","last_became_peered":"2023-10-08T08:42:01.145978+0000","last_unstale":"2023-10-08T08:42:39.274100+0000","last_undegraded":"2023-10-08T08:42:39.274100+0000","last_fullsized":"2023-10-08T08:42:39.274100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:55.768519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270396+0000","last_change":"2023-10-08T08:42:05.185079+0000","last_active":"2023-10-08T08:42:39.270396+0000","last_peered":"2023-10-08T08:42:39.270396+0000","last_clean":"2023-10-08T08:42:39.270396+0000","last_became_active":"2023-10-08T08:42:05.184521+0000","last_became_peered":"2023-10-08T08:42:05.184521+0000","last_unstale":"2023-10-08T08:42:39.270396+0000","last_undegraded":"2023-10-08T08:42:39.270396+0000","last_fullsized":"2023-10-08T08:42:39.270396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:39:17.457051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273959+0000","last_change":"2023-10-08T08:42:00.112111+0000","last_active":"2023-10-08T08:42:39.273959+0000","last_peered":"2023-10-08T08:42:39.273959+0000","last_clean":"2023-10-08T08:42:39.273959+0000","last_became_active":"2023-10-08T08:42:00.111808+0000","last_became_peered":"2023-10-08T08:42:00.111808+0000","last_unstale":"2023-10-08T08:42:39.273959+0000","last_undegraded":"2023-10-08T08:42:39.273959+0000","last_fullsized":"2023-10-08T08:42:39.273959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:03.022378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276049+0000","last_change":"2023-10-08T08:42:01.133308+0000","last_active":"2023-10-08T08:42:39.276049+0000","last_peered":"2023-10-08T08:42:39.276049+0000","last_clean":"2023-10-08T08:42:39.276049+0000","last_became_active":"2023-10-08T08:42:01.131649+0000","last_became_peered":"2023-10-08T08:42:01.131649+0000","last_unstale":"2023-10-08T08:42:39.276049+0000","last_undegraded":"2023-10-08T08:42:39.276049+0000","last_fullsized":"2023-10-08T08:42:39.276049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:05.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270293+0000","last_change":"2023-10-08T08:42:05.182409+0000","last_active":"2023-10-08T08:42:39.270293+0000","last_peered":"2023-10-08T08:42:39.270293+0000","last_clean":"2023-10-08T08:42:39.270293+0000","last_became_active":"2023-10-08T08:42:05.181974+0000","last_became_peered":"2023-10-08T08:42:05.181974+0000","last_unstale":"2023-10-08T08:42:39.270293+0000","last_undegraded":"2023-10-08T08:42:39.270293+0000","last_fullsized":"2023-10-08T08:42:39.270293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:54:05.821339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273251+0000","last_change":"2023-10-08T08:42:00.113287+0000","last_active":"2023-10-08T08:42:39.273251+0000","last_peered":"2023-10-08T08:42:39.273251+0000","last_clean":"2023-10-08T08:42:39.273251+0000","last_became_active":"2023-10-08T08:42:00.112996+0000","last_became_peered":"2023-10-08T08:42:00.112996+0000","last_unstale":"2023-10-08T08:42:39.273251+0000","last_undegraded":"2023-10-08T08:42:39.273251+0000","last_fullsized":"2023-10-08T08:42:39.273251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:42.559360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276426+0000","last_change":"2023-10-08T08:42:01.139763+0000","last_active":"2023-10-08T08:42:39.276426+0000","last_peered":"2023-10-08T08:42:39.276426+0000","last_clean":"2023-10-08T08:42:39.276426+0000","last_became_active":"2023-10-08T08:42:01.139451+0000","last_became_peered":"2023-10-08T08:42:01.139451+0000","last_unstale":"2023-10-08T08:42:39.276426+0000","last_undegraded":"2023-10-08T08:42:39.276426+0000","last_fullsized":"2023-10-08T08:42:39.276426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:58:10.166151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279067+0000","last_change":"2023-10-08T08:42:05.174612+0000","last_active":"2023-10-08T08:42:39.279067+0000","last_peered":"2023-10-08T08:42:39.279067+0000","last_clean":"2023-10-08T08:42:39.279067+0000","last_became_active":"2023-10-08T08:42:05.174174+0000","last_became_peered":"2023-10-08T08:42:05.174174+0000","last_unstale":"2023-10-08T08:42:39.279067+0000","last_undegraded":"2023-10-08T08:42:39.279067+0000","last_fullsized":"2023-10-08T08:42:39.279067+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:07.364562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.192622+0000","last_change":"2023-10-08T08:42:00.112537+0000","last_active":"2023-10-08T08:43:43.192622+0000","last_peered":"2023-10-08T08:43:43.192622+0000","last_clean":"2023-10-08T08:43:43.192622+0000","last_became_active":"2023-10-08T08:42:00.112060+0000","last_became_peered":"2023-10-08T08:42:00.112060+0000","last_unstale":"2023-10-08T08:43:43.192622+0000","last_undegraded":"2023-10-08T08:43:43.192622+0000","last_fullsized":"2023-10-08T08:43:43.192622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:41.878960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273799+0000","last_change":"2023-10-08T08:42:01.146929+0000","last_active":"2023-10-08T08:42:39.273799+0000","last_peered":"2023-10-08T08:42:39.273799+0000","last_clean":"2023-10-08T08:42:39.273799+0000","last_became_active":"2023-10-08T08:42:01.145980+0000","last_became_peered":"2023-10-08T08:42:01.145980+0000","last_unstale":"2023-10-08T08:42:39.273799+0000","last_undegraded":"2023-10-08T08:42:39.273799+0000","last_fullsized":"2023-10-08T08:42:39.273799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:26:37.411832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.443543+0000","last_change":"2023-10-08T08:42:40.443543+0000","last_active":"2023-10-08T08:42:40.443543+0000","last_peered":"2023-10-08T08:42:40.443543+0000","last_clean":"2023-10-08T08:42:40.443543+0000","last_became_active":"2023-10-08T08:42:40.443041+0000","last_became_peered":"2023-10-08T08:42:40.443041+0000","last_unstale":"2023-10-08T08:42:40.443543+0000","last_undegraded":"2023-10-08T08:42:40.443543+0000","last_fullsized":"2023-10-08T08:42:40.443543+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:21:35.827659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272970+0000","last_change":"2023-10-08T08:42:00.115656+0000","last_active":"2023-10-08T08:42:39.272970+0000","last_peered":"2023-10-08T08:42:39.272970+0000","last_clean":"2023-10-08T08:42:39.272970+0000","last_became_active":"2023-10-08T08:42:00.115342+0000","last_became_peered":"2023-10-08T08:42:00.115342+0000","last_unstale":"2023-10-08T08:42:39.272970+0000","last_undegraded":"2023-10-08T08:42:39.272970+0000","last_fullsized":"2023-10-08T08:42:39.272970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:32.630853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277813+0000","last_change":"2023-10-08T08:42:01.139137+0000","last_active":"2023-10-08T08:42:39.277813+0000","last_peered":"2023-10-08T08:42:39.277813+0000","last_clean":"2023-10-08T08:42:39.277813+0000","last_became_active":"2023-10-08T08:42:01.138510+0000","last_became_peered":"2023-10-08T08:42:01.138510+0000","last_unstale":"2023-10-08T08:42:39.277813+0000","last_undegraded":"2023-10-08T08:42:39.277813+0000","last_fullsized":"2023-10-08T08:42:39.277813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:16:28.875148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275308+0000","last_change":"2023-10-08T08:42:05.179770+0000","last_active":"2023-10-08T08:42:39.275308+0000","last_peered":"2023-10-08T08:42:39.275308+0000","last_clean":"2023-10-08T08:42:39.275308+0000","last_became_active":"2023-10-08T08:42:05.179312+0000","last_became_peered":"2023-10-08T08:42:05.179312+0000","last_unstale":"2023-10-08T08:42:39.275308+0000","last_undegraded":"2023-10-08T08:42:39.275308+0000","last_fullsized":"2023-10-08T08:42:39.275308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.947270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276681+0000","last_change":"2023-10-08T08:42:00.111299+0000","last_active":"2023-10-08T08:42:39.276681+0000","last_peered":"2023-10-08T08:42:39.276681+0000","last_clean":"2023-10-08T08:42:39.276681+0000","last_became_active":"2023-10-08T08:42:00.110966+0000","last_became_peered":"2023-10-08T08:42:00.110966+0000","last_unstale":"2023-10-08T08:42:39.276681+0000","last_undegraded":"2023-10-08T08:42:39.276681+0000","last_fullsized":"2023-10-08T08:42:39.276681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:34.211598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269504+0000","last_change":"2023-10-08T08:42:01.134205+0000","last_active":"2023-10-08T08:42:39.269504+0000","last_peered":"2023-10-08T08:42:39.269504+0000","last_clean":"2023-10-08T08:42:39.269504+0000","last_became_active":"2023-10-08T08:42:01.133887+0000","last_became_peered":"2023-10-08T08:42:01.133887+0000","last_unstale":"2023-10-08T08:42:39.269504+0000","last_undegraded":"2023-10-08T08:42:39.269504+0000","last_fullsized":"2023-10-08T08:42:39.269504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:01.807150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273842+0000","last_change":"2023-10-08T08:42:05.179119+0000","last_active":"2023-10-08T08:42:39.273842+0000","last_peered":"2023-10-08T08:42:39.273842+0000","last_clean":"2023-10-08T08:42:39.273842+0000","last_became_active":"2023-10-08T08:42:05.178712+0000","last_became_peered":"2023-10-08T08:42:05.178712+0000","last_unstale":"2023-10-08T08:42:39.273842+0000","last_undegraded":"2023-10-08T08:42:39.273842+0000","last_fullsized":"2023-10-08T08:42:39.273842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:54:38.514047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278470+0000","last_change":"2023-10-08T08:42:00.116426+0000","last_active":"2023-10-08T08:42:39.278470+0000","last_peered":"2023-10-08T08:42:39.278470+0000","last_clean":"2023-10-08T08:42:39.278470+0000","last_became_active":"2023-10-08T08:42:00.115313+0000","last_became_peered":"2023-10-08T08:42:00.115313+0000","last_unstale":"2023-10-08T08:42:39.278470+0000","last_undegraded":"2023-10-08T08:42:39.278470+0000","last_fullsized":"2023-10-08T08:42:39.278470+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:42.989380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275493+0000","last_change":"2023-10-08T08:42:01.129719+0000","last_active":"2023-10-08T08:42:39.275493+0000","last_peered":"2023-10-08T08:42:39.275493+0000","last_clean":"2023-10-08T08:42:39.275493+0000","last_became_active":"2023-10-08T08:42:01.129293+0000","last_became_peered":"2023-10-08T08:42:01.129293+0000","last_unstale":"2023-10-08T08:42:39.275493+0000","last_undegraded":"2023-10-08T08:42:39.275493+0000","last_fullsized":"2023-10-08T08:42:39.275493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:35.463614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269587+0000","last_change":"2023-10-08T08:42:05.172880+0000","last_active":"2023-10-08T08:42:39.269587+0000","last_peered":"2023-10-08T08:42:39.269587+0000","last_clean":"2023-10-08T08:42:39.269587+0000","last_became_active":"2023-10-08T08:42:05.172485+0000","last_became_peered":"2023-10-08T08:42:05.172485+0000","last_unstale":"2023-10-08T08:42:39.269587+0000","last_undegraded":"2023-10-08T08:42:39.269587+0000","last_fullsized":"2023-10-08T08:42:39.269587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:29.740318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.214391+0000","last_change":"2023-10-08T08:42:00.115206+0000","last_active":"2023-10-08T08:43:43.214391+0000","last_peered":"2023-10-08T08:43:43.214391+0000","last_clean":"2023-10-08T08:43:43.214391+0000","last_became_active":"2023-10-08T08:42:00.114905+0000","last_became_peered":"2023-10-08T08:42:00.114905+0000","last_unstale":"2023-10-08T08:43:43.214391+0000","last_undegraded":"2023-10-08T08:43:43.214391+0000","last_fullsized":"2023-10-08T08:43:43.214391+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:09.275317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276638+0000","last_change":"2023-10-08T08:42:01.141422+0000","last_active":"2023-10-08T08:42:39.276638+0000","last_peered":"2023-10-08T08:42:39.276638+0000","last_clean":"2023-10-08T08:42:39.276638+0000","last_became_active":"2023-10-08T08:42:01.140979+0000","last_became_peered":"2023-10-08T08:42:01.140979+0000","last_unstale":"2023-10-08T08:42:39.276638+0000","last_undegraded":"2023-10-08T08:42:39.276638+0000","last_fullsized":"2023-10-08T08:42:39.276638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:14.018786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275152+0000","last_change":"2023-10-08T08:42:05.184358+0000","last_active":"2023-10-08T08:42:39.275152+0000","last_peered":"2023-10-08T08:42:39.275152+0000","last_clean":"2023-10-08T08:42:39.275152+0000","last_became_active":"2023-10-08T08:42:05.183994+0000","last_became_peered":"2023-10-08T08:42:05.183994+0000","last_unstale":"2023-10-08T08:42:39.275152+0000","last_undegraded":"2023-10-08T08:42:39.275152+0000","last_fullsized":"2023-10-08T08:42:39.275152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:46.465110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277535+0000","last_change":"2023-10-08T08:42:00.115765+0000","last_active":"2023-10-08T08:42:39.277535+0000","last_peered":"2023-10-08T08:42:39.277535+0000","last_clean":"2023-10-08T08:42:39.277535+0000","last_became_active":"2023-10-08T08:42:00.115288+0000","last_became_peered":"2023-10-08T08:42:00.115288+0000","last_unstale":"2023-10-08T08:42:39.277535+0000","last_undegraded":"2023-10-08T08:42:39.277535+0000","last_fullsized":"2023-10-08T08:42:39.277535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:20.973280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273767+0000","last_change":"2023-10-08T08:42:01.143290+0000","last_active":"2023-10-08T08:42:39.273767+0000","last_peered":"2023-10-08T08:42:39.273767+0000","last_clean":"2023-10-08T08:42:39.273767+0000","last_became_active":"2023-10-08T08:42:01.143034+0000","last_became_peered":"2023-10-08T08:42:01.143034+0000","last_unstale":"2023-10-08T08:42:39.273767+0000","last_undegraded":"2023-10-08T08:42:39.273767+0000","last_fullsized":"2023-10-08T08:42:39.273767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:45.784275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.271060+0000","last_change":"2023-10-08T08:42:05.185022+0000","last_active":"2023-10-08T08:42:39.271060+0000","last_peered":"2023-10-08T08:42:39.271060+0000","last_clean":"2023-10-08T08:42:39.271060+0000","last_became_active":"2023-10-08T08:42:05.184476+0000","last_became_peered":"2023-10-08T08:42:05.184476+0000","last_unstale":"2023-10-08T08:42:39.271060+0000","last_undegraded":"2023-10-08T08:42:39.271060+0000","last_fullsized":"2023-10-08T08:42:39.271060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:14:04.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276317+0000","last_change":"2023-10-08T08:42:00.115556+0000","last_active":"2023-10-08T08:42:39.276317+0000","last_peered":"2023-10-08T08:42:39.276317+0000","last_clean":"2023-10-08T08:42:39.276317+0000","last_became_active":"2023-10-08T08:42:00.115251+0000","last_became_peered":"2023-10-08T08:42:00.115251+0000","last_unstale":"2023-10-08T08:42:39.276317+0000","last_undegraded":"2023-10-08T08:42:39.276317+0000","last_fullsized":"2023-10-08T08:42:39.276317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:55.439502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276120+0000","last_change":"2023-10-08T08:42:01.135969+0000","last_active":"2023-10-08T08:42:39.276120+0000","last_peered":"2023-10-08T08:42:39.276120+0000","last_clean":"2023-10-08T08:42:39.276120+0000","last_became_active":"2023-10-08T08:42:01.135615+0000","last_became_peered":"2023-10-08T08:42:01.135615+0000","last_unstale":"2023-10-08T08:42:39.276120+0000","last_undegraded":"2023-10-08T08:42:39.276120+0000","last_fullsized":"2023-10-08T08:42:39.276120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:23.153920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276151+0000","last_change":"2023-10-08T08:42:05.177904+0000","last_active":"2023-10-08T08:42:39.276151+0000","last_peered":"2023-10-08T08:42:39.276151+0000","last_clean":"2023-10-08T08:42:39.276151+0000","last_became_active":"2023-10-08T08:42:05.176397+0000","last_became_peered":"2023-10-08T08:42:05.176397+0000","last_unstale":"2023-10-08T08:42:39.276151+0000","last_undegraded":"2023-10-08T08:42:39.276151+0000","last_fullsized":"2023-10-08T08:42:39.276151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:50.134974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'14","reported_seq":185,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.192090+0000","last_change":"2023-10-08T08:42:00.114485+0000","last_active":"2023-10-08T08:43:43.192090+0000","last_peered":"2023-10-08T08:43:43.192090+0000","last_clean":"2023-10-08T08:43:43.192090+0000","last_became_active":"2023-10-08T08:42:00.114186+0000","last_became_peered":"2023-10-08T08:42:00.114186+0000","last_unstale":"2023-10-08T08:43:43.192090+0000","last_undegraded":"2023-10-08T08:43:43.192090+0000","last_fullsized":"2023-10-08T08:43:43.192090+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:30.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":80,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273394+0000","last_change":"2023-10-08T08:42:01.146627+0000","last_active":"2023-10-08T08:42:39.273394+0000","last_peered":"2023-10-08T08:42:39.273394+0000","last_clean":"2023-10-08T08:42:39.273394+0000","last_became_active":"2023-10-08T08:42:01.146332+0000","last_became_peered":"2023-10-08T08:42:01.146332+0000","last_unstale":"2023-10-08T08:42:39.273394+0000","last_undegraded":"2023-10-08T08:42:39.273394+0000","last_fullsized":"2023-10-08T08:42:39.273394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:51:00.825191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278530+0000","last_change":"2023-10-08T08:42:05.173257+0000","last_active":"2023-10-08T08:42:39.278530+0000","last_peered":"2023-10-08T08:42:39.278530+0000","last_clean":"2023-10-08T08:42:39.278530+0000","last_became_active":"2023-10-08T08:42:05.172891+0000","last_became_peered":"2023-10-08T08:42:05.172891+0000","last_unstale":"2023-10-08T08:42:39.278530+0000","last_undegraded":"2023-10-08T08:42:39.278530+0000","last_fullsized":"2023-10-08T08:42:39.278530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:32.802194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279368+0000","last_change":"2023-10-08T08:42:00.113330+0000","last_active":"2023-10-08T08:42:39.279368+0000","last_peered":"2023-10-08T08:42:39.279368+0000","last_clean":"2023-10-08T08:42:39.279368+0000","last_became_active":"2023-10-08T08:42:00.112183+0000","last_became_peered":"2023-10-08T08:42:00.112183+0000","last_unstale":"2023-10-08T08:42:39.279368+0000","last_undegraded":"2023-10-08T08:42:39.279368+0000","last_fullsized":"2023-10-08T08:42:39.279368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:48:13.158570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275089+0000","last_change":"2023-10-08T08:42:01.133854+0000","last_active":"2023-10-08T08:42:39.275089+0000","last_peered":"2023-10-08T08:42:39.275089+0000","last_clean":"2023-10-08T08:42:39.275089+0000","last_became_active":"2023-10-08T08:42:01.133540+0000","last_became_peered":"2023-10-08T08:42:01.133540+0000","last_unstale":"2023-10-08T08:42:39.275089+0000","last_undegraded":"2023-10-08T08:42:39.275089+0000","last_fullsized":"2023-10-08T08:42:39.275089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:50.011909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275437+0000","last_change":"2023-10-08T08:42:05.180359+0000","last_active":"2023-10-08T08:42:39.275437+0000","last_peered":"2023-10-08T08:42:39.275437+0000","last_clean":"2023-10-08T08:42:39.275437+0000","last_became_active":"2023-10-08T08:42:05.179877+0000","last_became_peered":"2023-10-08T08:42:05.179877+0000","last_unstale":"2023-10-08T08:42:39.275437+0000","last_undegraded":"2023-10-08T08:42:39.275437+0000","last_fullsized":"2023-10-08T08:42:39.275437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:52.926297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276709+0000","last_change":"2023-10-08T08:42:00.112036+0000","last_active":"2023-10-08T08:42:39.276709+0000","last_peered":"2023-10-08T08:42:39.276709+0000","last_clean":"2023-10-08T08:42:39.276709+0000","last_became_active":"2023-10-08T08:42:00.111710+0000","last_became_peered":"2023-10-08T08:42:00.111710+0000","last_unstale":"2023-10-08T08:42:39.276709+0000","last_undegraded":"2023-10-08T08:42:39.276709+0000","last_fullsized":"2023-10-08T08:42:39.276709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:58:16.004802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277573+0000","last_change":"2023-10-08T08:42:01.135245+0000","last_active":"2023-10-08T08:42:39.277573+0000","last_peered":"2023-10-08T08:42:39.277573+0000","last_clean":"2023-10-08T08:42:39.277573+0000","last_became_active":"2023-10-08T08:42:01.134941+0000","last_became_peered":"2023-10-08T08:42:01.134941+0000","last_unstale":"2023-10-08T08:42:39.277573+0000","last_undegraded":"2023-10-08T08:42:39.277573+0000","last_fullsized":"2023-10-08T08:42:39.277573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:08:13.745895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.282736+0000","last_change":"2023-10-08T08:42:40.281786+0000","last_active":"2023-10-08T08:42:40.282736+0000","last_peered":"2023-10-08T08:42:40.282736+0000","last_clean":"2023-10-08T08:42:40.282736+0000","last_became_active":"2023-10-08T08:42:40.280780+0000","last_became_peered":"2023-10-08T08:42:40.280780+0000","last_unstale":"2023-10-08T08:42:40.282736+0000","last_undegraded":"2023-10-08T08:42:40.282736+0000","last_fullsized":"2023-10-08T08:42:40.282736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:49.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":103,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:44.194302+0000","last_change":"2023-10-08T08:42:00.112610+0000","last_active":"2023-10-08T08:43:44.194302+0000","last_peered":"2023-10-08T08:43:44.194302+0000","last_clean":"2023-10-08T08:43:44.194302+0000","last_became_active":"2023-10-08T08:42:00.112313+0000","last_became_peered":"2023-10-08T08:42:00.112313+0000","last_unstale":"2023-10-08T08:43:44.194302+0000","last_undegraded":"2023-10-08T08:43:44.194302+0000","last_fullsized":"2023-10-08T08:43:44.194302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:32:35.940299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277060+0000","last_change":"2023-10-08T08:42:01.141538+0000","last_active":"2023-10-08T08:42:39.277060+0000","last_peered":"2023-10-08T08:42:39.277060+0000","last_clean":"2023-10-08T08:42:39.277060+0000","last_became_active":"2023-10-08T08:42:01.141241+0000","last_became_peered":"2023-10-08T08:42:01.141241+0000","last_unstale":"2023-10-08T08:42:39.277060+0000","last_undegraded":"2023-10-08T08:42:39.277060+0000","last_fullsized":"2023-10-08T08:42:39.277060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:41.539162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275573+0000","last_change":"2023-10-08T08:42:05.181949+0000","last_active":"2023-10-08T08:42:39.275573+0000","last_peered":"2023-10-08T08:42:39.275573+0000","last_clean":"2023-10-08T08:42:39.275573+0000","last_became_active":"2023-10-08T08:42:05.181532+0000","last_became_peered":"2023-10-08T08:42:05.181532+0000","last_unstale":"2023-10-08T08:42:39.275573+0000","last_undegraded":"2023-10-08T08:42:39.275573+0000","last_fullsized":"2023-10-08T08:42:39.275573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:44.035004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272872+0000","last_change":"2023-10-08T08:42:00.111175+0000","last_active":"2023-10-08T08:42:39.272872+0000","last_peered":"2023-10-08T08:42:39.272872+0000","last_clean":"2023-10-08T08:42:39.272872+0000","last_became_active":"2023-10-08T08:42:00.109672+0000","last_became_peered":"2023-10-08T08:42:00.109672+0000","last_unstale":"2023-10-08T08:42:39.272872+0000","last_undegraded":"2023-10-08T08:42:39.272872+0000","last_fullsized":"2023-10-08T08:42:39.272872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:42.715127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278596+0000","last_change":"2023-10-08T08:42:01.133910+0000","last_active":"2023-10-08T08:42:39.278596+0000","last_peered":"2023-10-08T08:42:39.278596+0000","last_clean":"2023-10-08T08:42:39.278596+0000","last_became_active":"2023-10-08T08:42:01.132738+0000","last_became_peered":"2023-10-08T08:42:01.132738+0000","last_unstale":"2023-10-08T08:42:39.278596+0000","last_undegraded":"2023-10-08T08:42:39.278596+0000","last_fullsized":"2023-10-08T08:42:39.278596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:19.966595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276206+0000","last_change":"2023-10-08T08:42:05.177048+0000","last_active":"2023-10-08T08:42:39.276206+0000","last_peered":"2023-10-08T08:42:39.276206+0000","last_clean":"2023-10-08T08:42:39.276206+0000","last_became_active":"2023-10-08T08:42:05.176654+0000","last_became_peered":"2023-10-08T08:42:05.176654+0000","last_unstale":"2023-10-08T08:42:39.276206+0000","last_undegraded":"2023-10-08T08:42:39.276206+0000","last_fullsized":"2023-10-08T08:42:39.276206+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:22.424769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274788+0000","last_change":"2023-10-08T08:42:00.112684+0000","last_active":"2023-10-08T08:42:39.274788+0000","last_peered":"2023-10-08T08:42:39.274788+0000","last_clean":"2023-10-08T08:42:39.274788+0000","last_became_active":"2023-10-08T08:42:00.112235+0000","last_became_peered":"2023-10-08T08:42:00.112235+0000","last_unstale":"2023-10-08T08:42:39.274788+0000","last_undegraded":"2023-10-08T08:42:39.274788+0000","last_fullsized":"2023-10-08T08:42:39.274788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:47.984940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276005+0000","last_change":"2023-10-08T08:42:01.133393+0000","last_active":"2023-10-08T08:42:39.276005+0000","last_peered":"2023-10-08T08:42:39.276005+0000","last_clean":"2023-10-08T08:42:39.276005+0000","last_became_active":"2023-10-08T08:42:01.133121+0000","last_became_peered":"2023-10-08T08:42:01.133121+0000","last_unstale":"2023-10-08T08:42:39.276005+0000","last_undegraded":"2023-10-08T08:42:39.276005+0000","last_fullsized":"2023-10-08T08:42:39.276005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:54.542269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.281572+0000","last_change":"2023-10-08T08:42:40.281572+0000","last_active":"2023-10-08T08:42:40.281572+0000","last_peered":"2023-10-08T08:42:40.281572+0000","last_clean":"2023-10-08T08:42:40.281572+0000","last_became_active":"2023-10-08T08:42:40.280996+0000","last_became_peered":"2023-10-08T08:42:40.280996+0000","last_unstale":"2023-10-08T08:42:40.281572+0000","last_undegraded":"2023-10-08T08:42:40.281572+0000","last_fullsized":"2023-10-08T08:42:40.281572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:11:34.435906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277067+0000","last_change":"2023-10-08T08:42:00.110059+0000","last_active":"2023-10-08T08:42:39.277067+0000","last_peered":"2023-10-08T08:42:39.277067+0000","last_clean":"2023-10-08T08:42:39.277067+0000","last_became_active":"2023-10-08T08:42:00.109743+0000","last_became_peered":"2023-10-08T08:42:00.109743+0000","last_unstale":"2023-10-08T08:42:39.277067+0000","last_undegraded":"2023-10-08T08:42:39.277067+0000","last_fullsized":"2023-10-08T08:42:39.277067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:03:40.950213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273339+0000","last_change":"2023-10-08T08:42:01.133595+0000","last_active":"2023-10-08T08:42:39.273339+0000","last_peered":"2023-10-08T08:42:39.273339+0000","last_clean":"2023-10-08T08:42:39.273339+0000","last_became_active":"2023-10-08T08:42:01.133268+0000","last_became_peered":"2023-10-08T08:42:01.133268+0000","last_unstale":"2023-10-08T08:42:39.273339+0000","last_undegraded":"2023-10-08T08:42:39.273339+0000","last_fullsized":"2023-10-08T08:42:39.273339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:49.571517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276328+0000","last_change":"2023-10-08T08:42:05.174472+0000","last_active":"2023-10-08T08:42:39.276328+0000","last_peered":"2023-10-08T08:42:39.276328+0000","last_clean":"2023-10-08T08:42:39.276328+0000","last_became_active":"2023-10-08T08:42:05.174073+0000","last_became_peered":"2023-10-08T08:42:05.174073+0000","last_unstale":"2023-10-08T08:42:39.276328+0000","last_undegraded":"2023-10-08T08:42:39.276328+0000","last_fullsized":"2023-10-08T08:42:39.276328+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:36.208008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":104,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:46.201935+0000","last_change":"2023-10-08T08:42:00.115978+0000","last_active":"2023-10-08T08:43:46.201935+0000","last_peered":"2023-10-08T08:43:46.201935+0000","last_clean":"2023-10-08T08:43:46.201935+0000","last_became_active":"2023-10-08T08:42:00.115670+0000","last_became_peered":"2023-10-08T08:42:00.115670+0000","last_unstale":"2023-10-08T08:43:46.201935+0000","last_undegraded":"2023-10-08T08:43:46.201935+0000","last_fullsized":"2023-10-08T08:43:46.201935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:11:41.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696927+0000","last_change":"2023-10-08T08:42:40.696927+0000","last_active":"2023-10-08T08:42:40.696927+0000","last_peered":"2023-10-08T08:42:40.696927+0000","last_clean":"2023-10-08T08:42:40.696927+0000","last_became_active":"2023-10-08T08:42:40.696534+0000","last_became_peered":"2023-10-08T08:42:40.696534+0000","last_unstale":"2023-10-08T08:42:40.696927+0000","last_undegraded":"2023-10-08T08:42:40.696927+0000","last_fullsized":"2023-10-08T08:42:40.696927+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:05.888834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275650+0000","last_change":"2023-10-08T08:42:05.177922+0000","last_active":"2023-10-08T08:42:39.275650+0000","last_peered":"2023-10-08T08:42:39.275650+0000","last_clean":"2023-10-08T08:42:39.275650+0000","last_became_active":"2023-10-08T08:42:05.177504+0000","last_became_peered":"2023-10-08T08:42:05.177504+0000","last_unstale":"2023-10-08T08:42:39.275650+0000","last_undegraded":"2023-10-08T08:42:39.275650+0000","last_fullsized":"2023-10-08T08:42:39.275650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:02.602437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278640+0000","last_change":"2023-10-08T08:42:01.139125+0000","last_active":"2023-10-08T08:42:39.278640+0000","last_peered":"2023-10-08T08:42:39.278640+0000","last_clean":"2023-10-08T08:42:39.278640+0000","last_became_active":"2023-10-08T08:42:01.138769+0000","last_became_peered":"2023-10-08T08:42:01.138769+0000","last_unstale":"2023-10-08T08:42:39.278640+0000","last_undegraded":"2023-10-08T08:42:39.278640+0000","last_fullsized":"2023-10-08T08:42:39.278640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:31:57.717833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":104,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:46.196245+0000","last_change":"2023-10-08T08:42:00.115528+0000","last_active":"2023-10-08T08:43:46.196245+0000","last_peered":"2023-10-08T08:43:46.196245+0000","last_clean":"2023-10-08T08:43:46.196245+0000","last_became_active":"2023-10-08T08:42:00.115189+0000","last_became_peered":"2023-10-08T08:42:00.115189+0000","last_unstale":"2023-10-08T08:43:46.196245+0000","last_undegraded":"2023-10-08T08:43:46.196245+0000","last_fullsized":"2023-10-08T08:43:46.196245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.254073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.695382+0000","last_change":"2023-10-08T08:42:40.695382+0000","last_active":"2023-10-08T08:42:40.695382+0000","last_peered":"2023-10-08T08:42:40.695382+0000","last_clean":"2023-10-08T08:42:40.695382+0000","last_became_active":"2023-10-08T08:42:40.695009+0000","last_became_peered":"2023-10-08T08:42:40.695009+0000","last_unstale":"2023-10-08T08:42:40.695382+0000","last_undegraded":"2023-10-08T08:42:40.695382+0000","last_fullsized":"2023-10-08T08:42:40.695382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:35.298546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269706+0000","last_change":"2023-10-08T08:42:01.131992+0000","last_active":"2023-10-08T08:42:39.269706+0000","last_peered":"2023-10-08T08:42:39.269706+0000","last_clean":"2023-10-08T08:42:39.269706+0000","last_became_active":"2023-10-08T08:42:01.131633+0000","last_became_peered":"2023-10-08T08:42:01.131633+0000","last_unstale":"2023-10-08T08:42:39.269706+0000","last_undegraded":"2023-10-08T08:42:39.269706+0000","last_fullsized":"2023-10-08T08:42:39.269706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:40.653710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270531+0000","last_change":"2023-10-08T08:42:00.112987+0000","last_active":"2023-10-08T08:42:39.270531+0000","last_peered":"2023-10-08T08:42:39.270531+0000","last_clean":"2023-10-08T08:42:39.270531+0000","last_became_active":"2023-10-08T08:42:00.112276+0000","last_became_peered":"2023-10-08T08:42:00.112276+0000","last_unstale":"2023-10-08T08:42:39.270531+0000","last_undegraded":"2023-10-08T08:42:39.270531+0000","last_fullsized":"2023-10-08T08:42:39.270531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:17.193726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277082+0000","last_change":"2023-10-08T08:41:02.223132+0000","last_active":"2023-10-08T08:42:39.277082+0000","last_peered":"2023-10-08T08:42:39.277082+0000","last_clean":"2023-10-08T08:42:39.277082+0000","last_became_active":"2023-10-08T08:41:02.222688+0000","last_became_peered":"2023-10-08T08:41:02.222688+0000","last_unstale":"2023-10-08T08:42:39.277082+0000","last_undegraded":"2023-10-08T08:42:39.277082+0000","last_fullsized":"2023-10-08T08:42:39.277082+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:38:15.738972+0000","last_clean_scrub_stamp":"2023-10-08T08:38:15.738972+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:27.673603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276236+0000","last_change":"2023-10-08T08:42:05.169025+0000","last_active":"2023-10-08T08:42:39.276236+0000","last_peered":"2023-10-08T08:42:39.276236+0000","last_clean":"2023-10-08T08:42:39.276236+0000","last_became_active":"2023-10-08T08:42:05.168100+0000","last_became_peered":"2023-10-08T08:42:05.168100+0000","last_unstale":"2023-10-08T08:42:39.276236+0000","last_undegraded":"2023-10-08T08:42:39.276236+0000","last_fullsized":"2023-10-08T08:42:39.276236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:30:40.830952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276572+0000","last_change":"2023-10-08T08:42:01.130878+0000","last_active":"2023-10-08T08:42:39.276572+0000","last_peered":"2023-10-08T08:42:39.276572+0000","last_clean":"2023-10-08T08:42:39.276572+0000","last_became_active":"2023-10-08T08:42:01.130649+0000","last_became_peered":"2023-10-08T08:42:01.130649+0000","last_unstale":"2023-10-08T08:42:39.276572+0000","last_undegraded":"2023-10-08T08:42:39.276572+0000","last_fullsized":"2023-10-08T08:42:39.276572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:15.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277371+0000","last_change":"2023-10-08T08:42:00.117747+0000","last_active":"2023-10-08T08:42:39.277371+0000","last_peered":"2023-10-08T08:42:39.277371+0000","last_clean":"2023-10-08T08:42:39.277371+0000","last_became_active":"2023-10-08T08:42:00.117437+0000","last_became_peered":"2023-10-08T08:42:00.117437+0000","last_unstale":"2023-10-08T08:42:39.277371+0000","last_undegraded":"2023-10-08T08:42:39.277371+0000","last_fullsized":"2023-10-08T08:42:39.277371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:13.230721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274614+0000","last_change":"2023-10-08T08:42:05.173175+0000","last_active":"2023-10-08T08:42:39.274614+0000","last_peered":"2023-10-08T08:42:39.274614+0000","last_clean":"2023-10-08T08:42:39.274614+0000","last_became_active":"2023-10-08T08:42:05.172754+0000","last_became_peered":"2023-10-08T08:42:05.172754+0000","last_unstale":"2023-10-08T08:42:39.274614+0000","last_undegraded":"2023-10-08T08:42:39.274614+0000","last_fullsized":"2023-10-08T08:42:39.274614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:48.900020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273546+0000","last_change":"2023-10-08T08:42:00.117094+0000","last_active":"2023-10-08T08:42:39.273546+0000","last_peered":"2023-10-08T08:42:39.273546+0000","last_clean":"2023-10-08T08:42:39.273546+0000","last_became_active":"2023-10-08T08:42:00.116773+0000","last_became_peered":"2023-10-08T08:42:00.116773+0000","last_unstale":"2023-10-08T08:42:39.273546+0000","last_undegraded":"2023-10-08T08:42:39.273546+0000","last_fullsized":"2023-10-08T08:42:39.273546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:28.632901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276460+0000","last_change":"2023-10-08T08:42:01.146290+0000","last_active":"2023-10-08T08:42:39.276460+0000","last_peered":"2023-10-08T08:42:39.276460+0000","last_clean":"2023-10-08T08:42:39.276460+0000","last_became_active":"2023-10-08T08:42:01.145585+0000","last_became_peered":"2023-10-08T08:42:01.145585+0000","last_unstale":"2023-10-08T08:42:39.276460+0000","last_undegraded":"2023-10-08T08:42:39.276460+0000","last_fullsized":"2023-10-08T08:42:39.276460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:16:15.140659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269495+0000","last_change":"2023-10-08T08:42:05.177611+0000","last_active":"2023-10-08T08:42:39.269495+0000","last_peered":"2023-10-08T08:42:39.269495+0000","last_clean":"2023-10-08T08:42:39.269495+0000","last_became_active":"2023-10-08T08:42:05.177027+0000","last_became_peered":"2023-10-08T08:42:05.177027+0000","last_unstale":"2023-10-08T08:42:39.269495+0000","last_undegraded":"2023-10-08T08:42:39.269495+0000","last_fullsized":"2023-10-08T08:42:39.269495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:48.846359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275664+0000","last_change":"2023-10-08T08:42:00.112453+0000","last_active":"2023-10-08T08:42:39.275664+0000","last_peered":"2023-10-08T08:42:39.275664+0000","last_clean":"2023-10-08T08:42:39.275664+0000","last_became_active":"2023-10-08T08:42:00.112159+0000","last_became_peered":"2023-10-08T08:42:00.112159+0000","last_unstale":"2023-10-08T08:42:39.275664+0000","last_undegraded":"2023-10-08T08:42:39.275664+0000","last_fullsized":"2023-10-08T08:42:39.275664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:27.713764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270602+0000","last_change":"2023-10-08T08:42:01.136743+0000","last_active":"2023-10-08T08:42:39.270602+0000","last_peered":"2023-10-08T08:42:39.270602+0000","last_clean":"2023-10-08T08:42:39.270602+0000","last_became_active":"2023-10-08T08:42:01.136442+0000","last_became_peered":"2023-10-08T08:42:01.136442+0000","last_unstale":"2023-10-08T08:42:39.270602+0000","last_undegraded":"2023-10-08T08:42:39.270602+0000","last_fullsized":"2023-10-08T08:42:39.270602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:50:41.937240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278976+0000","last_change":"2023-10-08T08:42:05.171945+0000","last_active":"2023-10-08T08:42:39.278976+0000","last_peered":"2023-10-08T08:42:39.278976+0000","last_clean":"2023-10-08T08:42:39.278976+0000","last_became_active":"2023-10-08T08:42:05.171573+0000","last_became_peered":"2023-10-08T08:42:05.171573+0000","last_unstale":"2023-10-08T08:42:39.278976+0000","last_undegraded":"2023-10-08T08:42:39.278976+0000","last_fullsized":"2023-10-08T08:42:39.278976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:03.677144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270977+0000","last_change":"2023-10-08T08:42:00.116005+0000","last_active":"2023-10-08T08:42:39.270977+0000","last_peered":"2023-10-08T08:42:39.270977+0000","last_clean":"2023-10-08T08:42:39.270977+0000","last_became_active":"2023-10-08T08:42:00.115701+0000","last_became_peered":"2023-10-08T08:42:00.115701+0000","last_unstale":"2023-10-08T08:42:39.270977+0000","last_undegraded":"2023-10-08T08:42:39.270977+0000","last_fullsized":"2023-10-08T08:42:39.270977+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:03:46.114324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273957+0000","last_change":"2023-10-08T08:42:01.140370+0000","last_active":"2023-10-08T08:42:39.273957+0000","last_peered":"2023-10-08T08:42:39.273957+0000","last_clean":"2023-10-08T08:42:39.273957+0000","last_became_active":"2023-10-08T08:42:01.139923+0000","last_became_peered":"2023-10-08T08:42:01.139923+0000","last_unstale":"2023-10-08T08:42:39.273957+0000","last_undegraded":"2023-10-08T08:42:39.273957+0000","last_fullsized":"2023-10-08T08:42:39.273957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:07.052821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270782+0000","last_change":"2023-10-08T08:42:05.177542+0000","last_active":"2023-10-08T08:42:39.270782+0000","last_peered":"2023-10-08T08:42:39.270782+0000","last_clean":"2023-10-08T08:42:39.270782+0000","last_became_active":"2023-10-08T08:42:05.176808+0000","last_became_peered":"2023-10-08T08:42:05.176808+0000","last_unstale":"2023-10-08T08:42:39.270782+0000","last_undegraded":"2023-10-08T08:42:39.270782+0000","last_fullsized":"2023-10-08T08:42:39.270782+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:44.845948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.284070+0000","last_change":"2023-10-08T08:42:40.284070+0000","last_active":"2023-10-08T08:42:40.284070+0000","last_peered":"2023-10-08T08:42:40.284070+0000","last_clean":"2023-10-08T08:42:40.284070+0000","last_became_active":"2023-10-08T08:42:40.280519+0000","last_became_peered":"2023-10-08T08:42:40.280519+0000","last_unstale":"2023-10-08T08:42:40.284070+0000","last_undegraded":"2023-10-08T08:42:40.284070+0000","last_fullsized":"2023-10-08T08:42:40.284070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:55:29.703074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272903+0000","last_change":"2023-10-08T08:42:01.139641+0000","last_active":"2023-10-08T08:42:39.272903+0000","last_peered":"2023-10-08T08:42:39.272903+0000","last_clean":"2023-10-08T08:42:39.272903+0000","last_became_active":"2023-10-08T08:42:01.139332+0000","last_became_peered":"2023-10-08T08:42:01.139332+0000","last_unstale":"2023-10-08T08:42:39.272903+0000","last_undegraded":"2023-10-08T08:42:39.272903+0000","last_fullsized":"2023-10-08T08:42:39.272903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:14.948944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278104+0000","last_change":"2023-10-08T08:42:05.180307+0000","last_active":"2023-10-08T08:42:39.278104+0000","last_peered":"2023-10-08T08:42:39.278104+0000","last_clean":"2023-10-08T08:42:39.278104+0000","last_became_active":"2023-10-08T08:42:05.179755+0000","last_became_peered":"2023-10-08T08:42:05.179755+0000","last_unstale":"2023-10-08T08:42:39.278104+0000","last_undegraded":"2023-10-08T08:42:39.278104+0000","last_fullsized":"2023-10-08T08:42:39.278104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:34.821395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269609+0000","last_change":"2023-10-08T08:42:00.112674+0000","last_active":"2023-10-08T08:42:39.269609+0000","last_peered":"2023-10-08T08:42:39.269609+0000","last_clean":"2023-10-08T08:42:39.269609+0000","last_became_active":"2023-10-08T08:42:00.110746+0000","last_became_peered":"2023-10-08T08:42:00.110746+0000","last_unstale":"2023-10-08T08:42:39.269609+0000","last_undegraded":"2023-10-08T08:42:39.269609+0000","last_fullsized":"2023-10-08T08:42:39.269609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:27.463811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274453+0000","last_change":"2023-10-08T08:42:01.150107+0000","last_active":"2023-10-08T08:42:39.274453+0000","last_peered":"2023-10-08T08:42:39.274453+0000","last_clean":"2023-10-08T08:42:39.274453+0000","last_became_active":"2023-10-08T08:42:01.149609+0000","last_became_peered":"2023-10-08T08:42:01.149609+0000","last_unstale":"2023-10-08T08:42:39.274453+0000","last_undegraded":"2023-10-08T08:42:39.274453+0000","last_fullsized":"2023-10-08T08:42:39.274453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:05.378286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270656+0000","last_change":"2023-10-08T08:42:05.177571+0000","last_active":"2023-10-08T08:42:39.270656+0000","last_peered":"2023-10-08T08:42:39.270656+0000","last_clean":"2023-10-08T08:42:39.270656+0000","last_became_active":"2023-10-08T08:42:05.177061+0000","last_became_peered":"2023-10-08T08:42:05.177061+0000","last_unstale":"2023-10-08T08:42:39.270656+0000","last_undegraded":"2023-10-08T08:42:39.270656+0000","last_fullsized":"2023-10-08T08:42:39.270656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:10.274262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.286517+0000","last_change":"2023-10-08T08:42:40.286517+0000","last_active":"2023-10-08T08:42:40.286517+0000","last_peered":"2023-10-08T08:42:40.286517+0000","last_clean":"2023-10-08T08:42:40.286517+0000","last_became_active":"2023-10-08T08:42:40.281562+0000","last_became_peered":"2023-10-08T08:42:40.281562+0000","last_unstale":"2023-10-08T08:42:40.286517+0000","last_undegraded":"2023-10-08T08:42:40.286517+0000","last_fullsized":"2023-10-08T08:42:40.286517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:23.313740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270339+0000","last_change":"2023-10-08T08:42:01.142209+0000","last_active":"2023-10-08T08:42:39.270339+0000","last_peered":"2023-10-08T08:42:39.270339+0000","last_clean":"2023-10-08T08:42:39.270339+0000","last_became_active":"2023-10-08T08:42:01.141911+0000","last_became_peered":"2023-10-08T08:42:01.141911+0000","last_unstale":"2023-10-08T08:42:39.270339+0000","last_undegraded":"2023-10-08T08:42:39.270339+0000","last_fullsized":"2023-10-08T08:42:39.270339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:00.066595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270619+0000","last_change":"2023-10-08T08:42:05.173463+0000","last_active":"2023-10-08T08:42:39.270619+0000","last_peered":"2023-10-08T08:42:39.270619+0000","last_clean":"2023-10-08T08:42:39.270619+0000","last_became_active":"2023-10-08T08:42:05.173045+0000","last_became_peered":"2023-10-08T08:42:05.173045+0000","last_unstale":"2023-10-08T08:42:39.270619+0000","last_undegraded":"2023-10-08T08:42:39.270619+0000","last_fullsized":"2023-10-08T08:42:39.270619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:10.774694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.272997+0000","last_change":"2023-10-08T08:42:00.111005+0000","last_active":"2023-10-08T08:42:39.272997+0000","last_peered":"2023-10-08T08:42:39.272997+0000","last_clean":"2023-10-08T08:42:39.272997+0000","last_became_active":"2023-10-08T08:42:00.110687+0000","last_became_peered":"2023-10-08T08:42:00.110687+0000","last_unstale":"2023-10-08T08:42:39.272997+0000","last_undegraded":"2023-10-08T08:42:39.272997+0000","last_fullsized":"2023-10-08T08:42:39.272997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:38.682150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277572+0000","last_change":"2023-10-08T08:42:01.144443+0000","last_active":"2023-10-08T08:42:39.277572+0000","last_peered":"2023-10-08T08:42:39.277572+0000","last_clean":"2023-10-08T08:42:39.277572+0000","last_became_active":"2023-10-08T08:42:01.143960+0000","last_became_peered":"2023-10-08T08:42:01.143960+0000","last_unstale":"2023-10-08T08:42:39.277572+0000","last_undegraded":"2023-10-08T08:42:39.277572+0000","last_fullsized":"2023-10-08T08:42:39.277572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:46:57.209569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275843+0000","last_change":"2023-10-08T08:42:05.178212+0000","last_active":"2023-10-08T08:42:39.275843+0000","last_peered":"2023-10-08T08:42:39.275843+0000","last_clean":"2023-10-08T08:42:39.275843+0000","last_became_active":"2023-10-08T08:42:05.177751+0000","last_became_peered":"2023-10-08T08:42:05.177751+0000","last_unstale":"2023-10-08T08:42:39.275843+0000","last_undegraded":"2023-10-08T08:42:39.275843+0000","last_fullsized":"2023-10-08T08:42:39.275843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:10.128104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:43:43.214954+0000","last_change":"2023-10-08T08:42:00.115576+0000","last_active":"2023-10-08T08:43:43.214954+0000","last_peered":"2023-10-08T08:43:43.214954+0000","last_clean":"2023-10-08T08:43:43.214954+0000","last_became_active":"2023-10-08T08:42:00.115296+0000","last_became_peered":"2023-10-08T08:42:00.115296+0000","last_unstale":"2023-10-08T08:43:43.214954+0000","last_undegraded":"2023-10-08T08:43:43.214954+0000","last_fullsized":"2023-10-08T08:43:43.214954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:22.392477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278387+0000","last_change":"2023-10-08T08:42:01.139104+0000","last_active":"2023-10-08T08:42:39.278387+0000","last_peered":"2023-10-08T08:42:39.278387+0000","last_clean":"2023-10-08T08:42:39.278387+0000","last_became_active":"2023-10-08T08:42:01.138653+0000","last_became_peered":"2023-10-08T08:42:01.138653+0000","last_unstale":"2023-10-08T08:42:39.278387+0000","last_undegraded":"2023-10-08T08:42:39.278387+0000","last_fullsized":"2023-10-08T08:42:39.278387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:24.784017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.273245+0000","last_change":"2023-10-08T08:42:05.186990+0000","last_active":"2023-10-08T08:42:39.273245+0000","last_peered":"2023-10-08T08:42:39.273245+0000","last_clean":"2023-10-08T08:42:39.273245+0000","last_became_active":"2023-10-08T08:42:05.186397+0000","last_became_peered":"2023-10-08T08:42:05.186397+0000","last_unstale":"2023-10-08T08:42:39.273245+0000","last_undegraded":"2023-10-08T08:42:39.273245+0000","last_fullsized":"2023-10-08T08:42:39.273245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:53.633137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276542+0000","last_change":"2023-10-08T08:42:00.114499+0000","last_active":"2023-10-08T08:42:39.276542+0000","last_peered":"2023-10-08T08:42:39.276542+0000","last_clean":"2023-10-08T08:42:39.276542+0000","last_became_active":"2023-10-08T08:42:00.114062+0000","last_became_peered":"2023-10-08T08:42:00.114062+0000","last_unstale":"2023-10-08T08:42:39.276542+0000","last_undegraded":"2023-10-08T08:42:39.276542+0000","last_fullsized":"2023-10-08T08:42:39.276542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:23.576889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277486+0000","last_change":"2023-10-08T08:42:01.139810+0000","last_active":"2023-10-08T08:42:39.277486+0000","last_peered":"2023-10-08T08:42:39.277486+0000","last_clean":"2023-10-08T08:42:39.277486+0000","last_became_active":"2023-10-08T08:42:01.139489+0000","last_became_peered":"2023-10-08T08:42:01.139489+0000","last_unstale":"2023-10-08T08:42:39.277486+0000","last_undegraded":"2023-10-08T08:42:39.277486+0000","last_fullsized":"2023-10-08T08:42:39.277486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:06.724645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278227+0000","last_change":"2023-10-08T08:42:05.172808+0000","last_active":"2023-10-08T08:42:39.278227+0000","last_peered":"2023-10-08T08:42:39.278227+0000","last_clean":"2023-10-08T08:42:39.278227+0000","last_became_active":"2023-10-08T08:42:05.172307+0000","last_became_peered":"2023-10-08T08:42:05.172307+0000","last_unstale":"2023-10-08T08:42:39.278227+0000","last_undegraded":"2023-10-08T08:42:39.278227+0000","last_fullsized":"2023-10-08T08:42:39.278227+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:04.148022+0000","last_clean_scrub_stamp":"2023-10-08T08:42:04.148022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.031070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275490+0000","last_change":"2023-10-08T08:42:00.112423+0000","last_active":"2023-10-08T08:42:39.275490+0000","last_peered":"2023-10-08T08:42:39.275490+0000","last_clean":"2023-10-08T08:42:39.275490+0000","last_became_active":"2023-10-08T08:42:00.112130+0000","last_became_peered":"2023-10-08T08:42:00.112130+0000","last_unstale":"2023-10-08T08:42:39.275490+0000","last_undegraded":"2023-10-08T08:42:39.275490+0000","last_fullsized":"2023-10-08T08:42:39.275490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:41:59.087079+0000","last_clean_scrub_stamp":"2023-10-08T08:41:59.087079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:54.898037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.277793+0000","last_change":"2023-10-08T08:42:01.148404+0000","last_active":"2023-10-08T08:42:39.277793+0000","last_peered":"2023-10-08T08:42:39.277793+0000","last_clean":"2023-10-08T08:42:39.277793+0000","last_became_active":"2023-10-08T08:42:01.148087+0000","last_became_peered":"2023-10-08T08:42:01.148087+0000","last_unstale":"2023-10-08T08:42:39.277793+0000","last_undegraded":"2023-10-08T08:42:39.277793+0000","last_fullsized":"2023-10-08T08:42:39.277793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:22:12.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.274525+0000","last_change":"2023-10-08T08:42:01.149762+0000","last_active":"2023-10-08T08:42:39.274525+0000","last_peered":"2023-10-08T08:42:39.274525+0000","last_clean":"2023-10-08T08:42:39.274525+0000","last_became_active":"2023-10-08T08:42:01.149392+0000","last_became_peered":"2023-10-08T08:42:01.149392+0000","last_unstale":"2023-10-08T08:42:39.274525+0000","last_undegraded":"2023-10-08T08:42:39.274525+0000","last_fullsized":"2023-10-08T08:42:39.274525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:22.487634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279392+0000","last_change":"2023-10-08T08:42:01.145106+0000","last_active":"2023-10-08T08:42:39.279392+0000","last_peered":"2023-10-08T08:42:39.279392+0000","last_clean":"2023-10-08T08:42:39.279392+0000","last_became_active":"2023-10-08T08:42:01.144709+0000","last_became_peered":"2023-10-08T08:42:01.144709+0000","last_unstale":"2023-10-08T08:42:39.279392+0000","last_undegraded":"2023-10-08T08:42:39.279392+0000","last_fullsized":"2023-10-08T08:42:39.279392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:24.248415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.280122+0000","last_change":"2023-10-08T08:42:01.148384+0000","last_active":"2023-10-08T08:42:39.280122+0000","last_peered":"2023-10-08T08:42:39.280122+0000","last_clean":"2023-10-08T08:42:39.280122+0000","last_became_active":"2023-10-08T08:42:01.148098+0000","last_became_peered":"2023-10-08T08:42:01.148098+0000","last_unstale":"2023-10-08T08:42:39.280122+0000","last_undegraded":"2023-10-08T08:42:39.280122+0000","last_fullsized":"2023-10-08T08:42:39.280122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:45.361279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.278516+0000","last_change":"2023-10-08T08:42:40.278516+0000","last_active":"2023-10-08T08:42:40.278516+0000","last_peered":"2023-10-08T08:42:40.278516+0000","last_clean":"2023-10-08T08:42:40.278516+0000","last_became_active":"2023-10-08T08:42:40.278111+0000","last_became_peered":"2023-10-08T08:42:40.278111+0000","last_unstale":"2023-10-08T08:42:40.278516+0000","last_undegraded":"2023-10-08T08:42:40.278516+0000","last_fullsized":"2023-10-08T08:42:40.278516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:32.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276507+0000","last_change":"2023-10-08T08:42:01.146486+0000","last_active":"2023-10-08T08:42:39.276507+0000","last_peered":"2023-10-08T08:42:39.276507+0000","last_clean":"2023-10-08T08:42:39.276507+0000","last_became_active":"2023-10-08T08:42:01.146002+0000","last_became_peered":"2023-10-08T08:42:01.146002+0000","last_unstale":"2023-10-08T08:42:39.276507+0000","last_undegraded":"2023-10-08T08:42:39.276507+0000","last_fullsized":"2023-10-08T08:42:39.276507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:28.217937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276175+0000","last_change":"2023-10-08T08:42:01.152380+0000","last_active":"2023-10-08T08:42:39.276175+0000","last_peered":"2023-10-08T08:42:39.276175+0000","last_clean":"2023-10-08T08:42:39.276175+0000","last_became_active":"2023-10-08T08:42:01.149760+0000","last_became_peered":"2023-10-08T08:42:01.149760+0000","last_unstale":"2023-10-08T08:42:39.276175+0000","last_undegraded":"2023-10-08T08:42:39.276175+0000","last_fullsized":"2023-10-08T08:42:39.276175+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:47:58.326416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.279642+0000","last_change":"2023-10-08T08:42:01.149593+0000","last_active":"2023-10-08T08:42:39.279642+0000","last_peered":"2023-10-08T08:42:39.279642+0000","last_clean":"2023-10-08T08:42:39.279642+0000","last_became_active":"2023-10-08T08:42:01.149235+0000","last_became_peered":"2023-10-08T08:42:01.149235+0000","last_unstale":"2023-10-08T08:42:39.279642+0000","last_undegraded":"2023-10-08T08:42:39.279642+0000","last_fullsized":"2023-10-08T08:42:39.279642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:51.379305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.270673+0000","last_change":"2023-10-08T08:42:01.133460+0000","last_active":"2023-10-08T08:42:39.270673+0000","last_peered":"2023-10-08T08:42:39.270673+0000","last_clean":"2023-10-08T08:42:39.270673+0000","last_became_active":"2023-10-08T08:42:01.133132+0000","last_became_peered":"2023-10-08T08:42:01.133132+0000","last_unstale":"2023-10-08T08:42:39.270673+0000","last_undegraded":"2023-10-08T08:42:39.270673+0000","last_fullsized":"2023-10-08T08:42:39.270673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:29.047135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.278661+0000","last_change":"2023-10-08T08:42:01.134274+0000","last_active":"2023-10-08T08:42:39.278661+0000","last_peered":"2023-10-08T08:42:39.278661+0000","last_clean":"2023-10-08T08:42:39.278661+0000","last_became_active":"2023-10-08T08:42:01.133040+0000","last_became_peered":"2023-10-08T08:42:01.133040+0000","last_unstale":"2023-10-08T08:42:39.278661+0000","last_undegraded":"2023-10-08T08:42:39.278661+0000","last_fullsized":"2023-10-08T08:42:39.278661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:18.054859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.269663+0000","last_change":"2023-10-08T08:42:01.128333+0000","last_active":"2023-10-08T08:42:39.269663+0000","last_peered":"2023-10-08T08:42:39.269663+0000","last_clean":"2023-10-08T08:42:39.269663+0000","last_became_active":"2023-10-08T08:42:01.128076+0000","last_became_peered":"2023-10-08T08:42:01.128076+0000","last_unstale":"2023-10-08T08:42:39.269663+0000","last_undegraded":"2023-10-08T08:42:39.269663+0000","last_fullsized":"2023-10-08T08:42:39.269663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.675185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.276377+0000","last_change":"2023-10-08T08:42:01.139518+0000","last_active":"2023-10-08T08:42:39.276377+0000","last_peered":"2023-10-08T08:42:39.276377+0000","last_clean":"2023-10-08T08:42:39.276377+0000","last_became_active":"2023-10-08T08:42:01.139217+0000","last_became_peered":"2023-10-08T08:42:01.139217+0000","last_unstale":"2023-10-08T08:42:39.276377+0000","last_undegraded":"2023-10-08T08:42:39.276377+0000","last_fullsized":"2023-10-08T08:42:39.276377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:05:02.485500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T08:42:39.275263+0000","last_change":"2023-10-08T08:42:01.142664+0000","last_active":"2023-10-08T08:42:39.275263+0000","last_peered":"2023-10-08T08:42:39.275263+0000","last_clean":"2023-10-08T08:42:39.275263+0000","last_became_active":"2023-10-08T08:42:01.142136+0000","last_became_peered":"2023-10-08T08:42:01.142136+0000","last_unstale":"2023-10-08T08:42:39.275263+0000","last_undegraded":"2023-10-08T08:42:39.275263+0000","last_fullsized":"2023-10-08T08:42:39.275263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:18.702123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T08:42:40.696535+0000","last_change":"2023-10-08T08:42:40.696535+0000","last_active":"2023-10-08T08:42:40.696535+0000","last_peered":"2023-10-08T08:42:40.696535+0000","last_clean":"2023-10-08T08:42:40.696535+0000","last_became_active":"2023-10-08T08:42:40.695973+0000","last_became_peered":"2023-10-08T08:42:40.695973+0000","last_unstale":"2023-10-08T08:42:40.696535+0000","last_undegraded":"2023-10-08T08:42:40.696535+0000","last_fullsized":"2023-10-08T08:42:40.696535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T08:42:00.093337+0000","last_clean_scrub_stamp":"2023-10-08T08:42:00.093337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:50.008782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10524,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":794,"num_read_kb":415,"num_write":211,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":31572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481825,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":494069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.60899999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.64400000000000002,"15min":0.63900000000000001},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88600000000000001,"5min":1.161,"15min":1.161},"last":0.73799999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.496},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73799999999999999,"5min":1.254,"15min":1.254},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Oct 8 08:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.622,"15min":0.60499999999999998},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.876},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67000000000000004,"15min":0.66200000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70299999999999996}]},{"osd":5,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.58399999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93000000000000005,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.747},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.68300000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.52600000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.024,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.72499999999999998,"15min":0.70799999999999996},"min":{"1min":0.53800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97999999999999998,"5min":1.196,"15min":1.196},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0449999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79000000000000004}]},{"osd":8,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.79900000000000004}]},{"osd":9,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.60399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.107,"5min":1.413,"15min":1.413},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.91700000000000004}]},{"osd":10,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.629,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0860000000000001,"5min":1.214,"15min":1.214},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.81299999999999994,"15min":0.80300000000000005},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0629999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.86499999999999999}]}]},{"osd":10,"up_from":70,"seq":300647710756,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1638400,"data_stored":1088563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":27654595},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.51200000000000001}]},{"osd":1,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.372}]},{"osd":2,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82599999999999996,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88900000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.83699999999999997,"5min":0.87,"15min":0.87},"last":0.44700000000000001}]},{"osd":5,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.51500000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0489999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93899999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:41:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.50700000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.032,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.55500000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.95599999999999996,"5min":1.23,"15min":1.23},"last":0.57999999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.998,"5min":1.208,"15min":1.208},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98399999999999999,"5min":1.173,"15min":1.173},"last":0.69699999999999995}]},{"osd":11,"last update":"Sun Oct 8 08:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82799999999999996,"15min":0.82999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97199999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.61599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.069},"last":0.75}]}]},{"osd":9,"up_from":65,"seq":279172874281,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":493739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.41899999999999998,"15min":0.42899999999999999},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.247},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.42699999999999999,"15min":0.44900000000000001},"min":{"1min":0.27000000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54900000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.33400000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72499999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81699999999999995,"5min":1.022,"15min":1.022},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2,"5min":2,"15min":2},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.32000000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.51300000000000001,"15min":0.53800000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.433}]},{"osd":4,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.498},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.40999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78000000000000003,"5min":1.028,"15min":1.028},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.41499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94499999999999995,"5min":0.995,"15min":0.995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67600000000000005,"15min":0.69499999999999995},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91500000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.621}]},{"osd":6,"last update":"Sun Oct 8 08:41:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39100000000000001}]},{"osd":7,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.69899999999999995,"15min":0.73299999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85599999999999998,"5min":1.151,"15min":1.151},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.70699999999999996,"15min":0.747},"min":{"1min":0.45800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.64500000000000002}]},{"osd":8,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73099999999999998,"15min":0.75800000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.70299999999999996}]},{"osd":10,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82499999999999996,"5min":1.216,"15min":1.216},"last":0.67400000000000004}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66400000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103214,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":494117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":1.256,"15min":1.256},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57799999999999996,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63700000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.51400000000000001}]},{"osd":1,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.60599999999999998,"15min":0.57799999999999996},"min":{"1min":0.58399999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63900000000000001,"15min":0.622},"min":{"1min":0.502,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.028,"15min":1.028},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.441},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.626,"5min":0.748,"15min":0.748},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67100000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63600000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.38700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76400000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78600000000000003,"5min":1.288,"15min":1.288},"last":0.54300000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.47099999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.67700000000000005,"15min":0.66000000000000003},"min":{"1min":0.66200000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72399999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58199999999999996,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.312,"15min":0.312},"max":{"1min":0.85199999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.87,"15min":0.87},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.75900000000000001},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.90000000000000002,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Sun Oct 8 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.67600000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71999999999999997,"15min":0.70799999999999996},"min":{"1min":0.64600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85699999999999998,"5min":1.026,"15min":1.026},"last":0.80500000000000005}]},{"osd":9,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.73199999999999998},"min":{"1min":0.60899999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.76300000000000001,"15min":0.73599999999999999},"min":{"1min":0.61399999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77100000000000002}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.76900000000000002,"15min":0.751},"min":{"1min":0.71799999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.052,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.78200000000000003,"15min":0.76500000000000001},"min":{"1min":0.73799999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.036,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.88}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.83199999999999996}]}]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1086127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41399999999999998,"15min":0.39700000000000002},"min":{"1min":0.312,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70299999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.432},"min":{"1min":0.33500000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73399999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.46800000000000003}]},{"osd":2,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82499999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.56499999999999995},"min":{"1min":0.51300000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73799999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63100000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55100000000000005,"15min":0.52700000000000002},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81499999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.41799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.502,"15min":0.49299999999999999},"min":{"1min":0.41699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.434}]},{"osd":5,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.89800000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.747},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.64100000000000001,"15min":0.61499999999999999},"min":{"1min":0.52600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89900000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.64100000000000001},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96499999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.42099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.024,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52700000000000002}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70699999999999996,"15min":0.69499999999999995},"min":{"1min":0.56399999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.995,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73299999999999998,"15min":0.71799999999999997},"min":{"1min":0.60099999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97199999999999998,"5min":1.234,"15min":1.234},"last":0.77700000000000002}]},{"osd":9,"last update":"Sun Oct 8 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.497,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84199999999999997,"5min":1.181,"15min":1.181},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.61099999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.86799999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68899999999999995}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.55500000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98899999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.64900000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91500000000000004,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73199999999999998}]},{"osd":11,"last update":"Sun Oct 8 08:43:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76300000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495669,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":493339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38,"15min":0.35699999999999998},"min":{"1min":0.27000000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52600000000000002,"5min":0.62,"15min":0.62},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.56200000000000006,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46200000000000002}]},{"osd":1,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.53700000000000003},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.80700000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.625}]},{"osd":2,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.55800000000000005},"min":{"1min":0.441,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80200000000000005,"5min":1.034,"15min":1.034},"last":0.69499999999999995}]},{"osd":3,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.54300000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.432},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.46500000000000002,"15min":0.46100000000000002},"min":{"1min":0.315,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56299999999999994,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57399999999999995,"15min":0.55800000000000005},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.75700000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73799999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61799999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.66900000000000004,"15min":0.627},"min":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79200000000000004,"5min":4.7670000000000003,"15min":4.7670000000000003},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64900000000000002,"15min":0.64400000000000002},"min":{"1min":0.442,"5min":0.379,"15min":0.379},"max":{"1min":0.95699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.49399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.96799999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68300000000000005}]},{"osd":8,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79700000000000004,"5min":1.087,"15min":1.087},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.47999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78100000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.71499999999999997}]},{"osd":9,"last update":"Sun Oct 8 08:43:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.65600000000000003,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81200000000000006,"5min":1.012,"15min":1.012},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.66800000000000004,"15min":0.70399999999999996},"min":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82199999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56000000000000005}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.58199999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.65300000000000002}]},{"osd":11,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542218,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":498211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.45400000000000001},"min":{"1min":0.29099999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.75900000000000001,"5min":1.242,"15min":1.242},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.44600000000000001},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.71699999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.55600000000000005,"15min":0.502},"min":{"1min":0.48899999999999999,"5min":0.246,"15min":0.246},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.56899999999999995,"15min":0.51500000000000001},"min":{"1min":0.33400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.45300000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.59599999999999997},"min":{"1min":0.41499999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81699999999999995,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.44900000000000001,"15min":0.42599999999999999},"min":{"1min":0.34300000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.40899999999999997},"min":{"1min":0.36599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.624,"15min":0.58299999999999996},"min":{"1min":0.54600000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.66500000000000004,"15min":0.627},"min":{"1min":0.46700000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.63900000000000001,"15min":0.59099999999999997},"min":{"1min":0.436,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.99299999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64900000000000002,"15min":0.64800000000000002},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93300000000000005,"5min":1.788,"15min":1.788},"last":0.65600000000000003}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.60699999999999998,"15min":0.57299999999999995},"min":{"1min":0.47999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.59799999999999998,"15min":0.56699999999999995},"min":{"1min":0.502,"5min":0.318,"15min":0.318},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.76600000000000001}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.67100000000000004,"15min":0.64100000000000001},"min":{"1min":0.59999999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.99299999999999999,"5min":1.002,"15min":1.002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.70599999999999996,"15min":0.67600000000000005},"min":{"1min":0.67400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70799999999999996}]},{"osd":9,"last update":"Sun Oct 8 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.72399999999999998,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.73499999999999999,"15min":0.70599999999999996},"min":{"1min":0.63600000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95899999999999996,"5min":1.044,"15min":1.044},"last":0.74399999999999999}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.69399999999999995,"15min":0.67500000000000004},"min":{"1min":0.54800000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.50600000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.86099999999999999}]},{"osd":11,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.88600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":495055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 08:43:09 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.56299999999999994,"15min":0.52300000000000002},"min":{"1min":0.46000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58899999999999997,"15min":0.53800000000000003},"min":{"1min":0.439,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55000000000000004}]},{"osd":2,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.433,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66900000000000004,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56899999999999995}]},{"osd":3,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.379},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52100000000000002,"15min":0.48599999999999999},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.79300000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.66600000000000004}]},{"osd":6,"last update":"Sun Oct 8 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.36799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65900000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41799999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.47499999999999998}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65800000000000003,"15min":0.64900000000000002},"min":{"1min":0.53600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.61299999999999999}]},{"osd":9,"last update":"Sun Oct 8 08:43:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66100000000000003,"15min":0.68100000000000005},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0860000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.51000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.63400000000000001}]},{"osd":10,"last update":"Sun Oct 8 08:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.53900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.755,"15min":0.755},"min":{"1min":0.59999999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.006,"15min":1.006},"last":0.624}]},{"osd":11,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.82199999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68799999999999994}]}]},{"osd":2,"up_from":19,"seq":81604378694,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":498431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.46999999999999997},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63400000000000001,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.48199999999999998},"min":{"1min":0.42899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.71599999999999997}]},{"osd":1,"last update":"Sun Oct 8 08:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54900000000000004,"15min":0.50700000000000001},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.86299999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.59799999999999998,"15min":0.53800000000000003},"min":{"1min":0.47999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89800000000000002,"5min":2.097,"15min":2.097},"last":0.77600000000000002}]},{"osd":3,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.55200000000000005},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80500000000000005,"5min":3.6800000000000002,"15min":3.6800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.56000000000000005},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":3.6970000000000001,"15min":3.6970000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.50600000000000001,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.56399999999999995,"15min":0.51200000000000001},"min":{"1min":0.53800000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.60499999999999998},"min":{"1min":0.44600000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82799999999999996,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63400000000000001,"15min":0.60399999999999998},"min":{"1min":0.52200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73099999999999998}]},{"osd":7,"last update":"Sun Oct 8 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.874}]},{"osd":8,"last update":"Sun Oct 8 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.61499999999999999,"15min":0.58299999999999996},"min":{"1min":0.497,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88400000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.66500000000000004},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95899999999999996,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80300000000000005}]},{"osd":9,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.76400000000000001,"15min":0.74099999999999999},"min":{"1min":0.70299999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.995,"5min":1.02,"15min":1.02},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.77700000000000002,"15min":0.745},"min":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97299999999999998,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.90200000000000002}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.79500000000000004,"15min":0.79300000000000004},"min":{"1min":0.59299999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.004,"5min":2.109,"15min":2.109},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.72299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.92100000000000004}]},{"osd":11,"last update":"Sun Oct 8 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.95399999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":492716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38100000000000001,"15min":0.35299999999999998},"min":{"1min":0.27000000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.39300000000000002,"15min":0.36099999999999999},"min":{"1min":0.26200000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51700000000000002,"5min":1.889,"15min":1.889},"last":2.5449999999999999}]},{"osd":1,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.55400000000000005,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71599999999999997,"5min":0.996,"15min":0.996},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59599999999999997,"15min":0.52600000000000002},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":3.6930000000000001}]},{"osd":2,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57199999999999995,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82499999999999996,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.86299999999999999}]},{"osd":4,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":1.927,"15min":1.927},"last":5.2539999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61799999999999999,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98599999999999999,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":0.94099999999999995}]},{"osd":5,"last update":"Sun Oct 8 08:43:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":1.992,"15min":1.992},"last":5.827},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81699999999999995,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":5.6360000000000001}]},{"osd":6,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48299999999999998,"15min":0.47499999999999998},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69499999999999995,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.014},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52000000000000002,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93899999999999995,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":6.2300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.92300000000000004}]},{"osd":8,"last update":"Sun Oct 8 08:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.62}]},{"osd":9,"last update":"Sun Oct 8 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.66000000000000003,"15min":0.71999999999999997},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":1.712,"15min":1.712},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.71199999999999997,"15min":0.76300000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":6.5209999999999999}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96199999999999997,"5min":2.339,"15min":2.339},"last":6.915},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89800000000000002,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.96499999999999997}]},{"osd":11,"last update":"Sun Oct 8 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.0329999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920830,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":493317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.67700000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77000000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.35899999999999999},"min":{"1min":0.314,"5min":0.247,"15min":0.247},"max":{"1min":0.53800000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.37},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.371},"min":{"1min":0.309,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54300000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.41899999999999998}]},{"osd":2,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.54000000000000004,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77500000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.62},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.51300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71299999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.57399999999999995,"15min":0.52600000000000002},"min":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.50900000000000001},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.621,"15min":0.59599999999999997},"min":{"1min":0.52000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.61099999999999999},"min":{"1min":0.52500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.874,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sun Oct 8 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84099999999999997,"5min":0.88,"15min":0.88},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83499999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.441,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86499999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79900000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69199999999999995}]},{"osd":8,"last update":"Sun Oct 8 08:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.55100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85799999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72899999999999998,"15min":0.71199999999999997},"min":{"1min":0.63800000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.99099999999999999,"5min":1.05,"15min":1.05},"last":0.76100000000000001}]},{"osd":9,"last update":"Sun Oct 8 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.50900000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":1.03,"15min":1.03},"last":0.72199999999999998}]},{"osd":10,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.81699999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.503,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.748}]},{"osd":11,"last update":"Sun Oct 8 08:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79300000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757305,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1626112,"data_stored":1085805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":0.871,"15min":0.871},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.47199999999999998},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.86899999999999999,"5min":0.871,"15min":0.871},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75800000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42299999999999999,"15min":0.39100000000000001},"min":{"1min":0.35799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.438,"15min":0.40999999999999998},"min":{"1min":0.35399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64700000000000002,"5min":0.748,"15min":0.748},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.50600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.51500000000000001},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.752,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.623,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81899999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91300000000000003,"5min":1.006,"15min":1.006},"last":0.72899999999999998}]},{"osd":6,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.89800000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.68400000000000005,"15min":0.66400000000000003},"min":{"1min":0.55300000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.98999999999999999,"5min":1.046,"15min":1.046},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78000000000000003}]},{"osd":8,"last update":"Sun Oct 8 08:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.436,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.629},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.51200000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95499999999999996,"5min":1.006,"15min":1.006},"last":0.61299999999999999}]},{"osd":9,"last update":"Sun Oct 8 08:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.748,"15min":0.73599999999999999},"min":{"1min":0.59399999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.63100000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98699999999999999,"5min":1.038,"15min":1.038},"last":0.93000000000000005}]},{"osd":10,"last update":"Sun Oct 8 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77800000000000002,"15min":0.76500000000000001},"min":{"1min":0.57699999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0209999999999999,"5min":1.032,"15min":1.032},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.74399999999999999,"15min":0.73599999999999999},"min":{"1min":0.62,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93899999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":6074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T08:43:49.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:49.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.721+0000 7fd24d3ff700 1 -- 172.21.15.70:0/2079194223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 msgr2=0x7fd24810c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.721+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/2079194223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 0x7fd24810c3b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd24000b0d0 tx=0x7fd24000b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.721+0000 7fd24d3ff700 1 -- 172.21.15.70:0/2079194223 shutdown_connections 2023-10-08T08:43:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.721+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/2079194223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 0x7fd24810c3b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.721+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/2079194223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2481055f0 0x7fd2481059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.721+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/2079194223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2480ff530 0x7fd2480ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.721+0000 7fd24d3ff700 1 -- 172.21.15.70:0/2079194223 >> 172.21.15.70:0/2079194223 conn(0x7fd2480fb000 msgr2=0x7fd2480fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.721+0000 7fd24d3ff700 1 -- 172.21.15.70:0/2079194223 shutdown_connections 2023-10-08T08:43:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.721+0000 7fd24d3ff700 1 -- 172.21.15.70:0/2079194223 wait complete. 2023-10-08T08:43:49.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd24d3ff700 1 Processor -- start 2023-10-08T08:43:49.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd24d3ff700 1 -- start start 2023-10-08T08:43:49.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd24d3ff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2480ff530 0x7fd2481978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:49.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd24d3ff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 0x7fd248197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd24d3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2481055f0 0x7fd2481a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd24d3ff700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2481986f0 con 0x7fd2480ffef0 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd24d3ff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2481a2eb0 con 0x7fd2480ff530 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd24d3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2481a2ff0 con 0x7fd2481055f0 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd2467fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 0x7fd248197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.722+0000 7fd2467fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 0x7fd248197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51082/0 (socket says 172.21.15.70:51082) 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd2467fc700 1 -- 172.21.15.70:0/3240876668 learned_addr learned my addr 172.21.15.70:0/3240876668 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd246ffd700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2480ff530 0x7fd2481978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd2477fe700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2481055f0 0x7fd2481a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd2467fc700 1 -- 172.21.15.70:0/3240876668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2481055f0 msgr2=0x7fd2481a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd2467fc700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2481055f0 0x7fd2481a2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd2467fc700 1 -- 172.21.15.70:0/3240876668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2480ff530 msgr2=0x7fd2481978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd2467fc700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2480ff530 0x7fd2481978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd2467fc700 1 -- 172.21.15.70:0/3240876668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd240009d00 con 0x7fd2480ffef0 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd2467fc700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 0x7fd248197e30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd23800c920 tx=0x7fd23800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd23ffff700 1 -- 172.21.15.70:0/3240876668 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238007b00 con 0x7fd2480ffef0 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2481a32d0 con 0x7fd2480ffef0 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd23ffff700 1 -- 172.21.15.70:0/3240876668 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd23800ce70 con 0x7fd2480ffef0 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd23ffff700 1 -- 172.21.15.70:0/3240876668 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238005460 con 0x7fd2480ffef0 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.723+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2481a37e0 con 0x7fd2480ffef0 2023-10-08T08:43:49.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.724+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd248107a90 con 0x7fd2480ffef0 2023-10-08T08:43:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.725+0000 7fd23ffff700 1 -- 172.21.15.70:0/3240876668 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fd238004750 con 0x7fd2480ffef0 2023-10-08T08:43:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.726+0000 7fd23ffff700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd2340a14d0 0x7fd2340a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.726+0000 7fd246ffd700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd2340a14d0 0x7fd2340a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.726+0000 7fd23ffff700 1 -- 172.21.15.70:0/3240876668 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd2380ccd90 con 0x7fd2480ffef0 2023-10-08T08:43:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.726+0000 7fd246ffd700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd2340a14d0 0x7fd2340a3990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd230005950 tx=0x7fd23000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:49.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.730+0000 7fd23ffff700 1 -- 172.21.15.70:0/3240876668 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd238096000 con 0x7fd2480ffef0 2023-10-08T08:43:49.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.926+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd248100c50 con 0x7fd2480ffef0 2023-10-08T08:43:49.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.927+0000 7fd23ffff700 1 -- 172.21.15.70:0/3240876668 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7fd23801d090 con 0x7fd2480ffef0 2023-10-08T08:43:49.929 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:49.929 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:49.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd2340a14d0 msgr2=0x7fd2340a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd2340a14d0 0x7fd2340a3990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd230005950 tx=0x7fd23000b410 comp rx=0 tx=0).stop 2023-10-08T08:43:49.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 msgr2=0x7fd248197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:49.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 0x7fd248197e30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd23800c920 tx=0x7fd23800cc30 comp rx=0 tx=0).stop 2023-10-08T08:43:49.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 shutdown_connections 2023-10-08T08:43:49.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd2340a14d0 0x7fd2340a3990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2481055f0 0x7fd2481a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2480ff530 0x7fd2481978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 --2- 172.21.15.70:0/3240876668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2480ffef0 0x7fd248197e30 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:49.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 >> 172.21.15.70:0/3240876668 conn(0x7fd2480fb000 msgr2=0x7fd2480fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:49.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 shutdown_connections 2023-10-08T08:43:49.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:49.930+0000 7fd24d3ff700 1 -- 172.21.15.70:0/3240876668 wait complete. 2023-10-08T08:43:49.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:43:49.944 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:43:50.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.067+0000 7f06894b5700 1 -- 172.21.15.70:0/1844917211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06840ff320 msgr2=0x7f06840ff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.067+0000 7f06894b5700 1 --2- 172.21.15.70:0/1844917211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06840ff320 0x7f06840ff700 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f066c009990 tx=0x7f066c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.067+0000 7f06894b5700 1 -- 172.21.15.70:0/1844917211 shutdown_connections 2023-10-08T08:43:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.067+0000 7f06894b5700 1 --2- 172.21.15.70:0/1844917211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0684105b30 0x7f068410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.067+0000 7f06894b5700 1 --2- 172.21.15.70:0/1844917211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06840ff320 0x7f06840ff700 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.067+0000 7f06894b5700 1 --2- 172.21.15.70:0/1844917211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06840ffcd0 0x7f0684105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.067+0000 7f06894b5700 1 -- 172.21.15.70:0/1844917211 >> 172.21.15.70:0/1844917211 conn(0x7f0684074940 msgr2=0x7f0684074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.067+0000 7f06894b5700 1 -- 172.21.15.70:0/1844917211 shutdown_connections 2023-10-08T08:43:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.067+0000 7f06894b5700 1 -- 172.21.15.70:0/1844917211 wait complete. 2023-10-08T08:43:50.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06894b5700 1 Processor -- start 2023-10-08T08:43:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06894b5700 1 -- start start 2023-10-08T08:43:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06894b5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06840ff320 0x7f0684196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06894b5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0684105b30 0x7f06841972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06894b5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f068419a550 0x7f068419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06894b5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068419af40 con 0x7f068419a550 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06894b5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068419b0b0 con 0x7f06840ff320 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06894b5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068419b270 con 0x7f0684105b30 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06837fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f068419a550 0x7f068419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06837fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f068419a550 0x7f068419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51098/0 (socket says 172.21.15.70:51098) 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06837fe700 1 -- 172.21.15.70:0/658713278 learned_addr learned my addr 172.21.15.70:0/658713278 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f06827fc700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0684105b30 0x7f06841972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.068+0000 7f0682ffd700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06840ff320 0x7f0684196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f06837fe700 1 -- 172.21.15.70:0/658713278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0684105b30 msgr2=0x7f06841972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f06837fe700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0684105b30 0x7f06841972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f06837fe700 1 -- 172.21.15.70:0/658713278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06840ff320 msgr2=0x7f0684196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f06837fe700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06840ff320 0x7f0684196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f06837fe700 1 -- 172.21.15.70:0/658713278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c0095f0 con 0x7f068419a550 2023-10-08T08:43:50.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f0682ffd700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06840ff320 0x7f0684196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:50.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f06837fe700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f068419a550 0x7f068419aa00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f067c00b970 tx=0x7f067c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:50.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f067bfff700 1 -- 172.21.15.70:0/658713278 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c00c930 con 0x7f068419a550 2023-10-08T08:43:50.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f067bfff700 1 -- 172.21.15.70:0/658713278 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f067c014440 con 0x7f068419a550 2023-10-08T08:43:50.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06841a38e0 con 0x7f068419a550 2023-10-08T08:43:50.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f067bfff700 1 -- 172.21.15.70:0/658713278 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c0075d0 con 0x7f068419a550 2023-10-08T08:43:50.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.069+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06841a3da0 con 0x7f068419a550 2023-10-08T08:43:50.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.070+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0684108d20 con 0x7f068419a550 2023-10-08T08:43:50.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.071+0000 7f067bfff700 1 -- 172.21.15.70:0/658713278 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f067c0145b0 con 0x7f068419a550 2023-10-08T08:43:50.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.071+0000 7f067bfff700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06700a1500 0x7f06700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.071+0000 7f0682ffd700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06700a1500 0x7f06700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.071+0000 7f067bfff700 1 -- 172.21.15.70:0/658713278 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f067c006e40 con 0x7f068419a550 2023-10-08T08:43:50.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.072+0000 7f0682ffd700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06700a1500 0x7f06700a39c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f066c006010 tx=0x7f066c00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:50.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.075+0000 7f067bfff700 1 -- 172.21.15.70:0/658713278 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f067c095ec0 con 0x7f068419a550 2023-10-08T08:43:50.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.267+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0684197fe0 con 0x7f068419a550 2023-10-08T08:43:50.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.267+0000 7f067bfff700 1 -- 172.21.15.70:0/658713278 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f067c0230a0 con 0x7f068419a550 2023-10-08T08:43:50.268 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:43:50.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.269+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06700a1500 msgr2=0x7f06700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.269+0000 7f06894b5700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06700a1500 0x7f06700a39c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f066c006010 tx=0x7f066c00b540 comp rx=0 tx=0).stop 2023-10-08T08:43:50.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.269+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f068419a550 msgr2=0x7f068419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.269+0000 7f06894b5700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f068419a550 0x7f068419aa00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f067c00b970 tx=0x7f067c00bc80 comp rx=0 tx=0).stop 2023-10-08T08:43:50.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.270+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 shutdown_connections 2023-10-08T08:43:50.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.270+0000 7f06894b5700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f06700a1500 0x7f06700a39c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.270+0000 7f06894b5700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f068419a550 0x7f068419aa00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.270+0000 7f06894b5700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06840ff320 0x7f0684196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.270+0000 7f06894b5700 1 --2- 172.21.15.70:0/658713278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0684105b30 0x7f06841972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.270+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 >> 172.21.15.70:0/658713278 conn(0x7f0684074940 msgr2=0x7f06840fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:50.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.270+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 shutdown_connections 2023-10-08T08:43:50.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.270+0000 7f06894b5700 1 -- 172.21.15.70:0/658713278 wait complete. 2023-10-08T08:43:50.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:43:50.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.406+0000 7f5ed1521700 1 -- 172.21.15.70:0/650887491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc100010 msgr2=0x7f5ecc10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.406+0000 7f5ed1521700 1 --2- 172.21.15.70:0/650887491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc100010 0x7f5ecc10c4b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400b0a0 tx=0x7f5ec400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.406+0000 7f5ed1521700 1 -- 172.21.15.70:0/650887491 shutdown_connections 2023-10-08T08:43:50.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.406+0000 7f5ed1521700 1 --2- 172.21.15.70:0/650887491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc100010 0x7f5ecc10c4b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.406+0000 7f5ed1521700 1 --2- 172.21.15.70:0/650887491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc1056f0 0x7f5ecc105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.406+0000 7f5ed1521700 1 --2- 172.21.15.70:0/650887491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ecc0ff650 0x7f5ecc0ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.406+0000 7f5ed1521700 1 -- 172.21.15.70:0/650887491 >> 172.21.15.70:0/650887491 conn(0x7f5ecc076760 msgr2=0x7f5ecc076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:50.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.406+0000 7f5ed1521700 1 -- 172.21.15.70:0/650887491 shutdown_connections 2023-10-08T08:43:50.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.406+0000 7f5ed1521700 1 -- 172.21.15.70:0/650887491 wait complete. 2023-10-08T08:43:50.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ed1521700 1 Processor -- start 2023-10-08T08:43:50.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ed1521700 1 -- start start 2023-10-08T08:43:50.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ed1521700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ff650 0x7f5ecc197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ed1521700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc100010 0x7f5ecc198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ed1521700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ecc1056f0 0x7f5ecc1a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ed1521700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc198880 con 0x7f5ecc0ff650 2023-10-08T08:43:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ed1521700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1a3090 con 0x7f5ecc100010 2023-10-08T08:43:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ed1521700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1a31d0 con 0x7f5ecc1056f0 2023-10-08T08:43:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ecaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ff650 0x7f5ecc197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ecaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ff650 0x7f5ecc197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51106/0 (socket says 172.21.15.70:51106) 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ecaffd700 1 -- 172.21.15.70:0/1800796350 learned_addr learned my addr 172.21.15.70:0/1800796350 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5eca7fc700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc100010 0x7f5ecc198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ecaffd700 1 -- 172.21.15.70:0/1800796350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ecc1056f0 msgr2=0x7f5ecc1a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ecaffd700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ecc1056f0 0x7f5ecc1a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ecaffd700 1 -- 172.21.15.70:0/1800796350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc100010 msgr2=0x7f5ecc198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ecaffd700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc100010 0x7f5ecc198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.407+0000 7f5ecaffd700 1 -- 172.21.15.70:0/1800796350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009d00 con 0x7f5ecc0ff650 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.408+0000 7f5ecaffd700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ff650 0x7f5ecc197ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00d950 tx=0x7f5ebc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.408+0000 7f5ec3fff700 1 -- 172.21.15.70:0/1800796350 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc009b40 con 0x7f5ecc0ff650 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.408+0000 7f5ec3fff700 1 -- 172.21.15.70:0/1800796350 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ebc009ca0 con 0x7f5ecc0ff650 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.408+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc1a3460 con 0x7f5ecc0ff650 2023-10-08T08:43:50.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.408+0000 7f5ec3fff700 1 -- 172.21.15.70:0/1800796350 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00f620 con 0x7f5ecc0ff650 2023-10-08T08:43:50.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.408+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc1a3970 con 0x7f5ecc0ff650 2023-10-08T08:43:50.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.409+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc107b90 con 0x7f5ecc0ff650 2023-10-08T08:43:50.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.410+0000 7f5ec3fff700 1 -- 172.21.15.70:0/1800796350 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f5ebc010460 con 0x7f5ecc0ff650 2023-10-08T08:43:50.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.410+0000 7f5ec3fff700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5eb80a14d0 0x7f5eb80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.411+0000 7f5eca7fc700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5eb80a14d0 0x7f5eb80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.411+0000 7f5ec3fff700 1 -- 172.21.15.70:0/1800796350 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5ebc0cd3e0 con 0x7f5ecc0ff650 2023-10-08T08:43:50.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.411+0000 7f5eca7fc700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5eb80a14d0 0x7f5eb80a3990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc069520 tx=0x7f5eb4005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:50.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.414+0000 7f5ec3fff700 1 -- 172.21.15.70:0/1800796350 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5ebc0966f0 con 0x7f5ecc0ff650 2023-10-08T08:43:50.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.608+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ecc0692d0 con 0x7f5ecc0ff650 2023-10-08T08:43:50.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.608+0000 7f5ec3fff700 1 -- 172.21.15.70:0/1800796350 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ebc099d10 con 0x7f5ecc0ff650 2023-10-08T08:43:50.609 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5eb80a14d0 msgr2=0x7f5eb80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5eb80a14d0 0x7f5eb80a3990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc069520 tx=0x7f5eb4005d50 comp rx=0 tx=0).stop 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ff650 msgr2=0x7f5ecc197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ff650 0x7f5ecc197ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00d950 tx=0x7f5ebc00dd10 comp rx=0 tx=0).stop 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 shutdown_connections 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5eb80a14d0 0x7f5eb80a3990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ecc1056f0 0x7f5ecc1a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ff650 0x7f5ecc197ad0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 --2- 172.21.15.70:0/1800796350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc100010 0x7f5ecc198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.610+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 >> 172.21.15.70:0/1800796350 conn(0x7f5ecc076760 msgr2=0x7f5ecc0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.611+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 shutdown_connections 2023-10-08T08:43:50.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.611+0000 7f5ed1521700 1 -- 172.21.15.70:0/1800796350 wait complete. 2023-10-08T08:43:50.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:50 smithi070 ceph-mon[99513]: from='client.15720 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:50.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:50 smithi070 ceph-mon[99513]: pgmap v291: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-08T08:43:50.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:50 smithi070 ceph-mon[99513]: from='client.15726 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:50.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:50 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3240876668' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:50.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:50 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/658713278' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:50.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:43:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.747+0000 7f744c5c4700 1 -- 172.21.15.70:0/1255706029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74440ffff0 msgr2=0x7f744410c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.747+0000 7f744c5c4700 1 --2- 172.21.15.70:0/1255706029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74440ffff0 0x7f744410c500 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f744000b0a0 tx=0x7f744000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.747+0000 7f744c5c4700 1 -- 172.21.15.70:0/1255706029 shutdown_connections 2023-10-08T08:43:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.747+0000 7f744c5c4700 1 --2- 172.21.15.70:0/1255706029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74440ffff0 0x7f744410c500 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.747+0000 7f744c5c4700 1 --2- 172.21.15.70:0/1255706029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7444105640 0x7f7444105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.747+0000 7f744c5c4700 1 --2- 172.21.15.70:0/1255706029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74440ff630 0x7f74440ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.747+0000 7f744c5c4700 1 -- 172.21.15.70:0/1255706029 >> 172.21.15.70:0/1255706029 conn(0x7f74440767f0 msgr2=0x7f7444076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.747+0000 7f744c5c4700 1 -- 172.21.15.70:0/1255706029 shutdown_connections 2023-10-08T08:43:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.747+0000 7f744c5c4700 1 -- 172.21.15.70:0/1255706029 wait complete. 2023-10-08T08:43:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744c5c4700 1 Processor -- start 2023-10-08T08:43:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744c5c4700 1 -- start start 2023-10-08T08:43:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744c5c4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74440ff630 0x7f744419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744c5c4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74440ffff0 0x7f744419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744c5c4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444105640 0x7f74441957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744c5c4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7444195e10 con 0x7f7444105640 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744c5c4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7444195f80 con 0x7f74440ffff0 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744c5c4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7444196140 con 0x7f74440ff630 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744ab61700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444105640 0x7f74441957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744ab61700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444105640 0x7f74441957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51122/0 (socket says 172.21.15.70:51122) 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f744ab61700 1 -- 172.21.15.70:0/2391395054 learned_addr learned my addr 172.21.15.70:0/2391395054 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.748+0000 7f7449b5f700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74440ffff0 0x7f744419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744a360700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74440ff630 0x7f744419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744ab61700 1 -- 172.21.15.70:0/2391395054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74440ff630 msgr2=0x7f744419b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744ab61700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74440ff630 0x7f744419b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744ab61700 1 -- 172.21.15.70:0/2391395054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74440ffff0 msgr2=0x7f744419bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744ab61700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74440ffff0 0x7f744419bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744ab61700 1 -- 172.21.15.70:0/2391395054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440009d00 con 0x7f7444105640 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f7449b5f700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74440ffff0 0x7f744419bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744a360700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74440ff630 0x7f744419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744ab61700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444105640 0x7f74441957a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f744000b830 tx=0x7f7440005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f743b7fe700 1 -- 172.21.15.70:0/2391395054 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000e040 con 0x7f7444105640 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74441963c0 con 0x7f7444105640 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f743b7fe700 1 -- 172.21.15.70:0/2391395054 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f744001d480 con 0x7f7444105640 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f743b7fe700 1 -- 172.21.15.70:0/2391395054 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744001b6b0 con 0x7f7444105640 2023-10-08T08:43:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.749+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74441a2660 con 0x7f7444105640 2023-10-08T08:43:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.750+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7444107c50 con 0x7f7444105640 2023-10-08T08:43:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.751+0000 7f743b7fe700 1 -- 172.21.15.70:0/2391395054 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f744001d5f0 con 0x7f7444105640 2023-10-08T08:43:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.751+0000 7f743b7fe700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74300a14d0 0x7f74300a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.752+0000 7f744a360700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74300a14d0 0x7f74300a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.752+0000 7f743b7fe700 1 -- 172.21.15.70:0/2391395054 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f74400cf4c0 con 0x7f7444105640 2023-10-08T08:43:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.752+0000 7f744a360700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74300a14d0 0x7f74300a3990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f743c00baa0 tx=0x7f743c005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:50.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.755+0000 7f743b7fe700 1 -- 172.21.15.70:0/2391395054 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7440098760 con 0x7f7444105640 2023-10-08T08:43:50.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:50 smithi105 ceph-mon[103798]: from='client.15720 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:50.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:50 smithi105 ceph-mon[103798]: pgmap v291: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-08T08:43:50.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:50 smithi105 ceph-mon[103798]: from='client.15726 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:50.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:50 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3240876668' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:50.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:50 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/658713278' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:50 smithi191 ceph-mon[104220]: from='client.15720 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:50 smithi191 ceph-mon[104220]: pgmap v291: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-08T08:43:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:50 smithi191 ceph-mon[104220]: from='client.15726 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:50 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3240876668' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:50.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:50 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/658713278' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:43:50.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.945+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7444100d70 con 0x7f7444105640 2023-10-08T08:43:50.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.945+0000 7f743b7fe700 1 -- 172.21.15.70:0/2391395054 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f744009bd80 con 0x7f7444105640 2023-10-08T08:43:50.946 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:43:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74300a14d0 msgr2=0x7f74300a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74300a14d0 0x7f74300a3990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f743c00baa0 tx=0x7f743c005db0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444105640 msgr2=0x7f74441957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444105640 0x7f74441957a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f744000b830 tx=0x7f7440005b80 comp rx=0 tx=0).stop 2023-10-08T08:43:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 shutdown_connections 2023-10-08T08:43:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f74300a14d0 0x7f74300a3990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7444105640 0x7f74441957a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74440ff630 0x7f744419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 --2- 172.21.15.70:0/2391395054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74440ffff0 0x7f744419bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 >> 172.21.15.70:0/2391395054 conn(0x7f74440767f0 msgr2=0x7f7444102120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 shutdown_connections 2023-10-08T08:43:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:50.947+0000 7f744c5c4700 1 -- 172.21.15.70:0/2391395054 wait complete. 2023-10-08T08:43:50.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:43:51.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/1547433543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 msgr2=0x7fcbc810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/1547433543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 0x7fcbc810d600 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000b0a0 tx=0x7fcbc000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/1547433543 shutdown_connections 2023-10-08T08:43:51.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/1547433543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 0x7fcbc810d600 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/1547433543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbc8106740 0x7fcbc8106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/1547433543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbc80fec80 0x7fcbc80ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/1547433543 >> 172.21.15.70:0/1547433543 conn(0x7fcbc8075c20 msgr2=0x7fcbc80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:51.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/1547433543 shutdown_connections 2023-10-08T08:43:51.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/1547433543 wait complete. 2023-10-08T08:43:51.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.083+0000 7fcbcd4c7700 1 Processor -- start 2023-10-08T08:43:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbcd4c7700 1 -- start start 2023-10-08T08:43:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbcd4c7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbc80fec80 0x7fcbc80ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbcd4c7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 0x7fcbc81003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbcd4c7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbc8106740 0x7fcbc81008e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbcd4c7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc81a5090 con 0x7fcbc80ff620 2023-10-08T08:43:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbcd4c7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc81a5200 con 0x7fcbc8106740 2023-10-08T08:43:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbcd4c7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc81a53c0 con 0x7fcbc80fec80 2023-10-08T08:43:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc67fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 0x7fcbc81003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc67fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 0x7fcbc81003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51134/0 (socket says 172.21.15.70:51134) 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc67fc700 1 -- 172.21.15.70:0/2744191155 learned_addr learned my addr 172.21.15.70:0/2744191155 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc6ffd700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbc80fec80 0x7fcbc80ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc77fe700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbc8106740 0x7fcbc81008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc67fc700 1 -- 172.21.15.70:0/2744191155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbc80fec80 msgr2=0x7fcbc80ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc67fc700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbc80fec80 0x7fcbc80ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc67fc700 1 -- 172.21.15.70:0/2744191155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbc8106740 msgr2=0x7fcbc81008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc67fc700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbc8106740 0x7fcbc81008e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc67fc700 1 -- 172.21.15.70:0/2744191155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0009d00 con 0x7fcbc80ff620 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc77fe700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbc8106740 0x7fcbc81008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.084+0000 7fcbc67fc700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 0x7fcbc81003a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800d950 tx=0x7fcbb800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.085+0000 7fcbaffff700 1 -- 172.21.15.70:0/2744191155 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8009940 con 0x7fcbc80ff620 2023-10-08T08:43:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.085+0000 7fcbaffff700 1 -- 172.21.15.70:0/2744191155 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbb8010460 con 0x7fcbc80ff620 2023-10-08T08:43:51.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.085+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc81a56a0 con 0x7fcbc80ff620 2023-10-08T08:43:51.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.085+0000 7fcbaffff700 1 -- 172.21.15.70:0/2744191155 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800f620 con 0x7fcbc80ff620 2023-10-08T08:43:51.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.085+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc81a5c00 con 0x7fcbc80ff620 2023-10-08T08:43:51.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.086+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc8108ce0 con 0x7fcbc80ff620 2023-10-08T08:43:51.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.087+0000 7fcbaffff700 1 -- 172.21.15.70:0/2744191155 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fcbb80108d0 con 0x7fcbc80ff620 2023-10-08T08:43:51.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.087+0000 7fcbaffff700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcbb00a1550 0x7fcbb00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.087+0000 7fcbc6ffd700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcbb00a1550 0x7fcbb00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.087+0000 7fcbaffff700 1 -- 172.21.15.70:0/2744191155 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcbb80ccf20 con 0x7fcbc80ff620 2023-10-08T08:43:51.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.088+0000 7fcbc6ffd700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcbb00a1550 0x7fcbb00a3a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc005950 tx=0x7fcbbc00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:51.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.092+0000 7fcbaffff700 1 -- 172.21.15.70:0/2744191155 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcbb8096190 con 0x7fcbc80ff620 2023-10-08T08:43:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.283+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcbc8066ca0 con 0x7fcbc80ff620 2023-10-08T08:43:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.284+0000 7fcbaffff700 1 -- 172.21.15.70:0/2744191155 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcbc8066ca0 con 0x7fcbc80ff620 2023-10-08T08:43:51.285 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:43:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcbb00a1550 msgr2=0x7fcbb00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcbb00a1550 0x7fcbb00a3a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc005950 tx=0x7fcbbc00b410 comp rx=0 tx=0).stop 2023-10-08T08:43:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 msgr2=0x7fcbc81003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 0x7fcbc81003a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800d950 tx=0x7fcbb800dc60 comp rx=0 tx=0).stop 2023-10-08T08:43:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 shutdown_connections 2023-10-08T08:43:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcbb00a1550 0x7fcbb00a3a10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbc8106740 0x7fcbc81008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbc80fec80 0x7fcbc80ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 --2- 172.21.15.70:0/2744191155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbc80ff620 0x7fcbc81003a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 >> 172.21.15.70:0/2744191155 conn(0x7fcbc8075c20 msgr2=0x7fcbc80fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 shutdown_connections 2023-10-08T08:43:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.286+0000 7fcbcd4c7700 1 -- 172.21.15.70:0/2744191155 wait complete. 2023-10-08T08:43:51.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:43:51.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 -- 172.21.15.70:0/2885222694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 msgr2=0x7fec20105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2885222694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 0x7fec20105bc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fec14009990 tx=0x7fec14009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 -- 172.21.15.70:0/2885222694 shutdown_connections 2023-10-08T08:43:51.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2885222694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec20100620 0x7fec2010c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2885222694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 0x7fec20105bc0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2885222694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec200ffc60 0x7fec201000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 -- 172.21.15.70:0/2885222694 >> 172.21.15.70:0/2885222694 conn(0x7fec20075a90 msgr2=0x7fec200fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:51.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 -- 172.21.15.70:0/2885222694 shutdown_connections 2023-10-08T08:43:51.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 -- 172.21.15.70:0/2885222694 wait complete. 2023-10-08T08:43:51.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 Processor -- start 2023-10-08T08:43:51.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 -- start start 2023-10-08T08:43:51.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec200ffc60 0x7fec2019c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec20100620 0x7fec2019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 0x7fec20196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec20197060 con 0x7fec201057e0 2023-10-08T08:43:51.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec201971d0 con 0x7fec200ffc60 2023-10-08T08:43:51.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.421+0000 7fec26ca8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec20197390 con 0x7fec20100620 2023-10-08T08:43:51.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec25245700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 0x7fec20196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec25245700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 0x7fec20196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51150/0 (socket says 172.21.15.70:51150) 2023-10-08T08:43:51.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec25245700 1 -- 172.21.15.70:0/2131663608 learned_addr learned my addr 172.21.15.70:0/2131663608 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec1ffff700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec20100620 0x7fec2019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec24a44700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec200ffc60 0x7fec2019c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec25245700 1 -- 172.21.15.70:0/2131663608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec20100620 msgr2=0x7fec2019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec25245700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec20100620 0x7fec2019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec25245700 1 -- 172.21.15.70:0/2131663608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec200ffc60 msgr2=0x7fec2019c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec25245700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec200ffc60 0x7fec2019c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec25245700 1 -- 172.21.15.70:0/2131663608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec140095f0 con 0x7fec201057e0 2023-10-08T08:43:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec25245700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 0x7fec20196a00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fec18007ee0 tx=0x7fec1800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec1dffb700 1 -- 172.21.15.70:0/2131663608 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18017070 con 0x7fec201057e0 2023-10-08T08:43:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec1dffb700 1 -- 172.21.15.70:0/2131663608 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec1800f040 con 0x7fec201057e0 2023-10-08T08:43:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec20197670 con 0x7fec201057e0 2023-10-08T08:43:51.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec1dffb700 1 -- 172.21.15.70:0/2131663608 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18005740 con 0x7fec201057e0 2023-10-08T08:43:51.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.422+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec201a38c0 con 0x7fec201057e0 2023-10-08T08:43:51.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.423+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec20100f10 con 0x7fec201057e0 2023-10-08T08:43:51.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.424+0000 7fec1dffb700 1 -- 172.21.15.70:0/2131663608 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fec1800dc60 con 0x7fec201057e0 2023-10-08T08:43:51.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.425+0000 7fec1dffb700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec100a1550 0x7fec100a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.425+0000 7fec24a44700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec100a1550 0x7fec100a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.425+0000 7fec1dffb700 1 -- 172.21.15.70:0/2131663608 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fec180cc8f0 con 0x7fec201057e0 2023-10-08T08:43:51.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.425+0000 7fec24a44700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec100a1550 0x7fec100a3a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fec1400b5c0 tx=0x7fec1401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:51.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.429+0000 7fec1dffb700 1 -- 172.21.15.70:0/2131663608 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fec18095b60 con 0x7fec201057e0 2023-10-08T08:43:51.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.666+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec20067610 con 0x7fec201057e0 2023-10-08T08:43:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.666+0000 7fec1dffb700 1 -- 172.21.15.70:0/2131663608 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11375 (secure 0 0 0) 0x7fec18099180 con 0x7fec201057e0 2023-10-08T08:43:51.667 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:51.667 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:29.077123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24572":{"gid":24572,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:43:51.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.668+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec100a1550 msgr2=0x7fec100a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.668+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec100a1550 0x7fec100a3a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fec1400b5c0 tx=0x7fec1401a040 comp rx=0 tx=0).stop 2023-10-08T08:43:51.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.668+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 msgr2=0x7fec20196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.668+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 0x7fec20196a00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fec18007ee0 tx=0x7fec1800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.669+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 shutdown_connections 2023-10-08T08:43:51.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.669+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fec100a1550 0x7fec100a3a10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.669+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec201057e0 0x7fec20196a00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.669+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec200ffc60 0x7fec2019c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.669+0000 7fec26ca8700 1 --2- 172.21.15.70:0/2131663608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec20100620 0x7fec2019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.669+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 >> 172.21.15.70:0/2131663608 conn(0x7fec20075a90 msgr2=0x7fec201038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:51.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.669+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 shutdown_connections 2023-10-08T08:43:51.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.669+0000 7fec26ca8700 1 -- 172.21.15.70:0/2131663608 wait complete. 2023-10-08T08:43:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:43:51.680 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:51 smithi070 ceph-mon[99513]: from='client.15732 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:51.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:51 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1800796350' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:51.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:51 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2391395054' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:51.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:51 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2744191155' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:51.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:43:51.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:51 smithi105 ceph-mon[103798]: from='client.15732 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:51.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:51 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1800796350' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:51.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:51 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2391395054' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:51.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:51 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2744191155' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:51.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 -- 172.21.15.70:0/604937245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8041017f0 msgr2=0x7fa804101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 --2- 172.21.15.70:0/604937245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8041017f0 0x7fa804101bd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa800009990 tx=0x7fa800009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 -- 172.21.15.70:0/604937245 shutdown_connections 2023-10-08T08:43:51.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 --2- 172.21.15.70:0/604937245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa80410ac10 0x7fa80410d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 --2- 172.21.15.70:0/604937245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8041017f0 0x7fa804101bd0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 --2- 172.21.15.70:0/604937245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa804102110 0x7fa80410a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 -- 172.21.15.70:0/604937245 >> 172.21.15.70:0/604937245 conn(0x7fa8040fb030 msgr2=0x7fa8040fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 -- 172.21.15.70:0/604937245 shutdown_connections 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 -- 172.21.15.70:0/604937245 wait complete. 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 Processor -- start 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 -- start start 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.803+0000 7fa80c793700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8041017f0 0x7fa80419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80c793700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa804102110 0x7fa80419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80c793700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa80410ac10 0x7fa804196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80c793700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804196fa0 con 0x7fa80410ac10 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80c793700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804197110 con 0x7fa804102110 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80c793700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8041972d0 con 0x7fa8041017f0 2023-10-08T08:43:51.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80ad30700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa80410ac10 0x7fa804196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80ad30700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa80410ac10 0x7fa804196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51164/0 (socket says 172.21.15.70:51164) 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80ad30700 1 -- 172.21.15.70:0/821130798 learned_addr learned my addr 172.21.15.70:0/821130798 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80a52f700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8041017f0 0x7fa80419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa809d2e700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa804102110 0x7fa80419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80ad30700 1 -- 172.21.15.70:0/821130798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8041017f0 msgr2=0x7fa80419c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80ad30700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8041017f0 0x7fa80419c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80ad30700 1 -- 172.21.15.70:0/821130798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa804102110 msgr2=0x7fa80419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80ad30700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa804102110 0x7fa80419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80ad30700 1 -- 172.21.15.70:0/821130798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000095f0 con 0x7fa80410ac10 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80a52f700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8041017f0 0x7fa80419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:51.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80ad30700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa80410ac10 0x7fa804196940 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00ada0 tx=0x7fa7fc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:51.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa7fb7fe700 1 -- 172.21.15.70:0/821130798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc00f070 con 0x7fa80410ac10 2023-10-08T08:43:51.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa7fb7fe700 1 -- 172.21.15.70:0/821130798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7fc007b30 con 0x7fa80410ac10 2023-10-08T08:43:51.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8041975b0 con 0x7fa80410ac10 2023-10-08T08:43:51.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa7fb7fe700 1 -- 172.21.15.70:0/821130798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc005440 con 0x7fa80410ac10 2023-10-08T08:43:51.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.804+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8041a37b0 con 0x7fa80410ac10 2023-10-08T08:43:51.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.805+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa804105d40 con 0x7fa80410ac10 2023-10-08T08:43:51.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.806+0000 7fa7fb7fe700 1 -- 172.21.15.70:0/821130798 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fa7fc004ad0 con 0x7fa80410ac10 2023-10-08T08:43:51.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.807+0000 7fa7fb7fe700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa7f00a14d0 0x7fa7f00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:51.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.807+0000 7fa80a52f700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa7f00a14d0 0x7fa7f00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:51.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.807+0000 7fa7fb7fe700 1 -- 172.21.15.70:0/821130798 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fa7fc0ccda0 con 0x7fa80410ac10 2023-10-08T08:43:51.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.807+0000 7fa80a52f700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa7f00a14d0 0x7fa7f00a3990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa80000b5c0 tx=0x7fa80001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:51.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:51.810+0000 7fa7fb7fe700 1 -- 172.21.15.70:0/821130798 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa7fc096040 con 0x7fa80410ac10 2023-10-08T08:43:51.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:51 smithi191 ceph-mon[104220]: from='client.15732 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T08:43:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:51 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1800796350' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:43:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:51 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2391395054' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:43:51.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:51 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2744191155' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:43:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.002+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa804068110 con 0x7fa80410ac10 2023-10-08T08:43:52.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.004+0000 7fa7fb7fe700 1 -- 172.21.15.70:0/821130798 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24747 (secure 0 0 0) 0x7fa7fc0b9090 con 0x7fa80410ac10 2023-10-08T08:43:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:43:52.005 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:42:40.267583+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:43:52.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa7f00a14d0 msgr2=0x7fa7f00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa7f00a14d0 0x7fa7f00a3990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa80000b5c0 tx=0x7fa80001a040 comp rx=0 tx=0).stop 2023-10-08T08:43:52.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa80410ac10 msgr2=0x7fa804196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa80410ac10 0x7fa804196940 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00ada0 tx=0x7fa7fc00c330 comp rx=0 tx=0).stop 2023-10-08T08:43:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 shutdown_connections 2023-10-08T08:43:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa7f00a14d0 0x7fa7f00a3990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa80410ac10 0x7fa804196940 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8041017f0 0x7fa80419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 --2- 172.21.15.70:0/821130798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa804102110 0x7fa80419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 >> 172.21.15.70:0/821130798 conn(0x7fa8040fb030 msgr2=0x7fa8040fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 shutdown_connections 2023-10-08T08:43:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.006+0000 7fa80c793700 1 -- 172.21.15.70:0/821130798 wait complete. 2023-10-08T08:43:52.020 DEBUG:tasks.fwd_scrub:Yielding 2023-10-08T08:43:52.020 INFO:teuthology.run_tasks:Running task exec... 2023-10-08T08:43:52.033 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T08:43:52.033 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:43:52.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2023-10-08T08:43:52.033 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-08T08:43:52.034 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T08:43:52.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T08:43:52.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.160+0000 7f3bb848a700 1 -- 172.21.15.70:0/3594932091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0105ae0 msgr2=0x7f3bb010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.160+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3594932091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0105ae0 0x7f3bb010d4f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b0d0 tx=0x7f3ba800b3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.160+0000 7f3bb848a700 1 -- 172.21.15.70:0/3594932091 shutdown_connections 2023-10-08T08:43:52.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.160+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3594932091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0105ae0 0x7f3bb010d4f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.160+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3594932091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bb0067fd0 0x7f3bb00683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.160+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3594932091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb0105120 0x7f3bb01055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.160+0000 7f3bb848a700 1 -- 172.21.15.70:0/3594932091 >> 172.21.15.70:0/3594932091 conn(0x7f3bb0076790 msgr2=0x7f3bb0076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.160+0000 7f3bb848a700 1 -- 172.21.15.70:0/3594932091 shutdown_connections 2023-10-08T08:43:52.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.160+0000 7f3bb848a700 1 -- 172.21.15.70:0/3594932091 wait complete. 2023-10-08T08:43:52.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb848a700 1 Processor -- start 2023-10-08T08:43:52.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb848a700 1 -- start start 2023-10-08T08:43:52.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb848a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0067fd0 0x7f3bb019c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb848a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bb0105120 0x7f3bb019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb848a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb0105ae0 0x7f3bb0196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb848a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0197110 con 0x7f3bb0067fd0 2023-10-08T08:43:52.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb848a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0197280 con 0x7f3bb0105120 2023-10-08T08:43:52.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb848a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0197440 con 0x7f3bb0105ae0 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb6226700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0067fd0 0x7f3bb019c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb6226700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0067fd0 0x7f3bb019c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51180/0 (socket says 172.21.15.70:51180) 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.161+0000 7f3bb6226700 1 -- 172.21.15.70:0/3484299841 learned_addr learned my addr 172.21.15.70:0/3484299841 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb5a25700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bb0105120 0x7f3bb019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb6a27700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb0105ae0 0x7f3bb0196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb6226700 1 -- 172.21.15.70:0/3484299841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb0105ae0 msgr2=0x7f3bb0196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb6226700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb0105ae0 0x7f3bb0196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb6226700 1 -- 172.21.15.70:0/3484299841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bb0105120 msgr2=0x7f3bb019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb6226700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bb0105120 0x7f3bb019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb6226700 1 -- 172.21.15.70:0/3484299841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8009d00 con 0x7f3bb0067fd0 2023-10-08T08:43:52.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7fe745575700 1 -- 172.21.15.70:0/280075104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 msgr2=0x7fe740106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7fe745575700 1 --2- 172.21.15.70:0/280075104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 0x7fe740106b30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe730009990 tx=0x7fe730009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb6226700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0067fd0 0x7f3bb019c930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00e9a0 tx=0x7f3bac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7fe745575700 1 -- 172.21.15.70:0/280075104 shutdown_connections 2023-10-08T08:43:52.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7fe745575700 1 --2- 172.21.15.70:0/280075104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe740101100 0x7fe74010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7fe745575700 1 --2- 172.21.15.70:0/280075104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 0x7fe740106b30 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7fe745575700 1 --2- 172.21.15.70:0/280075104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe740100740 0x7fe740100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7fe745575700 1 -- 172.21.15.70:0/280075104 >> 172.21.15.70:0/280075104 conn(0x7fe7400fc230 msgr2=0x7fe7400fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7fe745575700 1 -- 172.21.15.70:0/280075104 shutdown_connections 2023-10-08T08:43:52.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3ba77fe700 1 -- 172.21.15.70:0/3484299841 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac009790 con 0x7f3bb0067fd0 2023-10-08T08:43:52.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb0197720 con 0x7f3bb0067fd0 2023-10-08T08:43:52.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3ba77fe700 1 -- 172.21.15.70:0/3484299841 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bac010430 con 0x7f3bb0067fd0 2023-10-08T08:43:52.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3ba77fe700 1 -- 172.21.15.70:0/3484299841 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac018680 con 0x7f3bb0067fd0 2023-10-08T08:43:52.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb01a3920 con 0x7f3bb0067fd0 2023-10-08T08:43:52.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.162+0000 7fe745575700 1 -- 172.21.15.70:0/280075104 wait complete. 2023-10-08T08:43:52.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.163+0000 7fe745575700 1 Processor -- start 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.163+0000 7fe745575700 1 -- start start 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe745575700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe740100740 0x7fe740071e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe745575700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe740101100 0x7fe7400723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe745575700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 0x7fe74006afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe745575700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74006b7b0 con 0x7fe740106750 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe745575700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74006b920 con 0x7fe740101100 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe745575700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74006bae0 con 0x7fe740100740 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 0x7fe74006afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 0x7fe74006afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51188/0 (socket says 172.21.15.70:51188) 2023-10-08T08:43:52.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73f7fe700 1 -- 172.21.15.70:0/2950338134 learned_addr learned my addr 172.21.15.70:0/2950338134 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb0108bb0 con 0x7f3bb0067fd0 2023-10-08T08:43:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73effd700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe740100740 0x7fe740071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73e7fc700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe740101100 0x7fe7400723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73f7fe700 1 -- 172.21.15.70:0/2950338134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe740100740 msgr2=0x7fe740071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe740100740 0x7fe740071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73f7fe700 1 -- 172.21.15.70:0/2950338134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe740101100 msgr2=0x7fe7400723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe740101100 0x7fe7400723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73f7fe700 1 -- 172.21.15.70:0/2950338134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7300095f0 con 0x7fe740106750 2023-10-08T08:43:52.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73effd700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe740100740 0x7fe740071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:52.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.164+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 0x7fe74006afe0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe738007ee0 tx=0x7fe73800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.165+0000 7f3ba77fe700 1 -- 172.21.15.70:0/3484299841 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f3bac0105a0 con 0x7f3bb0067fd0 2023-10-08T08:43:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.165+0000 7f3ba77fe700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3b9c0a14d0 0x7f3b9c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.166+0000 7f3bb5a25700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3b9c0a14d0 0x7f3b9c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.166+0000 7f3ba77fe700 1 -- 172.21.15.70:0/3484299841 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3bac014070 con 0x7f3bb0067fd0 2023-10-08T08:43:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.166+0000 7f3bb5a25700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3b9c0a14d0 0x7f3b9c0a3990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0197c20 tx=0x7f3ba0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.169+0000 7fe727fff700 1 -- 172.21.15.70:0/2950338134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738017070 con 0x7fe740106750 2023-10-08T08:43:52.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.169+0000 7fe727fff700 1 -- 172.21.15.70:0/2950338134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe73800f040 con 0x7fe740106750 2023-10-08T08:43:52.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.169+0000 7fe727fff700 1 -- 172.21.15.70:0/2950338134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738005740 con 0x7fe740106750 2023-10-08T08:43:52.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.169+0000 7fe745575700 1 -- 172.21.15.70:0/2950338134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74006f9b0 con 0x7fe740106750 2023-10-08T08:43:52.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.169+0000 7f3ba77fe700 1 -- 172.21.15.70:0/3484299841 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3bac096760 con 0x7f3bb0067fd0 2023-10-08T08:43:52.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.169+0000 7fe745575700 1 -- 172.21.15.70:0/2950338134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74006fe70 con 0x7fe740106750 2023-10-08T08:43:52.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.171+0000 7fe727fff700 1 -- 172.21.15.70:0/2950338134 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe7380058a0 con 0x7fe740106750 2023-10-08T08:43:52.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.172+0000 7fe727fff700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe7280a1550 0x7fe7280a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.172+0000 7fe75175eb80 1 Processor -- start 2023-10-08T08:43:52.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.172+0000 7fe75175eb80 1 -- start start 2023-10-08T08:43:52.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.172+0000 7fe73effd700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe7280a1550 0x7fe7280a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.172+0000 7fe727fff700 1 -- 172.21.15.70:0/2950338134 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe7380cc940 con 0x7fe740106750 2023-10-08T08:43:52.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f376d6d0 0x55b1f376fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe75175eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f36cb4e0 con 0x55b1f3761f00 2023-10-08T08:43:52.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe75175eb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f36bcca0 con 0x55b1f3762820 2023-10-08T08:43:52.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe75175eb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f36ba5c0 con 0x55b1f376d6d0 2023-10-08T08:43:52.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51196/0 (socket says 172.21.15.70:51196) 2023-10-08T08:43:52.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 -- 172.21.15.70:0/776666557 learned_addr learned my addr 172.21.15.70:0/776666557 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe7280a1550 0x7fe7280a3a10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe730006010 tx=0x7fe73000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f376d6d0 0x55b1f376fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73e7fc700 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 -- 172.21.15.70:0/776666557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f376d6d0 msgr2=0x55b1f376fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f376d6d0 0x55b1f376fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 -- 172.21.15.70:0/776666557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 msgr2=0x55b1f376d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 -- 172.21.15.70:0/776666557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1f34e0e60 con 0x55b1f3761f00 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73e7fc700 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.173+0000 7fe73effd700 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37622e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe73000b910 tx=0x7fe730023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09923f4e9ae8cc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe7257fa700 1 -- 172.21.15.70:0/776666557 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73001d050 con 0x55b1f3761f00 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe7257fa700 1 -- 172.21.15.70:0/776666557 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe730005650 con 0x55b1f3761f00 2023-10-08T08:43:52.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe7257fa700 1 -- 172.21.15.70:0/776666557 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73002a070 con 0x55b1f3761f00 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe75175eb80 1 -- 172.21.15.70:0/776666557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 msgr2=0x55b1f37622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe75175eb80 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37622e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe73000b910 tx=0x7fe730023000 comp rx=0 tx=0).stop 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe75175eb80 1 -- 172.21.15.70:0/776666557 shutdown_connections 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe75175eb80 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f376d6d0 0x55b1f376fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe75175eb80 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37622e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe75175eb80 1 --2- 172.21.15.70:0/776666557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe75175eb80 1 -- 172.21.15.70:0/776666557 >> 172.21.15.70:0/776666557 conn(0x55b1f36d72e0 msgr2=0x55b1f375e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe75175eb80 1 -- 172.21.15.70:0/776666557 shutdown_connections 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.174+0000 7fe75175eb80 1 -- 172.21.15.70:0/776666557 wait complete. 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe75175eb80 1 -- start start 2023-10-08T08:43:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe75175eb80 1 Processor -- start 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 0x55b1f376d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f376abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe75175eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f36b5eb0 con 0x55b1f376d6d0 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe75175eb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f3652790 con 0x55b1f3762820 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe75175eb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f3652430 con 0x55b1f3761f00 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe75175eb80 10 client.0 _ll_register_callbacks cb 0x55b1f34af880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f376abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f376abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51206/0 (socket says 172.21.15.70:51206) 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe73f7fe700 1 -- 172.21.15.70:0/3808081596 learned_addr learned my addr 172.21.15.70:0/3808081596 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe73e7fc700 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe73effd700 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 0x55b1f376d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe73f7fe700 1 -- 172.21.15.70:0/3808081596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 msgr2=0x55b1f376d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 0x55b1f376d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe73f7fe700 1 -- 172.21.15.70:0/3808081596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 msgr2=0x55b1f376a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.175+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe73f7fe700 1 -- 172.21.15.70:0/3808081596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74010df10 con 0x55b1f376d6d0 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe73e7fc700 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f376abd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe738009510 tx=0x7fe738004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f689a44fb3ac93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe722ff5700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe722ff5700 1 -- 172.21.15.70:0/3808081596 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73800ddd0 con 0x55b1f376d6d0 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe722ff5700 1 -- 172.21.15.70:0/3808081596 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe73806be10 con 0x55b1f376d6d0 2023-10-08T08:43:52.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe75175eb80 1 -- 172.21.15.70:0/3808081596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1f367df30 con 0x55b1f376d6d0 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe722ff5700 1 -- 172.21.15.70:0/3808081596 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7380b2120 con 0x55b1f376d6d0 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe75175eb80 10 client.15792 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe75175eb80 1 -- 172.21.15.70:0/3808081596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b1f34c9ce0 con 0x55b1f376d6d0 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe722ff5700 1 -- 172.21.15.70:0/3808081596 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b1f367df30 con 0x55b1f376d6d0 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe722ff5700 1 -- 172.21.15.70:0/3808081596 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe7380840c0 con 0x55b1f376d6d0 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe75175eb80 10 client.15792 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe75175eb80 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe75175eb80 20 client.15792 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe75175eb80 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b1f377d100 0x55b1f377f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe75175eb80 4 client.15792 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.176+0000 7fe75175eb80 1 -- 172.21.15.70:0/3808081596 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1f36aee90 con 0x55b1f377d100 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.177+0000 7fe73effd700 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b1f377d100 0x55b1f377f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.177+0000 7fe73effd700 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b1f377d100 0x55b1f377f520 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73d968273d2610ff server_cookie=1538a65a1f834da in_seq=0 out_seq=0 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.177+0000 7fe722ff5700 10 client.15792 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe722ff5700 1 -- 172.21.15.70:0/3808081596 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b1f36aee90 con 0x55b1f377d100 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe722ff5700 10 client.15792 handle_command_reply: tid=0 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 client.15792 shutdown 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 -- 172.21.15.70:0/3808081596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 msgr2=0x55b1f376abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f376abd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe738009510 tx=0x7fe738004b80 comp rx=0 tx=0).stop 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 -- 172.21.15.70:0/3808081596 shutdown_connections 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f376abd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 0x55b1f376d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b1f377d100 0x55b1f377f520 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 --2- 172.21.15.70:0/3808081596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f376a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 -- 172.21.15.70:0/3808081596 >> 172.21.15.70:0/3808081596 conn(0x55b1f36d72e0 msgr2=0x55b1f375df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe722ff5700 0 client.15792 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:52.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 -- 172.21.15.70:0/3808081596 shutdown_connections 2023-10-08T08:43:52.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 1 -- 172.21.15.70:0/3808081596 wait complete. 2023-10-08T08:43:52.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.178+0000 7fe75175eb80 20 client.15792 trim_cache size 0 max 16384 2023-10-08T08:43:52.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe75175eb80 1 Processor -- start 2023-10-08T08:43:52.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe75175eb80 1 -- start start 2023-10-08T08:43:52.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37741c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3762820 0x55b1f3779020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f376d6d0 0x55b1f3769d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe75175eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f35369a0 con 0x55b1f3761f00 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe75175eb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f3762c00 con 0x55b1f376d6d0 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe75175eb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f375ab60 con 0x55b1f3762820 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe73effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe73effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37741c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51210/0 (socket says 172.21.15.70:51210) 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.195+0000 7fe73effd700 1 -- 172.21.15.70:0/1529184118 learned_addr learned my addr 172.21.15.70:0/1529184118 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe73e7fc700 1 --2- 172.21.15.70:0/1529184118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3762820 0x55b1f3779020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/1529184118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f376d6d0 0x55b1f3769d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe73effd700 1 -- 172.21.15.70:0/1529184118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3762820 msgr2=0x55b1f3779020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe73effd700 1 --2- 172.21.15.70:0/1529184118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3762820 0x55b1f3779020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe73effd700 1 -- 172.21.15.70:0/1529184118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f376d6d0 msgr2=0x55b1f3769d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe73effd700 1 --2- 172.21.15.70:0/1529184118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f376d6d0 0x55b1f3769d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe73effd700 1 -- 172.21.15.70:0/1529184118 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1f3784150 con 0x55b1f3761f00 2023-10-08T08:43:52.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe73effd700 1 --2- 172.21.15.70:0/1529184118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37741c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe73002f680 tx=0x7fe73002f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e6e7cb275d3101 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe725ffb700 1 -- 172.21.15.70:0/1529184118 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73001d040 con 0x55b1f3761f00 2023-10-08T08:43:52.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe725ffb700 1 -- 172.21.15.70:0/1529184118 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe730005940 con 0x55b1f3761f00 2023-10-08T08:43:52.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.196+0000 7fe725ffb700 1 -- 172.21.15.70:0/1529184118 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73002a040 con 0x55b1f3761f00 2023-10-08T08:43:52.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 -- 172.21.15.70:0/1529184118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 msgr2=0x55b1f37741c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1529184118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37741c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe73002f680 tx=0x7fe73002f610 comp rx=0 tx=0).stop 2023-10-08T08:43:52.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 -- 172.21.15.70:0/1529184118 shutdown_connections 2023-10-08T08:43:52.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1529184118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f376d6d0 0x55b1f3769d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1529184118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f3761f00 0x55b1f37741c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1529184118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3762820 0x55b1f3779020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 -- 172.21.15.70:0/1529184118 >> 172.21.15.70:0/1529184118 conn(0x55b1f36d72e0 msgr2=0x55b1f3778910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 -- 172.21.15.70:0/1529184118 shutdown_connections 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 -- 172.21.15.70:0/1529184118 wait complete. 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 -- start start 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 Processor -- start 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 0x55b1f3772b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f3773070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f37735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f37d1020 con 0x55b1f376d6d0 2023-10-08T08:43:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f37d1190 con 0x55b1f3762820 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.197+0000 7fe75175eb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1f37d1350 con 0x55b1f3761f00 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe75175eb80 10 client.0 _ll_register_callbacks cb 0x7fe73806b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f37735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73effd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 0x55b1f3772b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f37735b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51220/0 (socket says 172.21.15.70:51220) 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73f7fe700 1 -- 172.21.15.70:0/1843632397 learned_addr learned my addr 172.21.15.70:0/1843632397 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73e7fc700 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f3773070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73f7fe700 1 -- 172.21.15.70:0/1843632397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 msgr2=0x55b1f3772b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 0x55b1f3772b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73f7fe700 1 -- 172.21.15.70:0/1843632397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 msgr2=0x55b1f3773070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f3773070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73f7fe700 1 -- 172.21.15.70:0/1843632397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1f34e0e60 con 0x55b1f376d6d0 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73effd700 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 0x55b1f3772b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73e7fc700 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f3773070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe73f7fe700 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f37735b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe7380962e0 tx=0x7fe73806bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6269363e4958ef0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe722ff5700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe722ff5700 1 -- 172.21.15.70:0/1843632397 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738099d20 con 0x55b1f376d6d0 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe722ff5700 1 -- 172.21.15.70:0/1843632397 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe738099870 con 0x55b1f376d6d0 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe75175eb80 1 -- 172.21.15.70:0/1843632397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe730005650 con 0x55b1f376d6d0 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.198+0000 7fe722ff5700 1 -- 172.21.15.70:0/1843632397 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe738099640 con 0x55b1f376d6d0 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe75175eb80 10 client.15798 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe75175eb80 1 -- 172.21.15.70:0/1843632397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b1f35072d0 con 0x55b1f376d6d0 2023-10-08T08:43:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe722ff5700 1 -- 172.21.15.70:0/1843632397 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe73806b020 con 0x55b1f376d6d0 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe722ff5700 1 -- 172.21.15.70:0/1843632397 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe7380a1770 con 0x55b1f376d6d0 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe75175eb80 10 client.15798 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe75175eb80 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe75175eb80 20 client.15798 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b1f37d2690 0x55b1f37d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe75175eb80 4 client.15798 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe75175eb80 1 -- 172.21.15.70:0/1843632397 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b1f36aebb0 con 0x55b1f37d2690 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.199+0000 7fe73effd700 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b1f37d2690 0x55b1f37d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe722ff5700 10 client.15798 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe73effd700 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b1f37d2690 0x55b1f37d4a80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=301df8debf048078 server_cookie=7a9617303d424b82 in_seq=0 out_seq=0 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe722ff5700 1 -- 172.21.15.70:0/1843632397 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b1f36aebb0 con 0x55b1f37d2690 2023-10-08T08:43:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe722ff5700 10 client.15798 handle_command_reply: tid=0 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe75175eb80 1 client.15798 shutdown 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe75175eb80 1 -- 172.21.15.70:0/1843632397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 msgr2=0x55b1f37735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f37735b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe7380962e0 tx=0x7fe73806bf80 comp rx=0 tx=0).stop 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe75175eb80 1 -- 172.21.15.70:0/1843632397 shutdown_connections 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1f376d6d0 0x55b1f37735b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1f3761f00 0x55b1f3772b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b1f37d2690 0x55b1f37d4a80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.200+0000 7fe75175eb80 1 --2- 172.21.15.70:0/1843632397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b1f3762820 0x55b1f3773070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe722ff5700 0 client.15798 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe75175eb80 1 -- 172.21.15.70:0/1843632397 >> 172.21.15.70:0/1843632397 conn(0x55b1f36d72e0 msgr2=0x55b1f37791a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe75175eb80 1 -- 172.21.15.70:0/1843632397 shutdown_connections 2023-10-08T08:43:52.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe75175eb80 1 -- 172.21.15.70:0/1843632397 wait complete. 2023-10-08T08:43:52.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe75175eb80 20 client.15798 trim_cache size 0 max 16384 2023-10-08T08:43:52.209 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:52.209 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2023-10-08T08:43:52.209 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "831d03fb-7245-4188-a5c6-fb43bfa4ed7f", 2023-10-08T08:43:52.209 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2023-10-08T08:43:52.209 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:52.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 -- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe7280a1550 msgr2=0x7fe7280a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe7280a1550 0x7fe7280a3a10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe730006010 tx=0x7fe73000b540 comp rx=0 tx=0).stop 2023-10-08T08:43:52.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 -- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 msgr2=0x7fe74006afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 0x7fe74006afe0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe738007ee0 tx=0x7fe73800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 -- 172.21.15.70:0/2950338134 shutdown_connections 2023-10-08T08:43:52.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe7280a1550 0x7fe7280a3a10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe740106750 0x7fe74006afe0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe740100740 0x7fe740071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 --2- 172.21.15.70:0/2950338134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe740101100 0x7fe7400723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 -- 172.21.15.70:0/2950338134 >> 172.21.15.70:0/2950338134 conn(0x7fe7400fc230 msgr2=0x7fe7400fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 -- 172.21.15.70:0/2950338134 shutdown_connections 2023-10-08T08:43:52.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.201+0000 7fe745575700 1 -- 172.21.15.70:0/2950338134 wait complete. 2023-10-08T08:43:52.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:43:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.339+0000 7fe4b8482700 1 -- 172.21.15.70:0/3328765046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00fffe0 msgr2=0x7fe4b010c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.339+0000 7fe4b8482700 1 --2- 172.21.15.70:0/3328765046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00fffe0 0x7fe4b010c4e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800b0a0 tx=0x7fe4a800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.339+0000 7fe4b8482700 1 -- 172.21.15.70:0/3328765046 shutdown_connections 2023-10-08T08:43:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.339+0000 7fe4b8482700 1 --2- 172.21.15.70:0/3328765046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00fffe0 0x7fe4b010c4e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.339+0000 7fe4b8482700 1 --2- 172.21.15.70:0/3328765046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b01056b0 0x7fe4b0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.339+0000 7fe4b8482700 1 --2- 172.21.15.70:0/3328765046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4b00ff620 0x7fe4b00ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.339+0000 7fe4b8482700 1 -- 172.21.15.70:0/3328765046 >> 172.21.15.70:0/3328765046 conn(0x7fe4b0076780 msgr2=0x7fe4b0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.339+0000 7fe4b8482700 1 -- 172.21.15.70:0/3328765046 shutdown_connections 2023-10-08T08:43:52.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.339+0000 7fe4b8482700 1 -- 172.21.15.70:0/3328765046 wait complete. 2023-10-08T08:43:52.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b8482700 1 Processor -- start 2023-10-08T08:43:52.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b8482700 1 -- start start 2023-10-08T08:43:52.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b8482700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00ff620 0x7fe4b0195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b8482700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b00fffe0 0x7fe4b0195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b8482700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4b01056b0 0x7fe4b019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b8482700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b019a910 con 0x7fe4b00ff620 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b8482700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b019aa80 con 0x7fe4b00fffe0 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b8482700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b019ac40 con 0x7fe4b01056b0 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b621e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00ff620 0x7fe4b0195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b621e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00ff620 0x7fe4b0195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51230/0 (socket says 172.21.15.70:51230) 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b621e700 1 -- 172.21.15.70:0/106412170 learned_addr learned my addr 172.21.15.70:0/106412170 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b00fffe0 0x7fe4b0195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.340+0000 7fe4b6a1f700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4b01056b0 0x7fe4b019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4b621e700 1 -- 172.21.15.70:0/106412170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4b01056b0 msgr2=0x7fe4b019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4b621e700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4b01056b0 0x7fe4b019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4b621e700 1 -- 172.21.15.70:0/106412170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b00fffe0 msgr2=0x7fe4b0195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4b621e700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b00fffe0 0x7fe4b0195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4b621e700 1 -- 172.21.15.70:0/106412170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8009d00 con 0x7fe4b00ff620 2023-10-08T08:43:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4b621e700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00ff620 0x7fe4b0195a30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000d980 tx=0x7fe4a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4a77fe700 1 -- 172.21.15.70:0/106412170 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0004020 con 0x7fe4b00ff620 2023-10-08T08:43:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4a77fe700 1 -- 172.21.15.70:0/106412170 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4a000f690 con 0x7fe4b00ff620 2023-10-08T08:43:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4b8482700 1 -- 172.21.15.70:0/106412170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b019af20 con 0x7fe4b00ff620 2023-10-08T08:43:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4a77fe700 1 -- 172.21.15.70:0/106412170 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0003a60 con 0x7fe4b00ff620 2023-10-08T08:43:52.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.341+0000 7fe4b8482700 1 -- 172.21.15.70:0/106412170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b01a27d0 con 0x7fe4b00ff620 2023-10-08T08:43:52.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.343+0000 7fe4a77fe700 1 -- 172.21.15.70:0/106412170 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fe4a000fb00 con 0x7fe4b00ff620 2023-10-08T08:43:52.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.344+0000 7fe4a77fe700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe49c0a14d0 0x7fe49c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.344+0000 7fe4a77fe700 1 -- 172.21.15.70:0/106412170 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe4a00ccce0 con 0x7fe4b00ff620 2023-10-08T08:43:52.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.344+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe49c0a14d0 0x7fe49c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.344+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe49c0a14d0 0x7fe49c0a3990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0196f80 tx=0x7fe4ac00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4c466bb80 1 Processor -- start 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4c466bb80 1 -- start start 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a155f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a156a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a156ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a14c8460 con 0x55f2a155f7a0 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a14b9c20 con 0x55f2a155ee80 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a14b7540 con 0x55f2a156a650 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4b5a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a156a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4b621e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a155f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4b5a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a156a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51240/0 (socket says 172.21.15.70:51240) 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.345+0000 7fe4b5a1d700 1 -- 172.21.15.70:0/2441178037 learned_addr learned my addr 172.21.15.70:0/2441178037 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4b6a1f700 1 --2- 172.21.15.70:0/2441178037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a156ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4b5a1d700 1 -- 172.21.15.70:0/2441178037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 msgr2=0x55f2a156ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/2441178037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a156ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4b5a1d700 1 -- 172.21.15.70:0/2441178037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 msgr2=0x55f2a155f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/2441178037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a155f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4b5a1d700 1 -- 172.21.15.70:0/2441178037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2a12ddde0 con 0x55f2a155f7a0 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4b621e700 1 --2- 172.21.15.70:0/2441178037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a155f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/2441178037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a156a110 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac010f40 tx=0x7fe4ac013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285adf4e2a8a233d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4a4d82700 1 -- 172.21.15.70:0/2441178037 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00b950 con 0x55f2a155f7a0 2023-10-08T08:43:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4a4d82700 1 -- 172.21.15.70:0/2441178037 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4ac015070 con 0x55f2a155f7a0 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.346+0000 7fe4a4d82700 1 -- 172.21.15.70:0/2441178037 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac01c5f0 con 0x55f2a155f7a0 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 -- 172.21.15.70:0/2441178037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 msgr2=0x55f2a156a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/2441178037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a156a110 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac010f40 tx=0x7fe4ac013000 comp rx=0 tx=0).stop 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 -- 172.21.15.70:0/2441178037 shutdown_connections 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/2441178037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a156ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/2441178037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a155f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/2441178037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a156a110 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 -- 172.21.15.70:0/2441178037 >> 172.21.15.70:0/2441178037 conn(0x55f2a14d4260 msgr2=0x55f2a155b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 -- 172.21.15.70:0/2441178037 shutdown_connections 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 -- 172.21.15.70:0/2441178037 wait complete. 2023-10-08T08:43:52.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.347+0000 7fe4c466bb80 1 -- start start 2023-10-08T08:43:52.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4c466bb80 1 Processor -- start 2023-10-08T08:43:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a156a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a1567330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a1567940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a14b2e30 con 0x55f2a155f7a0 2023-10-08T08:43:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a144f710 con 0x55f2a155ee80 2023-10-08T08:43:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a144f3b0 con 0x55f2a156a650 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4c466bb80 10 client.0 _ll_register_callbacks cb 0x55f2a12ac800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b5a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a1567330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b5a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a1567330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51246/0 (socket says 172.21.15.70:51246) 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b5a1d700 1 -- 172.21.15.70:0/1442278152 learned_addr learned my addr 172.21.15.70:0/1442278152 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b6a1f700 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a1567940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b621e700 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a156a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b5a1d700 1 -- 172.21.15.70:0/1442278152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 msgr2=0x55f2a1567940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a1567940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b5a1d700 1 -- 172.21.15.70:0/1442278152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 msgr2=0x55f2a156a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a156a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b5a1d700 1 -- 172.21.15.70:0/1442278152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b01a27d0 con 0x55f2a155f7a0 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b6a1f700 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a1567940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b621e700 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a156a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a1567330 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac005790 tx=0x7fe4ac00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc26982223046fa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.348+0000 7fe499ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe499ffb700 1 -- 172.21.15.70:0/1442278152 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac02b070 con 0x55f2a155f7a0 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe499ffb700 1 -- 172.21.15.70:0/1442278152 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe4ac017070 con 0x55f2a155f7a0 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1442278152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2a147aeb0 con 0x55f2a155f7a0 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe499ffb700 1 -- 172.21.15.70:0/1442278152 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4ac011dc0 con 0x55f2a155f7a0 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4c466bb80 10 client.15810 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1442278152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fe4ac010c20 con 0x55f2a155f7a0 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe499ffb700 1 -- 172.21.15.70:0/1442278152 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f2a147aeb0 con 0x55f2a155f7a0 2023-10-08T08:43:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe499ffb700 1 -- 172.21.15.70:0/1442278152 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe4ac026b60 con 0x55f2a155f7a0 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4c466bb80 10 client.15810 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4c466bb80 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4c466bb80 20 client.15810 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55f2a157c200 0x55f2a157e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4c466bb80 4 client.15810 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1442278152 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2a14abe10 con 0x55f2a157c200 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.349+0000 7fe4b621e700 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55f2a157c200 0x55f2a157e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.350+0000 7fe4b621e700 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55f2a157c200 0x55f2a157e620 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cdee3ca86ff295c server_cookie=52e567bdda67928d in_seq=0 out_seq=0 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.350+0000 7fe499ffb700 10 client.15810 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.350+0000 7fe499ffb700 1 -- 172.21.15.70:0/1442278152 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f2a14abe10 con 0x55f2a157c200 2023-10-08T08:43:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.350+0000 7fe499ffb700 10 client.15810 handle_command_reply: tid=0 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.350+0000 7fe4c466bb80 1 client.15810 shutdown 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1442278152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 msgr2=0x55f2a1567330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a1567330 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac005790 tx=0x7fe4ac00be60 comp rx=0 tx=0).stop 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1442278152 shutdown_connections 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a1567940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55f2a157c200 0x55f2a157e620 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155ee80 0x55f2a156a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe499ffb700 0 client.15810 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1442278152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155f7a0 0x55f2a1567330 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1442278152 >> 172.21.15.70:0/1442278152 conn(0x55f2a14d4260 msgr2=0x55f2a155aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1442278152 shutdown_connections 2023-10-08T08:43:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1442278152 wait complete. 2023-10-08T08:43:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.351+0000 7fe4c466bb80 20 client.15810 trim_cache size 0 max 16384 2023-10-08T08:43:52.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.367+0000 7fe4c466bb80 1 Processor -- start 2023-10-08T08:43:52.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.367+0000 7fe4c466bb80 1 -- start start 2023-10-08T08:43:52.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.367+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a15711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.367+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 0x55f2a1565c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.367+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a1566140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a1333920 con 0x55f2a155ee80 2023-10-08T08:43:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a1557ae0 con 0x55f2a155f7a0 2023-10-08T08:43:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a1566680 con 0x55f2a156a650 2023-10-08T08:43:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b621e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a15711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b621e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a15711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51252/0 (socket says 172.21.15.70:51252) 2023-10-08T08:43:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b621e700 1 -- 172.21.15.70:0/1192785888 learned_addr learned my addr 172.21.15.70:0/1192785888 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b6a1f700 1 --2- 172.21.15.70:0/1192785888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a1566140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/1192785888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 0x55f2a1565c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b621e700 1 -- 172.21.15.70:0/1192785888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 msgr2=0x55f2a1566140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b621e700 1 --2- 172.21.15.70:0/1192785888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a1566140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b621e700 1 -- 172.21.15.70:0/1192785888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 msgr2=0x55f2a1565c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b621e700 1 --2- 172.21.15.70:0/1192785888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 0x55f2a1565c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b621e700 1 -- 172.21.15.70:0/1192785888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2a12c6c60 con 0x55f2a155ee80 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4b621e700 1 --2- 172.21.15.70:0/1192785888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a15711a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0000c00 tx=0x7fe4a00ca260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb56aef762c488a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4a5583700 1 -- 172.21.15.70:0/1192785888 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00a1f40 con 0x55f2a155ee80 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4a5583700 1 -- 172.21.15.70:0/1192785888 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4a00ca4a0 con 0x55f2a155ee80 2023-10-08T08:43:52.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.368+0000 7fe4a5583700 1 -- 172.21.15.70:0/1192785888 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0099e10 con 0x55f2a155ee80 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1192785888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 msgr2=0x55f2a15711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1192785888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a15711a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0000c00 tx=0x7fe4a00ca260 comp rx=0 tx=0).stop 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1192785888 shutdown_connections 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1192785888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a1566140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1192785888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a15711a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/1192785888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 0x55f2a1565c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1192785888 >> 172.21.15.70:0/1192785888 conn(0x55f2a14d4260 msgr2=0x55f2a1582fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1192785888 shutdown_connections 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 -- 172.21.15.70:0/1192785888 wait complete. 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 -- start start 2023-10-08T08:43:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 Processor -- start 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a156d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 0x55f2a156dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a156e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a15d0050 con 0x55f2a155ee80 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a15d0190 con 0x55f2a155f7a0 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a15d0350 con 0x55f2a156a650 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.369+0000 7fe4c466bb80 10 client.0 _ll_register_callbacks cb 0x7fe4a0004750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b621e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a156d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b621e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a156d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51258/0 (socket says 172.21.15.70:51258) 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b621e700 1 -- 172.21.15.70:0/4177098046 learned_addr learned my addr 172.21.15.70:0/4177098046 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b6a1f700 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a156e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 0x55f2a156dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b621e700 1 -- 172.21.15.70:0/4177098046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 msgr2=0x55f2a156e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b621e700 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a156e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b621e700 1 -- 172.21.15.70:0/4177098046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 msgr2=0x55f2a156dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b621e700 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 0x55f2a156dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b621e700 1 -- 172.21.15.70:0/4177098046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b019af20 con 0x55f2a155ee80 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4b621e700 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a156d7b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0099b40 tx=0x7fe4a009a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4845cf171d27f261 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe499ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe499ffb700 1 -- 172.21.15.70:0/4177098046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00234f0 con 0x55f2a155ee80 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe499ffb700 1 -- 172.21.15.70:0/4177098046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe4a0084040 con 0x55f2a155ee80 2023-10-08T08:43:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4c466bb80 1 -- 172.21.15.70:0/4177098046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe4ac015070 con 0x55f2a155ee80 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe499ffb700 1 -- 172.21.15.70:0/4177098046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4a007aea0 con 0x55f2a155ee80 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4c466bb80 10 client.15816 fetch_fsmap learned FSMap version 27 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe4c466bb80 1 -- 172.21.15.70:0/4177098046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f2a1304250 con 0x55f2a155ee80 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.370+0000 7fe499ffb700 1 -- 172.21.15.70:0/4177098046 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4ac015070 con 0x55f2a155ee80 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe499ffb700 1 -- 172.21.15.70:0/4177098046 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe4a0099e10 con 0x55f2a155ee80 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe4c466bb80 10 client.15816 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe4c466bb80 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe4c466bb80 20 client.15816 populate_metadata read hostname 'smithi070' 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55f2a15d18b0 0x55f2a15d3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe4c466bb80 4 client.15816 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe4c466bb80 1 -- 172.21.15.70:0/4177098046 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f2a14abb30 con 0x55f2a15d18b0 2023-10-08T08:43:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55f2a15d18b0 0x55f2a15d3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe499ffb700 10 client.15816 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.371+0000 7fe4b5a1d700 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55f2a15d18b0 0x55f2a15d3cd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ca145fd6d70ab73 server_cookie=f0cf37afa56a3a5 in_seq=0 out_seq=0 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe499ffb700 1 -- 172.21.15.70:0/4177098046 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f2a14abb30 con 0x55f2a15d18b0 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe499ffb700 10 client.15816 handle_command_reply: tid=0 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 client.15816 shutdown 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 -- 172.21.15.70:0/4177098046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 msgr2=0x55f2a156d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a156d7b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0099b40 tx=0x7fe4a009a3e0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 -- 172.21.15.70:0/4177098046 shutdown_connections 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f2a156a650 0x55f2a156e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f2a155ee80 0x55f2a156d7b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55f2a15d18b0 0x55f2a15d3cd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 --2- 172.21.15.70:0/4177098046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2a155f7a0 0x55f2a156dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe499ffb700 0 client.15816 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:43:52.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 -- 172.21.15.70:0/4177098046 >> 172.21.15.70:0/4177098046 conn(0x55f2a14d4260 msgr2=0x55f2a1565b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 -- 172.21.15.70:0/4177098046 shutdown_connections 2023-10-08T08:43:52.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 1 -- 172.21.15.70:0/4177098046 wait complete. 2023-10-08T08:43:52.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4c466bb80 20 client.15816 trim_cache size 0 max 16384 2023-10-08T08:43:52.381 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:43:52.381 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T08:43:52.381 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2023-10-08T08:43:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: "831d03fb-7245-4188-a5c6-fb43bfa4ed7f": { 2023-10-08T08:43:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2023-10-08T08:43:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "831d03fb-7245-4188-a5c6-fb43bfa4ed7f", 2023-10-08T08:43:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2023-10-08T08:43:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:43:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:43:52.382 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:43:52.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4b8482700 1 -- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe49c0a14d0 msgr2=0x7fe49c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4b8482700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe49c0a14d0 0x7fe49c0a3990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0196f80 tx=0x7fe4ac00b410 comp rx=0 tx=0).stop 2023-10-08T08:43:52.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4b8482700 1 -- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00ff620 msgr2=0x7fe4b0195a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4b8482700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00ff620 0x7fe4b0195a30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000d980 tx=0x7fe4a000dc90 comp rx=0 tx=0).stop 2023-10-08T08:43:52.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4b8482700 1 -- 172.21.15.70:0/106412170 shutdown_connections 2023-10-08T08:43:52.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.372+0000 7fe4b8482700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe49c0a14d0 0x7fe49c0a3990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.373+0000 7fe4b8482700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4b01056b0 0x7fe4b019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.373+0000 7fe4b8482700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4b00ff620 0x7fe4b0195a30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.373+0000 7fe4b8482700 1 --2- 172.21.15.70:0/106412170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b00fffe0 0x7fe4b0195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.373+0000 7fe4b8482700 1 -- 172.21.15.70:0/106412170 >> 172.21.15.70:0/106412170 conn(0x7fe4b0076780 msgr2=0x7fe4b00fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.373+0000 7fe4b8482700 1 -- 172.21.15.70:0/106412170 shutdown_connections 2023-10-08T08:43:52.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.373+0000 7fe4b8482700 1 -- 172.21.15.70:0/106412170 wait complete. 2023-10-08T08:43:52.385 INFO:tasks.cephfs.filesystem:scrub status for tag:831d03fb-7245-4188-a5c6-fb43bfa4ed7f - {'path': '/', 'tag': '831d03fb-7245-4188-a5c6-fb43bfa4ed7f', 'options': 'recursive,force'} 2023-10-08T08:43:52.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.410+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bb0197f20 con 0x7f3b9c0a14d0 2023-10-08T08:43:52.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.520+0000 7f3ba77fe700 1 -- 172.21.15.70:0/3484299841 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3bb0197f20 con 0x7f3b9c0a14d0 2023-10-08T08:43:52.521 INFO:teuthology.orchestra.run.smithi070.stdout:Schedule set for path / 2023-10-08T08:43:52.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3b9c0a14d0 msgr2=0x7f3b9c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3b9c0a14d0 0x7f3b9c0a3990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0197c20 tx=0x7f3ba0009260 comp rx=0 tx=0).stop 2023-10-08T08:43:52.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0067fd0 msgr2=0x7f3bb019c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0067fd0 0x7f3bb019c930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00e9a0 tx=0x7f3bac00ecb0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 shutdown_connections 2023-10-08T08:43:52.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3b9c0a14d0 0x7f3b9c0a3990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb0105ae0 0x7f3bb0196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0067fd0 0x7f3bb019c930 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 --2- 172.21.15.70:0/3484299841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bb0105120 0x7f3bb019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 >> 172.21.15.70:0/3484299841 conn(0x7f3bb0076790 msgr2=0x7f3bb00fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 shutdown_connections 2023-10-08T08:43:52.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.522+0000 7f3bb848a700 1 -- 172.21.15.70:0/3484299841 wait complete. 2023-10-08T08:43:52.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2023-10-08T08:43:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.699+0000 7f047209e700 1 -- 172.21.15.70:0/3803033314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c0ff5d0 msgr2=0x7f046c0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.699+0000 7f047209e700 1 --2- 172.21.15.70:0/3803033314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c0ff5d0 0x7f046c0ffa50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0460009990 tx=0x7f0460009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.699+0000 7f047209e700 1 -- 172.21.15.70:0/3803033314 shutdown_connections 2023-10-08T08:43:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.699+0000 7f047209e700 1 --2- 172.21.15.70:0/3803033314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f046c0fff90 0x7f046c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.699+0000 7f047209e700 1 --2- 172.21.15.70:0/3803033314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f046c1045e0 0x7f046c1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.699+0000 7f047209e700 1 --2- 172.21.15.70:0/3803033314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c0ff5d0 0x7f046c0ffa50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.699+0000 7f047209e700 1 -- 172.21.15.70:0/3803033314 >> 172.21.15.70:0/3803033314 conn(0x7f046c076790 msgr2=0x7f046c076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.700+0000 7f047209e700 1 -- 172.21.15.70:0/3803033314 shutdown_connections 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.700+0000 7f047209e700 1 -- 172.21.15.70:0/3803033314 wait complete. 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.700+0000 7f047209e700 1 Processor -- start 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f047209e700 1 -- start start 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f047209e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f046c0ff5d0 0x7f046c19b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f047209e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f046c0fff90 0x7f046c19bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f047209e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c1045e0 0x7f046c195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f047209e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c195e80 con 0x7f046c1045e0 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f047209e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c195ff0 con 0x7f046c0fff90 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f047209e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c1961b0 con 0x7f046c0ff5d0 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c1045e0 0x7f046c195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046b7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f046c0ff5d0 0x7f046c19b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c1045e0 0x7f046c195810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51298/0 (socket says 172.21.15.70:51298) 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046b7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f046c0ff5d0 0x7f046c19b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:38872/0 (socket says 172.21.15.70:38872) 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046bfff700 1 -- 172.21.15.70:0/2693326140 learned_addr learned my addr 172.21.15.70:0/2693326140 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046affd700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f046c0fff90 0x7f046c19bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046bfff700 1 -- 172.21.15.70:0/2693326140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f046c0ff5d0 msgr2=0x7f046c19b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046bfff700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f046c0ff5d0 0x7f046c19b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046bfff700 1 -- 172.21.15.70:0/2693326140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f046c0fff90 msgr2=0x7f046c19bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046bfff700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f046c0fff90 0x7f046c19bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046bfff700 1 -- 172.21.15.70:0/2693326140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04600095f0 con 0x7f046c1045e0 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.701+0000 7f046bfff700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c1045e0 0x7f046c195810 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f046400ef30 tx=0x7f046400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.702+0000 7f0468ff9700 1 -- 172.21.15.70:0/2693326140 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464018070 con 0x7f046c1045e0 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.702+0000 7f0468ff9700 1 -- 172.21.15.70:0/2693326140 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f046400f040 con 0x7f046c1045e0 2023-10-08T08:43:52.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.702+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046c196430 con 0x7f046c1045e0 2023-10-08T08:43:52.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.702+0000 7f0468ff9700 1 -- 172.21.15.70:0/2693326140 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046400cd00 con 0x7f046c1045e0 2023-10-08T08:43:52.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.702+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046c1a26d0 con 0x7f046c1045e0 2023-10-08T08:43:52.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.703+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046c107be0 con 0x7f046c1045e0 2023-10-08T08:43:52.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.704+0000 7f0468ff9700 1 -- 172.21.15.70:0/2693326140 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7f0464003a00 con 0x7f046c1045e0 2023-10-08T08:43:52.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.704+0000 7f0468ff9700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04540a14d0 0x7f04540a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:52.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.704+0000 7f046b7fe700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04540a14d0 0x7f04540a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:52.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.704+0000 7f0468ff9700 1 -- 172.21.15.70:0/2693326140 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f04640cccc0 con 0x7f046c1045e0 2023-10-08T08:43:52.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.705+0000 7f046b7fe700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04540a14d0 0x7f04540a3990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f046c069cf0 tx=0x7f045c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:52.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.709+0000 7f0468ff9700 1 -- 172.21.15.70:0/2693326140 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0464095fc0 con 0x7f046c1045e0 2023-10-08T08:43:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:52 smithi070 ceph-mon[99513]: pgmap v292: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:43:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:52 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2131663608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:52 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/821130798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:52.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:52 smithi105 ceph-mon[103798]: pgmap v292: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:43:52.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:52 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2131663608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:52.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:52 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/821130798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:52 smithi191 ceph-mon[104220]: pgmap v292: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:43:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:52 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2131663608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:43:52.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:52 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/821130798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:43:52.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.926+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f046c196cd0 con 0x7f04540a14d0 2023-10-08T08:43:52.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.978+0000 7f0468ff9700 1 -- 172.21.15.70:0/2693326140 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f046c196cd0 con 0x7f04540a14d0 2023-10-08T08:43:52.979 INFO:teuthology.orchestra.run.smithi070.stdout:Retention added to path / 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.980+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04540a14d0 msgr2=0x7f04540a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.980+0000 7f047209e700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04540a14d0 0x7f04540a3990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f046c069cf0 tx=0x7f045c009260 comp rx=0 tx=0).stop 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.980+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c1045e0 msgr2=0x7f046c195810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.980+0000 7f047209e700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c1045e0 0x7f046c195810 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f046400ef30 tx=0x7f046400c3a0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.980+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 shutdown_connections 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.981+0000 7f047209e700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f04540a14d0 0x7f04540a3990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.981+0000 7f047209e700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f046c1045e0 0x7f046c195810 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.981+0000 7f047209e700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f046c0ff5d0 0x7f046c19b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.981+0000 7f047209e700 1 --2- 172.21.15.70:0/2693326140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f046c0fff90 0x7f046c19bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:52.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.981+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 >> 172.21.15.70:0/2693326140 conn(0x7f046c076790 msgr2=0x7f046c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:52.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.981+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 shutdown_connections 2023-10-08T08:43:52.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:52.981+0000 7f047209e700 1 -- 172.21.15.70:0/2693326140 wait complete. 2023-10-08T08:43:52.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T08:43:53.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.115+0000 7fbb36273700 1 -- 172.21.15.70:0/20241709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 msgr2=0x7fbb300ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.115+0000 7fbb36273700 1 --2- 172.21.15.70:0/20241709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 0x7fbb300ffd50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009990 tx=0x7fbb24009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.115+0000 7fbb36273700 1 -- 172.21.15.70:0/20241709 shutdown_connections 2023-10-08T08:43:53.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.115+0000 7fbb36273700 1 --2- 172.21.15.70:0/20241709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb30100290 0x7fbb3010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.115+0000 7fbb36273700 1 --2- 172.21.15.70:0/20241709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb30105670 0x7fbb30105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.115+0000 7fbb36273700 1 --2- 172.21.15.70:0/20241709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 0x7fbb300ffd50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.115+0000 7fbb36273700 1 -- 172.21.15.70:0/20241709 >> 172.21.15.70:0/20241709 conn(0x7fbb300764c0 msgr2=0x7fbb300768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:53.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.115+0000 7fbb36273700 1 -- 172.21.15.70:0/20241709 shutdown_connections 2023-10-08T08:43:53.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.115+0000 7fbb36273700 1 -- 172.21.15.70:0/20241709 wait complete. 2023-10-08T08:43:53.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.116+0000 7fbb36273700 1 Processor -- start 2023-10-08T08:43:53.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.116+0000 7fbb36273700 1 -- start start 2023-10-08T08:43:53.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb36273700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 0x7fbb3019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:53.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb36273700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb30100290 0x7fbb3019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:53.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb36273700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb30105670 0x7fbb301957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:53.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb36273700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30195e40 con 0x7fbb300ff8d0 2023-10-08T08:43:53.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb36273700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30195fb0 con 0x7fbb30105670 2023-10-08T08:43:53.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb36273700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30196170 con 0x7fbb30100290 2023-10-08T08:43:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 0x7fbb3019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 0x7fbb3019b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51308/0 (socket says 172.21.15.70:51308) 2023-10-08T08:43:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2ffff700 1 -- 172.21.15.70:0/1158594186 learned_addr learned my addr 172.21.15.70:0/1158594186 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2f7fe700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb30100290 0x7fbb3019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb34810700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb30105670 0x7fbb301957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2ffff700 1 -- 172.21.15.70:0/1158594186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb30100290 msgr2=0x7fbb3019bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2ffff700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb30100290 0x7fbb3019bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2ffff700 1 -- 172.21.15.70:0/1158594186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb30105670 msgr2=0x7fbb301957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2ffff700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb30105670 0x7fbb301957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2ffff700 1 -- 172.21.15.70:0/1158594186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb240095f0 con 0x7fbb300ff8d0 2023-10-08T08:43:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2f7fe700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb30100290 0x7fbb3019bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:43:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2ffff700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 0x7fbb3019b6a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000d980 tx=0x7fbb2000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2d7fa700 1 -- 172.21.15.70:0/1158594186 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000de60 con 0x7fbb300ff8d0 2023-10-08T08:43:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb30196450 con 0x7fbb300ff8d0 2023-10-08T08:43:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2d7fa700 1 -- 172.21.15.70:0/1158594186 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb200044e0 con 0x7fbb300ff8d0 2023-10-08T08:43:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb2d7fa700 1 -- 172.21.15.70:0/1158594186 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20003be0 con 0x7fbb300ff8d0 2023-10-08T08:43:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.117+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb301a2690 con 0x7fbb300ff8d0 2023-10-08T08:43:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.118+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb30107bf0 con 0x7fbb300ff8d0 2023-10-08T08:43:53.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.120+0000 7fbb2d7fa700 1 -- 172.21.15.70:0/1158594186 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) v1 ==== 136020+0+0 (secure 0 0 0) 0x7fbb20009bb0 con 0x7fbb300ff8d0 2023-10-08T08:43:53.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.121+0000 7fbb2d7fa700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbb180a14d0 0x7fbb180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:53.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.121+0000 7fbb2f7fe700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbb180a14d0 0x7fbb180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:53.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.121+0000 7fbb2d7fa700 1 -- 172.21.15.70:0/1158594186 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fbb200cd1f0 con 0x7fbb300ff8d0 2023-10-08T08:43:53.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.121+0000 7fbb2f7fe700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbb180a14d0 0x7fbb180a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb24000c00 tx=0x7fbb24005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:53.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.124+0000 7fbb2d7fa700 1 -- 172.21.15.70:0/1158594186 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbb20096460 con 0x7fbb300ff8d0 2023-10-08T08:43:53.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.343+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb30196c90 con 0x7fbb180a14d0 2023-10-08T08:43:53.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.352+0000 7fbb2d7fa700 1 -- 172.21.15.70:0/1158594186 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7fbb30196c90 con 0x7fbb180a14d0 2023-10-08T08:43:53.353 INFO:teuthology.orchestra.run.smithi070.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T08:43:52", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-10-08T08:43:53.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbb180a14d0 msgr2=0x7fbb180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbb180a14d0 0x7fbb180a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb24000c00 tx=0x7fbb24005fb0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 msgr2=0x7fbb3019b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 0x7fbb3019b6a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000d980 tx=0x7fbb2000dd40 comp rx=0 tx=0).stop 2023-10-08T08:43:53.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 shutdown_connections 2023-10-08T08:43:53.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fbb180a14d0 0x7fbb180a3990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb30105670 0x7fbb301957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb300ff8d0 0x7fbb3019b6a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 --2- 172.21.15.70:0/1158594186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb30100290 0x7fbb3019bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 >> 172.21.15.70:0/1158594186 conn(0x7fbb300764c0 msgr2=0x7fbb300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:53.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 shutdown_connections 2023-10-08T08:43:53.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.354+0000 7fbb36273700 1 -- 172.21.15.70:0/1158594186 wait complete. 2023-10-08T08:43:53.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T08:43:53.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 -- 172.21.15.70:0/3729679017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c0ffaf0 msgr2=0x7f3a1c0fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 --2- 172.21.15.70:0/3729679017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c0ffaf0 0x7f3a1c0fff70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009990 tx=0x7f3a10009ca0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 -- 172.21.15.70:0/3729679017 shutdown_connections 2023-10-08T08:43:53.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 --2- 172.21.15.70:0/3729679017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a1c1004b0 0x7f3a1c10c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 --2- 172.21.15.70:0/3729679017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c105790 0x7f3a1c105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 --2- 172.21.15.70:0/3729679017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c0ffaf0 0x7f3a1c0fff70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 -- 172.21.15.70:0/3729679017 >> 172.21.15.70:0/3729679017 conn(0x7f3a1c076460 msgr2=0x7f3a1c076870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 -- 172.21.15.70:0/3729679017 shutdown_connections 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 -- 172.21.15.70:0/3729679017 wait complete. 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.495+0000 7f3a240d7700 1 Processor -- start 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a240d7700 1 -- start start 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a240d7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a1c0ffaf0 0x7f3a1c19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a240d7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c1004b0 0x7f3a1c19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a240d7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c105790 0x7f3a1c1957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a240d7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c195e50 con 0x7f3a1c105790 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a240d7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c195fc0 con 0x7f3a1c0ffaf0 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a240d7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c196180 con 0x7f3a1c1004b0 2023-10-08T08:43:53.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a22674700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c105790 0x7f3a1c1957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a22674700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c105790 0x7f3a1c1957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51326/0 (socket says 172.21.15.70:51326) 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a22674700 1 -- 172.21.15.70:0/2699550033 learned_addr learned my addr 172.21.15.70:0/2699550033 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a21672700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c1004b0 0x7f3a1c19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a21e73700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a1c0ffaf0 0x7f3a1c19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a22674700 1 -- 172.21.15.70:0/2699550033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c1004b0 msgr2=0x7f3a1c19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a22674700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c1004b0 0x7f3a1c19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a22674700 1 -- 172.21.15.70:0/2699550033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a1c0ffaf0 msgr2=0x7f3a1c19b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a22674700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a1c0ffaf0 0x7f3a1c19b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a22674700 1 -- 172.21.15.70:0/2699550033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a100095f0 con 0x7f3a1c105790 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.496+0000 7f3a22674700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c105790 0x7f3a1c1957e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c970 tx=0x7f3a0c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.497+0000 7f3a1affd700 1 -- 172.21.15.70:0/2699550033 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c004a30 con 0x7f3a1c105790 2023-10-08T08:43:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.497+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c196460 con 0x7f3a1c105790 2023-10-08T08:43:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.497+0000 7f3a1affd700 1 -- 172.21.15.70:0/2699550033 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a0c0054e0 con 0x7f3a1c105790 2023-10-08T08:43:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.497+0000 7f3a1affd700 1 -- 172.21.15.70:0/2699550033 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00eb20 con 0x7f3a1c105790 2023-10-08T08:43:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.497+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c1a2650 con 0x7f3a1c105790 2023-10-08T08:43:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.497+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c107b10 con 0x7f3a1c105790 2023-10-08T08:43:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.499+0000 7f3a1affd700 1 -- 172.21.15.70:0/2699550033 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) v1 ==== 136077+0+0 (secure 0 0 0) 0x7f3a0c004b90 con 0x7f3a1c105790 2023-10-08T08:43:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.499+0000 7f3a1affd700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a040a1560 0x7f3a040a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:43:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.499+0000 7f3a21e73700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a040a1560 0x7f3a040a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:43:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.500+0000 7f3a1affd700 1 -- 172.21.15.70:0/2699550033 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3a0c0cd1b0 con 0x7f3a1c105790 2023-10-08T08:43:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.500+0000 7f3a21e73700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a040a1560 0x7f3a040a3a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400f440 tx=0x7f3a140079e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:43:53.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.503+0000 7f3a1affd700 1 -- 172.21.15.70:0/2699550033 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a0c096260 con 0x7f3a1c105790 2023-10-08T08:43:53.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:53 smithi070 ceph-mon[99513]: scrub queued for path: / 2023-10-08T08:43:53.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:53 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:43:53.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:53 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:43:53.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:53 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:43:53.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:53 smithi070 ceph-mon[99513]: from='client.15783 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.720+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3a1c196c50 con 0x7f3a040a1560 2023-10-08T08:43:53.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.727+0000 7f3a1affd700 1 -- 172.21.15.70:0/2699550033 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f3a1c196c50 con 0x7f3a040a1560 2023-10-08T08:43:53.728 INFO:teuthology.orchestra.run.smithi070.stdout:/ 1m 6m3h 2023-10-08T08:43:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a040a1560 msgr2=0x7f3a040a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a040a1560 0x7f3a040a3a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400f440 tx=0x7f3a140079e0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c105790 msgr2=0x7f3a1c1957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:43:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c105790 0x7f3a1c1957e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c970 tx=0x7f3a0c00cc80 comp rx=0 tx=0).stop 2023-10-08T08:43:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 shutdown_connections 2023-10-08T08:43:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3a040a1560 0x7f3a040a3a20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a1c105790 0x7f3a1c1957e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a1c0ffaf0 0x7f3a1c19b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 --2- 172.21.15.70:0/2699550033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c1004b0 0x7f3a1c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:43:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 >> 172.21.15.70:0/2699550033 conn(0x7f3a1c076460 msgr2=0x7f3a1c0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:43:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 shutdown_connections 2023-10-08T08:43:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:43:53.729+0000 7f3a240d7700 1 -- 172.21.15.70:0/2699550033 wait complete. 2023-10-08T08:43:53.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-10-08T08:43:53.769 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-10-08T08:43:53.781 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-08T08:43:53.791 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:43:53.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-08T08:43:53.792 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:53 smithi105 ceph-mon[103798]: scrub queued for path: / 2023-10-08T08:43:53.792 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:53 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:43:53.792 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:53 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:43:53.792 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:53 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:43:53.792 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:53 smithi105 ceph-mon[103798]: from='client.15783 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:53.812 INFO:teuthology.run_tasks:Running task workunit... 2023-10-08T08:43:53.825 INFO:tasks.workunit:Pulling workunits from ref 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:43:53.826 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-08T08:43:53.826 INFO:tasks.workunit:timeout=6h 2023-10-08T08:43:53.826 INFO:tasks.workunit:cleanup=True 2023-10-08T08:43:53.826 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-08T08:43:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-08T08:43:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-08T08:43:53.843 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 7ch/124d Inode: 1 Links: 2 2023-10-08T08:43:53.843 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T08:43:53.843 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-08T08:43:53.843 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-10-08T08:43:53.843 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-10-08 08:42:01.118247429 +0000 2023-10-08T08:43:53.844 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-10-08 08:42:12.467685224 +0000 2023-10-08T08:43:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2023-10-08 08:42:01.118247429 +0000 2023-10-08T08:43:53.844 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-08T08:43:53.844 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-08T08:43:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:53 smithi191 ceph-mon[104220]: scrub queued for path: / 2023-10-08T08:43:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:53 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:43:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:53 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:43:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:53 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:43:53.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:53 smithi191 ceph-mon[104220]: from='client.15783 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:53.939 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T08:43:53.957 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-08T08:43:54.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:54 smithi070 ceph-mon[99513]: from='client.15828 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:54.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:54 smithi070 ceph-mon[99513]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-08T08:43:54.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:54 smithi070 ceph-mon[99513]: from='client.15834 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:54.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:54 smithi070 ceph-mon[99513]: mgrmap e21: x(active, since 7m), standbys: z, y 2023-10-08T08:43:54.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:54 smithi105 ceph-mon[103798]: from='client.15828 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:54.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:54 smithi105 ceph-mon[103798]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-08T08:43:54.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:54 smithi105 ceph-mon[103798]: from='client.15834 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:54.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:54 smithi105 ceph-mon[103798]: mgrmap e21: x(active, since 7m), standbys: z, y 2023-10-08T08:43:54.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:54 smithi191 ceph-mon[104220]: from='client.15828 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:54.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:54 smithi191 ceph-mon[104220]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-08T08:43:54.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:54 smithi191 ceph-mon[104220]: from='client.15834 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:54.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:54 smithi191 ceph-mon[104220]: mgrmap e21: x(active, since 7m), standbys: z, y 2023-10-08T08:43:55.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:55 smithi070 ceph-mon[99513]: from='client.15840 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:55.999 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:55 smithi191 ceph-mon[104220]: from='client.15840 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:55.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:55 smithi105 ceph-mon[103798]: from='client.15840 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:43:56.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:56 smithi105 ceph-mon[103798]: pgmap v294: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 46 op/s 2023-10-08T08:43:56.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:56 smithi191 ceph-mon[104220]: pgmap v294: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 46 op/s 2023-10-08T08:43:56.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:56 smithi070 ceph-mon[99513]: pgmap v294: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 46 op/s 2023-10-08T08:43:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:43:58 smithi105 ceph-mon[103798]: pgmap v295: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 114 KiB/s wr, 43 op/s 2023-10-08T08:43:58.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:43:58 smithi191 ceph-mon[104220]: pgmap v295: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 114 KiB/s wr, 43 op/s 2023-10-08T08:43:58.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:43:58 smithi070 ceph-mon[99513]: pgmap v295: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 114 KiB/s wr, 43 op/s 2023-10-08T08:44:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:00 smithi070 ceph-mon[99513]: pgmap v296: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 114 KiB/s wr, 43 op/s 2023-10-08T08:44:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:00 smithi105 ceph-mon[103798]: pgmap v296: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 114 KiB/s wr, 43 op/s 2023-10-08T08:44:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:00 smithi191 ceph-mon[104220]: pgmap v296: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 114 KiB/s wr, 43 op/s 2023-10-08T08:44:01.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:44:00 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:44:00.990+0000 7f509379e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T08:44:01.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:44:00 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:44:00.990+0000 7f509379e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T08:44:01.471 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:44:00 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:44:00.990+0000 7f509379e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T08:44:01.471 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:44:00 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:44:00.990+0000 7f509379e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T08:44:01.471 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:44:00 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:44:00.990+0000 7f509379e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T08:44:02.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:02 smithi070 ceph-mon[99513]: pgmap v297: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 115 KiB/s wr, 46 op/s 2023-10-08T08:44:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:02 smithi105 ceph-mon[103798]: pgmap v297: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 115 KiB/s wr, 46 op/s 2023-10-08T08:44:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:02 smithi191 ceph-mon[104220]: pgmap v297: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 115 KiB/s wr, 46 op/s 2023-10-08T08:44:03.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:03 smithi070 ceph-mon[99513]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T08:44:03.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:03 smithi105 ceph-mon[103798]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T08:44:03.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:03 smithi191 ceph-mon[104220]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T08:44:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:04 smithi070 ceph-mon[99513]: pgmap v298: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T08:44:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:04 smithi105 ceph-mon[103798]: pgmap v298: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T08:44:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:04 smithi191 ceph-mon[104220]: pgmap v298: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T08:44:05.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:05 smithi070 ceph-mon[99513]: scrub summary: idle 2023-10-08T08:44:05.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:05 smithi105 ceph-mon[103798]: scrub summary: idle 2023-10-08T08:44:05.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:05 smithi191 ceph-mon[104220]: scrub summary: idle 2023-10-08T08:44:06.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:06 smithi070 ceph-mon[99513]: pgmap v299: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 137 KiB/s wr, 59 op/s 2023-10-08T08:44:06.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:06 smithi105 ceph-mon[103798]: pgmap v299: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 137 KiB/s wr, 59 op/s 2023-10-08T08:44:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:06 smithi191 ceph-mon[104220]: pgmap v299: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 137 KiB/s wr, 59 op/s 2023-10-08T08:44:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.977+0000 7f7bb39bf700 1 -- 172.21.15.70:0/2182837224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0fff90 msgr2=0x7f7bac10c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.977+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/2182837224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0fff90 0x7f7bac10c490 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400b0a0 tx=0x7f7ba400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.977+0000 7f7bb39bf700 1 -- 172.21.15.70:0/2182837224 shutdown_connections 2023-10-08T08:44:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.977+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/2182837224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0fff90 0x7f7bac10c490 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.977+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/2182837224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1045e0 0x7f7bac1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.977+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/2182837224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0ff5d0 0x7f7bac0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.977+0000 7f7bb39bf700 1 -- 172.21.15.70:0/2182837224 >> 172.21.15.70:0/2182837224 conn(0x7f7bac076790 msgr2=0x7f7bac076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.977+0000 7f7bb39bf700 1 -- 172.21.15.70:0/2182837224 shutdown_connections 2023-10-08T08:44:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.977+0000 7f7bb39bf700 1 -- 172.21.15.70:0/2182837224 wait complete. 2023-10-08T08:44:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb39bf700 1 Processor -- start 2023-10-08T08:44:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb39bf700 1 -- start start 2023-10-08T08:44:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb39bf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ff5d0 0x7f7bac19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb39bf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0fff90 0x7f7bac19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb39bf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1045e0 0x7f7bac1958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb39bf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac1960b0 con 0x7f7bac0ff5d0 2023-10-08T08:44:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb39bf700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac196220 con 0x7f7bac0fff90 2023-10-08T08:44:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb39bf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac1963e0 con 0x7f7bac1045e0 2023-10-08T08:44:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb175b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ff5d0 0x7f7bac19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb175b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ff5d0 0x7f7bac19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51356/0 (socket says 172.21.15.70:51356) 2023-10-08T08:44:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb175b700 1 -- 172.21.15.70:0/3496475706 learned_addr learned my addr 172.21.15.70:0/3496475706 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.978+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0fff90 0x7f7bac19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7bb1f5c700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1045e0 0x7f7bac1958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7bb175b700 1 -- 172.21.15.70:0/3496475706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1045e0 msgr2=0x7f7bac1958e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7bb175b700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1045e0 0x7f7bac1958e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7bb175b700 1 -- 172.21.15.70:0/3496475706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0fff90 msgr2=0x7f7bac19bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7bb175b700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0fff90 0x7f7bac19bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7bb175b700 1 -- 172.21.15.70:0/3496475706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba4009d00 con 0x7f7bac0ff5d0 2023-10-08T08:44:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7bb175b700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ff5d0 0x7f7bac19b840 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800d980 tx=0x7f7ba800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7ba27fc700 1 -- 172.21.15.70:0/3496475706 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800b950 con 0x7f7bac0ff5d0 2023-10-08T08:44:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7ba27fc700 1 -- 172.21.15.70:0/3496475706 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ba8007620 con 0x7f7bac0ff5d0 2023-10-08T08:44:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7bb39bf700 1 -- 172.21.15.70:0/3496475706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac1966c0 con 0x7f7bac0ff5d0 2023-10-08T08:44:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7ba27fc700 1 -- 172.21.15.70:0/3496475706 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800f3c0 con 0x7f7bac0ff5d0 2023-10-08T08:44:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.979+0000 7f7bb39bf700 1 -- 172.21.15.70:0/3496475706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac1a27c0 con 0x7f7bac0ff5d0 2023-10-08T08:44:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.981+0000 7f7ba27fc700 1 -- 172.21.15.70:0/3496475706 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7ba8010640 con 0x7f7bac0ff5d0 2023-10-08T08:44:06.992 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.982+0000 7f7ba27fc700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b980a15f0 0x7f7b980a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.992 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.982+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b980a15f0 0x7f7b980a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.992 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.982+0000 7f7ba27fc700 1 -- 172.21.15.70:0/3496475706 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7ba80cd260 con 0x7f7bac0ff5d0 2023-10-08T08:44:06.992 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.982+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b980a15f0 0x7f7b980a3ab0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7bac197050 tx=0x7f7b9c00b3c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:06.992 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.983+0000 7f7bbfba8b80 1 Processor -- start 2023-10-08T08:44:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.983+0000 7f7bbfba8b80 1 -- start start 2023-10-08T08:44:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.983+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447eb6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.983+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447eb0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.983+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 0x557447eb1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.983+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447e19400 con 0x557447eb71a0 2023-10-08T08:44:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.983+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447e0abc0 con 0x557447eb10b0 2023-10-08T08:44:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.983+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447e084e0 con 0x557447eb6880 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb0f5a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447eb0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb0f5a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447eb0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51366/0 (socket says 172.21.15.70:51366) 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb0f5a700 1 -- 172.21.15.70:0/460269384 learned_addr learned my addr 172.21.15.70:0/460269384 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb175b700 1 --2- 172.21.15.70:0/460269384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447eb6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb1f5c700 1 --2- 172.21.15.70:0/460269384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 0x557447eb1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb0f5a700 1 -- 172.21.15.70:0/460269384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 msgr2=0x557447eb6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/460269384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447eb6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb0f5a700 1 -- 172.21.15.70:0/460269384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 msgr2=0x557447eb1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/460269384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 0x557447eb1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb0f5a700 1 -- 172.21.15.70:0/460269384 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557447c2ed80 con 0x557447eb71a0 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/460269384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447eb0b70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c003aa0 tx=0x7f7b9c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa93bc5fe81c4fe9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7b977fe700 1 -- 172.21.15.70:0/460269384 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0118d0 con 0x557447eb71a0 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7b977fe700 1 -- 172.21.15.70:0/460269384 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b9c015070 con 0x557447eb71a0 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.984+0000 7f7b977fe700 1 -- 172.21.15.70:0/460269384 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c01ed50 con 0x557447eb71a0 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/460269384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 msgr2=0x557447eb0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/460269384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447eb0b70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c003aa0 tx=0x7f7b9c013000 comp rx=0 tx=0).stop 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/460269384 shutdown_connections 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/460269384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 0x557447eb1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/460269384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447eb6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/460269384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447eb0b70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/460269384 >> 172.21.15.70:0/460269384 conn(0x557447e25200 msgr2=0x557447eabb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/460269384 shutdown_connections 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/460269384 wait complete. 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 -- start start 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.985+0000 7f7bbfba8b80 1 Processor -- start 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447eba550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447ebaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb71a0 0x557447ebafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447e03dd0 con 0x557447eb10b0 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447da06b0 con 0x557447eb71a0 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447da0350 con 0x557447eb6880 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bbfba8b80 10 client.0 _ll_register_callbacks cb 0x557447bfd7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb175b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447eba550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb175b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447eba550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51370/0 (socket says 172.21.15.70:51370) 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb175b700 1 -- 172.21.15.70:0/2992264143 learned_addr learned my addr 172.21.15.70:0/2992264143 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447ebaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb1f5c700 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb71a0 0x557447ebafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb175b700 1 -- 172.21.15.70:0/2992264143 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 msgr2=0x557447ebaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb175b700 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447ebaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb175b700 1 -- 172.21.15.70:0/2992264143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb71a0 msgr2=0x557447ebafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb175b700 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb71a0 0x557447ebafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb175b700 1 -- 172.21.15.70:0/2992264143 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c003780 con 0x557447eb10b0 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.986+0000 7f7bb1f5c700 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb71a0 0x557447ebafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bb175b700 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447eba550 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80ca6e0 tx=0x7f7ba8099fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13be8a9bb6023b00 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7b94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7b94ff9700 1 -- 172.21.15.70:0/2992264143 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba809a170 con 0x557447eb10b0 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7b94ff9700 1 -- 172.21.15.70:0/2992264143 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7ba809a2d0 con 0x557447eb10b0 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/2992264143 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557447dcbe50 con 0x557447eb10b0 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7b94ff9700 1 -- 172.21.15.70:0/2992264143 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ba8099400 con 0x557447eb10b0 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bbfba8b80 10 client.15858 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/2992264143 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557447c17c00 con 0x557447eb10b0 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7b94ff9700 1 -- 172.21.15.70:0/2992264143 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557447dcbe50 con 0x557447eb10b0 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7b94ff9700 1 -- 172.21.15.70:0/2992264143 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7ba809d070 con 0x557447eb10b0 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bbfba8b80 10 client.15858 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bbfba8b80 10 client.15858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bbfba8b80 20 client.15858 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557447ecad00 0x557447ecd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bbfba8b80 4 client.15858 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.987+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/2992264143 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557447dfcdb0 con 0x557447ecad00 2023-10-08T08:44:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.988+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557447ecad00 0x557447ecd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.988+0000 7f7b94ff9700 10 client.15858 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.988+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557447ecad00 0x557447ecd120 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=862d739a8b4dcf56 server_cookie=70b3480451aedaa6 in_seq=0 out_seq=0 2023-10-08T08:44:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7b94ff9700 1 -- 172.21.15.70:0/2992264143 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557447dfcdb0 con 0x557447ecad00 2023-10-08T08:44:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7b94ff9700 10 client.15858 handle_command_reply: tid=0 2023-10-08T08:44:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 client.15858 shutdown 2023-10-08T08:44:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/2992264143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 msgr2=0x557447eba550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447eba550 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80ca6e0 tx=0x7f7ba8099fc0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/2992264143 shutdown_connections 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557447ecad00 0x557447ecd120 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb71a0 0x557447ebafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447eba550 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/2992264143 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447ebaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7b94ff9700 0 client.15858 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/2992264143 >> 172.21.15.70:0/2992264143 conn(0x557447e25200 msgr2=0x557447eab010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/2992264143 shutdown_connections 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/2992264143 wait complete. 2023-10-08T08:44:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:06.989+0000 7f7bbfba8b80 20 client.15858 trim_cache size 0 max 16384 2023-10-08T08:44:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.004+0000 7f7bbfba8b80 1 Processor -- start 2023-10-08T08:44:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.004+0000 7f7bbfba8b80 1 -- start start 2023-10-08T08:44:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.004+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 0x557447eb0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.004+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447eb5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.004+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447ebadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.004+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447c848c0 con 0x557447eb71a0 2023-10-08T08:44:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.004+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447ea8830 con 0x557447eb10b0 2023-10-08T08:44:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.004+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447ea3670 con 0x557447eb6880 2023-10-08T08:44:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb1f5c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447ebadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb1f5c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447ebadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51382/0 (socket says 172.21.15.70:51382) 2023-10-08T08:44:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb1f5c700 1 -- 172.21.15.70:0/4171558122 learned_addr learned my addr 172.21.15.70:0/4171558122 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb175b700 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 0x557447eb0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447eb5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb1f5c700 1 -- 172.21.15.70:0/4171558122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 msgr2=0x557447eb5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb1f5c700 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447eb5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb1f5c700 1 -- 172.21.15.70:0/4171558122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 msgr2=0x557447eb0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb1f5c700 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 0x557447eb0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb1f5c700 1 -- 172.21.15.70:0/4171558122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557447ed1d30 con 0x557447eb71a0 2023-10-08T08:44:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb175b700 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 0x557447eb0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7bb1f5c700 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447ebadf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4015000 tx=0x7f7ba4007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd0a64963691493 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7b97fff700 1 -- 172.21.15.70:0/4171558122 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba400e040 con 0x557447eb71a0 2023-10-08T08:44:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7b97fff700 1 -- 172.21.15.70:0/4171558122 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ba4004a50 con 0x557447eb71a0 2023-10-08T08:44:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.005+0000 7f7b97fff700 1 -- 172.21.15.70:0/4171558122 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba401c440 con 0x557447eb71a0 2023-10-08T08:44:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/4171558122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 msgr2=0x557447ebadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447ebadf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4015000 tx=0x7f7ba4007b80 comp rx=0 tx=0).stop 2023-10-08T08:44:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/4171558122 shutdown_connections 2023-10-08T08:44:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb71a0 0x557447ebadf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb10b0 0x557447eb0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/4171558122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb6880 0x557447eb5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/4171558122 >> 172.21.15.70:0/4171558122 conn(0x557447e25200 msgr2=0x557447eb5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/4171558122 shutdown_connections 2023-10-08T08:44:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/4171558122 wait complete. 2023-10-08T08:44:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 -- start start 2023-10-08T08:44:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.006+0000 7f7bbfba8b80 1 Processor -- start 2023-10-08T08:44:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447ebf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb6880 0x557447ebfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bbfba8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb71a0 0x557447ebffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447f1dc40 con 0x557447eb10b0 2023-10-08T08:44:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447f1ddb0 con 0x557447eb6880 2023-10-08T08:44:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bbfba8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557447f1df70 con 0x557447eb71a0 2023-10-08T08:44:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bbfba8b80 10 client.0 _ll_register_callbacks cb 0x7f7ba8010460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb175b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447ebf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb175b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447ebf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51384/0 (socket says 172.21.15.70:51384) 2023-10-08T08:44:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb175b700 1 -- 172.21.15.70:0/1077601202 learned_addr learned my addr 172.21.15.70:0/1077601202 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb1f5c700 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb71a0 0x557447ebffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb6880 0x557447ebfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb175b700 1 -- 172.21.15.70:0/1077601202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb71a0 msgr2=0x557447ebffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb175b700 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb71a0 0x557447ebffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb175b700 1 -- 172.21.15.70:0/1077601202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb6880 msgr2=0x557447ebfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb175b700 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb6880 0x557447ebfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb175b700 1 -- 172.21.15.70:0/1077601202 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac10cd90 con 0x557447eb10b0 2023-10-08T08:44:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bb175b700 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447ebf520 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800b540 tx=0x7f7ba8010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e34c3fb1bae904 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7b94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7b94ff9700 1 -- 172.21.15.70:0/1077601202 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8096020 con 0x557447eb10b0 2023-10-08T08:44:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7b94ff9700 1 -- 172.21.15.70:0/1077601202 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7ba8099400 con 0x557447eb10b0 2023-10-08T08:44:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.007+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/1077601202 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b9c015070 con 0x557447eb10b0 2023-10-08T08:44:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7b94ff9700 1 -- 172.21.15.70:0/1077601202 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ba8099ce0 con 0x557447eb10b0 2023-10-08T08:44:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7bbfba8b80 10 client.15864 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/1077601202 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557447c551f0 con 0x557447eb10b0 2023-10-08T08:44:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7b94ff9700 1 -- 172.21.15.70:0/1077601202 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b9c015070 con 0x557447eb10b0 2023-10-08T08:44:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7b94ff9700 1 -- 172.21.15.70:0/1077601202 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7ba809d040 con 0x557447eb10b0 2023-10-08T08:44:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7bbfba8b80 10 client.15864 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7bbfba8b80 10 client.15864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7bbfba8b80 20 client.15864 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557447f1f3e0 0x557447f217d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7bbfba8b80 4 client.15864 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:44:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/1077601202 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557447dfcad0 con 0x557447f1f3e0 2023-10-08T08:44:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.008+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557447f1f3e0 0x557447f217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.009+0000 7f7b94ff9700 10 client.15864 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.009+0000 7f7bb0f5a700 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557447f1f3e0 0x557447f217d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c174eb65c04452c4 server_cookie=ee85f06e7cc3d23e in_seq=0 out_seq=0 2023-10-08T08:44:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7b94ff9700 1 -- 172.21.15.70:0/1077601202 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557447dfcad0 con 0x557447f1f3e0 2023-10-08T08:44:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7b94ff9700 10 client.15864 handle_command_reply: tid=0 2023-10-08T08:44:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 client.15864 shutdown 2023-10-08T08:44:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/1077601202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 msgr2=0x557447ebf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447ebf520 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800b540 tx=0x7f7ba8010a40 comp rx=0 tx=0).stop 2023-10-08T08:44:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/1077601202 shutdown_connections 2023-10-08T08:44:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557447eb71a0 0x557447ebffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557447eb10b0 0x557447ebf520 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557447f1f3e0 0x557447f217d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 --2- 172.21.15.70:0/1077601202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557447eb6880 0x557447ebfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/1077601202 >> 172.21.15.70:0/1077601202 conn(0x557447e25200 msgr2=0x557447eb7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7b94ff9700 0 client.15864 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/1077601202 shutdown_connections 2023-10-08T08:44:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 1 -- 172.21.15.70:0/1077601202 wait complete. 2023-10-08T08:44:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.016+0000 7f7bbfba8b80 20 client.15864 trim_cache size 0 max 16384 2023-10-08T08:44:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:44:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:44:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:44:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:44:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 -- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b980a15f0 msgr2=0x7f7b980a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b980a15f0 0x7f7b980a3ab0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7bac197050 tx=0x7f7b9c00b3c0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 -- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ff5d0 msgr2=0x7f7bac19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ff5d0 0x7f7bac19b840 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800d980 tx=0x7f7ba800dc90 comp rx=0 tx=0).stop 2023-10-08T08:44:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 -- 172.21.15.70:0/3496475706 shutdown_connections 2023-10-08T08:44:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7b980a15f0 0x7f7b980a3ab0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1045e0 0x7f7bac1958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac0ff5d0 0x7f7bac19b840 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 --2- 172.21.15.70:0/3496475706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bac0fff90 0x7f7bac19bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 -- 172.21.15.70:0/3496475706 >> 172.21.15.70:0/3496475706 conn(0x7f7bac076790 msgr2=0x7f7bac0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 -- 172.21.15.70:0/3496475706 shutdown_connections 2023-10-08T08:44:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:07.017+0000 7f7bb39bf700 1 -- 172.21.15.70:0/3496475706 wait complete. 2023-10-08T08:44:08.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:08 smithi070 ceph-mon[99513]: pgmap v300: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-10-08T08:44:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:08 smithi105 ceph-mon[103798]: pgmap v300: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-10-08T08:44:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:08 smithi191 ceph-mon[104220]: pgmap v300: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2023-10-08T08:44:09.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:09 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:44:09.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:09 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:44:09.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:09 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:44:10.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:10 smithi070 ceph-mon[99513]: pgmap v301: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2023-10-08T08:44:10.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:10 smithi105 ceph-mon[103798]: pgmap v301: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2023-10-08T08:44:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:10 smithi191 ceph-mon[104220]: pgmap v301: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2023-10-08T08:44:12.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: pgmap v302: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 26 op/s 2023-10-08T08:44:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:44:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:44:12.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: pgmap v302: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 26 op/s 2023-10-08T08:44:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:44:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:44:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: pgmap v302: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 26 op/s 2023-10-08T08:44:12.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:12.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:44:12.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:44:12.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:44:14.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:14 smithi070 ceph-mon[99513]: pgmap v303: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2023-10-08T08:44:14.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:14 smithi105 ceph-mon[103798]: pgmap v303: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2023-10-08T08:44:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:14 smithi191 ceph-mon[104220]: pgmap v303: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2023-10-08T08:44:16.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:16 smithi070 ceph-mon[99513]: pgmap v304: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-10-08T08:44:16.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:16 smithi105 ceph-mon[103798]: pgmap v304: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-10-08T08:44:16.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:16 smithi191 ceph-mon[104220]: pgmap v304: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-10-08T08:44:18.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:18 smithi070 ceph-mon[99513]: pgmap v305: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T08:44:18.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:18 smithi105 ceph-mon[103798]: pgmap v305: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T08:44:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:18 smithi191 ceph-mon[104220]: pgmap v305: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T08:44:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.136+0000 7f7f15ea7700 1 -- 172.21.15.70:0/4287793849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100fec60 msgr2=0x7f7f100ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/4287793849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100fec60 0x7f7f100ff0e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009990 tx=0x7f7f04009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 -- 172.21.15.70:0/4287793849 shutdown_connections 2023-10-08T08:44:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/4287793849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f100ff620 0x7f7f1010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/4287793849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f10106760 0x7f7f10106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/4287793849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100fec60 0x7f7f100ff0e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 -- 172.21.15.70:0/4287793849 >> 172.21.15.70:0/4287793849 conn(0x7f7f10075bf0 msgr2=0x7f7f100fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 -- 172.21.15.70:0/4287793849 shutdown_connections 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 -- 172.21.15.70:0/4287793849 wait complete. 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 Processor -- start 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.137+0000 7f7f15ea7700 1 -- start start 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f15ea7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100fec60 0x7f7f1019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f15ea7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100ff620 0x7f7f1019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f15ea7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f10106760 0x7f7f10196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f15ea7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10196fd0 con 0x7f7f100ff620 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f15ea7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10197140 con 0x7f7f10106760 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f15ea7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10197300 con 0x7f7f100fec60 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100ff620 0x7f7f1019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100ff620 0x7f7f1019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51398/0 (socket says 172.21.15.70:51398) 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0effd700 1 -- 172.21.15.70:0/1529572685 learned_addr learned my addr 172.21.15.70:0/1529572685 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100fec60 0x7f7f1019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0ffff700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f10106760 0x7f7f10196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0effd700 1 -- 172.21.15.70:0/1529572685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100fec60 msgr2=0x7f7f1019c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0effd700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100fec60 0x7f7f1019c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0effd700 1 -- 172.21.15.70:0/1529572685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f10106760 msgr2=0x7f7f10196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0effd700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f10106760 0x7f7f10196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0effd700 1 -- 172.21.15.70:0/1529572685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f040095f0 con 0x7f7f100ff620 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0ffff700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f10106760 0x7f7f10196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0effd700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100ff620 0x7f7f1019cd80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7f040098e0 tx=0x7f7f0400f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0cff9700 1 -- 172.21.15.70:0/1529572685 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0401d070 con 0x7f7f100ff620 2023-10-08T08:44:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0cff9700 1 -- 172.21.15.70:0/1529572685 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f0400fb90 con 0x7f7f100ff620 2023-10-08T08:44:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f0cff9700 1 -- 172.21.15.70:0/1529572685 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04017650 con 0x7f7f100ff620 2023-10-08T08:44:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f15ea7700 1 -- 172.21.15.70:0/1529572685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f10197580 con 0x7f7f100ff620 2023-10-08T08:44:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.138+0000 7f7f15ea7700 1 -- 172.21.15.70:0/1529572685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f101a3830 con 0x7f7f100ff620 2023-10-08T08:44:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.141+0000 7f7f0cff9700 1 -- 172.21.15.70:0/1529572685 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7f0400fd00 con 0x7f7f100ff620 2023-10-08T08:44:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.142+0000 7f7f0cff9700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7ef80a15f0 0x7f7ef80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.142+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7ef80a15f0 0x7f7ef80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.142+0000 7f7f0cff9700 1 -- 172.21.15.70:0/1529572685 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7f040ce530 con 0x7f7f100ff620 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.142+0000 7f7f22090b80 1 Processor -- start 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.142+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7ef80a15f0 0x7f7ef80a3ab0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000bbb0 tx=0x7f7f0000b590 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.142+0000 7f7f22090b80 1 -- start start 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe975c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe96fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe970510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f22090b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe8d8400 con 0x55eafe9700b0 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f22090b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe8c9bc0 con 0x55eafe9761a0 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f22090b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe8c74e0 con 0x55eafe975880 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe970510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe970510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51408/0 (socket says 172.21.15.70:51408) 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0ffff700 1 -- 172.21.15.70:0/2068609294 learned_addr learned my addr 172.21.15.70:0/2068609294 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe975c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0effd700 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe96fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0ffff700 1 -- 172.21.15.70:0/2068609294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 msgr2=0x55eafe975c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0ffff700 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe975c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0ffff700 1 -- 172.21.15.70:0/2068609294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 msgr2=0x55eafe96fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0ffff700 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe96fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0ffff700 1 -- 172.21.15.70:0/2068609294 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eafe6edd80 con 0x55eafe9700b0 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0effd700 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe96fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.143+0000 7f7f0ffff700 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe970510 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009d60 tx=0x7f7f080077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96da0f733130008 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.144+0000 7f7ef5ffb700 1 -- 172.21.15.70:0/2068609294 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08004db0 con 0x55eafe9700b0 2023-10-08T08:44:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.144+0000 7f7ef5ffb700 1 -- 172.21.15.70:0/2068609294 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f080054e0 con 0x55eafe9700b0 2023-10-08T08:44:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.144+0000 7f7ef5ffb700 1 -- 172.21.15.70:0/2068609294 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f080146f0 con 0x55eafe9700b0 2023-10-08T08:44:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.145+0000 7f7f22090b80 1 -- 172.21.15.70:0/2068609294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 msgr2=0x55eafe970510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.145+0000 7f7f22090b80 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe970510 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009d60 tx=0x7f7f080077e0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.145+0000 7f7f22090b80 1 -- 172.21.15.70:0/2068609294 shutdown_connections 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.145+0000 7f7f22090b80 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe970510 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.145+0000 7f7f22090b80 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe975c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.145+0000 7f7f22090b80 1 --2- 172.21.15.70:0/2068609294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe96fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.145+0000 7f7f22090b80 1 -- 172.21.15.70:0/2068609294 >> 172.21.15.70:0/2068609294 conn(0x55eafe8e4200 msgr2=0x55eafe96ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.145+0000 7f7f22090b80 1 -- 172.21.15.70:0/2068609294 shutdown_connections 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.145+0000 7f7f22090b80 1 -- 172.21.15.70:0/2068609294 wait complete. 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f22090b80 1 -- start start 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f22090b80 1 Processor -- start 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9700b0 0x55eafe97c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe975880 0x55eafe9794d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe9761a0 0x55eafe979b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f22090b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe8c2dd0 con 0x55eafe975880 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f22090b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe85f6b0 con 0x55eafe9700b0 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f22090b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe85f350 con 0x55eafe9761a0 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f22090b80 10 client.0 _ll_register_callbacks cb 0x55eafe6bc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe975880 0x55eafe9794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe975880 0x55eafe9794d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51412/0 (socket says 172.21.15.70:51412) 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0effd700 1 -- 172.21.15.70:0/1764574963 learned_addr learned my addr 172.21.15.70:0/1764574963 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9700b0 0x55eafe97c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0ffff700 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe9761a0 0x55eafe979b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0effd700 1 -- 172.21.15.70:0/1764574963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe9761a0 msgr2=0x55eafe979b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0effd700 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe9761a0 0x55eafe979b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0effd700 1 -- 172.21.15.70:0/1764574963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9700b0 msgr2=0x55eafe97c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0effd700 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9700b0 0x55eafe97c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0effd700 1 -- 172.21.15.70:0/1764574963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f080099c0 con 0x55eafe975880 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.146+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9700b0 0x55eafe97c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f0effd700 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe975880 0x55eafe9794d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7f040cbfb0 tx=0x7f7f0409bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6424a11eb10add48 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7eeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1764574963 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f040a35d0 con 0x55eafe975880 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1764574963 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7f0409a7c0 con 0x55eafe975880 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f22090b80 1 -- 172.21.15.70:0/1764574963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eafe88ae50 con 0x55eafe975880 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1764574963 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f0409a980 con 0x55eafe975880 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f22090b80 10 client.15876 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f22090b80 1 -- 172.21.15.70:0/1764574963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55eafe6d6c00 con 0x55eafe975880 2023-10-08T08:44:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1764574963 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eafe88ae50 con 0x55eafe975880 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1764574963 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7f040970c0 con 0x55eafe975880 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f22090b80 10 client.15876 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f22090b80 10 client.15876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f22090b80 20 client.15876 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55eafe9897b0 0x55eafe98bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f22090b80 4 client.15876 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.147+0000 7f7f22090b80 1 -- 172.21.15.70:0/1764574963 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eafe8bbdb0 con 0x55eafe9897b0 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.148+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55eafe9897b0 0x55eafe98bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.148+0000 7f7eeeffd700 10 client.15876 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.148+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55eafe9897b0 0x55eafe98bbd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d257d32bbe8c04c server_cookie=43d7c42305bf714 in_seq=0 out_seq=0 2023-10-08T08:44:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1764574963 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eafe8bbdb0 con 0x55eafe9897b0 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7eeeffd700 10 client.15876 handle_command_reply: tid=0 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 client.15876 shutdown 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 -- 172.21.15.70:0/1764574963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe975880 msgr2=0x55eafe9794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe975880 0x55eafe9794d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7f040cbfb0 tx=0x7f7f0409bb00 comp rx=0 tx=0).stop 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 -- 172.21.15.70:0/1764574963 shutdown_connections 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe9761a0 0x55eafe979b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55eafe9897b0 0x55eafe98bbd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9700b0 0x55eafe97c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7eeeffd700 0 client.15876 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1764574963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe975880 0x55eafe9794d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 -- 172.21.15.70:0/1764574963 >> 172.21.15.70:0/1764574963 conn(0x55eafe8e4200 msgr2=0x55eafe96a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 -- 172.21.15.70:0/1764574963 shutdown_connections 2023-10-08T08:44:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 1 -- 172.21.15.70:0/1764574963 wait complete. 2023-10-08T08:44:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.149+0000 7f7f22090b80 20 client.15876 trim_cache size 0 max 16384 2023-10-08T08:44:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.163+0000 7f7f22090b80 1 Processor -- start 2023-10-08T08:44:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.163+0000 7f7f22090b80 1 -- start start 2023-10-08T08:44:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe96fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.166 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe985a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe96a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f22090b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe7438c0 con 0x55eafe9700b0 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f22090b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe967830 con 0x55eafe9761a0 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f22090b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe9652b0 con 0x55eafe975880 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe96fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe96fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51418/0 (socket says 172.21.15.70:51418) 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0f7fe700 1 -- 172.21.15.70:0/3534519733 learned_addr learned my addr 172.21.15.70:0/3534519733 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0f7fe700 1 -- 172.21.15.70:0/3534519733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 msgr2=0x55eafe985a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0effd700 1 --2- 172.21.15.70:0/3534519733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe985a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/3534519733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe985a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0f7fe700 1 -- 172.21.15.70:0/3534519733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 msgr2=0x55eafe96a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/3534519733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe96a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0f7fe700 1 -- 172.21.15.70:0/3534519733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eafe7141f0 con 0x55eafe9700b0 2023-10-08T08:44:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/3534519733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe96fb70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7f00014040 tx=0x7f7f00015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751a9549f415c5c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7ef67fc700 1 -- 172.21.15.70:0/3534519733 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00025040 con 0x55eafe9700b0 2023-10-08T08:44:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7ef67fc700 1 -- 172.21.15.70:0/3534519733 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f00027cd0 con 0x55eafe9700b0 2023-10-08T08:44:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.164+0000 7f7ef67fc700 1 -- 172.21.15.70:0/3534519733 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0001f690 con 0x55eafe9700b0 2023-10-08T08:44:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.165+0000 7f7f22090b80 1 -- 172.21.15.70:0/3534519733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 msgr2=0x55eafe96fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.165+0000 7f7f22090b80 1 --2- 172.21.15.70:0/3534519733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe96fb70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7f00014040 tx=0x7f7f00015000 comp rx=0 tx=0).stop 2023-10-08T08:44:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 -- 172.21.15.70:0/3534519733 shutdown_connections 2023-10-08T08:44:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 --2- 172.21.15.70:0/3534519733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe96a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 --2- 172.21.15.70:0/3534519733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe96fb70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 --2- 172.21.15.70:0/3534519733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe985a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 -- 172.21.15.70:0/3534519733 >> 172.21.15.70:0/3534519733 conn(0x55eafe8e4200 msgr2=0x55eafe985340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 -- 172.21.15.70:0/3534519733 shutdown_connections 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 -- 172.21.15.70:0/3534519733 wait complete. 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 -- start start 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 Processor -- start 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe97edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe97f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe9dc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe97fa90 con 0x55eafe9700b0 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe9dcb50 con 0x55eafe9761a0 2023-10-08T08:44:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafe9dcd10 con 0x55eafe975880 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f22090b80 10 client.0 _ll_register_callbacks cb 0x7f7f0409aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe97edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f0f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe97edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51424/0 (socket says 172.21.15.70:51424) 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.166+0000 7f7f0f7fe700 1 -- 172.21.15.70:0/1003025329 learned_addr learned my addr 172.21.15.70:0/1003025329 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f0ffff700 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe9dc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f0effd700 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe97f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f0f7fe700 1 -- 172.21.15.70:0/1003025329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 msgr2=0x55eafe97f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe97f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f0f7fe700 1 -- 172.21.15.70:0/1003025329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 msgr2=0x55eafe9dc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe9dc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f0f7fe700 1 -- 172.21.15.70:0/1003025329 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0000fa50 con 0x55eafe9700b0 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f0f7fe700 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe97edc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7f00028f40 tx=0x7f7f00028f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9756decf3322fd43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7eeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1003025329 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00011d20 con 0x55eafe9700b0 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1003025329 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7f00005040 con 0x55eafe9700b0 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f22090b80 1 -- 172.21.15.70:0/1003025329 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f080054e0 con 0x55eafe9700b0 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1003025329 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f00005200 con 0x55eafe9700b0 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f22090b80 10 client.15882 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7f22090b80 1 -- 172.21.15.70:0/1003025329 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55eafe6ec250 con 0x55eafe9700b0 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.167+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1003025329 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f080054e0 con 0x55eafe9700b0 2023-10-08T08:44:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1003025329 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7f00004750 con 0x55eafe9700b0 2023-10-08T08:44:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7f22090b80 10 client.15882 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7f22090b80 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7f22090b80 20 client.15882 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55eafe9de4a0 0x55eafe9e08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7f22090b80 4 client.15882 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:44:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7f22090b80 1 -- 172.21.15.70:0/1003025329 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eafe8bbad0 con 0x55eafe9de4a0 2023-10-08T08:44:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7f0effd700 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55eafe9de4a0 0x55eafe9e08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7eeeffd700 10 client.15882 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.168+0000 7f7f0effd700 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55eafe9de4a0 0x55eafe9e08c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6875be46729358f server_cookie=100972e57886f8f1 in_seq=0 out_seq=0 2023-10-08T08:44:20.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.172+0000 7f7eeeffd700 1 -- 172.21.15.70:0/1003025329 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eafe8bbad0 con 0x55eafe9de4a0 2023-10-08T08:44:20.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.172+0000 7f7eeeffd700 10 client.15882 handle_command_reply: tid=0 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 client.15882 shutdown 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 -- 172.21.15.70:0/1003025329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 msgr2=0x55eafe97edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe97edc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7f00028f40 tx=0x7f7f00028f70 comp rx=0 tx=0).stop 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 -- 172.21.15.70:0/1003025329 shutdown_connections 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55eafe9de4a0 0x55eafe9e08c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55eafe9761a0 0x55eafe9dc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafe9700b0 0x55eafe97edc0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7eeeffd700 0 client.15882 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 --2- 172.21.15.70:0/1003025329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafe975880 0x55eafe97f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 -- 172.21.15.70:0/1003025329 >> 172.21.15.70:0/1003025329 conn(0x55eafe8e4200 msgr2=0x55eafe97ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 -- 172.21.15.70:0/1003025329 shutdown_connections 2023-10-08T08:44:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 1 -- 172.21.15.70:0/1003025329 wait complete. 2023-10-08T08:44:20.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f22090b80 20 client.15882 trim_cache size 0 max 16384 2023-10-08T08:44:20.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:44:20.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:44:20.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:44:20.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:44:20.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 -- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7ef80a15f0 msgr2=0x7f7ef80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:20.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7ef80a15f0 0x7f7ef80a3ab0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000bbb0 tx=0x7f7f0000b590 comp rx=0 tx=0).stop 2023-10-08T08:44:20.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 -- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100ff620 msgr2=0x7f7f1019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:20.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100ff620 0x7f7f1019cd80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7f040098e0 tx=0x7f7f0400f720 comp rx=0 tx=0).stop 2023-10-08T08:44:20.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 -- 172.21.15.70:0/1529572685 shutdown_connections 2023-10-08T08:44:20.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7ef80a15f0 0x7f7ef80a3ab0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f10106760 0x7f7f10196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100fec60 0x7f7f1019c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 --2- 172.21.15.70:0/1529572685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f100ff620 0x7f7f1019cd80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.173+0000 7f7f15ea7700 1 -- 172.21.15.70:0/1529572685 >> 172.21.15.70:0/1529572685 conn(0x7f7f10075bf0 msgr2=0x7f7f100fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.174+0000 7f7f15ea7700 1 -- 172.21.15.70:0/1529572685 shutdown_connections 2023-10-08T08:44:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:20.174+0000 7f7f15ea7700 1 -- 172.21.15.70:0/1529572685 wait complete. 2023-10-08T08:44:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:20 smithi070 ceph-mon[99513]: pgmap v306: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T08:44:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:20 smithi105 ceph-mon[103798]: pgmap v306: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T08:44:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:20 smithi191 ceph-mon[104220]: pgmap v306: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T08:44:22.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:44:22.424 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:22 smithi070 ceph-mon[99513]: pgmap v307: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-08T08:44:22.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:22 smithi105 ceph-mon[103798]: pgmap v307: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-08T08:44:22.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.528+0000 7f8faba98700 1 -- 172.21.15.70:0/339449070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ffa20 msgr2=0x7f8fa410d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.528+0000 7f8faba98700 1 --2- 172.21.15.70:0/339449070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ffa20 0x7f8fa410d640 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00b0d0 tx=0x7f8f9c00b3e0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.528+0000 7f8faba98700 1 -- 172.21.15.70:0/339449070 shutdown_connections 2023-10-08T08:44:22.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.528+0000 7f8faba98700 1 --2- 172.21.15.70:0/339449070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ffa20 0x7f8fa410d640 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.528+0000 7f8faba98700 1 --2- 172.21.15.70:0/339449070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa4105740 0x7f8fa4105b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.528+0000 7f8faba98700 1 --2- 172.21.15.70:0/339449070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa40ff060 0x7f8fa40ff4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.528+0000 7f8faba98700 1 -- 172.21.15.70:0/339449070 >> 172.21.15.70:0/339449070 conn(0x7f8fa4075c20 msgr2=0x7f8fa4076030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:22.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.528+0000 7f8faba98700 1 -- 172.21.15.70:0/339449070 shutdown_connections 2023-10-08T08:44:22.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.528+0000 7f8faba98700 1 -- 172.21.15.70:0/339449070 wait complete. 2023-10-08T08:44:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.529+0000 7f8faba98700 1 Processor -- start 2023-10-08T08:44:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.529+0000 7f8faba98700 1 -- start start 2023-10-08T08:44:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.529+0000 7f8faba98700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ff060 0x7f8fa419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.529+0000 7f8faba98700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa40ffa20 0x7f8fa419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.529+0000 7f8faba98700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa4105740 0x7f8fa4196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.529+0000 7f8faba98700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41971a0 con 0x7f8fa40ff060 2023-10-08T08:44:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.529+0000 7f8faba98700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa4197310 con 0x7f8fa40ffa20 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.529+0000 7f8faba98700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41974d0 con 0x7f8fa4105740 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9834700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ff060 0x7f8fa419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9834700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ff060 0x7f8fa419ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51436/0 (socket says 172.21.15.70:51436) 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9834700 1 -- 172.21.15.70:0/2995618883 learned_addr learned my addr 172.21.15.70:0/2995618883 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa40ffa20 0x7f8fa419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8faa035700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa4105740 0x7f8fa4196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9834700 1 -- 172.21.15.70:0/2995618883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa4105740 msgr2=0x7f8fa4196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa4105740 0x7f8fa4196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9834700 1 -- 172.21.15.70:0/2995618883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa40ffa20 msgr2=0x7f8fa419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa40ffa20 0x7f8fa419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9834700 1 -- 172.21.15.70:0/2995618883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c009d00 con 0x7f8fa40ff060 2023-10-08T08:44:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8faa035700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa4105740 0x7f8fa4196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ff060 0x7f8fa419ca00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000e9a0 tx=0x7f8fa000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8f9affd700 1 -- 172.21.15.70:0/2995618883 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0009790 con 0x7f8fa40ff060 2023-10-08T08:44:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8f9affd700 1 -- 172.21.15.70:0/2995618883 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fa000cbd0 con 0x7f8fa40ff060 2023-10-08T08:44:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8faba98700 1 -- 172.21.15.70:0/2995618883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa41977b0 con 0x7f8fa40ff060 2023-10-08T08:44:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8f9affd700 1 -- 172.21.15.70:0/2995618883 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0018680 con 0x7f8fa40ff060 2023-10-08T08:44:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.530+0000 7f8faba98700 1 -- 172.21.15.70:0/2995618883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa41a39f0 con 0x7f8fa40ff060 2023-10-08T08:44:22.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.532+0000 7f8f9affd700 1 -- 172.21.15.70:0/2995618883 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8fa000cd40 con 0x7f8fa40ff060 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.533+0000 7f8f9affd700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8f900a1670 0x7f8f900a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.533+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8f900a1670 0x7f8f900a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.533+0000 7f8f9affd700 1 -- 172.21.15.70:0/2995618883 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8fa0014070 con 0x7f8fa40ff060 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.534+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8f900a1670 0x7f8f900a3b30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40760d0 tx=0x7f8f94009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.534+0000 7f8fb7c81b80 1 Processor -- start 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.534+0000 7f8fb7c81b80 1 -- start start 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.534+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 0x55b435ce2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.534+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 0x55b435ced110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.534+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ced650 0x55b435cefa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435c4b460 con 0x55b435ced650 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435c3cc20 con 0x55b435ce27a0 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435c3a540 con 0x55b435ce1e80 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8faa035700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ced650 0x55b435cefa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8faa035700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ced650 0x55b435cefa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51448/0 (socket says 172.21.15.70:51448) 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8faa035700 1 -- 172.21.15.70:0/2105363026 learned_addr learned my addr 172.21.15.70:0/2105363026 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2105363026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 0x55b435ced110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2105363026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 0x55b435ce2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8faa035700 1 -- 172.21.15.70:0/2105363026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 msgr2=0x55b435ce2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8faa035700 1 --2- 172.21.15.70:0/2105363026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 0x55b435ce2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8faa035700 1 -- 172.21.15.70:0/2105363026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 msgr2=0x55b435ced110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8faa035700 1 --2- 172.21.15.70:0/2105363026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 0x55b435ced110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8faa035700 1 -- 172.21.15.70:0/2105363026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b435a60de0 con 0x55b435ced650 2023-10-08T08:44:22.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8faa035700 1 --2- 172.21.15.70:0/2105363026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ced650 0x55b435cefa40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009c60 tx=0x7f8f9c009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37336d70c5df3196 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:22.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8f8ffff700 1 -- 172.21.15.70:0/2105363026 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00e030 con 0x55b435ced650 2023-10-08T08:44:22.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8f8ffff700 1 -- 172.21.15.70:0/2105363026 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f9c009490 con 0x55b435ced650 2023-10-08T08:44:22.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.535+0000 7f8f8ffff700 1 -- 172.21.15.70:0/2105363026 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c007740 con 0x55b435ced650 2023-10-08T08:44:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.536+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2105363026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ced650 msgr2=0x55b435cefa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.536+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2105363026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ced650 0x55b435cefa40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009c60 tx=0x7f8f9c009c90 comp rx=0 tx=0).stop 2023-10-08T08:44:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.536+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2105363026 shutdown_connections 2023-10-08T08:44:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.536+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2105363026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ced650 0x55b435cefa40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.536+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2105363026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 0x55b435ce2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.536+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2105363026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 0x55b435ced110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.536+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2105363026 >> 172.21.15.70:0/2105363026 conn(0x55b435c57260 msgr2=0x55b435cde2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.536+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2105363026 shutdown_connections 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.536+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2105363026 wait complete. 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fb7c81b80 1 -- start start 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fb7c81b80 1 Processor -- start 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce1e80 0x55b435cecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 0x55b435cea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 0x55b435cea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435c35e30 con 0x55b435ce1e80 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435bd2710 con 0x55b435ce27a0 2023-10-08T08:44:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435bd23b0 con 0x55b435ced650 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fb7c81b80 10 client.0 _ll_register_callbacks cb 0x55b435a2f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fa9834700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce1e80 0x55b435cecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fa9834700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce1e80 0x55b435cecfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51450/0 (socket says 172.21.15.70:51450) 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.537+0000 7f8fa9834700 1 -- 172.21.15.70:0/2714763552 learned_addr learned my addr 172.21.15.70:0/2714763552 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 0x55b435cea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8faa035700 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 0x55b435cea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fa9834700 1 -- 172.21.15.70:0/2714763552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 msgr2=0x55b435cea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 0x55b435cea8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fa9834700 1 -- 172.21.15.70:0/2714763552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 msgr2=0x55b435cea2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 0x55b435cea2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fa9834700 1 -- 172.21.15.70:0/2714763552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa410ded0 con 0x55b435ce1e80 2023-10-08T08:44:22.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce1e80 0x55b435cecfc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00cab40 tx=0x7f8fa009aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dd88e10318c62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8f8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2714763552 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa009e2d0 con 0x55b435ce1e80 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2714763552 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8fa00a2700 con 0x55b435ce1e80 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2714763552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b435bfdeb0 con 0x55b435ce1e80 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2714763552 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fa0099860 con 0x55b435ce1e80 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fb7c81b80 10 client.15894 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2714763552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b435a49c60 con 0x55b435ce1e80 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.538+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2714763552 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b435bfdeb0 con 0x55b435ce1e80 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2714763552 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8fa00b2070 con 0x55b435ce1e80 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8fb7c81b80 10 client.15894 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:22.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8fb7c81b80 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8fb7c81b80 20 client.15894 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b435cfd0e0 0x55b435cff500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8fb7c81b80 4 client.15894 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2714763552 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b435c2ee10 con 0x55b435cfd0e0 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b435cfd0e0 0x55b435cff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b435cfd0e0 0x55b435cff500 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45f4a1dae78ae703 server_cookie=dfbd0645e6dd1839 in_seq=0 out_seq=0 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.539+0000 7f8f8d7fa700 10 client.15894 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2714763552 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b435c2ee10 con 0x55b435cfd0e0 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8f8d7fa700 10 client.15894 handle_command_reply: tid=0 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 client.15894 shutdown 2023-10-08T08:44:22.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2714763552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce1e80 msgr2=0x55b435cecfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce1e80 0x55b435cecfc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00cab40 tx=0x7f8fa009aba0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2714763552 shutdown_connections 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 0x55b435cea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce1e80 0x55b435cecfc0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b435cfd0e0 0x55b435cff500 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2714763552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce27a0 0x55b435cea2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8f8d7fa700 0 client.15894 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2714763552 >> 172.21.15.70:0/2714763552 conn(0x55b435c57260 msgr2=0x55b435cddec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2714763552 shutdown_connections 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2714763552 wait complete. 2023-10-08T08:44:22.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.540+0000 7f8fb7c81b80 20 client.15894 trim_cache size 0 max 16384 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fb7c81b80 1 Processor -- start 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fb7c81b80 1 -- start start 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 0x55b435cf4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ced650 0x55b435cde2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435ab6920 con 0x55b435ce27a0 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435cde7f0 con 0x55b435ced650 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435ce8800 con 0x55b435ce1e80 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fa9033700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fa9033700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cddd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51460/0 (socket says 172.21.15.70:51460) 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fa9033700 1 -- 172.21.15.70:0/1747661569 learned_addr learned my addr 172.21.15.70:0/1747661569 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fa9834700 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 0x55b435cf4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8faa035700 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ced650 0x55b435cde2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fa9033700 1 -- 172.21.15.70:0/1747661569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 msgr2=0x55b435cf4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fa9033700 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 0x55b435cf4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fa9033700 1 -- 172.21.15.70:0/1747661569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ced650 msgr2=0x55b435cde2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fa9033700 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ced650 0x55b435cde2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.557+0000 7f8fa9033700 1 -- 172.21.15.70:0/1747661569 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b435a87250 con 0x55b435ce27a0 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.558+0000 7f8fa9834700 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 0x55b435cf4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.558+0000 7f8fa9033700 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cddd70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009ab0 tx=0x7f8f94014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71707bb259d1d5b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.558+0000 7f8f98d82700 1 -- 172.21.15.70:0/1747661569 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9402c070 con 0x55b435ce27a0 2023-10-08T08:44:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.558+0000 7f8f98d82700 1 -- 172.21.15.70:0/1747661569 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f94016070 con 0x55b435ce27a0 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.558+0000 7f8f98d82700 1 -- 172.21.15.70:0/1747661569 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94027070 con 0x55b435ce27a0 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.558+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/1747661569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 msgr2=0x55b435cddd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.558+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cddd70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009ab0 tx=0x7f8f94014000 comp rx=0 tx=0).stop 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/1747661569 shutdown_connections 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ced650 0x55b435cde2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ce1e80 0x55b435cf4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/1747661569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cddd70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/1747661569 >> 172.21.15.70:0/1747661569 conn(0x55b435c57260 msgr2=0x55b435ce8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/1747661569 shutdown_connections 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/1747661569 wait complete. 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 -- start start 2023-10-08T08:44:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 Processor -- start 2023-10-08T08:44:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce1e80 0x55b435cf3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cf39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 0x55b435d4a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435d4a5b0 con 0x55b435ce27a0 2023-10-08T08:44:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435d4a720 con 0x55b435ce1e80 2023-10-08T08:44:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b435d4a8e0 con 0x55b435ced650 2023-10-08T08:44:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.559+0000 7f8fb7c81b80 10 client.0 _ll_register_callbacks cb 0x7f8fa0099cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9033700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cf39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9033700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cf39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51466/0 (socket says 172.21.15.70:51466) 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9033700 1 -- 172.21.15.70:0/2906936486 learned_addr learned my addr 172.21.15.70:0/2906936486 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce1e80 0x55b435cf3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8faa035700 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 0x55b435d4a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9033700 1 -- 172.21.15.70:0/2906936486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 msgr2=0x55b435d4a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 0x55b435d4a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9033700 1 -- 172.21.15.70:0/2906936486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce1e80 msgr2=0x55b435cf3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce1e80 0x55b435cf3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9033700 1 -- 172.21.15.70:0/2906936486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f94022450 con 0x55b435ce27a0 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8faa035700 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 0x55b435d4a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fa9033700 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cf39d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8f94011ab0 tx=0x7f8f940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344d75a0c1961c7d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8f8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2906936486 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94027030 con 0x55b435ce27a0 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2906936486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f9c009490 con 0x55b435ce27a0 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2906936486 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8f94018070 con 0x55b435ce27a0 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2906936486 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f9402c070 con 0x55b435ce27a0 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fb7c81b80 10 client.15900 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2906936486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b435a5f2b0 con 0x55b435ce27a0 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.560+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2906936486 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f9403c020 con 0x55b435ce27a0 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2906936486 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8f94039070 con 0x55b435ce27a0 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8fb7c81b80 10 client.15900 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8fb7c81b80 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8fb7c81b80 20 client.15900 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b435d53370 0x55b435d55790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8fb7c81b80 4 client.15900 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2906936486 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b435c2eb30 con 0x55b435d53370 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b435d53370 0x55b435d55790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8f8d7fa700 10 client.15900 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.561+0000 7f8fa9834700 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b435d53370 0x55b435d55790 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fb57664260b1fbc server_cookie=30208cab916520bd in_seq=0 out_seq=0 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8f8d7fa700 1 -- 172.21.15.70:0/2906936486 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b435c2eb30 con 0x55b435d53370 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8f8d7fa700 10 client.15900 handle_command_reply: tid=0 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 client.15900 shutdown 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2906936486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 msgr2=0x55b435cf39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cf39d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8f94011ab0 tx=0x7f8f940057f0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2906936486 shutdown_connections 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b435ced650 0x55b435d4a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b435d53370 0x55b435d55790 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b435ce1e80 0x55b435cf3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8f8d7fa700 0 client.15900 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 --2- 172.21.15.70:0/2906936486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b435ce27a0 0x55b435cf39d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2906936486 >> 172.21.15.70:0/2906936486 conn(0x55b435c57260 msgr2=0x55b435ce8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2906936486 shutdown_connections 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 1 -- 172.21.15.70:0/2906936486 wait complete. 2023-10-08T08:44:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.562+0000 7f8fb7c81b80 20 client.15900 trim_cache size 0 max 16384 2023-10-08T08:44:22.571 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:44:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2023-10-08T08:44:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2023-10-08T08:44:22.571 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 -- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8f900a1670 msgr2=0x7f8f900a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8f900a1670 0x7f8f900a3b30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40760d0 tx=0x7f8f94009260 comp rx=0 tx=0).stop 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 -- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ff060 msgr2=0x7f8fa419ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ff060 0x7f8fa419ca00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000e9a0 tx=0x7f8fa000ed60 comp rx=0 tx=0).stop 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 -- 172.21.15.70:0/2995618883 shutdown_connections 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8f900a1670 0x7f8f900a3b30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa4105740 0x7f8fa4196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa40ff060 0x7f8fa419ca00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 --2- 172.21.15.70:0/2995618883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa40ffa20 0x7f8fa419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 -- 172.21.15.70:0/2995618883 >> 172.21.15.70:0/2995618883 conn(0x7f8fa4075c20 msgr2=0x7f8fa40fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 -- 172.21.15.70:0/2995618883 shutdown_connections 2023-10-08T08:44:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.563+0000 7f8faba98700 1 -- 172.21.15.70:0/2995618883 wait complete. 2023-10-08T08:44:22.575 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T08:44:22.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:44:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:22 smithi191 ceph-mon[104220]: pgmap v307: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-08T08:44:22.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.746+0000 7f9524513700 1 -- 172.21.15.70:0/1373598655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c105600 msgr2=0x7f951c1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.746+0000 7f9524513700 1 --2- 172.21.15.70:0/1373598655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c105600 0x7f951c1059e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f95180099c0 tx=0x7f9518009cd0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.746+0000 7f9524513700 1 -- 172.21.15.70:0/1373598655 shutdown_connections 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.746+0000 7f9524513700 1 --2- 172.21.15.70:0/1373598655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c0fff00 0x7f951c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.746+0000 7f9524513700 1 --2- 172.21.15.70:0/1373598655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c105600 0x7f951c1059e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.746+0000 7f9524513700 1 --2- 172.21.15.70:0/1373598655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f951c0ff540 0x7f951c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.746+0000 7f9524513700 1 -- 172.21.15.70:0/1373598655 >> 172.21.15.70:0/1373598655 conn(0x7f951c0fb030 msgr2=0x7f951c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.746+0000 7f9524513700 1 -- 172.21.15.70:0/1373598655 shutdown_connections 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.746+0000 7f9524513700 1 -- 172.21.15.70:0/1373598655 wait complete. 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9524513700 1 Processor -- start 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9524513700 1 -- start start 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9524513700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f951c0ff540 0x7f951c1956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9524513700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c0fff00 0x7f951c195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9524513700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c105600 0x7f951c196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9524513700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c1a4e50 con 0x7f951c0fff00 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9524513700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c1a4fc0 con 0x7f951c0ff540 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9524513700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c1a5180 con 0x7f951c105600 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9521aae700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c0fff00 0x7f951c195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9521aae700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c0fff00 0x7f951c195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51480/0 (socket says 172.21.15.70:51480) 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f9521aae700 1 -- 172.21.15.70:0/3697722178 learned_addr learned my addr 172.21.15.70:0/3697722178 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.747+0000 7f95222af700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f951c0ff540 0x7f951c1956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f9521aae700 1 -- 172.21.15.70:0/3697722178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c105600 msgr2=0x7f951c196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f9521aae700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c105600 0x7f951c196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f9521aae700 1 -- 172.21.15.70:0/3697722178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f951c0ff540 msgr2=0x7f951c1956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:22.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f9521aae700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f951c0ff540 0x7f951c1956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f9521aae700 1 -- 172.21.15.70:0/3697722178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180095f0 con 0x7f951c0fff00 2023-10-08T08:44:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f9521aae700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c0fff00 0x7f951c195bf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f950c00d950 tx=0x7f950c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f95137fe700 1 -- 172.21.15.70:0/3697722178 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c009940 con 0x7f951c0fff00 2023-10-08T08:44:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f95137fe700 1 -- 172.21.15.70:0/3697722178 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f950c010460 con 0x7f951c0fff00 2023-10-08T08:44:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c1a5460 con 0x7f951c0fff00 2023-10-08T08:44:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f95137fe700 1 -- 172.21.15.70:0/3697722178 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c00f620 con 0x7f951c0fff00 2023-10-08T08:44:22.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.748+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c1a59c0 con 0x7f951c0fff00 2023-10-08T08:44:22.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.749+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c107a80 con 0x7f951c0fff00 2023-10-08T08:44:22.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.750+0000 7f95137fe700 1 -- 172.21.15.70:0/3697722178 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f950c0108d0 con 0x7f951c0fff00 2023-10-08T08:44:22.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.751+0000 7f95137fe700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95080a1670 0x7f95080a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:22.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.751+0000 7f95222af700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95080a1670 0x7f95080a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:22.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.751+0000 7f95137fe700 1 -- 172.21.15.70:0/3697722178 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f950c0cd1b0 con 0x7f951c0fff00 2023-10-08T08:44:22.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.752+0000 7f95222af700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95080a1670 0x7f95080a3b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9518009990 tx=0x7f9518003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:22.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:22.756+0000 7f95137fe700 1 -- 172.21.15.70:0/3697722178 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f950c096200 con 0x7f951c0fff00 2023-10-08T08:44:23.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.015+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f951c100c60 con 0x7f951c0fff00 2023-10-08T08:44:23.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.016+0000 7f95137fe700 1 -- 172.21.15.70:0/3697722178 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11375 (secure 0 0 0) 0x7f950c099820 con 0x7f951c0fff00 2023-10-08T08:44:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:44:23.017 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:29.077123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24572":{"gid":24572,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:44:23.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95080a1670 msgr2=0x7f95080a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95080a1670 0x7f95080a3b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9518009990 tx=0x7f9518003680 comp rx=0 tx=0).stop 2023-10-08T08:44:23.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c0fff00 msgr2=0x7f951c195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c0fff00 0x7f951c195bf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f950c00d950 tx=0x7f950c00dc60 comp rx=0 tx=0).stop 2023-10-08T08:44:23.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 shutdown_connections 2023-10-08T08:44:23.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f95080a1670 0x7f95080a3b30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c105600 0x7f951c196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f951c0ff540 0x7f951c1956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 --2- 172.21.15.70:0/3697722178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f951c0fff00 0x7f951c195bf0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 >> 172.21.15.70:0/3697722178 conn(0x7f951c0fb030 msgr2=0x7f951c0fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 shutdown_connections 2023-10-08T08:44:23.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.018+0000 7f9524513700 1 -- 172.21.15.70:0/3697722178 wait complete. 2023-10-08T08:44:23.020 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:44:23.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.158+0000 7f906555d700 1 -- 172.21.15.70:0/3050925434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9060106740 msgr2=0x7f9060106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.158+0000 7f906555d700 1 --2- 172.21.15.70:0/3050925434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9060106740 0x7f9060106b20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9050009990 tx=0x7f9050009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.158+0000 7f906555d700 1 -- 172.21.15.70:0/3050925434 shutdown_connections 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.158+0000 7f906555d700 1 --2- 172.21.15.70:0/3050925434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90601010f0 0x7f906010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.158+0000 7f906555d700 1 --2- 172.21.15.70:0/3050925434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9060106740 0x7f9060106b20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.158+0000 7f906555d700 1 --2- 172.21.15.70:0/3050925434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9060100730 0x7f9060100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.158+0000 7f906555d700 1 -- 172.21.15.70:0/3050925434 >> 172.21.15.70:0/3050925434 conn(0x7f90600fc200 msgr2=0x7f90600fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.158+0000 7f906555d700 1 -- 172.21.15.70:0/3050925434 shutdown_connections 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.158+0000 7f906555d700 1 -- 172.21.15.70:0/3050925434 wait complete. 2023-10-08T08:44:23.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.159+0000 7f906555d700 1 Processor -- start 2023-10-08T08:44:23.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.159+0000 7f906555d700 1 -- start start 2023-10-08T08:44:23.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.159+0000 7f906555d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9060100730 0x7f906019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.159+0000 7f906555d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90601010f0 0x7f906019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.159+0000 7f906555d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9060106740 0x7f9060196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.159+0000 7f906555d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9060197080 con 0x7f90601010f0 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.159+0000 7f906555d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90601971f0 con 0x7f9060106740 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.159+0000 7f906555d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90601973b0 con 0x7f9060100730 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905e7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90601010f0 0x7f906019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905e7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90601010f0 0x7f906019ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51494/0 (socket says 172.21.15.70:51494) 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905e7fc700 1 -- 172.21.15.70:0/36420569 learned_addr learned my addr 172.21.15.70:0/36420569 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905f7fe700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9060106740 0x7f9060196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905effd700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9060100730 0x7f906019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905e7fc700 1 -- 172.21.15.70:0/36420569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9060100730 msgr2=0x7f906019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905e7fc700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9060100730 0x7f906019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905e7fc700 1 -- 172.21.15.70:0/36420569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9060106740 msgr2=0x7f9060196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905e7fc700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9060106740 0x7f9060196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905e7fc700 1 -- 172.21.15.70:0/36420569 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500095f0 con 0x7f90601010f0 2023-10-08T08:44:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f905e7fc700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90601010f0 0x7f906019ce30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f905400d980 tx=0x7f905400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f9047fff700 1 -- 172.21.15.70:0/36420569 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905400bb60 con 0x7f90601010f0 2023-10-08T08:44:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f906555d700 1 -- 172.21.15.70:0/36420569 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9060197690 con 0x7f90601010f0 2023-10-08T08:44:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f9047fff700 1 -- 172.21.15.70:0/36420569 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9054007640 con 0x7f90601010f0 2023-10-08T08:44:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f9047fff700 1 -- 172.21.15.70:0/36420569 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054004e90 con 0x7f90601010f0 2023-10-08T08:44:23.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.160+0000 7f906555d700 1 -- 172.21.15.70:0/36420569 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90601a38e0 con 0x7f90601010f0 2023-10-08T08:44:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.162+0000 7f9047fff700 1 -- 172.21.15.70:0/36420569 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f905400bcc0 con 0x7f90601010f0 2023-10-08T08:44:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.163+0000 7f9047fff700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90480a15f0 0x7f90480a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.163+0000 7f9047fff700 1 -- 172.21.15.70:0/36420569 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f90540cd2a0 con 0x7f90601010f0 2023-10-08T08:44:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.163+0000 7f905effd700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90480a15f0 0x7f90480a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.163+0000 7f905effd700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90480a15f0 0x7f90480a3ab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f905000b5c0 tx=0x7f905001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.165+0000 7f9071746b80 1 Processor -- start 2023-10-08T08:44:23.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f9071746b80 1 -- start start 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f9071746b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd1e80 0x561faabd2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f9071746b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd27a0 0x561faabdd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f9071746b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabdfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f9071746b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faab3b460 con 0x561faabdd650 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f9071746b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faab2cc20 con 0x561faabd27a0 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f9071746b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faab2a540 con 0x561faabd1e80 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabdfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabdfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51504/0 (socket says 172.21.15.70:51504) 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905effd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd1e80 0x561faabd2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905f7fe700 1 -- 172.21.15.70:0/2050849459 learned_addr learned my addr 172.21.15.70:0/2050849459 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905e7fc700 1 --2- 172.21.15.70:0/2050849459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd27a0 0x561faabdd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905f7fe700 1 -- 172.21.15.70:0/2050849459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd1e80 msgr2=0x561faabd2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905f7fe700 1 --2- 172.21.15.70:0/2050849459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd1e80 0x561faabd2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905f7fe700 1 -- 172.21.15.70:0/2050849459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd27a0 msgr2=0x561faabdd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905f7fe700 1 --2- 172.21.15.70:0/2050849459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd27a0 0x561faabdd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.166+0000 7f905f7fe700 1 -- 172.21.15.70:0/2050849459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561faa950de0 con 0x561faabdd650 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f905f7fe700 1 --2- 172.21.15.70:0/2050849459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabdfa40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9058009f20 tx=0x7f9058009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f1757d9eee8634 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f90457fa700 1 -- 172.21.15.70:0/2050849459 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058011070 con 0x561faabdd650 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f90457fa700 1 -- 172.21.15.70:0/2050849459 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9058009a50 con 0x561faabdd650 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f90457fa700 1 -- 172.21.15.70:0/2050849459 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058015da0 con 0x561faabdd650 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f9071746b80 1 -- 172.21.15.70:0/2050849459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 msgr2=0x561faabdfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f9071746b80 1 --2- 172.21.15.70:0/2050849459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabdfa40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9058009f20 tx=0x7f9058009f50 comp rx=0 tx=0).stop 2023-10-08T08:44:23.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f9071746b80 1 -- 172.21.15.70:0/2050849459 shutdown_connections 2023-10-08T08:44:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f9071746b80 1 --2- 172.21.15.70:0/2050849459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabdfa40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f9071746b80 1 --2- 172.21.15.70:0/2050849459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd1e80 0x561faabd2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f9071746b80 1 --2- 172.21.15.70:0/2050849459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd27a0 0x561faabdd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.167+0000 7f9071746b80 1 -- 172.21.15.70:0/2050849459 >> 172.21.15.70:0/2050849459 conn(0x561faab47260 msgr2=0x561faabce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 -- 172.21.15.70:0/2050849459 shutdown_connections 2023-10-08T08:44:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 -- 172.21.15.70:0/2050849459 wait complete. 2023-10-08T08:44:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 -- start start 2023-10-08T08:44:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 Processor -- start 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd1e80 0x561faabdd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faabda2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabda920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faab25e30 con 0x561faabdd650 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faaac2710 con 0x561faabd1e80 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faaac23b0 con 0x561faabd27a0 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f9071746b80 10 client.0 _ll_register_callbacks cb 0x561faa91f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f905effd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd1e80 0x561faabdd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.168+0000 7f905f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabda920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f905effd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd1e80 0x561faabdd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:38964/0 (socket says 172.21.15.70:38964) 2023-10-08T08:44:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f905effd700 1 -- 172.21.15.70:0/1567650055 learned_addr learned my addr 172.21.15.70:0/1567650055 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f905effd700 1 -- 172.21.15.70:0/1567650055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 msgr2=0x561faabda2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f905effd700 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faabda2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f905effd700 1 -- 172.21.15.70:0/1567650055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 msgr2=0x561faabda920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f905effd700 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabda920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f905effd700 1 -- 172.21.15.70:0/1567650055 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9058009bd0 con 0x561faabd1e80 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f905effd700 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd1e80 0x561faabdd000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9050015000 tx=0x7f9050009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95666cfc99631b47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f9042ff5700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f9042ff5700 1 -- 172.21.15.70:0/1567650055 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905002a050 con 0x561faabd1e80 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f9071746b80 1 -- 172.21.15.70:0/1567650055 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561faab1ee10 con 0x561faabd1e80 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f9042ff5700 1 -- 172.21.15.70:0/1567650055 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f905000f660 con 0x561faabd1e80 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f9042ff5700 1 -- 172.21.15.70:0/1567650055 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f905001d040 con 0x561faabd1e80 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f9071746b80 10 client.25394 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.169+0000 7f9071746b80 1 -- 172.21.15.70:0/1567650055 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561faa939c60 con 0x561faabd1e80 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.170+0000 7f9042ff5700 1 -- 172.21.15.70:0/1567650055 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561faab1ee10 con 0x561faabd1e80 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.170+0000 7f9042ff5700 1 -- 172.21.15.70:0/1567650055 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f905002f8f0 con 0x561faabd1e80 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.170+0000 7f9071746b80 10 client.25394 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.170+0000 7f9071746b80 10 client.25394 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.170+0000 7f9071746b80 20 client.25394 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.170+0000 7f9071746b80 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x561faabed240 0x561faabef660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.170+0000 7f9071746b80 4 client.25394 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.170+0000 7f9071746b80 1 -- 172.21.15.70:0/1567650055 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561faab1eb30 con 0x561faabed240 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.170+0000 7f905e7fc700 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x561faabed240 0x561faabef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.171+0000 7f9042ff5700 10 client.25394 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.171+0000 7f905e7fc700 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x561faabed240 0x561faabef660 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e3242fd92cf59ada server_cookie=8ccb3d0932fd9b90 in_seq=0 out_seq=0 2023-10-08T08:44:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.171+0000 7f9042ff5700 1 -- 172.21.15.70:0/1567650055 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561faab1eb30 con 0x561faabed240 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.171+0000 7f9042ff5700 10 client.25394 handle_command_reply: tid=0 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.171+0000 7f9071746b80 1 client.25394 shutdown 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.171+0000 7f9071746b80 1 -- 172.21.15.70:0/1567650055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd1e80 msgr2=0x561faabdd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.171+0000 7f9071746b80 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd1e80 0x561faabdd000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9050015000 tx=0x7f9050009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9071746b80 1 -- 172.21.15.70:0/1567650055 shutdown_connections 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9071746b80 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x561faabed240 0x561faabef660 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9071746b80 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabdd650 0x561faabda920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9042ff5700 0 client.25394 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9071746b80 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabd1e80 0x561faabdd000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9071746b80 1 --2- 172.21.15.70:0/1567650055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faabda2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9071746b80 1 -- 172.21.15.70:0/1567650055 >> 172.21.15.70:0/1567650055 conn(0x561faab47260 msgr2=0x561faabcdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9071746b80 1 -- 172.21.15.70:0/1567650055 shutdown_connections 2023-10-08T08:44:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9071746b80 1 -- 172.21.15.70:0/1567650055 wait complete. 2023-10-08T08:44:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.172+0000 7f9071746b80 20 client.25394 trim_cache size 0 max 16384 2023-10-08T08:44:23.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.185+0000 7f9071746b80 1 Processor -- start 2023-10-08T08:44:23.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.185+0000 7f9071746b80 1 -- start start 2023-10-08T08:44:23.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f9071746b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faabd8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f9071746b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faabd9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f9071746b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 0x561faabe88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f9071746b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faa9a6920 con 0x561faabd1e80 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f9071746b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faabcf8b0 con 0x561faabdd650 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f9071746b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faabdfe00 con 0x561faabd27a0 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faabd8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faabd8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51514/0 (socket says 172.21.15.70:51514) 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905effd700 1 -- 172.21.15.70:0/2976682741 learned_addr learned my addr 172.21.15.70:0/2976682741 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905f7fe700 1 --2- 172.21.15.70:0/2976682741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 0x561faabe88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905effd700 1 -- 172.21.15.70:0/2976682741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 msgr2=0x561faabd9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905effd700 1 --2- 172.21.15.70:0/2976682741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faabd9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905effd700 1 -- 172.21.15.70:0/2976682741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 msgr2=0x561faabe88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905effd700 1 --2- 172.21.15.70:0/2976682741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 0x561faabe88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905effd700 1 -- 172.21.15.70:0/2976682741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561faa977250 con 0x561faabd1e80 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905f7fe700 1 --2- 172.21.15.70:0/2976682741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 0x561faabe88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f905effd700 1 --2- 172.21.15.70:0/2976682741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faabd8bc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f905002fc50 tx=0x7f9050005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8d90000f9c43aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f9045ffb700 1 -- 172.21.15.70:0/2976682741 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905001d050 con 0x561faabd1e80 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f9045ffb700 1 -- 172.21.15.70:0/2976682741 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f905002b040 con 0x561faabd1e80 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.186+0000 7f9045ffb700 1 -- 172.21.15.70:0/2976682741 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905002a040 con 0x561faabd1e80 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 -- 172.21.15.70:0/2976682741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 msgr2=0x561faabd8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 --2- 172.21.15.70:0/2976682741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faabd8bc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f905002fc50 tx=0x7f9050005fd0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 -- 172.21.15.70:0/2976682741 shutdown_connections 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 --2- 172.21.15.70:0/2976682741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 0x561faabe88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 --2- 172.21.15.70:0/2976682741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faabd8bc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 --2- 172.21.15.70:0/2976682741 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faabd9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 -- 172.21.15.70:0/2976682741 >> 172.21.15.70:0/2976682741 conn(0x561faab47260 msgr2=0x561faabd5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 -- 172.21.15.70:0/2976682741 shutdown_connections 2023-10-08T08:44:23.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 -- 172.21.15.70:0/2976682741 wait complete. 2023-10-08T08:44:23.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.187+0000 7f9071746b80 1 -- start start 2023-10-08T08:44:23.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9071746b80 1 Processor -- start 2023-10-08T08:44:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9071746b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faac3e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9071746b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faac3ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9071746b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 0x561faac39040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9071746b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faac39720 con 0x561faabd1e80 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9071746b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faac39890 con 0x561faabdd650 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9071746b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561faac39a50 con 0x561faabd27a0 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9071746b80 10 client.0 _ll_register_callbacks cb 0x7f9050005360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faac3e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faac3e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51520/0 (socket says 172.21.15.70:51520) 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905effd700 1 -- 172.21.15.70:0/2259298209 learned_addr learned my addr 172.21.15.70:0/2259298209 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905f7fe700 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 0x561faac39040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905e7fc700 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faac3ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905effd700 1 -- 172.21.15.70:0/2259298209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 msgr2=0x561faac3ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905effd700 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faac3ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905effd700 1 -- 172.21.15.70:0/2259298209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 msgr2=0x561faac39040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905effd700 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 0x561faac39040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905effd700 1 -- 172.21.15.70:0/2259298209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561faa939c60 con 0x561faabd1e80 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905e7fc700 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faac3ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f905effd700 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faac3e920 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9050044040 tx=0x7f9050009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f65e99a9a23ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9042ff5700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.188+0000 7f9042ff5700 1 -- 172.21.15.70:0/2259298209 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905001d040 con 0x561faabd1e80 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9042ff5700 1 -- 172.21.15.70:0/2259298209 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9050023850 con 0x561faabd1e80 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9071746b80 1 -- 172.21.15.70:0/2259298209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561faaaedeb0 con 0x561faabd1e80 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9042ff5700 1 -- 172.21.15.70:0/2259298209 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f905002a040 con 0x561faabd1e80 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9071746b80 10 client.15924 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9071746b80 1 -- 172.21.15.70:0/2259298209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561faa94f2b0 con 0x561faabd1e80 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9042ff5700 1 -- 172.21.15.70:0/2259298209 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561faaaedeb0 con 0x561faabd1e80 2023-10-08T08:44:23.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9042ff5700 1 -- 172.21.15.70:0/2259298209 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9050052070 con 0x561faabd1e80 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9071746b80 10 client.15924 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9071746b80 10 client.15924 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9071746b80 20 client.15924 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9071746b80 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x561faac46260 0x561faac48680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9071746b80 4 client.15924 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f9071746b80 1 -- 172.21.15.70:0/2259298209 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561faa971f70 con 0x561faac46260 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.189+0000 7f905e7fc700 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x561faac46260 0x561faac48680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9042ff5700 10 client.15924 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f905e7fc700 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x561faac46260 0x561faac48680 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6d84a5f58946520c server_cookie=944017eaa6c64ce5 in_seq=0 out_seq=0 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9042ff5700 1 -- 172.21.15.70:0/2259298209 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561faa971f70 con 0x561faac46260 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9042ff5700 10 client.15924 handle_command_reply: tid=0 2023-10-08T08:44:23.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 client.15924 shutdown 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 -- 172.21.15.70:0/2259298209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 msgr2=0x561faac3e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faac3e920 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9050044040 tx=0x7f9050009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 -- 172.21.15.70:0/2259298209 shutdown_connections 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561faabdd650 0x561faac39040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x561faac46260 0x561faac48680 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561faabd1e80 0x561faac3e920 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9042ff5700 0 client.15924 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 --2- 172.21.15.70:0/2259298209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561faabd27a0 0x561faac3ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 -- 172.21.15.70:0/2259298209 >> 172.21.15.70:0/2259298209 conn(0x561faab47260 msgr2=0x561faabd8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 -- 172.21.15.70:0/2259298209 shutdown_connections 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 1 -- 172.21.15.70:0/2259298209 wait complete. 2023-10-08T08:44:23.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.190+0000 7f9071746b80 20 client.15924 trim_cache size 0 max 16384 2023-10-08T08:44:23.199 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 -- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90480a15f0 msgr2=0x7f90480a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90480a15f0 0x7f90480a3ab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f905000b5c0 tx=0x7f905001a040 comp rx=0 tx=0).stop 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 -- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90601010f0 msgr2=0x7f906019ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90601010f0 0x7f906019ce30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f905400d980 tx=0x7f905400dd40 comp rx=0 tx=0).stop 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 -- 172.21.15.70:0/36420569 shutdown_connections 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90480a15f0 0x7f90480a3ab0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9060106740 0x7f9060196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9060100730 0x7f906019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 --2- 172.21.15.70:0/36420569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90601010f0 0x7f906019ce30 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 -- 172.21.15.70:0/36420569 >> 172.21.15.70:0/36420569 conn(0x7f90600fc200 msgr2=0x7f90600fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 -- 172.21.15.70:0/36420569 shutdown_connections 2023-10-08T08:44:23.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.191+0000 7f906555d700 1 -- 172.21.15.70:0/36420569 wait complete. 2023-10-08T08:44:23.204 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T08:44:23.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.346+0000 7fc31cec6700 1 -- 172.21.15.70:0/1971023578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3181007d0 msgr2=0x7fc31810c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.346+0000 7fc31cec6700 1 --2- 172.21.15.70:0/1971023578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3181007d0 0x7fc31810c4f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc31000b0d0 tx=0x7fc31000b3e0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.346+0000 7fc31cec6700 1 -- 172.21.15.70:0/1971023578 shutdown_connections 2023-10-08T08:44:23.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.346+0000 7fc31cec6700 1 --2- 172.21.15.70:0/1971023578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3181007d0 0x7fc31810c4f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.346+0000 7fc31cec6700 1 --2- 172.21.15.70:0/1971023578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc318105630 0x7fc318105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.346+0000 7fc31cec6700 1 --2- 172.21.15.70:0/1971023578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3180ffe10 0x7fc318100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.346+0000 7fc31cec6700 1 -- 172.21.15.70:0/1971023578 >> 172.21.15.70:0/1971023578 conn(0x7fc318075c20 msgr2=0x7fc3180fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.346+0000 7fc31cec6700 1 -- 172.21.15.70:0/1971023578 shutdown_connections 2023-10-08T08:44:23.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.346+0000 7fc31cec6700 1 -- 172.21.15.70:0/1971023578 wait complete. 2023-10-08T08:44:23.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc31cec6700 1 Processor -- start 2023-10-08T08:44:23.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc31cec6700 1 -- start start 2023-10-08T08:44:23.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc31cec6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3180ffe10 0x7fc31819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc31cec6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3181007d0 0x7fc31819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc31cec6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc318105630 0x7fc318196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc31cec6700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318197100 con 0x7fc318105630 2023-10-08T08:44:23.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc31cec6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318197270 con 0x7fc3180ffe10 2023-10-08T08:44:23.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc31cec6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318197430 con 0x7fc3181007d0 2023-10-08T08:44:23.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc318105630 0x7fc318196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc318105630 0x7fc318196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51538/0 (socket says 172.21.15.70:51538) 2023-10-08T08:44:23.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc316d9d700 1 -- 172.21.15.70:0/279651120 learned_addr learned my addr 172.21.15.70:0/279651120 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc31659c700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3180ffe10 0x7fc31819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc315d9b700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3181007d0 0x7fc31819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc316d9d700 1 -- 172.21.15.70:0/279651120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3181007d0 msgr2=0x7fc31819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc316d9d700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3181007d0 0x7fc31819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc316d9d700 1 -- 172.21.15.70:0/279651120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3180ffe10 msgr2=0x7fc31819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.347+0000 7fc316d9d700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3180ffe10 0x7fc31819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.348+0000 7fc316d9d700 1 -- 172.21.15.70:0/279651120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310009d00 con 0x7fc318105630 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.348+0000 7fc315d9b700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3181007d0 0x7fc31819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.348+0000 7fc316d9d700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc318105630 0x7fc318196aa0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc3100094c0 tx=0x7fc3100095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.348+0000 7fc3077fe700 1 -- 172.21.15.70:0/279651120 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000e040 con 0x7fc318105630 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.348+0000 7fc3077fe700 1 -- 172.21.15.70:0/279651120 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc31001db40 con 0x7fc318105630 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.348+0000 7fc31cec6700 1 -- 172.21.15.70:0/279651120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3181976b0 con 0x7fc318105630 2023-10-08T08:44:23.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.348+0000 7fc3077fe700 1 -- 172.21.15.70:0/279651120 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31001baf0 con 0x7fc318105630 2023-10-08T08:44:23.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.348+0000 7fc31cec6700 1 -- 172.21.15.70:0/279651120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3181a3960 con 0x7fc318105630 2023-10-08T08:44:23.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.350+0000 7fc3077fe700 1 -- 172.21.15.70:0/279651120 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc31001dcb0 con 0x7fc318105630 2023-10-08T08:44:23.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.350+0000 7fc3077fe700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3000a15f0 0x7fc3000a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.351+0000 7fc31659c700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3000a15f0 0x7fc3000a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.351+0000 7fc3077fe700 1 -- 172.21.15.70:0/279651120 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc3100cecf0 con 0x7fc318105630 2023-10-08T08:44:23.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.351+0000 7fc31659c700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3000a15f0 0x7fc3000a3ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc308005950 tx=0x7fc3080058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc3290afb80 1 Processor -- start 2023-10-08T08:44:23.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc3290afb80 1 -- start start 2023-10-08T08:44:23.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb993ce80 0x557cb993d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb994c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb994ca60 0x557cb994ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc3290afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb98a6460 con 0x557cb993ce80 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc3290afb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb9897c20 con 0x557cb994ca60 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc3290afb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb9895540 con 0x557cb993d7a0 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc31659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb993ce80 0x557cb993d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc31659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb993ce80 0x557cb993d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51542/0 (socket says 172.21.15.70:51542) 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.353+0000 7fc31659c700 1 -- 172.21.15.70:0/4250840699 learned_addr learned my addr 172.21.15.70:0/4250840699 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc316d9d700 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb994ca60 0x557cb994ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc315d9b700 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb994c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc31659c700 1 -- 172.21.15.70:0/4250840699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 msgr2=0x557cb994c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc31659c700 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb994c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc31659c700 1 -- 172.21.15.70:0/4250840699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb994ca60 msgr2=0x557cb994ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc31659c700 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb994ca60 0x557cb994ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc31659c700 1 -- 172.21.15.70:0/4250840699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cb96bbde0 con 0x557cb993ce80 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc316d9d700 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb994ca60 0x557cb994ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc31659c700 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb993ce80 0x557cb993d260 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc30800fcd0 tx=0x7fc308012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42efdbb116c25f6c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc304ff9700 1 -- 172.21.15.70:0/4250840699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308011c40 con 0x557cb993ce80 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc304ff9700 1 -- 172.21.15.70:0/4250840699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc308011da0 con 0x557cb993ce80 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.354+0000 7fc304ff9700 1 -- 172.21.15.70:0/4250840699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30801d680 con 0x557cb993ce80 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 -- 172.21.15.70:0/4250840699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb993ce80 msgr2=0x557cb993d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb993ce80 0x557cb993d260 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc30800fcd0 tx=0x7fc308012000 comp rx=0 tx=0).stop 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 -- 172.21.15.70:0/4250840699 shutdown_connections 2023-10-08T08:44:23.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb994ca60 0x557cb994ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb993ce80 0x557cb993d260 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 --2- 172.21.15.70:0/4250840699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb994c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 -- 172.21.15.70:0/4250840699 >> 172.21.15.70:0/4250840699 conn(0x557cb98b2260 msgr2=0x557cb99392d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 -- 172.21.15.70:0/4250840699 shutdown_connections 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 -- 172.21.15.70:0/4250840699 wait complete. 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 -- start start 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.355+0000 7fc3290afb80 1 Processor -- start 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 0x557cb994c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb99497b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9949ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc3290afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb9890e30 con 0x557cb994ca60 2023-10-08T08:44:23.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc3290afb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb982d710 con 0x557cb993ce80 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc3290afb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb982d3b0 con 0x557cb993d7a0 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc3290afb80 10 client.0 _ll_register_callbacks cb 0x557cb968a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9949ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9949ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51552/0 (socket says 172.21.15.70:51552) 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc316d9d700 1 -- 172.21.15.70:0/3652524567 learned_addr learned my addr 172.21.15.70:0/3652524567 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc315d9b700 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb99497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc31659c700 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 0x557cb994c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc316d9d700 1 -- 172.21.15.70:0/3652524567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 msgr2=0x557cb99497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc316d9d700 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb99497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc316d9d700 1 -- 172.21.15.70:0/3652524567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 msgr2=0x557cb994c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc316d9d700 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 0x557cb994c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc316d9d700 1 -- 172.21.15.70:0/3652524567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30800f980 con 0x557cb994ca60 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc316d9d700 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9949ef0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc3100cc220 tx=0x7fc31009b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21baa56542972417 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc2fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.356+0000 7fc2fdffb700 1 -- 172.21.15.70:0/3652524567 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31001be60 con 0x557cb994ca60 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc3290afb80 1 -- 172.21.15.70:0/3652524567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cb9858eb0 con 0x557cb994ca60 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc2fdffb700 1 -- 172.21.15.70:0/3652524567 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc31009ba90 con 0x557cb994ca60 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc2fdffb700 1 -- 172.21.15.70:0/3652524567 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc31009fbe0 con 0x557cb994ca60 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc3290afb80 10 client.15936 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc3290afb80 1 -- 172.21.15.70:0/3652524567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557cb96a4c60 con 0x557cb994ca60 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc2fdffb700 1 -- 172.21.15.70:0/3652524567 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557cb9858eb0 con 0x557cb994ca60 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc2fdffb700 1 -- 172.21.15.70:0/3652524567 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc3100670e0 con 0x557cb994ca60 2023-10-08T08:44:23.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc3290afb80 10 client.15936 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc3290afb80 10 client.15936 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc3290afb80 20 client.15936 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc3290afb80 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x557cb995c2f0 0x557cb995e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc3290afb80 4 client.15936 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc3290afb80 1 -- 172.21.15.70:0/3652524567 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557cb9889e10 con 0x557cb995c2f0 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.357+0000 7fc31659c700 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x557cb995c2f0 0x557cb995e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.358+0000 7fc2fdffb700 10 client.15936 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.358+0000 7fc31659c700 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x557cb995c2f0 0x557cb995e6e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=45e3cf63c6fb2b8c server_cookie=37356ebb4d1cb0a1 in_seq=0 out_seq=0 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.358+0000 7fc2fdffb700 1 -- 172.21.15.70:0/3652524567 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557cb9889e10 con 0x557cb995c2f0 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.358+0000 7fc2fdffb700 10 client.15936 handle_command_reply: tid=0 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 client.15936 shutdown 2023-10-08T08:44:23.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 -- 172.21.15.70:0/3652524567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 msgr2=0x557cb9949ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9949ef0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc3100cc220 tx=0x7fc31009b650 comp rx=0 tx=0).stop 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 -- 172.21.15.70:0/3652524567 shutdown_connections 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9949ef0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 0x557cb994c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x557cb995c2f0 0x557cb995e6e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 --2- 172.21.15.70:0/3652524567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb99497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc2fdffb700 0 client.15936 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 -- 172.21.15.70:0/3652524567 >> 172.21.15.70:0/3652524567 conn(0x557cb98b2260 msgr2=0x557cb9938ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 -- 172.21.15.70:0/3652524567 shutdown_connections 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 1 -- 172.21.15.70:0/3652524567 wait complete. 2023-10-08T08:44:23.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.359+0000 7fc3290afb80 20 client.15936 trim_cache size 0 max 16384 2023-10-08T08:44:23.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.372+0000 7fc3290afb80 1 Processor -- start 2023-10-08T08:44:23.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.372+0000 7fc3290afb80 1 -- start start 2023-10-08T08:44:23.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993ce80 0x557cb9949770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993d7a0 0x557cb99535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb994bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc3290afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb9711920 con 0x557cb994ca60 2023-10-08T08:44:23.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc3290afb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb9935ae0 con 0x557cb993d7a0 2023-10-08T08:44:23.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc3290afb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb994a4f0 con 0x557cb993ce80 2023-10-08T08:44:23.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb994bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb994bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51560/0 (socket says 172.21.15.70:51560) 2023-10-08T08:44:23.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc316d9d700 1 -- 172.21.15.70:0/2161427821 learned_addr learned my addr 172.21.15.70:0/2161427821 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc31659c700 1 --2- 172.21.15.70:0/2161427821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993ce80 0x557cb9949770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc315d9b700 1 --2- 172.21.15.70:0/2161427821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993d7a0 0x557cb99535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc316d9d700 1 -- 172.21.15.70:0/2161427821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993ce80 msgr2=0x557cb9949770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc316d9d700 1 --2- 172.21.15.70:0/2161427821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993ce80 0x557cb9949770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc316d9d700 1 -- 172.21.15.70:0/2161427821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993d7a0 msgr2=0x557cb99535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc316d9d700 1 --2- 172.21.15.70:0/2161427821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993d7a0 0x557cb99535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc316d9d700 1 -- 172.21.15.70:0/2161427821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cb96e2250 con 0x557cb994ca60 2023-10-08T08:44:23.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc316d9d700 1 --2- 172.21.15.70:0/2161427821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb994bfc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc310009fd0 tx=0x7fc3100099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a70b63fd1d9d876 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc3057fa700 1 -- 172.21.15.70:0/2161427821 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31009bf70 con 0x557cb994ca60 2023-10-08T08:44:23.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.373+0000 7fc3057fa700 1 -- 172.21.15.70:0/2161427821 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc31009ba90 con 0x557cb994ca60 2023-10-08T08:44:23.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3057fa700 1 -- 172.21.15.70:0/2161427821 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31009b210 con 0x557cb994ca60 2023-10-08T08:44:23.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3290afb80 1 -- 172.21.15.70:0/2161427821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 msgr2=0x557cb994bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3290afb80 1 --2- 172.21.15.70:0/2161427821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb994bfc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc310009fd0 tx=0x7fc3100099e0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3290afb80 1 -- 172.21.15.70:0/2161427821 shutdown_connections 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3290afb80 1 --2- 172.21.15.70:0/2161427821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb994bfc0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3290afb80 1 --2- 172.21.15.70:0/2161427821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993ce80 0x557cb9949770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3290afb80 1 --2- 172.21.15.70:0/2161427821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993d7a0 0x557cb99535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3290afb80 1 -- 172.21.15.70:0/2161427821 >> 172.21.15.70:0/2161427821 conn(0x557cb98b2260 msgr2=0x557cb9949060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3290afb80 1 -- 172.21.15.70:0/2161427821 shutdown_connections 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.374+0000 7fc3290afb80 1 -- 172.21.15.70:0/2161427821 wait complete. 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc3290afb80 1 -- start start 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc3290afb80 1 Processor -- start 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 0x557cb9953760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb9951b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc3290afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9952280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc3290afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb9952990 con 0x557cb994ca60 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc3290afb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb99b0100 con 0x557cb993ce80 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc3290afb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb99b0240 con 0x557cb993d7a0 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc3290afb80 10 client.0 _ll_register_callbacks cb 0x7fc31009b860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9952280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc316d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9952280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51566/0 (socket says 172.21.15.70:51566) 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc316d9d700 1 -- 172.21.15.70:0/1238674929 learned_addr learned my addr 172.21.15.70:0/1238674929 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc315d9b700 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb9951b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.375+0000 7fc31659c700 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 0x557cb9953760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc316d9d700 1 -- 172.21.15.70:0/1238674929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 msgr2=0x557cb9951b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc316d9d700 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb9951b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc316d9d700 1 -- 172.21.15.70:0/1238674929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 msgr2=0x557cb9953760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc316d9d700 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 0x557cb9953760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc316d9d700 1 -- 172.21.15.70:0/1238674929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557cb96a4c60 con 0x557cb994ca60 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc316d9d700 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9952280 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc3100cc770 tx=0x7fc31000cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca9ccd7ccea3b17 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc2fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc2fdffb700 1 -- 172.21.15.70:0/1238674929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100b8070 con 0x557cb994ca60 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc2fdffb700 1 -- 172.21.15.70:0/1238674929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc31009fbe0 con 0x557cb994ca60 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc3290afb80 1 -- 172.21.15.70:0/1238674929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc308011da0 con 0x557cb994ca60 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc2fdffb700 1 -- 172.21.15.70:0/1238674929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc31001be60 con 0x557cb994ca60 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc3290afb80 10 client.15942 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc3290afb80 1 -- 172.21.15.70:0/1238674929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557cb96ba2b0 con 0x557cb994ca60 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc2fdffb700 1 -- 172.21.15.70:0/1238674929 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc308011da0 con 0x557cb994ca60 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc2fdffb700 1 -- 172.21.15.70:0/1238674929 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc310081020 con 0x557cb994ca60 2023-10-08T08:44:23.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc3290afb80 10 client.15942 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.376+0000 7fc3290afb80 10 client.15942 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-08T08:44:23.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc3290afb80 20 client.15942 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc3290afb80 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x557cb99b1490 0x557cb99b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc3290afb80 4 client.15942 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:23.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc3290afb80 1 -- 172.21.15.70:0/1238674929 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557cb9889b30 con 0x557cb99b1490 2023-10-08T08:44:23.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc31659c700 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x557cb99b1490 0x557cb99b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc2fdffb700 10 client.15942 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:44:23.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc31659c700 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x557cb99b1490 0x557cb99b3880 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9e4509c813f8db59 server_cookie=dcc94fa155f41c25 in_seq=0 out_seq=0 2023-10-08T08:44:23.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc2fdffb700 1 -- 172.21.15.70:0/1238674929 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557cb9889b30 con 0x557cb99b1490 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc2fdffb700 10 client.15942 handle_command_reply: tid=0 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc3290afb80 1 client.15942 shutdown 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc3290afb80 1 -- 172.21.15.70:0/1238674929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 msgr2=0x557cb9952280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.377+0000 7fc3290afb80 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9952280 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc3100cc770 tx=0x7fc31000cfa0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc3290afb80 1 -- 172.21.15.70:0/1238674929 shutdown_connections 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc3290afb80 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557cb994ca60 0x557cb9952280 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc3290afb80 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb993ce80 0x557cb9953760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc3290afb80 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x557cb99b1490 0x557cb99b3880 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc3290afb80 1 --2- 172.21.15.70:0/1238674929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557cb993d7a0 0x557cb9951b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc2fdffb700 0 client.15942 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:44:23.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc3290afb80 1 -- 172.21.15.70:0/1238674929 >> 172.21.15.70:0/1238674929 conn(0x557cb98b2260 msgr2=0x557cb993f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc3290afb80 1 -- 172.21.15.70:0/1238674929 shutdown_connections 2023-10-08T08:44:23.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc3290afb80 1 -- 172.21.15.70:0/1238674929 wait complete. 2023-10-08T08:44:23.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc3290afb80 20 client.15942 trim_cache size 0 max 16384 2023-10-08T08:44:23.387 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:23.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 -- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3000a15f0 msgr2=0x7fc3000a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3000a15f0 0x7fc3000a3ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc308005950 tx=0x7fc3080058e0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 -- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc318105630 msgr2=0x7fc318196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc318105630 0x7fc318196aa0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc3100094c0 tx=0x7fc3100095a0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 -- 172.21.15.70:0/279651120 shutdown_connections 2023-10-08T08:44:23.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc3000a15f0 0x7fc3000a3ab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc318105630 0x7fc318196aa0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3180ffe10 0x7fc31819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 --2- 172.21.15.70:0/279651120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3181007d0 0x7fc31819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 -- 172.21.15.70:0/279651120 >> 172.21.15.70:0/279651120 conn(0x7fc318075c20 msgr2=0x7fc3180fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 -- 172.21.15.70:0/279651120 shutdown_connections 2023-10-08T08:44:23.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.378+0000 7fc31cec6700 1 -- 172.21.15.70:0/279651120 wait complete. 2023-10-08T08:44:23.390 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:23 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3697722178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:44:23.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T08:44:23.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:23 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3697722178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:44:23.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.520+0000 7f1baf927700 1 -- 172.21.15.70:0/3300419245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 msgr2=0x7f1ba810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.520+0000 7f1baf927700 1 --2- 172.21.15.70:0/3300419245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 0x7f1ba810d610 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000b0a0 tx=0x7f1ba000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.520+0000 7f1baf927700 1 -- 172.21.15.70:0/3300419245 shutdown_connections 2023-10-08T08:44:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.520+0000 7f1baf927700 1 --2- 172.21.15.70:0/3300419245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 0x7f1ba810d610 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.520+0000 7f1baf927700 1 --2- 172.21.15.70:0/3300419245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8106750 0x7f1ba8106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.520+0000 7f1baf927700 1 --2- 172.21.15.70:0/3300419245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ba8100740 0x7f1ba8100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.520+0000 7f1baf927700 1 -- 172.21.15.70:0/3300419245 >> 172.21.15.70:0/3300419245 conn(0x7f1ba80fc230 msgr2=0x7f1ba80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.521+0000 7f1baf927700 1 -- 172.21.15.70:0/3300419245 shutdown_connections 2023-10-08T08:44:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.521+0000 7f1baf927700 1 -- 172.21.15.70:0/3300419245 wait complete. 2023-10-08T08:44:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.521+0000 7f1baf927700 1 Processor -- start 2023-10-08T08:44:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.521+0000 7f1baf927700 1 -- start start 2023-10-08T08:44:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1baf927700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8100740 0x7f1ba8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1baf927700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 0x7f1ba8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1baf927700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ba8106750 0x7f1ba8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1baf927700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba81a4f40 con 0x7f1ba8101100 2023-10-08T08:44:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1baf927700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba81a50b0 con 0x7f1ba8106750 2023-10-08T08:44:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1baf927700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba81a5270 con 0x7f1ba8100740 2023-10-08T08:44:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bacec2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 0x7f1ba8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bacec2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 0x7f1ba8073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51578/0 (socket says 172.21.15.70:51578) 2023-10-08T08:44:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bacec2700 1 -- 172.21.15.70:0/3619057051 learned_addr learned my addr 172.21.15.70:0/3619057051 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8100740 0x7f1ba8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1badec4700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ba8106750 0x7f1ba8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bacec2700 1 -- 172.21.15.70:0/3619057051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8100740 msgr2=0x7f1ba8072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bacec2700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8100740 0x7f1ba8072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bacec2700 1 -- 172.21.15.70:0/3619057051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ba8106750 msgr2=0x7f1ba8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bacec2700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ba8106750 0x7f1ba8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bacec2700 1 -- 172.21.15.70:0/3619057051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba0009d00 con 0x7f1ba8101100 2023-10-08T08:44:23.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1bacec2700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 0x7f1ba8073030 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400c920 tx=0x7f1ba400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1b9e7fc700 1 -- 172.21.15.70:0/3619057051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4007b00 con 0x7f1ba8101100 2023-10-08T08:44:23.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1baf927700 1 -- 172.21.15.70:0/3619057051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba81a5550 con 0x7f1ba8101100 2023-10-08T08:44:23.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1b9e7fc700 1 -- 172.21.15.70:0/3619057051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ba400ce70 con 0x7f1ba8101100 2023-10-08T08:44:23.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.522+0000 7f1b9e7fc700 1 -- 172.21.15.70:0/3619057051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4005460 con 0x7f1ba8101100 2023-10-08T08:44:23.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.523+0000 7f1baf927700 1 -- 172.21.15.70:0/3619057051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba81a5a60 con 0x7f1ba8101100 2023-10-08T08:44:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.525+0000 7f1b9e7fc700 1 -- 172.21.15.70:0/3619057051 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1ba4004750 con 0x7f1ba8101100 2023-10-08T08:44:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.526+0000 7f1b9e7fc700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1b940a15f0 0x7f1b940a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.526+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1b940a15f0 0x7f1b940a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.526+0000 7f1b9e7fc700 1 -- 172.21.15.70:0/3619057051 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1ba40cd040 con 0x7f1ba8101100 2023-10-08T08:44:23.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.526+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1b940a15f0 0x7f1b940a3ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1b98005950 tx=0x7f1b9800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bbbb10b80 1 Processor -- start 2023-10-08T08:44:23.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bbbb10b80 1 -- start start 2023-10-08T08:44:23.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 0x5629c0c90260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c907a0 0x5629c0c9b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c9da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0bf9460 con 0x5629c0c9b650 2023-10-08T08:44:23.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0beac20 con 0x5629c0c907a0 2023-10-08T08:44:23.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0be8540 con 0x5629c0c8fe80 2023-10-08T08:44:23.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1badec4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c9da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1badec4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c9da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51588/0 (socket says 172.21.15.70:51588) 2023-10-08T08:44:23.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1badec4700 1 -- 172.21.15.70:0/172618932 learned_addr learned my addr 172.21.15.70:0/172618932 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bacec2700 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c907a0 0x5629c0c9b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 0x5629c0c90260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.527+0000 7f1badec4700 1 -- 172.21.15.70:0/172618932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 msgr2=0x5629c0c90260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1badec4700 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 0x5629c0c90260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1badec4700 1 -- 172.21.15.70:0/172618932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c907a0 msgr2=0x5629c0c9b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1badec4700 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c907a0 0x5629c0c9b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1badec4700 1 -- 172.21.15.70:0/172618932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629c0a0ede0 con 0x5629c0c9b650 2023-10-08T08:44:23.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 0x5629c0c90260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1bacec2700 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c907a0 0x5629c0c9b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1badec4700 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c9da40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000b0a0 tx=0x7f1ba0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbc067f25af9c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1b937fe700 1 -- 172.21.15.70:0/172618932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000e050 con 0x5629c0c9b650 2023-10-08T08:44:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1b937fe700 1 -- 172.21.15.70:0/172618932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ba00074e0 con 0x5629c0c9b650 2023-10-08T08:44:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.528+0000 7f1b937fe700 1 -- 172.21.15.70:0/172618932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00054e0 con 0x5629c0c9b650 2023-10-08T08:44:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/172618932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 msgr2=0x5629c0c9da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c9da40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000b0a0 tx=0x7f1ba0009190 comp rx=0 tx=0).stop 2023-10-08T08:44:23.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/172618932 shutdown_connections 2023-10-08T08:44:23.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c9da40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 0x5629c0c90260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/172618932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c907a0 0x5629c0c9b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/172618932 >> 172.21.15.70:0/172618932 conn(0x5629c0c05260 msgr2=0x5629c0c8c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/172618932 shutdown_connections 2023-10-08T08:44:23.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/172618932 wait complete. 2023-10-08T08:44:23.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 -- start start 2023-10-08T08:44:23.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.529+0000 7f1bbbb10b80 1 Processor -- start 2023-10-08T08:44:23.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c8fe80 0x5629c0c9afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c982b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0be3e30 con 0x5629c0c9b650 2023-10-08T08:44:23.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0b80710 con 0x5629c0c8fe80 2023-10-08T08:44:23.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0b803b0 con 0x5629c0c907a0 2023-10-08T08:44:23.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bbbb10b80 10 client.0 _ll_register_callbacks cb 0x5629c09dd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1badec4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1badec4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51594/0 (socket says 172.21.15.70:51594) 2023-10-08T08:44:23.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1badec4700 1 -- 172.21.15.70:0/4145447965 learned_addr learned my addr 172.21.15.70:0/4145447965 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bacec2700 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c8fe80 0x5629c0c9afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1badec4700 1 -- 172.21.15.70:0/4145447965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 msgr2=0x5629c0c982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1badec4700 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1badec4700 1 -- 172.21.15.70:0/4145447965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c8fe80 msgr2=0x5629c0c9afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1badec4700 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c8fe80 0x5629c0c9afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1badec4700 1 -- 172.21.15.70:0/4145447965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba810df10 con 0x5629c0c9b650 2023-10-08T08:44:23.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bacec2700 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:23.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c8fe80 0x5629c0c9afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:23.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1badec4700 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c988e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00062a0 tx=0x7f1ba000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315505d1c48eda9b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1b90ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:23.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4145447965 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00054f0 con 0x5629c0c9b650 2023-10-08T08:44:23.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4145447965 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1ba0004db0 con 0x5629c0c9b650 2023-10-08T08:44:23.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.530+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4145447965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629c0babeb0 con 0x5629c0c9b650 2023-10-08T08:44:23.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4145447965 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ba000e020 con 0x5629c0c9b650 2023-10-08T08:44:23.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1bbbb10b80 10 client.15954 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4145447965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5629c09f7c60 con 0x5629c0c9b650 2023-10-08T08:44:23.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4145447965 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5629c0babeb0 con 0x5629c0c9b650 2023-10-08T08:44:23.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4145447965 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1ba000b0d0 con 0x5629c0c9b650 2023-10-08T08:44:23.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1bbbb10b80 10 client.15954 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1bbbb10b80 10 client.15954 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-08T08:44:23.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1bbbb10b80 20 client.15954 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5629c0caab10 0x5629c0cacf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1bbbb10b80 4 client.15954 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:23.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4145447965 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629c0bdce10 con 0x5629c0caab10 2023-10-08T08:44:23.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.531+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5629c0caab10 0x5629c0cacf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.532+0000 7f1b90ff9700 10 client.15954 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:44:23.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.532+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5629c0caab10 0x5629c0cacf00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca1cdf2cb28fa82b server_cookie=83903853d4855521 in_seq=0 out_seq=0 2023-10-08T08:44:23.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.532+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4145447965 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5629c0bdce10 con 0x5629c0caab10 2023-10-08T08:44:23.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.532+0000 7f1b90ff9700 10 client.15954 handle_command_reply: tid=0 2023-10-08T08:44:23.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.532+0000 7f1bbbb10b80 1 client.15954 shutdown 2023-10-08T08:44:23.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.532+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4145447965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 msgr2=0x5629c0c988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.532+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c988e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00062a0 tx=0x7f1ba000b970 comp rx=0 tx=0).stop 2023-10-08T08:44:23.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.532+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4145447965 shutdown_connections 2023-10-08T08:44:23.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.533+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5629c0caab10 0x5629c0cacf00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.533+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c9b650 0x5629c0c988e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.533+0000 7f1b90ff9700 0 client.15954 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:44:23.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.533+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c8fe80 0x5629c0c9afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.533+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4145447965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.533+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4145447965 >> 172.21.15.70:0/4145447965 conn(0x5629c0c05260 msgr2=0x5629c0c8bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.533+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4145447965 shutdown_connections 2023-10-08T08:44:23.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.533+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4145447965 wait complete. 2023-10-08T08:44:23.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.533+0000 7f1bbbb10b80 20 client.15954 trim_cache size 0 max 16384 2023-10-08T08:44:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.545+0000 7f1bbbb10b80 1 Processor -- start 2023-10-08T08:44:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.545+0000 7f1bbbb10b80 1 -- start start 2023-10-08T08:44:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c8fe80 0x5629c0c92d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c98800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 0x5629c0ca6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0a64920 con 0x5629c0c8fe80 2023-10-08T08:44:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0c910d0 con 0x5629c0c9b650 2023-10-08T08:44:23.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0c86570 con 0x5629c0c907a0 2023-10-08T08:44:23.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bad6c3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c8fe80 0x5629c0c92d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bad6c3700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c8fe80 0x5629c0c92d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51598/0 (socket says 172.21.15.70:51598) 2023-10-08T08:44:23.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bad6c3700 1 -- 172.21.15.70:0/4133715504 learned_addr learned my addr 172.21.15.70:0/4133715504 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bacec2700 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c98800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1badec4700 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 0x5629c0ca6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bad6c3700 1 -- 172.21.15.70:0/4133715504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 msgr2=0x5629c0c98800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c98800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bad6c3700 1 -- 172.21.15.70:0/4133715504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 msgr2=0x5629c0ca6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 0x5629c0ca6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bad6c3700 1 -- 172.21.15.70:0/4133715504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629c0a35250 con 0x5629c0c8fe80 2023-10-08T08:44:23.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bacec2700 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c98800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:23.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1badec4700 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 0x5629c0ca6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:23.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c8fe80 0x5629c0c92d70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1b980059d0 tx=0x7f1b98013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e08a94bfd242a9c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.546+0000 7f1b93fff700 1 -- 172.21.15.70:0/4133715504 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98024070 con 0x5629c0c8fe80 2023-10-08T08:44:23.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1b93fff700 1 -- 172.21.15.70:0/4133715504 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b98015070 con 0x5629c0c8fe80 2023-10-08T08:44:23.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1b93fff700 1 -- 172.21.15.70:0/4133715504 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98004e50 con 0x5629c0c8fe80 2023-10-08T08:44:23.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4133715504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c8fe80 msgr2=0x5629c0c92d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c8fe80 0x5629c0c92d70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1b980059d0 tx=0x7f1b98013000 comp rx=0 tx=0).stop 2023-10-08T08:44:23.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4133715504 shutdown_connections 2023-10-08T08:44:23.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 0x5629c0ca6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c8fe80 0x5629c0c92d70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4133715504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c907a0 0x5629c0c98800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4133715504 >> 172.21.15.70:0/4133715504 conn(0x5629c0c05260 msgr2=0x5629c0c96b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4133715504 shutdown_connections 2023-10-08T08:44:23.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.547+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4133715504 wait complete. 2023-10-08T08:44:23.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bbbb10b80 1 -- start start 2023-10-08T08:44:23.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bbbb10b80 1 Processor -- start 2023-10-08T08:44:23.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 0x5629c0ca1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c907a0 0x5629c0ca0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bbbb10b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 0x5629c0ca0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0ca0cd0 con 0x5629c0c907a0 2023-10-08T08:44:23.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0ca0e40 con 0x5629c0c9b650 2023-10-08T08:44:23.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bbbb10b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629c0ca1000 con 0x5629c0c8fe80 2023-10-08T08:44:23.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bbbb10b80 10 client.0 _ll_register_callbacks cb 0x7f1ba0009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bacec2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c907a0 0x5629c0ca0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bacec2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c907a0 0x5629c0ca0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51606/0 (socket says 172.21.15.70:51606) 2023-10-08T08:44:23.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bacec2700 1 -- 172.21.15.70:0/4237601372 learned_addr learned my addr 172.21.15.70:0/4237601372 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 0x5629c0ca1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.548+0000 7f1badec4700 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 0x5629c0ca0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bacec2700 1 -- 172.21.15.70:0/4237601372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 msgr2=0x5629c0ca1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bacec2700 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 0x5629c0ca1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bacec2700 1 -- 172.21.15.70:0/4237601372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 msgr2=0x5629c0ca0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bacec2700 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 0x5629c0ca0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bacec2700 1 -- 172.21.15.70:0/4237601372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b98010c80 con 0x5629c0c907a0 2023-10-08T08:44:23.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bacec2700 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c907a0 0x5629c0ca0250 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4099ce0 tx=0x7f1ba4099c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb42c9fbeec8e69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1b90ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:23.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4237601372 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba409a1b0 con 0x5629c0c907a0 2023-10-08T08:44:23.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4237601372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ba00074e0 con 0x5629c0c907a0 2023-10-08T08:44:23.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4237601372 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1ba4099d50 con 0x5629c0c907a0 2023-10-08T08:44:23.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4237601372 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ba409dea0 con 0x5629c0c907a0 2023-10-08T08:44:23.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bbbb10b80 10 client.15960 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4237601372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5629c0a0d2b0 con 0x5629c0c907a0 2023-10-08T08:44:23.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4237601372 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ba00074e0 con 0x5629c0c907a0 2023-10-08T08:44:23.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4237601372 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1ba40a1d70 con 0x5629c0c907a0 2023-10-08T08:44:23.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bbbb10b80 10 client.15960 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bbbb10b80 10 client.15960 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-08T08:44:23.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bbbb10b80 20 client.15960 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5629c0cffc40 0x5629c0d02060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bbbb10b80 4 client.15960 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:23.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.549+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4237601372 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5629c0bdcb30 con 0x5629c0cffc40 2023-10-08T08:44:23.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.550+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5629c0cffc40 0x5629c0d02060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.550+0000 7f1b90ff9700 10 client.15960 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:44:23.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.550+0000 7f1bad6c3700 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5629c0cffc40 0x5629c0d02060 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a7dac3bc7768c35b server_cookie=b4b429d4ed7edd1e in_seq=0 out_seq=0 2023-10-08T08:44:23.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.550+0000 7f1b90ff9700 1 -- 172.21.15.70:0/4237601372 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5629c0bdcb30 con 0x5629c0cffc40 2023-10-08T08:44:23.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.550+0000 7f1b90ff9700 10 client.15960 handle_command_reply: tid=0 2023-10-08T08:44:23.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.550+0000 7f1bbbb10b80 1 client.15960 shutdown 2023-10-08T08:44:23.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.550+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4237601372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c907a0 msgr2=0x5629c0ca0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.550+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c907a0 0x5629c0ca0250 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4099ce0 tx=0x7f1ba4099c30 comp rx=0 tx=0).stop 2023-10-08T08:44:23.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4237601372 shutdown_connections 2023-10-08T08:44:23.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5629c0cffc40 0x5629c0d02060 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5629c0c9b650 0x5629c0ca0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1b90ff9700 0 client.15960 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:44:23.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629c0c8fe80 0x5629c0ca1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1bbbb10b80 1 --2- 172.21.15.70:0/4237601372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629c0c907a0 0x5629c0ca0250 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4237601372 >> 172.21.15.70:0/4237601372 conn(0x5629c0c05260 msgr2=0x5629c0c99b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4237601372 shutdown_connections 2023-10-08T08:44:23.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1bbbb10b80 1 -- 172.21.15.70:0/4237601372 wait complete. 2023-10-08T08:44:23.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1bbbb10b80 20 client.15960 trim_cache size 0 max 16384 2023-10-08T08:44:23.581 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 -- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1b940a15f0 msgr2=0x7f1b940a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1b940a15f0 0x7f1b940a3ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1b98005950 tx=0x7f1b9800b410 comp rx=0 tx=0).stop 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 -- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 msgr2=0x7f1ba8073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 0x7f1ba8073030 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400c920 tx=0x7f1ba400cc30 comp rx=0 tx=0).stop 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 -- 172.21.15.70:0/3619057051 shutdown_connections 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1b940a15f0 0x7f1b940a3ab0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ba8106750 0x7f1ba8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ba8100740 0x7f1ba8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 --2- 172.21.15.70:0/3619057051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ba8101100 0x7f1ba8073030 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 -- 172.21.15.70:0/3619057051 >> 172.21.15.70:0/3619057051 conn(0x7f1ba80fc230 msgr2=0x7f1ba80fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 -- 172.21.15.70:0/3619057051 shutdown_connections 2023-10-08T08:44:23.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.551+0000 7f1baf927700 1 -- 172.21.15.70:0/3619057051 wait complete. 2023-10-08T08:44:23.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T08:44:23.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:23 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3697722178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:44:23.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.711+0000 7f2d2af8e700 1 -- 172.21.15.70:0/3174227175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240ff620 msgr2=0x7f2d240ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.711+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/3174227175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240ff620 0x7f2d240ffaa0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009990 tx=0x7f2d10009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.711+0000 7f2d2af8e700 1 -- 172.21.15.70:0/3174227175 shutdown_connections 2023-10-08T08:44:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.711+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/3174227175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d240fffe0 0x7f2d2410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.711+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/3174227175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d241056b0 0x7f2d24105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.711+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/3174227175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240ff620 0x7f2d240ffaa0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.711+0000 7f2d2af8e700 1 -- 172.21.15.70:0/3174227175 >> 172.21.15.70:0/3174227175 conn(0x7f2d24076780 msgr2=0x7f2d24076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.711+0000 7f2d2af8e700 1 -- 172.21.15.70:0/3174227175 shutdown_connections 2023-10-08T08:44:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.711+0000 7f2d2af8e700 1 -- 172.21.15.70:0/3174227175 wait complete. 2023-10-08T08:44:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d2af8e700 1 Processor -- start 2023-10-08T08:44:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d2af8e700 1 -- start start 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d2af8e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d240ff620 0x7f2d241012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d2af8e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240fffe0 0x7f2d241017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d2af8e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d241056b0 0x7f2d24101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d2af8e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241a4e90 con 0x7f2d240fffe0 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d2af8e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241a5000 con 0x7f2d241056b0 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d2af8e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241a51c0 con 0x7f2d240ff620 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d23fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240fffe0 0x7f2d241017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d23fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240fffe0 0x7f2d241017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51620/0 (socket says 172.21.15.70:51620) 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d23fff700 1 -- 172.21.15.70:0/2140757451 learned_addr learned my addr 172.21.15.70:0/2140757451 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.712+0000 7f2d2952b700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d241056b0 0x7f2d24101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d240ff620 0x7f2d241012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d23fff700 1 -- 172.21.15.70:0/2140757451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d240ff620 msgr2=0x7f2d241012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d23fff700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d240ff620 0x7f2d241012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d23fff700 1 -- 172.21.15.70:0/2140757451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d241056b0 msgr2=0x7f2d24101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d23fff700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d241056b0 0x7f2d24101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d23fff700 1 -- 172.21.15.70:0/2140757451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100095f0 con 0x7f2d240fffe0 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d240ff620 0x7f2d241012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d23fff700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240fffe0 0x7f2d241017f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2d100098e0 tx=0x7f2d1000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d21ffb700 1 -- 172.21.15.70:0/2140757451 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1001d070 con 0x7f2d240fffe0 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d21ffb700 1 -- 172.21.15.70:0/2140757451 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d10022470 con 0x7f2d240fffe0 2023-10-08T08:44:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d2af8e700 1 -- 172.21.15.70:0/2140757451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d241a5440 con 0x7f2d240fffe0 2023-10-08T08:44:23.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d21ffb700 1 -- 172.21.15.70:0/2140757451 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10017650 con 0x7f2d240fffe0 2023-10-08T08:44:23.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.713+0000 7f2d2af8e700 1 -- 172.21.15.70:0/2140757451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d241a5920 con 0x7f2d240fffe0 2023-10-08T08:44:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.716+0000 7f2d21ffb700 1 -- 172.21.15.70:0/2140757451 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2d100225e0 con 0x7f2d240fffe0 2023-10-08T08:44:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.716+0000 7f2d21ffb700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2d140a15f0 0x7f2d140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.716+0000 7f2d21ffb700 1 -- 172.21.15.70:0/2140757451 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2d100ce3b0 con 0x7f2d240fffe0 2023-10-08T08:44:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2d140a15f0 0x7f2d140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d37177b80 1 Processor -- start 2023-10-08T08:44:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d37177b80 1 -- start start 2023-10-08T08:44:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff50e80 0x561eeff51260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff517a0 0x561eeff5c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff5ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d37177b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eefeba460 con 0x561eeff5c650 2023-10-08T08:44:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d37177b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eefeabc20 con 0x561eeff50e80 2023-10-08T08:44:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d37177b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eefea9540 con 0x561eeff517a0 2023-10-08T08:44:23.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d2952b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff5ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d2952b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff5ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51628/0 (socket says 172.21.15.70:51628) 2023-10-08T08:44:23.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.717+0000 7f2d2952b700 1 -- 172.21.15.70:0/3658563219 learned_addr learned my addr 172.21.15.70:0/3658563219 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d23fff700 1 --2- 172.21.15.70:0/3658563219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff517a0 0x561eeff5c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d2952b700 1 -- 172.21.15.70:0/3658563219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff517a0 msgr2=0x561eeff5c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d2952b700 1 --2- 172.21.15.70:0/3658563219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff517a0 0x561eeff5c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d2952b700 1 -- 172.21.15.70:0/3658563219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff50e80 msgr2=0x561eeff51260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T08:44:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d2952b700 1 --2- 172.21.15.70:0/3658563219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff50e80 0x561eeff51260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d2952b700 1 -- 172.21.15.70:0/3658563219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561eefccfde0 con 0x561eeff5c650 2023-10-08T08:44:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2d140a15f0 0x7f2d140a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005950 tx=0x7f2d180058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d2952b700 1 --2- 172.21.15.70:0/3658563219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff5ea40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0098f0 tx=0x7f2d1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbec6522ca19f9aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d0effd700 1 -- 172.21.15.70:0/3658563219 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c019070 con 0x561eeff5c650 2023-10-08T08:44:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d0effd700 1 -- 172.21.15.70:0/3658563219 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d1c00f040 con 0x561eeff5c650 2023-10-08T08:44:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.718+0000 7f2d0effd700 1 -- 172.21.15.70:0/3658563219 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c007ab0 con 0x561eeff5c650 2023-10-08T08:44:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 -- 172.21.15.70:0/3658563219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 msgr2=0x561eeff5ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 --2- 172.21.15.70:0/3658563219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff5ea40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0098f0 tx=0x7f2d1c009c00 comp rx=0 tx=0).stop 2023-10-08T08:44:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 -- 172.21.15.70:0/3658563219 shutdown_connections 2023-10-08T08:44:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 --2- 172.21.15.70:0/3658563219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff5ea40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 --2- 172.21.15.70:0/3658563219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff50e80 0x561eeff51260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 --2- 172.21.15.70:0/3658563219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff517a0 0x561eeff5c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 -- 172.21.15.70:0/3658563219 >> 172.21.15.70:0/3658563219 conn(0x561eefec6260 msgr2=0x561eeff4d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 -- 172.21.15.70:0/3658563219 shutdown_connections 2023-10-08T08:44:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 -- 172.21.15.70:0/3658563219 wait complete. 2023-10-08T08:44:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 -- start start 2023-10-08T08:44:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.719+0000 7f2d37177b80 1 Processor -- start 2023-10-08T08:44:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff5c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 0x561eeff59330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 0x561eeff599b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d37177b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eefea4e30 con 0x561eeff517a0 2023-10-08T08:44:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d37177b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eefe41710 con 0x561eeff5c650 2023-10-08T08:44:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d37177b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eefe413b0 con 0x561eeff50e80 2023-10-08T08:44:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d37177b80 10 client.0 _ll_register_callbacks cb 0x561eefc9e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d28d2a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff5c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d28d2a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff5c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:39210/0 (socket says 172.21.15.70:39210) 2023-10-08T08:44:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d2952b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 0x561eeff599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d28d2a700 1 -- 172.21.15.70:0/1043894691 learned_addr learned my addr 172.21.15.70:0/1043894691 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d28d2a700 1 -- 172.21.15.70:0/1043894691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 msgr2=0x561eeff599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 0x561eeff599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d28d2a700 1 -- 172.21.15.70:0/1043894691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 msgr2=0x561eeff59330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 0x561eeff59330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.720+0000 7f2d28d2a700 1 -- 172.21.15.70:0/1043894691 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c003c50 con 0x561eeff50e80 2023-10-08T08:44:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.721+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff5c040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800ff00 tx=0x7f2d18004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86a10393cf61d8c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.721+0000 7f2d03fff700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:44:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.721+0000 7f2d03fff700 1 -- 172.21.15.70:0/1043894691 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1801e650 con 0x561eeff50e80 2023-10-08T08:44:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.721+0000 7f2d37177b80 1 -- 172.21.15.70:0/1043894691 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561eefe6ceb0 con 0x561eeff50e80 2023-10-08T08:44:23.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.721+0000 7f2d03fff700 1 -- 172.21.15.70:0/1043894691 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2d1801e7b0 con 0x561eeff50e80 2023-10-08T08:44:23.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.721+0000 7f2d03fff700 1 -- 172.21.15.70:0/1043894691 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d18011e70 con 0x561eeff50e80 2023-10-08T08:44:23.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.721+0000 7f2d37177b80 10 client.25429 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.721+0000 7f2d37177b80 1 -- 172.21.15.70:0/1043894691 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561eefcb8c60 con 0x561eeff50e80 2023-10-08T08:44:23.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.721+0000 7f2d03fff700 1 -- 172.21.15.70:0/1043894691 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561eefe6ceb0 con 0x561eeff50e80 2023-10-08T08:44:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d03fff700 1 -- 172.21.15.70:0/1043894691 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2d18010a90 con 0x561eeff50e80 2023-10-08T08:44:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d37177b80 10 client.25429 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d37177b80 10 client.25429 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-10-08T08:44:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d37177b80 20 client.25429 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d37177b80 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x561eeff6c1d0 0x561eeff6e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d37177b80 4 client.25429 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d37177b80 1 -- 172.21.15.70:0/1043894691 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561eefe9de10 con 0x561eeff6c1d0 2023-10-08T08:44:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d23fff700 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x561eeff6c1d0 0x561eeff6e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d23fff700 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x561eeff6c1d0 0x561eeff6e610 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83509663324273db server_cookie=82940aef80660937 in_seq=0 out_seq=0 2023-10-08T08:44:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.722+0000 7f2d03fff700 10 client.25429 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:44:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d03fff700 1 -- 172.21.15.70:0/1043894691 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561eefe9de10 con 0x561eeff6c1d0 2023-10-08T08:44:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d03fff700 10 client.25429 handle_command_reply: tid=0 2023-10-08T08:44:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 client.25429 shutdown 2023-10-08T08:44:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 -- 172.21.15.70:0/1043894691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 msgr2=0x561eeff5c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff5c040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800ff00 tx=0x7f2d18004750 comp rx=0 tx=0).stop 2023-10-08T08:44:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 -- 172.21.15.70:0/1043894691 shutdown_connections 2023-10-08T08:44:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x561eeff6c1d0 0x561eeff6e610 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 0x561eeff599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff5c040 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d03fff700 0 client.25429 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:44:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 --2- 172.21.15.70:0/1043894691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 0x561eeff59330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 -- 172.21.15.70:0/1043894691 >> 172.21.15.70:0/1043894691 conn(0x561eefec6260 msgr2=0x561eeff4cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 -- 172.21.15.70:0/1043894691 shutdown_connections 2023-10-08T08:44:23.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 1 -- 172.21.15.70:0/1043894691 wait complete. 2023-10-08T08:44:23.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.723+0000 7f2d37177b80 20 client.25429 trim_cache size 0 max 16384 2023-10-08T08:44:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.736+0000 7f2d37177b80 1 Processor -- start 2023-10-08T08:44:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.736+0000 7f2d37177b80 1 -- start start 2023-10-08T08:44:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff53d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 0x561eeff678f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 0x561eeff67e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d37177b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eefd25920 con 0x561eeff517a0 2023-10-08T08:44:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d37177b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eeff68cc0 con 0x561eeff5c650 2023-10-08T08:44:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d37177b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eeff520d0 con 0x561eeff50e80 2023-10-08T08:44:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d23fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 0x561eeff678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d23fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 0x561eeff678f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51642/0 (socket says 172.21.15.70:51642) 2023-10-08T08:44:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d23fff700 1 -- 172.21.15.70:0/3811110096 learned_addr learned my addr 172.21.15.70:0/3811110096 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff53d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d2952b700 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 0x561eeff67e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d23fff700 1 -- 172.21.15.70:0/3811110096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 msgr2=0x561eeff53d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d23fff700 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff53d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d23fff700 1 -- 172.21.15.70:0/3811110096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 msgr2=0x561eeff67e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d23fff700 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 0x561eeff67e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d23fff700 1 -- 172.21.15.70:0/3811110096 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561eefcf6250 con 0x561eeff517a0 2023-10-08T08:44:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff53d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d23fff700 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 0x561eeff678f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2d1009aef0 tx=0x7f2d10009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503072317871afa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d0f7fe700 1 -- 172.21.15.70:0/3811110096 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1009f170 con 0x561eeff517a0 2023-10-08T08:44:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d0f7fe700 1 -- 172.21.15.70:0/3811110096 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d1009f340 con 0x561eeff517a0 2023-10-08T08:44:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.737+0000 7f2d0f7fe700 1 -- 172.21.15.70:0/3811110096 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100228e0 con 0x561eeff517a0 2023-10-08T08:44:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 -- 172.21.15.70:0/3811110096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 msgr2=0x561eeff678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 0x561eeff678f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2d1009aef0 tx=0x7f2d10009310 comp rx=0 tx=0).stop 2023-10-08T08:44:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 -- 172.21.15.70:0/3811110096 shutdown_connections 2023-10-08T08:44:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff5c650 0x561eeff67e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff53d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 --2- 172.21.15.70:0/3811110096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff517a0 0x561eeff678f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 -- 172.21.15.70:0/3811110096 >> 172.21.15.70:0/3811110096 conn(0x561eefec6260 msgr2=0x561eeff57c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 -- 172.21.15.70:0/3811110096 shutdown_connections 2023-10-08T08:44:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 -- 172.21.15.70:0/3811110096 wait complete. 2023-10-08T08:44:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.738+0000 7f2d37177b80 1 -- start start 2023-10-08T08:44:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d37177b80 1 Processor -- start 2023-10-08T08:44:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff62b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff517a0 0x561eeff63070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d37177b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d37177b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eeff616d0 con 0x561eeff5c650 2023-10-08T08:44:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d37177b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eeff61840 con 0x561eeff517a0 2023-10-08T08:44:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d37177b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eeff61a00 con 0x561eeff50e80 2023-10-08T08:44:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d37177b80 10 client.0 _ll_register_callbacks cb 0x7f2d1800beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d2952b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d2952b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff610d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51650/0 (socket says 172.21.15.70:51650) 2023-10-08T08:44:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d2952b700 1 -- 172.21.15.70:0/2070134372 learned_addr learned my addr 172.21.15.70:0/2070134372 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d23fff700 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff517a0 0x561eeff63070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.739+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff62b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d2952b700 1 -- 172.21.15.70:0/2070134372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 msgr2=0x561eeff62b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d2952b700 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff62b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d2952b700 1 -- 172.21.15.70:0/2070134372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff517a0 msgr2=0x561eeff63070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d2952b700 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff517a0 0x561eeff63070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d2952b700 1 -- 172.21.15.70:0/2070134372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d241a5920 con 0x561eeff5c650 2023-10-08T08:44:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff62b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d2952b700 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff610d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0098f0 tx=0x7f2d1c0078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2103dcdd8523d5b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d03fff700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d03fff700 1 -- 172.21.15.70:0/2070134372 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c019040 con 0x561eeff5c650 2023-10-08T08:44:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d03fff700 1 -- 172.21.15.70:0/2070134372 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2d1c007cd0 con 0x561eeff5c650 2023-10-08T08:44:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d37177b80 1 -- 172.21.15.70:0/2070134372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d1c00f040 con 0x561eeff5c650 2023-10-08T08:44:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d03fff700 1 -- 172.21.15.70:0/2070134372 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d1c007e90 con 0x561eeff5c650 2023-10-08T08:44:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d37177b80 10 client.15975 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d37177b80 1 -- 172.21.15.70:0/2070134372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561eefcce2b0 con 0x561eeff5c650 2023-10-08T08:44:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.740+0000 7f2d03fff700 1 -- 172.21.15.70:0/2070134372 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d1c00f040 con 0x561eeff5c650 2023-10-08T08:44:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d03fff700 1 -- 172.21.15.70:0/2070134372 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2d1c01f5b0 con 0x561eeff5c650 2023-10-08T08:44:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d37177b80 10 client.15975 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d37177b80 10 client.15975 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-10-08T08:44:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d37177b80 20 client.15975 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d37177b80 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x561eeffc13a0 0x561eeffc37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d37177b80 4 client.15975 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d37177b80 1 -- 172.21.15.70:0/2070134372 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561eefe9db30 con 0x561eeffc13a0 2023-10-08T08:44:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x561eeffc13a0 0x561eeffc37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d03fff700 10 client.15975 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:44:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.741+0000 7f2d28d2a700 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x561eeffc13a0 0x561eeffc37c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8af5983857e543ea server_cookie=bd37f42854201c7d in_seq=0 out_seq=0 2023-10-08T08:44:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d03fff700 1 -- 172.21.15.70:0/2070134372 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561eefe9db30 con 0x561eeffc13a0 2023-10-08T08:44:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d03fff700 10 client.15975 handle_command_reply: tid=0 2023-10-08T08:44:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 client.15975 shutdown 2023-10-08T08:44:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 -- 172.21.15.70:0/2070134372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 msgr2=0x561eeff610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff610d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0098f0 tx=0x7f2d1c0078b0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 -- 172.21.15.70:0/2070134372 shutdown_connections 2023-10-08T08:44:23.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x561eeffc13a0 0x561eeffc37c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561eeff5c650 0x561eeff610d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561eeff50e80 0x561eeff62b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d03fff700 0 client.15975 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:44:23.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 --2- 172.21.15.70:0/2070134372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561eeff517a0 0x561eeff63070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 -- 172.21.15.70:0/2070134372 >> 172.21.15.70:0/2070134372 conn(0x561eefec6260 msgr2=0x561eeff68180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 -- 172.21.15.70:0/2070134372 shutdown_connections 2023-10-08T08:44:23.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 1 -- 172.21.15.70:0/2070134372 wait complete. 2023-10-08T08:44:23.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d37177b80 20 client.15975 trim_cache size 0 max 16384 2023-10-08T08:44:23.768 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d2af8e700 1 -- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2d140a15f0 msgr2=0x7f2d140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2d140a15f0 0x7f2d140a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005950 tx=0x7f2d180058e0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d2af8e700 1 -- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240fffe0 msgr2=0x7f2d241017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.742+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240fffe0 0x7f2d241017f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2d100098e0 tx=0x7f2d1000f670 comp rx=0 tx=0).stop 2023-10-08T08:44:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.743+0000 7f2d2af8e700 1 -- 172.21.15.70:0/2140757451 shutdown_connections 2023-10-08T08:44:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.743+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2d140a15f0 0x7f2d140a3ab0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.743+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d241056b0 0x7f2d24101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.743+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d240ff620 0x7f2d241012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.743+0000 7f2d2af8e700 1 --2- 172.21.15.70:0/2140757451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d240fffe0 0x7f2d241017f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.743+0000 7f2d2af8e700 1 -- 172.21.15.70:0/2140757451 >> 172.21.15.70:0/2140757451 conn(0x7f2d24076780 msgr2=0x7f2d240fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.743+0000 7f2d2af8e700 1 -- 172.21.15.70:0/2140757451 shutdown_connections 2023-10-08T08:44:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.743+0000 7f2d2af8e700 1 -- 172.21.15.70:0/2140757451 wait complete. 2023-10-08T08:44:23.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T08:44:23.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 -- 172.21.15.70:0/2740832839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 msgr2=0x7f2634100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 --2- 172.21.15.70:0/2740832839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 0x7f2634100210 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2620009990 tx=0x7f2620009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 -- 172.21.15.70:0/2740832839 shutdown_connections 2023-10-08T08:44:23.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 --2- 172.21.15.70:0/2740832839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2634100750 0x7f263410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 --2- 172.21.15.70:0/2740832839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2634105630 0x7f2634105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 --2- 172.21.15.70:0/2740832839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 0x7f2634100210 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 -- 172.21.15.70:0/2740832839 >> 172.21.15.70:0/2740832839 conn(0x7f2634075c20 msgr2=0x7f26340fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 -- 172.21.15.70:0/2740832839 shutdown_connections 2023-10-08T08:44:23.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 -- 172.21.15.70:0/2740832839 wait complete. 2023-10-08T08:44:23.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.896+0000 7f263ac54700 1 Processor -- start 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f263ac54700 1 -- start start 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f263ac54700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 0x7f26341979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f263ac54700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2634100750 0x7f2634197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f263ac54700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2634105630 0x7f26341a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f263ac54700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26341987f0 con 0x7f26340ffd90 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f263ac54700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26341a2fb0 con 0x7f2634100750 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f263ac54700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26341a30f0 con 0x7f2634105630 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26389f0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 0x7f26341979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26389f0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 0x7f26341979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51660/0 (socket says 172.21.15.70:51660) 2023-10-08T08:44:23.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26389f0700 1 -- 172.21.15.70:0/2423449616 learned_addr learned my addr 172.21.15.70:0/2423449616 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f2633fff700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2634100750 0x7f2634197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26391f1700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2634105630 0x7f26341a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26389f0700 1 -- 172.21.15.70:0/2423449616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2634105630 msgr2=0x7f26341a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26389f0700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2634105630 0x7f26341a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26389f0700 1 -- 172.21.15.70:0/2423449616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2634100750 msgr2=0x7f2634197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26389f0700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2634100750 0x7f2634197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26389f0700 1 -- 172.21.15.70:0/2423449616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200095f0 con 0x7f26340ffd90 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.897+0000 7f26389f0700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 0x7f26341979f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f262800d950 tx=0x7f262800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.898+0000 7f2631ffb700 1 -- 172.21.15.70:0/2423449616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628009940 con 0x7f26340ffd90 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.898+0000 7f263ac54700 1 -- 172.21.15.70:0/2423449616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26341a33d0 con 0x7f26340ffd90 2023-10-08T08:44:23.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.898+0000 7f2631ffb700 1 -- 172.21.15.70:0/2423449616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2628010460 con 0x7f26340ffd90 2023-10-08T08:44:23.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.898+0000 7f2631ffb700 1 -- 172.21.15.70:0/2423449616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262800f620 con 0x7f26340ffd90 2023-10-08T08:44:23.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.898+0000 7f263ac54700 1 -- 172.21.15.70:0/2423449616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26341a3900 con 0x7f26340ffd90 2023-10-08T08:44:23.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.900+0000 7f2631ffb700 1 -- 172.21.15.70:0/2423449616 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f26280108d0 con 0x7f26340ffd90 2023-10-08T08:44:23.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.901+0000 7f2631ffb700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26240a15f0 0x7f26240a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.901+0000 7f2633fff700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26240a15f0 0x7f26240a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.901+0000 7f2631ffb700 1 -- 172.21.15.70:0/2423449616 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f26280cd540 con 0x7f26340ffd90 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f2633fff700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26240a15f0 0x7f26240a3ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f262000b5c0 tx=0x7f2620005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f2646e3db80 1 Processor -- start 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f2646e3db80 1 -- start start 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x55575936c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 0x555759377110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759379a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f2646e3db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557592d5460 con 0x555759377650 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f2646e3db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557592c6c20 con 0x55575936be80 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f2646e3db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557592c4540 con 0x55575936c7a0 2023-10-08T08:44:23.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f26391f1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759379a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f26389f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x55575936c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.902+0000 7f26391f1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759379a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51672/0 (socket says 172.21.15.70:51672) 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f26391f1700 1 -- 172.21.15.70:0/921066501 learned_addr learned my addr 172.21.15.70:0/921066501 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f2633fff700 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 0x555759377110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f26391f1700 1 -- 172.21.15.70:0/921066501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 msgr2=0x555759377110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f26391f1700 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 0x555759377110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f26391f1700 1 -- 172.21.15.70:0/921066501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 msgr2=0x55575936c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f26391f1700 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x55575936c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f26391f1700 1 -- 172.21.15.70:0/921066501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557590eade0 con 0x555759377650 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f2633fff700 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 0x555759377110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:23.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f26389f0700 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x55575936c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:23.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f26391f1700 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759379a40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f262c009dc0 tx=0x7f262c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f383e416e1f3dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f261effd700 1 -- 172.21.15.70:0/921066501 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c014610 con 0x555759377650 2023-10-08T08:44:23.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f261effd700 1 -- 172.21.15.70:0/921066501 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f262c00f050 con 0x555759377650 2023-10-08T08:44:23.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.903+0000 7f261effd700 1 -- 172.21.15.70:0/921066501 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c013930 con 0x555759377650 2023-10-08T08:44:23.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 -- 172.21.15.70:0/921066501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 msgr2=0x555759379a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759379a40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f262c009dc0 tx=0x7f262c0077e0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 -- 172.21.15.70:0/921066501 shutdown_connections 2023-10-08T08:44:23.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759379a40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x55575936c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 --2- 172.21.15.70:0/921066501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 0x555759377110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 -- 172.21.15.70:0/921066501 >> 172.21.15.70:0/921066501 conn(0x5557592e1260 msgr2=0x5557593682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 -- 172.21.15.70:0/921066501 shutdown_connections 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 -- 172.21.15.70:0/921066501 wait complete. 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 -- start start 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.904+0000 7f2646e3db80 1 Processor -- start 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x5557593770b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 0x5557593743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759374ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f2646e3db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557592bfe30 con 0x555759377650 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f2646e3db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575925c710 con 0x55575936be80 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f2646e3db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575925c3b0 con 0x55575936c7a0 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f2646e3db80 10 client.0 _ll_register_callbacks cb 0x5557590b9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f26389f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x5557593770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f2633fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 0x5557593743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f26389f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x5557593770b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39134/0 (socket says 172.21.15.70:39134) 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f26389f0700 1 -- 172.21.15.70:0/3736506125 learned_addr learned my addr 172.21.15.70:0/3736506125 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f26391f1700 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759374ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f26389f0700 1 -- 172.21.15.70:0/3736506125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 msgr2=0x5557593743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f26389f0700 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 0x5557593743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f26389f0700 1 -- 172.21.15.70:0/3736506125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 msgr2=0x555759374ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.905+0000 7f26389f0700 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759374ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f26389f0700 1 -- 172.21.15.70:0/3736506125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26341a3900 con 0x55575936be80 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f26389f0700 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x5557593770b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f26280caa20 tx=0x7f262809a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8e51ef2b1151caf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f2613fff700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f2613fff700 1 -- 172.21.15.70:0/3736506125 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262809e170 con 0x55575936be80 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f2646e3db80 1 -- 172.21.15.70:0/3736506125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555759287eb0 con 0x55575936be80 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f2613fff700 1 -- 172.21.15.70:0/3736506125 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f26280a25e0 con 0x55575936be80 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f2613fff700 1 -- 172.21.15.70:0/3736506125 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26280cd1f0 con 0x55575936be80 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f2646e3db80 10 client.25454 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f2646e3db80 1 -- 172.21.15.70:0/3736506125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f262c009a20 con 0x55575936be80 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f2613fff700 1 -- 172.21.15.70:0/3736506125 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555759287eb0 con 0x55575936be80 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.906+0000 7f2613fff700 1 -- 172.21.15.70:0/3736506125 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2628099740 con 0x55575936be80 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.907+0000 7f2646e3db80 10 client.25454 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.907+0000 7f2646e3db80 10 client.25454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.907+0000 7f2646e3db80 20 client.25454 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.907+0000 7f2646e3db80 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x555759386f40 0x555759389330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.907+0000 7f2646e3db80 4 client.25454 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.907+0000 7f2646e3db80 1 -- 172.21.15.70:0/3736506125 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557592b8e10 con 0x555759386f40 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.907+0000 7f2633fff700 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x555759386f40 0x555759389330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.907+0000 7f2613fff700 10 client.25454 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:23.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.907+0000 7f2633fff700 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x555759386f40 0x555759389330 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=846f9bc3e4fa6466 server_cookie=4dc81d3de2d0844e in_seq=0 out_seq=0 2023-10-08T08:44:23.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2613fff700 1 -- 172.21.15.70:0/3736506125 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5557592b8e10 con 0x555759386f40 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2613fff700 10 client.25454 handle_command_reply: tid=0 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 client.25454 shutdown 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 -- 172.21.15.70:0/3736506125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 msgr2=0x5557593770b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x5557593770b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f26280caa20 tx=0x7f262809a250 comp rx=0 tx=0).stop 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 -- 172.21.15.70:0/3736506125 shutdown_connections 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555759377650 0x555759374ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x555759386f40 0x555759389330 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55575936be80 0x5557593770b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2613fff700 0 client.25454 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 --2- 172.21.15.70:0/3736506125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936c7a0 0x5557593743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 -- 172.21.15.70:0/3736506125 >> 172.21.15.70:0/3736506125 conn(0x5557592e1260 msgr2=0x555759367ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 -- 172.21.15.70:0/3736506125 shutdown_connections 2023-10-08T08:44:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 1 -- 172.21.15.70:0/3736506125 wait complete. 2023-10-08T08:44:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.908+0000 7f2646e3db80 20 client.25454 trim_cache size 0 max 16384 2023-10-08T08:44:23.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.921+0000 7f2646e3db80 1 Processor -- start 2023-10-08T08:44:23.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.921+0000 7f2646e3db80 1 -- start start 2023-10-08T08:44:23.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 0x55575936ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x5557593828f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 0x55575936f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2646e3db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555759140920 con 0x55575936c7a0 2023-10-08T08:44:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2646e3db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575936c5e0 con 0x555759377650 2023-10-08T08:44:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2646e3db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557593728f0 con 0x55575936be80 2023-10-08T08:44:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2633fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x5557593828f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2633fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x5557593828f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51682/0 (socket says 172.21.15.70:51682) 2023-10-08T08:44:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2633fff700 1 -- 172.21.15.70:0/738546051 learned_addr learned my addr 172.21.15.70:0/738546051 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f26389f0700 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 0x55575936ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f26391f1700 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 0x55575936f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2633fff700 1 -- 172.21.15.70:0/738546051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 msgr2=0x55575936ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2633fff700 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 0x55575936ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2633fff700 1 -- 172.21.15.70:0/738546051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 msgr2=0x55575936f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2633fff700 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 0x55575936f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2633fff700 1 -- 172.21.15.70:0/738546051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557590d3c60 con 0x55575936c7a0 2023-10-08T08:44:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f26391f1700 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 0x55575936f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f26389f0700 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 0x55575936ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:23.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f2633fff700 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x5557593828f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2620009990 tx=0x7f262001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a021851af0cfba9a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.922+0000 7f261f7fe700 1 -- 172.21.15.70:0/738546051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620031da0 con 0x55575936c7a0 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f261f7fe700 1 -- 172.21.15.70:0/738546051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2620035070 con 0x55575936c7a0 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f261f7fe700 1 -- 172.21.15.70:0/738546051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620003b90 con 0x55575936c7a0 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f2646e3db80 1 -- 172.21.15.70:0/738546051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 msgr2=0x5557593828f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f2646e3db80 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x5557593828f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2620009990 tx=0x7f262001f000 comp rx=0 tx=0).stop 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f2646e3db80 1 -- 172.21.15.70:0/738546051 shutdown_connections 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f2646e3db80 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 0x55575936f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f2646e3db80 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 0x55575936ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f2646e3db80 1 --2- 172.21.15.70:0/738546051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x5557593828f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f2646e3db80 1 -- 172.21.15.70:0/738546051 >> 172.21.15.70:0/738546051 conn(0x5557592e1260 msgr2=0x55575938dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f2646e3db80 1 -- 172.21.15.70:0/738546051 shutdown_connections 2023-10-08T08:44:23.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.923+0000 7f2646e3db80 1 -- 172.21.15.70:0/738546051 wait complete. 2023-10-08T08:44:23.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.924+0000 7f2646e3db80 1 -- start start 2023-10-08T08:44:23.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.924+0000 7f2646e3db80 1 Processor -- start 2023-10-08T08:44:23.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.924+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 0x55575937df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.924+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x55575937c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.924+0000 7f2646e3db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 0x55575937c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.924+0000 7f2646e3db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575937cd00 con 0x55575936c7a0 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.924+0000 7f2646e3db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575937ce70 con 0x555759377650 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.924+0000 7f2646e3db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575937d030 con 0x55575936be80 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2646e3db80 10 client.0 _ll_register_callbacks cb 0x7f262809a950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2633fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x55575937c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2633fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x55575937c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51690/0 (socket says 172.21.15.70:51690) 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2633fff700 1 -- 172.21.15.70:0/1069515368 learned_addr learned my addr 172.21.15.70:0/1069515368 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f26391f1700 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 0x55575937c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f26389f0700 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 0x55575937df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2633fff700 1 -- 172.21.15.70:0/1069515368 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 msgr2=0x55575937df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2633fff700 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 0x55575937df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2633fff700 1 -- 172.21.15.70:0/1069515368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 msgr2=0x55575937c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2633fff700 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 0x55575937c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2633fff700 1 -- 172.21.15.70:0/1069515368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c009a20 con 0x55575936c7a0 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2633fff700 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x55575937c280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f26200315e0 tx=0x7f262000b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd52e130a3350126 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2613fff700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2613fff700 1 -- 172.21.15.70:0/1069515368 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262003d070 con 0x55575936c7a0 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2646e3db80 1 -- 172.21.15.70:0/1069515368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f262c00f050 con 0x55575936c7a0 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2613fff700 1 -- 172.21.15.70:0/1069515368 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2620005040 con 0x55575936c7a0 2023-10-08T08:44:23.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2613fff700 1 -- 172.21.15.70:0/1069515368 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2620005200 con 0x55575936c7a0 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2646e3db80 10 client.15993 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.925+0000 7f2646e3db80 1 -- 172.21.15.70:0/1069515368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f263410cdf0 con 0x55575936c7a0 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.926+0000 7f2613fff700 1 -- 172.21.15.70:0/1069515368 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f262c00f050 con 0x55575936c7a0 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.926+0000 7f2613fff700 1 -- 172.21.15.70:0/1069515368 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2620040030 con 0x55575936c7a0 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.926+0000 7f2646e3db80 10 client.15993 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.926+0000 7f2646e3db80 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.926+0000 7f2646e3db80 20 client.15993 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.926+0000 7f2646e3db80 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5557593dbd70 0x5557593de160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.926+0000 7f2646e3db80 4 client.15993 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.926+0000 7f2646e3db80 1 -- 172.21.15.70:0/1069515368 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5557592b8b30 con 0x5557593dbd70 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.926+0000 7f26389f0700 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5557593dbd70 0x5557593de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2613fff700 10 client.15993 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f26389f0700 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5557593dbd70 0x5557593de160 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adb2420ded570168 server_cookie=45cd7e50d50b02f7 in_seq=0 out_seq=0 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2613fff700 1 -- 172.21.15.70:0/1069515368 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5557592b8b30 con 0x5557593dbd70 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2613fff700 10 client.15993 handle_command_reply: tid=0 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 client.15993 shutdown 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 -- 172.21.15.70:0/1069515368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 msgr2=0x55575937c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x55575937c280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f26200315e0 tx=0x7f262000b800 comp rx=0 tx=0).stop 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 -- 172.21.15.70:0/1069515368 shutdown_connections 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5557593dbd70 0x5557593de160 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555759377650 0x55575937c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55575936be80 0x55575937df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2613fff700 0 client.15993 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 --2- 172.21.15.70:0/1069515368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55575936c7a0 0x55575937c280 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 -- 172.21.15.70:0/1069515368 >> 172.21.15.70:0/1069515368 conn(0x5557592e1260 msgr2=0x5557593828f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 -- 172.21.15.70:0/1069515368 shutdown_connections 2023-10-08T08:44:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 1 -- 172.21.15.70:0/1069515368 wait complete. 2023-10-08T08:44:23.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.927+0000 7f2646e3db80 20 client.15993 trim_cache size 0 max 16384 2023-10-08T08:44:23.936 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 -- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26240a15f0 msgr2=0x7f26240a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26240a15f0 0x7f26240a3ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f262000b5c0 tx=0x7f2620005960 comp rx=0 tx=0).stop 2023-10-08T08:44:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 -- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 msgr2=0x7f26341979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 0x7f26341979f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f262800d950 tx=0x7f262800dc60 comp rx=0 tx=0).stop 2023-10-08T08:44:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 -- 172.21.15.70:0/2423449616 shutdown_connections 2023-10-08T08:44:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f26240a15f0 0x7f26240a3ab0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2634105630 0x7f26341a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26340ffd90 0x7f26341979f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 --2- 172.21.15.70:0/2423449616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2634100750 0x7f2634197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:23.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 -- 172.21.15.70:0/2423449616 >> 172.21.15.70:0/2423449616 conn(0x7f2634075c20 msgr2=0x7f26340fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:23.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 -- 172.21.15.70:0/2423449616 shutdown_connections 2023-10-08T08:44:23.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:23.928+0000 7f263ac54700 1 -- 172.21.15.70:0/2423449616 wait complete. 2023-10-08T08:44:24.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:24 smithi070 ceph-mon[99513]: pgmap v308: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:44:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:24 smithi105 ceph-mon[103798]: pgmap v308: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:44:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:24 smithi191 ceph-mon[104220]: pgmap v308: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:44:24.941 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T08:44:24.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T08:44:25.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.071+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/1386727676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd980ff620 msgr2=0x7fcd980ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.071+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/1386727676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd980ff620 0x7fcd980ffaa0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009990 tx=0x7fcd88009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.071+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/1386727676 shutdown_connections 2023-10-08T08:44:25.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.071+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/1386727676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd980fffe0 0x7fcd9810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.071+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/1386727676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd981056b0 0x7fcd98105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.071+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/1386727676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd980ff620 0x7fcd980ffaa0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.071+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/1386727676 >> 172.21.15.70:0/1386727676 conn(0x7fcd98076780 msgr2=0x7fcd98076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.071+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/1386727676 shutdown_connections 2023-10-08T08:44:25.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.071+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/1386727676 wait complete. 2023-10-08T08:44:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.072+0000 7fcd9ff5e700 1 Processor -- start 2023-10-08T08:44:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.072+0000 7fcd9ff5e700 1 -- start start 2023-10-08T08:44:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.072+0000 7fcd9ff5e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd980ff620 0x7fcd9819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9ff5e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd980fffe0 0x7fcd9819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9ff5e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd981056b0 0x7fcd98196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9ff5e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd98196f70 con 0x7fcd980ff620 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9ff5e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd981970e0 con 0x7fcd980fffe0 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9ff5e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd981972a0 con 0x7fcd981056b0 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9e4fb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd981056b0 0x7fcd98196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9e4fb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd981056b0 0x7fcd98196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:39282/0 (socket says 172.21.15.70:39282) 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9e4fb700 1 -- 172.21.15.70:0/186122012 learned_addr learned my addr 172.21.15.70:0/186122012 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd980fffe0 0x7fcd9819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd980ff620 0x7fcd9819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9d4f9700 1 -- 172.21.15.70:0/186122012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd981056b0 msgr2=0x7fcd98196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd981056b0 0x7fcd98196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9d4f9700 1 -- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd980ff620 msgr2=0x7fcd9819c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd980ff620 0x7fcd9819c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9d4f9700 1 -- 172.21.15.70:0/186122012 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd880095f0 con 0x7fcd980fffe0 2023-10-08T08:44:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.073+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd980ff620 0x7fcd9819c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.074+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd980fffe0 0x7fcd9819ccd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd880059d0 tx=0x7fcd88004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.074+0000 7fcd8effd700 1 -- 172.21.15.70:0/186122012 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8801d070 con 0x7fcd980fffe0 2023-10-08T08:44:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.074+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/186122012 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd98197520 con 0x7fcd980fffe0 2023-10-08T08:44:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.074+0000 7fcd8effd700 1 -- 172.21.15.70:0/186122012 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd88022470 con 0x7fcd980fffe0 2023-10-08T08:44:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.074+0000 7fcd8effd700 1 -- 172.21.15.70:0/186122012 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88017650 con 0x7fcd980fffe0 2023-10-08T08:44:25.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.074+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/186122012 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd981a3780 con 0x7fcd980fffe0 2023-10-08T08:44:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.077+0000 7fcd8effd700 1 -- 172.21.15.70:0/186122012 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fcd880225e0 con 0x7fcd980fffe0 2023-10-08T08:44:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.078+0000 7fcd8effd700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd840a15f0 0x7fcd840a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.078+0000 7fcd8effd700 1 -- 172.21.15.70:0/186122012 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcd880ce570 con 0x7fcd980fffe0 2023-10-08T08:44:25.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.078+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd840a15f0 0x7fcd840a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.078+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd840a15f0 0x7fcd840a3ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcd98077ab0 tx=0x7fcd94009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.079+0000 7fcdac147b80 1 Processor -- start 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.079+0000 7fcdac147b80 1 -- start start 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.079+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e54b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.079+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e46390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.079+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e5b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.079+0000 7fcdac147b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8dae4e0 con 0x561ca8e54760 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.079+0000 7fcdac147b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8d9fca0 con 0x561ca8e45f10 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.079+0000 7fcdac147b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8d9d5c0 con 0x561ca8e468d0 2023-10-08T08:44:25.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9d4f9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e46390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9e4fb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e5b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9d4f9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e46390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39170/0 (socket says 172.21.15.70:39170) 2023-10-08T08:44:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9d4f9700 1 -- 172.21.15.70:0/1384288303 learned_addr learned my addr 172.21.15.70:0/1384288303 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9e4fb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e5b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:39288/0 (socket says 172.21.15.70:39288) 2023-10-08T08:44:25.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/1384288303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e54b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9dcfa700 1 -- 172.21.15.70:0/1384288303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 msgr2=0x561ca8e5b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/1384288303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e5b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9dcfa700 1 -- 172.21.15.70:0/1384288303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 msgr2=0x561ca8e46390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/1384288303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e46390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.080+0000 7fcd9dcfa700 1 -- 172.21.15.70:0/1384288303 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ca8bc3e60 con 0x561ca8e54760 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.081+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/1384288303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e54b40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcd94004300 tx=0x7fcd94014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb46e7bbeb32f15 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.081+0000 7fcd83fff700 1 -- 172.21.15.70:0/1384288303 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94003d10 con 0x561ca8e54760 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.081+0000 7fcd83fff700 1 -- 172.21.15.70:0/1384288303 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd94003e70 con 0x561ca8e54760 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.081+0000 7fcd83fff700 1 -- 172.21.15.70:0/1384288303 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd940267c0 con 0x561ca8e54760 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 -- 172.21.15.70:0/1384288303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 msgr2=0x561ca8e54b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 --2- 172.21.15.70:0/1384288303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e54b40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcd94004300 tx=0x7fcd94014000 comp rx=0 tx=0).stop 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 -- 172.21.15.70:0/1384288303 shutdown_connections 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 --2- 172.21.15.70:0/1384288303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e5b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 --2- 172.21.15.70:0/1384288303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e54b40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 --2- 172.21.15.70:0/1384288303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e46390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 -- 172.21.15.70:0/1384288303 >> 172.21.15.70:0/1384288303 conn(0x561ca8dba2e0 msgr2=0x561ca8e41200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 -- 172.21.15.70:0/1384288303 shutdown_connections 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 -- 172.21.15.70:0/1384288303 wait complete. 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.082+0000 7fcdac147b80 1 -- start start 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcdac147b80 1 Processor -- start 2023-10-08T08:44:25.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e45f10 0x561ca8e588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e468d0 0x561ca8e58df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e59330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcdac147b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8d98eb0 con 0x561ca8e54760 2023-10-08T08:44:25.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcdac147b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8d35790 con 0x561ca8e468d0 2023-10-08T08:44:25.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcdac147b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8d35430 con 0x561ca8e45f10 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcdac147b80 10 client.0 _ll_register_callbacks cb 0x561ca8b92880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcd9e4fb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e59330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcd9e4fb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e59330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51718/0 (socket says 172.21.15.70:51718) 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcd9e4fb700 1 -- 172.21.15.70:0/2807735354 learned_addr learned my addr 172.21.15.70:0/2807735354 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e468d0 0x561ca8e58df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.083+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e45f10 0x561ca8e588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.084+0000 7fcd9d4f9700 1 -- 172.21.15.70:0/2807735354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e45f10 msgr2=0x561ca8e588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.084+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e45f10 0x561ca8e588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.084+0000 7fcd9d4f9700 1 -- 172.21.15.70:0/2807735354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 msgr2=0x561ca8e59330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.084+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e59330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.084+0000 7fcd9d4f9700 1 -- 172.21.15.70:0/2807735354 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd94017070 con 0x561ca8e468d0 2023-10-08T08:44:25.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.084+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e468d0 0x561ca8e58df0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd88097810 tx=0x7fcd8809ae50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a72fd221cc640ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.084+0000 7fcd817fa700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.084+0000 7fcd817fa700 1 -- 172.21.15.70:0/2807735354 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8809ba10 con 0x561ca8e468d0 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcdac147b80 1 -- 172.21.15.70:0/2807735354 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ca8d60f30 con 0x561ca8e468d0 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcd817fa700 1 -- 172.21.15.70:0/2807735354 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcd8809b310 con 0x561ca8e468d0 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcd817fa700 1 -- 172.21.15.70:0/2807735354 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd8809f460 con 0x561ca8e468d0 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcdac147b80 10 client.25472 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcdac147b80 1 -- 172.21.15.70:0/2807735354 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561ca8bacce0 con 0x561ca8e468d0 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcd817fa700 1 -- 172.21.15.70:0/2807735354 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd880b7080 con 0x561ca8e468d0 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcd817fa700 1 -- 172.21.15.70:0/2807735354 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcd8809a800 con 0x561ca8e468d0 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcdac147b80 10 client.25472 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcdac147b80 10 client.25472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcdac147b80 20 client.25472 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x561ca8e687f0 0x561ca8e6ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcdac147b80 4 client.25472 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.085+0000 7fcdac147b80 1 -- 172.21.15.70:0/2807735354 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ca8d91e90 con 0x561ca8e687f0 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.086+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x561ca8e687f0 0x561ca8e6ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.086+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x561ca8e687f0 0x561ca8e6ac10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73fb5ab8a616620b server_cookie=6dc74ab6b6d8b51a in_seq=0 out_seq=0 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.086+0000 7fcd817fa700 10 client.25472 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcd817fa700 1 -- 172.21.15.70:0/2807735354 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561ca8d91e90 con 0x561ca8e687f0 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcd817fa700 10 client.25472 handle_command_reply: tid=0 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 client.25472 shutdown 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 -- 172.21.15.70:0/2807735354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e468d0 msgr2=0x561ca8e58df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e468d0 0x561ca8e58df0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd88097810 tx=0x7fcd8809ae50 comp rx=0 tx=0).stop 2023-10-08T08:44:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 -- 172.21.15.70:0/2807735354 shutdown_connections 2023-10-08T08:44:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e59330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e45f10 0x561ca8e588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x561ca8e687f0 0x561ca8e6ac10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2807735354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e468d0 0x561ca8e58df0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcd817fa700 0 client.25472 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 -- 172.21.15.70:0/2807735354 >> 172.21.15.70:0/2807735354 conn(0x561ca8dba2e0 msgr2=0x561ca8e40df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 -- 172.21.15.70:0/2807735354 shutdown_connections 2023-10-08T08:44:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 1 -- 172.21.15.70:0/2807735354 wait complete. 2023-10-08T08:44:25.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.087+0000 7fcdac147b80 20 client.25472 trim_cache size 0 max 16384 2023-10-08T08:44:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.111+0000 7fcdac147b80 1 Processor -- start 2023-10-08T08:44:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.111+0000 7fcdac147b80 1 -- start start 2023-10-08T08:44:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.111+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.111+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e57180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.111+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.111+0000 7fcdac147b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8c199a0 con 0x561ca8e54760 2023-10-08T08:44:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.111+0000 7fcdac147b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8d91e90 con 0x561ca8e45f10 2023-10-08T08:44:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.111+0000 7fcdac147b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8e417a0 con 0x561ca8e468d0 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9e4fb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9dcfa700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9dcfa700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39180/0 (socket says 172.21.15.70:39180) 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9e4fb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51724/0 (socket says 172.21.15.70:51724) 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9dcfa700 1 -- 172.21.15.70:0/1043456153 learned_addr learned my addr 172.21.15.70:0/1043456153 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/1043456153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e57180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9e4fb700 1 -- 172.21.15.70:0/1043456153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 msgr2=0x561ca8e57180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9e4fb700 1 --2- 172.21.15.70:0/1043456153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e57180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9e4fb700 1 -- 172.21.15.70:0/1043456153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 msgr2=0x561ca8e563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9e4fb700 1 --2- 172.21.15.70:0/1043456153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9e4fb700 1 -- 172.21.15.70:0/1043456153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ca8e6f840 con 0x561ca8e54760 2023-10-08T08:44:25.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd9e4fb700 1 --2- 172.21.15.70:0/1043456153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e576c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcd900137e0 tx=0x7fcd90013810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9776f081257630d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd8cff9700 1 -- 172.21.15.70:0/1043456153 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90004bb0 con 0x561ca8e54760 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd8cff9700 1 -- 172.21.15.70:0/1043456153 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd90004d10 con 0x561ca8e54760 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.112+0000 7fcd8cff9700 1 -- 172.21.15.70:0/1043456153 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9001e6e0 con 0x561ca8e54760 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.113+0000 7fcdac147b80 1 -- 172.21.15.70:0/1043456153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 msgr2=0x561ca8e576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.113+0000 7fcdac147b80 1 --2- 172.21.15.70:0/1043456153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e576c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcd900137e0 tx=0x7fcd90013810 comp rx=0 tx=0).stop 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.113+0000 7fcdac147b80 1 -- 172.21.15.70:0/1043456153 shutdown_connections 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.113+0000 7fcdac147b80 1 --2- 172.21.15.70:0/1043456153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e54760 0x561ca8e576c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.113+0000 7fcdac147b80 1 --2- 172.21.15.70:0/1043456153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e45f10 0x561ca8e563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.113+0000 7fcdac147b80 1 --2- 172.21.15.70:0/1043456153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e57180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.113+0000 7fcdac147b80 1 -- 172.21.15.70:0/1043456153 >> 172.21.15.70:0/1043456153 conn(0x561ca8dba2e0 msgr2=0x561ca8e64260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.113+0000 7fcdac147b80 1 -- 172.21.15.70:0/1043456153 shutdown_connections 2023-10-08T08:44:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.113+0000 7fcdac147b80 1 -- 172.21.15.70:0/1043456153 wait complete. 2023-10-08T08:44:25.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.114+0000 7fcdac147b80 1 -- start start 2023-10-08T08:44:25.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.114+0000 7fcdac147b80 1 Processor -- start 2023-10-08T08:44:25.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.114+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e45f10 0x561ca8e5ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.114+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e5efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.114+0000 7fcdac147b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e54760 0x561ca8ebc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.114+0000 7fcdac147b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8ebcb70 con 0x561ca8e45f10 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.114+0000 7fcdac147b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8ebccb0 con 0x561ca8e54760 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.114+0000 7fcdac147b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ca8ebce40 con 0x561ca8e468d0 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.114+0000 7fcdac147b80 10 client.0 _ll_register_callbacks cb 0x561ca8b92880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9dcfa700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e45f10 0x561ca8e5ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9dcfa700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e45f10 0x561ca8e5ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51728/0 (socket says 172.21.15.70:51728) 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9dcfa700 1 -- 172.21.15.70:0/2422150396 learned_addr learned my addr 172.21.15.70:0/2422150396 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9e4fb700 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e54760 0x561ca8ebc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e5efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9dcfa700 1 -- 172.21.15.70:0/2422150396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 msgr2=0x561ca8e5efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e5efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9dcfa700 1 -- 172.21.15.70:0/2422150396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e54760 msgr2=0x561ca8ebc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e54760 0x561ca8ebc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9dcfa700 1 -- 172.21.15.70:0/2422150396 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd900134c0 con 0x561ca8e45f10 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd9dcfa700 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e45f10 0x561ca8e5ea60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcd94004300 tx=0x7fcd940056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2640d2ca3c1d2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd817fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd817fa700 1 -- 172.21.15.70:0/2422150396 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9402c040 con 0x561ca8e45f10 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd817fa700 1 -- 172.21.15.70:0/2422150396 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcd94003b50 con 0x561ca8e45f10 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcdac147b80 1 -- 172.21.15.70:0/2422150396 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd94003e70 con 0x561ca8e45f10 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.115+0000 7fcd817fa700 1 -- 172.21.15.70:0/2422150396 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd94033b80 con 0x561ca8e45f10 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcdac147b80 10 client.16011 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcdac147b80 1 -- 172.21.15.70:0/2422150396 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561ca8bea2d0 con 0x561ca8e45f10 2023-10-08T08:44:25.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcd817fa700 1 -- 172.21.15.70:0/2422150396 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd94003e70 con 0x561ca8e45f10 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcd817fa700 1 -- 172.21.15.70:0/2422150396 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcd94024020 con 0x561ca8e45f10 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcdac147b80 10 client.16011 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcdac147b80 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcdac147b80 20 client.16011 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x561ca8ebe6f0 0x561ca8ec0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcdac147b80 4 client.16011 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcdac147b80 1 -- 172.21.15.70:0/2422150396 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561ca8d91bb0 con 0x561ca8ebe6f0 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.116+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x561ca8ebe6f0 0x561ca8ec0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.117+0000 7fcd817fa700 10 client.16011 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.117+0000 7fcd9d4f9700 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x561ca8ebe6f0 0x561ca8ec0b10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6182fea6b82e7be5 server_cookie=5154a20451607cd3 in_seq=0 out_seq=0 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.117+0000 7fcd817fa700 1 -- 172.21.15.70:0/2422150396 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561ca8d91bb0 con 0x561ca8ebe6f0 2023-10-08T08:44:25.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcd817fa700 10 client.16011 handle_command_reply: tid=0 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 client.16011 shutdown 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 -- 172.21.15.70:0/2422150396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e45f10 msgr2=0x561ca8e5ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e45f10 0x561ca8e5ea60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcd94004300 tx=0x7fcd940056e0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 -- 172.21.15.70:0/2422150396 shutdown_connections 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x561ca8ebe6f0 0x561ca8ec0b10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561ca8e54760 0x561ca8ebc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ca8e45f10 0x561ca8e5ea60 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 --2- 172.21.15.70:0/2422150396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ca8e468d0 0x561ca8e5efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 -- 172.21.15.70:0/2422150396 >> 172.21.15.70:0/2422150396 conn(0x561ca8dba2e0 msgr2=0x561ca8e57180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcd817fa700 0 client.16011 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 -- 172.21.15.70:0/2422150396 shutdown_connections 2023-10-08T08:44:25.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 1 -- 172.21.15.70:0/2422150396 wait complete. 2023-10-08T08:44:25.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.118+0000 7fcdac147b80 20 client.16011 trim_cache size 0 max 16384 2023-10-08T08:44:25.125 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:44:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2023-10-08T08:44:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "8bfe6914-ced8-471f-babe-1736ff2769c2", 2023-10-08T08:44:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2023-10-08T08:44:25.125 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:44:25.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd840a15f0 msgr2=0x7fcd840a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd840a15f0 0x7fcd840a3ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcd98077ab0 tx=0x7fcd94009260 comp rx=0 tx=0).stop 2023-10-08T08:44:25.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/186122012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd980fffe0 msgr2=0x7fcd9819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd980fffe0 0x7fcd9819ccd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd880059d0 tx=0x7fcd88004730 comp rx=0 tx=0).stop 2023-10-08T08:44:25.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/186122012 shutdown_connections 2023-10-08T08:44:25.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcd840a15f0 0x7fcd840a3ab0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd981056b0 0x7fcd98196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd980ff620 0x7fcd9819c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 --2- 172.21.15.70:0/186122012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd980fffe0 0x7fcd9819ccd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/186122012 >> 172.21.15.70:0/186122012 conn(0x7fcd98076780 msgr2=0x7fcd980fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/186122012 shutdown_connections 2023-10-08T08:44:25.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.119+0000 7fcd9ff5e700 1 -- 172.21.15.70:0/186122012 wait complete. 2023-10-08T08:44:25.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:44:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.270+0000 7f0ca14a0700 1 -- 172.21.15.70:0/1308792239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c106740 msgr2=0x7f0c9c106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.270+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/1308792239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c106740 0x7f0c9c106b20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009990 tx=0x7f0c8c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.271+0000 7f0ca14a0700 1 -- 172.21.15.70:0/1308792239 shutdown_connections 2023-10-08T08:44:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.271+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/1308792239 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9c1010f0 0x7f0c9c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.271+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/1308792239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c106740 0x7f0c9c106b20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.271+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/1308792239 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c9c100730 0x7f0c9c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.271+0000 7f0ca14a0700 1 -- 172.21.15.70:0/1308792239 >> 172.21.15.70:0/1308792239 conn(0x7f0c9c0fc200 msgr2=0x7f0c9c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.271+0000 7f0ca14a0700 1 -- 172.21.15.70:0/1308792239 shutdown_connections 2023-10-08T08:44:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.271+0000 7f0ca14a0700 1 -- 172.21.15.70:0/1308792239 wait complete. 2023-10-08T08:44:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.271+0000 7f0ca14a0700 1 Processor -- start 2023-10-08T08:44:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0ca14a0700 1 -- start start 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0ca14a0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c100730 0x7f0c9c19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0ca14a0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9c1010f0 0x7f0c9c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0ca14a0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c9c106740 0x7f0c9c196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0ca14a0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c197070 con 0x7f0c9c100730 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0ca14a0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c1971e0 con 0x7f0c9c1010f0 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0ca14a0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c1973a0 con 0x7f0c9c106740 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c100730 0x7f0c9c19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c100730 0x7f0c9c19c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51740/0 (socket says 172.21.15.70:51740) 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9affd700 1 -- 172.21.15.70:0/2414405974 learned_addr learned my addr 172.21.15.70:0/2414405974 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c9c106740 0x7f0c9c196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9c1010f0 0x7f0c9c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9affd700 1 -- 172.21.15.70:0/2414405974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c9c106740 msgr2=0x7f0c9c196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9affd700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c9c106740 0x7f0c9c196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9affd700 1 -- 172.21.15.70:0/2414405974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9c1010f0 msgr2=0x7f0c9c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9affd700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9c1010f0 0x7f0c9c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.272+0000 7f0c9affd700 1 -- 172.21.15.70:0/2414405974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c94009c40 con 0x7f0c9c100730 2023-10-08T08:44:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.273+0000 7f0c9affd700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c100730 0x7f0c9c19c8e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c000c00 tx=0x7f0c8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.273+0000 7f0c83fff700 1 -- 172.21.15.70:0/2414405974 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c01d070 con 0x7f0c9c100730 2023-10-08T08:44:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.273+0000 7f0ca14a0700 1 -- 172.21.15.70:0/2414405974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c0095f0 con 0x7f0c9c100730 2023-10-08T08:44:25.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.273+0000 7f0ca14a0700 1 -- 172.21.15.70:0/2414405974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c1a36f0 con 0x7f0c9c100730 2023-10-08T08:44:25.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.273+0000 7f0c83fff700 1 -- 172.21.15.70:0/2414405974 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c8c022470 con 0x7f0c9c100730 2023-10-08T08:44:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.273+0000 7f0c83fff700 1 -- 172.21.15.70:0/2414405974 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c017650 con 0x7f0c9c100730 2023-10-08T08:44:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.275+0000 7f0c83fff700 1 -- 172.21.15.70:0/2414405974 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0c8c00fa80 con 0x7f0c9c100730 2023-10-08T08:44:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.276+0000 7f0c83fff700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0c840a15f0 0x7f0c840a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.276+0000 7f0c83fff700 1 -- 172.21.15.70:0/2414405974 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0c8c0ce3e0 con 0x7f0c9c100730 2023-10-08T08:44:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.276+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0c840a15f0 0x7f0c840a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.276+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0c840a15f0 0x7f0c840a3ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c197bd0 tx=0x7f0c90009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0cad689b80 1 Processor -- start 2023-10-08T08:44:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0cad689b80 1 -- start start 2023-10-08T08:44:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b340587e80 0x55b340588260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3405887a0 0x55b340593110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340593650 0x55b340595a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0cad689b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3404f1460 con 0x55b340593650 2023-10-08T08:44:25.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0cad689b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3404e2c20 con 0x55b340587e80 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0cad689b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3404e0540 con 0x55b3405887a0 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340593650 0x55b340595a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340593650 0x55b340595a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51752/0 (socket says 172.21.15.70:51752) 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/2923511297 learned_addr learned my addr 172.21.15.70:0/2923511297 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.278+0000 7f0c9affd700 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b340587e80 0x55b340588260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3405887a0 0x55b340593110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/2923511297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3405887a0 msgr2=0x55b340593110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3405887a0 0x55b340593110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/2923511297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b340587e80 msgr2=0x55b340588260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b340587e80 0x55b340588260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/2923511297 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b340306de0 con 0x55b340593650 2023-10-08T08:44:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3405887a0 0x55b340593110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340593650 0x55b340595a40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400e730 tx=0x7f0c94009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b7b477fc754552 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c817fa700 1 -- 172.21.15.70:0/2923511297 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400e040 con 0x55b340593650 2023-10-08T08:44:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c817fa700 1 -- 172.21.15.70:0/2923511297 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c9400f040 con 0x55b340593650 2023-10-08T08:44:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.279+0000 7f0c817fa700 1 -- 172.21.15.70:0/2923511297 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94007500 con 0x55b340593650 2023-10-08T08:44:25.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 -- 172.21.15.70:0/2923511297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340593650 msgr2=0x55b340595a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340593650 0x55b340595a40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400e730 tx=0x7f0c94009920 comp rx=0 tx=0).stop 2023-10-08T08:44:25.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 -- 172.21.15.70:0/2923511297 shutdown_connections 2023-10-08T08:44:25.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340593650 0x55b340595a40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b340587e80 0x55b340588260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 --2- 172.21.15.70:0/2923511297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3405887a0 0x55b340593110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 -- 172.21.15.70:0/2923511297 >> 172.21.15.70:0/2923511297 conn(0x55b3404fd260 msgr2=0x55b3405842d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 -- 172.21.15.70:0/2923511297 shutdown_connections 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 -- 172.21.15.70:0/2923511297 wait complete. 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.280+0000 7f0cad689b80 1 -- start start 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0cad689b80 1 Processor -- start 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340587e80 0x55b340592f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3405887a0 0x55b340590250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340593650 0x55b3405907f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0cad689b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3404dbe30 con 0x55b340587e80 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0cad689b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b340478710 con 0x55b3405887a0 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0cad689b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3404783b0 con 0x55b340593650 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0cad689b80 10 client.0 _ll_register_callbacks cb 0x55b3402d5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0c9affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340587e80 0x55b340592f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0c9affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340587e80 0x55b340592f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51754/0 (socket says 172.21.15.70:51754) 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0c9affd700 1 -- 172.21.15.70:0/4197152125 learned_addr learned my addr 172.21.15.70:0/4197152125 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340593650 0x55b3405907f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0c9affd700 1 -- 172.21.15.70:0/4197152125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340593650 msgr2=0x55b3405907f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0c9affd700 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340593650 0x55b3405907f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0c9affd700 1 -- 172.21.15.70:0/4197152125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3405887a0 msgr2=0x55b340590250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0c9affd700 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3405887a0 0x55b340590250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.281+0000 7f0c9affd700 1 -- 172.21.15.70:0/4197152125 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9400e410 con 0x55b340587e80 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.282+0000 7f0c9affd700 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340587e80 0x55b340592f60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0095c0 tx=0x7f0c8c09ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86eddb8638195cae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.282+0000 7f0c7eff5700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.282+0000 7f0c7eff5700 1 -- 172.21.15.70:0/4197152125 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c0ce280 con 0x55b340587e80 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.282+0000 7f0c7eff5700 1 -- 172.21.15.70:0/4197152125 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0c8c09b920 con 0x55b340587e80 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.282+0000 7f0cad689b80 1 -- 172.21.15.70:0/4197152125 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3404a3eb0 con 0x55b340587e80 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.282+0000 7f0c7eff5700 1 -- 172.21.15.70:0/4197152125 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c8c09b220 con 0x55b340587e80 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.282+0000 7f0cad689b80 10 client.16023 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:25.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.282+0000 7f0cad689b80 1 -- 172.21.15.70:0/4197152125 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b3402efc60 con 0x55b340587e80 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.282+0000 7f0c7eff5700 1 -- 172.21.15.70:0/4197152125 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b3404a3eb0 con 0x55b340587e80 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0c7eff5700 1 -- 172.21.15.70:0/4197152125 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0c8c0b92a0 con 0x55b340587e80 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0cad689b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0cad689b80 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0cad689b80 20 client.16023 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0cad689b80 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b3405a2d90 0x55b3405a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0cad689b80 4 client.16023 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0cad689b80 1 -- 172.21.15.70:0/4197152125 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b3404d4e10 con 0x55b3405a2d90 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b3405a2d90 0x55b3405a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0c7eff5700 10 client.16023 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.283+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b3405a2d90 0x55b3405a51b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81057e631b458181 server_cookie=8db363d6c1f3fc65 in_seq=0 out_seq=0 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0c7eff5700 1 -- 172.21.15.70:0/4197152125 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b3404d4e10 con 0x55b3405a2d90 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0c7eff5700 10 client.16023 handle_command_reply: tid=0 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 client.16023 shutdown 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 -- 172.21.15.70:0/4197152125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340587e80 msgr2=0x55b340592f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340587e80 0x55b340592f60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0095c0 tx=0x7f0c8c09ae80 comp rx=0 tx=0).stop 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 -- 172.21.15.70:0/4197152125 shutdown_connections 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340593650 0x55b3405907f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b340587e80 0x55b340592f60 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b3405a2d90 0x55b3405a51b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 --2- 172.21.15.70:0/4197152125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3405887a0 0x55b340590250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 -- 172.21.15.70:0/4197152125 >> 172.21.15.70:0/4197152125 conn(0x55b3404fd260 msgr2=0x55b340583ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0c7eff5700 0 client.16023 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:25.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 -- 172.21.15.70:0/4197152125 shutdown_connections 2023-10-08T08:44:25.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 1 -- 172.21.15.70:0/4197152125 wait complete. 2023-10-08T08:44:25.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.284+0000 7f0cad689b80 20 client.16023 trim_cache size 0 max 16384 2023-10-08T08:44:25.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.313+0000 7f0cad689b80 1 Processor -- start 2023-10-08T08:44:25.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.313+0000 7f0cad689b80 1 -- start start 2023-10-08T08:44:25.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.313+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.313+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 0x55b34059e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.313+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b34059ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.313+0000 7f0cad689b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b34035c920 con 0x55b3405887a0 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.313+0000 7f0cad689b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b34058b0e0 con 0x55b3404fd260 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.313+0000 7f0cad689b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b340584ed0 con 0x55b340587e80 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.313+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b34059ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b34059ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51766/0 (socket says 172.21.15.70:51766) 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/3484309869 learned_addr learned my addr 172.21.15.70:0/3484309869 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9affd700 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 0x55b34059e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/3484309869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 msgr2=0x55b34059e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 0x55b34059e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/3484309869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 msgr2=0x55b34059a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/3484309869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b34032d250 con 0x55b3405887a0 2023-10-08T08:44:25.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9affd700 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:25.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b34059ee70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400e700 tx=0x7f0c94006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eca0e10eb9b7735 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c81ffb700 1 -- 172.21.15.70:0/3484309869 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400e040 con 0x55b3405887a0 2023-10-08T08:44:25.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c81ffb700 1 -- 172.21.15.70:0/3484309869 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c94004b50 con 0x55b3405887a0 2023-10-08T08:44:25.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.314+0000 7f0c81ffb700 1 -- 172.21.15.70:0/3484309869 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94004310 con 0x55b3405887a0 2023-10-08T08:44:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 -- 172.21.15.70:0/3484309869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 msgr2=0x55b34059ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b34059ee70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400e700 tx=0x7f0c94006000 comp rx=0 tx=0).stop 2023-10-08T08:44:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 -- 172.21.15.70:0/3484309869 shutdown_connections 2023-10-08T08:44:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b34059ee70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 --2- 172.21.15.70:0/3484309869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 0x55b34059e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 -- 172.21.15.70:0/3484309869 >> 172.21.15.70:0/3484309869 conn(0x55b3405802a0 msgr2=0x55b34058eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 -- 172.21.15.70:0/3484309869 shutdown_connections 2023-10-08T08:44:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 -- 172.21.15.70:0/3484309869 wait complete. 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.315+0000 7f0cad689b80 1 -- start start 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0cad689b80 1 Processor -- start 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 0x55b3405985b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0cad689b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b340598b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0cad689b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b340599240 con 0x55b3405887a0 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0cad689b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3405993b0 con 0x55b3404fd260 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0cad689b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3405f6bf0 con 0x55b340587e80 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0cad689b80 10 client.0 _ll_register_callbacks cb 0x7f0c8c00b2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b340598b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b340598b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51772/0 (socket says 172.21.15.70:51772) 2023-10-08T08:44:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9affd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/1464301180 learned_addr learned my addr 172.21.15.70:0/1464301180 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 0x55b3405985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/1464301180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 msgr2=0x55b3405985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 0x55b3405985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/1464301180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 msgr2=0x55b34059a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.316+0000 7f0c9b7fe700 1 -- 172.21.15.70:0/1464301180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3402efc60 con 0x55b3405887a0 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0c9a7fc700 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 0x55b3405985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0c9affd700 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0c9b7fe700 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b340598b30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400ed20 tx=0x7f0c94004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d612741952fc3f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0c7eff5700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0c7eff5700 1 -- 172.21.15.70:0/1464301180 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94007910 con 0x55b3405887a0 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0c7eff5700 1 -- 172.21.15.70:0/1464301180 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0c94007a70 con 0x55b3405887a0 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0cad689b80 1 -- 172.21.15.70:0/1464301180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c9400f040 con 0x55b3405887a0 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0c7eff5700 1 -- 172.21.15.70:0/1464301180 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c94003c70 con 0x55b3405887a0 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0cad689b80 10 client.16029 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0cad689b80 1 -- 172.21.15.70:0/1464301180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b340306de0 con 0x55b3405887a0 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0c7eff5700 1 -- 172.21.15.70:0/1464301180 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c9400f040 con 0x55b3405887a0 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.317+0000 7f0c7eff5700 1 -- 172.21.15.70:0/1464301180 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0c94028430 con 0x55b3405887a0 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0cad689b80 10 client.16029 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0cad689b80 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0cad689b80 20 client.16029 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0cad689b80 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b340593650 0x55b3405fa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0cad689b80 4 client.16029 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:44:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0cad689b80 1 -- 172.21.15.70:0/1464301180 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b3404d4b30 con 0x55b340593650 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0c9affd700 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b340593650 0x55b3405fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0c7eff5700 10 client.16029 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0c9affd700 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b340593650 0x55b3405fa040 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebbb5c57046cfa16 server_cookie=81b1e18e83d96f45 in_seq=0 out_seq=0 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0c7eff5700 1 -- 172.21.15.70:0/1464301180 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b3404d4b30 con 0x55b340593650 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0c7eff5700 10 client.16029 handle_command_reply: tid=0 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.318+0000 7f0cad689b80 1 client.16029 shutdown 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 -- 172.21.15.70:0/1464301180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 msgr2=0x55b340598b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b340598b30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400ed20 tx=0x7f0c94004f60 comp rx=0 tx=0).stop 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 -- 172.21.15.70:0/1464301180 shutdown_connections 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b3405887a0 0x55b340598b30 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b340593650 0x55b3405fa040 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3404fd260 0x55b34059a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 --2- 172.21.15.70:0/1464301180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b340587e80 0x55b3405985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 -- 172.21.15.70:0/1464301180 >> 172.21.15.70:0/1464301180 conn(0x55b3405802a0 msgr2=0x55b34059e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0c7eff5700 0 client.16029 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:25.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 -- 172.21.15.70:0/1464301180 shutdown_connections 2023-10-08T08:44:25.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 1 -- 172.21.15.70:0/1464301180 wait complete. 2023-10-08T08:44:25.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0cad689b80 20 client.16029 trim_cache size 0 max 16384 2023-10-08T08:44:25.326 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:44:25.326 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T08:44:25.326 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2023-10-08T08:44:25.326 INFO:teuthology.orchestra.run.smithi070.stdout: "8bfe6914-ced8-471f-babe-1736ff2769c2": { 2023-10-08T08:44:25.327 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2023-10-08T08:44:25.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "8bfe6914-ced8-471f-babe-1736ff2769c2", 2023-10-08T08:44:25.327 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2023-10-08T08:44:25.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:44:25.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:44:25.327 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 -- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0c840a15f0 msgr2=0x7f0c840a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0c840a15f0 0x7f0c840a3ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c197bd0 tx=0x7f0c90009260 comp rx=0 tx=0).stop 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 -- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c100730 msgr2=0x7f0c9c19c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c100730 0x7f0c9c19c8e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c000c00 tx=0x7f0c8c004730 comp rx=0 tx=0).stop 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 -- 172.21.15.70:0/2414405974 shutdown_connections 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0c840a15f0 0x7f0c840a3ab0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c9c106740 0x7f0c9c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c9c100730 0x7f0c9c19c8e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 --2- 172.21.15.70:0/2414405974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9c1010f0 0x7f0c9c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.319+0000 7f0ca14a0700 1 -- 172.21.15.70:0/2414405974 >> 172.21.15.70:0/2414405974 conn(0x7f0c9c0fc200 msgr2=0x7f0c9c0fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.320+0000 7f0ca14a0700 1 -- 172.21.15.70:0/2414405974 shutdown_connections 2023-10-08T08:44:25.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:25.320+0000 7f0ca14a0700 1 -- 172.21.15.70:0/2414405974 wait complete. 2023-10-08T08:44:25.336 INFO:tasks.cephfs.filesystem:scrub status for tag:8bfe6914-ced8-471f-babe-1736ff2769c2 - {'path': '/', 'tag': '8bfe6914-ced8-471f-babe-1736ff2769c2', 'options': 'recursive,force'} 2023-10-08T08:44:26.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:26 smithi070 ceph-mon[99513]: pgmap v309: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-08T08:44:26.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:26 smithi070 ceph-mon[99513]: scrub queued for path: / 2023-10-08T08:44:26.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:26 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:44:26.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:26 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:44:26.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:26 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:44:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:26 smithi105 ceph-mon[103798]: pgmap v309: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-08T08:44:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:26 smithi105 ceph-mon[103798]: scrub queued for path: / 2023-10-08T08:44:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:26 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:44:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:26 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:44:26.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:26 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:44:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:26 smithi191 ceph-mon[104220]: pgmap v309: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-08T08:44:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:26 smithi191 ceph-mon[104220]: scrub queued for path: / 2023-10-08T08:44:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:26 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:44:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:26 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:44:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:26 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:44:28.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:28 smithi070 ceph-mon[99513]: pgmap v310: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T08:44:28.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:28 smithi105 ceph-mon[103798]: pgmap v310: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T08:44:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:28 smithi191 ceph-mon[104220]: pgmap v310: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T08:44:30.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:30 smithi070 ceph-mon[99513]: pgmap v311: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T08:44:30.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:30 smithi070 ceph-mon[99513]: scrub summary: idle 2023-10-08T08:44:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:30 smithi105 ceph-mon[103798]: pgmap v311: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T08:44:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:30 smithi105 ceph-mon[103798]: scrub summary: idle 2023-10-08T08:44:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:30 smithi191 ceph-mon[104220]: pgmap v311: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T08:44:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:30 smithi191 ceph-mon[104220]: scrub summary: idle 2023-10-08T08:44:32.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:32 smithi070 ceph-mon[99513]: pgmap v312: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 682 B/s wr, 12 op/s 2023-10-08T08:44:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:32 smithi105 ceph-mon[103798]: pgmap v312: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 682 B/s wr, 12 op/s 2023-10-08T08:44:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:32 smithi191 ceph-mon[104220]: pgmap v312: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 682 B/s wr, 12 op/s 2023-10-08T08:44:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.336+0000 7f299189f700 1 -- 172.21.15.70:0/896846823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c0ff290 msgr2=0x7f298c0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.336+0000 7f299189f700 1 --2- 172.21.15.70:0/896846823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c0ff290 0x7f298c0ff670 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f297c009990 tx=0x7f297c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.336+0000 7f299189f700 1 -- 172.21.15.70:0/896846823 shutdown_connections 2023-10-08T08:44:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.336+0000 7f299189f700 1 --2- 172.21.15.70:0/896846823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f298c104130 0x7f298c10bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.336+0000 7f299189f700 1 --2- 172.21.15.70:0/896846823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c0ff290 0x7f298c0ff670 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.337+0000 7f299189f700 1 --2- 172.21.15.70:0/896846823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f298c0ffc40 0x7f298c103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.337+0000 7f299189f700 1 -- 172.21.15.70:0/896846823 >> 172.21.15.70:0/896846823 conn(0x7f298c074970 msgr2=0x7f298c074d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:33.338 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.337+0000 7f299189f700 1 -- 172.21.15.70:0/896846823 shutdown_connections 2023-10-08T08:44:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.337+0000 7f299189f700 1 -- 172.21.15.70:0/896846823 wait complete. 2023-10-08T08:44:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.337+0000 7f299189f700 1 Processor -- start 2023-10-08T08:44:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f299189f700 1 -- start start 2023-10-08T08:44:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f299189f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f298c0ff290 0x7f298c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f299189f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c104130 0x7f298c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f299189f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f298c1947d0 0x7f298c194c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f299189f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c195250 con 0x7f298c104130 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f299189f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c195390 con 0x7f298c0ff290 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f299189f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c195550 con 0x7f298c1947d0 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f298a7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c104130 0x7f298c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f298a7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c104130 0x7f298c19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51784/0 (socket says 172.21.15.70:51784) 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f298a7fc700 1 -- 172.21.15.70:0/3977266502 learned_addr learned my addr 172.21.15.70:0/3977266502 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f298affd700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f298c0ff290 0x7f298c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f298b7fe700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f298c1947d0 0x7f298c194c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f298a7fc700 1 -- 172.21.15.70:0/3977266502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f298c1947d0 msgr2=0x7f298c194c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f298a7fc700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f298c1947d0 0x7f298c194c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.338+0000 7f298a7fc700 1 -- 172.21.15.70:0/3977266502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f298c0ff290 msgr2=0x7f298c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.339+0000 7f298a7fc700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f298c0ff290 0x7f298c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.339+0000 7f298a7fc700 1 -- 172.21.15.70:0/3977266502 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0095f0 con 0x7f298c104130 2023-10-08T08:44:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.339+0000 7f298a7fc700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c104130 0x7f298c19abe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f298000d980 tx=0x7f298000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.339+0000 7f299089d700 1 -- 172.21.15.70:0/3977266502 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298000f890 con 0x7f298c104130 2023-10-08T08:44:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.339+0000 7f299189f700 1 -- 172.21.15.70:0/3977266502 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c1a5920 con 0x7f298c104130 2023-10-08T08:44:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.339+0000 7f299089d700 1 -- 172.21.15.70:0/3977266502 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2980010460 con 0x7f298c104130 2023-10-08T08:44:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.339+0000 7f299089d700 1 -- 172.21.15.70:0/3977266502 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298000e610 con 0x7f298c104130 2023-10-08T08:44:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.339+0000 7f299189f700 1 -- 172.21.15.70:0/3977266502 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c1a5e80 con 0x7f298c104130 2023-10-08T08:44:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.344+0000 7f299da88b80 1 Processor -- start 2023-10-08T08:44:33.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f299089d700 1 -- 172.21.15.70:0/3977266502 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f29800105d0 con 0x7f298c104130 2023-10-08T08:44:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f299da88b80 1 -- start start 2023-10-08T08:44:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f299da88b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d457b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f299da88b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 0x5644d457fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f299da88b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d4580230 0x5644d4580690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f299da88b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d44db400 con 0x5644d457be90 2023-10-08T08:44:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f299da88b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d44ccbc0 con 0x5644d457b570 2023-10-08T08:44:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f299da88b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d44ca4e0 con 0x5644d4580230 2023-10-08T08:44:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f298affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 0x5644d457fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f298affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 0x5644d457fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51792/0 (socket says 172.21.15.70:51792) 2023-10-08T08:44:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f298affd700 1 -- 172.21.15.70:0/2476485155 learned_addr learned my addr 172.21.15.70:0/2476485155 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.346+0000 7f298b7fe700 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d457b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f298a7fc700 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d4580230 0x5644d4580690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f298b7fe700 1 -- 172.21.15.70:0/2476485155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d4580230 msgr2=0x5644d4580690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f298b7fe700 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d4580230 0x5644d4580690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f298b7fe700 1 -- 172.21.15.70:0/2476485155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 msgr2=0x5644d457fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f298b7fe700 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 0x5644d457fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f298b7fe700 1 -- 172.21.15.70:0/2476485155 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644d42f0d80 con 0x5644d457b570 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f298affd700 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 0x5644d457fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f298a7fc700 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d4580230 0x5644d4580690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f299089d700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f29740a15e0 0x7f29740a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f298b7fe700 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d457b950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2984009290 tx=0x7f2984009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81dfb4d084334688 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f299089d700 1 -- 172.21.15.70:0/3977266502 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f29800ce1e0 con 0x7f298c104130 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.347+0000 7f2971ffb700 1 -- 172.21.15.70:0/2476485155 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984007bf0 con 0x5644d457b570 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.348+0000 7f2971ffb700 1 -- 172.21.15.70:0/2476485155 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2984007d50 con 0x5644d457b570 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.348+0000 7f298affd700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f29740a15e0 0x7f29740a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.348+0000 7f2971ffb700 1 -- 172.21.15.70:0/2476485155 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984014db0 con 0x5644d457b570 2023-10-08T08:44:33.353 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.348+0000 7f298affd700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f29740a15e0 0x7f29740a3aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f297c009990 tx=0x7f297c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.348+0000 7f299da88b80 1 -- 172.21.15.70:0/2476485155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 msgr2=0x5644d457b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.348+0000 7f299da88b80 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d457b950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2984009290 tx=0x7f2984009920 comp rx=0 tx=0).stop 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.349+0000 7f299da88b80 1 -- 172.21.15.70:0/2476485155 shutdown_connections 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.349+0000 7f299da88b80 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d4580230 0x5644d4580690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.349+0000 7f299da88b80 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d457b950 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.349+0000 7f299da88b80 1 --2- 172.21.15.70:0/2476485155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 0x5644d457fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.349+0000 7f299da88b80 1 -- 172.21.15.70:0/2476485155 >> 172.21.15.70:0/2476485155 conn(0x5644d44e7200 msgr2=0x5644d456db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.349+0000 7f299da88b80 1 -- 172.21.15.70:0/2476485155 shutdown_connections 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.349+0000 7f299da88b80 1 -- 172.21.15.70:0/2476485155 wait complete. 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.349+0000 7f299da88b80 1 -- start start 2023-10-08T08:44:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.349+0000 7f299da88b80 1 Processor -- start 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f299da88b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d45879a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f299da88b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 0x5644d4584c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f299da88b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d4580230 0x5644d45852c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f299da88b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d44c5dd0 con 0x5644d457be90 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f299da88b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d44626b0 con 0x5644d4580230 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f299da88b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d4462350 con 0x5644d457b570 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f299da88b80 10 client.0 _ll_register_callbacks cb 0x5644d42bf7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f298affd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d45879a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f298affd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d45879a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:39374/0 (socket says 172.21.15.70:39374) 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f298affd700 1 -- 172.21.15.70:0/2503438839 learned_addr learned my addr 172.21.15.70:0/2503438839 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f298b7fe700 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d4580230 0x5644d45852c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.355 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f298affd700 1 -- 172.21.15.70:0/2503438839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d4580230 msgr2=0x5644d45852c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f298affd700 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d4580230 0x5644d45852c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f298affd700 1 -- 172.21.15.70:0/2503438839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 msgr2=0x5644d4584c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f298affd700 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 0x5644d4584c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.350+0000 7f298affd700 1 -- 172.21.15.70:0/2503438839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c10c500 con 0x5644d457b570 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f298b7fe700 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d4580230 0x5644d45852c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f298affd700 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d45879a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b2e0 tx=0x7f297c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=937b16379df5355d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f296affd700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f296affd700 1 -- 172.21.15.70:0/2503438839 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c026660 con 0x5644d457b570 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f299da88b80 1 -- 172.21.15.70:0/2503438839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644d448de50 con 0x5644d457b570 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f296affd700 1 -- 172.21.15.70:0/2503438839 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f297c004e80 con 0x5644d457b570 2023-10-08T08:44:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f296affd700 1 -- 172.21.15.70:0/2503438839 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f297c0267c0 con 0x5644d457b570 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f299da88b80 10 client.25492 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f299da88b80 1 -- 172.21.15.70:0/2503438839 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f298400d040 con 0x5644d457b570 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.351+0000 7f296affd700 1 -- 172.21.15.70:0/2503438839 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5644d448de50 con 0x5644d457b570 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.352+0000 7f296affd700 1 -- 172.21.15.70:0/2503438839 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f297c00f840 con 0x5644d457b570 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.352+0000 7f299da88b80 10 client.25492 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.352+0000 7f299da88b80 10 client.25492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.352+0000 7f299da88b80 20 client.25492 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.352+0000 7f299da88b80 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5644d4595310 0x5644d4597730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.352+0000 7f299da88b80 4 client.25492 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.352+0000 7f299da88b80 1 -- 172.21.15.70:0/2503438839 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644d44bedb0 con 0x5644d4595310 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.352+0000 7f298a7fc700 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5644d4595310 0x5644d4597730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.353+0000 7f296affd700 10 client.25492 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.353+0000 7f298a7fc700 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5644d4595310 0x5644d4597730 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2e0736ccff58d4e server_cookie=d4b3d15d0020868d in_seq=0 out_seq=0 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.353+0000 7f296affd700 1 -- 172.21.15.70:0/2503438839 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5644d44bedb0 con 0x5644d4595310 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.353+0000 7f296affd700 10 client.25492 handle_command_reply: tid=0 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.353+0000 7f299da88b80 1 client.25492 shutdown 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 -- 172.21.15.70:0/2503438839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 msgr2=0x5644d45879a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d45879a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b2e0 tx=0x7f297c009310 comp rx=0 tx=0).stop 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 -- 172.21.15.70:0/2503438839 shutdown_connections 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5644d4595310 0x5644d4597730 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d4580230 0x5644d45852c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d45879a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 --2- 172.21.15.70:0/2503438839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d457be90 0x5644d4584c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 -- 172.21.15.70:0/2503438839 >> 172.21.15.70:0/2503438839 conn(0x5644d44e7200 msgr2=0x5644d4571b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f296affd700 0 client.25492 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 -- 172.21.15.70:0/2503438839 shutdown_connections 2023-10-08T08:44:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 1 -- 172.21.15.70:0/2503438839 wait complete. 2023-10-08T08:44:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.354+0000 7f299da88b80 20 client.25492 trim_cache size 0 max 16384 2023-10-08T08:44:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.381+0000 7f299da88b80 1 Processor -- start 2023-10-08T08:44:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.381+0000 7f299da88b80 1 -- start start 2023-10-08T08:44:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f299da88b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d456d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f299da88b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457be90 0x5644d4590bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f299da88b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 0x5644d4591110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f299da88b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d43468c0 con 0x5644d4580230 2023-10-08T08:44:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f299da88b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d448de50 con 0x5644d457be90 2023-10-08T08:44:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f299da88b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d457c2c0 con 0x5644d457b570 2023-10-08T08:44:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 0x5644d4591110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298affd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d456d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 0x5644d4591110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51808/0 (socket says 172.21.15.70:51808) 2023-10-08T08:44:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298b7fe700 1 -- 172.21.15.70:0/4208381626 learned_addr learned my addr 172.21.15.70:0/4208381626 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298a7fc700 1 --2- 172.21.15.70:0/4208381626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457be90 0x5644d4590bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298affd700 1 -- 172.21.15.70:0/4208381626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457be90 msgr2=0x5644d4590bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298affd700 1 --2- 172.21.15.70:0/4208381626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457be90 0x5644d4590bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298affd700 1 -- 172.21.15.70:0/4208381626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 msgr2=0x5644d4591110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298affd700 1 --2- 172.21.15.70:0/4208381626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 0x5644d4591110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.382+0000 7f298affd700 1 -- 172.21.15.70:0/4208381626 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644d42d9c00 con 0x5644d457b570 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.383+0000 7f298affd700 1 --2- 172.21.15.70:0/4208381626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d456d790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b690 tx=0x7f297c00bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c46ec9117b9540 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.383+0000 7f29727fc700 1 -- 172.21.15.70:0/4208381626 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c004e80 con 0x5644d457b570 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.383+0000 7f29727fc700 1 -- 172.21.15.70:0/4208381626 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f297c01e040 con 0x5644d457b570 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.383+0000 7f29727fc700 1 -- 172.21.15.70:0/4208381626 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c026bf0 con 0x5644d457b570 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 -- 172.21.15.70:0/4208381626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 msgr2=0x5644d456d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 --2- 172.21.15.70:0/4208381626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d456d790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f297c00b690 tx=0x7f297c00bef0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 -- 172.21.15.70:0/4208381626 shutdown_connections 2023-10-08T08:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 --2- 172.21.15.70:0/4208381626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 0x5644d4591110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 --2- 172.21.15.70:0/4208381626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457b570 0x5644d456d790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 --2- 172.21.15.70:0/4208381626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457be90 0x5644d4590bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 -- 172.21.15.70:0/4208381626 >> 172.21.15.70:0/4208381626 conn(0x5644d44e7200 msgr2=0x5644d4583560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 -- 172.21.15.70:0/4208381626 shutdown_connections 2023-10-08T08:44:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 -- 172.21.15.70:0/4208381626 wait complete. 2023-10-08T08:44:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.384+0000 7f299da88b80 1 -- start start 2023-10-08T08:44:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f299da88b80 1 Processor -- start 2023-10-08T08:44:33.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f299da88b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d458a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f299da88b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457be90 0x5644d458a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f299da88b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 0x5644d458aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f299da88b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d45e8180 con 0x5644d4580230 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f299da88b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d45e82f0 con 0x5644d457b570 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f299da88b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644d45e84b0 con 0x5644d457be90 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f299da88b80 10 client.0 _ll_register_callbacks cb 0x7f297c00ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f298affd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d458a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f298affd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d458a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39268/0 (socket says 172.21.15.70:39268) 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.385+0000 7f298affd700 1 -- 172.21.15.70:0/2457044638 learned_addr learned my addr 172.21.15.70:0/2457044638 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f298a7fc700 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457be90 0x5644d458a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f298affd700 1 -- 172.21.15.70:0/2457044638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457be90 msgr2=0x5644d458a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f298affd700 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457be90 0x5644d458a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f298affd700 1 -- 172.21.15.70:0/2457044638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 msgr2=0x5644d458aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f298affd700 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 0x5644d458aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f298affd700 1 -- 172.21.15.70:0/2457044638 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298400d040 con 0x5644d457b570 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f298affd700 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d458a460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f297c005f50 tx=0x7f297c009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5842d1cc34adabbf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f296affd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f296affd700 1 -- 172.21.15.70:0/2457044638 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c046070 con 0x5644d457b570 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f299da88b80 1 -- 172.21.15.70:0/2457044638 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2984007d50 con 0x5644d457b570 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f296affd700 1 -- 172.21.15.70:0/2457044638 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f297c00f670 con 0x5644d457b570 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f296affd700 1 -- 172.21.15.70:0/2457044638 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f297c00f870 con 0x5644d457b570 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f299da88b80 10 client.25508 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.386+0000 7f299da88b80 1 -- 172.21.15.70:0/2457044638 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5644d43171f0 con 0x5644d457b570 2023-10-08T08:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.387+0000 7f296affd700 1 -- 172.21.15.70:0/2457044638 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2984007d50 con 0x5644d457b570 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.387+0000 7f296affd700 1 -- 172.21.15.70:0/2457044638 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f297c0249f0 con 0x5644d457b570 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.387+0000 7f299da88b80 10 client.25508 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.387+0000 7f299da88b80 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.387+0000 7f299da88b80 20 client.25508 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.387+0000 7f299da88b80 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5644d45e9860 0x5644d45ebc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.387+0000 7f299da88b80 4 client.25508 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.387+0000 7f299da88b80 1 -- 172.21.15.70:0/2457044638 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5644d44bead0 con 0x5644d45e9860 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.387+0000 7f298a7fc700 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5644d45e9860 0x5644d45ebc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.388+0000 7f296affd700 10 client.25508 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:33.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.388+0000 7f298a7fc700 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5644d45e9860 0x5644d45ebc80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc81a940d719fe57 server_cookie=db1186c14b0969a2 in_seq=0 out_seq=0 2023-10-08T08:44:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f296affd700 1 -- 172.21.15.70:0/2457044638 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5644d44bead0 con 0x5644d45e9860 2023-10-08T08:44:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f296affd700 10 client.25508 handle_command_reply: tid=0 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 client.25508 shutdown 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 -- 172.21.15.70:0/2457044638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 msgr2=0x5644d458a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d458a460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f297c005f50 tx=0x7f297c009300 comp rx=0 tx=0).stop 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 -- 172.21.15.70:0/2457044638 shutdown_connections 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644d4580230 0x5644d458aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5644d45e9860 0x5644d45ebc80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644d457b570 0x5644d458a460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f296affd700 0 client.25508 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 --2- 172.21.15.70:0/2457044638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5644d457be90 0x5644d458a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 -- 172.21.15.70:0/2457044638 >> 172.21.15.70:0/2457044638 conn(0x5644d44e7200 msgr2=0x5644d457f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 -- 172.21.15.70:0/2457044638 shutdown_connections 2023-10-08T08:44:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.397+0000 7f299da88b80 1 -- 172.21.15.70:0/2457044638 wait complete. 2023-10-08T08:44:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299da88b80 20 client.25508 trim_cache size 0 max 16384 2023-10-08T08:44:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:44:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:44:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:44:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 -- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f29740a15e0 msgr2=0x7f29740a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f29740a15e0 0x7f29740a3aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f297c009990 tx=0x7f297c005960 comp rx=0 tx=0).stop 2023-10-08T08:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 -- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c104130 msgr2=0x7f298c19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c104130 0x7f298c19abe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f298000d980 tx=0x7f298000dc90 comp rx=0 tx=0).stop 2023-10-08T08:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 -- 172.21.15.70:0/3977266502 shutdown_connections 2023-10-08T08:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f29740a15e0 0x7f29740a3aa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f298c1947d0 0x7f298c194c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f298c0ff290 0x7f298c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 --2- 172.21.15.70:0/3977266502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f298c104130 0x7f298c19abe0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.398+0000 7f299189f700 1 -- 172.21.15.70:0/3977266502 >> 172.21.15.70:0/3977266502 conn(0x7f298c074970 msgr2=0x7f298c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.399+0000 7f299189f700 1 -- 172.21.15.70:0/3977266502 shutdown_connections 2023-10-08T08:44:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:33.399+0000 7f299189f700 1 -- 172.21.15.70:0/3977266502 wait complete. 2023-10-08T08:44:34.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:34 smithi070 ceph-mon[99513]: pgmap v313: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2023-10-08T08:44:34.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:34 smithi105 ceph-mon[103798]: pgmap v313: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2023-10-08T08:44:34.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:34 smithi191 ceph-mon[104220]: pgmap v313: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2023-10-08T08:44:36.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:36 smithi070 ceph-mon[99513]: pgmap v314: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2023-10-08T08:44:36.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:36 smithi105 ceph-mon[103798]: pgmap v314: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2023-10-08T08:44:36.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:36 smithi191 ceph-mon[104220]: pgmap v314: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2023-10-08T08:44:38.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:38 smithi070 ceph-mon[99513]: pgmap v315: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T08:44:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:38 smithi105 ceph-mon[103798]: pgmap v315: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T08:44:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:38 smithi191 ceph-mon[104220]: pgmap v315: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T08:44:40.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:40 smithi070 ceph-mon[99513]: pgmap v316: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T08:44:40.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:40 smithi105 ceph-mon[103798]: pgmap v316: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T08:44:40.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:40 smithi191 ceph-mon[104220]: pgmap v316: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T08:44:42.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:42 smithi070 ceph-mon[99513]: pgmap v317: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-10-08T08:44:42.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:42 smithi105 ceph-mon[103798]: pgmap v317: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-10-08T08:44:42.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:42 smithi191 ceph-mon[104220]: pgmap v317: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-10-08T08:44:44.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:44 smithi070 ceph-mon[99513]: pgmap v318: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-08T08:44:44.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:44 smithi105 ceph-mon[103798]: pgmap v318: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-08T08:44:44.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:44 smithi191 ceph-mon[104220]: pgmap v318: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-08T08:44:46.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:46 smithi070 ceph-mon[99513]: pgmap v319: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2023-10-08T08:44:46.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:46 smithi105 ceph-mon[103798]: pgmap v319: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2023-10-08T08:44:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.565+0000 7f1009f3b700 1 -- 172.21.15.70:0/1515906567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10041045e0 msgr2=0x7f10041049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.565+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1515906567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10041045e0 0x7f10041049c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009990 tx=0x7f0ff4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.565+0000 7f1009f3b700 1 -- 172.21.15.70:0/1515906567 shutdown_connections 2023-10-08T08:44:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.565+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1515906567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10040fff90 0x7f100410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.565+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1515906567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10041045e0 0x7f10041049c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.565+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1515906567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10040ff5d0 0x7f10040ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.565+0000 7f1009f3b700 1 -- 172.21.15.70:0/1515906567 >> 172.21.15.70:0/1515906567 conn(0x7f1004076790 msgr2=0x7f1004076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.565+0000 7f1009f3b700 1 -- 172.21.15.70:0/1515906567 shutdown_connections 2023-10-08T08:44:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.566+0000 7f1009f3b700 1 -- 172.21.15.70:0/1515906567 wait complete. 2023-10-08T08:44:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.566+0000 7f1009f3b700 1 Processor -- start 2023-10-08T08:44:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.566+0000 7f1009f3b700 1 -- start start 2023-10-08T08:44:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f1009f3b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10040ff5d0 0x7f100419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f1009f3b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10040fff90 0x7f100419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f1009f3b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10041045e0 0x7f1004194780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f1009f3b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1004194e30 con 0x7f10040ff5d0 2023-10-08T08:44:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f1009f3b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1004194fa0 con 0x7f10040fff90 2023-10-08T08:44:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f1009f3b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1004195160 con 0x7f10041045e0 2023-10-08T08:44:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f10037fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10040ff5d0 0x7f100419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f10037fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10040ff5d0 0x7f100419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51824/0 (socket says 172.21.15.70:51824) 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f10037fe700 1 -- 172.21.15.70:0/1522105828 learned_addr learned my addr 172.21.15.70:0/1522105828 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f1003fff700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10041045e0 0x7f1004194780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f10037fe700 1 -- 172.21.15.70:0/1522105828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10041045e0 msgr2=0x7f1004194780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f10037fe700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10041045e0 0x7f1004194780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f10037fe700 1 -- 172.21.15.70:0/1522105828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10040fff90 msgr2=0x7f100419ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f10037fe700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10040fff90 0x7f100419ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.567+0000 7f10037fe700 1 -- 172.21.15.70:0/1522105828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40095f0 con 0x7f10040ff5d0 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.568+0000 7f10037fe700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10040ff5d0 0x7f100419a630 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40038b0 tx=0x7f0ff4012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.568+0000 7f1000ff9700 1 -- 172.21.15.70:0/1522105828 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4004620 con 0x7f10040ff5d0 2023-10-08T08:44:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.568+0000 7f1009f3b700 1 -- 172.21.15.70:0/1522105828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10041953e0 con 0x7f10040ff5d0 2023-10-08T08:44:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.568+0000 7f1000ff9700 1 -- 172.21.15.70:0/1522105828 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ff400b9b0 con 0x7f10040ff5d0 2023-10-08T08:44:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.568+0000 7f1000ff9700 1 -- 172.21.15.70:0/1522105828 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4022900 con 0x7f10040ff5d0 2023-10-08T08:44:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.568+0000 7f1009f3b700 1 -- 172.21.15.70:0/1522105828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10041a1660 con 0x7f10040ff5d0 2023-10-08T08:44:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.571+0000 7f1000ff9700 1 -- 172.21.15.70:0/1522105828 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0ff400bb20 con 0x7f10040ff5d0 2023-10-08T08:44:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.572+0000 7f1000ff9700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0fec0a15f0 0x7f0fec0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.572+0000 7f1000ff9700 1 -- 172.21.15.70:0/1522105828 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0ff40d36a0 con 0x7f10040ff5d0 2023-10-08T08:44:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.572+0000 7f1002ffd700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0fec0a15f0 0x7f0fec0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.573+0000 7f1002ffd700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0fec0a15f0 0x7f0fec0a3ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1004195eb0 tx=0x7f0ff800b3f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.573+0000 7f1016124b80 1 Processor -- start 2023-10-08T08:44:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.573+0000 7f1016124b80 1 -- start start 2023-10-08T08:44:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f1016124b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 0x56539bddfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f1016124b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 0x56539bdd9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f1016124b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bdda510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f1016124b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bd42400 con 0x56539bddf880 2023-10-08T08:44:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f1016124b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bd33bc0 con 0x56539bdda0b0 2023-10-08T08:44:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f1016124b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bd314e0 con 0x56539bde01a0 2023-10-08T08:44:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f10037fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 0x56539bddfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f1003fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bdda510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f10037fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 0x56539bddfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51832/0 (socket says 172.21.15.70:51832) 2023-10-08T08:44:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f10037fe700 1 -- 172.21.15.70:0/2783361368 learned_addr learned my addr 172.21.15.70:0/2783361368 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f10037fe700 1 -- 172.21.15.70:0/2783361368 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 msgr2=0x56539bdd9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f10037fe700 1 --2- 172.21.15.70:0/2783361368 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 0x56539bdd9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f10037fe700 1 -- 172.21.15.70:0/2783361368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 msgr2=0x56539bdda510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f10037fe700 1 --2- 172.21.15.70:0/2783361368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bdda510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f10037fe700 1 -- 172.21.15.70:0/2783361368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56539bb57d80 con 0x56539bddf880 2023-10-08T08:44:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.574+0000 7f10037fe700 1 --2- 172.21.15.70:0/2783361368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 0x56539bddfc60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0ff409cfa0 tx=0x7f0ff4003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5b34353414e617 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.575+0000 7f0fe9ffb700 1 -- 172.21.15.70:0/2783361368 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40a0c30 con 0x56539bddf880 2023-10-08T08:44:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.575+0000 7f0fe9ffb700 1 -- 172.21.15.70:0/2783361368 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ff40a0530 con 0x56539bddf880 2023-10-08T08:44:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.575+0000 7f0fe9ffb700 1 -- 172.21.15.70:0/2783361368 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff409cc40 con 0x56539bddf880 2023-10-08T08:44:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 -- 172.21.15.70:0/2783361368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 msgr2=0x56539bddfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 --2- 172.21.15.70:0/2783361368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 0x56539bddfc60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0ff409cfa0 tx=0x7f0ff4003e00 comp rx=0 tx=0).stop 2023-10-08T08:44:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 -- 172.21.15.70:0/2783361368 shutdown_connections 2023-10-08T08:44:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 --2- 172.21.15.70:0/2783361368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bdda510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 --2- 172.21.15.70:0/2783361368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 0x56539bddfc60 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 --2- 172.21.15.70:0/2783361368 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 0x56539bdd9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 -- 172.21.15.70:0/2783361368 >> 172.21.15.70:0/2783361368 conn(0x56539bd4e200 msgr2=0x56539bdd4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 -- 172.21.15.70:0/2783361368 shutdown_connections 2023-10-08T08:44:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 -- 172.21.15.70:0/2783361368 wait complete. 2023-10-08T08:44:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.576+0000 7f1016124b80 1 -- start start 2023-10-08T08:44:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1016124b80 1 Processor -- start 2023-10-08T08:44:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1016124b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bde3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1016124b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 0x56539bde3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1016124b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bde01a0 0x56539bde3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1016124b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bd2cdd0 con 0x56539bde01a0 2023-10-08T08:44:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1016124b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bcc96b0 con 0x56539bdda0b0 2023-10-08T08:44:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1016124b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bcc9350 con 0x56539bddf880 2023-10-08T08:44:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1016124b80 10 client.0 _ll_register_callbacks cb 0x56539bb267a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1003fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bde01a0 0x56539bde3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1003fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bde01a0 0x56539bde3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51842/0 (socket says 172.21.15.70:51842) 2023-10-08T08:44:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1003fff700 1 -- 172.21.15.70:0/2642322215 learned_addr learned my addr 172.21.15.70:0/2642322215 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f1002ffd700 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 0x56539bde3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.577+0000 7f10037fe700 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bde3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f1003fff700 1 -- 172.21.15.70:0/2642322215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 msgr2=0x56539bde3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f1003fff700 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 0x56539bde3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f1003fff700 1 -- 172.21.15.70:0/2642322215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 msgr2=0x56539bde3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f1003fff700 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bde3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f1003fff700 1 -- 172.21.15.70:0/2642322215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10041a1660 con 0x56539bde01a0 2023-10-08T08:44:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f1003fff700 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bde01a0 0x56539bde3fd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc012e80 tx=0x7f0ffc014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9454eaea54f68e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f0fe2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/2642322215 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00e040 con 0x56539bde01a0 2023-10-08T08:44:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f1016124b80 1 -- 172.21.15.70:0/2642322215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56539bcf4e50 con 0x56539bde01a0 2023-10-08T08:44:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/2642322215 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0ffc014ae0 con 0x56539bde01a0 2023-10-08T08:44:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/2642322215 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ffc014ca0 con 0x56539bde01a0 2023-10-08T08:44:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f1016124b80 10 client.16053 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.578+0000 7f1016124b80 1 -- 172.21.15.70:0/2642322215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56539bb40c00 con 0x56539bde01a0 2023-10-08T08:44:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.580+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/2642322215 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56539bcf4e50 con 0x56539bde01a0 2023-10-08T08:44:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.580+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/2642322215 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0ffc01c020 con 0x56539bde01a0 2023-10-08T08:44:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.580+0000 7f1016124b80 10 client.16053 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.580+0000 7f1016124b80 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.580+0000 7f1016124b80 20 client.16053 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.580+0000 7f1016124b80 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56539bdf3b10 0x56539bdf5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.580+0000 7f1016124b80 4 client.16053 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.580+0000 7f1016124b80 1 -- 172.21.15.70:0/2642322215 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56539bd25db0 con 0x56539bdf3b10 2023-10-08T08:44:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.580+0000 7f10037fe700 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56539bdf3b10 0x56539bdf5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.581+0000 7f0fe2ffd700 10 client.16053 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.581+0000 7f10037fe700 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56539bdf3b10 0x56539bdf5f30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4790bf81c2023ff server_cookie=a5d59c353eb0fd9d in_seq=0 out_seq=0 2023-10-08T08:44:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.581+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/2642322215 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56539bd25db0 con 0x56539bdf3b10 2023-10-08T08:44:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.581+0000 7f0fe2ffd700 10 client.16053 handle_command_reply: tid=0 2023-10-08T08:44:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.581+0000 7f1016124b80 1 client.16053 shutdown 2023-10-08T08:44:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 -- 172.21.15.70:0/2642322215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bde01a0 msgr2=0x56539bde3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bde01a0 0x56539bde3fd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc012e80 tx=0x7f0ffc014600 comp rx=0 tx=0).stop 2023-10-08T08:44:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 -- 172.21.15.70:0/2642322215 shutdown_connections 2023-10-08T08:44:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bde01a0 0x56539bde3fd0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56539bdf3b10 0x56539bdf5f30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bde3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 --2- 172.21.15.70:0/2642322215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 0x56539bde3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 -- 172.21.15.70:0/2642322215 >> 172.21.15.70:0/2642322215 conn(0x56539bd4e200 msgr2=0x56539bdd4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f0fe2ffd700 0 client.16053 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 -- 172.21.15.70:0/2642322215 shutdown_connections 2023-10-08T08:44:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 1 -- 172.21.15.70:0/2642322215 wait complete. 2023-10-08T08:44:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.582+0000 7f1016124b80 20 client.16053 trim_cache size 0 max 16384 2023-10-08T08:44:46.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:46 smithi191 ceph-mon[104220]: pgmap v319: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2023-10-08T08:44:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f1016124b80 1 Processor -- start 2023-10-08T08:44:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f1016124b80 1 -- start start 2023-10-08T08:44:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f1016124b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bdda0b0 0x56539bdd9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f1016124b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 0x56539bde2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f1016124b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bde01a0 0x56539bdea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f1016124b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bbad8c0 con 0x56539bdda0b0 2023-10-08T08:44:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f1016124b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bcf4e50 con 0x56539bde01a0 2023-10-08T08:44:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f1016124b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bdcf2b0 con 0x56539bddf880 2023-10-08T08:44:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f10037fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bdda0b0 0x56539bdd9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f10037fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bdda0b0 0x56539bdd9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51846/0 (socket says 172.21.15.70:51846) 2023-10-08T08:44:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.610+0000 7f10037fe700 1 -- 172.21.15.70:0/674477465 learned_addr learned my addr 172.21.15.70:0/674477465 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f1002ffd700 1 --2- 172.21.15.70:0/674477465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 0x56539bde2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f1003fff700 1 --2- 172.21.15.70:0/674477465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bde01a0 0x56539bdea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f10037fe700 1 -- 172.21.15.70:0/674477465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 msgr2=0x56539bde2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f10037fe700 1 --2- 172.21.15.70:0/674477465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 0x56539bde2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f10037fe700 1 -- 172.21.15.70:0/674477465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bde01a0 msgr2=0x56539bdea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f10037fe700 1 --2- 172.21.15.70:0/674477465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bde01a0 0x56539bdea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f10037fe700 1 -- 172.21.15.70:0/674477465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56539bdfab20 con 0x56539bdda0b0 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f10037fe700 1 --2- 172.21.15.70:0/674477465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bdda0b0 0x56539bdd9b70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0ff408b140 tx=0x7f0ff4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123219a3659a6814 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f0fea7fc700 1 -- 172.21.15.70:0/674477465 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40bc070 con 0x56539bdda0b0 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f0fea7fc700 1 -- 172.21.15.70:0/674477465 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ff409c040 con 0x56539bdda0b0 2023-10-08T08:44:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.611+0000 7f0fea7fc700 1 -- 172.21.15.70:0/674477465 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40d3390 con 0x56539bdda0b0 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.612+0000 7f1016124b80 1 -- 172.21.15.70:0/674477465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bdda0b0 msgr2=0x56539bdd9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.612+0000 7f1016124b80 1 --2- 172.21.15.70:0/674477465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bdda0b0 0x56539bdd9b70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0ff408b140 tx=0x7f0ff4005e80 comp rx=0 tx=0).stop 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.612+0000 7f1016124b80 1 -- 172.21.15.70:0/674477465 shutdown_connections 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.612+0000 7f1016124b80 1 --2- 172.21.15.70:0/674477465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bde01a0 0x56539bdea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.612+0000 7f1016124b80 1 --2- 172.21.15.70:0/674477465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bdda0b0 0x56539bdd9b70 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.612+0000 7f1016124b80 1 --2- 172.21.15.70:0/674477465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bddf880 0x56539bde2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.612+0000 7f1016124b80 1 -- 172.21.15.70:0/674477465 >> 172.21.15.70:0/674477465 conn(0x56539bd4e200 msgr2=0x56539bdde600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.612+0000 7f1016124b80 1 -- 172.21.15.70:0/674477465 shutdown_connections 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.612+0000 7f1016124b80 1 -- 172.21.15.70:0/674477465 wait complete. 2023-10-08T08:44:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.613+0000 7f1016124b80 1 -- start start 2023-10-08T08:44:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.613+0000 7f1016124b80 1 Processor -- start 2023-10-08T08:44:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.613+0000 7f1016124b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bdeaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.613+0000 7f1016124b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 0x56539bde69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.613+0000 7f1016124b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 0x56539bde6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.613+0000 7f1016124b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bde7610 con 0x56539bddf880 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.613+0000 7f1016124b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539bde7780 con 0x56539bdda0b0 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.613+0000 7f1016124b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539be468f0 con 0x56539bde01a0 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.613+0000 7f1016124b80 10 client.0 _ll_register_callbacks cb 0x7f0ffc0127b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f10037fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bdeaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f10037fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bdeaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39310/0 (socket says 172.21.15.70:39310) 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f10037fe700 1 -- 172.21.15.70:0/3219097164 learned_addr learned my addr 172.21.15.70:0/3219097164 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f1003fff700 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 0x56539bde6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f1003fff700 1 -- 172.21.15.70:0/3219097164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 msgr2=0x56539bdeaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f1003fff700 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bdeaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f1003fff700 1 -- 172.21.15.70:0/3219097164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 msgr2=0x56539bde69c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f1003fff700 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 0x56539bde69c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f1003fff700 1 -- 172.21.15.70:0/3219097164 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56539bb57d80 con 0x56539bde01a0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f1003fff700 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 0x56539bde6f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0046d0 tx=0x7f0ffc014a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e97147b07271cc1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f0fe2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.614+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/3219097164 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00e040 con 0x56539bde01a0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f1016124b80 1 -- 172.21.15.70:0/3219097164 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ff40a0530 con 0x56539bde01a0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/3219097164 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0ffc004cd0 con 0x56539bde01a0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/3219097164 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ffc0093e0 con 0x56539bde01a0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f1016124b80 10 client.25513 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f1016124b80 1 -- 172.21.15.70:0/3219097164 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56539bb7e1f0 con 0x56539bde01a0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/3219097164 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ff40a0530 con 0x56539bde01a0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/3219097164 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0ffc014320 con 0x56539bde01a0 2023-10-08T08:44:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f1016124b80 10 client.25513 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f1016124b80 10 client.25513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f1016124b80 20 client.25513 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f1016124b80 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56539be507d0 0x56539be52bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f1016124b80 4 client.25513 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:44:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.615+0000 7f1016124b80 1 -- 172.21.15.70:0/3219097164 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56539bd25ad0 con 0x56539be507d0 2023-10-08T08:44:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.616+0000 7f10037fe700 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56539be507d0 0x56539be52bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.616+0000 7f0fe2ffd700 10 client.25513 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.616+0000 7f10037fe700 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56539be507d0 0x56539be52bf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ad9b6a6eba3c7a server_cookie=2114e4d14121bca5 in_seq=0 out_seq=0 2023-10-08T08:44:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f0fe2ffd700 1 -- 172.21.15.70:0/3219097164 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56539bd25ad0 con 0x56539be507d0 2023-10-08T08:44:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f0fe2ffd700 10 client.25513 handle_command_reply: tid=0 2023-10-08T08:44:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 client.25513 shutdown 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 -- 172.21.15.70:0/3219097164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 msgr2=0x56539bde6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 0x56539bde6f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0046d0 tx=0x7f0ffc014a00 comp rx=0 tx=0).stop 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 -- 172.21.15.70:0/3219097164 shutdown_connections 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56539bde01a0 0x56539bde6f00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56539be507d0 0x56539be52bf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56539bdda0b0 0x56539bdeaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 --2- 172.21.15.70:0/3219097164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56539bddf880 0x56539bde69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 -- 172.21.15.70:0/3219097164 >> 172.21.15.70:0/3219097164 conn(0x56539bd4e200 msgr2=0x56539bde0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f0fe2ffd700 0 client.25513 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 -- 172.21.15.70:0/3219097164 shutdown_connections 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 1 -- 172.21.15.70:0/3219097164 wait complete. 2023-10-08T08:44:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.620+0000 7f1016124b80 20 client.25513 trim_cache size 0 max 16384 2023-10-08T08:44:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:44:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:44:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:44:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:44:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 -- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0fec0a15f0 msgr2=0x7f0fec0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0fec0a15f0 0x7f0fec0a3ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1004195eb0 tx=0x7f0ff800b3f0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 -- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10040ff5d0 msgr2=0x7f100419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10040ff5d0 0x7f100419a630 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40038b0 tx=0x7f0ff4012f90 comp rx=0 tx=0).stop 2023-10-08T08:44:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 -- 172.21.15.70:0/1522105828 shutdown_connections 2023-10-08T08:44:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0fec0a15f0 0x7f0fec0a3ab0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10041045e0 0x7f1004194780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10040ff5d0 0x7f100419a630 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 --2- 172.21.15.70:0/1522105828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10040fff90 0x7f100419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.621+0000 7f1009f3b700 1 -- 172.21.15.70:0/1522105828 >> 172.21.15.70:0/1522105828 conn(0x7f1004076790 msgr2=0x7f10040fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.622+0000 7f1009f3b700 1 -- 172.21.15.70:0/1522105828 shutdown_connections 2023-10-08T08:44:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:46.622+0000 7f1009f3b700 1 -- 172.21.15.70:0/1522105828 wait complete. 2023-10-08T08:44:48.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:48 smithi070 ceph-mon[99513]: pgmap v320: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-10-08T08:44:48.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:48 smithi105 ceph-mon[103798]: pgmap v320: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-10-08T08:44:48.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:48 smithi191 ceph-mon[104220]: pgmap v320: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-10-08T08:44:50.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:50 smithi070 ceph-mon[99513]: pgmap v321: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-08T08:44:50.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:50 smithi105 ceph-mon[103798]: pgmap v321: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-08T08:44:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:50 smithi191 ceph-mon[104220]: pgmap v321: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'. 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr: 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr: 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr: 2023-10-08T08:44:51.844 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2023-10-08T08:44:51.845 INFO:tasks.workunit.client.0.smithi070.stderr: 2023-10-08T08:44:51.845 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2023-10-08T08:44:51.845 INFO:tasks.workunit.client.0.smithi070.stderr: 2023-10-08T08:44:51.845 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2023-10-08T08:44:51.845 INFO:tasks.workunit.client.0.smithi070.stderr: 2023-10-08T08:44:51.845 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-08T08:44:51.845 INFO:tasks.workunit.client.0.smithi070.stderr: 2023-10-08T08:44:51.845 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 7b3143bae3b Merge PR #48130 into wip-batrick-testing-20231007.154158 2023-10-08T08:44:51.846 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-08T08:44:51.882 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-08T08:44:51.884 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T08:44:51.884 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-08T08:44:52.417 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-08T08:44:52.470 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-08T08:44:52.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:52 smithi070 ceph-mon[99513]: pgmap v322: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-08T08:44:52.507 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T08:44:52.509 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T08:44:52.509 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-08T08:44:52.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:52 smithi105 ceph-mon[103798]: pgmap v322: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-08T08:44:52.546 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T08:44:52.549 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:44:52.549 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-08T08:44:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:52 smithi191 ceph-mon[104220]: pgmap v322: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2023-10-08T08:44:52.606 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-10-08T08:44:52.607 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-10-08T08:44:52.607 DEBUG:teuthology.orchestra.run.smithi070:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-10-08T08:44:52.675 INFO:tasks.workunit.client.0.smithi070.stderr:+ mkdir -p fsstress 2023-10-08T08:44:52.677 INFO:tasks.workunit.client.0.smithi070.stderr:+ pushd fsstress 2023-10-08T08:44:52.677 INFO:tasks.workunit.client.0.smithi070.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-10-08T08:44:52.677 INFO:tasks.workunit.client.0.smithi070.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-10-08T08:44:53.346 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xzf ltp-full.tgz 2023-10-08T08:44:54.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:54 smithi070 ceph-mon[99513]: pgmap v323: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T08:44:54.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:54 smithi105 ceph-mon[103798]: pgmap v323: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T08:44:54.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:54 smithi191 ceph-mon[104220]: pgmap v323: 129 pgs: 129 active+clean; 1.2 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T08:44:55.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:44:55.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.469+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/1319246018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0fffe0 msgr2=0x7f7e9c10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/1319246018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0fffe0 0x7f7e9c10c4e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400b0a0 tx=0x7f7e9400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/1319246018 shutdown_connections 2023-10-08T08:44:55.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/1319246018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0fffe0 0x7f7e9c10c4e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/1319246018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e9c1056b0 0x7f7e9c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/1319246018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e9c0ff620 0x7f7e9c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/1319246018 >> 172.21.15.70:0/1319246018 conn(0x7f7e9c076780 msgr2=0x7f7e9c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:55.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/1319246018 shutdown_connections 2023-10-08T08:44:55.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/1319246018 wait complete. 2023-10-08T08:44:55.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 Processor -- start 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.470+0000 7f7ea0e9f700 1 -- start start 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7ea0e9f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0ff620 0x7f7e9c19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7ea0e9f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e9c0fffe0 0x7f7e9c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7ea0e9f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e9c1056b0 0x7f7e9c195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7ea0e9f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c195e80 con 0x7f7e9c0ff620 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7ea0e9f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c195ff0 con 0x7f7e9c0fffe0 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7ea0e9f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1961b0 con 0x7f7e9c1056b0 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0ff620 0x7f7e9c19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0ff620 0x7f7e9c19b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51868/0 (socket says 172.21.15.70:51868) 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9a59c700 1 -- 172.21.15.70:0/3714715682 learned_addr learned my addr 172.21.15.70:0/3714715682 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:55.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e9c0fffe0 0x7f7e9c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9ad9d700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e9c1056b0 0x7f7e9c195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9a59c700 1 -- 172.21.15.70:0/3714715682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e9c1056b0 msgr2=0x7f7e9c195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e9c1056b0 0x7f7e9c195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9a59c700 1 -- 172.21.15.70:0/3714715682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e9c0fffe0 msgr2=0x7f7e9c19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e9c0fffe0 0x7f7e9c19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9a59c700 1 -- 172.21.15.70:0/3714715682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e94009d00 con 0x7f7e9c0ff620 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0ff620 0x7f7e9c19b690 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00e970 tx=0x7f7e8c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e8b7fe700 1 -- 172.21.15.70:0/3714715682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c009790 con 0x7f7e9c0ff620 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/3714715682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c196490 con 0x7f7e9c0ff620 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e8b7fe700 1 -- 172.21.15.70:0/3714715682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e8c00c7e0 con 0x7f7e9c0ff620 2023-10-08T08:44:55.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/3714715682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c1a2680 con 0x7f7e9c0ff620 2023-10-08T08:44:55.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.471+0000 7f7e8b7fe700 1 -- 172.21.15.70:0/3714715682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c003c10 con 0x7f7e9c0ff620 2023-10-08T08:44:55.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.474+0000 7f7e8b7fe700 1 -- 172.21.15.70:0/3714715682 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7e8c00cc50 con 0x7f7e9c0ff620 2023-10-08T08:44:55.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.474+0000 7f7e8b7fe700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7e840a15f0 0x7f7e840a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.474+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7e840a15f0 0x7f7e840a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.474+0000 7f7e8b7fe700 1 -- 172.21.15.70:0/3714715682 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7e8c014070 con 0x7f7e9c0ff620 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.475+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7e840a15f0 0x7f7e840a3ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c196be0 tx=0x7f7e9000a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.475+0000 7f7ead088b80 1 Processor -- start 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.475+0000 7f7ead088b80 1 -- start start 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.475+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c023260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.475+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 0x56054c02e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.475+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 0x56054c030a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.475+0000 7f7ead088b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054bf8c460 con 0x56054c022e80 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.475+0000 7f7ead088b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054bf7dc20 con 0x56054c02e650 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.475+0000 7f7ead088b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054bf7b540 con 0x56054c0237a0 2023-10-08T08:44:55.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c023260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c023260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51876/0 (socket says 172.21.15.70:51876) 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9a59c700 1 -- 172.21.15.70:0/2978998312 learned_addr learned my addr 172.21.15.70:0/2978998312 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9ad9d700 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 0x56054c030a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 0x56054c02e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9a59c700 1 -- 172.21.15.70:0/2978998312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 msgr2=0x56054c02e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 0x56054c02e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9a59c700 1 -- 172.21.15.70:0/2978998312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 msgr2=0x56054c030a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 0x56054c030a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9a59c700 1 -- 172.21.15.70:0/2978998312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56054bda1de0 con 0x56054c022e80 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 0x56054c02e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:55.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c023260 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0a2090 tx=0x7f7e8c099c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da3eed6149c4491 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e88ff9700 1 -- 172.21.15.70:0/2978998312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c09e170 con 0x56054c022e80 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e88ff9700 1 -- 172.21.15.70:0/2978998312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e8c09e380 con 0x56054c022e80 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.476+0000 7f7e88ff9700 1 -- 172.21.15.70:0/2978998312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c096940 con 0x56054c022e80 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 -- 172.21.15.70:0/2978998312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 msgr2=0x56054c023260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c023260 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0a2090 tx=0x7f7e8c099c10 comp rx=0 tx=0).stop 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 -- 172.21.15.70:0/2978998312 shutdown_connections 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 0x56054c030a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c023260 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 --2- 172.21.15.70:0/2978998312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 0x56054c02e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 -- 172.21.15.70:0/2978998312 >> 172.21.15.70:0/2978998312 conn(0x56054bf98260 msgr2=0x56054c01f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 -- 172.21.15.70:0/2978998312 shutdown_connections 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 -- 172.21.15.70:0/2978998312 wait complete. 2023-10-08T08:44:55.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 -- start start 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.477+0000 7f7ead088b80 1 Processor -- start 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c022e80 0x56054c02e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 0x56054c02b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c02e650 0x56054c02bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7ead088b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054bf76e30 con 0x56054c02e650 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7ead088b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054bf13710 con 0x56054c0237a0 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7ead088b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054bf133b0 con 0x56054c022e80 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7ead088b80 10 client.0 _ll_register_callbacks cb 0x56054bd70800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c02e650 0x56054c02bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e99d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 0x56054c02b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9a59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c022e80 0x56054c02e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c02e650 0x56054c02bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51886/0 (socket says 172.21.15.70:51886) 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9ad9d700 1 -- 172.21.15.70:0/622676324 learned_addr learned my addr 172.21.15.70:0/622676324 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9ad9d700 1 -- 172.21.15.70:0/622676324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c022e80 msgr2=0x56054c02e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9ad9d700 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c022e80 0x56054c02e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9ad9d700 1 -- 172.21.15.70:0/622676324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 msgr2=0x56054c02b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9ad9d700 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 0x56054c02b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9ad9d700 1 -- 172.21.15.70:0/622676324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c1a2680 con 0x56054c02e650 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 0x56054c02b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e9ad9d700 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c02e650 0x56054c02bac0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7e94007fd0 tx=0x7f7e9400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2428073aef47fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.478+0000 7f7e81ffb700 1 -- 172.21.15.70:0/622676324 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400e040 con 0x56054c02e650 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7e81ffb700 1 -- 172.21.15.70:0/622676324 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7e94003e10 con 0x56054c02e650 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7ead088b80 1 -- 172.21.15.70:0/622676324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56054bf3eeb0 con 0x56054c02e650 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7e81ffb700 1 -- 172.21.15.70:0/622676324 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e940074e0 con 0x56054c02e650 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7ead088b80 10 client.16068 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7ead088b80 1 -- 172.21.15.70:0/622676324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56054bd8ac60 con 0x56054c02e650 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7e81ffb700 1 -- 172.21.15.70:0/622676324 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56054bf3eeb0 con 0x56054c02e650 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7e81ffb700 1 -- 172.21.15.70:0/622676324 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7e94023020 con 0x56054c02e650 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7ead088b80 10 client.16068 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7ead088b80 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7ead088b80 20 client.16068 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7ead088b80 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56054c03e210 0x56054c040630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7ead088b80 4 client.16068 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:55.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7ead088b80 1 -- 172.21.15.70:0/622676324 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56054bf6fe10 con 0x56054c03e210 2023-10-08T08:44:55.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.479+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56054c03e210 0x56054c040630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.480+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56054c03e210 0x56054c040630 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=608bb17664325962 server_cookie=43a60711839d4b8c in_seq=0 out_seq=0 2023-10-08T08:44:55.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.480+0000 7f7e81ffb700 10 client.16068 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7e81ffb700 1 -- 172.21.15.70:0/622676324 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56054bf6fe10 con 0x56054c03e210 2023-10-08T08:44:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7e81ffb700 10 client.16068 handle_command_reply: tid=0 2023-10-08T08:44:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 client.16068 shutdown 2023-10-08T08:44:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 -- 172.21.15.70:0/622676324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c02e650 msgr2=0x56054c02bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c02e650 0x56054c02bac0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7e94007fd0 tx=0x7f7e9400be20 comp rx=0 tx=0).stop 2023-10-08T08:44:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 -- 172.21.15.70:0/622676324 shutdown_connections 2023-10-08T08:44:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c02e650 0x56054c02bac0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c022e80 0x56054c02e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56054c03e210 0x56054c040630 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 --2- 172.21.15.70:0/622676324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 0x56054c02b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7e81ffb700 0 client.16068 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 -- 172.21.15.70:0/622676324 >> 172.21.15.70:0/622676324 conn(0x56054bf98260 msgr2=0x56054c01eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 -- 172.21.15.70:0/622676324 shutdown_connections 2023-10-08T08:44:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 1 -- 172.21.15.70:0/622676324 wait complete. 2023-10-08T08:44:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.482+0000 7f7ead088b80 20 client.16068 trim_cache size 0 max 16384 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7ead088b80 1 Processor -- start 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7ead088b80 1 -- start start 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c0351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 0x56054c0398f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c02e650 0x56054c026670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7ead088b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054bdf7920 con 0x56054c022e80 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7ead088b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054c0240d0 con 0x56054c0237a0 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7ead088b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054c020060 con 0x56054c02e650 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7e9a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c0351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7e9a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c0351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51890/0 (socket says 172.21.15.70:51890) 2023-10-08T08:44:55.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7e9a59c700 1 -- 172.21.15.70:0/3953011430 learned_addr learned my addr 172.21.15.70:0/3953011430 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/3953011430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 0x56054c0398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7e9a59c700 1 -- 172.21.15.70:0/3953011430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c02e650 msgr2=0x56054c026670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/3953011430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c02e650 0x56054c026670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7e9a59c700 1 -- 172.21.15.70:0/3953011430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 msgr2=0x56054c0398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/3953011430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 0x56054c0398f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.499+0000 7f7e9a59c700 1 -- 172.21.15.70:0/3953011430 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56054bdc8250 con 0x56054c022e80 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/3953011430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c0351a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c096ca0 tx=0x7f7e8c003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312c6ebff384f93d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7e897fa700 1 -- 172.21.15.70:0/3953011430 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c098370 con 0x56054c022e80 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7e897fa700 1 -- 172.21.15.70:0/3953011430 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e8c082070 con 0x56054c022e80 2023-10-08T08:44:55.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7e897fa700 1 -- 172.21.15.70:0/3953011430 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c096940 con 0x56054c022e80 2023-10-08T08:44:55.506 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7ead088b80 1 -- 172.21.15.70:0/3953011430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 msgr2=0x56054c0351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.506 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7ead088b80 1 --2- 172.21.15.70:0/3953011430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c0351a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c096ca0 tx=0x7f7e8c003710 comp rx=0 tx=0).stop 2023-10-08T08:44:55.506 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7ead088b80 1 -- 172.21.15.70:0/3953011430 shutdown_connections 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7ead088b80 1 --2- 172.21.15.70:0/3953011430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c02e650 0x56054c026670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7ead088b80 1 --2- 172.21.15.70:0/3953011430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c0351a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7ead088b80 1 --2- 172.21.15.70:0/3953011430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c0237a0 0x56054c0398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7ead088b80 1 -- 172.21.15.70:0/3953011430 >> 172.21.15.70:0/3953011430 conn(0x56054bf98260 msgr2=0x56054c024e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7ead088b80 1 -- 172.21.15.70:0/3953011430 shutdown_connections 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.500+0000 7f7ead088b80 1 -- 172.21.15.70:0/3953011430 wait complete. 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7ead088b80 1 -- start start 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7ead088b80 1 Processor -- start 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c035010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 0x56054c033590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7ead088b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 0x56054c033ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7ead088b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054c0341e0 con 0x56054c022e80 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7ead088b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054c034350 con 0x56054c02e650 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7ead088b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054c092050 con 0x56054c0237a0 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7ead088b80 10 client.0 _ll_register_callbacks cb 0x7f7e94007e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e9a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c035010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e9a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c035010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51896/0 (socket says 172.21.15.70:51896) 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e9a59c700 1 -- 172.21.15.70:0/4056080370 learned_addr learned my addr 172.21.15.70:0/4056080370 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e9ad9d700 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 0x56054c033ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 0x56054c033590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e9a59c700 1 -- 172.21.15.70:0/4056080370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 msgr2=0x56054c033590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 0x56054c033590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e9a59c700 1 -- 172.21.15.70:0/4056080370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 msgr2=0x56054c033ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 0x56054c033ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.501+0000 7f7e9a59c700 1 -- 172.21.15.70:0/4056080370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56054bda1de0 con 0x56054c022e80 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7e9a59c700 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c035010 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c09a1c0 tx=0x7f7e8c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40513b21a8be84c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7e81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7e81ffb700 1 -- 172.21.15.70:0/4056080370 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c096940 con 0x56054c022e80 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7e81ffb700 1 -- 172.21.15.70:0/4056080370 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7e8c07b070 con 0x56054c022e80 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7ead088b80 1 -- 172.21.15.70:0/4056080370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e8c09e380 con 0x56054c022e80 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7e81ffb700 1 -- 172.21.15.70:0/4056080370 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e8c096aa0 con 0x56054c022e80 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7ead088b80 10 client.16074 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7ead088b80 1 -- 172.21.15.70:0/4056080370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56054bda02b0 con 0x56054c022e80 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7e81ffb700 1 -- 172.21.15.70:0/4056080370 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e8c09e380 con 0x56054c022e80 2023-10-08T08:44:55.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7e81ffb700 1 -- 172.21.15.70:0/4056080370 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7e8c0cd240 con 0x56054c022e80 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7ead088b80 10 client.16074 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7ead088b80 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7ead088b80 20 client.16074 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7ead088b80 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56054c0932a0 0x56054c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7ead088b80 4 client.16074 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7ead088b80 1 -- 172.21.15.70:0/4056080370 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56054bf6fb30 con 0x56054c0932a0 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.502+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56054c0932a0 0x56054c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.503+0000 7f7e99d9b700 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56054c0932a0 0x56054c095690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e0812d74ffb1fd8 server_cookie=f62482acd5701ba0 in_seq=0 out_seq=0 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.503+0000 7f7e81ffb700 10 client.16074 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7e81ffb700 1 -- 172.21.15.70:0/4056080370 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56054bf6fb30 con 0x56054c0932a0 2023-10-08T08:44:55.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7e81ffb700 10 client.16074 handle_command_reply: tid=0 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 client.16074 shutdown 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 -- 172.21.15.70:0/4056080370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 msgr2=0x56054c035010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c035010 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c09a1c0 tx=0x7f7e8c00c450 comp rx=0 tx=0).stop 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 -- 172.21.15.70:0/4056080370 shutdown_connections 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56054c0932a0 0x56054c095690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56054c02e650 0x56054c033ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56054c022e80 0x56054c035010 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7e81ffb700 0 client.16074 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 --2- 172.21.15.70:0/4056080370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56054c0237a0 0x56054c033590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 -- 172.21.15.70:0/4056080370 >> 172.21.15.70:0/4056080370 conn(0x56054bf98260 msgr2=0x56054c0398f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 -- 172.21.15.70:0/4056080370 shutdown_connections 2023-10-08T08:44:55.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 1 -- 172.21.15.70:0/4056080370 wait complete. 2023-10-08T08:44:55.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.505+0000 7f7ead088b80 20 client.16074 trim_cache size 0 max 16384 2023-10-08T08:44:55.512 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:44:55.512 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2023-10-08T08:44:55.512 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2023-10-08T08:44:55.512 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:44:55.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7e840a15f0 msgr2=0x7f7e840a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7e840a15f0 0x7f7e840a3ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c196be0 tx=0x7f7e9000a300 comp rx=0 tx=0).stop 2023-10-08T08:44:55.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0ff620 msgr2=0x7f7e9c19b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0ff620 0x7f7e9c19b690 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00e970 tx=0x7f7e8c00ec80 comp rx=0 tx=0).stop 2023-10-08T08:44:55.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/3714715682 shutdown_connections 2023-10-08T08:44:55.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f7e840a15f0 0x7f7e840a3ab0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e9c1056b0 0x7f7e9c195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e9c0ff620 0x7f7e9c19b690 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 --2- 172.21.15.70:0/3714715682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e9c0fffe0 0x7f7e9c19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/3714715682 >> 172.21.15.70:0/3714715682 conn(0x7f7e9c076780 msgr2=0x7f7e9c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:55.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/3714715682 shutdown_connections 2023-10-08T08:44:55.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.506+0000 7f7ea0e9f700 1 -- 172.21.15.70:0/3714715682 wait complete. 2023-10-08T08:44:55.518 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T08:44:55.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:44:55.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.646+0000 7f17a2d53700 1 -- 172.21.15.70:0/2727504725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c102130 msgr2=0x7f179c10a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.646+0000 7f17a2d53700 1 --2- 172.21.15.70:0/2727504725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c102130 0x7f179c10a610 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1788009990 tx=0x7f1788009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.646+0000 7f17a2d53700 1 -- 172.21.15.70:0/2727504725 shutdown_connections 2023-10-08T08:44:55.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.646+0000 7f17a2d53700 1 --2- 172.21.15.70:0/2727504725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c10ac30 0x7f179c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.646+0000 7f17a2d53700 1 --2- 172.21.15.70:0/2727504725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c101810 0x7f179c101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.646+0000 7f17a2d53700 1 --2- 172.21.15.70:0/2727504725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c102130 0x7f179c10a610 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.646+0000 7f17a2d53700 1 -- 172.21.15.70:0/2727504725 >> 172.21.15.70:0/2727504725 conn(0x7f179c0fb050 msgr2=0x7f179c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.646+0000 7f17a2d53700 1 -- 172.21.15.70:0/2727504725 shutdown_connections 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.646+0000 7f17a2d53700 1 -- 172.21.15.70:0/2727504725 wait complete. 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a2d53700 1 Processor -- start 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a2d53700 1 -- start start 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a2d53700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c101810 0x7f179c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a2d53700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c102130 0x7f179c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a2d53700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c10ac30 0x7f179c196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a2d53700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c197080 con 0x7f179c101810 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a2d53700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c1971f0 con 0x7f179c10ac30 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a2d53700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c1973b0 con 0x7f179c102130 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a0aef700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c101810 0x7f179c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a0aef700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c101810 0x7f179c19c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51910/0 (socket says 172.21.15.70:51910) 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a0aef700 1 -- 172.21.15.70:0/548219367 learned_addr learned my addr 172.21.15.70:0/548219367 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a12f0700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c10ac30 0x7f179c196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f179bfff700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c102130 0x7f179c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a0aef700 1 -- 172.21.15.70:0/548219367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c102130 msgr2=0x7f179c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a0aef700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c102130 0x7f179c19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a0aef700 1 -- 172.21.15.70:0/548219367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c10ac30 msgr2=0x7f179c196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a0aef700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c10ac30 0x7f179c196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a0aef700 1 -- 172.21.15.70:0/548219367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17880095f0 con 0x7f179c101810 2023-10-08T08:44:55.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.647+0000 7f17a0aef700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c101810 0x7f179c19c890 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f179000d950 tx=0x7f179000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:55.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.648+0000 7f1799ffb700 1 -- 172.21.15.70:0/548219367 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790009940 con 0x7f179c101810 2023-10-08T08:44:55.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.648+0000 7f1799ffb700 1 -- 172.21.15.70:0/548219367 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1790010460 con 0x7f179c101810 2023-10-08T08:44:55.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.648+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c197690 con 0x7f179c101810 2023-10-08T08:44:55.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.648+0000 7f1799ffb700 1 -- 172.21.15.70:0/548219367 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179000f620 con 0x7f179c101810 2023-10-08T08:44:55.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.648+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c1a3880 con 0x7f179c101810 2023-10-08T08:44:55.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.649+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c105d00 con 0x7f179c101810 2023-10-08T08:44:55.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.650+0000 7f1799ffb700 1 -- 172.21.15.70:0/548219367 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f17900108d0 con 0x7f179c101810 2023-10-08T08:44:55.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.650+0000 7f1799ffb700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f178c0a15f0 0x7f178c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:55.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.650+0000 7f1799ffb700 1 -- 172.21.15.70:0/548219367 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f17900cd250 con 0x7f179c101810 2023-10-08T08:44:55.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.650+0000 7f179bfff700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f178c0a15f0 0x7f178c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:55.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.651+0000 7f179bfff700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f178c0a15f0 0x7f178c0a3ab0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1788006010 tx=0x7f178800b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:55.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.655+0000 7f1799ffb700 1 -- 172.21.15.70:0/548219367 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f17900962a0 con 0x7f179c101810 2023-10-08T08:44:55.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.920+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f179c197e80 con 0x7f179c101810 2023-10-08T08:44:55.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.920+0000 7f1799ffb700 1 -- 172.21.15.70:0/548219367 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11375 (secure 0 0 0) 0x7f17900998c0 con 0x7f179c101810 2023-10-08T08:44:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:44:55.921 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:42:29.077123+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24572":{"gid":24572,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/2412806046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2412806046},{"type":"v1","addr":"172.21.15.105:6835","nonce":2412806046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:44:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f178c0a15f0 msgr2=0x7f178c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f178c0a15f0 0x7f178c0a3ab0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1788006010 tx=0x7f178800b260 comp rx=0 tx=0).stop 2023-10-08T08:44:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c101810 msgr2=0x7f179c19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c101810 0x7f179c19c890 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f179000d950 tx=0x7f179000dc60 comp rx=0 tx=0).stop 2023-10-08T08:44:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 shutdown_connections 2023-10-08T08:44:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f178c0a15f0 0x7f178c0a3ab0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c10ac30 0x7f179c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c101810 0x7f179c19c890 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 --2- 172.21.15.70:0/548219367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c102130 0x7f179c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:55.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 >> 172.21.15.70:0/548219367 conn(0x7f179c0fb050 msgr2=0x7f179c0fbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:55.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 shutdown_connections 2023-10-08T08:44:55.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:55.923+0000 7f17a2d53700 1 -- 172.21.15.70:0/548219367 wait complete. 2023-10-08T08:44:55.925 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2023-10-08T08:44:55.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T08:44:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.067+0000 7f4411f9e700 1 -- 172.21.15.70:0/1730579395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c0fffe0 msgr2=0x7f440c10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.067+0000 7f4411f9e700 1 --2- 172.21.15.70:0/1730579395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c0fffe0 0x7f440c10c4e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f440400b0a0 tx=0x7f440400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.067+0000 7f4411f9e700 1 -- 172.21.15.70:0/1730579395 shutdown_connections 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.067+0000 7f4411f9e700 1 --2- 172.21.15.70:0/1730579395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c0fffe0 0x7f440c10c4e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.067+0000 7f4411f9e700 1 --2- 172.21.15.70:0/1730579395 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f440c1056b0 0x7f440c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.067+0000 7f4411f9e700 1 --2- 172.21.15.70:0/1730579395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c0ff620 0x7f440c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.067+0000 7f4411f9e700 1 -- 172.21.15.70:0/1730579395 >> 172.21.15.70:0/1730579395 conn(0x7f440c076780 msgr2=0x7f440c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.067+0000 7f4411f9e700 1 -- 172.21.15.70:0/1730579395 shutdown_connections 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.067+0000 7f4411f9e700 1 -- 172.21.15.70:0/1730579395 wait complete. 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f4411f9e700 1 Processor -- start 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f4411f9e700 1 -- start start 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f4411f9e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c0ff620 0x7f440c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f4411f9e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f440c0fffe0 0x7f440c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f4411f9e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1056b0 0x7f440c1a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f4411f9e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c1987c0 con 0x7f440c1056b0 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f4411f9e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c1a2fd0 con 0x7f440c0fffe0 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f4411f9e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c1a3110 con 0x7f440c0ff620 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1056b0 0x7f440c1a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1056b0 0x7f440c1a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51928/0 (socket says 172.21.15.70:51928) 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440bfff700 1 -- 172.21.15.70:0/2263068573 learned_addr learned my addr 172.21.15.70:0/2263068573 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440affd700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f440c0fffe0 0x7f440c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440b7fe700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c0ff620 0x7f440c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440bfff700 1 -- 172.21.15.70:0/2263068573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c0ff620 msgr2=0x7f440c197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440bfff700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c0ff620 0x7f440c197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440bfff700 1 -- 172.21.15.70:0/2263068573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f440c0fffe0 msgr2=0x7f440c197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440bfff700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f440c0fffe0 0x7f440c197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440bfff700 1 -- 172.21.15.70:0/2263068573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4404009d00 con 0x7f440c1056b0 2023-10-08T08:44:56.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.068+0000 7f440b7fe700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c0ff620 0x7f440c197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.069+0000 7f440bfff700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1056b0 0x7f440c1a2a90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f440400b070 tx=0x7f4404007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.069+0000 7f4408ff9700 1 -- 172.21.15.70:0/2263068573 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440400e040 con 0x7f440c1056b0 2023-10-08T08:44:56.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.069+0000 7f4411f9e700 1 -- 172.21.15.70:0/2263068573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c1a3340 con 0x7f440c1056b0 2023-10-08T08:44:56.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.069+0000 7f4408ff9700 1 -- 172.21.15.70:0/2263068573 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4404004e60 con 0x7f440c1056b0 2023-10-08T08:44:56.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.069+0000 7f4408ff9700 1 -- 172.21.15.70:0/2263068573 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4404005280 con 0x7f440c1056b0 2023-10-08T08:44:56.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.069+0000 7f4411f9e700 1 -- 172.21.15.70:0/2263068573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c1a37c0 con 0x7f440c1056b0 2023-10-08T08:44:56.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.071+0000 7f4408ff9700 1 -- 172.21.15.70:0/2263068573 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f44040054a0 con 0x7f440c1056b0 2023-10-08T08:44:56.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.072+0000 7f4408ff9700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43f80a15f0 0x7f43f80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.072+0000 7f440b7fe700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43f80a15f0 0x7f43f80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.072+0000 7f4408ff9700 1 -- 172.21.15.70:0/2263068573 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f44040cea20 con 0x7f440c1056b0 2023-10-08T08:44:56.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.072+0000 7f440b7fe700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43f80a15f0 0x7f43f80a3ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f440c077ab0 tx=0x7f43fc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.072+0000 7f441e187b80 1 Processor -- start 2023-10-08T08:44:56.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.072+0000 7f441e187b80 1 -- start start 2023-10-08T08:44:56.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f441e187b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d624260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f441e187b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 0x55944d62f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f441e187b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d631a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f441e187b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d58d460 con 0x55944d62f650 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f441e187b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d57ec20 con 0x55944d623e80 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f441e187b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d57c540 con 0x55944d6247a0 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d624260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d624260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39390/0 (socket says 172.21.15.70:39390) 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d631a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440b7fe700 1 -- 172.21.15.70:0/1179007062 learned_addr learned my addr 172.21.15.70:0/1179007062 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440affd700 1 --2- 172.21.15.70:0/1179007062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 0x55944d62f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440b7fe700 1 -- 172.21.15.70:0/1179007062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 msgr2=0x55944d62f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440b7fe700 1 --2- 172.21.15.70:0/1179007062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 0x55944d62f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440b7fe700 1 -- 172.21.15.70:0/1179007062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 msgr2=0x55944d631a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440b7fe700 1 --2- 172.21.15.70:0/1179007062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d631a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440b7fe700 1 -- 172.21.15.70:0/1179007062 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55944d3a2de0 con 0x55944d623e80 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440bfff700 1 --2- 172.21.15.70:0/1179007062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d631a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f440b7fe700 1 --2- 172.21.15.70:0/1179007062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d624260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f43fc010d30 tx=0x7f43fc009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a942a68b087ffffd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.073+0000 7f4401ffb700 1 -- 172.21.15.70:0/1179007062 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc012b40 con 0x55944d623e80 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f4401ffb700 1 -- 172.21.15.70:0/1179007062 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43fc012ca0 con 0x55944d623e80 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f4401ffb700 1 -- 172.21.15.70:0/1179007062 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc01e610 con 0x55944d623e80 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f441e187b80 1 -- 172.21.15.70:0/1179007062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 msgr2=0x55944d624260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f441e187b80 1 --2- 172.21.15.70:0/1179007062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d624260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f43fc010d30 tx=0x7f43fc009f90 comp rx=0 tx=0).stop 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f441e187b80 1 -- 172.21.15.70:0/1179007062 shutdown_connections 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f441e187b80 1 --2- 172.21.15.70:0/1179007062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d631a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f441e187b80 1 --2- 172.21.15.70:0/1179007062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d624260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f441e187b80 1 --2- 172.21.15.70:0/1179007062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 0x55944d62f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f441e187b80 1 -- 172.21.15.70:0/1179007062 >> 172.21.15.70:0/1179007062 conn(0x55944d599260 msgr2=0x55944d6202d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f441e187b80 1 -- 172.21.15.70:0/1179007062 shutdown_connections 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.074+0000 7f441e187b80 1 -- 172.21.15.70:0/1179007062 wait complete. 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f441e187b80 1 -- start start 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f441e187b80 1 Processor -- start 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f441e187b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 0x55944d62efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f441e187b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d6247a0 0x55944d62c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f441e187b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d62c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f441e187b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d577e30 con 0x55944d62f650 2023-10-08T08:44:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f441e187b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d514710 con 0x55944d6247a0 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f441e187b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d5143b0 con 0x55944d623e80 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f441e187b80 10 client.0 _ll_register_callbacks cb 0x55944d371800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f440affd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d6247a0 0x55944d62c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f440bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d62c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f440affd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d6247a0 0x55944d62c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39398/0 (socket says 172.21.15.70:39398) 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f440affd700 1 -- 172.21.15.70:0/803706514 learned_addr learned my addr 172.21.15.70:0/803706514 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f440b7fe700 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 0x55944d62efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f440affd700 1 -- 172.21.15.70:0/803706514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 msgr2=0x55944d62efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f440affd700 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 0x55944d62efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f440affd700 1 -- 172.21.15.70:0/803706514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 msgr2=0x55944d62c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.075+0000 7f440affd700 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d62c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f440affd700 1 -- 172.21.15.70:0/803706514 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c1a37c0 con 0x55944d6247a0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f440bfff700 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d62c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f440affd700 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d6247a0 0x55944d62c350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43f40115e0 tx=0x7f43f40118f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e30acf32294001a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f43eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f43eaffd700 1 -- 172.21.15.70:0/803706514 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4009680 con 0x55944d6247a0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f43eaffd700 1 -- 172.21.15.70:0/803706514 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f43f4014650 con 0x55944d6247a0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f441e187b80 1 -- 172.21.15.70:0/803706514 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55944d53feb0 con 0x55944d6247a0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f43eaffd700 1 -- 172.21.15.70:0/803706514 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43f4014810 con 0x55944d6247a0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f441e187b80 10 client.25559 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f441e187b80 1 -- 172.21.15.70:0/803706514 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f43fc0109b0 con 0x55944d6247a0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f43eaffd700 1 -- 172.21.15.70:0/803706514 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55944d53feb0 con 0x55944d6247a0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f43eaffd700 1 -- 172.21.15.70:0/803706514 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f43f401b020 con 0x55944d6247a0 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f441e187b80 10 client.25559 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f441e187b80 10 client.25559 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f441e187b80 20 client.25559 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.076+0000 7f441e187b80 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55944d63f210 0x55944d641630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.077+0000 7f441e187b80 4 client.25559 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.077+0000 7f441e187b80 1 -- 172.21.15.70:0/803706514 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55944d570e10 con 0x55944d63f210 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.077+0000 7f440b7fe700 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55944d63f210 0x55944d641630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.077+0000 7f440b7fe700 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55944d63f210 0x55944d641630 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c2ceef39343ea9ca server_cookie=58efe84c793a727 in_seq=0 out_seq=0 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.077+0000 7f43eaffd700 10 client.25559 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f43eaffd700 1 -- 172.21.15.70:0/803706514 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55944d570e10 con 0x55944d63f210 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f43eaffd700 10 client.25559 handle_command_reply: tid=0 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 client.25559 shutdown 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 -- 172.21.15.70:0/803706514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d6247a0 msgr2=0x55944d62c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d6247a0 0x55944d62c350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43f40115e0 tx=0x7f43f40118f0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 -- 172.21.15.70:0/803706514 shutdown_connections 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55944d63f210 0x55944d641630 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d62f650 0x55944d62c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f43eaffd700 0 client.25559 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 0x55944d62efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 --2- 172.21.15.70:0/803706514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d6247a0 0x55944d62c350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 -- 172.21.15.70:0/803706514 >> 172.21.15.70:0/803706514 conn(0x55944d599260 msgr2=0x55944d61fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 -- 172.21.15.70:0/803706514 shutdown_connections 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.078+0000 7f441e187b80 1 -- 172.21.15.70:0/803706514 wait complete. 2023-10-08T08:44:56.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.079+0000 7f441e187b80 20 client.25559 trim_cache size 0 max 16384 2023-10-08T08:44:56.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f441e187b80 1 Processor -- start 2023-10-08T08:44:56.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f441e187b80 1 -- start start 2023-10-08T08:44:56.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f441e187b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d599260 0x55944d6361a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f441e187b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 0x55944d627650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f441e187b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d6247a0 0x55944d627b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f441e187b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d3f8920 con 0x55944d6247a0 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f441e187b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d625970 con 0x55944d599260 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f441e187b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d6366e0 con 0x55944d623e80 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f440bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d6247a0 0x55944d627b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f440b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d599260 0x55944d6361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f440bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d6247a0 0x55944d627b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51950/0 (socket says 172.21.15.70:51950) 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f440bfff700 1 -- 172.21.15.70:0/1943824381 learned_addr learned my addr 172.21.15.70:0/1943824381 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.092+0000 7f440affd700 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 0x55944d627650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f440b7fe700 1 -- 172.21.15.70:0/1943824381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 msgr2=0x55944d627650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f440b7fe700 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 0x55944d627650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f440b7fe700 1 -- 172.21.15.70:0/1943824381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d6247a0 msgr2=0x55944d627b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f440b7fe700 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d6247a0 0x55944d627b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f440b7fe700 1 -- 172.21.15.70:0/1943824381 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55944d38bc60 con 0x55944d599260 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f440bfff700 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d6247a0 0x55944d627b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f440affd700 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 0x55944d627650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f440b7fe700 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d599260 0x55944d6361a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43fc010950 tx=0x7f43fc016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31ffbf3b52c97049 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f44027fc700 1 -- 172.21.15.70:0/1943824381 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc02e040 con 0x55944d599260 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f44027fc700 1 -- 172.21.15.70:0/1943824381 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43fc02f040 con 0x55944d599260 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f44027fc700 1 -- 172.21.15.70:0/1943824381 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc035560 con 0x55944d599260 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.093+0000 7f441e187b80 1 -- 172.21.15.70:0/1943824381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d599260 msgr2=0x55944d6361a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d599260 0x55944d6361a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43fc010950 tx=0x7f43fc016000 comp rx=0 tx=0).stop 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 -- 172.21.15.70:0/1943824381 shutdown_connections 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d6247a0 0x55944d627b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d599260 0x55944d6361a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 --2- 172.21.15.70:0/1943824381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d623e80 0x55944d627650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 -- 172.21.15.70:0/1943824381 >> 172.21.15.70:0/1943824381 conn(0x55944d61c2a0 msgr2=0x55944d62b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 -- 172.21.15.70:0/1943824381 shutdown_connections 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 -- 172.21.15.70:0/1943824381 wait complete. 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 -- start start 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 Processor -- start 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d599260 0x55944d635f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d634470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 0x55944d6349b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d635080 con 0x55944d599260 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d6351f0 con 0x55944d623e80 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55944d693010 con 0x55944d6247a0 2023-10-08T08:44:56.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f441e187b80 10 client.0 _ll_register_callbacks cb 0x7f43f4009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.094+0000 7f440b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d599260 0x55944d635f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d599260 0x55944d635f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51952/0 (socket says 172.21.15.70:51952) 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440b7fe700 1 -- 172.21.15.70:0/348824564 learned_addr learned my addr 172.21.15.70:0/348824564 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440affd700 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d634470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440bfff700 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 0x55944d6349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440b7fe700 1 -- 172.21.15.70:0/348824564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 msgr2=0x55944d6349b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440b7fe700 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 0x55944d6349b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440b7fe700 1 -- 172.21.15.70:0/348824564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 msgr2=0x55944d634470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440b7fe700 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d634470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440b7fe700 1 -- 172.21.15.70:0/348824564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c1a3340 con 0x55944d599260 2023-10-08T08:44:56.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440bfff700 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 0x55944d6349b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f440b7fe700 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d599260 0x55944d635f80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f43fc012f10 tx=0x7f43fc012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e74c5758ed3404 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f43eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f43eaffd700 1 -- 172.21.15.70:0/348824564 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc02e050 con 0x55944d599260 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f43eaffd700 1 -- 172.21.15.70:0/348824564 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f43fc01fe40 con 0x55944d599260 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f441e187b80 1 -- 172.21.15.70:0/348824564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43fc012ca0 con 0x55944d599260 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f43eaffd700 1 -- 172.21.15.70:0/348824564 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43fc035980 con 0x55944d599260 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f441e187b80 10 client.16098 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.095+0000 7f441e187b80 1 -- 172.21.15.70:0/348824564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55944d3a2de0 con 0x55944d599260 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f43eaffd700 1 -- 172.21.15.70:0/348824564 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43fc012ca0 con 0x55944d599260 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f43eaffd700 1 -- 172.21.15.70:0/348824564 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f43fc046070 con 0x55944d599260 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f441e187b80 10 client.16098 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f441e187b80 10 client.16098 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f441e187b80 20 client.16098 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f441e187b80 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55944d62f650 0x55944d696210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f441e187b80 4 client.16098 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f441e187b80 1 -- 172.21.15.70:0/348824564 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55944d570b30 con 0x55944d62f650 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f440affd700 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55944d62f650 0x55944d696210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f43eaffd700 10 client.16098 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.096+0000 7f440affd700 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55944d62f650 0x55944d696210 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85b0dfe3a7b476f0 server_cookie=98b077eb706294bd in_seq=0 out_seq=0 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f43eaffd700 1 -- 172.21.15.70:0/348824564 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55944d570b30 con 0x55944d62f650 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f43eaffd700 10 client.16098 handle_command_reply: tid=0 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 client.16098 shutdown 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 -- 172.21.15.70:0/348824564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d599260 msgr2=0x55944d635f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d599260 0x55944d635f80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f43fc012f10 tx=0x7f43fc012aa0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 -- 172.21.15.70:0/348824564 shutdown_connections 2023-10-08T08:44:56.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55944d6247a0 0x55944d6349b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55944d62f650 0x55944d696210 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55944d599260 0x55944d635f80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f43eaffd700 0 client.16098 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:44:56.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 --2- 172.21.15.70:0/348824564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55944d623e80 0x55944d634470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 -- 172.21.15.70:0/348824564 >> 172.21.15.70:0/348824564 conn(0x55944d61c2a0 msgr2=0x55944d627650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 -- 172.21.15.70:0/348824564 shutdown_connections 2023-10-08T08:44:56.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 1 -- 172.21.15.70:0/348824564 wait complete. 2023-10-08T08:44:56.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f441e187b80 20 client.16098 trim_cache size 0 max 16384 2023-10-08T08:44:56.106 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:56.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 -- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43f80a15f0 msgr2=0x7f43f80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43f80a15f0 0x7f43f80a3ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f440c077ab0 tx=0x7f43fc009260 comp rx=0 tx=0).stop 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 -- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1056b0 msgr2=0x7f440c1a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1056b0 0x7f440c1a2a90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f440400b070 tx=0x7f4404007870 comp rx=0 tx=0).stop 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 -- 172.21.15.70:0/2263068573 shutdown_connections 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43f80a15f0 0x7f43f80a3ab0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1056b0 0x7f440c1a2a90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c0ff620 0x7f440c197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 --2- 172.21.15.70:0/2263068573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f440c0fffe0 0x7f440c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.097+0000 7f4411f9e700 1 -- 172.21.15.70:0/2263068573 >> 172.21.15.70:0/2263068573 conn(0x7f440c076780 msgr2=0x7f440c0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.098+0000 7f4411f9e700 1 -- 172.21.15.70:0/2263068573 shutdown_connections 2023-10-08T08:44:56.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.098+0000 7f4411f9e700 1 -- 172.21.15.70:0/2263068573 wait complete. 2023-10-08T08:44:56.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T08:44:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 -- 172.21.15.70:0/1887173123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 msgr2=0x7fc710105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 --2- 172.21.15.70:0/1887173123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 0x7fc710105a40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc700009990 tx=0x7fc700009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 -- 172.21.15.70:0/1887173123 shutdown_connections 2023-10-08T08:44:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 --2- 172.21.15.70:0/1887173123 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc710100790 0x7fc71010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 --2- 172.21.15.70:0/1887173123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 0x7fc710105a40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 --2- 172.21.15.70:0/1887173123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7100ffdd0 0x7fc710100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 -- 172.21.15.70:0/1887173123 >> 172.21.15.70:0/1887173123 conn(0x7fc710075c20 msgr2=0x7fc7100fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 -- 172.21.15.70:0/1887173123 shutdown_connections 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 -- 172.21.15.70:0/1887173123 wait complete. 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.237+0000 7fc7148a7700 1 Processor -- start 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc7148a7700 1 -- start start 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc7148a7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7100ffdd0 0x7fc71019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc7148a7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc710100790 0x7fc71019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc7148a7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 0x7fc710196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc7148a7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101970c0 con 0x7fc710105660 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc7148a7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc710197230 con 0x7fc710100790 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc7148a7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101973f0 con 0x7fc7100ffdd0 2023-10-08T08:44:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 0x7fc710196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 0x7fc710196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51970/0 (socket says 172.21.15.70:51970) 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70ed9d700 1 -- 172.21.15.70:0/281344896 learned_addr learned my addr 172.21.15.70:0/281344896 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70e59c700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7100ffdd0 0x7fc71019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc710100790 0x7fc71019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70ed9d700 1 -- 172.21.15.70:0/281344896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7100ffdd0 msgr2=0x7fc71019c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70ed9d700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7100ffdd0 0x7fc71019c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70ed9d700 1 -- 172.21.15.70:0/281344896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc710100790 msgr2=0x7fc71019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70ed9d700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc710100790 0x7fc71019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70ed9d700 1 -- 172.21.15.70:0/281344896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000095f0 con 0x7fc710105660 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc710100790 0x7fc71019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc70ed9d700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 0x7fc710196a60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc708007ee0 tx=0x7fc70800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc6ff7fe700 1 -- 172.21.15.70:0/281344896 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70800ddd0 con 0x7fc710105660 2023-10-08T08:44:56.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc6ff7fe700 1 -- 172.21.15.70:0/281344896 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc70800f040 con 0x7fc710105660 2023-10-08T08:44:56.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc7148a7700 1 -- 172.21.15.70:0/281344896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7101976d0 con 0x7fc710105660 2023-10-08T08:44:56.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.238+0000 7fc6ff7fe700 1 -- 172.21.15.70:0/281344896 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708015400 con 0x7fc710105660 2023-10-08T08:44:56.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.239+0000 7fc7148a7700 1 -- 172.21.15.70:0/281344896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7101a38d0 con 0x7fc710105660 2023-10-08T08:44:56.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.241+0000 7fc6ff7fe700 1 -- 172.21.15.70:0/281344896 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc708004000 con 0x7fc710105660 2023-10-08T08:44:56.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.241+0000 7fc6ff7fe700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc6f80a1670 0x7fc6f80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.241+0000 7fc6ff7fe700 1 -- 172.21.15.70:0/281344896 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc7080cccf0 con 0x7fc710105660 2023-10-08T08:44:56.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.241+0000 7fc70e59c700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc6f80a1670 0x7fc6f80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.242+0000 7fc70e59c700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc6f80a1670 0x7fc6f80a3b30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc700005850 tx=0x7fc70001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.242+0000 7fc720a90b80 1 Processor -- start 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.242+0000 7fc720a90b80 1 -- start start 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.242+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 0x56348fe2b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.242+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe2b7a0 0x56348fe3a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.242+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe3aa60 0x56348fe3ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.242+0000 7fc720a90b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fd94460 con 0x56348fe3aa60 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.242+0000 7fc720a90b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fd85c20 con 0x56348fe2ae80 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.242+0000 7fc720a90b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fd83540 con 0x56348fe2b7a0 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe3aa60 0x56348fe3ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70e59c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 0x56348fe2b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70ed9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe3aa60 0x56348fe3ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51978/0 (socket says 172.21.15.70:51978) 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70ed9d700 1 -- 172.21.15.70:0/1194451248 learned_addr learned my addr 172.21.15.70:0/1194451248 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/1194451248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe2b7a0 0x56348fe3a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70ed9d700 1 -- 172.21.15.70:0/1194451248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe2b7a0 msgr2=0x56348fe3a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70ed9d700 1 --2- 172.21.15.70:0/1194451248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe2b7a0 0x56348fe3a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70ed9d700 1 -- 172.21.15.70:0/1194451248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 msgr2=0x56348fe2b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70ed9d700 1 --2- 172.21.15.70:0/1194451248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 0x56348fe2b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70ed9d700 1 -- 172.21.15.70:0/1194451248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56348fba9de0 con 0x56348fe3aa60 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/1194451248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe2b7a0 0x56348fe3a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc70ed9d700 1 --2- 172.21.15.70:0/1194451248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe3aa60 0x56348fe3ce50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc708096410 tx=0x7fc708009410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95530a82a891581 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc6fcff9700 1 -- 172.21.15.70:0/1194451248 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080b7ea0 con 0x56348fe3aa60 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc6fcff9700 1 -- 172.21.15.70:0/1194451248 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc708099300 con 0x56348fe3aa60 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.243+0000 7fc6fcff9700 1 -- 172.21.15.70:0/1194451248 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708099c00 con 0x56348fe3aa60 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 -- 172.21.15.70:0/1194451248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe3aa60 msgr2=0x56348fe3ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 --2- 172.21.15.70:0/1194451248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe3aa60 0x56348fe3ce50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc708096410 tx=0x7fc708009410 comp rx=0 tx=0).stop 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 -- 172.21.15.70:0/1194451248 shutdown_connections 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 --2- 172.21.15.70:0/1194451248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe3aa60 0x56348fe3ce50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 --2- 172.21.15.70:0/1194451248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 0x56348fe2b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 --2- 172.21.15.70:0/1194451248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe2b7a0 0x56348fe3a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 -- 172.21.15.70:0/1194451248 >> 172.21.15.70:0/1194451248 conn(0x56348fda0260 msgr2=0x56348fe272d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 -- 172.21.15.70:0/1194451248 shutdown_connections 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 -- 172.21.15.70:0/1194451248 wait complete. 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 -- start start 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 Processor -- start 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 0x56348fe3a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2b7a0 0x56348fe37820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.244+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe37e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc720a90b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fd7ee30 con 0x56348fe2b7a0 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc720a90b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fd1b710 con 0x56348fe2ae80 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc720a90b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fd1b3b0 con 0x56348fe3aa60 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc720a90b80 10 client.0 _ll_register_callbacks cb 0x56348fb78800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70dd9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2b7a0 0x56348fe37820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70dd9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2b7a0 0x56348fe37820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51982/0 (socket says 172.21.15.70:51982) 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70dd9b700 1 -- 172.21.15.70:0/3248767022 learned_addr learned my addr 172.21.15.70:0/3248767022 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70e59c700 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 0x56348fe3a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70ed9d700 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe37e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70dd9b700 1 -- 172.21.15.70:0/3248767022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 msgr2=0x56348fe37e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe37e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70dd9b700 1 -- 172.21.15.70:0/3248767022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 msgr2=0x56348fe3a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 0x56348fe3a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70dd9b700 1 -- 172.21.15.70:0/3248767022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7101a38d0 con 0x56348fe2b7a0 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70e59c700 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 0x56348fe3a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2b7a0 0x56348fe37820 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc704009ee0 tx=0x7fc70400f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd1d278735b4204 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc6f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/3248767022 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704004220 con 0x56348fe2b7a0 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/3248767022 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc704015070 con 0x56348fe2b7a0 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc720a90b80 1 -- 172.21.15.70:0/3248767022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56348fd46eb0 con 0x56348fe2b7a0 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/3248767022 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc704004380 con 0x56348fe2b7a0 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc720a90b80 10 client.16110 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.245+0000 7fc720a90b80 1 -- 172.21.15.70:0/3248767022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56348fb92c60 con 0x56348fe2b7a0 2023-10-08T08:44:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/3248767022 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56348fd46eb0 con 0x56348fe2b7a0 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/3248767022 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc704011560 con 0x56348fe2b7a0 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc720a90b80 10 client.16110 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc720a90b80 10 client.16110 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc720a90b80 20 client.16110 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc720a90b80 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56348fe4a6b0 0x56348fe4cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc720a90b80 4 client.16110 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc720a90b80 1 -- 172.21.15.70:0/3248767022 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56348fd77e10 con 0x56348fe4a6b0 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc70e59c700 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56348fe4a6b0 0x56348fe4cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc6f5ffb700 10 client.16110 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.246+0000 7fc70e59c700 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56348fe4a6b0 0x56348fe4cad0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4cb38b388c257d1b server_cookie=6f01afd1f37702d0 in_seq=0 out_seq=0 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/3248767022 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56348fd77e10 con 0x56348fe4a6b0 2023-10-08T08:44:56.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc6f5ffb700 10 client.16110 handle_command_reply: tid=0 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 client.16110 shutdown 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 -- 172.21.15.70:0/3248767022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2b7a0 msgr2=0x56348fe37820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2b7a0 0x56348fe37820 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc704009ee0 tx=0x7fc70400f640 comp rx=0 tx=0).stop 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 -- 172.21.15.70:0/3248767022 shutdown_connections 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56348fe4a6b0 0x56348fe4cad0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe37e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc6f5ffb700 0 client.16110 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2ae80 0x56348fe3a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 --2- 172.21.15.70:0/3248767022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2b7a0 0x56348fe37820 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 -- 172.21.15.70:0/3248767022 >> 172.21.15.70:0/3248767022 conn(0x56348fda0260 msgr2=0x56348fe26ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 -- 172.21.15.70:0/3248767022 shutdown_connections 2023-10-08T08:44:56.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.247+0000 7fc720a90b80 1 -- 172.21.15.70:0/3248767022 wait complete. 2023-10-08T08:44:56.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.248+0000 7fc720a90b80 20 client.16110 trim_cache size 0 max 16384 2023-10-08T08:44:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.260+0000 7fc720a90b80 1 Processor -- start 2023-10-08T08:44:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.260+0000 7fc720a90b80 1 -- start start 2023-10-08T08:44:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.260+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe37e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.260+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 0x56348fe415b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.260+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe36110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.260+0000 7fc720a90b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fbff920 con 0x56348fe2ae80 2023-10-08T08:44:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.260+0000 7fc720a90b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fe28790 con 0x56348fe2b7a0 2023-10-08T08:44:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.260+0000 7fc720a90b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fe32710 con 0x56348fe3aa60 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.260+0000 7fc70e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe37e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc70e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe37e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51988/0 (socket says 172.21.15.70:51988) 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc70e59c700 1 -- 172.21.15.70:0/2802946020 learned_addr learned my addr 172.21.15.70:0/2802946020 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/2802946020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 0x56348fe415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc70e59c700 1 -- 172.21.15.70:0/2802946020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 msgr2=0x56348fe36110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc70e59c700 1 --2- 172.21.15.70:0/2802946020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe36110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc70e59c700 1 -- 172.21.15.70:0/2802946020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 msgr2=0x56348fe415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc70e59c700 1 --2- 172.21.15.70:0/2802946020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 0x56348fe415b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc70e59c700 1 -- 172.21.15.70:0/2802946020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56348fbd0250 con 0x56348fe2ae80 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc70e59c700 1 --2- 172.21.15.70:0/2802946020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe37e10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc700000c00 tx=0x7fc70001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06f9343d89fc3f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc6fd7fa700 1 -- 172.21.15.70:0/2802946020 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70002a040 con 0x56348fe2ae80 2023-10-08T08:44:56.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc6fd7fa700 1 -- 172.21.15.70:0/2802946020 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc70002b040 con 0x56348fe2ae80 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc6fd7fa700 1 -- 172.21.15.70:0/2802946020 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70001d040 con 0x56348fe2ae80 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc720a90b80 1 -- 172.21.15.70:0/2802946020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 msgr2=0x56348fe37e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.261+0000 7fc720a90b80 1 --2- 172.21.15.70:0/2802946020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe37e10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc700000c00 tx=0x7fc70001e000 comp rx=0 tx=0).stop 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 -- 172.21.15.70:0/2802946020 shutdown_connections 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 --2- 172.21.15.70:0/2802946020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe36110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 --2- 172.21.15.70:0/2802946020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe37e10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 --2- 172.21.15.70:0/2802946020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 0x56348fe415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 -- 172.21.15.70:0/2802946020 >> 172.21.15.70:0/2802946020 conn(0x56348fda0260 msgr2=0x56348fe264d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 -- 172.21.15.70:0/2802946020 shutdown_connections 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 -- 172.21.15.70:0/2802946020 wait complete. 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 -- start start 2023-10-08T08:44:56.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 Processor -- start 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe3f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 0x56348fe3fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe9d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fe40380 con 0x56348fe2ae80 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fe9da20 con 0x56348fe2b7a0 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348fe9db60 con 0x56348fe3aa60 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc720a90b80 10 client.0 _ll_register_callbacks cb 0x7fc704009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc70e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe3f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc70e59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe3f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51994/0 (socket says 172.21.15.70:51994) 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc70e59c700 1 -- 172.21.15.70:0/436596773 learned_addr learned my addr 172.21.15.70:0/436596773 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.262+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 0x56348fe3fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc70ed9d700 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe9d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc70e59c700 1 -- 172.21.15.70:0/436596773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 msgr2=0x56348fe9d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc70e59c700 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe9d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc70e59c700 1 -- 172.21.15.70:0/436596773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 msgr2=0x56348fe3fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc70e59c700 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 0x56348fe3fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc70e59c700 1 -- 172.21.15.70:0/436596773 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71010cda0 con 0x56348fe2ae80 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc70ed9d700 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe9d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 0x56348fe3fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc70e59c700 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe3f780 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c010 tx=0x7fc7000047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f0ccb96460e3fd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc6f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/436596773 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70001d050 con 0x56348fe2ae80 2023-10-08T08:44:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/436596773 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc7000342b0 con 0x56348fe2ae80 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc720a90b80 1 -- 172.21.15.70:0/436596773 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc708099300 con 0x56348fe2ae80 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/436596773 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc70002a040 con 0x56348fe2ae80 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc720a90b80 10 client.16116 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc720a90b80 1 -- 172.21.15.70:0/436596773 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56348fba82b0 con 0x56348fe2ae80 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/436596773 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc708099300 con 0x56348fe2ae80 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/436596773 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc700045070 con 0x56348fe2ae80 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc720a90b80 10 client.16116 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc720a90b80 10 client.16116 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc720a90b80 20 client.16116 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc720a90b80 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56348fe9ef10 0x56348fea1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc720a90b80 4 client.16116 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:56.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.263+0000 7fc720a90b80 1 -- 172.21.15.70:0/436596773 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56348fd77b30 con 0x56348fe9ef10 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56348fe9ef10 0x56348fea1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc70dd9b700 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56348fe9ef10 0x56348fea1330 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=77520dbd7ac1b3ea server_cookie=8853a077b34be06c in_seq=0 out_seq=0 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc6f5ffb700 10 client.16116 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc6f5ffb700 1 -- 172.21.15.70:0/436596773 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56348fd77b30 con 0x56348fe9ef10 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc6f5ffb700 10 client.16116 handle_command_reply: tid=0 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc720a90b80 1 client.16116 shutdown 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc720a90b80 1 -- 172.21.15.70:0/436596773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 msgr2=0x56348fe3f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc720a90b80 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe3f780 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c010 tx=0x7fc7000047a0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc720a90b80 1 -- 172.21.15.70:0/436596773 shutdown_connections 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc720a90b80 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56348fe9ef10 0x56348fea1330 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc720a90b80 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56348fe3aa60 0x56348fe9d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc6f5ffb700 0 client.16116 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:44:56.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc720a90b80 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56348fe2ae80 0x56348fe3f780 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc720a90b80 1 --2- 172.21.15.70:0/436596773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56348fe2b7a0 0x56348fe3fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.264+0000 7fc720a90b80 1 -- 172.21.15.70:0/436596773 >> 172.21.15.70:0/436596773 conn(0x56348fda0260 msgr2=0x56348fe26cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc720a90b80 1 -- 172.21.15.70:0/436596773 shutdown_connections 2023-10-08T08:44:56.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc720a90b80 1 -- 172.21.15.70:0/436596773 wait complete. 2023-10-08T08:44:56.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc720a90b80 20 client.16116 trim_cache size 0 max 16384 2023-10-08T08:44:56.273 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:56.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 -- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc6f80a1670 msgr2=0x7fc6f80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc6f80a1670 0x7fc6f80a3b30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc700005850 tx=0x7fc70001a040 comp rx=0 tx=0).stop 2023-10-08T08:44:56.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 -- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 msgr2=0x7fc710196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 0x7fc710196a60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc708007ee0 tx=0x7fc70800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 -- 172.21.15.70:0/281344896 shutdown_connections 2023-10-08T08:44:56.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc6f80a1670 0x7fc6f80a3b30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc710105660 0x7fc710196a60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7100ffdd0 0x7fc71019c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 --2- 172.21.15.70:0/281344896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc710100790 0x7fc71019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 -- 172.21.15.70:0/281344896 >> 172.21.15.70:0/281344896 conn(0x7fc710075c20 msgr2=0x7fc7100fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 -- 172.21.15.70:0/281344896 shutdown_connections 2023-10-08T08:44:56.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.265+0000 7fc7148a7700 1 -- 172.21.15.70:0/281344896 wait complete. 2023-10-08T08:44:56.278 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T08:44:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.400+0000 7f942c33b700 1 -- 172.21.15.70:0/739658339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 msgr2=0x7f942410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.400+0000 7f942c33b700 1 --2- 172.21.15.70:0/739658339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 0x7f942410c4e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f941400b0a0 tx=0x7f941400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.400+0000 7f942c33b700 1 -- 172.21.15.70:0/739658339 shutdown_connections 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.400+0000 7f942c33b700 1 --2- 172.21.15.70:0/739658339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 0x7f942410c4e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.400+0000 7f942c33b700 1 --2- 172.21.15.70:0/739658339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94241056b0 0x7f9424105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.400+0000 7f942c33b700 1 --2- 172.21.15.70:0/739658339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240ff620 0x7f94240ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.400+0000 7f942c33b700 1 -- 172.21.15.70:0/739658339 >> 172.21.15.70:0/739658339 conn(0x7f9424076780 msgr2=0x7f9424076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.400+0000 7f942c33b700 1 -- 172.21.15.70:0/739658339 shutdown_connections 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.400+0000 7f942c33b700 1 -- 172.21.15.70:0/739658339 wait complete. 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942c33b700 1 Processor -- start 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942c33b700 1 -- start start 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942c33b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94240ff620 0x7f9424196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942c33b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 0x7f9424196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942c33b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94241056b0 0x7f942419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942c33b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942419b940 con 0x7f94240fffe0 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942c33b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942419bab0 con 0x7f94241056b0 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942c33b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942419bc70 con 0x7f94240ff620 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94298d6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 0x7f9424196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94298d6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 0x7f9424196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52010/0 (socket says 172.21.15.70:52010) 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94298d6700 1 -- 172.21.15.70:0/3862749264 learned_addr learned my addr 172.21.15.70:0/3862749264 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942a0d7700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94240ff620 0x7f9424196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942a8d8700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94241056b0 0x7f942419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94298d6700 1 -- 172.21.15.70:0/3862749264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94240ff620 msgr2=0x7f9424196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94298d6700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94240ff620 0x7f9424196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94298d6700 1 -- 172.21.15.70:0/3862749264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94241056b0 msgr2=0x7f942419b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94298d6700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94241056b0 0x7f942419b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94298d6700 1 -- 172.21.15.70:0/3862749264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009d00 con 0x7f94240fffe0 2023-10-08T08:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f942a0d7700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94240ff620 0x7f9424196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94298d6700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 0x7f9424196fa0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f941800e9a0 tx=0x7f941800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.401+0000 7f94237fe700 1 -- 172.21.15.70:0/3862749264 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418009790 con 0x7f94240fffe0 2023-10-08T08:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.402+0000 7f94237fe700 1 -- 172.21.15.70:0/3862749264 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f941800cbd0 con 0x7f94240fffe0 2023-10-08T08:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.402+0000 7f942c33b700 1 -- 172.21.15.70:0/3862749264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942419bf50 con 0x7f94240fffe0 2023-10-08T08:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.402+0000 7f94237fe700 1 -- 172.21.15.70:0/3862749264 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418018680 con 0x7f94240fffe0 2023-10-08T08:44:56.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.402+0000 7f942c33b700 1 -- 172.21.15.70:0/3862749264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94241a3800 con 0x7f94240fffe0 2023-10-08T08:44:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.404+0000 7f94237fe700 1 -- 172.21.15.70:0/3862749264 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f941800cd40 con 0x7f94240fffe0 2023-10-08T08:44:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.404+0000 7f94237fe700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f940c0a15f0 0x7f940c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.404+0000 7f942a0d7700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f940c0a15f0 0x7f940c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.404+0000 7f94237fe700 1 -- 172.21.15.70:0/3862749264 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9418014070 con 0x7f94240fffe0 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.405+0000 7f942a0d7700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f940c0a15f0 0x7f940c0a3ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f941c005950 tx=0x7f941c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.405+0000 7f9438524b80 1 Processor -- start 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.405+0000 7f9438524b80 1 -- start start 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.405+0000 7f9438524b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 0x55ee47bea260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.405+0000 7f9438524b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bf5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f9438524b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bf7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f9438524b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47b53460 con 0x55ee47bf5650 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f9438524b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47b44c20 con 0x55ee47bea7a0 2023-10-08T08:44:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f9438524b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47b42540 con 0x55ee47be9e80 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a8d8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bf7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a8d8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bf7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52020/0 (socket says 172.21.15.70:52020) 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a8d8700 1 -- 172.21.15.70:0/1955024393 learned_addr learned my addr 172.21.15.70:0/1955024393 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f94298d6700 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bf5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a0d7700 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 0x55ee47bea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a8d8700 1 -- 172.21.15.70:0/1955024393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 msgr2=0x55ee47bea260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a8d8700 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 0x55ee47bea260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a8d8700 1 -- 172.21.15.70:0/1955024393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 msgr2=0x55ee47bf5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a8d8700 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bf5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a8d8700 1 -- 172.21.15.70:0/1955024393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee47968de0 con 0x55ee47bf5650 2023-10-08T08:44:56.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f94298d6700 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bf5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f942a8d8700 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bf7a40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9414009cc0 tx=0x7f9414009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b68eda25def98b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f9420d82700 1 -- 172.21.15.70:0/1955024393 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400e050 con 0x55ee47bf5650 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f9420d82700 1 -- 172.21.15.70:0/1955024393 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9414007e00 con 0x55ee47bf5650 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.406+0000 7f9420d82700 1 -- 172.21.15.70:0/1955024393 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414007960 con 0x55ee47bf5650 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 -- 172.21.15.70:0/1955024393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 msgr2=0x55ee47bf7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bf7a40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9414009cc0 tx=0x7f9414009450 comp rx=0 tx=0).stop 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 -- 172.21.15.70:0/1955024393 shutdown_connections 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bf7a40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 0x55ee47bea260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 --2- 172.21.15.70:0/1955024393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bf5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 -- 172.21.15.70:0/1955024393 >> 172.21.15.70:0/1955024393 conn(0x55ee47b5f260 msgr2=0x55ee47be62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 -- 172.21.15.70:0/1955024393 shutdown_connections 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 -- 172.21.15.70:0/1955024393 wait complete. 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 -- start start 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.407+0000 7f9438524b80 1 Processor -- start 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f9438524b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47bf4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f9438524b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bf22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f9438524b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 0x55ee47bf28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f9438524b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47b3de30 con 0x55ee47be9e80 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f9438524b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47ada710 con 0x55ee47bea7a0 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f9438524b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47ada3b0 con 0x55ee47bf5650 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f9438524b80 10 client.0 _ll_register_callbacks cb 0x55ee47937800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a0d7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47bf4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a0d7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47bf4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52022/0 (socket says 172.21.15.70:52022) 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a0d7700 1 -- 172.21.15.70:0/716639594 learned_addr learned my addr 172.21.15.70:0/716639594 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f94298d6700 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bf22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a8d8700 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 0x55ee47bf28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a0d7700 1 -- 172.21.15.70:0/716639594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 msgr2=0x55ee47bf28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a0d7700 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 0x55ee47bf28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a0d7700 1 -- 172.21.15.70:0/716639594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 msgr2=0x55ee47bf22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a0d7700 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bf22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a0d7700 1 -- 172.21.15.70:0/716639594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94241a3800 con 0x55ee47be9e80 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a8d8700 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 0x55ee47bf28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f942a0d7700 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47bf4fc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f941c00ffd0 tx=0x7f941c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a2f4abba4fc913 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.408+0000 7f9409ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9409ffb700 1 -- 172.21.15.70:0/716639594 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c028670 con 0x55ee47be9e80 2023-10-08T08:44:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9438524b80 1 -- 172.21.15.70:0/716639594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee47b05eb0 con 0x55ee47be9e80 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9409ffb700 1 -- 172.21.15.70:0/716639594 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f941c01f430 con 0x55ee47be9e80 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9409ffb700 1 -- 172.21.15.70:0/716639594 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f941c0287d0 con 0x55ee47be9e80 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9438524b80 10 client.16128 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9438524b80 1 -- 172.21.15.70:0/716639594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f942410cde0 con 0x55ee47be9e80 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9409ffb700 1 -- 172.21.15.70:0/716639594 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee47b05eb0 con 0x55ee47be9e80 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9409ffb700 1 -- 172.21.15.70:0/716639594 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f941c01fcd0 con 0x55ee47be9e80 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9438524b80 10 client.16128 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9438524b80 10 client.16128 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9438524b80 20 client.16128 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9438524b80 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55ee47c050d0 0x55ee47c074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9438524b80 4 client.16128 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f9438524b80 1 -- 172.21.15.70:0/716639594 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee47b36e10 con 0x55ee47c050d0 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.409+0000 7f94298d6700 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55ee47c050d0 0x55ee47c074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.410+0000 7f9409ffb700 10 client.16128 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.410+0000 7f94298d6700 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55ee47c050d0 0x55ee47c074f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c67ee7e1515a8622 server_cookie=4b7eb1eaa7abc152 in_seq=0 out_seq=0 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.410+0000 7f9409ffb700 1 -- 172.21.15.70:0/716639594 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee47b36e10 con 0x55ee47c050d0 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.410+0000 7f9409ffb700 10 client.16128 handle_command_reply: tid=0 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.410+0000 7f9438524b80 1 client.16128 shutdown 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 -- 172.21.15.70:0/716639594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 msgr2=0x55ee47bf4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47bf4fc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f941c00ffd0 tx=0x7f941c004750 comp rx=0 tx=0).stop 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 -- 172.21.15.70:0/716639594 shutdown_connections 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55ee47c050d0 0x55ee47c074f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 0x55ee47bf28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47bf4fc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9409ffb700 0 client.16128 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:44:56.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 --2- 172.21.15.70:0/716639594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bf22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 -- 172.21.15.70:0/716639594 >> 172.21.15.70:0/716639594 conn(0x55ee47b5f260 msgr2=0x55ee47be5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 -- 172.21.15.70:0/716639594 shutdown_connections 2023-10-08T08:44:56.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 1 -- 172.21.15.70:0/716639594 wait complete. 2023-10-08T08:44:56.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.411+0000 7f9438524b80 20 client.16128 trim_cache size 0 max 16384 2023-10-08T08:44:56.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.423+0000 7f9438524b80 1 Processor -- start 2023-10-08T08:44:56.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.423+0000 7f9438524b80 1 -- start start 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.423+0000 7f9438524b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47c00890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.423+0000 7f9438524b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47c00dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f9438524b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 0x55ee47bef510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f9438524b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee479be920 con 0x55ee47be9e80 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f9438524b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47be78e0 con 0x55ee47bea7a0 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f9438524b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47be50e0 con 0x55ee47bf5650 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f942a0d7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47c00890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f942a0d7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47c00890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52030/0 (socket says 172.21.15.70:52030) 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f942a0d7700 1 -- 172.21.15.70:0/2121730956 learned_addr learned my addr 172.21.15.70:0/2121730956 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f94298d6700 1 --2- 172.21.15.70:0/2121730956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47c00dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f942a0d7700 1 -- 172.21.15.70:0/2121730956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 msgr2=0x55ee47bef510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f942a0d7700 1 --2- 172.21.15.70:0/2121730956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 0x55ee47bef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f942a0d7700 1 -- 172.21.15.70:0/2121730956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 msgr2=0x55ee47c00dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f942a0d7700 1 --2- 172.21.15.70:0/2121730956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47c00dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f942a0d7700 1 -- 172.21.15.70:0/2121730956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee47951c60 con 0x55ee47be9e80 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f94298d6700 1 --2- 172.21.15.70:0/2121730956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47c00dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f942a0d7700 1 --2- 172.21.15.70:0/2121730956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47c00890 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f941c01e4b0 tx=0x7f941c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c338ff2e9cb79a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f9421583700 1 -- 172.21.15.70:0/2121730956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c01e8a0 con 0x55ee47be9e80 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f9421583700 1 -- 172.21.15.70:0/2121730956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f941c028470 con 0x55ee47be9e80 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.424+0000 7f9421583700 1 -- 172.21.15.70:0/2121730956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c01f690 con 0x55ee47be9e80 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 -- 172.21.15.70:0/2121730956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 msgr2=0x55ee47c00890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 --2- 172.21.15.70:0/2121730956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47c00890 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f941c01e4b0 tx=0x7f941c011f20 comp rx=0 tx=0).stop 2023-10-08T08:44:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 -- 172.21.15.70:0/2121730956 shutdown_connections 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 --2- 172.21.15.70:0/2121730956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47bf5650 0x55ee47bef510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 --2- 172.21.15.70:0/2121730956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47be9e80 0x55ee47c00890 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 --2- 172.21.15.70:0/2121730956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47c00dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 -- 172.21.15.70:0/2121730956 >> 172.21.15.70:0/2121730956 conn(0x55ee47b5f260 msgr2=0x55ee47bf0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 -- 172.21.15.70:0/2121730956 shutdown_connections 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 -- 172.21.15.70:0/2121730956 wait complete. 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 -- start start 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 Processor -- start 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 0x55ee47bfa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bfaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bfb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47c58f30 con 0x55ee47bf5650 2023-10-08T08:44:56.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47c59070 con 0x55ee47bea7a0 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee47c591b0 con 0x55ee47be9e80 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f9438524b80 10 client.0 _ll_register_callbacks cb 0x7f941c00fbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.425+0000 7f942a8d8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bfb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f942a8d8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bfb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52040/0 (socket says 172.21.15.70:52040) 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f942a8d8700 1 -- 172.21.15.70:0/947739340 learned_addr learned my addr 172.21.15.70:0/947739340 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f94298d6700 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bfaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f942a0d7700 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 0x55ee47bfa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f942a8d8700 1 -- 172.21.15.70:0/947739340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 msgr2=0x55ee47bfa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f942a8d8700 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 0x55ee47bfa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f942a8d8700 1 -- 172.21.15.70:0/947739340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 msgr2=0x55ee47bfaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f942a8d8700 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bfaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f942a8d8700 1 -- 172.21.15.70:0/947739340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942410cde0 con 0x55ee47bf5650 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f94298d6700 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bfaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f942a8d8700 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bfb3f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9414005ad0 tx=0x7f941400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0cd5bd4316d336 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f9409ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f9409ffb700 1 -- 172.21.15.70:0/947739340 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414004a50 con 0x55ee47bf5650 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f9409ffb700 1 -- 172.21.15.70:0/947739340 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9414004bb0 con 0x55ee47bf5650 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f9438524b80 1 -- 172.21.15.70:0/947739340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9414007e00 con 0x55ee47bf5650 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f9409ffb700 1 -- 172.21.15.70:0/947739340 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f941400e020 con 0x55ee47bf5650 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f9438524b80 10 client.16134 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f9438524b80 1 -- 172.21.15.70:0/947739340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ee4798f250 con 0x55ee47bf5650 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.426+0000 7f9409ffb700 1 -- 172.21.15.70:0/947739340 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9414007e00 con 0x55ee47bf5650 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9409ffb700 1 -- 172.21.15.70:0/947739340 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f941400b0d0 con 0x55ee47bf5650 2023-10-08T08:44:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9438524b80 10 client.16134 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9438524b80 10 client.16134 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9438524b80 20 client.16134 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9438524b80 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55ee47c5a5b0 0x55ee47c5c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9438524b80 4 client.16134 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9438524b80 1 -- 172.21.15.70:0/947739340 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ee47b36b30 con 0x55ee47c5a5b0 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f942a0d7700 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55ee47c5a5b0 0x55ee47c5c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9409ffb700 10 client.16134 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f942a0d7700 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55ee47c5a5b0 0x55ee47c5c9d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9e246fac5be658a server_cookie=770a91fb51c3a78d in_seq=0 out_seq=0 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9409ffb700 1 -- 172.21.15.70:0/947739340 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ee47b36b30 con 0x55ee47c5a5b0 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9409ffb700 10 client.16134 handle_command_reply: tid=0 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.427+0000 7f9438524b80 1 client.16134 shutdown 2023-10-08T08:44:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 -- 172.21.15.70:0/947739340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 msgr2=0x55ee47bfb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bfb3f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9414005ad0 tx=0x7f941400cea0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 -- 172.21.15.70:0/947739340 shutdown_connections 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55ee47c5a5b0 0x55ee47c5c9d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee47bf5650 0x55ee47bfb3f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9409ffb700 0 client.16134 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ee47be9e80 0x55ee47bfa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 --2- 172.21.15.70:0/947739340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee47bea7a0 0x55ee47bfaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 -- 172.21.15.70:0/947739340 >> 172.21.15.70:0/947739340 conn(0x55ee47b5f260 msgr2=0x55ee47c00890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 -- 172.21.15.70:0/947739340 shutdown_connections 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 1 -- 172.21.15.70:0/947739340 wait complete. 2023-10-08T08:44:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f9438524b80 20 client.16134 trim_cache size 0 max 16384 2023-10-08T08:44:56.437 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:56.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 -- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f940c0a15f0 msgr2=0x7f940c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f940c0a15f0 0x7f940c0a3ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f941c005950 tx=0x7f941c0058e0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 -- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 msgr2=0x7f9424196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 0x7f9424196fa0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f941800e9a0 tx=0x7f941800ed60 comp rx=0 tx=0).stop 2023-10-08T08:44:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 -- 172.21.15.70:0/3862749264 shutdown_connections 2023-10-08T08:44:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f940c0a15f0 0x7f940c0a3ab0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94241056b0 0x7f942419b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94240ff620 0x7f9424196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 --2- 172.21.15.70:0/3862749264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94240fffe0 0x7f9424196fa0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 -- 172.21.15.70:0/3862749264 >> 172.21.15.70:0/3862749264 conn(0x7f9424076780 msgr2=0x7f94240fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 -- 172.21.15.70:0/3862749264 shutdown_connections 2023-10-08T08:44:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.428+0000 7f942c33b700 1 -- 172.21.15.70:0/3862749264 wait complete. 2023-10-08T08:44:56.441 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T08:44:56.464 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:56 smithi070 ceph-mon[99513]: pgmap v324: 129 pgs: 129 active+clean; 3.3 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-08T08:44:56.464 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:56 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/548219367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:44:56.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:56 smithi105 ceph-mon[103798]: pgmap v324: 129 pgs: 129 active+clean; 3.3 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-08T08:44:56.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:56 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/548219367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:44:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.563+0000 7f584041a700 1 -- 172.21.15.70:0/2578071960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5838105b80 msgr2=0x7f583810d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.563+0000 7f584041a700 1 --2- 172.21.15.70:0/2578071960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5838105b80 0x7f583810d590 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f583000b0d0 tx=0x7f583000b3e0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.563+0000 7f584041a700 1 -- 172.21.15.70:0/2578071960 shutdown_connections 2023-10-08T08:44:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.563+0000 7f584041a700 1 --2- 172.21.15.70:0/2578071960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5838105b80 0x7f583810d590 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.563+0000 7f584041a700 1 --2- 172.21.15.70:0/2578071960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5838067ce0 0x7f58380680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.563+0000 7f584041a700 1 --2- 172.21.15.70:0/2578071960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58381051c0 0x7f5838105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.563+0000 7f584041a700 1 -- 172.21.15.70:0/2578071960 >> 172.21.15.70:0/2578071960 conn(0x7f5838076780 msgr2=0x7f5838076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.563+0000 7f584041a700 1 -- 172.21.15.70:0/2578071960 shutdown_connections 2023-10-08T08:44:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.563+0000 7f584041a700 1 -- 172.21.15.70:0/2578071960 wait complete. 2023-10-08T08:44:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f584041a700 1 Processor -- start 2023-10-08T08:44:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f584041a700 1 -- start start 2023-10-08T08:44:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f584041a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838067ce0 0x7f583819c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f584041a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58381051c0 0x7f583819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f584041a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5838105b80 0x7f5838196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f584041a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5838197180 con 0x7f58381051c0 2023-10-08T08:44:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f584041a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58381972f0 con 0x7f5838105b80 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f584041a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58381974b0 con 0x7f5838067ce0 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583d9b5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58381051c0 0x7f583819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583d9b5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58381051c0 0x7f583819cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52052/0 (socket says 172.21.15.70:52052) 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583d9b5700 1 -- 172.21.15.70:0/3529820986 learned_addr learned my addr 172.21.15.70:0/3529820986 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583e9b7700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5838105b80 0x7f5838196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583e1b6700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838067ce0 0x7f583819c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583d9b5700 1 -- 172.21.15.70:0/3529820986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838067ce0 msgr2=0x7f583819c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583d9b5700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838067ce0 0x7f583819c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583d9b5700 1 -- 172.21.15.70:0/3529820986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5838105b80 msgr2=0x7f5838196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583d9b5700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5838105b80 0x7f5838196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583d9b5700 1 -- 172.21.15.70:0/3529820986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830009d00 con 0x7f58381051c0 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.564+0000 7f583e9b7700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5838105b80 0x7f5838196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.565+0000 7f583d9b5700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58381051c0 0x7f583819cf30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f583400e9a0 tx=0x7f583400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.565+0000 7f582f7fe700 1 -- 172.21.15.70:0/3529820986 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834009790 con 0x7f58381051c0 2023-10-08T08:44:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.565+0000 7f582f7fe700 1 -- 172.21.15.70:0/3529820986 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f583400cbd0 con 0x7f58381051c0 2023-10-08T08:44:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.565+0000 7f584041a700 1 -- 172.21.15.70:0/3529820986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5838197790 con 0x7f58381051c0 2023-10-08T08:44:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.565+0000 7f582f7fe700 1 -- 172.21.15.70:0/3529820986 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834018680 con 0x7f58381051c0 2023-10-08T08:44:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.565+0000 7f584041a700 1 -- 172.21.15.70:0/3529820986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58381a39e0 con 0x7f58381051c0 2023-10-08T08:44:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.567+0000 7f582f7fe700 1 -- 172.21.15.70:0/3529820986 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f583400cd40 con 0x7f58381051c0 2023-10-08T08:44:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.567+0000 7f582f7fe700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f58240a1670 0x7f58240a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.567+0000 7f582f7fe700 1 -- 172.21.15.70:0/3529820986 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5834014070 con 0x7f58381051c0 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.567+0000 7f583e1b6700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f58240a1670 0x7f58240a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.568+0000 7f583e1b6700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f58240a1670 0x7f58240a3b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5828005950 tx=0x7f58280058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.568+0000 7f584c603b80 1 Processor -- start 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.568+0000 7f584c603b80 1 -- start start 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f584c603b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9ae80 0x563322e9b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f584c603b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322ea6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f584c603b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322ea8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f584c603b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322e04460 con 0x563322ea6650 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f584c603b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322df5c20 con 0x563322e9ae80 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f584c603b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322df3540 con 0x563322e9b7a0 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e9b7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322ea8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e9b7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322ea8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52062/0 (socket says 172.21.15.70:52062) 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e9b7700 1 -- 172.21.15.70:0/536755098 learned_addr learned my addr 172.21.15.70:0/536755098 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583d9b5700 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322ea6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e1b6700 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9ae80 0x563322e9b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e9b7700 1 -- 172.21.15.70:0/536755098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 msgr2=0x563322ea6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e9b7700 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322ea6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e9b7700 1 -- 172.21.15.70:0/536755098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9ae80 msgr2=0x563322e9b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e9b7700 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9ae80 0x563322e9b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e9b7700 1 -- 172.21.15.70:0/536755098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563322c19de0 con 0x563322ea6650 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583d9b5700 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322ea6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.569+0000 7f583e9b7700 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322ea8a40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5830009310 tx=0x7f5830009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdeb705700a7002 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f582cd82700 1 -- 172.21.15.70:0/536755098 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583000e040 con 0x563322ea6650 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f582cd82700 1 -- 172.21.15.70:0/536755098 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5830007d00 con 0x563322ea6650 2023-10-08T08:44:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f582cd82700 1 -- 172.21.15.70:0/536755098 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830007840 con 0x563322ea6650 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f584c603b80 1 -- 172.21.15.70:0/536755098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 msgr2=0x563322ea8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f584c603b80 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322ea8a40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5830009310 tx=0x7f5830009340 comp rx=0 tx=0).stop 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f584c603b80 1 -- 172.21.15.70:0/536755098 shutdown_connections 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f584c603b80 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322ea8a40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f584c603b80 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9ae80 0x563322e9b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f584c603b80 1 --2- 172.21.15.70:0/536755098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322ea6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f584c603b80 1 -- 172.21.15.70:0/536755098 >> 172.21.15.70:0/536755098 conn(0x563322e10260 msgr2=0x563322e972d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f584c603b80 1 -- 172.21.15.70:0/536755098 shutdown_connections 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.570+0000 7f584c603b80 1 -- 172.21.15.70:0/536755098 wait complete. 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f584c603b80 1 -- start start 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f584c603b80 1 Processor -- start 2023-10-08T08:44:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f584c603b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ea5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f584c603b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322ea32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f584c603b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 0x563322ea38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f584c603b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322deee30 con 0x563322e9ae80 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f584c603b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322d8b710 con 0x563322ea6650 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f584c603b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322d8b3b0 con 0x563322e9b7a0 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f583e1b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ea5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f584c603b80 10 client.0 _ll_register_callbacks cb 0x563322be8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f583e1b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ea5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52064/0 (socket says 172.21.15.70:52064) 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f583e1b6700 1 -- 172.21.15.70:0/971646357 learned_addr learned my addr 172.21.15.70:0/971646357 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.571+0000 7f583e9b7700 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 0x563322ea38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f583e1b6700 1 -- 172.21.15.70:0/971646357 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 msgr2=0x563322ea32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f583e1b6700 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322ea32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f583e1b6700 1 -- 172.21.15.70:0/971646357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 msgr2=0x563322ea38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f583e1b6700 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 0x563322ea38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f583e1b6700 1 -- 172.21.15.70:0/971646357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583810dec0 con 0x563322e9ae80 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f583e1b6700 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ea5fc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f58280116f0 tx=0x7f5828004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6232fe407b1421b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f5821ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f5821ffb700 1 -- 172.21.15.70:0/971646357 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582801f830 con 0x563322e9ae80 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f5821ffb700 1 -- 172.21.15.70:0/971646357 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f582801f990 con 0x563322e9ae80 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f584c603b80 1 -- 172.21.15.70:0/971646357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563322db6eb0 con 0x563322e9ae80 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f5821ffb700 1 -- 172.21.15.70:0/971646357 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f582801fb50 con 0x563322e9ae80 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f584c603b80 10 client.16146 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f584c603b80 1 -- 172.21.15.70:0/971646357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563322c02c60 con 0x563322e9ae80 2023-10-08T08:44:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f5821ffb700 1 -- 172.21.15.70:0/971646357 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563322db6eb0 con 0x563322e9ae80 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f5821ffb700 1 -- 172.21.15.70:0/971646357 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5828005140 con 0x563322e9ae80 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f584c603b80 10 client.16146 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f584c603b80 10 client.16146 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f584c603b80 20 client.16146 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f584c603b80 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x563322eb6140 0x563322eb8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f584c603b80 4 client.16146 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.572+0000 7f584c603b80 1 -- 172.21.15.70:0/971646357 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563322de7e10 con 0x563322eb6140 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.573+0000 7f583d9b5700 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x563322eb6140 0x563322eb8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.573+0000 7f583d9b5700 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x563322eb6140 0x563322eb8560 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed572f3a38621a5a server_cookie=4744dc5bd6abd4a6 in_seq=0 out_seq=0 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.573+0000 7f5821ffb700 10 client.16146 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f5821ffb700 1 -- 172.21.15.70:0/971646357 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563322de7e10 con 0x563322eb6140 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f5821ffb700 10 client.16146 handle_command_reply: tid=0 2023-10-08T08:44:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 client.16146 shutdown 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 -- 172.21.15.70:0/971646357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 msgr2=0x563322ea5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ea5fc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f58280116f0 tx=0x7f5828004750 comp rx=0 tx=0).stop 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 -- 172.21.15.70:0/971646357 shutdown_connections 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x563322eb6140 0x563322eb8560 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 0x563322ea38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f5821ffb700 0 client.16146 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ea5fc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 --2- 172.21.15.70:0/971646357 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322ea32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 -- 172.21.15.70:0/971646357 >> 172.21.15.70:0/971646357 conn(0x563322e10260 msgr2=0x563322e96ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 -- 172.21.15.70:0/971646357 shutdown_connections 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 1 -- 172.21.15.70:0/971646357 wait complete. 2023-10-08T08:44:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.574+0000 7f584c603b80 20 client.16146 trim_cache size 0 max 16384 2023-10-08T08:44:56.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.586+0000 7f584c603b80 1 Processor -- start 2023-10-08T08:44:56.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f584c603b80 1 -- start start 2023-10-08T08:44:56.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f584c603b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9ae80 0x563322e9dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f584c603b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9b7a0 0x563322eb1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f584c603b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322eb1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f584c603b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322c6f920 con 0x563322ea6650 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f584c603b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322e93ae0 con 0x563322e9b7a0 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f584c603b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322e960b0 con 0x563322e9ae80 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e9b7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322eb1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e9b7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322eb1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52076/0 (socket says 172.21.15.70:52076) 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e9b7700 1 -- 172.21.15.70:0/2377228639 learned_addr learned my addr 172.21.15.70:0/2377228639 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e1b6700 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9ae80 0x563322e9dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583d9b5700 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9b7a0 0x563322eb1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e9b7700 1 -- 172.21.15.70:0/2377228639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9ae80 msgr2=0x563322e9dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e9b7700 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9ae80 0x563322e9dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e9b7700 1 -- 172.21.15.70:0/2377228639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9b7a0 msgr2=0x563322eb1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e9b7700 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9b7a0 0x563322eb1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e9b7700 1 -- 172.21.15.70:0/2377228639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563322c40250 con 0x563322ea6650 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583d9b5700 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9b7a0 0x563322eb1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f583e9b7700 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322eb1dd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5830004f50 tx=0x7f583000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5870d9114fb414e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f582d583700 1 -- 172.21.15.70:0/2377228639 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583000e040 con 0x563322ea6650 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.587+0000 7f582d583700 1 -- 172.21.15.70:0/2377228639 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5830004a50 con 0x563322ea6650 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f582d583700 1 -- 172.21.15.70:0/2377228639 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58300256b0 con 0x563322ea6650 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 -- 172.21.15.70:0/2377228639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 msgr2=0x563322eb1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322eb1dd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5830004f50 tx=0x7f583000b730 comp rx=0 tx=0).stop 2023-10-08T08:44:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 -- 172.21.15.70:0/2377228639 shutdown_connections 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322ea6650 0x563322eb1dd0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9ae80 0x563322e9dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 --2- 172.21.15.70:0/2377228639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322e9b7a0 0x563322eb1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 -- 172.21.15.70:0/2377228639 >> 172.21.15.70:0/2377228639 conn(0x563322e10260 msgr2=0x563322ea1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 -- 172.21.15.70:0/2377228639 shutdown_connections 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 -- 172.21.15.70:0/2377228639 wait complete. 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 -- start start 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.588+0000 7f584c603b80 1 Processor -- start 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f584c603b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ead300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f584c603b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322eab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f584c603b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 0x563322eabe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f584c603b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322eac580 con 0x563322e9ae80 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f584c603b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322f09fa0 con 0x563322ea6650 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f584c603b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563322f0a0e0 con 0x563322e9b7a0 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f584c603b80 10 client.0 _ll_register_callbacks cb 0x7f582800ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e1b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ead300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e1b6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ead300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52078/0 (socket says 172.21.15.70:52078) 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e1b6700 1 -- 172.21.15.70:0/888238060 learned_addr learned my addr 172.21.15.70:0/888238060 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e9b7700 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 0x563322eabe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583d9b5700 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322eab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e1b6700 1 -- 172.21.15.70:0/888238060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 msgr2=0x563322eab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e1b6700 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322eab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e1b6700 1 -- 172.21.15.70:0/888238060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 msgr2=0x563322eabe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e1b6700 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 0x563322eabe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e1b6700 1 -- 172.21.15.70:0/888238060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563322c19de0 con 0x563322e9ae80 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583d9b5700 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322eab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e9b7700 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 0x563322eabe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f583e1b6700 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ead300 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5828009920 tx=0x7f582801fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712a2f5fcc718e13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.589+0000 7f5821ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f5821ffb700 1 -- 172.21.15.70:0/888238060 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582800e870 con 0x563322e9ae80 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f5821ffb700 1 -- 172.21.15.70:0/888238060 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5828009320 con 0x563322e9ae80 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f584c603b80 1 -- 172.21.15.70:0/888238060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5830007d00 con 0x563322e9ae80 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f5821ffb700 1 -- 172.21.15.70:0/888238060 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5828011d90 con 0x563322e9ae80 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f584c603b80 10 client.16152 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f584c603b80 1 -- 172.21.15.70:0/888238060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563322c182b0 con 0x563322e9ae80 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f5821ffb700 1 -- 172.21.15.70:0/888238060 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5830007d00 con 0x563322e9ae80 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f5821ffb700 1 -- 172.21.15.70:0/888238060 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f58280287b0 con 0x563322e9ae80 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f584c603b80 10 client.16152 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f584c603b80 10 client.16152 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f584c603b80 20 client.16152 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f584c603b80 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x563322f0b740 0x563322f0db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f584c603b80 4 client.16152 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f584c603b80 1 -- 172.21.15.70:0/888238060 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563322de7b30 con 0x563322f0b740 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.590+0000 7f583d9b5700 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x563322f0b740 0x563322f0db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f5821ffb700 10 client.16152 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f583d9b5700 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x563322f0b740 0x563322f0db60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c602d694b0a29b2 server_cookie=3a1e0736aa5ff9d0 in_seq=0 out_seq=0 2023-10-08T08:44:56.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f5821ffb700 1 -- 172.21.15.70:0/888238060 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563322de7b30 con 0x563322f0b740 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f5821ffb700 10 client.16152 handle_command_reply: tid=0 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 client.16152 shutdown 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 -- 172.21.15.70:0/888238060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 msgr2=0x563322ead300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ead300 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5828009920 tx=0x7f582801fde0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 -- 172.21.15.70:0/888238060 shutdown_connections 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x563322f0b740 0x563322f0db60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563322ea6650 0x563322eabe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f5821ffb700 0 client.16152 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563322e9ae80 0x563322ead300 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 --2- 172.21.15.70:0/888238060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563322e9b7a0 0x563322eab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 -- 172.21.15.70:0/888238060 >> 172.21.15.70:0/888238060 conn(0x563322e10260 msgr2=0x563322eb1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 -- 172.21.15.70:0/888238060 shutdown_connections 2023-10-08T08:44:56.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 1 -- 172.21.15.70:0/888238060 wait complete. 2023-10-08T08:44:56.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.591+0000 7f584c603b80 20 client.16152 trim_cache size 0 max 16384 2023-10-08T08:44:56.601 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 -- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f58240a1670 msgr2=0x7f58240a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f58240a1670 0x7f58240a3b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5828005950 tx=0x7f58280058e0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 -- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58381051c0 msgr2=0x7f583819cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58381051c0 0x7f583819cf30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f583400e9a0 tx=0x7f583400ed60 comp rx=0 tx=0).stop 2023-10-08T08:44:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 -- 172.21.15.70:0/3529820986 shutdown_connections 2023-10-08T08:44:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f58240a1670 0x7f58240a3b30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5838105b80 0x7f5838196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5838067ce0 0x7f583819c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 --2- 172.21.15.70:0/3529820986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58381051c0 0x7f583819cf30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 -- 172.21.15.70:0/3529820986 >> 172.21.15.70:0/3529820986 conn(0x7f5838076780 msgr2=0x7f58380fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 -- 172.21.15.70:0/3529820986 shutdown_connections 2023-10-08T08:44:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.592+0000 7f584041a700 1 -- 172.21.15.70:0/3529820986 wait complete. 2023-10-08T08:44:56.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:56 smithi191 ceph-mon[104220]: pgmap v324: 129 pgs: 129 active+clean; 3.3 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-08T08:44:56.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:56 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/548219367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:44:56.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T08:44:56.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.768+0000 7f828de0e700 1 -- 172.21.15.70:0/2126142811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82881056b0 msgr2=0x7f8288105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.768+0000 7f828de0e700 1 --2- 172.21.15.70:0/2126142811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82881056b0 0x7f8288105a90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f827c009990 tx=0x7f827c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.768+0000 7f828de0e700 1 -- 172.21.15.70:0/2126142811 shutdown_connections 2023-10-08T08:44:56.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.768+0000 7f828de0e700 1 --2- 172.21.15.70:0/2126142811 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82880fffe0 0x7f828810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.768+0000 7f828de0e700 1 --2- 172.21.15.70:0/2126142811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82881056b0 0x7f8288105a90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.768+0000 7f828de0e700 1 --2- 172.21.15.70:0/2126142811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82880ff620 0x7f82880ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.768+0000 7f828de0e700 1 -- 172.21.15.70:0/2126142811 >> 172.21.15.70:0/2126142811 conn(0x7f8288076780 msgr2=0x7f8288076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.768+0000 7f828de0e700 1 -- 172.21.15.70:0/2126142811 shutdown_connections 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.768+0000 7f828de0e700 1 -- 172.21.15.70:0/2126142811 wait complete. 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f828de0e700 1 Processor -- start 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f828de0e700 1 -- start start 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f828de0e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82880ff620 0x7f8288195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f828de0e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82880fffe0 0x7f8288195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f828de0e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82881056b0 0x7f828819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f828de0e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828819a920 con 0x7f82880ff620 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f828de0e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828819aa90 con 0x7f82880fffe0 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f828de0e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828819ac50 con 0x7f82881056b0 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f82877fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82880ff620 0x7f8288195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f82877fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82880ff620 0x7f8288195a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52092/0 (socket says 172.21.15.70:52092) 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f82877fe700 1 -- 172.21.15.70:0/1012522806 learned_addr learned my addr 172.21.15.70:0/1012522806 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f8287fff700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82881056b0 0x7f828819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f8286ffd700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82880fffe0 0x7f8288195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f82877fe700 1 -- 172.21.15.70:0/1012522806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82881056b0 msgr2=0x7f828819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f82877fe700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82881056b0 0x7f828819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f82877fe700 1 -- 172.21.15.70:0/1012522806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82880fffe0 msgr2=0x7f8288195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f82877fe700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82880fffe0 0x7f8288195f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.769+0000 7f82877fe700 1 -- 172.21.15.70:0/1012522806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0095f0 con 0x7f82880ff620 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.770+0000 7f82877fe700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82880ff620 0x7f8288195a40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f827c000c00 tx=0x7f827c01aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.770+0000 7f8284ff9700 1 -- 172.21.15.70:0/1012522806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c01f070 con 0x7f82880ff620 2023-10-08T08:44:56.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.770+0000 7f8284ff9700 1 -- 172.21.15.70:0/1012522806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f827c01ad50 con 0x7f82880ff620 2023-10-08T08:44:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.770+0000 7f828de0e700 1 -- 172.21.15.70:0/1012522806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828819aed0 con 0x7f82880ff620 2023-10-08T08:44:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.770+0000 7f8284ff9700 1 -- 172.21.15.70:0/1012522806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0257e0 con 0x7f82880ff620 2023-10-08T08:44:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.770+0000 7f828de0e700 1 -- 172.21.15.70:0/1012522806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828819b1d0 con 0x7f82880ff620 2023-10-08T08:44:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.772+0000 7f8284ff9700 1 -- 172.21.15.70:0/1012522806 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f827c023070 con 0x7f82880ff620 2023-10-08T08:44:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.772+0000 7f8284ff9700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f82700a15f0 0x7f82700a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.773+0000 7f8284ff9700 1 -- 172.21.15.70:0/1012522806 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f827c0d0840 con 0x7f82880ff620 2023-10-08T08:44:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.773+0000 7f8286ffd700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f82700a15f0 0x7f82700a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.773+0000 7f8286ffd700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f82700a15f0 0x7f82700a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8288196f90 tx=0x7f8278005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.773+0000 7f8299ff7b80 1 Processor -- start 2023-10-08T08:44:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.773+0000 7f8299ff7b80 1 -- start start 2023-10-08T08:44:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 0x56262134f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x56262135e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 0x562621360e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626212b8460 con 0x56262134f7a0 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626212a9c20 con 0x56262135ea60 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626212a7540 con 0x56262134ee80 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x56262135e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x56262135e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52102/0 (socket says 172.21.15.70:52102) 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8286ffd700 1 -- 172.21.15.70:0/1676264038 learned_addr learned my addr 172.21.15.70:0/1676264038 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f82877fe700 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 0x56262134f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8287fff700 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 0x562621360e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8286ffd700 1 -- 172.21.15.70:0/1676264038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 msgr2=0x56262134f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8286ffd700 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 0x56262134f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8286ffd700 1 -- 172.21.15.70:0/1676264038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 msgr2=0x562621360e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8286ffd700 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 0x562621360e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8286ffd700 1 -- 172.21.15.70:0/1676264038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626210cdde0 con 0x56262134f7a0 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8287fff700 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 0x562621360e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f82877fe700 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 0x56262134f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f8286ffd700 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x56262135e520 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f827800dbc0 tx=0x7f8278010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37af8946ec2efc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f826dffb700 1 -- 172.21.15.70:0/1676264038 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800f930 con 0x56262134f7a0 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f826dffb700 1 -- 172.21.15.70:0/1676264038 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f827801c450 con 0x56262134f7a0 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.774+0000 7f826dffb700 1 -- 172.21.15.70:0/1676264038 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827801b610 con 0x56262134f7a0 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 -- 172.21.15.70:0/1676264038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 msgr2=0x56262135e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x56262135e520 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f827800dbc0 tx=0x7f8278010000 comp rx=0 tx=0).stop 2023-10-08T08:44:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 -- 172.21.15.70:0/1676264038 shutdown_connections 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 0x562621360e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 0x56262134f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/1676264038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x56262135e520 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 -- 172.21.15.70:0/1676264038 >> 172.21.15.70:0/1676264038 conn(0x5626212c4260 msgr2=0x56262134b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 -- 172.21.15.70:0/1676264038 shutdown_connections 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 -- 172.21.15.70:0/1676264038 wait complete. 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.775+0000 7f8299ff7b80 1 -- start start 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8299ff7b80 1 Processor -- start 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 0x56262135e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134f7a0 0x56262135b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262135ea60 0x56262135bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626212a2e30 con 0x56262135ea60 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262123f710 con 0x56262134ee80 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262123f3b0 con 0x56262134f7a0 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8299ff7b80 10 client.0 _ll_register_callbacks cb 0x56262109c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8287fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262135ea60 0x56262135bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8287fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262135ea60 0x56262135bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52110/0 (socket says 172.21.15.70:52110) 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8287fff700 1 -- 172.21.15.70:0/2588316685 learned_addr learned my addr 172.21.15.70:0/2588316685 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8286ffd700 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134f7a0 0x56262135b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f82877fe700 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 0x56262135e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8287fff700 1 -- 172.21.15.70:0/2588316685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134f7a0 msgr2=0x56262135b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8287fff700 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134f7a0 0x56262135b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8287fff700 1 -- 172.21.15.70:0/2588316685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 msgr2=0x56262135e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8287fff700 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 0x56262135e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.776+0000 7f8287fff700 1 -- 172.21.15.70:0/2588316685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827800d8a0 con 0x56262135ea60 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8287fff700 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262135ea60 0x56262135bc40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8280009b70 tx=0x7f8280009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc909cfb0225a6c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8266ffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8266ffd700 1 -- 172.21.15.70:0/2588316685 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280007940 con 0x56262135ea60 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8266ffd700 1 -- 172.21.15.70:0/2588316685 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8280006e40 con 0x56262135ea60 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8299ff7b80 1 -- 172.21.15.70:0/2588316685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56262126aeb0 con 0x56262135ea60 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8266ffd700 1 -- 172.21.15.70:0/2588316685 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f828000aa50 con 0x56262135ea60 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8299ff7b80 10 client.16164 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8299ff7b80 1 -- 172.21.15.70:0/2588316685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5626210b6c60 con 0x56262135ea60 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8266ffd700 1 -- 172.21.15.70:0/2588316685 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56262126aeb0 con 0x56262135ea60 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8266ffd700 1 -- 172.21.15.70:0/2588316685 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8280013070 con 0x56262135ea60 2023-10-08T08:44:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8299ff7b80 10 client.16164 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8299ff7b80 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8299ff7b80 20 client.16164 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56262136e5b0 0x5626213709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8299ff7b80 4 client.16164 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.777+0000 7f8299ff7b80 1 -- 172.21.15.70:0/2588316685 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56262129be10 con 0x56262136e5b0 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.778+0000 7f82877fe700 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56262136e5b0 0x5626213709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.778+0000 7f8266ffd700 10 client.16164 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.778+0000 7f82877fe700 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56262136e5b0 0x5626213709d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369014af803c847f server_cookie=458cdeab30acb65 in_seq=0 out_seq=0 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.778+0000 7f8266ffd700 1 -- 172.21.15.70:0/2588316685 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56262129be10 con 0x56262136e5b0 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.778+0000 7f8266ffd700 10 client.16164 handle_command_reply: tid=0 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.778+0000 7f8299ff7b80 1 client.16164 shutdown 2023-10-08T08:44:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 -- 172.21.15.70:0/2588316685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262135ea60 msgr2=0x56262135bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262135ea60 0x56262135bc40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8280009b70 tx=0x7f8280009ba0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 -- 172.21.15.70:0/2588316685 shutdown_connections 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262135ea60 0x56262135bc40 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56262136e5b0 0x5626213709d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 0x56262135e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/2588316685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134f7a0 0x56262135b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8266ffd700 0 client.16164 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 -- 172.21.15.70:0/2588316685 >> 172.21.15.70:0/2588316685 conn(0x5626212c4260 msgr2=0x56262134aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 -- 172.21.15.70:0/2588316685 shutdown_connections 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 1 -- 172.21.15.70:0/2588316685 wait complete. 2023-10-08T08:44:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.779+0000 7f8299ff7b80 20 client.16164 trim_cache size 0 max 16384 2023-10-08T08:44:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.791+0000 7f8299ff7b80 1 Processor -- start 2023-10-08T08:44:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.791+0000 7f8299ff7b80 1 -- start start 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 0x56262135bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 0x562621369d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562621123920 con 0x56262134f7a0 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262136b010 con 0x56262135ea60 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626213500d0 con 0x56262134ee80 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52116/0 (socket says 172.21.15.70:52116) 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8286ffd700 1 -- 172.21.15.70:0/3055800666 learned_addr learned my addr 172.21.15.70:0/3055800666 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f82877fe700 1 --2- 172.21.15.70:0/3055800666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 0x56262135bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8286ffd700 1 -- 172.21.15.70:0/3055800666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 msgr2=0x56262135bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8287fff700 1 --2- 172.21.15.70:0/3055800666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 0x562621369d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8286ffd700 1 --2- 172.21.15.70:0/3055800666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 0x56262135bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8286ffd700 1 -- 172.21.15.70:0/3055800666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 msgr2=0x562621369d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8286ffd700 1 --2- 172.21.15.70:0/3055800666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 0x562621369d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8286ffd700 1 -- 172.21.15.70:0/3055800666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562621361020 con 0x56262134f7a0 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f8286ffd700 1 --2- 172.21.15.70:0/3055800666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213655a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f827801cdf0 tx=0x7f827800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d829b11bd34bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f826e7fc700 1 -- 172.21.15.70:0/3055800666 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827802b050 con 0x56262134f7a0 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f826e7fc700 1 -- 172.21.15.70:0/3055800666 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f827802c040 con 0x56262134f7a0 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.792+0000 7f826e7fc700 1 -- 172.21.15.70:0/3055800666 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800fba0 con 0x56262134f7a0 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3055800666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 msgr2=0x5626213655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3055800666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213655a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f827801cdf0 tx=0x7f827800b820 comp rx=0 tx=0).stop 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3055800666 shutdown_connections 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3055800666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262135ea60 0x562621369d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3055800666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262134ee80 0x56262135bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3055800666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213655a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3055800666 >> 172.21.15.70:0/3055800666 conn(0x5626212c4260 msgr2=0x562621359f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3055800666 shutdown_connections 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3055800666 wait complete. 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 -- start start 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.793+0000 7f8299ff7b80 1 Processor -- start 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 0x562621361b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8299ff7b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262135ea60 0x5626213625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626213c23e0 con 0x56262134f7a0 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626213c2520 con 0x56262134ee80 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8299ff7b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626213c2660 con 0x56262135ea60 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8299ff7b80 10 client.0 _ll_register_callbacks cb 0x7f82800093b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8286ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52122/0 (socket says 172.21.15.70:52122) 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8286ffd700 1 -- 172.21.15.70:0/3810292760 learned_addr learned my addr 172.21.15.70:0/3810292760 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f82877fe700 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 0x562621361b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8287fff700 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262135ea60 0x5626213625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8286ffd700 1 -- 172.21.15.70:0/3810292760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262135ea60 msgr2=0x5626213625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8286ffd700 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262135ea60 0x5626213625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8286ffd700 1 -- 172.21.15.70:0/3810292760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 msgr2=0x562621361b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8286ffd700 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 0x562621361b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8286ffd700 1 -- 172.21.15.70:0/3810292760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626210cdde0 con 0x56262134f7a0 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f82877fe700 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 0x562621361b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8286ffd700 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213620b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f827800faa0 tx=0x7f827800fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcce80197f58dce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8266ffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.794+0000 7f8266ffd700 1 -- 172.21.15.70:0/3810292760 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278005230 con 0x56262134f7a0 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3810292760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f827801c450 con 0x56262134f7a0 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8266ffd700 1 -- 172.21.15.70:0/3810292760 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8278005390 con 0x56262134f7a0 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8266ffd700 1 -- 172.21.15.70:0/3810292760 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f827802b020 con 0x56262134f7a0 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8299ff7b80 10 client.16170 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3810292760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5626210f4250 con 0x56262134f7a0 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8266ffd700 1 -- 172.21.15.70:0/3810292760 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f827801c450 con 0x56262134f7a0 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8266ffd700 1 -- 172.21.15.70:0/3810292760 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8278042070 con 0x56262134f7a0 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8299ff7b80 10 client.16170 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8299ff7b80 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8299ff7b80 20 client.16170 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5626213c3970 0x5626213c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8299ff7b80 4 client.16170 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3810292760 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56262129bb30 con 0x5626213c3970 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.795+0000 7f82877fe700 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5626213c3970 0x5626213c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f82877fe700 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5626213c3970 0x5626213c5d90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e843e766e30e5928 server_cookie=2fe647772f2341d4 in_seq=0 out_seq=0 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8266ffd700 10 client.16170 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8266ffd700 1 -- 172.21.15.70:0/3810292760 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56262129bb30 con 0x5626213c3970 2023-10-08T08:44:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8266ffd700 10 client.16170 handle_command_reply: tid=0 2023-10-08T08:44:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 client.16170 shutdown 2023-10-08T08:44:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3810292760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 msgr2=0x5626213620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213620b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f827800faa0 tx=0x7f827800fad0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3810292760 shutdown_connections 2023-10-08T08:44:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56262135ea60 0x5626213625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5626213c3970 0x5626213c5d90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56262134ee80 0x562621361b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 --2- 172.21.15.70:0/3810292760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56262134f7a0 0x5626213620b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8266ffd700 0 client.16170 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3810292760 >> 172.21.15.70:0/3810292760 conn(0x5626212c4260 msgr2=0x562621369d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3810292760 shutdown_connections 2023-10-08T08:44:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 1 -- 172.21.15.70:0/3810292760 wait complete. 2023-10-08T08:44:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f8299ff7b80 20 client.16170 trim_cache size 0 max 16384 2023-10-08T08:44:56.805 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:44:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f828de0e700 1 -- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f82700a15f0 msgr2=0x7f82700a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f828de0e700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f82700a15f0 0x7f82700a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8288196f90 tx=0x7f8278005d50 comp rx=0 tx=0).stop 2023-10-08T08:44:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f828de0e700 1 -- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82880ff620 msgr2=0x7f8288195a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.796+0000 7f828de0e700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82880ff620 0x7f8288195a40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f827c000c00 tx=0x7f827c01aa30 comp rx=0 tx=0).stop 2023-10-08T08:44:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.797+0000 7f828de0e700 1 -- 172.21.15.70:0/1012522806 shutdown_connections 2023-10-08T08:44:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.797+0000 7f828de0e700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f82700a15f0 0x7f82700a3ab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.797+0000 7f828de0e700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82881056b0 0x7f828819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.797+0000 7f828de0e700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82880ff620 0x7f8288195a40 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.797+0000 7f828de0e700 1 --2- 172.21.15.70:0/1012522806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82880fffe0 0x7f8288195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.797+0000 7f828de0e700 1 -- 172.21.15.70:0/1012522806 >> 172.21.15.70:0/1012522806 conn(0x7f8288076780 msgr2=0x7f82880fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.797+0000 7f828de0e700 1 -- 172.21.15.70:0/1012522806 shutdown_connections 2023-10-08T08:44:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:56.797+0000 7f828de0e700 1 -- 172.21.15.70:0/1012522806 wait complete. 2023-10-08T08:44:57.810 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T08:44:57.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T08:44:58.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.044+0000 7f8ed97bf700 1 -- 172.21.15.70:0/3615563255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed41056b0 msgr2=0x7f8ed4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.044+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/3615563255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed41056b0 0x7f8ed4105a90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40098f0 tx=0x7f8ec4009c00 comp rx=0 tx=0).stop 2023-10-08T08:44:58.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.044+0000 7f8ed97bf700 1 -- 172.21.15.70:0/3615563255 shutdown_connections 2023-10-08T08:44:58.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.044+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/3615563255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed40fffe0 0x7f8ed410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.044+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/3615563255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed41056b0 0x7f8ed4105a90 secure :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40098f0 tx=0x7f8ec4009c00 comp rx=0 tx=0).stop 2023-10-08T08:44:58.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.044+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/3615563255 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed40ff620 0x7f8ed40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.044+0000 7f8ed97bf700 1 -- 172.21.15.70:0/3615563255 >> 172.21.15.70:0/3615563255 conn(0x7f8ed4076780 msgr2=0x7f8ed4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.054+0000 7f8ed97bf700 1 -- 172.21.15.70:0/3615563255 shutdown_connections 2023-10-08T08:44:58.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.054+0000 7f8ed97bf700 1 -- 172.21.15.70:0/3615563255 wait complete. 2023-10-08T08:44:58.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.055+0000 7f8ed97bf700 1 Processor -- start 2023-10-08T08:44:58.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.055+0000 7f8ed97bf700 1 -- start start 2023-10-08T08:44:58.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.055+0000 7f8ed97bf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed40ff620 0x7f8ed41954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.055+0000 7f8ed97bf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed40fffe0 0x7f8ed4195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.055+0000 7f8ed97bf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed40713d0 0x7f8ed4071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.055+0000 7f8ed97bf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4071e90 con 0x7f8ed40713d0 2023-10-08T08:44:58.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.055+0000 7f8ed97bf700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4072000 con 0x7f8ed40fffe0 2023-10-08T08:44:58.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.055+0000 7f8ed97bf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed40721c0 con 0x7f8ed40ff620 2023-10-08T08:44:58.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.056+0000 7f8ed37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed40713d0 0x7f8ed4071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.056+0000 7f8ed37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed40713d0 0x7f8ed4071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52154/0 (socket says 172.21.15.70:52154) 2023-10-08T08:44:58.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.056+0000 7f8ed37fe700 1 -- 172.21.15.70:0/4078371104 learned_addr learned my addr 172.21.15.70:0/4078371104 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.056+0000 7f8ed37fe700 1 -- 172.21.15.70:0/4078371104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed40ff620 msgr2=0x7f8ed41954f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.056+0000 7f8ed37fe700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed40ff620 0x7f8ed41954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.056+0000 7f8ed37fe700 1 -- 172.21.15.70:0/4078371104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed40fffe0 msgr2=0x7f8ed4195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.056+0000 7f8ed37fe700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed40fffe0 0x7f8ed4195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.056+0000 7f8ed37fe700 1 -- 172.21.15.70:0/4078371104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4009520 con 0x7f8ed40713d0 2023-10-08T08:44:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.057+0000 7f8ed37fe700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed40713d0 0x7f8ed4071850 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00ada0 tx=0x7f8ecc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.058+0000 7f8ebbfff700 1 -- 172.21.15.70:0/4078371104 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00f070 con 0x7f8ed40713d0 2023-10-08T08:44:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.058+0000 7f8ed97bf700 1 -- 172.21.15.70:0/4078371104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed419d480 con 0x7f8ed40713d0 2023-10-08T08:44:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.058+0000 7f8ed97bf700 1 -- 172.21.15.70:0/4078371104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed419d960 con 0x7f8ed40713d0 2023-10-08T08:44:58.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.058+0000 7f8ebbfff700 1 -- 172.21.15.70:0/4078371104 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ecc007e60 con 0x7f8ed40713d0 2023-10-08T08:44:58.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.058+0000 7f8ebbfff700 1 -- 172.21.15.70:0/4078371104 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc0053c0 con 0x7f8ed40713d0 2023-10-08T08:44:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.063+0000 7f8ee59a8b80 1 Processor -- start 2023-10-08T08:44:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.064+0000 7f8ee59a8b80 1 -- start start 2023-10-08T08:44:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.065+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa98102e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.065+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9810820 0x560fa98239a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.065+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa98262d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.065+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa97794e0 con 0x560fa9823ee0 2023-10-08T08:44:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.065+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa976aca0 con 0x560fa980ff00 2023-10-08T08:44:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.065+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa97685c0 con 0x560fa9810820 2023-10-08T08:44:58.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.065+0000 7f8ebbfff700 1 -- 172.21.15.70:0/4078371104 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8ecc004ad0 con 0x7f8ed40713d0 2023-10-08T08:44:58.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ed27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa98262d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ed27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa98262d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52164/0 (socket says 172.21.15.70:52164) 2023-10-08T08:44:58.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ed27fc700 1 -- 172.21.15.70:0/950522641 learned_addr learned my addr 172.21.15.70:0/950522641 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/950522641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa98102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ebbfff700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ebc0a16b0 0x7f8ebc0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ed27fc700 1 -- 172.21.15.70:0/950522641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9810820 msgr2=0x560fa98239a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T08:44:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/950522641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9810820 0x560fa98239a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ed27fc700 1 -- 172.21.15.70:0/950522641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 msgr2=0x560fa98102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/950522641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa98102e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ed27fc700 1 -- 172.21.15.70:0/950522641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fa958ee60 con 0x560fa9823ee0 2023-10-08T08:44:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.066+0000 7f8ebbfff700 1 -- 172.21.15.70:0/4078371104 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8ecc0cc9a0 con 0x7f8ed40713d0 2023-10-08T08:44:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.069+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/950522641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa98262d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8ec801afc0 tx=0x7f8ec801a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b8fcba18cd9e65 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.069+0000 7f8eb97fa700 1 -- 172.21.15.70:0/950522641 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8029070 con 0x560fa9823ee0 2023-10-08T08:44:58.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.069+0000 7f8eb97fa700 1 -- 172.21.15.70:0/950522641 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ec80044f0 con 0x560fa9823ee0 2023-10-08T08:44:58.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.069+0000 7f8eb97fa700 1 -- 172.21.15.70:0/950522641 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8021450 con 0x560fa9823ee0 2023-10-08T08:44:58.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.071+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/950522641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 msgr2=0x560fa98262d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.071+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/950522641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa98262d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8ec801afc0 tx=0x7f8ec801a7b0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.071+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/950522641 shutdown_connections 2023-10-08T08:44:58.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.071+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/950522641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa98262d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.071+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/950522641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa98102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.071+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/950522641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9810820 0x560fa98239a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.071+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/950522641 >> 172.21.15.70:0/950522641 conn(0x560fa97852e0 msgr2=0x560fa980c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.073+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/950522641 shutdown_connections 2023-10-08T08:44:58.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.074+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/950522641 wait complete. 2023-10-08T08:44:58.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.074+0000 7f8ee59a8b80 1 -- start start 2023-10-08T08:44:58.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.074+0000 7f8ee59a8b80 1 Processor -- start 2023-10-08T08:44:58.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.075+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa981d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.075+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9823ee0 0x560fa981da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.075+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823210 0x560fa9823690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.075+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9763eb0 con 0x560fa9823210 2023-10-08T08:44:58.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.075+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9700790 con 0x560fa980ff00 2023-10-08T08:44:58.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.075+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9700430 con 0x560fa9823ee0 2023-10-08T08:44:58.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.075+0000 7f8ee59a8b80 10 client.0 _ll_register_callbacks cb 0x560fa955d880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:58.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.075+0000 7f8ed37fe700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ebc0a16b0 0x7f8ebc0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.077+0000 7f8ed2ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9823ee0 0x560fa981da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.077+0000 7f8ed2ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9823ee0 0x560fa981da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:39750/0 (socket says 172.21.15.70:39750) 2023-10-08T08:44:58.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.077+0000 7f8ed2ffd700 1 -- 172.21.15.70:0/1397740375 learned_addr learned my addr 172.21.15.70:0/1397740375 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.080+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa981d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.080+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823210 0x560fa9823690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.081+0000 7f8ed27fc700 1 -- 172.21.15.70:0/1397740375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9823ee0 msgr2=0x560fa981da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.081+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9823ee0 0x560fa981da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.081+0000 7f8ed27fc700 1 -- 172.21.15.70:0/1397740375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 msgr2=0x560fa981d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.081+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa981d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.081+0000 7f8ed27fc700 1 -- 172.21.15.70:0/1397740375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec801acd0 con 0x560fa9823210 2023-10-08T08:44:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.081+0000 7f8ed37fe700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ebc0a16b0 0x7f8ebc0a3b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc096150 tx=0x7f8ecc095a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.084+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823210 0x560fa9823690 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8001eb0 tx=0x7f8ec8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32765720a4cb87f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.087+0000 7f8eb6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:58.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.087+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/1397740375 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8029070 con 0x560fa9823210 2023-10-08T08:44:58.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.087+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/1397740375 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8ec8003890 con 0x560fa9823210 2023-10-08T08:44:58.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.088+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1397740375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560fa972bf30 con 0x560fa9823210 2023-10-08T08:44:58.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.088+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/1397740375 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec8003f00 con 0x560fa9823210 2023-10-08T08:44:58.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.088+0000 7f8ee59a8b80 10 client.16182 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:58.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.088+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1397740375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560fa9577ce0 con 0x560fa9823210 2023-10-08T08:44:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.089+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/1397740375 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560fa972bf30 con 0x560fa9823210 2023-10-08T08:44:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.089+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/1397740375 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8ec8021a70 con 0x560fa9823210 2023-10-08T08:44:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.089+0000 7f8ee59a8b80 10 client.16182 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.089+0000 7f8ee59a8b80 10 client.16182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.089+0000 7f8ee59a8b80 20 client.16182 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.089+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560fa983c740 0x560fa983eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.089+0000 7f8ee59a8b80 4 client.16182 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.089+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1397740375 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560fa975ce90 con 0x560fa983c740 2023-10-08T08:44:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.090+0000 7f8ed2ffd700 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560fa983c740 0x560fa983eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.100+0000 7f8eb6ff5700 10 client.16182 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:58.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.100+0000 7f8ed2ffd700 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560fa983c740 0x560fa983eb60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bba848cb5c03eeb server_cookie=d30a63ab5204b97 in_seq=0 out_seq=0 2023-10-08T08:44:58.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.105+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/1397740375 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560fa975ce90 con 0x560fa983c740 2023-10-08T08:44:58.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.105+0000 7f8eb6ff5700 10 client.16182 handle_command_reply: tid=0 2023-10-08T08:44:58.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.105+0000 7f8ee59a8b80 1 client.16182 shutdown 2023-10-08T08:44:58.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.105+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1397740375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823210 msgr2=0x560fa9823690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.105+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823210 0x560fa9823690 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8001eb0 tx=0x7f8ec8004750 comp rx=0 tx=0).stop 2023-10-08T08:44:58.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.106+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1397740375 shutdown_connections 2023-10-08T08:44:58.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.106+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823210 0x560fa9823690 secure :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8001eb0 tx=0x7f8ec8004750 comp rx=0 tx=0).stop 2023-10-08T08:44:58.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.106+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560fa983c740 0x560fa983eb60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.106+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa981d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.106+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1397740375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9823ee0 0x560fa981da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.106+0000 7f8eb6ff5700 0 client.16182 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:58.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.106+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1397740375 >> 172.21.15.70:0/1397740375 conn(0x560fa97852e0 msgr2=0x560fa980bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.115+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1397740375 shutdown_connections 2023-10-08T08:44:58.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.116+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1397740375 wait complete. 2023-10-08T08:44:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.127+0000 7f8ee59a8b80 20 client.16182 trim_cache size 0 max 16384 2023-10-08T08:44:58.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.157+0000 7f8ee59a8b80 1 Processor -- start 2023-10-08T08:44:58.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.158+0000 7f8ee59a8b80 1 -- start start 2023-10-08T08:44:58.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.158+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa9812dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.158+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa98221f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.158+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa9813f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.158+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa95e49a0 con 0x560fa9823ee0 2023-10-08T08:44:58.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.158+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9819e50 con 0x560fa980ff00 2023-10-08T08:44:58.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.158+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9810530 con 0x560fa9813ab0 2023-10-08T08:44:58.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.159+0000 7f8ed27fc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa9812dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.159+0000 7f8ed27fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa9813f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.160+0000 7f8ed27fc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa9812dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39634/0 (socket says 172.21.15.70:39634) 2023-10-08T08:44:58.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.160+0000 7f8ed27fc700 1 -- 172.21.15.70:0/1805665126 learned_addr learned my addr 172.21.15.70:0/1805665126 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.162+0000 7f8ed27fc700 1 -- 172.21.15.70:0/1805665126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 msgr2=0x560fa9812dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.162+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/1805665126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa9812dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.162+0000 7f8ed27fc700 1 -- 172.21.15.70:0/1805665126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 msgr2=0x560fa98221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.162+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/1805665126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa98221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.162+0000 7f8ed27fc700 1 -- 172.21.15.70:0/1805665126 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fa9818390 con 0x560fa9813ab0 2023-10-08T08:44:58.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.162+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/1805665126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa9813f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8023500 tx=0x7f8ec8003e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f27c3000a479ec82 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.164+0000 7f8eb9ffb700 1 -- 172.21.15.70:0/1805665126 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8029050 con 0x560fa9813ab0 2023-10-08T08:44:58.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.164+0000 7f8eb9ffb700 1 -- 172.21.15.70:0/1805665126 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ec801f490 con 0x560fa9813ab0 2023-10-08T08:44:58.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.164+0000 7f8eb9ffb700 1 -- 172.21.15.70:0/1805665126 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8004920 con 0x560fa9813ab0 2023-10-08T08:44:58.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.165+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1805665126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 msgr2=0x560fa9813f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.165+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1805665126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa9813f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8023500 tx=0x7f8ec8003e60 comp rx=0 tx=0).stop 2023-10-08T08:44:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.174+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1805665126 shutdown_connections 2023-10-08T08:44:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.174+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1805665126 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa9813f10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.174+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1805665126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa9812dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.174+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/1805665126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa98221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.174+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1805665126 >> 172.21.15.70:0/1805665126 conn(0x560fa97852e0 msgr2=0x560fa980aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.187+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1805665126 shutdown_connections 2023-10-08T08:44:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.192+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/1805665126 wait complete. 2023-10-08T08:44:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.193+0000 7f8ee59a8b80 1 -- start start 2023-10-08T08:44:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.193+0000 7f8ee59a8b80 1 Processor -- start 2023-10-08T08:44:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.193+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa9820c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.193+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa98211c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.193+0000 7f8ee59a8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa9890540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.193+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9821970 con 0x560fa9823ee0 2023-10-08T08:44:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.193+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9821ae0 con 0x560fa980ff00 2023-10-08T08:44:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.193+0000 7f8ee59a8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9890ab0 con 0x560fa9813ab0 2023-10-08T08:44:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.193+0000 7f8ee59a8b80 10 client.0 _ll_register_callbacks cb 0x7f8ec8003cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.194+0000 7f8ed2ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa98211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.194+0000 7f8ed2ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa98211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:39760/0 (socket says 172.21.15.70:39760) 2023-10-08T08:44:58.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.194+0000 7f8ed2ffd700 1 -- 172.21.15.70:0/39359110 learned_addr learned my addr 172.21.15.70:0/39359110 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.194+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa9820c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.194+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa9890540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.195+0000 7f8ed2ffd700 1 -- 172.21.15.70:0/39359110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 msgr2=0x560fa9820c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.195+0000 7f8ed2ffd700 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa9820c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.195+0000 7f8ed2ffd700 1 -- 172.21.15.70:0/39359110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 msgr2=0x560fa9890540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.195+0000 7f8ed2ffd700 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa9890540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.195+0000 7f8ed2ffd700 1 -- 172.21.15.70:0/39359110 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fa9577ce0 con 0x560fa9813ab0 2023-10-08T08:44:58.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.199+0000 7f8ed2ffd700 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa98211c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40098c0 tx=0x7f8ec400fd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e70e304d8cd55e0b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.199+0000 7f8eb6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:44:58.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.200+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/39359110 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec400f790 con 0x560fa9813ab0 2023-10-08T08:44:58.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.201+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/39359110 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8ec400f8f0 con 0x560fa9813ab0 2023-10-08T08:44:58.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.201+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/39359110 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ec80044f0 con 0x560fa9813ab0 2023-10-08T08:44:58.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.210+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/39359110 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec4023980 con 0x560fa9813ab0 2023-10-08T08:44:58.211 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:58 smithi070 ceph-mon[99513]: pgmap v325: 129 pgs: 129 active+clean; 3.3 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 183 KiB/s wr, 9 op/s 2023-10-08T08:44:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.213+0000 7f8ee59a8b80 10 client.25591 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.213+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/39359110 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560fa95b52d0 con 0x560fa9813ab0 2023-10-08T08:44:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.218+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/39359110 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ec80044f0 con 0x560fa9813ab0 2023-10-08T08:44:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.218+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/39359110 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8ec4015020 con 0x560fa9813ab0 2023-10-08T08:44:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.218+0000 7f8ee59a8b80 10 client.25591 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.218+0000 7f8ee59a8b80 10 client.25591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.218+0000 7f8ee59a8b80 20 client.25591 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.218+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560fa9892290 0x560fa98946b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.218+0000 7f8ee59a8b80 4 client.25591 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T08:44:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.218+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/39359110 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560fa975cbb0 con 0x560fa9892290 2023-10-08T08:44:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.219+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560fa9892290 0x560fa98946b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.222+0000 7f8eb6ff5700 10 client.25591 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.222+0000 7f8ed27fc700 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560fa9892290 0x560fa98946b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92e3315037ead4fc server_cookie=5c10f609cacfa1ed in_seq=0 out_seq=0 2023-10-08T08:44:58.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.232+0000 7f8eb6ff5700 1 -- 172.21.15.70:0/39359110 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560fa975cbb0 con 0x560fa9892290 2023-10-08T08:44:58.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.232+0000 7f8eb6ff5700 10 client.25591 handle_command_reply: tid=0 2023-10-08T08:44:58.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.232+0000 7f8ee59a8b80 1 client.25591 shutdown 2023-10-08T08:44:58.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.241+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/39359110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 msgr2=0x560fa98211c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.241+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa98211c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40098c0 tx=0x7f8ec400fd50 comp rx=0 tx=0).stop 2023-10-08T08:44:58.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.241+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/39359110 shutdown_connections 2023-10-08T08:44:58.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.241+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560fa9823ee0 0x560fa9890540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.241+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560fa9892290 0x560fa98946b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.241+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560fa980ff00 0x560fa9820c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.241+0000 7f8ee59a8b80 1 --2- 172.21.15.70:0/39359110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560fa9813ab0 0x560fa98211c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.241+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/39359110 >> 172.21.15.70:0/39359110 conn(0x560fa97852e0 msgr2=0x560fa980b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.241+0000 7f8eb6ff5700 0 client.25591 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:58.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.242+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/39359110 shutdown_connections 2023-10-08T08:44:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.242+0000 7f8ee59a8b80 1 -- 172.21.15.70:0/39359110 wait complete. 2023-10-08T08:44:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.243+0000 7f8ee59a8b80 20 client.25591 trim_cache size 0 max 16384 2023-10-08T08:44:58.246 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:44:58.246 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2023-10-08T08:44:58.246 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "36e24967-20e3-478a-adb7-8b123d22e960", 2023-10-08T08:44:58.246 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2023-10-08T08:44:58.246 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:44:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.248+0000 7f8ed97bf700 1 -- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ebc0a16b0 msgr2=0x7f8ebc0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.248+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ebc0a16b0 0x7f8ebc0a3b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc096150 tx=0x7f8ecc095a20 comp rx=0 tx=0).stop 2023-10-08T08:44:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.248+0000 7f8ed97bf700 1 -- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed40713d0 msgr2=0x7f8ed4071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.248+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed40713d0 0x7f8ed4071850 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00ada0 tx=0x7f8ecc00c330 comp rx=0 tx=0).stop 2023-10-08T08:44:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.249+0000 7f8ed97bf700 1 -- 172.21.15.70:0/4078371104 shutdown_connections 2023-10-08T08:44:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.249+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ebc0a16b0 0x7f8ebc0a3b70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.249+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed40713d0 0x7f8ed4071850 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.249+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed40ff620 0x7f8ed41954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.249+0000 7f8ed97bf700 1 --2- 172.21.15.70:0/4078371104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed40fffe0 0x7f8ed4195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.249+0000 7f8ed97bf700 1 -- 172.21.15.70:0/4078371104 >> 172.21.15.70:0/4078371104 conn(0x7f8ed4076780 msgr2=0x7f8ed4106cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.249+0000 7f8ed97bf700 1 -- 172.21.15.70:0/4078371104 shutdown_connections 2023-10-08T08:44:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.249+0000 7f8ed97bf700 1 -- 172.21.15.70:0/4078371104 wait complete. 2023-10-08T08:44:58.275 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:44:58.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.480+0000 7f815a24b700 1 -- 172.21.15.70:0/1055634556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154106750 msgr2=0x7f8154106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.480+0000 7f815a24b700 1 --2- 172.21.15.70:0/1055634556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154106750 0x7f8154106b30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8144009990 tx=0x7f8144009ca0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.480+0000 7f815a24b700 1 -- 172.21.15.70:0/1055634556 shutdown_connections 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.480+0000 7f815a24b700 1 --2- 172.21.15.70:0/1055634556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8154101100 0x7f815410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.480+0000 7f815a24b700 1 --2- 172.21.15.70:0/1055634556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154106750 0x7f8154106b30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.480+0000 7f815a24b700 1 --2- 172.21.15.70:0/1055634556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8154100740 0x7f8154100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.480+0000 7f815a24b700 1 -- 172.21.15.70:0/1055634556 >> 172.21.15.70:0/1055634556 conn(0x7f81540fc230 msgr2=0x7f81540fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.480+0000 7f815a24b700 1 -- 172.21.15.70:0/1055634556 shutdown_connections 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.480+0000 7f815a24b700 1 -- 172.21.15.70:0/1055634556 wait complete. 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.481+0000 7f815a24b700 1 Processor -- start 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.481+0000 7f815a24b700 1 -- start start 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.481+0000 7f815a24b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154100740 0x7f815419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.481+0000 7f815a24b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8154101100 0x7f815419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.481+0000 7f815a24b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8154106750 0x7f8154194770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.481+0000 7f815a24b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8154194dd0 con 0x7f8154100740 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.481+0000 7f815a24b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8154194f40 con 0x7f8154101100 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.481+0000 7f815a24b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8154195100 con 0x7f8154106750 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.481+0000 7f81537fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154100740 0x7f815419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f81537fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154100740 0x7f815419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52196/0 (socket says 172.21.15.70:52196) 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f81537fe700 1 -- 172.21.15.70:0/2733658461 learned_addr learned my addr 172.21.15.70:0/2733658461 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f8152ffd700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8154101100 0x7f815419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f8153fff700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8154106750 0x7f8154194770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f81537fe700 1 -- 172.21.15.70:0/2733658461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8154106750 msgr2=0x7f8154194770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f81537fe700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8154106750 0x7f8154194770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f81537fe700 1 -- 172.21.15.70:0/2733658461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8154101100 msgr2=0x7f815419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f81537fe700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8154101100 0x7f815419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f81537fe700 1 -- 172.21.15.70:0/2733658461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81440095f0 con 0x7f8154100740 2023-10-08T08:44:58.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f81537fe700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154100740 0x7f815419a640 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8144000c00 tx=0x7f8144004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f8150ff9700 1 -- 172.21.15.70:0/2733658461 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814401d070 con 0x7f8154100740 2023-10-08T08:44:58.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f8150ff9700 1 -- 172.21.15.70:0/2733658461 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8144022470 con 0x7f8154100740 2023-10-08T08:44:58.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f815a24b700 1 -- 172.21.15.70:0/2733658461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8154195380 con 0x7f8154100740 2023-10-08T08:44:58.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f8150ff9700 1 -- 172.21.15.70:0/2733658461 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144017650 con 0x7f8154100740 2023-10-08T08:44:58.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.482+0000 7f815a24b700 1 -- 172.21.15.70:0/2733658461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81541a1630 con 0x7f8154100740 2023-10-08T08:44:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.485+0000 7f8150ff9700 1 -- 172.21.15.70:0/2733658461 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f81440225e0 con 0x7f8154100740 2023-10-08T08:44:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.486+0000 7f8150ff9700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f813c0a15f0 0x7f813c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.486+0000 7f8152ffd700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f813c0a15f0 0x7f813c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.486+0000 7f8150ff9700 1 -- 172.21.15.70:0/2733658461 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f81440ce600 con 0x7f8154100740 2023-10-08T08:44:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.486+0000 7f8166434b80 1 Processor -- start 2023-10-08T08:44:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.486+0000 7f8166434b80 1 -- start start 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.486+0000 7f8152ffd700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f813c0a15f0 0x7f813c0a3ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8154195e80 tx=0x7f814800b700 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8166434b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3ae260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8166434b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8166434b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3b9650 0x55568e3bba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8166434b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e317460 con 0x55568e3ade80 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8166434b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e308c20 con 0x55568e3ae7a0 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8166434b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e306540 con 0x55568e3b9650 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f81537fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8152ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8152ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39664/0 (socket says 172.21.15.70:39664) 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f81537fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52204/0 (socket says 172.21.15.70:52204) 2023-10-08T08:44:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8152ffd700 1 -- 172.21.15.70:0/3045509358 learned_addr learned my addr 172.21.15.70:0/3045509358 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8153fff700 1 --2- 172.21.15.70:0/3045509358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3b9650 0x55568e3bba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8152ffd700 1 -- 172.21.15.70:0/3045509358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3b9650 msgr2=0x55568e3bba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8152ffd700 1 --2- 172.21.15.70:0/3045509358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3b9650 0x55568e3bba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8152ffd700 1 -- 172.21.15.70:0/3045509358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 msgr2=0x55568e3ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8152ffd700 1 --2- 172.21.15.70:0/3045509358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8152ffd700 1 -- 172.21.15.70:0/3045509358 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55568e12cde0 con 0x55568e3ae7a0 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f81537fe700 1 --2- 172.21.15.70:0/3045509358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8152ffd700 1 --2- 172.21.15.70:0/3045509358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b9110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8148014f10 tx=0x7f814800d050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc739e28e374b69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8139ffb700 1 -- 172.21.15.70:0/3045509358 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148025400 con 0x55568e3ae7a0 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8139ffb700 1 -- 172.21.15.70:0/3045509358 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8148013040 con 0x55568e3ae7a0 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.487+0000 7f8139ffb700 1 -- 172.21.15.70:0/3045509358 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814801a850 con 0x55568e3ae7a0 2023-10-08T08:44:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 -- 172.21.15.70:0/3045509358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 msgr2=0x55568e3b9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 --2- 172.21.15.70:0/3045509358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b9110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8148014f10 tx=0x7f814800d050 comp rx=0 tx=0).stop 2023-10-08T08:44:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 -- 172.21.15.70:0/3045509358 shutdown_connections 2023-10-08T08:44:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 --2- 172.21.15.70:0/3045509358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3b9650 0x55568e3bba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 --2- 172.21.15.70:0/3045509358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 --2- 172.21.15.70:0/3045509358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b9110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 -- 172.21.15.70:0/3045509358 >> 172.21.15.70:0/3045509358 conn(0x55568e323260 msgr2=0x55568e3aa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 -- 172.21.15.70:0/3045509358 shutdown_connections 2023-10-08T08:44:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 -- 172.21.15.70:0/3045509358 wait complete. 2023-10-08T08:44:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.488+0000 7f8166434b80 1 -- start start 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8166434b80 1 Processor -- start 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8166434b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 0x55568e3b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8166434b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8166434b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8166434b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e301e30 con 0x55568e3b9650 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8166434b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e29e710 con 0x55568e3ae7a0 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8166434b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e29e3b0 con 0x55568e3ade80 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8166434b80 10 client.0 _ll_register_callbacks cb 0x55568e0fb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8153fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8152ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8153fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52214/0 (socket says 172.21.15.70:52214) 2023-10-08T08:44:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8152ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39670/0 (socket says 172.21.15.70:39670) 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f81537fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 0x55568e3b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8153fff700 1 -- 172.21.15.70:0/393119450 learned_addr learned my addr 172.21.15.70:0/393119450 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8153fff700 1 -- 172.21.15.70:0/393119450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 msgr2=0x55568e3b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8153fff700 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 0x55568e3b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8153fff700 1 -- 172.21.15.70:0/393119450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 msgr2=0x55568e3b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8153fff700 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8153fff700 1 -- 172.21.15.70:0/393119450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81541a1630 con 0x55568e3b9650 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.489+0000 7f8153fff700 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f814c011f60 tx=0x7f814c014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fbd60c4d56ac8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8132ffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8132ffd700 1 -- 172.21.15.70:0/393119450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00e040 con 0x55568e3b9650 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8132ffd700 1 -- 172.21.15.70:0/393119450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f814c014b40 con 0x55568e3b9650 2023-10-08T08:44:58.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8166434b80 1 -- 172.21.15.70:0/393119450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55568e2c9eb0 con 0x55568e3b9650 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8132ffd700 1 -- 172.21.15.70:0/393119450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f814c014d00 con 0x55568e3b9650 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8166434b80 10 client.16197 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8166434b80 1 -- 172.21.15.70:0/393119450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f8148014c50 con 0x55568e3b9650 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8132ffd700 1 -- 172.21.15.70:0/393119450 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55568e2c9eb0 con 0x55568e3b9650 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8132ffd700 1 -- 172.21.15.70:0/393119450 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f814c01c020 con 0x55568e3b9650 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8166434b80 10 client.16197 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8166434b80 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8166434b80 20 client.16197 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8166434b80 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55568e3c9310 0x55568e3cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8166434b80 4 client.16197 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f8166434b80 1 -- 172.21.15.70:0/393119450 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55568e2fae10 con 0x55568e3c9310 2023-10-08T08:44:58.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.490+0000 7f81537fe700 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55568e3c9310 0x55568e3cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.491+0000 7f8132ffd700 10 client.16197 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.491+0000 7f81537fe700 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55568e3c9310 0x55568e3cb730 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c5591795a2e8e85 server_cookie=3f903229295a80ff in_seq=0 out_seq=0 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8132ffd700 1 -- 172.21.15.70:0/393119450 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55568e2fae10 con 0x55568e3c9310 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8132ffd700 10 client.16197 handle_command_reply: tid=0 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 client.16197 shutdown 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 -- 172.21.15.70:0/393119450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 msgr2=0x55568e3b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f814c011f60 tx=0x7f814c014600 comp rx=0 tx=0).stop 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 -- 172.21.15.70:0/393119450 shutdown_connections 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f00 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 0x55568e3b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55568e3c9310 0x55568e3cb730 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 --2- 172.21.15.70:0/393119450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8132ffd700 0 client.16197 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:58.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 -- 172.21.15.70:0/393119450 >> 172.21.15.70:0/393119450 conn(0x55568e323260 msgr2=0x55568e3a9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 -- 172.21.15.70:0/393119450 shutdown_connections 2023-10-08T08:44:58.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.493+0000 7f8166434b80 1 -- 172.21.15.70:0/393119450 wait complete. 2023-10-08T08:44:58.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.494+0000 7f8166434b80 20 client.16197 trim_cache size 0 max 16384 2023-10-08T08:44:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.510+0000 7f8166434b80 1 Processor -- start 2023-10-08T08:44:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.510+0000 7f8166434b80 1 -- start start 2023-10-08T08:44:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.510+0000 7f8166434b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 0x55568e3b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.510+0000 7f8166434b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.510+0000 7f8166434b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.510+0000 7f8166434b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e182920 con 0x55568e3b9650 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.510+0000 7f8166434b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e3c5d40 con 0x55568e3ae7a0 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.510+0000 7f8166434b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e3b7a30 con 0x55568e3ade80 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8153fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8152ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8152ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39678/0 (socket says 172.21.15.70:39678) 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8153fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52222/0 (socket says 172.21.15.70:52222) 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8152ffd700 1 -- 172.21.15.70:0/3984688277 learned_addr learned my addr 172.21.15.70:0/3984688277 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f81537fe700 1 --2- 172.21.15.70:0/3984688277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 0x55568e3b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8153fff700 1 -- 172.21.15.70:0/3984688277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 msgr2=0x55568e3b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8153fff700 1 --2- 172.21.15.70:0/3984688277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 0x55568e3b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8153fff700 1 -- 172.21.15.70:0/3984688277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 msgr2=0x55568e3b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8153fff700 1 --2- 172.21.15.70:0/3984688277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8153fff700 1 -- 172.21.15.70:0/3984688277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55568e115c60 con 0x55568e3b9650 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8152ffd700 1 --2- 172.21.15.70:0/3984688277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f8153fff700 1 --2- 172.21.15.70:0/3984688277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f814c000f80 tx=0x7f814c014950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e21c1ccfbf63ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f813a7fc700 1 -- 172.21.15.70:0/3984688277 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00e040 con 0x55568e3b9650 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f813a7fc700 1 -- 172.21.15.70:0/3984688277 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f814c00f040 con 0x55568e3b9650 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.511+0000 7f813a7fc700 1 -- 172.21.15.70:0/3984688277 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0079c0 con 0x55568e3b9650 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 -- 172.21.15.70:0/3984688277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 msgr2=0x55568e3b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 --2- 172.21.15.70:0/3984688277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f814c000f80 tx=0x7f814c014950 comp rx=0 tx=0).stop 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 -- 172.21.15.70:0/3984688277 shutdown_connections 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 --2- 172.21.15.70:0/3984688277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3b9650 0x55568e3b6f50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 --2- 172.21.15.70:0/3984688277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ade80 0x55568e3b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 --2- 172.21.15.70:0/3984688277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3ae7a0 0x55568e3b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 -- 172.21.15.70:0/3984688277 >> 172.21.15.70:0/3984688277 conn(0x55568e323260 msgr2=0x55568e3b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 -- 172.21.15.70:0/3984688277 shutdown_connections 2023-10-08T08:44:58.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 -- 172.21.15.70:0/3984688277 wait complete. 2023-10-08T08:44:58.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 -- start start 2023-10-08T08:44:58.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.512+0000 7f8166434b80 1 Processor -- start 2023-10-08T08:44:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8166434b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8166434b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ae7a0 0x55568e3be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8166434b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3b9650 0x55568e3bece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8166434b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e3bf3a0 con 0x55568e3ade80 2023-10-08T08:44:58.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8166434b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e3bf510 con 0x55568e3b9650 2023-10-08T08:44:58.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8166434b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568e41d150 con 0x55568e3ae7a0 2023-10-08T08:44:58.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8166434b80 10 client.0 _ll_register_callbacks cb 0x7f814c0118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f81537fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f81537fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52224/0 (socket says 172.21.15.70:52224) 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f81537fe700 1 -- 172.21.15.70:0/118706406 learned_addr learned my addr 172.21.15.70:0/118706406 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8153fff700 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3b9650 0x55568e3bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8152ffd700 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ae7a0 0x55568e3be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f81537fe700 1 -- 172.21.15.70:0/118706406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ae7a0 msgr2=0x55568e3be7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f81537fe700 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ae7a0 0x55568e3be7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f81537fe700 1 -- 172.21.15.70:0/118706406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3b9650 msgr2=0x55568e3bece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f81537fe700 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3b9650 0x55568e3bece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f81537fe700 1 -- 172.21.15.70:0/118706406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55568e12cde0 con 0x55568e3ade80 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f81537fe700 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3c01d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8144006010 tx=0x7f814400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934f44cfa5227520 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8132ffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:58.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8132ffd700 1 -- 172.21.15.70:0/118706406 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814409f490 con 0x55568e3ade80 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8132ffd700 1 -- 172.21.15.70:0/118706406 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f81440a3640 con 0x55568e3ade80 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.513+0000 7f8166434b80 1 -- 172.21.15.70:0/118706406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8148013040 con 0x55568e3ade80 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8132ffd700 1 -- 172.21.15.70:0/118706406 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81440996e0 con 0x55568e3ade80 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8166434b80 10 client.16203 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8166434b80 1 -- 172.21.15.70:0/118706406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f8148014c50 con 0x55568e3ade80 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8132ffd700 1 -- 172.21.15.70:0/118706406 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8148013040 con 0x55568e3ade80 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8132ffd700 1 -- 172.21.15.70:0/118706406 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f814407d070 con 0x55568e3ade80 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8166434b80 10 client.16203 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8166434b80 10 client.16203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8166434b80 20 client.16203 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8166434b80 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55568e41e530 0x55568e420950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:58.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8166434b80 4 client.16203 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8166434b80 1 -- 172.21.15.70:0/118706406 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55568e2fab30 con 0x55568e41e530 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8152ffd700 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55568e41e530 0x55568e420950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8132ffd700 10 client.16203 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.514+0000 7f8152ffd700 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55568e41e530 0x55568e420950 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d837ad62fde186 server_cookie=bf57ef9e4f0c30c7 in_seq=0 out_seq=0 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8132ffd700 1 -- 172.21.15.70:0/118706406 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55568e2fab30 con 0x55568e41e530 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8132ffd700 10 client.16203 handle_command_reply: tid=0 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 client.16203 shutdown 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 -- 172.21.15.70:0/118706406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 msgr2=0x55568e3c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3c01d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8144006010 tx=0x7f814400b6a0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 -- 172.21.15.70:0/118706406 shutdown_connections 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55568e41e530 0x55568e420950 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55568e3b9650 0x55568e3bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8132ffd700 0 client.16203 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55568e3ade80 0x55568e3c01d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 --2- 172.21.15.70:0/118706406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55568e3ae7a0 0x55568e3be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 -- 172.21.15.70:0/118706406 >> 172.21.15.70:0/118706406 conn(0x55568e323260 msgr2=0x55568e3b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 -- 172.21.15.70:0/118706406 shutdown_connections 2023-10-08T08:44:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 1 -- 172.21.15.70:0/118706406 wait complete. 2023-10-08T08:44:58.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f8166434b80 20 client.16203 trim_cache size 0 max 16384 2023-10-08T08:44:58.525 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:44:58.525 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "scrub active (237 inodes in the stack)", 2023-10-08T08:44:58.525 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2023-10-08T08:44:58.526 INFO:teuthology.orchestra.run.smithi070.stdout: "36e24967-20e3-478a-adb7-8b123d22e960": { 2023-10-08T08:44:58.526 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2023-10-08T08:44:58.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "36e24967-20e3-478a-adb7-8b123d22e960", 2023-10-08T08:44:58.526 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2023-10-08T08:44:58.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:44:58.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:44:58.526 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.517+0000 7f815a24b700 1 -- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f813c0a15f0 msgr2=0x7f813c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f813c0a15f0 0x7f813c0a3ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8154195e80 tx=0x7f814800b700 comp rx=0 tx=0).stop 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 -- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154100740 msgr2=0x7f815419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154100740 0x7f815419a640 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8144000c00 tx=0x7f8144004730 comp rx=0 tx=0).stop 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 -- 172.21.15.70:0/2733658461 shutdown_connections 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f813c0a15f0 0x7f813c0a3ab0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8154106750 0x7f8154194770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8154100740 0x7f815419a640 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 --2- 172.21.15.70:0/2733658461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8154101100 0x7f815419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:58.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 -- 172.21.15.70:0/2733658461 >> 172.21.15.70:0/2733658461 conn(0x7f81540fc230 msgr2=0x7f81540fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:58.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 -- 172.21.15.70:0/2733658461 shutdown_connections 2023-10-08T08:44:58.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:44:58.518+0000 7f815a24b700 1 -- 172.21.15.70:0/2733658461 wait complete. 2023-10-08T08:44:58.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:58 smithi105 ceph-mon[103798]: pgmap v325: 129 pgs: 129 active+clean; 3.3 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 183 KiB/s wr, 9 op/s 2023-10-08T08:44:58.530 INFO:tasks.cephfs.filesystem:scrub status for tag:36e24967-20e3-478a-adb7-8b123d22e960 - {'path': '/', 'tag': '36e24967-20e3-478a-adb7-8b123d22e960', 'options': 'recursive,force'} 2023-10-08T08:44:58.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:58 smithi191 ceph-mon[104220]: pgmap v325: 129 pgs: 129 active+clean; 3.3 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 183 KiB/s wr, 9 op/s 2023-10-08T08:44:59.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:59 smithi070 ceph-mon[99513]: scrub queued for path: / 2023-10-08T08:44:59.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:59 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:44:59.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:44:59 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:44:59.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:59 smithi105 ceph-mon[103798]: scrub queued for path: / 2023-10-08T08:44:59.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:59 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:44:59.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:44:59 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:44:59.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:59 smithi191 ceph-mon[104220]: scrub queued for path: / 2023-10-08T08:44:59.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:59 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:44:59.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:44:59 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:44:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.739+0000 7f99775d7700 1 -- 172.21.15.70:0/4105092160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 msgr2=0x7f997010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.739+0000 7f99775d7700 1 --2- 172.21.15.70:0/4105092160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 0x7f997010d570 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f996800b0a0 tx=0x7f996800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.739+0000 7f99775d7700 1 -- 172.21.15.70:0/4105092160 shutdown_connections 2023-10-08T08:44:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.739+0000 7f99775d7700 1 --2- 172.21.15.70:0/4105092160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 0x7f997010d570 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.739+0000 7f99775d7700 1 --2- 172.21.15.70:0/4105092160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9970106760 0x7f9970106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.739+0000 7f99775d7700 1 --2- 172.21.15.70:0/4105092160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99700fec60 0x7f99700ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.739+0000 7f99775d7700 1 -- 172.21.15.70:0/4105092160 >> 172.21.15.70:0/4105092160 conn(0x7f9970075bf0 msgr2=0x7f99700fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.739+0000 7f99775d7700 1 -- 172.21.15.70:0/4105092160 shutdown_connections 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.739+0000 7f99775d7700 1 -- 172.21.15.70:0/4105092160 wait complete. 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f99775d7700 1 Processor -- start 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f99775d7700 1 -- start start 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f99775d7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99700fec60 0x7f997019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f99775d7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 0x7f997019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f99775d7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9970106760 0x7f99701969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f99775d7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9970197050 con 0x7f99700ff620 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f99775d7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99701971c0 con 0x7f99700fec60 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f99775d7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9970197380 con 0x7f9970106760 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 0x7f997019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 0x7f997019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52240/0 (socket says 172.21.15.70:52240) 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9974b72700 1 -- 172.21.15.70:0/2378165779 learned_addr learned my addr 172.21.15.70:0/2378165779 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9975373700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99700fec60 0x7f997019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9975b74700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9970106760 0x7f99701969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9974b72700 1 -- 172.21.15.70:0/2378165779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9970106760 msgr2=0x7f99701969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9974b72700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9970106760 0x7f99701969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9974b72700 1 -- 172.21.15.70:0/2378165779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99700fec60 msgr2=0x7f997019c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9974b72700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99700fec60 0x7f997019c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9974b72700 1 -- 172.21.15.70:0/2378165779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968009d00 con 0x7f99700ff620 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9975373700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99700fec60 0x7f997019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f9974b72700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 0x7f997019cdb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f996000c9b0 tx=0x7f996000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:59.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.740+0000 7f99667fc700 1 -- 172.21.15.70:0/2378165779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960007b00 con 0x7f99700ff620 2023-10-08T08:44:59.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.741+0000 7f99775d7700 1 -- 172.21.15.70:0/2378165779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9970197660 con 0x7f99700ff620 2023-10-08T08:44:59.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.741+0000 7f99667fc700 1 -- 172.21.15.70:0/2378165779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f996000ce50 con 0x7f99700ff620 2023-10-08T08:44:59.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.741+0000 7f99667fc700 1 -- 172.21.15.70:0/2378165779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960018660 con 0x7f99700ff620 2023-10-08T08:44:59.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.741+0000 7f99775d7700 1 -- 172.21.15.70:0/2378165779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99701a3860 con 0x7f99700ff620 2023-10-08T08:44:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.743+0000 7f99667fc700 1 -- 172.21.15.70:0/2378165779 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f996000f450 con 0x7f99700ff620 2023-10-08T08:44:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.743+0000 7f99667fc700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f995c0a15f0 0x7f995c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.743+0000 7f9975373700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f995c0a15f0 0x7f995c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.743+0000 7f99667fc700 1 -- 172.21.15.70:0/2378165779 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f99600cd330 con 0x7f99700ff620 2023-10-08T08:44:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.744+0000 7f9975373700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f995c0a15f0 0x7f995c0a3ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f996c011490 tx=0x7f996c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.744+0000 7f99837c0b80 1 Processor -- start 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.744+0000 7f99837c0b80 1 -- start start 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.744+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725f880 0x55893725fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.744+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589372601a0 0x558937259b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.744+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 0x55893725a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.744+0000 7f99837c0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589371c2400 con 0x5589372601a0 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.744+0000 7f99837c0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589371b3bc0 con 0x55893725a0b0 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.744+0000 7f99837c0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589371b14e0 con 0x55893725f880 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589372601a0 0x558937259b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589372601a0 0x558937259b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52248/0 (socket says 172.21.15.70:52248) 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9974b72700 1 -- 172.21.15.70:0/1927066018 learned_addr learned my addr 172.21.15.70:0/1927066018 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9975b74700 1 --2- 172.21.15.70:0/1927066018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 0x55893725a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9975373700 1 --2- 172.21.15.70:0/1927066018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725f880 0x55893725fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9974b72700 1 -- 172.21.15.70:0/1927066018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725f880 msgr2=0x55893725fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9974b72700 1 --2- 172.21.15.70:0/1927066018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725f880 0x55893725fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9974b72700 1 -- 172.21.15.70:0/1927066018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 msgr2=0x55893725a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9974b72700 1 --2- 172.21.15.70:0/1927066018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 0x55893725a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9974b72700 1 -- 172.21.15.70:0/1927066018 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558936fd7d80 con 0x5589372601a0 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f9974b72700 1 --2- 172.21.15.70:0/1927066018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589372601a0 0x558937259b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9960096ab0 tx=0x7f9960099ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5525c6e2f58514 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f995b7fe700 1 -- 172.21.15.70:0/1927066018 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960007c60 con 0x5589372601a0 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f995b7fe700 1 -- 172.21.15.70:0/1927066018 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f996009a040 con 0x5589372601a0 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.745+0000 7f995b7fe700 1 -- 172.21.15.70:0/1927066018 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996009a2a0 con 0x5589372601a0 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 -- 172.21.15.70:0/1927066018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589372601a0 msgr2=0x558937259b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 --2- 172.21.15.70:0/1927066018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589372601a0 0x558937259b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9960096ab0 tx=0x7f9960099ac0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 -- 172.21.15.70:0/1927066018 shutdown_connections 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 --2- 172.21.15.70:0/1927066018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 0x55893725a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 --2- 172.21.15.70:0/1927066018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725f880 0x55893725fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 --2- 172.21.15.70:0/1927066018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589372601a0 0x558937259b70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 -- 172.21.15.70:0/1927066018 >> 172.21.15.70:0/1927066018 conn(0x5589371ce200 msgr2=0x558937254b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 -- 172.21.15.70:0/1927066018 shutdown_connections 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 -- 172.21.15.70:0/1927066018 wait complete. 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 -- start start 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.746+0000 7f99837c0b80 1 Processor -- start 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 0x558937263580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x558937263ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5589372601a0 0x558937264000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f99837c0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589371acdd0 con 0x55893725f880 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f99837c0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589371496b0 con 0x55893725a0b0 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f99837c0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558937149350 con 0x5589372601a0 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f99837c0b80 10 client.0 _ll_register_callbacks cb 0x558936fa67a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x558937263ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9975373700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 0x558937263580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x558937263ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52254/0 (socket says 172.21.15.70:52254) 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9974b72700 1 -- 172.21.15.70:0/3554504399 learned_addr learned my addr 172.21.15.70:0/3554504399 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9975b74700 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5589372601a0 0x558937264000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9974b72700 1 -- 172.21.15.70:0/3554504399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5589372601a0 msgr2=0x558937264000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9974b72700 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5589372601a0 0x558937264000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9974b72700 1 -- 172.21.15.70:0/3554504399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 msgr2=0x558937263580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9974b72700 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 0x558937263580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9974b72700 1 -- 172.21.15.70:0/3554504399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99701a3860 con 0x55893725f880 2023-10-08T08:44:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9975373700 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 0x558937263580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9974b72700 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x558937263ac0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f996000a700 tx=0x7f996000f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93ff4f286d854ee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9958ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9958ff9700 1 -- 172.21.15.70:0/3554504399 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960007c60 con 0x55893725f880 2023-10-08T08:44:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f9958ff9700 1 -- 172.21.15.70:0/3554504399 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f996009e190 con 0x55893725f880 2023-10-08T08:44:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.747+0000 7f99837c0b80 1 -- 172.21.15.70:0/3554504399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558937174e50 con 0x55893725f880 2023-10-08T08:44:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f9958ff9700 1 -- 172.21.15.70:0/3554504399 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9960099530 con 0x55893725f880 2023-10-08T08:44:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f99837c0b80 10 client.16215 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f99837c0b80 1 -- 172.21.15.70:0/3554504399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558936fc0c00 con 0x55893725f880 2023-10-08T08:44:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f9958ff9700 1 -- 172.21.15.70:0/3554504399 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558937174e50 con 0x55893725f880 2023-10-08T08:44:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f9958ff9700 1 -- 172.21.15.70:0/3554504399 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f99600a1f40 con 0x55893725f880 2023-10-08T08:44:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f99837c0b80 10 client.16215 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f99837c0b80 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f99837c0b80 20 client.16215 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x558937277bc0 0x558937279fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f99837c0b80 4 client.16215 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f99837c0b80 1 -- 172.21.15.70:0/3554504399 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589371a5db0 con 0x558937277bc0 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.748+0000 7f9975373700 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x558937277bc0 0x558937279fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.749+0000 7f9958ff9700 10 client.16215 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.749+0000 7f9975373700 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x558937277bc0 0x558937279fb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6359e70e393aa233 server_cookie=315b0d0edc012943 in_seq=0 out_seq=0 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f9958ff9700 1 -- 172.21.15.70:0/3554504399 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5589371a5db0 con 0x558937277bc0 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f9958ff9700 10 client.16215 handle_command_reply: tid=0 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 client.16215 shutdown 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 -- 172.21.15.70:0/3554504399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 msgr2=0x558937263ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x558937263ac0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f996000a700 tx=0x7f996000f9b0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 -- 172.21.15.70:0/3554504399 shutdown_connections 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5589372601a0 0x558937264000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x558937277bc0 0x558937279fb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55893725a0b0 0x558937263580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3554504399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x558937263ac0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f9958ff9700 0 client.16215 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 -- 172.21.15.70:0/3554504399 >> 172.21.15.70:0/3554504399 conn(0x5589371ce200 msgr2=0x558937254010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 -- 172.21.15.70:0/3554504399 shutdown_connections 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 1 -- 172.21.15.70:0/3554504399 wait complete. 2023-10-08T08:44:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.750+0000 7f99837c0b80 20 client.16215 trim_cache size 0 max 16384 2023-10-08T08:44:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.764+0000 7f99837c0b80 1 Processor -- start 2023-10-08T08:44:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.764+0000 7f99837c0b80 1 -- start start 2023-10-08T08:44:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.764+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 0x558937259b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.764+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893725ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.764+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 0x558937263e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.764+0000 7f99837c0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55893702d8c0 con 0x55893725f880 2023-10-08T08:44:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.764+0000 7f99837c0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x558937251830 con 0x5589372601a0 2023-10-08T08:44:59.770 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f99837c0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558937255940 con 0x55893725a0b0 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893725ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893725ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52262/0 (socket says 172.21.15.70:52262) 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9974b72700 1 -- 172.21.15.70:0/2874190827 learned_addr learned my addr 172.21.15.70:0/2874190827 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9975b74700 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 0x558937263e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9975373700 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 0x558937259b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9974b72700 1 -- 172.21.15.70:0/2874190827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 msgr2=0x558937259b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9974b72700 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 0x558937259b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9974b72700 1 -- 172.21.15.70:0/2874190827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 msgr2=0x558937263e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9974b72700 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 0x558937263e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9974b72700 1 -- 172.21.15.70:0/2874190827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55893727eb60 con 0x55893725f880 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9975b74700 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 0x558937263e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:44:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f9974b72700 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893725ed60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9960099d40 tx=0x7f9960096400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff0c4411008bf73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f995bfff700 1 -- 172.21.15.70:0/2874190827 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960007c60 con 0x55893725f880 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f995bfff700 1 -- 172.21.15.70:0/2874190827 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f996009e190 con 0x55893725f880 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.765+0000 7f995bfff700 1 -- 172.21.15.70:0/2874190827 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960099790 con 0x55893725f880 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 -- 172.21.15.70:0/2874190827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 msgr2=0x55893725ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893725ed60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9960099d40 tx=0x7f9960096400 comp rx=0 tx=0).stop 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 -- 172.21.15.70:0/2874190827 shutdown_connections 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 0x558937263e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 0x558937259b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 --2- 172.21.15.70:0/2874190827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893725ed60 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 -- 172.21.15.70:0/2874190827 >> 172.21.15.70:0/2874190827 conn(0x5589371ce200 msgr2=0x55893725e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 -- 172.21.15.70:0/2874190827 shutdown_connections 2023-10-08T08:44:59.772 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 -- 172.21.15.70:0/2874190827 wait complete. 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 -- start start 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.766+0000 7f99837c0b80 1 Processor -- start 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 0x55893726f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893726c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f99837c0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 0x55893726ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f99837c0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55893726d110 con 0x55893725f880 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f99837c0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55893726d280 con 0x5589372601a0 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f99837c0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589372ca940 con 0x55893725a0b0 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f99837c0b80 10 client.0 _ll_register_callbacks cb 0x7f9968009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893726c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9974b72700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893726c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52268/0 (socket says 172.21.15.70:52268) 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9974b72700 1 -- 172.21.15.70:0/3427613150 learned_addr learned my addr 172.21.15.70:0/3427613150 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:44:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9975b74700 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 0x55893726ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9975373700 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 0x55893726f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9974b72700 1 -- 172.21.15.70:0/3427613150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 msgr2=0x55893726f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9974b72700 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 0x55893726f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9974b72700 1 -- 172.21.15.70:0/3427613150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 msgr2=0x55893726ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9974b72700 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 0x55893726ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9974b72700 1 -- 172.21.15.70:0/3427613150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997010de30 con 0x55893725f880 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9974b72700 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893726c4f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f99600a1ea0 tx=0x7f99600afff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2236597fb3be009 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9958ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9958ff9700 1 -- 172.21.15.70:0/3427613150 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960007c60 con 0x55893725f880 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f9958ff9700 1 -- 172.21.15.70:0/3427613150 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f99600a23d0 con 0x55893725f880 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.767+0000 7f99837c0b80 1 -- 172.21.15.70:0/3427613150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f996009a040 con 0x55893725f880 2023-10-08T08:44:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f9958ff9700 1 -- 172.21.15.70:0/3427613150 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9960099e10 con 0x55893725f880 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f99837c0b80 10 client.16221 fetch_fsmap learned FSMap version 27 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f99837c0b80 1 -- 172.21.15.70:0/3427613150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558936fc0c00 con 0x55893725f880 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f9958ff9700 1 -- 172.21.15.70:0/3427613150 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9960083080 con 0x55893725f880 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f9958ff9700 1 -- 172.21.15.70:0/3427613150 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9960098fa0 con 0x55893725f880 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f99837c0b80 10 client.16221 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f99837c0b80 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f99837c0b80 20 client.16221 populate_metadata read hostname 'smithi070' 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5589372cbbe0 0x5589372cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f99837c0b80 4 client.16221 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f99837c0b80 1 -- 172.21.15.70:0/3427613150 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5589371a5ad0 con 0x5589372cbbe0 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.768+0000 7f9975373700 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5589372cbbe0 0x5589372cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:44:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.769+0000 7f9958ff9700 10 client.16221 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:44:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:44:59.769+0000 7f9975373700 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5589372cbbe0 0x5589372cdfd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b248e754d780e6e server_cookie=3eafef2d26402f41 in_seq=0 out_seq=0 2023-10-08T08:45:00.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:00 smithi105 ceph-mon[103798]: pgmap v326: 129 pgs: 129 active+clean; 4.0 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 263 KiB/s wr, 30 op/s 2023-10-08T08:45:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:00 smithi191 ceph-mon[104220]: pgmap v326: 129 pgs: 129 active+clean; 4.0 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 263 KiB/s wr, 30 op/s 2023-10-08T08:45:00.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:00 smithi070 ceph-mon[99513]: pgmap v326: 129 pgs: 129 active+clean; 4.0 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 263 KiB/s wr, 30 op/s 2023-10-08T08:45:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f9958ff9700 1 -- 172.21.15.70:0/3427613150 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5589371a5ad0 con 0x5589372cbbe0 2023-10-08T08:45:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f9958ff9700 10 client.16221 handle_command_reply: tid=0 2023-10-08T08:45:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 client.16221 shutdown 2023-10-08T08:45:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 -- 172.21.15.70:0/3427613150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 msgr2=0x55893726c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893726c4f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f99600a1ea0 tx=0x7f99600afff0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 -- 172.21.15.70:0/3427613150 shutdown_connections 2023-10-08T08:45:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5589372cbbe0 0x5589372cdfd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5589372601a0 0x55893726ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55893725a0b0 0x55893726f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 --2- 172.21.15.70:0/3427613150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55893725f880 0x55893726c4f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 -- 172.21.15.70:0/3427613150 >> 172.21.15.70:0/3427613150 conn(0x5589371ce200 msgr2=0x558937263e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f9958ff9700 0 client.16221 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 -- 172.21.15.70:0/3427613150 shutdown_connections 2023-10-08T08:45:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.260+0000 7f99837c0b80 1 -- 172.21.15.70:0/3427613150 wait complete. 2023-10-08T08:45:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99837c0b80 20 client.16221 trim_cache size 0 max 16384 2023-10-08T08:45:01.263 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:45:01.264 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:45:01.264 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:45:01.264 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:45:01.264 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 -- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f995c0a15f0 msgr2=0x7f995c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f995c0a15f0 0x7f995c0a3ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f996c011490 tx=0x7f996c009260 comp rx=0 tx=0).stop 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 -- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 msgr2=0x7f997019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 0x7f997019cdb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f996000c9b0 tx=0x7f996000ccc0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 -- 172.21.15.70:0/2378165779 shutdown_connections 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f995c0a15f0 0x7f995c0a3ab0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9970106760 0x7f99701969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99700fec60 0x7f997019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 --2- 172.21.15.70:0/2378165779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99700ff620 0x7f997019cdb0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 -- 172.21.15.70:0/2378165779 >> 172.21.15.70:0/2378165779 conn(0x7f9970075bf0 msgr2=0x7f99700fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:01.265 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 -- 172.21.15.70:0/2378165779 shutdown_connections 2023-10-08T08:45:01.266 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:01.261+0000 7f99775d7700 1 -- 172.21.15.70:0/2378165779 wait complete. 2023-10-08T08:45:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:02 smithi105 ceph-mon[103798]: pgmap v327: 129 pgs: 129 active+clean; 28 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 2.3 MiB/s wr, 278 op/s 2023-10-08T08:45:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:02 smithi191 ceph-mon[104220]: pgmap v327: 129 pgs: 129 active+clean; 28 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 2.3 MiB/s wr, 278 op/s 2023-10-08T08:45:02.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:02 smithi070 ceph-mon[99513]: pgmap v327: 129 pgs: 129 active+clean; 28 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 2.3 MiB/s wr, 278 op/s 2023-10-08T08:45:03.499 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:03 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:03.500 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:03 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[141878]: *** Caught signal (Segmentation fault) ** 2023-10-08T08:45:03.500 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:03 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[141878]: in thread 7ff7edb11700 thread_name:MR_Finisher 2023-10-08T08:45:03.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:03 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:03.711 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:03 smithi105 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service: Main process exited, code=exited, status=139/n/a 2023-10-08T08:45:03.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:03 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:03.770 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:03 smithi105 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service: Failed with result 'exit-code'. 2023-10-08T08:45:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:04 smithi105 ceph-mon[103798]: pgmap v328: 129 pgs: 129 active+clean; 29 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 2.5 MiB/s wr, 506 op/s 2023-10-08T08:45:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:04 smithi191 ceph-mon[104220]: pgmap v328: 129 pgs: 129 active+clean; 29 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 2.5 MiB/s wr, 506 op/s 2023-10-08T08:45:04.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:04 smithi070 ceph-mon[99513]: pgmap v328: 129 pgs: 129 active+clean; 29 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 2.5 MiB/s wr, 506 op/s 2023-10-08T08:45:05.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:05 smithi105 ceph-mon[103798]: scrub summary: idle 2023-10-08T08:45:05.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:05 smithi191 ceph-mon[104220]: scrub summary: idle 2023-10-08T08:45:05.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:05 smithi070 ceph-mon[99513]: scrub summary: idle 2023-10-08T08:45:06.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:06 smithi105 ceph-mon[103798]: pgmap v329: 129 pgs: 129 active+clean; 31 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 1.07k op/s 2023-10-08T08:45:06.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:06 smithi191 ceph-mon[104220]: pgmap v329: 129 pgs: 129 active+clean; 31 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 1.07k op/s 2023-10-08T08:45:06.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:06 smithi070 ceph-mon[99513]: pgmap v329: 129 pgs: 129 active+clean; 31 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 1.07k op/s 2023-10-08T08:45:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:08 smithi105 ceph-mon[103798]: pgmap v330: 129 pgs: 129 active+clean; 31 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 1.22k op/s 2023-10-08T08:45:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:08 smithi191 ceph-mon[104220]: pgmap v330: 129 pgs: 129 active+clean; 31 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 1.22k op/s 2023-10-08T08:45:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:08 smithi070 ceph-mon[99513]: pgmap v330: 129 pgs: 129 active+clean; 31 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 1.22k op/s 2023-10-08T08:45:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:10 smithi191 ceph-mon[104220]: pgmap v331: 129 pgs: 129 active+clean; 31 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 1.22k op/s 2023-10-08T08:45:10.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:10 smithi070 ceph-mon[99513]: pgmap v331: 129 pgs: 129 active+clean; 31 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 1.22k op/s 2023-10-08T08:45:10.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:10 smithi105 ceph-mon[103798]: pgmap v331: 129 pgs: 129 active+clean; 31 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 1.22k op/s 2023-10-08T08:45:11.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:11 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:11.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:11 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:11.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:11 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:12 smithi191 ceph-mon[104220]: pgmap v332: 129 pgs: 129 active+clean; 34 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 1.21k op/s 2023-10-08T08:45:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:12 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:45:12.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:12 smithi070 ceph-mon[99513]: pgmap v332: 129 pgs: 129 active+clean; 34 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 1.21k op/s 2023-10-08T08:45:12.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:12 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:45:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:12 smithi105 ceph-mon[103798]: pgmap v332: 129 pgs: 129 active+clean; 34 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 1.21k op/s 2023-10-08T08:45:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:12 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:45:13.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:45:13.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:45:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:45:13.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:45:13.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:45:13.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:45:13.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:45:13.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:45:13.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:45:14.082 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:13 smithi105 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service: Service RestartSec=10s expired, scheduling restart. 2023-10-08T08:45:14.082 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:13 smithi105 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service: Scheduled restart job, restart counter is at 1. 2023-10-08T08:45:14.082 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:13 smithi105 systemd[1]: Stopped Ceph mds.e for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:45:14.082 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:13 smithi105 systemd[1]: Starting Ceph mds.e for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:45:14.332 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:14 smithi105 podman[144776]: 2023-10-08T08:45:14.332 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:14 smithi105 ceph-mds[144816]: -- 172.21.15.105:0/4072828007 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b6bf85f1e0 con 0x55b6bf834800 2023-10-08T08:45:14.332 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:14 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: starting mds.e at 2023-10-08T08:45:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 -- 172.21.15.70:0/3889001466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 msgr2=0x7fd2040ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 --2- 172.21.15.70:0/3889001466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 0x7fd2040ffa50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009990 tx=0x7fd1f0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 -- 172.21.15.70:0/3889001466 shutdown_connections 2023-10-08T08:45:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 --2- 172.21.15.70:0/3889001466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2040fff90 0x7fd20410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 --2- 172.21.15.70:0/3889001466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2041045e0 0x7fd2041049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 --2- 172.21.15.70:0/3889001466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 0x7fd2040ffa50 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 -- 172.21.15.70:0/3889001466 >> 172.21.15.70:0/3889001466 conn(0x7fd204076790 msgr2=0x7fd204076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 -- 172.21.15.70:0/3889001466 shutdown_connections 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 -- 172.21.15.70:0/3889001466 wait complete. 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 Processor -- start 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 -- start start 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 0x7fd204197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2040fff90 0x7fd204197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.374+0000 7fd20ac81700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2041045e0 0x7fd2041a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd20ac81700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204198790 con 0x7fd2040ff5d0 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd20ac81700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2041a2f20 con 0x7fd2040fff90 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd20ac81700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2041a3090 con 0x7fd2041045e0 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd208a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 0x7fd204197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd208a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 0x7fd204197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52282/0 (socket says 172.21.15.70:52282) 2023-10-08T08:45:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd208a1d700 1 -- 172.21.15.70:0/906727771 learned_addr learned my addr 172.21.15.70:0/906727771 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd203fff700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2040fff90 0x7fd204197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd20921e700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2041045e0 0x7fd2041a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd208a1d700 1 -- 172.21.15.70:0/906727771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2041045e0 msgr2=0x7fd2041a29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd208a1d700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2041045e0 0x7fd2041a29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd208a1d700 1 -- 172.21.15.70:0/906727771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2040fff90 msgr2=0x7fd204197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd208a1d700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2040fff90 0x7fd204197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd208a1d700 1 -- 172.21.15.70:0/906727771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f00095f0 con 0x7fd2040ff5d0 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd20921e700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2041045e0 0x7fd2041a29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd208a1d700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 0x7fd204197960 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800d980 tx=0x7fd1f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd201ffb700 1 -- 172.21.15.70:0/906727771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800b950 con 0x7fd2040ff5d0 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd20ac81700 1 -- 172.21.15.70:0/906727771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2041a3370 con 0x7fd2040ff5d0 2023-10-08T08:45:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd201ffb700 1 -- 172.21.15.70:0/906727771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1f8007620 con 0x7fd2040ff5d0 2023-10-08T08:45:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd201ffb700 1 -- 172.21.15.70:0/906727771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800f3c0 con 0x7fd2040ff5d0 2023-10-08T08:45:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.375+0000 7fd20ac81700 1 -- 172.21.15.70:0/906727771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2041a38d0 con 0x7fd2040ff5d0 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.378+0000 7fd201ffb700 1 -- 172.21.15.70:0/906727771 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd1f8010640 con 0x7fd2040ff5d0 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.378+0000 7fd201ffb700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a15f0 0x7fd1f40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.379+0000 7fd203fff700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a15f0 0x7fd1f40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.379+0000 7fd201ffb700 1 -- 172.21.15.70:0/906727771 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd1f80cd1e0 con 0x7fd2040ff5d0 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.379+0000 7fd203fff700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a15f0 0x7fd1f40a3ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd2040682d0 tx=0x7fd1f0005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.379+0000 7fd216e6ab80 1 Processor -- start 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.379+0000 7fd216e6ab80 1 -- start start 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.379+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 0x55bdb1ee8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.379+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1ee2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.379+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.379+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1e4b400 con 0x55bdb1ee30b0 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1e3cbc0 con 0x55bdb1ee91a0 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1e3a4e0 con 0x55bdb1ee8880 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd20921e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd20921e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52294/0 (socket says 172.21.15.70:52294) 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd20921e700 1 -- 172.21.15.70:0/734362257 learned_addr learned my addr 172.21.15.70:0/734362257 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd203fff700 1 --2- 172.21.15.70:0/734362257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1ee2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd208a1d700 1 --2- 172.21.15.70:0/734362257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 0x55bdb1ee8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd20921e700 1 -- 172.21.15.70:0/734362257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 msgr2=0x55bdb1ee8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd20921e700 1 --2- 172.21.15.70:0/734362257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 0x55bdb1ee8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd20921e700 1 -- 172.21.15.70:0/734362257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 msgr2=0x55bdb1ee2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd20921e700 1 --2- 172.21.15.70:0/734362257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1ee2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd20921e700 1 -- 172.21.15.70:0/734362257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdb1c60d80 con 0x55bdb1ee30b0 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd20921e700 1 --2- 172.21.15.70:0/734362257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee3510 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009400 tx=0x7fd1fc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4388c7f48414588 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd1eeffd700 1 -- 172.21.15.70:0/734362257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc014610 con 0x55bdb1ee30b0 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd1eeffd700 1 -- 172.21.15.70:0/734362257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1fc00f050 con 0x55bdb1ee30b0 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.380+0000 7fd1eeffd700 1 -- 172.21.15.70:0/734362257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0139b0 con 0x55bdb1ee30b0 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 -- 172.21.15.70:0/734362257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 msgr2=0x55bdb1ee3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/734362257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee3510 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009400 tx=0x7fd1fc009920 comp rx=0 tx=0).stop 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 -- 172.21.15.70:0/734362257 shutdown_connections 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/734362257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee3510 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/734362257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 0x55bdb1ee8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/734362257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1ee2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 -- 172.21.15.70:0/734362257 >> 172.21.15.70:0/734362257 conn(0x55bdb1e57200 msgr2=0x55bdb1eddb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 -- 172.21.15.70:0/734362257 shutdown_connections 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 -- 172.21.15.70:0/734362257 wait complete. 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 -- start start 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.381+0000 7fd216e6ab80 1 Processor -- start 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee30b0 0x55bdb1eec550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee8880 0x55bdb1eeca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1eecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1e35dd0 con 0x55bdb1ee8880 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1dd26b0 con 0x55bdb1ee91a0 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1dd2350 con 0x55bdb1ee30b0 2023-10-08T08:45:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd216e6ab80 10 client.0 _ll_register_callbacks cb 0x55bdb1c2f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd203fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee8880 0x55bdb1eeca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd203fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee8880 0x55bdb1eeca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52298/0 (socket says 172.21.15.70:52298) 2023-10-08T08:45:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd203fff700 1 -- 172.21.15.70:0/272194184 learned_addr learned my addr 172.21.15.70:0/272194184 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd20921e700 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1eecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd208a1d700 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee30b0 0x55bdb1eec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd203fff700 1 -- 172.21.15.70:0/272194184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee30b0 msgr2=0x55bdb1eec550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd203fff700 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee30b0 0x55bdb1eec550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd203fff700 1 -- 172.21.15.70:0/272194184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 msgr2=0x55bdb1eecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd203fff700 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1eecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd203fff700 1 -- 172.21.15.70:0/272194184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc0090b0 con 0x55bdb1ee8880 2023-10-08T08:45:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd203fff700 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee8880 0x55bdb1eeca90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098e0 tx=0x7fd1f0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c60108a5c5fed2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.382+0000 7fd1e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd1e3fff700 1 -- 172.21.15.70:0/272194184 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0004e50 con 0x55bdb1ee8880 2023-10-08T08:45:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd216e6ab80 1 -- 172.21.15.70:0/272194184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bdb1dfde50 con 0x55bdb1ee8880 2023-10-08T08:45:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd1e3fff700 1 -- 172.21.15.70:0/272194184 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd1f000f460 con 0x55bdb1ee8880 2023-10-08T08:45:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd1e3fff700 1 -- 172.21.15.70:0/272194184 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1f0039730 con 0x55bdb1ee8880 2023-10-08T08:45:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd216e6ab80 10 client.16239 fetch_fsmap learned FSMap version 28 2023-10-08T08:45:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd216e6ab80 1 -- 172.21.15.70:0/272194184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55bdb1c49c00 con 0x55bdb1ee8880 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd1e3fff700 1 -- 172.21.15.70:0/272194184 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bdb1dfde50 con 0x55bdb1ee8880 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd1e3fff700 1 -- 172.21.15.70:0/272194184 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd1f002f070 con 0x55bdb1ee8880 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd216e6ab80 10 client.16239 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd216e6ab80 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd216e6ab80 20 client.16239 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55bdb1efcd50 0x55bdb1eff170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd216e6ab80 4 client.16239 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd216e6ab80 1 -- 172.21.15.70:0/272194184 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bdb1e2edb0 con 0x55bdb1efcd50 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.383+0000 7fd208a1d700 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55bdb1efcd50 0x55bdb1eff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd1e3fff700 10 client.16239 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd208a1d700 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55bdb1efcd50 0x55bdb1eff170 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcd1ac455fc7320e server_cookie=317063facda70d91 in_seq=0 out_seq=0 2023-10-08T08:45:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd1e3fff700 1 -- 172.21.15.70:0/272194184 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bdb1e2edb0 con 0x55bdb1efcd50 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd1e3fff700 10 client.16239 handle_command_reply: tid=0 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd216e6ab80 1 client.16239 shutdown 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd216e6ab80 1 -- 172.21.15.70:0/272194184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee8880 msgr2=0x55bdb1eeca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee8880 0x55bdb1eeca90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098e0 tx=0x7fd1f0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd216e6ab80 1 -- 172.21.15.70:0/272194184 shutdown_connections 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55bdb1efcd50 0x55bdb1eff170 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1eecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee30b0 0x55bdb1eec550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd1e3fff700 0 client.16239 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/272194184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee8880 0x55bdb1eeca90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.384+0000 7fd216e6ab80 1 -- 172.21.15.70:0/272194184 >> 172.21.15.70:0/272194184 conn(0x55bdb1e57200 msgr2=0x55bdb1edd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.385+0000 7fd216e6ab80 1 -- 172.21.15.70:0/272194184 shutdown_connections 2023-10-08T08:45:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.385+0000 7fd216e6ab80 1 -- 172.21.15.70:0/272194184 wait complete. 2023-10-08T08:45:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.385+0000 7fd216e6ab80 20 client.16239 trim_cache size 0 max 16384 2023-10-08T08:45:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.399+0000 7fd216e6ab80 1 Processor -- start 2023-10-08T08:45:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.399+0000 7fd216e6ab80 1 -- start start 2023-10-08T08:45:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.399+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.399+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 0x55bdb1ef3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.399+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1eecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.399+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1cb68c0 con 0x55bdb1ee30b0 2023-10-08T08:45:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.399+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1eedb50 con 0x55bdb1ee91a0 2023-10-08T08:45:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.399+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1ef4150 con 0x55bdb1ee8880 2023-10-08T08:45:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.399+0000 7fd208a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd208a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52304/0 (socket says 172.21.15.70:52304) 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd208a1d700 1 -- 172.21.15.70:0/3365755913 learned_addr learned my addr 172.21.15.70:0/3365755913 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd20921e700 1 --2- 172.21.15.70:0/3365755913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1eecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd203fff700 1 --2- 172.21.15.70:0/3365755913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 0x55bdb1ef3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd208a1d700 1 -- 172.21.15.70:0/3365755913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 msgr2=0x55bdb1ef3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd208a1d700 1 --2- 172.21.15.70:0/3365755913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 0x55bdb1ef3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd208a1d700 1 -- 172.21.15.70:0/3365755913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 msgr2=0x55bdb1eecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd208a1d700 1 --2- 172.21.15.70:0/3365755913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1eecdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd208a1d700 1 -- 172.21.15.70:0/3365755913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdb1c871f0 con 0x55bdb1ee30b0 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd208a1d700 1 --2- 172.21.15.70:0/3365755913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee2b70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80ca660 tx=0x7fd1f80cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a3e0367d1e0e79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd1ef7fe700 1 -- 172.21.15.70:0/3365755913 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f809dfe0 con 0x55bdb1ee30b0 2023-10-08T08:45:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd1ef7fe700 1 -- 172.21.15.70:0/3365755913 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1f8014070 con 0x55bdb1ee30b0 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.400+0000 7fd1ef7fe700 1 -- 172.21.15.70:0/3365755913 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f809a0f0 con 0x55bdb1ee30b0 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 -- 172.21.15.70:0/3365755913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 msgr2=0x55bdb1ee2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/3365755913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee2b70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80ca660 tx=0x7fd1f80cc040 comp rx=0 tx=0).stop 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 -- 172.21.15.70:0/3365755913 shutdown_connections 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/3365755913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee91a0 0x55bdb1eecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/3365755913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ee2b70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/3365755913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee8880 0x55bdb1ef3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 -- 172.21.15.70:0/3365755913 >> 172.21.15.70:0/3365755913 conn(0x55bdb1e57200 msgr2=0x55bdb1ed9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 -- 172.21.15.70:0/3365755913 shutdown_connections 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 -- 172.21.15.70:0/3365755913 wait complete. 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 -- start start 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 Processor -- start 2023-10-08T08:45:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ef1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee8880 0x55bdb1ef2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee91a0 0x55bdb1f49b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1f4a090 con 0x55bdb1ee30b0 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1f4a200 con 0x55bdb1ee8880 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdb1f4a3c0 con 0x55bdb1ee91a0 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.401+0000 7fd216e6ab80 10 client.0 _ll_register_callbacks cb 0x7fd1f000ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd208a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ef1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd208a1d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ef1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52310/0 (socket says 172.21.15.70:52310) 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd208a1d700 1 -- 172.21.15.70:0/1585107913 learned_addr learned my addr 172.21.15.70:0/1585107913 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd203fff700 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee8880 0x55bdb1ef2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd20921e700 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee91a0 0x55bdb1f49b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd208a1d700 1 -- 172.21.15.70:0/1585107913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee91a0 msgr2=0x55bdb1f49b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd208a1d700 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee91a0 0x55bdb1f49b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd208a1d700 1 -- 172.21.15.70:0/1585107913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee8880 msgr2=0x55bdb1ef2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd208a1d700 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee8880 0x55bdb1ef2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd208a1d700 1 -- 172.21.15.70:0/1585107913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2041a38d0 con 0x55bdb1ee30b0 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd20921e700 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee91a0 0x55bdb1f49b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd208a1d700 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ef1e00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80cc010 tx=0x7fd1f80a2220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c924faf3111e420e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd1e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd1e3fff700 1 -- 172.21.15.70:0/1585107913 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8099380 con 0x55bdb1ee30b0 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd1e3fff700 1 -- 172.21.15.70:0/1585107913 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd1f80994e0 con 0x55bdb1ee30b0 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd216e6ab80 1 -- 172.21.15.70:0/1585107913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1fc00f050 con 0x55bdb1ee30b0 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd1e3fff700 1 -- 172.21.15.70:0/1585107913 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1f809a0f0 con 0x55bdb1ee30b0 2023-10-08T08:45:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd216e6ab80 10 client.16245 fetch_fsmap learned FSMap version 28 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd216e6ab80 1 -- 172.21.15.70:0/1585107913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55bdb1c5f250 con 0x55bdb1ee30b0 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd1e3fff700 1 -- 172.21.15.70:0/1585107913 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1f8080020 con 0x55bdb1ee30b0 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.402+0000 7fd1e3fff700 1 -- 172.21.15.70:0/1585107913 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd1f8098df0 con 0x55bdb1ee30b0 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.403+0000 7fd216e6ab80 10 client.16245 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.403+0000 7fd216e6ab80 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.403+0000 7fd216e6ab80 20 client.16245 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.403+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55bdb1f51930 0x55bdb1f53d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.403+0000 7fd216e6ab80 4 client.16245 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.403+0000 7fd216e6ab80 1 -- 172.21.15.70:0/1585107913 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bdb1e2ead0 con 0x55bdb1f51930 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.403+0000 7fd203fff700 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55bdb1f51930 0x55bdb1f53d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.403+0000 7fd1e3fff700 10 client.16245 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:14.403+0000 7fd203fff700 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55bdb1f51930 0x55bdb1f53d50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3939271549860ab6 server_cookie=89f14d065a2cf06b in_seq=0 out_seq=0 2023-10-08T08:45:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:14 smithi070 ceph-mon[99513]: pgmap v333: 129 pgs: 129 active+clean; 34 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 1.5 MiB/s wr, 960 op/s 2023-10-08T08:45:14.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:14 smithi070 ceph-mon[99513]: daemon mds.e restarted 2023-10-08T08:45:14.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:14 smithi105 ceph-mon[103798]: pgmap v333: 129 pgs: 129 active+clean; 34 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 1.5 MiB/s wr, 960 op/s 2023-10-08T08:45:14.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:14 smithi105 ceph-mon[103798]: daemon mds.e restarted 2023-10-08T08:45:14.772 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:14 smithi105 bash[144776]: e986c6fdcef4c110d7ee73ce42a7fdde574a9a505244ffb227e8ef46082e44cf 2023-10-08T08:45:14.772 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:45:14 smithi105 systemd[1]: Started Ceph mds.e for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:45:14.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:14 smithi191 ceph-mon[104220]: pgmap v333: 129 pgs: 129 active+clean; 34 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 1.5 MiB/s wr, 960 op/s 2023-10-08T08:45:14.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:14 smithi191 ceph-mon[104220]: daemon mds.e restarted 2023-10-08T08:45:15.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:15 smithi070 ceph-mon[99513]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T08:45:15.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:15 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6834/3069500316,v1:172.21.15.105:6835/3069500316] up:boot 2023-10-08T08:45:15.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:15 smithi070 ceph-mon[99513]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T08:45:15.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:45:15.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:15 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:15.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:15 smithi105 ceph-mon[103798]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T08:45:15.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:15 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6834/3069500316,v1:172.21.15.105:6835/3069500316] up:boot 2023-10-08T08:45:15.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:15 smithi105 ceph-mon[103798]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T08:45:15.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:45:15.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:15 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:15 smithi191 ceph-mon[104220]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T08:45:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:15 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6834/3069500316,v1:172.21.15.105:6835/3069500316] up:boot 2023-10-08T08:45:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:15 smithi191 ceph-mon[104220]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T08:45:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:45:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:15 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd1e3fff700 1 -- 172.21.15.70:0/1585107913 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bdb1e2ead0 con 0x55bdb1f51930 2023-10-08T08:45:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd1e3fff700 10 client.16245 handle_command_reply: tid=0 2023-10-08T08:45:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd216e6ab80 1 client.16245 shutdown 2023-10-08T08:45:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd216e6ab80 1 -- 172.21.15.70:0/1585107913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 msgr2=0x55bdb1ef1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ef1e00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80cc010 tx=0x7fd1f80a2220 comp rx=0 tx=0).stop 2023-10-08T08:45:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd216e6ab80 1 -- 172.21.15.70:0/1585107913 shutdown_connections 2023-10-08T08:45:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bdb1ee91a0 0x55bdb1f49b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdb1ee30b0 0x55bdb1ef1e00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55bdb1f51930 0x55bdb1f53d50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd216e6ab80 1 --2- 172.21.15.70:0/1585107913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bdb1ee8880 0x55bdb1ef2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd216e6ab80 1 -- 172.21.15.70:0/1585107913 >> 172.21.15.70:0/1585107913 conn(0x55bdb1e57200 msgr2=0x55bdb1eeaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.893+0000 7fd1e3fff700 0 client.16245 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.894+0000 7fd216e6ab80 1 -- 172.21.15.70:0/1585107913 shutdown_connections 2023-10-08T08:45:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.894+0000 7fd216e6ab80 1 -- 172.21.15.70:0/1585107913 wait complete. 2023-10-08T08:45:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.894+0000 7fd216e6ab80 20 client.16245 trim_cache size 0 max 16384 2023-10-08T08:45:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:45:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:45:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:45:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:45:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 -- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a15f0 msgr2=0x7fd1f40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a15f0 0x7fd1f40a3ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd2040682d0 tx=0x7fd1f0005fd0 comp rx=0 tx=0).stop 2023-10-08T08:45:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 -- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 msgr2=0x7fd204197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 0x7fd204197960 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800d980 tx=0x7fd1f800dc90 comp rx=0 tx=0).stop 2023-10-08T08:45:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 -- 172.21.15.70:0/906727771 shutdown_connections 2023-10-08T08:45:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd1f40a15f0 0x7fd1f40a3ab0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2041045e0 0x7fd2041a29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2040ff5d0 0x7fd204197960 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 --2- 172.21.15.70:0/906727771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2040fff90 0x7fd204197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 -- 172.21.15.70:0/906727771 >> 172.21.15.70:0/906727771 conn(0x7fd204076790 msgr2=0x7fd2040fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 -- 172.21.15.70:0/906727771 shutdown_connections 2023-10-08T08:45:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:15.896+0000 7fd20ac81700 1 -- 172.21.15.70:0/906727771 wait complete. 2023-10-08T08:45:16.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:16 smithi070 ceph-mon[99513]: pgmap v335: 129 pgs: 129 active+clean; 40 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 1001 KiB/s wr, 273 op/s 2023-10-08T08:45:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:16 smithi105 ceph-mon[103798]: pgmap v335: 129 pgs: 129 active+clean; 40 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 1001 KiB/s wr, 273 op/s 2023-10-08T08:45:16.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:16 smithi191 ceph-mon[104220]: pgmap v335: 129 pgs: 129 active+clean; 40 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 1001 KiB/s wr, 273 op/s 2023-10-08T08:45:17.964 INFO:tasks.workunit.client.0.smithi070.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-10-08T08:45:17.965 INFO:tasks.workunit.client.0.smithi070.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-10-08T08:45:17.965 INFO:tasks.workunit.client.0.smithi070.stderr:+ make 2023-10-08T08:45:18.028 INFO:tasks.workunit.client.0.smithi070.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-10-08T08:45:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:18 smithi105 ceph-mon[103798]: pgmap v336: 129 pgs: 129 active+clean; 42 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.2 MiB/s wr, 500 op/s 2023-10-08T08:45:18.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:18 smithi191 ceph-mon[104220]: pgmap v336: 129 pgs: 129 active+clean; 42 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.2 MiB/s wr, 500 op/s 2023-10-08T08:45:18.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:18 smithi070 ceph-mon[99513]: pgmap v336: 129 pgs: 129 active+clean; 42 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.2 MiB/s wr, 500 op/s 2023-10-08T08:45:19.210 INFO:tasks.workunit.client.0.smithi070.stderr:++ readlink -f fsstress 2023-10-08T08:45:19.211 INFO:tasks.workunit.client.0.smithi070.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-10-08T08:45:19.211 INFO:tasks.workunit.client.0.smithi070.stderr:+ popd 2023-10-08T08:45:19.211 INFO:tasks.workunit.client.0.smithi070.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-10-08T08:45:19.211 INFO:tasks.workunit.client.0.smithi070.stderr:+ popd 2023-10-08T08:45:19.212 INFO:tasks.workunit.client.0.smithi070.stdout:~/cephtest/mnt.0/client.0/tmp 2023-10-08T08:45:19.212 INFO:tasks.workunit.client.0.smithi070.stderr:++ mktemp -d -p . 2023-10-08T08:45:19.213 INFO:tasks.workunit.client.0.smithi070.stderr:+ T=./tmp.d0CxhQbRKL 2023-10-08T08:45:19.213 INFO:tasks.workunit.client.0.smithi070.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.d0CxhQbRKL -l 1 -n 1000 -p 10 -v 2023-10-08T08:45:19.214 INFO:tasks.workunit.client.0.smithi070.stdout:seed = 1696672464 2023-10-08T08:45:19.216 INFO:tasks.workunit.client.0.smithi070.stdout:0/0: readlink - no filename 2023-10-08T08:45:19.216 INFO:tasks.workunit.client.0.smithi070.stdout:0/1: dwrite - no filename 2023-10-08T08:45:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/2: fdatasync - no filename 2023-10-08T08:45:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/3: write - no filename 2023-10-08T08:45:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/4: fsync - no filename 2023-10-08T08:45:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/5: dwrite - no filename 2023-10-08T08:45:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/6: dwrite - no filename 2023-10-08T08:45:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/7: chown . 7334 1 2023-10-08T08:45:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/8: unlink - no file 2023-10-08T08:45:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/9: write - no filename 2023-10-08T08:45:19.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/10: write - no filename 2023-10-08T08:45:19.218 INFO:tasks.workunit.client.0.smithi070.stdout:1/0: dwrite - no filename 2023-10-08T08:45:19.218 INFO:tasks.workunit.client.0.smithi070.stdout:1/1: link - no file 2023-10-08T08:45:19.218 INFO:tasks.workunit.client.0.smithi070.stdout:1/2: chown . 49183 1 2023-10-08T08:45:19.218 INFO:tasks.workunit.client.0.smithi070.stdout:1/3: read - no filename 2023-10-08T08:45:19.218 INFO:tasks.workunit.client.0.smithi070.stdout:1/4: rename - no filename 2023-10-08T08:45:19.218 INFO:tasks.workunit.client.0.smithi070.stdout:0/11: mknod c0 0 2023-10-08T08:45:19.218 INFO:tasks.workunit.client.0.smithi070.stdout:0/12: write - no filename 2023-10-08T08:45:19.219 INFO:tasks.workunit.client.0.smithi070.stdout:2/0: dwrite - no filename 2023-10-08T08:45:19.219 INFO:tasks.workunit.client.0.smithi070.stdout:1/5: symlink l0 0 2023-10-08T08:45:19.220 INFO:tasks.workunit.client.0.smithi070.stdout:0/13: mkdir d1 0 2023-10-08T08:45:19.220 INFO:tasks.workunit.client.0.smithi070.stdout:0/14: dread - no filename 2023-10-08T08:45:19.220 INFO:tasks.workunit.client.0.smithi070.stdout:0/15: write - no filename 2023-10-08T08:45:19.221 INFO:tasks.workunit.client.0.smithi070.stdout:2/1: symlink l0 0 2023-10-08T08:45:19.222 INFO:tasks.workunit.client.0.smithi070.stdout:1/6: symlink l1 0 2023-10-08T08:45:19.222 INFO:tasks.workunit.client.0.smithi070.stdout:1/7: rmdir - no directory 2023-10-08T08:45:19.222 INFO:tasks.workunit.client.0.smithi070.stdout:1/8: truncate - no filename 2023-10-08T08:45:19.222 INFO:tasks.workunit.client.0.smithi070.stdout:0/16: creat d1/f2 x:0 0 0 2023-10-08T08:45:19.227 INFO:tasks.workunit.client.0.smithi070.stdout:4/0: dwrite - no filename 2023-10-08T08:45:19.227 INFO:tasks.workunit.client.0.smithi070.stdout:3/0: mkdir d0 0 2023-10-08T08:45:19.227 INFO:tasks.workunit.client.0.smithi070.stdout:3/1: truncate - no filename 2023-10-08T08:45:19.227 INFO:tasks.workunit.client.0.smithi070.stdout:2/2: link l0 l1 0 2023-10-08T08:45:19.227 INFO:tasks.workunit.client.0.smithi070.stdout:0/17: creat d1/f3 x:0 0 0 2023-10-08T08:45:19.227 INFO:tasks.workunit.client.0.smithi070.stdout:0/18: readlink - no filename 2023-10-08T08:45:19.227 INFO:tasks.workunit.client.0.smithi070.stdout:5/0: write - no filename 2023-10-08T08:45:19.227 INFO:tasks.workunit.client.0.smithi070.stdout:5/1: write - no filename 2023-10-08T08:45:19.227 INFO:tasks.workunit.client.0.smithi070.stdout:5/2: dwrite - no filename 2023-10-08T08:45:19.228 INFO:tasks.workunit.client.0.smithi070.stdout:4/1: creat f0 x:0 0 0 2023-10-08T08:45:19.228 INFO:tasks.workunit.client.0.smithi070.stdout:4/2: stat f0 0 2023-10-08T08:45:19.228 INFO:tasks.workunit.client.0.smithi070.stdout:3/2: creat d0/f1 x:0 0 0 2023-10-08T08:45:19.230 INFO:tasks.workunit.client.0.smithi070.stdout:6/0: write - no filename 2023-10-08T08:45:19.247 INFO:tasks.workunit.client.0.smithi070.stdout:3/3: creat d0/f2 x:0 0 0 2023-10-08T08:45:19.248 INFO:tasks.workunit.client.0.smithi070.stdout:6/1: symlink l0 0 2023-10-08T08:45:19.248 INFO:tasks.workunit.client.0.smithi070.stdout:6/2: dwrite - no filename 2023-10-08T08:45:19.248 INFO:tasks.workunit.client.0.smithi070.stdout:4/3: unlink f0 0 2023-10-08T08:45:19.249 INFO:tasks.workunit.client.0.smithi070.stdout:4/4: fdatasync - no filename 2023-10-08T08:45:19.249 INFO:tasks.workunit.client.0.smithi070.stdout:0/19: fsync d1/f2 0 2023-10-08T08:45:19.249 INFO:tasks.workunit.client.0.smithi070.stdout:0/20: stat d1/f2 0 2023-10-08T08:45:19.249 INFO:tasks.workunit.client.0.smithi070.stdout:1/9: getdents . 0 2023-10-08T08:45:19.252 INFO:tasks.workunit.client.0.smithi070.stdout:3/4: symlink d0/l3 0 2023-10-08T08:45:19.254 INFO:tasks.workunit.client.0.smithi070.stdout:6/3: creat f1 x:0 0 0 2023-10-08T08:45:19.254 INFO:tasks.workunit.client.0.smithi070.stdout:6/4: readlink l0 0 2023-10-08T08:45:19.254 INFO:tasks.workunit.client.0.smithi070.stdout:6/5: rmdir - no directory 2023-10-08T08:45:19.255 INFO:tasks.workunit.client.0.smithi070.stdout:4/5: creat f1 x:0 0 0 2023-10-08T08:45:19.259 INFO:tasks.workunit.client.0.smithi070.stdout:6/6: creat f2 x:0 0 0 2023-10-08T08:45:19.259 INFO:tasks.workunit.client.0.smithi070.stdout:6/7: write f1 [4457,2604] 0 2023-10-08T08:45:19.259 INFO:tasks.workunit.client.0.smithi070.stdout:6/8: chown f1 2 1 2023-10-08T08:45:19.259 INFO:tasks.workunit.client.0.smithi070.stdout:0/21: link d1/f3 d1/f4 0 2023-10-08T08:45:19.259 INFO:tasks.workunit.client.0.smithi070.stdout:0/22: readlink - no filename 2023-10-08T08:45:19.259 INFO:tasks.workunit.client.0.smithi070.stdout:0/23: write d1/f3 [646448,87714] 0 2023-10-08T08:45:19.260 INFO:tasks.workunit.client.0.smithi070.stdout:1/10: mknod c2 0 2023-10-08T08:45:19.260 INFO:tasks.workunit.client.0.smithi070.stdout:1/11: dwrite - no filename 2023-10-08T08:45:19.260 INFO:tasks.workunit.client.0.smithi070.stdout:1/12: read - no filename 2023-10-08T08:45:19.261 INFO:tasks.workunit.client.0.smithi070.stdout:1/13: readlink l1 0 2023-10-08T08:45:19.261 INFO:tasks.workunit.client.0.smithi070.stdout:1/14: dwrite - no filename 2023-10-08T08:45:19.261 INFO:tasks.workunit.client.0.smithi070.stdout:1/15: rmdir - no directory 2023-10-08T08:45:19.264 INFO:tasks.workunit.client.0.smithi070.stdout:7/0: rename - no filename 2023-10-08T08:45:19.264 INFO:tasks.workunit.client.0.smithi070.stdout:7/1: rmdir - no directory 2023-10-08T08:45:19.264 INFO:tasks.workunit.client.0.smithi070.stdout:7/2: chown . 30 1 2023-10-08T08:45:19.290 INFO:tasks.workunit.client.0.smithi070.stdout:4/6: link f1 f2 0 2023-10-08T08:45:19.290 INFO:tasks.workunit.client.0.smithi070.stdout:0/24: link d1/f2 d1/f5 0 2023-10-08T08:45:19.297 INFO:tasks.workunit.client.0.smithi070.stdout:8/0: creat f0 x:0 0 0 2023-10-08T08:45:19.297 INFO:tasks.workunit.client.0.smithi070.stdout:4/7: creat f3 x:0 0 0 2023-10-08T08:45:19.297 INFO:tasks.workunit.client.0.smithi070.stdout:4/8: chown f2 16 1 2023-10-08T08:45:19.297 INFO:tasks.workunit.client.0.smithi070.stdout:4/9: rmdir - no directory 2023-10-08T08:45:19.298 INFO:tasks.workunit.client.0.smithi070.stdout:8/1: write f0 [462490,121844] 0 2023-10-08T08:45:19.298 INFO:tasks.workunit.client.0.smithi070.stdout:9/0: chown . 498135 1 2023-10-08T08:45:19.298 INFO:tasks.workunit.client.0.smithi070.stdout:9/1: write - no filename 2023-10-08T08:45:19.299 INFO:tasks.workunit.client.0.smithi070.stdout:8/2: mkdir d1 0 2023-10-08T08:45:19.299 INFO:tasks.workunit.client.0.smithi070.stdout:8/3: getdents d1 0 2023-10-08T08:45:19.301 INFO:tasks.workunit.client.0.smithi070.stdout:9/2: creat f0 x:0 0 0 2023-10-08T08:45:19.305 INFO:tasks.workunit.client.0.smithi070.stdout:8/4: mkdir d1/d2 0 2023-10-08T08:45:19.315 INFO:tasks.workunit.client.0.smithi070.stdout:8/5: creat d1/d2/f3 x:0 0 0 2023-10-08T08:45:19.433 INFO:tasks.workunit.client.0.smithi070.stdout:3/5: fsync d0/f2 0 2023-10-08T08:45:19.433 INFO:tasks.workunit.client.0.smithi070.stdout:3/6: fsync d0/f2 0 2023-10-08T08:45:19.433 INFO:tasks.workunit.client.0.smithi070.stdout:3/7: dread - d0/f1 zero size 2023-10-08T08:45:19.433 INFO:tasks.workunit.client.0.smithi070.stdout:3/8: fdatasync d0/f2 0 2023-10-08T08:45:19.434 INFO:tasks.workunit.client.0.smithi070.stdout:3/9: fdatasync d0/f2 0 2023-10-08T08:45:19.438 INFO:tasks.workunit.client.0.smithi070.stdout:1/16: getdents . 0 2023-10-08T08:45:19.438 INFO:tasks.workunit.client.0.smithi070.stdout:1/17: dread - no filename 2023-10-08T08:45:19.439 INFO:tasks.workunit.client.0.smithi070.stdout:1/18: truncate - no filename 2023-10-08T08:45:19.449 INFO:tasks.workunit.client.0.smithi070.stdout:1/19: link l1 l3 0 2023-10-08T08:45:19.449 INFO:tasks.workunit.client.0.smithi070.stdout:1/20: dread - no filename 2023-10-08T08:45:19.456 INFO:tasks.workunit.client.0.smithi070.stdout:1/21: chown l1 85903 1 2023-10-08T08:45:20.031 INFO:tasks.workunit.client.0.smithi070.stdout:6/9: dwrite f2 [0,4194304] 0 2023-10-08T08:45:20.043 INFO:tasks.workunit.client.0.smithi070.stdout:6/10: symlink l3 0 2023-10-08T08:45:20.043 INFO:tasks.workunit.client.0.smithi070.stdout:6/11: readlink l3 0 2023-10-08T08:45:20.049 INFO:tasks.workunit.client.0.smithi070.stdout:6/12: creat f4 x:0 0 0 2023-10-08T08:45:20.050 INFO:tasks.workunit.client.0.smithi070.stdout:6/13: dread - f4 zero size 2023-10-08T08:45:20.050 INFO:tasks.workunit.client.0.smithi070.stdout:6/14: dread - f4 zero size 2023-10-08T08:45:20.072 INFO:tasks.workunit.client.0.smithi070.stdout:9/3: dwrite f0 [0,4194304] 0 2023-10-08T08:45:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:20 smithi070 ceph-mon[99513]: pgmap v337: 129 pgs: 129 active+clean; 44 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 886 op/s 2023-10-08T08:45:20.473 INFO:tasks.workunit.client.0.smithi070.stdout:9/4: dread f0 [0,4194304] 0 2023-10-08T08:45:20.473 INFO:tasks.workunit.client.0.smithi070.stdout:9/5: fdatasync f0 0 2023-10-08T08:45:20.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:20 smithi105 ceph-mon[103798]: pgmap v337: 129 pgs: 129 active+clean; 44 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 886 op/s 2023-10-08T08:45:20.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:20 smithi191 ceph-mon[104220]: pgmap v337: 129 pgs: 129 active+clean; 44 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 886 op/s 2023-10-08T08:45:20.868 INFO:tasks.workunit.client.0.smithi070.stdout:0/25: dwrite d1/f5 [0,4194304] 0 2023-10-08T08:45:21.206 INFO:tasks.workunit.client.0.smithi070.stdout:4/10: dwrite f1 [0,4194304] 0 2023-10-08T08:45:21.206 INFO:tasks.workunit.client.0.smithi070.stdout:4/11: truncate f3 123199 0 2023-10-08T08:45:21.291 INFO:tasks.workunit.client.0.smithi070.stdout:8/6: dread f0 [0,4194304] 0 2023-10-08T08:45:21.294 INFO:tasks.workunit.client.0.smithi070.stdout:8/7: dread f0 [0,4194304] 0 2023-10-08T08:45:21.294 INFO:tasks.workunit.client.0.smithi070.stdout:8/8: readlink - no filename 2023-10-08T08:45:21.342 INFO:tasks.workunit.client.0.smithi070.stdout:9/6: getdents . 0 2023-10-08T08:45:21.592 INFO:tasks.workunit.client.0.smithi070.stdout:3/10: dwrite d0/f2 [0,4194304] 0 2023-10-08T08:45:21.685 INFO:tasks.workunit.client.0.smithi070.stdout:0/26: dwrite d1/f3 [0,4194304] 0 2023-10-08T08:45:21.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:21 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:21.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:21 smithi105 ceph-mon[103798]: pgmap v338: 129 pgs: 129 active+clean; 64 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 1.60k op/s 2023-10-08T08:45:21.818 INFO:tasks.workunit.client.0.smithi070.stdout:4/12: dwrite f2 [0,4194304] 0 2023-10-08T08:45:21.818 INFO:tasks.workunit.client.0.smithi070.stdout:4/13: readlink - no filename 2023-10-08T08:45:21.818 INFO:tasks.workunit.client.0.smithi070.stdout:4/14: stat f2 0 2023-10-08T08:45:21.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:21 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:21.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:21 smithi191 ceph-mon[104220]: pgmap v338: 129 pgs: 129 active+clean; 64 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 1.60k op/s 2023-10-08T08:45:21.973 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:21 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:23.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:21 smithi070 ceph-mon[99513]: pgmap v338: 129 pgs: 129 active+clean; 64 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 1.60k op/s 2023-10-08T08:45:23.374 INFO:tasks.workunit.client.0.smithi070.stdout:8/9: symlink d1/d2/l4 0 2023-10-08T08:45:23.374 INFO:tasks.workunit.client.0.smithi070.stdout:8/10: chown d1/d2/l4 7 1 2023-10-08T08:45:23.374 INFO:tasks.workunit.client.0.smithi070.stdout:8/11: dread f0 [0,4194304] 0 2023-10-08T08:45:23.374 INFO:tasks.workunit.client.0.smithi070.stdout:9/7: mkdir d1 0 2023-10-08T08:45:23.374 INFO:tasks.workunit.client.0.smithi070.stdout:3/11: rename d0/l3 to d0/l4 0 2023-10-08T08:45:23.374 INFO:tasks.workunit.client.0.smithi070.stdout:3/12: write d0/f1 [865789,121717] 0 2023-10-08T08:45:23.374 INFO:tasks.workunit.client.0.smithi070.stdout:0/27: creat d1/f6 x:0 0 0 2023-10-08T08:45:24.052 INFO:tasks.workunit.client.0.smithi070.stdout:9/8: symlink d1/l2 0 2023-10-08T08:45:24.054 INFO:tasks.workunit.client.0.smithi070.stdout:0/28: creat d1/f7 x:0 0 0 2023-10-08T08:45:24.054 INFO:tasks.workunit.client.0.smithi070.stdout:0/29: chown d1/f7 3351095 1 2023-10-08T08:45:24.056 INFO:tasks.workunit.client.0.smithi070.stdout:4/15: rename f1 to f4 0 2023-10-08T08:45:24.056 INFO:tasks.workunit.client.0.smithi070.stdout:4/16: write f2 [4748783,61508] 0 2023-10-08T08:45:24.057 INFO:tasks.workunit.client.0.smithi070.stdout:4/17: write f3 [102960,93356] 0 2023-10-08T08:45:24.057 INFO:tasks.workunit.client.0.smithi070.stdout:8/12: rmdir d1/d2 39 2023-10-08T08:45:24.060 INFO:tasks.workunit.client.0.smithi070.stdout:9/9: symlink d1/l3 0 2023-10-08T08:45:24.062 INFO:tasks.workunit.client.0.smithi070.stdout:9/10: mknod d1/c4 0 2023-10-08T08:45:24.063 INFO:tasks.workunit.client.0.smithi070.stdout:9/11: mkdir d1/d5 0 2023-10-08T08:45:24.072 INFO:tasks.workunit.client.0.smithi070.stdout:0/30: dread d1/f4 [0,4194304] 0 2023-10-08T08:45:24.074 INFO:tasks.workunit.client.0.smithi070.stdout:0/31: mknod d1/c8 0 2023-10-08T08:45:24.076 INFO:tasks.workunit.client.0.smithi070.stdout:9/12: dread f0 [0,4194304] 0 2023-10-08T08:45:24.076 INFO:tasks.workunit.client.0.smithi070.stdout:9/13: rename d1/d5 to d1/d5/d6 22 2023-10-08T08:45:24.076 INFO:tasks.workunit.client.0.smithi070.stdout:9/14: truncate f0 4855504 0 2023-10-08T08:45:24.077 INFO:tasks.workunit.client.0.smithi070.stdout:9/15: mknod d1/d5/c7 0 2023-10-08T08:45:24.077 INFO:tasks.workunit.client.0.smithi070.stdout:0/32: write d1/f3 [1558700,75192] 0 2023-10-08T08:45:24.107 INFO:tasks.workunit.client.0.smithi070.stdout:9/16: dwrite f0 [0,4194304] 0 2023-10-08T08:45:24.112 INFO:tasks.workunit.client.0.smithi070.stdout:0/33: dread d1/f5 [0,4194304] 0 2023-10-08T08:45:24.114 INFO:tasks.workunit.client.0.smithi070.stdout:0/34: mknod d1/c9 0 2023-10-08T08:45:24.131 INFO:tasks.workunit.client.0.smithi070.stdout:0/35: dread d1/f2 [0,4194304] 0 2023-10-08T08:45:24.140 INFO:tasks.workunit.client.0.smithi070.stdout:3/13: rename d0/l4 to d0/l5 0 2023-10-08T08:45:24.200 INFO:tasks.workunit.client.0.smithi070.stdout:8/13: dwrite d1/d2/f3 [0,4194304] 0 2023-10-08T08:45:24.203 INFO:tasks.workunit.client.0.smithi070.stdout:8/14: rmdir d1/d2 39 2023-10-08T08:45:24.207 INFO:tasks.workunit.client.0.smithi070.stdout:4/18: dwrite f4 [0,4194304] 0 2023-10-08T08:45:24.208 INFO:tasks.workunit.client.0.smithi070.stdout:0/36: dwrite d1/f5 [0,4194304] 0 2023-10-08T08:45:24.209 INFO:tasks.workunit.client.0.smithi070.stdout:4/19: creat f5 x:0 0 0 2023-10-08T08:45:24.214 INFO:tasks.workunit.client.0.smithi070.stdout:4/20: rename f3 to f6 0 2023-10-08T08:45:24.214 INFO:tasks.workunit.client.0.smithi070.stdout:4/21: readlink - no filename 2023-10-08T08:45:24.215 INFO:tasks.workunit.client.0.smithi070.stdout:4/22: creat f7 x:0 0 0 2023-10-08T08:45:24.221 INFO:tasks.workunit.client.0.smithi070.stdout:4/23: symlink l8 0 2023-10-08T08:45:24.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/37: dwrite d1/f3 [0,4194304] 0 2023-10-08T08:45:24.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/38: chown d1/f5 61 1 2023-10-08T08:45:24.269 INFO:tasks.workunit.client.0.smithi070.stdout:4/24: dread f2 [0,4194304] 0 2023-10-08T08:45:24.272 INFO:tasks.workunit.client.0.smithi070.stdout:0/39: dread d1/f4 [0,4194304] 0 2023-10-08T08:45:24.273 INFO:tasks.workunit.client.0.smithi070.stdout:0/40: creat d1/fa x:0 0 0 2023-10-08T08:45:24.275 INFO:tasks.workunit.client.0.smithi070.stdout:0/41: rename d1/f3 to d1/fb 0 2023-10-08T08:45:24.283 INFO:tasks.workunit.client.0.smithi070.stdout:0/42: dread d1/fb [0,4194304] 0 2023-10-08T08:45:24.284 INFO:tasks.workunit.client.0.smithi070.stdout:0/43: rename d1/c8 to d1/cc 0 2023-10-08T08:45:24.284 INFO:tasks.workunit.client.0.smithi070.stdout:4/25: dread f2 [0,4194304] 0 2023-10-08T08:45:24.285 INFO:tasks.workunit.client.0.smithi070.stdout:0/44: mkdir d1/dd 0 2023-10-08T08:45:24.286 INFO:tasks.workunit.client.0.smithi070.stdout:0/45: symlink d1/dd/le 0 2023-10-08T08:45:24.307 INFO:tasks.workunit.client.0.smithi070.stdout:0/46: dwrite d1/fa [0,4194304] 0 2023-10-08T08:45:24.310 INFO:tasks.workunit.client.0.smithi070.stdout:0/47: creat d1/dd/ff x:0 0 0 2023-10-08T08:45:24.310 INFO:tasks.workunit.client.0.smithi070.stdout:0/48: fdatasync d1/fa 0 2023-10-08T08:45:24.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:24 smithi070 ceph-mon[99513]: pgmap v339: 129 pgs: 129 active+clean; 72 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.0 MiB/s wr, 1.75k op/s 2023-10-08T08:45:24.474 INFO:tasks.workunit.client.0.smithi070.stdout:9/17: getdents d1/d5 0 2023-10-08T08:45:24.474 INFO:tasks.workunit.client.0.smithi070.stdout:9/18: write f0 [4293742,64990] 0 2023-10-08T08:45:24.474 INFO:tasks.workunit.client.0.smithi070.stdout:9/19: rename d1/d5 to d1/d5/d8 22 2023-10-08T08:45:24.479 INFO:tasks.workunit.client.0.smithi070.stdout:8/15: truncate d1/d2/f3 1910676 0 2023-10-08T08:45:24.488 INFO:tasks.workunit.client.0.smithi070.stdout:9/20: dread f0 [0,4194304] 0 2023-10-08T08:45:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:24 smithi105 ceph-mon[103798]: pgmap v339: 129 pgs: 129 active+clean; 72 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.0 MiB/s wr, 1.75k op/s 2023-10-08T08:45:24.534 INFO:tasks.workunit.client.0.smithi070.stdout:9/21: creat d1/f9 x:0 0 0 2023-10-08T08:45:24.540 INFO:tasks.workunit.client.0.smithi070.stdout:0/49: truncate d1/fa 2153367 0 2023-10-08T08:45:24.541 INFO:tasks.workunit.client.0.smithi070.stdout:0/50: symlink d1/dd/l10 0 2023-10-08T08:45:24.541 INFO:tasks.workunit.client.0.smithi070.stdout:0/51: chown d1/f5 19983988 1 2023-10-08T08:45:24.553 INFO:tasks.workunit.client.0.smithi070.stdout:0/52: rmdir d1/dd 39 2023-10-08T08:45:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:24 smithi191 ceph-mon[104220]: pgmap v339: 129 pgs: 129 active+clean; 72 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.0 MiB/s wr, 1.75k op/s 2023-10-08T08:45:24.611 INFO:tasks.workunit.client.0.smithi070.stdout:0/53: write d1/fb [2529777,49884] 0 2023-10-08T08:45:24.617 INFO:tasks.workunit.client.0.smithi070.stdout:8/16: truncate d1/d2/f3 1359237 0 2023-10-08T08:45:24.624 INFO:tasks.workunit.client.0.smithi070.stdout:0/54: dread d1/f2 [0,4194304] 0 2023-10-08T08:45:24.624 INFO:tasks.workunit.client.0.smithi070.stdout:0/55: chown d1/dd/l10 247685830 1 2023-10-08T08:45:24.629 INFO:tasks.workunit.client.0.smithi070.stdout:8/17: dread d1/d2/f3 [0,4194304] 0 2023-10-08T08:45:24.632 INFO:tasks.workunit.client.0.smithi070.stdout:8/18: dread f0 [0,4194304] 0 2023-10-08T08:45:24.633 INFO:tasks.workunit.client.0.smithi070.stdout:8/19: mknod d1/c5 0 2023-10-08T08:45:24.636 INFO:tasks.workunit.client.0.smithi070.stdout:8/20: getdents d1/d2 0 2023-10-08T08:45:24.637 INFO:tasks.workunit.client.0.smithi070.stdout:8/21: truncate d1/d2/f3 2058020 0 2023-10-08T08:45:24.637 INFO:tasks.workunit.client.0.smithi070.stdout:8/22: write d1/d2/f3 [2938279,71889] 0 2023-10-08T08:45:24.637 INFO:tasks.workunit.client.0.smithi070.stdout:8/23: getdents d1/d2 0 2023-10-08T08:45:24.648 INFO:tasks.workunit.client.0.smithi070.stdout:0/56: dwrite d1/f7 [0,4194304] 0 2023-10-08T08:45:24.650 INFO:tasks.workunit.client.0.smithi070.stdout:8/24: dread d1/d2/f3 [0,4194304] 0 2023-10-08T08:45:24.651 INFO:tasks.workunit.client.0.smithi070.stdout:0/57: creat d1/f11 x:0 0 0 2023-10-08T08:45:24.652 INFO:tasks.workunit.client.0.smithi070.stdout:8/25: mkdir d1/d2/d6 0 2023-10-08T08:45:24.653 INFO:tasks.workunit.client.0.smithi070.stdout:0/58: mknod d1/c12 0 2023-10-08T08:45:24.674 INFO:tasks.workunit.client.0.smithi070.stdout:0/59: dwrite d1/f5 [0,4194304] 0 2023-10-08T08:45:24.678 INFO:tasks.workunit.client.0.smithi070.stdout:0/60: write d1/f2 [290537,4277] 0 2023-10-08T08:45:24.678 INFO:tasks.workunit.client.0.smithi070.stdout:0/61: chown d1/f2 1102736 1 2023-10-08T08:45:24.678 INFO:tasks.workunit.client.0.smithi070.stdout:0/62: write d1/dd/ff [516782,63282] 0 2023-10-08T08:45:24.678 INFO:tasks.workunit.client.0.smithi070.stdout:0/63: chown d1/f6 1518 1 2023-10-08T08:45:24.678 INFO:tasks.workunit.client.0.smithi070.stdout:0/64: truncate d1/fb 5100826 0 2023-10-08T08:45:24.678 INFO:tasks.workunit.client.0.smithi070.stdout:0/65: chown d1/dd/le 45338 1 2023-10-08T08:45:24.679 INFO:tasks.workunit.client.0.smithi070.stdout:8/26: dwrite f0 [0,4194304] 0 2023-10-08T08:45:24.680 INFO:tasks.workunit.client.0.smithi070.stdout:0/66: getdents d1 0 2023-10-08T08:45:24.680 INFO:tasks.workunit.client.0.smithi070.stdout:0/67: truncate d1/f11 449131 0 2023-10-08T08:45:24.683 INFO:tasks.workunit.client.0.smithi070.stdout:8/27: mknod d1/d2/d6/c7 0 2023-10-08T08:45:24.686 INFO:tasks.workunit.client.0.smithi070.stdout:8/28: unlink d1/d2/f3 0 2023-10-08T08:45:24.693 INFO:tasks.workunit.client.0.smithi070.stdout:0/68: truncate d1/f5 4098148 0 2023-10-08T08:45:24.713 INFO:tasks.workunit.client.0.smithi070.stdout:8/29: dwrite f0 [0,4194304] 0 2023-10-08T08:45:24.716 INFO:tasks.workunit.client.0.smithi070.stdout:0/69: creat d1/dd/f13 x:0 0 0 2023-10-08T08:45:24.720 INFO:tasks.workunit.client.0.smithi070.stdout:0/70: mkdir d1/d14 0 2023-10-08T08:45:24.724 INFO:tasks.workunit.client.0.smithi070.stdout:0/71: write d1/fa [1871886,35423] 0 2023-10-08T08:45:24.726 INFO:tasks.workunit.client.0.smithi070.stdout:0/72: mknod d1/dd/c15 0 2023-10-08T08:45:24.732 INFO:tasks.workunit.client.0.smithi070.stdout:8/30: dread f0 [0,4194304] 0 2023-10-08T08:45:24.734 INFO:tasks.workunit.client.0.smithi070.stdout:8/31: getdents d1/d2 0 2023-10-08T08:45:24.734 INFO:tasks.workunit.client.0.smithi070.stdout:8/32: chown d1/d2/d6 62 1 2023-10-08T08:45:24.736 INFO:tasks.workunit.client.0.smithi070.stdout:8/33: mknod d1/d2/c8 0 2023-10-08T08:45:24.737 INFO:tasks.workunit.client.0.smithi070.stdout:8/34: readlink d1/d2/l4 0 2023-10-08T08:45:24.737 INFO:tasks.workunit.client.0.smithi070.stdout:8/35: chown d1/d2/l4 3 1 2023-10-08T08:45:24.737 INFO:tasks.workunit.client.0.smithi070.stdout:8/36: fdatasync f0 0 2023-10-08T08:45:24.737 INFO:tasks.workunit.client.0.smithi070.stdout:8/37: fdatasync f0 0 2023-10-08T08:45:24.742 INFO:tasks.workunit.client.0.smithi070.stdout:8/38: symlink d1/d2/d6/l9 0 2023-10-08T08:45:24.743 INFO:tasks.workunit.client.0.smithi070.stdout:8/39: creat d1/d2/d6/fa x:0 0 0 2023-10-08T08:45:24.748 INFO:tasks.workunit.client.0.smithi070.stdout:0/73: dwrite d1/f7 [0,4194304] 0 2023-10-08T08:45:24.749 INFO:tasks.workunit.client.0.smithi070.stdout:0/74: creat d1/dd/f16 x:0 0 0 2023-10-08T08:45:24.756 INFO:tasks.workunit.client.0.smithi070.stdout:0/75: dread d1/fb [0,4194304] 0 2023-10-08T08:45:24.757 INFO:tasks.workunit.client.0.smithi070.stdout:0/76: mknod d1/c17 0 2023-10-08T08:45:24.757 INFO:tasks.workunit.client.0.smithi070.stdout:8/40: dread f0 [0,4194304] 0 2023-10-08T08:45:24.758 INFO:tasks.workunit.client.0.smithi070.stdout:0/77: creat d1/dd/f18 x:0 0 0 2023-10-08T08:45:24.758 INFO:tasks.workunit.client.0.smithi070.stdout:0/78: write d1/dd/ff [604675,72731] 0 2023-10-08T08:45:24.759 INFO:tasks.workunit.client.0.smithi070.stdout:0/79: dread d1/f11 [0,4194304] 0 2023-10-08T08:45:24.759 INFO:tasks.workunit.client.0.smithi070.stdout:8/41: write f0 [953853,49499] 0 2023-10-08T08:45:24.762 INFO:tasks.workunit.client.0.smithi070.stdout:8/42: creat d1/fb x:0 0 0 2023-10-08T08:45:24.765 INFO:tasks.workunit.client.0.smithi070.stdout:8/43: symlink d1/d2/lc 0 2023-10-08T08:45:24.781 INFO:tasks.workunit.client.0.smithi070.stdout:0/80: dwrite d1/fb [0,4194304] 0 2023-10-08T08:45:24.788 INFO:tasks.workunit.client.0.smithi070.stdout:8/44: dwrite d1/fb [0,4194304] 0 2023-10-08T08:45:24.788 INFO:tasks.workunit.client.0.smithi070.stdout:8/45: write d1/d2/d6/fa [22618,16692] 0 2023-10-08T08:45:24.840 INFO:tasks.workunit.client.0.smithi070.stdout:0/81: rmdir d1 39 2023-10-08T08:45:24.847 INFO:tasks.workunit.client.0.smithi070.stdout:8/46: getdents d1/d2/d6 0 2023-10-08T08:45:24.851 INFO:tasks.workunit.client.0.smithi070.stdout:8/47: creat d1/d2/fd x:0 0 0 2023-10-08T08:45:24.853 INFO:tasks.workunit.client.0.smithi070.stdout:8/48: mkdir d1/de 0 2023-10-08T08:45:24.853 INFO:tasks.workunit.client.0.smithi070.stdout:8/49: truncate d1/d2/fd 174269 0 2023-10-08T08:45:24.853 INFO:tasks.workunit.client.0.smithi070.stdout:8/50: getdents d1/de 0 2023-10-08T08:45:24.853 INFO:tasks.workunit.client.0.smithi070.stdout:0/82: dread d1/f5 [0,4194304] 0 2023-10-08T08:45:24.874 INFO:tasks.workunit.client.0.smithi070.stdout:0/83: dwrite d1/dd/f16 [0,4194304] 0 2023-10-08T08:45:24.877 INFO:tasks.workunit.client.0.smithi070.stdout:0/84: getdents d1 0 2023-10-08T08:45:24.878 INFO:tasks.workunit.client.0.smithi070.stdout:0/85: read d1/f2 [4040638,15118] 0 2023-10-08T08:45:24.878 INFO:tasks.workunit.client.0.smithi070.stdout:0/86: fdatasync d1/f6 0 2023-10-08T08:45:24.879 INFO:tasks.workunit.client.0.smithi070.stdout:0/87: mkdir d1/d19 0 2023-10-08T08:45:24.879 INFO:tasks.workunit.client.0.smithi070.stdout:0/88: read - d1/f6 zero size 2023-10-08T08:45:24.879 INFO:tasks.workunit.client.0.smithi070.stdout:0/89: fdatasync d1/f5 0 2023-10-08T08:45:24.879 INFO:tasks.workunit.client.0.smithi070.stdout:8/51: dwrite d1/d2/fd [0,4194304] 0 2023-10-08T08:45:24.883 INFO:tasks.workunit.client.0.smithi070.stdout:0/90: creat d1/d19/f1a x:0 0 0 2023-10-08T08:45:24.946 INFO:tasks.workunit.client.0.smithi070.stdout:0/91: dwrite d1/f2 [0,4194304] 0 2023-10-08T08:45:24.968 INFO:tasks.workunit.client.0.smithi070.stdout:0/92: dwrite d1/f7 [0,4194304] 0 2023-10-08T08:45:24.989 INFO:tasks.workunit.client.0.smithi070.stdout:0/93: dwrite d1/f7 [0,4194304] 0 2023-10-08T08:45:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:0/94: read d1/f2 [573224,49555] 0 2023-10-08T08:45:25.017 INFO:tasks.workunit.client.0.smithi070.stdout:0/95: dwrite d1/dd/f13 [0,4194304] 0 2023-10-08T08:45:25.027 INFO:tasks.workunit.client.0.smithi070.stdout:0/96: dread d1/dd/f16 [0,4194304] 0 2023-10-08T08:45:25.038 INFO:tasks.workunit.client.0.smithi070.stdout:0/97: mkdir d1/dd/d1b 0 2023-10-08T08:45:25.039 INFO:tasks.workunit.client.0.smithi070.stdout:0/98: fsync d1/dd/f18 0 2023-10-08T08:45:25.039 INFO:tasks.workunit.client.0.smithi070.stdout:0/99: chown d1/c17 9 1 2023-10-08T08:45:25.057 INFO:tasks.workunit.client.0.smithi070.stdout:0/100: dwrite d1/dd/f18 [0,4194304] 0 2023-10-08T08:45:25.069 INFO:tasks.workunit.client.0.smithi070.stdout:0/101: dread d1/f2 [0,4194304] 0 2023-10-08T08:45:25.082 INFO:tasks.workunit.client.0.smithi070.stdout:0/102: mkdir d1/d14/d1c 0 2023-10-08T08:45:25.098 INFO:tasks.workunit.client.0.smithi070.stdout:0/103: dread d1/dd/f13 [0,4194304] 0 2023-10-08T08:45:25.098 INFO:tasks.workunit.client.0.smithi070.stdout:0/104: chown d1/f6 5062 1 2023-10-08T08:45:25.099 INFO:tasks.workunit.client.0.smithi070.stdout:0/105: mkdir d1/d1d 0 2023-10-08T08:45:25.123 INFO:tasks.workunit.client.0.smithi070.stdout:0/106: dwrite d1/dd/f13 [0,4194304] 0 2023-10-08T08:45:25.145 INFO:tasks.workunit.client.0.smithi070.stdout:0/107: dwrite d1/f2 [0,4194304] 0 2023-10-08T08:45:25.157 INFO:tasks.workunit.client.0.smithi070.stdout:0/108: symlink d1/d1d/l1e 0 2023-10-08T08:45:25.160 INFO:tasks.workunit.client.0.smithi070.stdout:0/109: write d1/dd/f13 [2829553,100457] 0 2023-10-08T08:45:25.161 INFO:tasks.workunit.client.0.smithi070.stdout:0/110: stat d1/cc 0 2023-10-08T08:45:25.161 INFO:tasks.workunit.client.0.smithi070.stdout:0/111: dread - d1/d19/f1a zero size 2023-10-08T08:45:25.162 INFO:tasks.workunit.client.0.smithi070.stdout:0/112: write d1/f7 [3322839,101016] 0 2023-10-08T08:45:25.206 INFO:tasks.workunit.client.0.smithi070.stdout:0/113: truncate d1/f7 3387897 0 2023-10-08T08:45:25.217 INFO:tasks.workunit.client.0.smithi070.stdout:0/114: unlink d1/f2 0 2023-10-08T08:45:25.226 INFO:tasks.workunit.client.0.smithi070.stdout:0/115: rename d1/d19 to d1/d14/d1f 0 2023-10-08T08:45:25.226 INFO:tasks.workunit.client.0.smithi070.stdout:0/116: write d1/dd/ff [748228,87485] 0 2023-10-08T08:45:25.241 INFO:tasks.workunit.client.0.smithi070.stdout:8/52: sync 2023-10-08T08:45:25.241 INFO:tasks.workunit.client.0.smithi070.stdout:9/22: sync 2023-10-08T08:45:25.241 INFO:tasks.workunit.client.0.smithi070.stdout:5/3: sync 2023-10-08T08:45:25.241 INFO:tasks.workunit.client.0.smithi070.stdout:1/22: sync 2023-10-08T08:45:25.241 INFO:tasks.workunit.client.0.smithi070.stdout:1/23: dwrite - no filename 2023-10-08T08:45:25.241 INFO:tasks.workunit.client.0.smithi070.stdout:1/24: truncate - no filename 2023-10-08T08:45:25.241 INFO:tasks.workunit.client.0.smithi070.stdout:1/25: dread - no filename 2023-10-08T08:45:25.241 INFO:tasks.workunit.client.0.smithi070.stdout:7/3: sync 2023-10-08T08:45:25.241 INFO:tasks.workunit.client.0.smithi070.stdout:4/26: sync 2023-10-08T08:45:25.242 INFO:tasks.workunit.client.0.smithi070.stdout:4/27: stat f5 0 2023-10-08T08:45:25.242 INFO:tasks.workunit.client.0.smithi070.stdout:4/28: readlink l8 0 2023-10-08T08:45:25.242 INFO:tasks.workunit.client.0.smithi070.stdout:0/117: dread d1/dd/f18 [0,4194304] 0 2023-10-08T08:45:25.242 INFO:tasks.workunit.client.0.smithi070.stdout:4/29: truncate f2 5005338 0 2023-10-08T08:45:25.242 INFO:tasks.workunit.client.0.smithi070.stdout:4/30: truncate f6 503468 0 2023-10-08T08:45:25.242 INFO:tasks.workunit.client.0.smithi070.stdout:2/3: sync 2023-10-08T08:45:25.242 INFO:tasks.workunit.client.0.smithi070.stdout:6/15: sync 2023-10-08T08:45:25.242 INFO:tasks.workunit.client.0.smithi070.stdout:3/14: sync 2023-10-08T08:45:25.243 INFO:tasks.workunit.client.0.smithi070.stdout:1/26: stat c2 0 2023-10-08T08:45:25.243 INFO:tasks.workunit.client.0.smithi070.stdout:1/27: dwrite - no filename 2023-10-08T08:45:25.243 INFO:tasks.workunit.client.0.smithi070.stdout:1/28: truncate - no filename 2023-10-08T08:45:25.243 INFO:tasks.workunit.client.0.smithi070.stdout:1/29: chown l1 6 1 2023-10-08T08:45:25.244 INFO:tasks.workunit.client.0.smithi070.stdout:5/4: creat f0 x:0 0 0 2023-10-08T08:45:25.245 INFO:tasks.workunit.client.0.smithi070.stdout:7/4: creat f0 x:0 0 0 2023-10-08T08:45:25.245 INFO:tasks.workunit.client.0.smithi070.stdout:7/5: write f0 [509226,96731] 0 2023-10-08T08:45:25.246 INFO:tasks.workunit.client.0.smithi070.stdout:0/118: write d1/f6 [706444,6480] 0 2023-10-08T08:45:25.246 INFO:tasks.workunit.client.0.smithi070.stdout:0/119: write d1/f6 [1201051,105395] 0 2023-10-08T08:45:25.246 INFO:tasks.workunit.client.0.smithi070.stdout:4/31: creat f9 x:0 0 0 2023-10-08T08:45:25.247 INFO:tasks.workunit.client.0.smithi070.stdout:2/4: stat l1 0 2023-10-08T08:45:25.247 INFO:tasks.workunit.client.0.smithi070.stdout:2/5: read - no filename 2023-10-08T08:45:25.248 INFO:tasks.workunit.client.0.smithi070.stdout:3/15: truncate d0/f1 30289 0 2023-10-08T08:45:25.249 INFO:tasks.workunit.client.0.smithi070.stdout:3/16: fdatasync d0/f1 0 2023-10-08T08:45:25.267 INFO:tasks.workunit.client.0.smithi070.stdout:8/53: dwrite d1/d2/d6/fa [0,4194304] 0 2023-10-08T08:45:25.268 INFO:tasks.workunit.client.0.smithi070.stdout:8/54: fdatasync d1/d2/d6/fa 0 2023-10-08T08:45:25.270 INFO:tasks.workunit.client.0.smithi070.stdout:6/16: dwrite f2 [0,4194304] 0 2023-10-08T08:45:25.283 INFO:tasks.workunit.client.0.smithi070.stdout:7/6: mknod c1 0 2023-10-08T08:45:25.283 INFO:tasks.workunit.client.0.smithi070.stdout:7/7: write f0 [703887,54792] 0 2023-10-08T08:45:25.285 INFO:tasks.workunit.client.0.smithi070.stdout:4/32: creat fa x:0 0 0 2023-10-08T08:45:25.285 INFO:tasks.workunit.client.0.smithi070.stdout:2/6: creat f2 x:0 0 0 2023-10-08T08:45:25.287 INFO:tasks.workunit.client.0.smithi070.stdout:3/17: mknod d0/c6 0 2023-10-08T08:45:25.287 INFO:tasks.workunit.client.0.smithi070.stdout:3/18: write d0/f1 [945668,102470] 0 2023-10-08T08:45:25.291 INFO:tasks.workunit.client.0.smithi070.stdout:5/5: dwrite f0 [0,4194304] 0 2023-10-08T08:45:25.293 INFO:tasks.workunit.client.0.smithi070.stdout:0/120: write d1/dd/ff [380920,25453] 0 2023-10-08T08:45:25.293 INFO:tasks.workunit.client.0.smithi070.stdout:8/55: mknod d1/cf 0 2023-10-08T08:45:25.295 INFO:tasks.workunit.client.0.smithi070.stdout:6/17: dwrite f2 [0,4194304] 0 2023-10-08T08:45:25.297 INFO:tasks.workunit.client.0.smithi070.stdout:1/30: link c2 c4 0 2023-10-08T08:45:25.299 INFO:tasks.workunit.client.0.smithi070.stdout:2/7: symlink l3 0 2023-10-08T08:45:25.299 INFO:tasks.workunit.client.0.smithi070.stdout:2/8: dread - f2 zero size 2023-10-08T08:45:25.301 INFO:tasks.workunit.client.0.smithi070.stdout:3/19: mknod d0/c7 0 2023-10-08T08:45:25.305 INFO:tasks.workunit.client.0.smithi070.stdout:0/121: chown d1/d14/d1c 5276 1 2023-10-08T08:45:25.305 INFO:tasks.workunit.client.0.smithi070.stdout:8/56: symlink d1/de/l10 0 2023-10-08T08:45:25.312 INFO:tasks.workunit.client.0.smithi070.stdout:0/122: write d1/f6 [11302,99019] 0 2023-10-08T08:45:25.313 INFO:tasks.workunit.client.0.smithi070.stdout:7/8: dwrite f0 [0,4194304] 0 2023-10-08T08:45:25.313 INFO:tasks.workunit.client.0.smithi070.stdout:7/9: fsync f0 0 2023-10-08T08:45:25.315 INFO:tasks.workunit.client.0.smithi070.stdout:6/18: creat f5 x:0 0 0 2023-10-08T08:45:25.317 INFO:tasks.workunit.client.0.smithi070.stdout:4/33: dwrite f5 [0,4194304] 0 2023-10-08T08:45:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:2/9: unlink l3 0 2023-10-08T08:45:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:1/31: creat f5 x:0 0 0 2023-10-08T08:45:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:2/10: write f2 [651705,101815] 0 2023-10-08T08:45:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:2/11: write f2 [1766652,72868] 0 2023-10-08T08:45:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:5/6: getdents . 0 2023-10-08T08:45:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:7/10: mknod c2 0 2023-10-08T08:45:25.328 INFO:tasks.workunit.client.0.smithi070.stdout:6/19: symlink l6 0 2023-10-08T08:45:25.329 INFO:tasks.workunit.client.0.smithi070.stdout:1/32: stat l3 0 2023-10-08T08:45:25.329 INFO:tasks.workunit.client.0.smithi070.stdout:1/33: rmdir - no directory 2023-10-08T08:45:25.330 INFO:tasks.workunit.client.0.smithi070.stdout:6/20: creat f7 x:0 0 0 2023-10-08T08:45:25.330 INFO:tasks.workunit.client.0.smithi070.stdout:6/21: rmdir - no directory 2023-10-08T08:45:25.334 INFO:tasks.workunit.client.0.smithi070.stdout:8/57: dread d1/fb [0,4194304] 0 2023-10-08T08:45:25.335 INFO:tasks.workunit.client.0.smithi070.stdout:3/20: dwrite d0/f1 [0,4194304] 0 2023-10-08T08:45:25.347 INFO:tasks.workunit.client.0.smithi070.stdout:5/7: write f0 [2279341,73388] 0 2023-10-08T08:45:25.348 INFO:tasks.workunit.client.0.smithi070.stdout:4/34: dwrite f6 [0,4194304] 0 2023-10-08T08:45:25.351 INFO:tasks.workunit.client.0.smithi070.stdout:7/11: dread f0 [0,4194304] 0 2023-10-08T08:45:25.351 INFO:tasks.workunit.client.0.smithi070.stdout:0/123: dwrite d1/f11 [0,4194304] 0 2023-10-08T08:45:25.351 INFO:tasks.workunit.client.0.smithi070.stdout:7/12: rmdir - no directory 2023-10-08T08:45:25.351 INFO:tasks.workunit.client.0.smithi070.stdout:0/124: readlink d1/dd/l10 0 2023-10-08T08:45:25.352 INFO:tasks.workunit.client.0.smithi070.stdout:5/8: fdatasync f0 0 2023-10-08T08:45:25.353 INFO:tasks.workunit.client.0.smithi070.stdout:7/13: write f0 [4088808,87428] 0 2023-10-08T08:45:25.355 INFO:tasks.workunit.client.0.smithi070.stdout:7/14: write f0 [1732399,111305] 0 2023-10-08T08:45:25.366 INFO:tasks.workunit.client.0.smithi070.stdout:6/22: dwrite f1 [0,4194304] 0 2023-10-08T08:45:25.367 INFO:tasks.workunit.client.0.smithi070.stdout:3/21: creat d0/f8 x:0 0 0 2023-10-08T08:45:25.368 INFO:tasks.workunit.client.0.smithi070.stdout:2/12: truncate f2 1174860 0 2023-10-08T08:45:25.369 INFO:tasks.workunit.client.0.smithi070.stdout:8/58: dwrite f0 [0,4194304] 0 2023-10-08T08:45:25.369 INFO:tasks.workunit.client.0.smithi070.stdout:1/34: mkdir d6 0 2023-10-08T08:45:25.371 INFO:tasks.workunit.client.0.smithi070.stdout:4/35: mknod cb 0 2023-10-08T08:45:25.375 INFO:tasks.workunit.client.0.smithi070.stdout:5/9: mknod c1 0 2023-10-08T08:45:25.375 INFO:tasks.workunit.client.0.smithi070.stdout:5/10: chown f0 6 1 2023-10-08T08:45:25.390 INFO:tasks.workunit.client.0.smithi070.stdout:6/23: symlink l8 0 2023-10-08T08:45:25.390 INFO:tasks.workunit.client.0.smithi070.stdout:2/13: dwrite f2 [0,4194304] 0 2023-10-08T08:45:25.390 INFO:tasks.workunit.client.0.smithi070.stdout:2/14: rmdir - no directory 2023-10-08T08:45:25.391 INFO:tasks.workunit.client.0.smithi070.stdout:3/22: rename d0/c6 to d0/c9 0 2023-10-08T08:45:25.391 INFO:tasks.workunit.client.0.smithi070.stdout:6/24: write f2 [1475692,33806] 0 2023-10-08T08:45:25.401 INFO:tasks.workunit.client.0.smithi070.stdout:3/23: dread d0/f2 [0,4194304] 0 2023-10-08T08:45:25.401 INFO:tasks.workunit.client.0.smithi070.stdout:3/24: fsync d0/f2 0 2023-10-08T08:45:25.405 INFO:tasks.workunit.client.0.smithi070.stdout:8/59: link d1/de/l10 d1/l11 0 2023-10-08T08:45:25.405 INFO:tasks.workunit.client.0.smithi070.stdout:8/60: chown d1/d2/d6/l9 2068 1 2023-10-08T08:45:25.405 INFO:tasks.workunit.client.0.smithi070.stdout:1/35: mknod d6/c7 0 2023-10-08T08:45:25.406 INFO:tasks.workunit.client.0.smithi070.stdout:4/36: truncate f2 2930248 0 2023-10-08T08:45:25.407 INFO:tasks.workunit.client.0.smithi070.stdout:0/125: symlink d1/d1d/l20 0 2023-10-08T08:45:25.409 INFO:tasks.workunit.client.0.smithi070.stdout:5/11: creat f2 x:0 0 0 2023-10-08T08:45:25.410 INFO:tasks.workunit.client.0.smithi070.stdout:7/15: truncate f0 2002311 0 2023-10-08T08:45:25.411 INFO:tasks.workunit.client.0.smithi070.stdout:6/25: dwrite f4 [0,4194304] 0 2023-10-08T08:45:25.428 INFO:tasks.workunit.client.0.smithi070.stdout:4/37: dwrite fa [0,4194304] 0 2023-10-08T08:45:25.428 INFO:tasks.workunit.client.0.smithi070.stdout:4/38: stat f2 0 2023-10-08T08:45:25.428 INFO:tasks.workunit.client.0.smithi070.stdout:4/39: truncate f7 945869 0 2023-10-08T08:45:25.428 INFO:tasks.workunit.client.0.smithi070.stdout:4/40: fsync fa 0 2023-10-08T08:45:25.428 INFO:tasks.workunit.client.0.smithi070.stdout:4/41: readlink l8 0 2023-10-08T08:45:25.429 INFO:tasks.workunit.client.0.smithi070.stdout:4/42: read fa [3495284,106552] 0 2023-10-08T08:45:25.435 INFO:tasks.workunit.client.0.smithi070.stdout:6/26: dwrite f7 [0,4194304] 0 2023-10-08T08:45:25.457 INFO:tasks.workunit.client.0.smithi070.stdout:6/27: dwrite f1 [0,4194304] 0 2023-10-08T08:45:25.475 INFO:tasks.workunit.client.0.smithi070.stdout:9/23: sync 2023-10-08T08:45:25.477 INFO:tasks.workunit.client.0.smithi070.stdout:2/15: symlink l4 0 2023-10-08T08:45:25.478 INFO:tasks.workunit.client.0.smithi070.stdout:3/25: mknod d0/ca 0 2023-10-08T08:45:25.478 INFO:tasks.workunit.client.0.smithi070.stdout:3/26: chown d0/f2 31938 1 2023-10-08T08:45:25.479 INFO:tasks.workunit.client.0.smithi070.stdout:9/24: dread f0 [4194304,4194304] 0 2023-10-08T08:45:25.479 INFO:tasks.workunit.client.0.smithi070.stdout:3/27: write d0/f1 [2201077,31429] 0 2023-10-08T08:45:25.491 INFO:tasks.workunit.client.0.smithi070.stdout:2/16: dread f2 [0,4194304] 0 2023-10-08T08:45:25.494 INFO:tasks.workunit.client.0.smithi070.stdout:2/17: write f2 [527291,64365] 0 2023-10-08T08:45:25.494 INFO:tasks.workunit.client.0.smithi070.stdout:2/18: read f2 [874730,2184] 0 2023-10-08T08:45:25.495 INFO:tasks.workunit.client.0.smithi070.stdout:2/19: write f2 [4249163,89488] 0 2023-10-08T08:45:25.499 INFO:tasks.workunit.client.0.smithi070.stdout:9/25: dwrite d1/f9 [0,4194304] 0 2023-10-08T08:45:25.503 INFO:tasks.workunit.client.0.smithi070.stdout:8/61: mknod d1/c12 0 2023-10-08T08:45:25.504 INFO:tasks.workunit.client.0.smithi070.stdout:1/36: link l1 d6/l8 0 2023-10-08T08:45:25.504 INFO:tasks.workunit.client.0.smithi070.stdout:0/126: fdatasync d1/f7 0 2023-10-08T08:45:25.505 INFO:tasks.workunit.client.0.smithi070.stdout:5/12: symlink l3 0 2023-10-08T08:45:25.505 INFO:tasks.workunit.client.0.smithi070.stdout:5/13: chown c1 101 1 2023-10-08T08:45:25.506 INFO:tasks.workunit.client.0.smithi070.stdout:7/16: mkdir d3 0 2023-10-08T08:45:25.513 INFO:tasks.workunit.client.0.smithi070.stdout:6/28: creat f9 x:0 0 0 2023-10-08T08:45:25.513 INFO:tasks.workunit.client.0.smithi070.stdout:6/29: dread - f5 zero size 2023-10-08T08:45:25.514 INFO:tasks.workunit.client.0.smithi070.stdout:3/28: mkdir d0/db 0 2023-10-08T08:45:25.515 INFO:tasks.workunit.client.0.smithi070.stdout:2/20: symlink l5 0 2023-10-08T08:45:25.525 INFO:tasks.workunit.client.0.smithi070.stdout:1/37: rename d6/l8 to d6/l9 0 2023-10-08T08:45:25.525 INFO:tasks.workunit.client.0.smithi070.stdout:1/38: write f5 [157208,39295] 0 2023-10-08T08:45:25.526 INFO:tasks.workunit.client.0.smithi070.stdout:1/39: readlink d6/l9 0 2023-10-08T08:45:25.526 INFO:tasks.workunit.client.0.smithi070.stdout:1/40: read f5 [104912,47071] 0 2023-10-08T08:45:25.526 INFO:tasks.workunit.client.0.smithi070.stdout:0/127: symlink d1/dd/l21 0 2023-10-08T08:45:25.528 INFO:tasks.workunit.client.0.smithi070.stdout:5/14: rename c1 to c4 0 2023-10-08T08:45:25.529 INFO:tasks.workunit.client.0.smithi070.stdout:7/17: truncate f0 1917865 0 2023-10-08T08:45:25.530 INFO:tasks.workunit.client.0.smithi070.stdout:6/30: link l6 la 0 2023-10-08T08:45:25.531 INFO:tasks.workunit.client.0.smithi070.stdout:2/21: mknod c6 0 2023-10-08T08:45:25.532 INFO:tasks.workunit.client.0.smithi070.stdout:9/26: getdents d1 0 2023-10-08T08:45:25.540 INFO:tasks.workunit.client.0.smithi070.stdout:1/41: rename d6/c7 to d6/ca 0 2023-10-08T08:45:25.540 INFO:tasks.workunit.client.0.smithi070.stdout:7/18: symlink d3/l4 0 2023-10-08T08:45:25.540 INFO:tasks.workunit.client.0.smithi070.stdout:6/31: symlink lb 0 2023-10-08T08:45:25.540 INFO:tasks.workunit.client.0.smithi070.stdout:8/62: mknod d1/d2/c13 0 2023-10-08T08:45:25.540 INFO:tasks.workunit.client.0.smithi070.stdout:8/63: chown d1/d2/d6 4112341 1 2023-10-08T08:45:25.540 INFO:tasks.workunit.client.0.smithi070.stdout:3/29: getdents d0 0 2023-10-08T08:45:25.541 INFO:tasks.workunit.client.0.smithi070.stdout:2/22: rename l0 to l7 0 2023-10-08T08:45:25.544 INFO:tasks.workunit.client.0.smithi070.stdout:0/128: dwrite d1/dd/ff [0,4194304] 0 2023-10-08T08:45:25.545 INFO:tasks.workunit.client.0.smithi070.stdout:5/15: getdents . 0 2023-10-08T08:45:25.549 INFO:tasks.workunit.client.0.smithi070.stdout:7/19: mknod d3/c5 0 2023-10-08T08:45:25.550 INFO:tasks.workunit.client.0.smithi070.stdout:6/32: mknod cc 0 2023-10-08T08:45:25.551 INFO:tasks.workunit.client.0.smithi070.stdout:8/64: creat d1/d2/d6/f14 x:0 0 0 2023-10-08T08:45:25.552 INFO:tasks.workunit.client.0.smithi070.stdout:3/30: creat d0/db/fc x:0 0 0 2023-10-08T08:45:25.553 INFO:tasks.workunit.client.0.smithi070.stdout:2/23: creat f8 x:0 0 0 2023-10-08T08:45:25.553 INFO:tasks.workunit.client.0.smithi070.stdout:2/24: stat l4 0 2023-10-08T08:45:25.553 INFO:tasks.workunit.client.0.smithi070.stdout:2/25: fsync f2 0 2023-10-08T08:45:25.554 INFO:tasks.workunit.client.0.smithi070.stdout:7/20: dread f0 [0,4194304] 0 2023-10-08T08:45:25.554 INFO:tasks.workunit.client.0.smithi070.stdout:7/21: chown d3 401922 1 2023-10-08T08:45:25.559 INFO:tasks.workunit.client.0.smithi070.stdout:1/42: link l0 d6/lb 0 2023-10-08T08:45:25.559 INFO:tasks.workunit.client.0.smithi070.stdout:1/43: write f5 [352322,88442] 0 2023-10-08T08:45:25.559 INFO:tasks.workunit.client.0.smithi070.stdout:1/44: readlink l0 0 2023-10-08T08:45:25.560 INFO:tasks.workunit.client.0.smithi070.stdout:6/33: mknod cd 0 2023-10-08T08:45:25.560 INFO:tasks.workunit.client.0.smithi070.stdout:6/34: chown f4 35 1 2023-10-08T08:45:25.560 INFO:tasks.workunit.client.0.smithi070.stdout:6/35: write f9 [895565,118340] 0 2023-10-08T08:45:25.561 INFO:tasks.workunit.client.0.smithi070.stdout:8/65: mkdir d1/de/d15 0 2023-10-08T08:45:25.561 INFO:tasks.workunit.client.0.smithi070.stdout:8/66: fsync d1/d2/d6/fa 0 2023-10-08T08:45:25.562 INFO:tasks.workunit.client.0.smithi070.stdout:2/26: mknod c9 0 2023-10-08T08:45:25.562 INFO:tasks.workunit.client.0.smithi070.stdout:2/27: chown f8 4174864 1 2023-10-08T08:45:25.563 INFO:tasks.workunit.client.0.smithi070.stdout:7/22: creat d3/f6 x:0 0 0 2023-10-08T08:45:25.563 INFO:tasks.workunit.client.0.smithi070.stdout:1/45: mkdir d6/dc 0 2023-10-08T08:45:25.564 INFO:tasks.workunit.client.0.smithi070.stdout:1/46: write f5 [156725,127157] 0 2023-10-08T08:45:25.565 INFO:tasks.workunit.client.0.smithi070.stdout:6/36: rename cd to ce 0 2023-10-08T08:45:25.565 INFO:tasks.workunit.client.0.smithi070.stdout:6/37: write f5 [251139,39415] 0 2023-10-08T08:45:25.565 INFO:tasks.workunit.client.0.smithi070.stdout:6/38: stat f4 0 2023-10-08T08:45:25.565 INFO:tasks.workunit.client.0.smithi070.stdout:6/39: write f5 [734573,42498] 0 2023-10-08T08:45:25.566 INFO:tasks.workunit.client.0.smithi070.stdout:6/40: write f5 [1807409,67469] 0 2023-10-08T08:45:25.566 INFO:tasks.workunit.client.0.smithi070.stdout:8/67: unlink d1/de/l10 0 2023-10-08T08:45:25.566 INFO:tasks.workunit.client.0.smithi070.stdout:8/68: dread - d1/d2/d6/f14 zero size 2023-10-08T08:45:25.567 INFO:tasks.workunit.client.0.smithi070.stdout:2/28: truncate f2 3244024 0 2023-10-08T08:45:25.570 INFO:tasks.workunit.client.0.smithi070.stdout:8/69: getdents d1/d2/d6 0 2023-10-08T08:45:25.570 INFO:tasks.workunit.client.0.smithi070.stdout:7/23: dread f0 [0,4194304] 0 2023-10-08T08:45:25.570 INFO:tasks.workunit.client.0.smithi070.stdout:7/24: fdatasync d3/f6 0 2023-10-08T08:45:25.574 INFO:tasks.workunit.client.0.smithi070.stdout:7/25: read f0 [1410547,76411] 0 2023-10-08T08:45:25.574 INFO:tasks.workunit.client.0.smithi070.stdout:7/26: stat c2 0 2023-10-08T08:45:25.574 INFO:tasks.workunit.client.0.smithi070.stdout:7/27: chown f0 22375 1 2023-10-08T08:45:25.574 INFO:tasks.workunit.client.0.smithi070.stdout:7/28: chown c2 24 1 2023-10-08T08:45:25.574 INFO:tasks.workunit.client.0.smithi070.stdout:8/70: unlink d1/d2/fd 0 2023-10-08T08:45:25.574 INFO:tasks.workunit.client.0.smithi070.stdout:3/31: dwrite d0/f2 [4194304,4194304] 0 2023-10-08T08:45:25.575 INFO:tasks.workunit.client.0.smithi070.stdout:7/29: unlink f0 0 2023-10-08T08:45:25.576 INFO:tasks.workunit.client.0.smithi070.stdout:8/71: truncate d1/d2/d6/fa 2189940 0 2023-10-08T08:45:25.579 INFO:tasks.workunit.client.0.smithi070.stdout:1/47: dread f5 [0,4194304] 0 2023-10-08T08:45:25.581 INFO:tasks.workunit.client.0.smithi070.stdout:3/32: creat d0/db/fd x:0 0 0 2023-10-08T08:45:25.581 INFO:tasks.workunit.client.0.smithi070.stdout:7/30: mkdir d3/d7 0 2023-10-08T08:45:25.582 INFO:tasks.workunit.client.0.smithi070.stdout:7/31: chown c1 324889155 1 2023-10-08T08:45:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:8/72: unlink d1/c12 0 2023-10-08T08:45:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:2/29: dwrite f8 [0,4194304] 0 2023-10-08T08:45:25.589 INFO:tasks.workunit.client.0.smithi070.stdout:3/33: link d0/c7 d0/db/ce 0 2023-10-08T08:45:25.591 INFO:tasks.workunit.client.0.smithi070.stdout:7/32: creat d3/d7/f8 x:0 0 0 2023-10-08T08:45:25.596 INFO:tasks.workunit.client.0.smithi070.stdout:2/30: creat fa x:0 0 0 2023-10-08T08:45:25.596 INFO:tasks.workunit.client.0.smithi070.stdout:2/31: chown c6 97 1 2023-10-08T08:45:25.597 INFO:tasks.workunit.client.0.smithi070.stdout:3/34: symlink d0/db/lf 0 2023-10-08T08:45:25.601 INFO:tasks.workunit.client.0.smithi070.stdout:2/32: link fa fb 0 2023-10-08T08:45:25.601 INFO:tasks.workunit.client.0.smithi070.stdout:2/33: write fa [198791,111467] 0 2023-10-08T08:45:25.601 INFO:tasks.workunit.client.0.smithi070.stdout:8/73: dread d1/d2/d6/fa [0,4194304] 0 2023-10-08T08:45:25.602 INFO:tasks.workunit.client.0.smithi070.stdout:3/35: unlink d0/db/fc 0 2023-10-08T08:45:25.604 INFO:tasks.workunit.client.0.smithi070.stdout:1/48: dread f5 [0,4194304] 0 2023-10-08T08:45:25.604 INFO:tasks.workunit.client.0.smithi070.stdout:1/49: write f5 [1193194,75671] 0 2023-10-08T08:45:25.604 INFO:tasks.workunit.client.0.smithi070.stdout:6/41: dwrite f5 [0,4194304] 0 2023-10-08T08:45:25.608 INFO:tasks.workunit.client.0.smithi070.stdout:9/27: rename d1/f9 to d1/d5/fa 0 2023-10-08T08:45:25.609 INFO:tasks.workunit.client.0.smithi070.stdout:8/74: dread d1/d2/d6/fa [0,4194304] 0 2023-10-08T08:45:25.611 INFO:tasks.workunit.client.0.smithi070.stdout:7/33: dwrite d3/d7/f8 [0,4194304] 0 2023-10-08T08:45:25.611 INFO:tasks.workunit.client.0.smithi070.stdout:7/34: dread - d3/f6 zero size 2023-10-08T08:45:25.611 INFO:tasks.workunit.client.0.smithi070.stdout:7/35: truncate d3/f6 290053 0 2023-10-08T08:45:25.612 INFO:tasks.workunit.client.0.smithi070.stdout:2/34: dread f2 [0,4194304] 0 2023-10-08T08:45:25.612 INFO:tasks.workunit.client.0.smithi070.stdout:9/28: creat d1/fb x:0 0 0 2023-10-08T08:45:25.612 INFO:tasks.workunit.client.0.smithi070.stdout:9/29: dread - d1/fb zero size 2023-10-08T08:45:25.613 INFO:tasks.workunit.client.0.smithi070.stdout:5/16: mkdir d5 0 2023-10-08T08:45:25.615 INFO:tasks.workunit.client.0.smithi070.stdout:3/36: truncate d0/f2 895659 0 2023-10-08T08:45:25.621 INFO:tasks.workunit.client.0.smithi070.stdout:2/35: unlink c9 0 2023-10-08T08:45:25.626 INFO:tasks.workunit.client.0.smithi070.stdout:2/36: fdatasync fb 0 2023-10-08T08:45:25.634 INFO:tasks.workunit.client.0.smithi070.stdout:7/36: dwrite d3/d7/f8 [0,4194304] 0 2023-10-08T08:45:25.640 INFO:tasks.workunit.client.0.smithi070.stdout:6/42: dread f5 [0,4194304] 0 2023-10-08T08:45:25.640 INFO:tasks.workunit.client.0.smithi070.stdout:3/37: dwrite d0/f1 [4194304,4194304] 0 2023-10-08T08:45:25.640 INFO:tasks.workunit.client.0.smithi070.stdout:3/38: dread - d0/db/fd zero size 2023-10-08T08:45:25.646 INFO:tasks.workunit.client.0.smithi070.stdout:8/75: dwrite d1/fb [4194304,4194304] 0 2023-10-08T08:45:25.647 INFO:tasks.workunit.client.0.smithi070.stdout:1/50: dread f5 [0,4194304] 0 2023-10-08T08:45:25.655 INFO:tasks.workunit.client.0.smithi070.stdout:6/43: dread f1 [0,4194304] 0 2023-10-08T08:45:25.657 INFO:tasks.workunit.client.0.smithi070.stdout:5/17: fsync f0 0 2023-10-08T08:45:25.661 INFO:tasks.workunit.client.0.smithi070.stdout:2/37: creat fc x:0 0 0 2023-10-08T08:45:25.662 INFO:tasks.workunit.client.0.smithi070.stdout:7/37: mkdir d3/d7/d9 0 2023-10-08T08:45:25.662 INFO:tasks.workunit.client.0.smithi070.stdout:2/38: write fb [1336317,96026] 0 2023-10-08T08:45:25.662 INFO:tasks.workunit.client.0.smithi070.stdout:2/39: stat fc 0 2023-10-08T08:45:25.662 INFO:tasks.workunit.client.0.smithi070.stdout:2/40: chown l7 5885890 1 2023-10-08T08:45:25.666 INFO:tasks.workunit.client.0.smithi070.stdout:6/44: mkdir df 0 2023-10-08T08:45:25.667 INFO:tasks.workunit.client.0.smithi070.stdout:9/30: rename d1/c4 to d1/d5/cc 0 2023-10-08T08:45:25.667 INFO:tasks.workunit.client.0.smithi070.stdout:7/38: rename d3 to d3/d7/da 22 2023-10-08T08:45:25.668 INFO:tasks.workunit.client.0.smithi070.stdout:7/39: dread d3/f6 [0,4194304] 0 2023-10-08T08:45:25.670 INFO:tasks.workunit.client.0.smithi070.stdout:7/40: dread d3/f6 [0,4194304] 0 2023-10-08T08:45:25.670 INFO:tasks.workunit.client.0.smithi070.stdout:7/41: fdatasync d3/d7/f8 0 2023-10-08T08:45:25.670 INFO:tasks.workunit.client.0.smithi070.stdout:7/42: rename d3 to d3/d7/d9/db 22 2023-10-08T08:45:25.670 INFO:tasks.workunit.client.0.smithi070.stdout:7/43: write d3/f6 [1119356,7926] 0 2023-10-08T08:45:25.670 INFO:tasks.workunit.client.0.smithi070.stdout:8/76: symlink d1/de/d15/l16 0 2023-10-08T08:45:25.672 INFO:tasks.workunit.client.0.smithi070.stdout:1/51: dwrite f5 [0,4194304] 0 2023-10-08T08:45:25.672 INFO:tasks.workunit.client.0.smithi070.stdout:6/45: creat df/f10 x:0 0 0 2023-10-08T08:45:25.674 INFO:tasks.workunit.client.0.smithi070.stdout:9/31: readlink d1/l2 0 2023-10-08T08:45:25.680 INFO:tasks.workunit.client.0.smithi070.stdout:7/44: symlink d3/d7/d9/lc 0 2023-10-08T08:45:25.681 INFO:tasks.workunit.client.0.smithi070.stdout:1/52: symlink d6/ld 0 2023-10-08T08:45:25.685 INFO:tasks.workunit.client.0.smithi070.stdout:1/53: rename d6/ld to d6/dc/le 0 2023-10-08T08:45:25.690 INFO:tasks.workunit.client.0.smithi070.stdout:7/45: rmdir d3 39 2023-10-08T08:45:25.692 INFO:tasks.workunit.client.0.smithi070.stdout:1/54: rename d6/l9 to d6/lf 0 2023-10-08T08:45:25.694 INFO:tasks.workunit.client.0.smithi070.stdout:1/55: creat d6/f10 x:0 0 0 2023-10-08T08:45:25.694 INFO:tasks.workunit.client.0.smithi070.stdout:8/77: dwrite f0 [0,4194304] 0 2023-10-08T08:45:25.695 INFO:tasks.workunit.client.0.smithi070.stdout:8/78: creat d1/d2/f17 x:0 0 0 2023-10-08T08:45:25.695 INFO:tasks.workunit.client.0.smithi070.stdout:8/79: stat d1/de 0 2023-10-08T08:45:25.699 INFO:tasks.workunit.client.0.smithi070.stdout:9/32: rename d1/d5 to d1/dd 0 2023-10-08T08:45:25.700 INFO:tasks.workunit.client.0.smithi070.stdout:7/46: dread d3/d7/f8 [0,4194304] 0 2023-10-08T08:45:25.700 INFO:tasks.workunit.client.0.smithi070.stdout:9/33: link d1/dd/cc d1/dd/ce 0 2023-10-08T08:45:25.700 INFO:tasks.workunit.client.0.smithi070.stdout:9/34: truncate d1/fb 830458 0 2023-10-08T08:45:25.701 INFO:tasks.workunit.client.0.smithi070.stdout:9/35: rename d1/l2 to d1/dd/lf 0 2023-10-08T08:45:25.703 INFO:tasks.workunit.client.0.smithi070.stdout:9/36: creat d1/dd/f10 x:0 0 0 2023-10-08T08:45:25.703 INFO:tasks.workunit.client.0.smithi070.stdout:9/37: fdatasync d1/dd/fa 0 2023-10-08T08:45:25.703 INFO:tasks.workunit.client.0.smithi070.stdout:9/38: chown d1/dd/lf 33362392 1 2023-10-08T08:45:25.716 INFO:tasks.workunit.client.0.smithi070.stdout:1/56: dread f5 [0,4194304] 0 2023-10-08T08:45:25.716 INFO:tasks.workunit.client.0.smithi070.stdout:9/39: dread f0 [4194304,4194304] 0 2023-10-08T08:45:25.719 INFO:tasks.workunit.client.0.smithi070.stdout:8/80: dwrite f0 [0,4194304] 0 2023-10-08T08:45:25.719 INFO:tasks.workunit.client.0.smithi070.stdout:8/81: truncate d1/d2/d6/f14 635712 0 2023-10-08T08:45:25.726 INFO:tasks.workunit.client.0.smithi070.stdout:7/47: dwrite d3/d7/f8 [0,4194304] 0 2023-10-08T08:45:25.726 INFO:tasks.workunit.client.0.smithi070.stdout:7/48: chown d3/c5 2360 1 2023-10-08T08:45:25.726 INFO:tasks.workunit.client.0.smithi070.stdout:7/49: write d3/f6 [1841174,59846] 0 2023-10-08T08:45:25.726 INFO:tasks.workunit.client.0.smithi070.stdout:7/50: chown d3/l4 95142 1 2023-10-08T08:45:25.726 INFO:tasks.workunit.client.0.smithi070.stdout:7/51: chown d3/d7/d9 141447 1 2023-10-08T08:45:25.727 INFO:tasks.workunit.client.0.smithi070.stdout:5/18: dwrite f0 [0,4194304] 0 2023-10-08T08:45:25.728 INFO:tasks.workunit.client.0.smithi070.stdout:6/46: dwrite f7 [0,4194304] 0 2023-10-08T08:45:25.728 INFO:tasks.workunit.client.0.smithi070.stdout:5/19: chown l3 36923 1 2023-10-08T08:45:25.730 INFO:tasks.workunit.client.0.smithi070.stdout:5/20: unlink c4 0 2023-10-08T08:45:25.732 INFO:tasks.workunit.client.0.smithi070.stdout:5/21: link f2 d5/f6 0 2023-10-08T08:45:25.732 INFO:tasks.workunit.client.0.smithi070.stdout:5/22: write f2 [497035,26720] 0 2023-10-08T08:45:25.732 INFO:tasks.workunit.client.0.smithi070.stdout:5/23: readlink l3 0 2023-10-08T08:45:25.732 INFO:tasks.workunit.client.0.smithi070.stdout:5/24: truncate f2 863863 0 2023-10-08T08:45:25.732 INFO:tasks.workunit.client.0.smithi070.stdout:1/57: dread f5 [0,4194304] 0 2023-10-08T08:45:25.733 INFO:tasks.workunit.client.0.smithi070.stdout:1/58: dread - d6/f10 zero size 2023-10-08T08:45:25.733 INFO:tasks.workunit.client.0.smithi070.stdout:1/59: write d6/f10 [13433,129234] 0 2023-10-08T08:45:25.733 INFO:tasks.workunit.client.0.smithi070.stdout:5/25: rmdir d5 39 2023-10-08T08:45:25.734 INFO:tasks.workunit.client.0.smithi070.stdout:6/47: write f5 [115680,84247] 0 2023-10-08T08:45:25.735 INFO:tasks.workunit.client.0.smithi070.stdout:5/26: link f2 d5/f7 0 2023-10-08T08:45:25.736 INFO:tasks.workunit.client.0.smithi070.stdout:6/48: mkdir df/d11 0 2023-10-08T08:45:25.736 INFO:tasks.workunit.client.0.smithi070.stdout:6/49: readlink l8 0 2023-10-08T08:45:25.736 INFO:tasks.workunit.client.0.smithi070.stdout:9/40: dread d1/dd/fa [0,4194304] 0 2023-10-08T08:45:25.737 INFO:tasks.workunit.client.0.smithi070.stdout:5/27: rename d5/f6 to d5/f8 0 2023-10-08T08:45:25.740 INFO:tasks.workunit.client.0.smithi070.stdout:8/82: dwrite d1/d2/f17 [0,4194304] 0 2023-10-08T08:45:25.742 INFO:tasks.workunit.client.0.smithi070.stdout:8/83: getdents d1/de/d15 0 2023-10-08T08:45:25.744 INFO:tasks.workunit.client.0.smithi070.stdout:5/28: write d5/f7 [370820,45799] 0 2023-10-08T08:45:25.744 INFO:tasks.workunit.client.0.smithi070.stdout:5/29: write d5/f8 [664909,324] 0 2023-10-08T08:45:25.748 INFO:tasks.workunit.client.0.smithi070.stdout:5/30: creat d5/f9 x:0 0 0 2023-10-08T08:45:25.755 INFO:tasks.workunit.client.0.smithi070.stdout:8/84: rmdir d1/d2/d6 39 2023-10-08T08:45:25.755 INFO:tasks.workunit.client.0.smithi070.stdout:1/60: dwrite f5 [0,4194304] 0 2023-10-08T08:45:25.755 INFO:tasks.workunit.client.0.smithi070.stdout:1/61: truncate f5 4968996 0 2023-10-08T08:45:25.761 INFO:tasks.workunit.client.0.smithi070.stdout:8/85: mkdir d1/de/d18 0 2023-10-08T08:45:25.762 INFO:tasks.workunit.client.0.smithi070.stdout:7/52: dread d3/f6 [0,4194304] 0 2023-10-08T08:45:25.763 INFO:tasks.workunit.client.0.smithi070.stdout:1/62: unlink d6/dc/le 0 2023-10-08T08:45:25.766 INFO:tasks.workunit.client.0.smithi070.stdout:7/53: creat d3/d7/fd x:0 0 0 2023-10-08T08:45:25.767 INFO:tasks.workunit.client.0.smithi070.stdout:1/63: creat d6/f11 x:0 0 0 2023-10-08T08:45:25.767 INFO:tasks.workunit.client.0.smithi070.stdout:8/86: truncate d1/d2/f17 1329778 0 2023-10-08T08:45:25.768 INFO:tasks.workunit.client.0.smithi070.stdout:6/50: dwrite df/f10 [0,4194304] 0 2023-10-08T08:45:25.768 INFO:tasks.workunit.client.0.smithi070.stdout:7/54: mknod d3/ce 0 2023-10-08T08:45:25.768 INFO:tasks.workunit.client.0.smithi070.stdout:7/55: chown d3/ce 75522 1 2023-10-08T08:45:25.769 INFO:tasks.workunit.client.0.smithi070.stdout:1/64: creat d6/f12 x:0 0 0 2023-10-08T08:45:25.770 INFO:tasks.workunit.client.0.smithi070.stdout:1/65: dread - d6/f11 zero size 2023-10-08T08:45:25.770 INFO:tasks.workunit.client.0.smithi070.stdout:6/51: write df/f10 [611520,62541] 0 2023-10-08T08:45:25.770 INFO:tasks.workunit.client.0.smithi070.stdout:6/52: write f5 [4743109,11485] 0 2023-10-08T08:45:25.771 INFO:tasks.workunit.client.0.smithi070.stdout:6/53: readlink l0 0 2023-10-08T08:45:25.772 INFO:tasks.workunit.client.0.smithi070.stdout:7/56: mknod d3/d7/cf 0 2023-10-08T08:45:25.774 INFO:tasks.workunit.client.0.smithi070.stdout:7/57: write d3/f6 [400177,51567] 0 2023-10-08T08:45:25.775 INFO:tasks.workunit.client.0.smithi070.stdout:8/87: truncate f0 3454135 0 2023-10-08T08:45:25.775 INFO:tasks.workunit.client.0.smithi070.stdout:5/31: dread f0 [0,4194304] 0 2023-10-08T08:45:25.776 INFO:tasks.workunit.client.0.smithi070.stdout:6/54: rename la to df/l12 0 2023-10-08T08:45:25.776 INFO:tasks.workunit.client.0.smithi070.stdout:7/58: rename d3/d7/d9 to d3/d7/d9/d10 22 2023-10-08T08:45:25.777 INFO:tasks.workunit.client.0.smithi070.stdout:8/88: mknod d1/de/d15/c19 0 2023-10-08T08:45:25.778 INFO:tasks.workunit.client.0.smithi070.stdout:5/32: mkdir d5/da 0 2023-10-08T08:45:25.778 INFO:tasks.workunit.client.0.smithi070.stdout:7/59: fsync d3/d7/fd 0 2023-10-08T08:45:25.779 INFO:tasks.workunit.client.0.smithi070.stdout:1/66: fsync d6/f11 0 2023-10-08T08:45:25.780 INFO:tasks.workunit.client.0.smithi070.stdout:7/60: link d3/ce d3/d7/c11 0 2023-10-08T08:45:25.782 INFO:tasks.workunit.client.0.smithi070.stdout:1/67: creat d6/dc/f13 x:0 0 0 2023-10-08T08:45:25.784 INFO:tasks.workunit.client.0.smithi070.stdout:7/61: rmdir d3/d7/d9 39 2023-10-08T08:45:25.784 INFO:tasks.workunit.client.0.smithi070.stdout:7/62: truncate d3/d7/fd 824324 0 2023-10-08T08:45:25.785 INFO:tasks.workunit.client.0.smithi070.stdout:7/63: creat d3/f12 x:0 0 0 2023-10-08T08:45:25.798 INFO:tasks.workunit.client.0.smithi070.stdout:7/64: dread d3/f6 [0,4194304] 0 2023-10-08T08:45:25.802 INFO:tasks.workunit.client.0.smithi070.stdout:7/65: truncate d3/d7/fd 627681 0 2023-10-08T08:45:25.804 INFO:tasks.workunit.client.0.smithi070.stdout:7/66: creat d3/f13 x:0 0 0 2023-10-08T08:45:25.804 INFO:tasks.workunit.client.0.smithi070.stdout:7/67: stat d3/d7/fd 0 2023-10-08T08:45:25.804 INFO:tasks.workunit.client.0.smithi070.stdout:5/33: dwrite f2 [0,4194304] 0 2023-10-08T08:45:25.805 INFO:tasks.workunit.client.0.smithi070.stdout:7/68: mknod d3/c14 0 2023-10-08T08:45:25.808 INFO:tasks.workunit.client.0.smithi070.stdout:5/34: rename f2 to d5/fb 0 2023-10-08T08:45:25.808 INFO:tasks.workunit.client.0.smithi070.stdout:5/35: chown d5/fb 48690 1 2023-10-08T08:45:25.809 INFO:tasks.workunit.client.0.smithi070.stdout:8/89: dwrite d1/fb [4194304,4194304] 0 2023-10-08T08:45:25.810 INFO:tasks.workunit.client.0.smithi070.stdout:1/68: dwrite d6/f11 [0,4194304] 0 2023-10-08T08:45:25.810 INFO:tasks.workunit.client.0.smithi070.stdout:1/69: write d6/dc/f13 [317249,60004] 0 2023-10-08T08:45:25.810 INFO:tasks.workunit.client.0.smithi070.stdout:7/69: rename d3/d7/d9/lc to d3/d7/l15 0 2023-10-08T08:45:25.810 INFO:tasks.workunit.client.0.smithi070.stdout:7/70: chown d3/l4 3 1 2023-10-08T08:45:25.810 INFO:tasks.workunit.client.0.smithi070.stdout:7/71: write d3/f12 [521420,128483] 0 2023-10-08T08:45:25.810 INFO:tasks.workunit.client.0.smithi070.stdout:7/72: readlink d3/l4 0 2023-10-08T08:45:25.811 INFO:tasks.workunit.client.0.smithi070.stdout:6/55: dwrite df/f10 [0,4194304] 0 2023-10-08T08:45:25.811 INFO:tasks.workunit.client.0.smithi070.stdout:6/56: truncate f2 4888551 0 2023-10-08T08:45:25.812 INFO:tasks.workunit.client.0.smithi070.stdout:8/90: mkdir d1/de/d1a 0 2023-10-08T08:45:25.812 INFO:tasks.workunit.client.0.smithi070.stdout:8/91: stat d1/de 0 2023-10-08T08:45:25.812 INFO:tasks.workunit.client.0.smithi070.stdout:8/92: getdents d1/de/d1a 0 2023-10-08T08:45:25.814 INFO:tasks.workunit.client.0.smithi070.stdout:6/57: write f5 [3428825,98430] 0 2023-10-08T08:45:25.818 INFO:tasks.workunit.client.0.smithi070.stdout:8/93: creat d1/de/d1a/f1b x:0 0 0 2023-10-08T08:45:25.819 INFO:tasks.workunit.client.0.smithi070.stdout:6/58: mknod df/d11/c13 0 2023-10-08T08:45:25.819 INFO:tasks.workunit.client.0.smithi070.stdout:6/59: write f9 [1638672,14486] 0 2023-10-08T08:45:25.819 INFO:tasks.workunit.client.0.smithi070.stdout:6/60: fsync f7 0 2023-10-08T08:45:25.820 INFO:tasks.workunit.client.0.smithi070.stdout:1/70: rmdir d6/dc 39 2023-10-08T08:45:25.821 INFO:tasks.workunit.client.0.smithi070.stdout:7/73: getdents d3/d7 0 2023-10-08T08:45:25.824 INFO:tasks.workunit.client.0.smithi070.stdout:8/94: creat d1/f1c x:0 0 0 2023-10-08T08:45:25.824 INFO:tasks.workunit.client.0.smithi070.stdout:8/95: fdatasync d1/de/d1a/f1b 0 2023-10-08T08:45:25.824 INFO:tasks.workunit.client.0.smithi070.stdout:6/61: symlink df/d11/l14 0 2023-10-08T08:45:25.825 INFO:tasks.workunit.client.0.smithi070.stdout:1/71: stat d6/lb 0 2023-10-08T08:45:25.825 INFO:tasks.workunit.client.0.smithi070.stdout:7/74: symlink d3/d7/l16 0 2023-10-08T08:45:25.826 INFO:tasks.workunit.client.0.smithi070.stdout:6/62: creat df/f15 x:0 0 0 2023-10-08T08:45:25.827 INFO:tasks.workunit.client.0.smithi070.stdout:1/72: mkdir d6/dc/d14 0 2023-10-08T08:45:25.827 INFO:tasks.workunit.client.0.smithi070.stdout:7/75: stat d3/ce 0 2023-10-08T08:45:25.827 INFO:tasks.workunit.client.0.smithi070.stdout:6/63: write f9 [1373077,66223] 0 2023-10-08T08:45:25.828 INFO:tasks.workunit.client.0.smithi070.stdout:8/96: mknod d1/d2/c1d 0 2023-10-08T08:45:25.829 INFO:tasks.workunit.client.0.smithi070.stdout:8/97: write d1/d2/d6/f14 [339304,121807] 0 2023-10-08T08:45:25.829 INFO:tasks.workunit.client.0.smithi070.stdout:8/98: dread - d1/f1c zero size 2023-10-08T08:45:25.829 INFO:tasks.workunit.client.0.smithi070.stdout:1/73: mkdir d6/dc/d14/d15 0 2023-10-08T08:45:25.829 INFO:tasks.workunit.client.0.smithi070.stdout:1/74: getdents d6/dc/d14/d15 0 2023-10-08T08:45:25.830 INFO:tasks.workunit.client.0.smithi070.stdout:6/64: symlink df/l16 0 2023-10-08T08:45:25.830 INFO:tasks.workunit.client.0.smithi070.stdout:8/99: truncate d1/d2/d6/fa 1765751 0 2023-10-08T08:45:25.831 INFO:tasks.workunit.client.0.smithi070.stdout:8/100: write d1/d2/d6/f14 [319585,94632] 0 2023-10-08T08:45:25.831 INFO:tasks.workunit.client.0.smithi070.stdout:1/75: mknod d6/dc/d14/c16 0 2023-10-08T08:45:25.832 INFO:tasks.workunit.client.0.smithi070.stdout:8/101: creat d1/d2/f1e x:0 0 0 2023-10-08T08:45:25.832 INFO:tasks.workunit.client.0.smithi070.stdout:8/102: readlink d1/de/d15/l16 0 2023-10-08T08:45:25.832 INFO:tasks.workunit.client.0.smithi070.stdout:1/76: mkdir d6/d17 0 2023-10-08T08:45:25.833 INFO:tasks.workunit.client.0.smithi070.stdout:8/103: creat d1/d2/f1f x:0 0 0 2023-10-08T08:45:25.836 INFO:tasks.workunit.client.0.smithi070.stdout:1/77: rmdir d6/dc/d14/d15 0 2023-10-08T08:45:25.851 INFO:tasks.workunit.client.0.smithi070.stdout:6/65: dwrite f1 [0,4194304] 0 2023-10-08T08:45:25.852 INFO:tasks.workunit.client.0.smithi070.stdout:6/66: creat df/f17 x:0 0 0 2023-10-08T08:45:25.853 INFO:tasks.workunit.client.0.smithi070.stdout:7/76: read d3/d7/f8 [960422,35821] 0 2023-10-08T08:45:25.858 INFO:tasks.workunit.client.0.smithi070.stdout:7/77: rename d3/d7/l16 to d3/d7/l17 0 2023-10-08T08:45:25.860 INFO:tasks.workunit.client.0.smithi070.stdout:7/78: dread d3/d7/fd [0,4194304] 0 2023-10-08T08:45:25.862 INFO:tasks.workunit.client.0.smithi070.stdout:7/79: mknod d3/c18 0 2023-10-08T08:45:25.862 INFO:tasks.workunit.client.0.smithi070.stdout:7/80: fsync d3/f13 0 2023-10-08T08:45:25.862 INFO:tasks.workunit.client.0.smithi070.stdout:7/81: mkdir d3/d19 0 2023-10-08T08:45:25.863 INFO:tasks.workunit.client.0.smithi070.stdout:7/82: readlink d3/d7/l17 0 2023-10-08T08:45:25.905 INFO:tasks.workunit.client.0.smithi070.stdout:1/78: dwrite d6/f11 [0,4194304] 0 2023-10-08T08:45:25.905 INFO:tasks.workunit.client.0.smithi070.stdout:8/104: dwrite d1/d2/d6/fa [0,4194304] 0 2023-10-08T08:45:25.911 INFO:tasks.workunit.client.0.smithi070.stdout:1/79: creat d6/f18 x:0 0 0 2023-10-08T08:45:25.912 INFO:tasks.workunit.client.0.smithi070.stdout:8/105: creat d1/de/d15/f20 x:0 0 0 2023-10-08T08:45:25.913 INFO:tasks.workunit.client.0.smithi070.stdout:8/106: fsync d1/d2/f1f 0 2023-10-08T08:45:25.914 INFO:tasks.workunit.client.0.smithi070.stdout:8/107: getdents d1/de/d1a 0 2023-10-08T08:45:25.915 INFO:tasks.workunit.client.0.smithi070.stdout:8/108: write f0 [4414395,47585] 0 2023-10-08T08:45:25.916 INFO:tasks.workunit.client.0.smithi070.stdout:8/109: rename d1/de/d18 to d1/de/d21 0 2023-10-08T08:45:25.917 INFO:tasks.workunit.client.0.smithi070.stdout:8/110: mkdir d1/d2/d6/d22 0 2023-10-08T08:45:25.949 INFO:tasks.workunit.client.0.smithi070.stdout:8/111: dwrite d1/de/d1a/f1b [0,4194304] 0 2023-10-08T08:45:25.953 INFO:tasks.workunit.client.0.smithi070.stdout:8/112: mkdir d1/d23 0 2023-10-08T08:45:25.963 INFO:tasks.workunit.client.0.smithi070.stdout:1/80: dwrite d6/f18 [0,4194304] 0 2023-10-08T08:45:25.973 INFO:tasks.workunit.client.0.smithi070.stdout:8/113: dwrite d1/d2/d6/fa [0,4194304] 0 2023-10-08T08:45:25.974 INFO:tasks.workunit.client.0.smithi070.stdout:8/114: creat d1/f24 x:0 0 0 2023-10-08T08:45:25.976 INFO:tasks.workunit.client.0.smithi070.stdout:8/115: creat d1/de/f25 x:0 0 0 2023-10-08T08:45:25.977 INFO:tasks.workunit.client.0.smithi070.stdout:4/43: sync 2023-10-08T08:45:25.977 INFO:tasks.workunit.client.0.smithi070.stdout:3/39: sync 2023-10-08T08:45:25.977 INFO:tasks.workunit.client.0.smithi070.stdout:0/129: sync 2023-10-08T08:45:25.977 INFO:tasks.workunit.client.0.smithi070.stdout:3/40: truncate d0/f8 750470 0 2023-10-08T08:45:25.978 INFO:tasks.workunit.client.0.smithi070.stdout:2/41: sync 2023-10-08T08:45:25.978 INFO:tasks.workunit.client.0.smithi070.stdout:9/41: sync 2023-10-08T08:45:25.978 INFO:tasks.workunit.client.0.smithi070.stdout:0/130: truncate d1/f11 3258625 0 2023-10-08T08:45:25.979 INFO:tasks.workunit.client.0.smithi070.stdout:2/42: mknod cd 0 2023-10-08T08:45:25.979 INFO:tasks.workunit.client.0.smithi070.stdout:2/43: read - fc zero size 2023-10-08T08:45:25.979 INFO:tasks.workunit.client.0.smithi070.stdout:2/44: write fc [343262,92106] 0 2023-10-08T08:45:25.980 INFO:tasks.workunit.client.0.smithi070.stdout:9/42: creat d1/dd/f11 x:0 0 0 2023-10-08T08:45:25.980 INFO:tasks.workunit.client.0.smithi070.stdout:9/43: read - d1/dd/f11 zero size 2023-10-08T08:45:25.981 INFO:tasks.workunit.client.0.smithi070.stdout:0/131: symlink d1/d14/d1f/l22 0 2023-10-08T08:45:25.983 INFO:tasks.workunit.client.0.smithi070.stdout:1/81: dwrite d6/dc/f13 [0,4194304] 0 2023-10-08T08:45:25.983 INFO:tasks.workunit.client.0.smithi070.stdout:1/82: fdatasync d6/f10 0 2023-10-08T08:45:25.983 INFO:tasks.workunit.client.0.smithi070.stdout:1/83: fdatasync f5 0 2023-10-08T08:45:25.983 INFO:tasks.workunit.client.0.smithi070.stdout:1/84: chown c4 99418 1 2023-10-08T08:45:25.983 INFO:tasks.workunit.client.0.smithi070.stdout:2/45: mknod ce 0 2023-10-08T08:45:25.987 INFO:tasks.workunit.client.0.smithi070.stdout:1/85: creat d6/dc/f19 x:0 0 0 2023-10-08T08:45:25.988 INFO:tasks.workunit.client.0.smithi070.stdout:2/46: truncate fa 643838 0 2023-10-08T08:45:25.989 INFO:tasks.workunit.client.0.smithi070.stdout:9/44: mknod d1/c12 0 2023-10-08T08:45:25.997 INFO:tasks.workunit.client.0.smithi070.stdout:9/45: rmdir d1/dd 39 2023-10-08T08:45:25.998 INFO:tasks.workunit.client.0.smithi070.stdout:9/46: creat d1/f13 x:0 0 0 2023-10-08T08:45:26.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/47: rename d1/c12 to d1/dd/c14 0 2023-10-08T08:45:26.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/48: chown d1/fb 486109992 1 2023-10-08T08:45:26.012 INFO:tasks.workunit.client.0.smithi070.stdout:4/44: write f6 [1806862,86343] 0 2023-10-08T08:45:26.012 INFO:tasks.workunit.client.0.smithi070.stdout:0/132: write d1/f7 [1470401,37506] 0 2023-10-08T08:45:26.012 INFO:tasks.workunit.client.0.smithi070.stdout:0/133: write d1/d14/d1f/f1a [310366,110817] 0 2023-10-08T08:45:26.013 INFO:tasks.workunit.client.0.smithi070.stdout:4/45: mkdir dc 0 2023-10-08T08:45:26.013 INFO:tasks.workunit.client.0.smithi070.stdout:8/116: dwrite f0 [4194304,4194304] 0 2023-10-08T08:45:26.014 INFO:tasks.workunit.client.0.smithi070.stdout:0/134: mknod d1/d14/d1f/c23 0 2023-10-08T08:45:26.015 INFO:tasks.workunit.client.0.smithi070.stdout:8/117: write d1/fb [1296606,48207] 0 2023-10-08T08:45:26.016 INFO:tasks.workunit.client.0.smithi070.stdout:9/49: rename d1/dd/c14 to d1/dd/c15 0 2023-10-08T08:45:26.016 INFO:tasks.workunit.client.0.smithi070.stdout:1/86: dwrite f5 [4194304,4194304] 0 2023-10-08T08:45:26.019 INFO:tasks.workunit.client.0.smithi070.stdout:2/47: truncate fa 156020 0 2023-10-08T08:45:26.020 INFO:tasks.workunit.client.0.smithi070.stdout:8/118: mknod d1/de/d1a/c26 0 2023-10-08T08:45:26.021 INFO:tasks.workunit.client.0.smithi070.stdout:9/50: rename d1/dd/cc to d1/dd/c16 0 2023-10-08T08:45:26.022 INFO:tasks.workunit.client.0.smithi070.stdout:1/87: write d6/dc/f13 [3614657,102542] 0 2023-10-08T08:45:26.024 INFO:tasks.workunit.client.0.smithi070.stdout:2/48: mkdir df 0 2023-10-08T08:45:26.025 INFO:tasks.workunit.client.0.smithi070.stdout:8/119: mknod d1/d2/d6/d22/c27 0 2023-10-08T08:45:26.026 INFO:tasks.workunit.client.0.smithi070.stdout:9/51: truncate d1/dd/fa 3257140 0 2023-10-08T08:45:26.026 INFO:tasks.workunit.client.0.smithi070.stdout:9/52: fsync d1/dd/f10 0 2023-10-08T08:45:26.027 INFO:tasks.workunit.client.0.smithi070.stdout:2/49: mknod df/c10 0 2023-10-08T08:45:26.029 INFO:tasks.workunit.client.0.smithi070.stdout:8/120: creat d1/d23/f28 x:0 0 0 2023-10-08T08:45:26.032 INFO:tasks.workunit.client.0.smithi070.stdout:2/50: unlink l5 0 2023-10-08T08:45:26.032 INFO:tasks.workunit.client.0.smithi070.stdout:2/51: write fc [1180498,10132] 0 2023-10-08T08:45:26.034 INFO:tasks.workunit.client.0.smithi070.stdout:9/53: link d1/dd/c16 d1/dd/c17 0 2023-10-08T08:45:26.036 INFO:tasks.workunit.client.0.smithi070.stdout:8/121: symlink d1/d2/d6/d22/l29 0 2023-10-08T08:45:26.037 INFO:tasks.workunit.client.0.smithi070.stdout:2/52: rmdir df 39 2023-10-08T08:45:26.040 INFO:tasks.workunit.client.0.smithi070.stdout:9/54: link d1/f13 d1/dd/f18 0 2023-10-08T08:45:26.040 INFO:tasks.workunit.client.0.smithi070.stdout:9/55: chown d1/dd/c16 0 1 2023-10-08T08:45:26.040 INFO:tasks.workunit.client.0.smithi070.stdout:9/56: stat d1/dd/f11 0 2023-10-08T08:45:26.040 INFO:tasks.workunit.client.0.smithi070.stdout:0/135: dwrite d1/f6 [0,4194304] 0 2023-10-08T08:45:26.040 INFO:tasks.workunit.client.0.smithi070.stdout:0/136: write d1/d14/d1f/f1a [981104,101348] 0 2023-10-08T08:45:26.040 INFO:tasks.workunit.client.0.smithi070.stdout:4/46: dwrite f9 [0,4194304] 0 2023-10-08T08:45:26.041 INFO:tasks.workunit.client.0.smithi070.stdout:8/122: mknod d1/d2/d6/c2a 0 2023-10-08T08:45:26.045 INFO:tasks.workunit.client.0.smithi070.stdout:2/53: rename f2 to df/f11 0 2023-10-08T08:45:26.045 INFO:tasks.workunit.client.0.smithi070.stdout:4/47: rename dc to dc/dd 22 2023-10-08T08:45:26.045 INFO:tasks.workunit.client.0.smithi070.stdout:9/57: mkdir d1/dd/d19 0 2023-10-08T08:45:26.047 INFO:tasks.workunit.client.0.smithi070.stdout:0/137: mkdir d1/d1d/d24 0 2023-10-08T08:45:26.048 INFO:tasks.workunit.client.0.smithi070.stdout:1/88: dwrite f5 [4194304,4194304] 0 2023-10-08T08:45:26.049 INFO:tasks.workunit.client.0.smithi070.stdout:2/54: read fb [77550,120708] 0 2023-10-08T08:45:26.050 INFO:tasks.workunit.client.0.smithi070.stdout:8/123: rename d1/f1c to d1/d2/d6/d22/f2b 0 2023-10-08T08:45:26.054 INFO:tasks.workunit.client.0.smithi070.stdout:0/138: rename d1/f4 to d1/dd/f25 0 2023-10-08T08:45:26.054 INFO:tasks.workunit.client.0.smithi070.stdout:0/139: write d1/f11 [3411548,48251] 0 2023-10-08T08:45:26.057 INFO:tasks.workunit.client.0.smithi070.stdout:0/140: read d1/dd/f13 [95235,109737] 0 2023-10-08T08:45:26.058 INFO:tasks.workunit.client.0.smithi070.stdout:4/48: dread f5 [0,4194304] 0 2023-10-08T08:45:26.059 INFO:tasks.workunit.client.0.smithi070.stdout:4/49: dread f7 [0,4194304] 0 2023-10-08T08:45:26.061 INFO:tasks.workunit.client.0.smithi070.stdout:5/36: sync 2023-10-08T08:45:26.061 INFO:tasks.workunit.client.0.smithi070.stdout:4/50: rename l8 to dc/le 0 2023-10-08T08:45:26.062 INFO:tasks.workunit.client.0.smithi070.stdout:5/37: creat d5/fc x:0 0 0 2023-10-08T08:45:26.062 INFO:tasks.workunit.client.0.smithi070.stdout:5/38: write d5/fc [420097,116742] 0 2023-10-08T08:45:26.063 INFO:tasks.workunit.client.0.smithi070.stdout:4/51: rename f5 to dc/ff 0 2023-10-08T08:45:26.063 INFO:tasks.workunit.client.0.smithi070.stdout:5/39: rename d5 to d5/da/dd 22 2023-10-08T08:45:26.065 INFO:tasks.workunit.client.0.smithi070.stdout:4/52: rename f2 to dc/f10 0 2023-10-08T08:45:26.065 INFO:tasks.workunit.client.0.smithi070.stdout:5/40: unlink d5/f8 0 2023-10-08T08:45:26.066 INFO:tasks.workunit.client.0.smithi070.stdout:1/89: dread f5 [0,4194304] 0 2023-10-08T08:45:26.067 INFO:tasks.workunit.client.0.smithi070.stdout:4/53: unlink f4 0 2023-10-08T08:45:26.078 INFO:tasks.workunit.client.0.smithi070.stdout:9/58: dwrite d1/f13 [0,4194304] 0 2023-10-08T08:45:26.085 INFO:tasks.workunit.client.0.smithi070.stdout:5/41: write d5/fb [260157,15250] 0 2023-10-08T08:45:26.085 INFO:tasks.workunit.client.0.smithi070.stdout:4/54: dread f9 [0,4194304] 0 2023-10-08T08:45:26.087 INFO:tasks.workunit.client.0.smithi070.stdout:5/42: rename l3 to d5/le 0 2023-10-08T08:45:26.090 INFO:tasks.workunit.client.0.smithi070.stdout:5/43: rename d5/fb to d5/ff 0 2023-10-08T08:45:26.091 INFO:tasks.workunit.client.0.smithi070.stdout:5/44: creat d5/da/f10 x:0 0 0 2023-10-08T08:45:26.093 INFO:tasks.workunit.client.0.smithi070.stdout:5/45: link f0 d5/da/f11 0 2023-10-08T08:45:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:9/59: dread d1/dd/fa [0,4194304] 0 2023-10-08T08:45:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:9/60: getdents d1/dd/d19 0 2023-10-08T08:45:26.099 INFO:tasks.workunit.client.0.smithi070.stdout:4/55: dread dc/ff [0,4194304] 0 2023-10-08T08:45:26.100 INFO:tasks.workunit.client.0.smithi070.stdout:1/90: dwrite d6/f10 [0,4194304] 0 2023-10-08T08:45:26.101 INFO:tasks.workunit.client.0.smithi070.stdout:4/56: read f6 [1384982,41776] 0 2023-10-08T08:45:26.103 INFO:tasks.workunit.client.0.smithi070.stdout:2/55: dwrite fc [0,4194304] 0 2023-10-08T08:45:26.103 INFO:tasks.workunit.client.0.smithi070.stdout:2/56: write fa [858974,54996] 0 2023-10-08T08:45:26.107 INFO:tasks.workunit.client.0.smithi070.stdout:5/46: write d5/ff [2028223,28059] 0 2023-10-08T08:45:26.110 INFO:tasks.workunit.client.0.smithi070.stdout:5/47: dread d5/fc [0,4194304] 0 2023-10-08T08:45:26.114 INFO:tasks.workunit.client.0.smithi070.stdout:9/61: dread d1/dd/f18 [0,4194304] 0 2023-10-08T08:45:26.114 INFO:tasks.workunit.client.0.smithi070.stdout:9/62: read - d1/dd/f10 zero size 2023-10-08T08:45:26.114 INFO:tasks.workunit.client.0.smithi070.stdout:9/63: chown d1/dd/c16 69 1 2023-10-08T08:45:26.115 INFO:tasks.workunit.client.0.smithi070.stdout:9/64: mkdir d1/dd/d1a 0 2023-10-08T08:45:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:5/48: dread d5/da/f11 [0,4194304] 0 2023-10-08T08:45:26.135 INFO:tasks.workunit.client.0.smithi070.stdout:9/65: dwrite d1/dd/f18 [4194304,4194304] 0 2023-10-08T08:45:26.137 INFO:tasks.workunit.client.0.smithi070.stdout:9/66: creat d1/dd/d19/f1b x:0 0 0 2023-10-08T08:45:26.138 INFO:tasks.workunit.client.0.smithi070.stdout:9/67: creat d1/dd/d1a/f1c x:0 0 0 2023-10-08T08:45:26.138 INFO:tasks.workunit.client.0.smithi070.stdout:9/68: write d1/dd/f10 [822865,57612] 0 2023-10-08T08:45:26.144 INFO:tasks.workunit.client.0.smithi070.stdout:9/69: truncate d1/f13 3385856 0 2023-10-08T08:45:26.145 INFO:tasks.workunit.client.0.smithi070.stdout:9/70: creat d1/dd/d1a/f1d x:0 0 0 2023-10-08T08:45:26.146 INFO:tasks.workunit.client.0.smithi070.stdout:9/71: fsync f0 0 2023-10-08T08:45:26.146 INFO:tasks.workunit.client.0.smithi070.stdout:9/72: creat d1/dd/d19/f1e x:0 0 0 2023-10-08T08:45:26.163 INFO:tasks.workunit.client.0.smithi070.stdout:9/73: write f0 [2255976,116802] 0 2023-10-08T08:45:26.167 INFO:tasks.workunit.client.0.smithi070.stdout:9/74: symlink d1/l1f 0 2023-10-08T08:45:26.167 INFO:tasks.workunit.client.0.smithi070.stdout:5/49: dwrite d5/da/f11 [0,4194304] 0 2023-10-08T08:45:26.167 INFO:tasks.workunit.client.0.smithi070.stdout:5/50: chown f0 0 1 2023-10-08T08:45:26.168 INFO:tasks.workunit.client.0.smithi070.stdout:2/57: dwrite fc [0,4194304] 0 2023-10-08T08:45:26.168 INFO:tasks.workunit.client.0.smithi070.stdout:2/58: truncate fb 1699086 0 2023-10-08T08:45:26.173 INFO:tasks.workunit.client.0.smithi070.stdout:9/75: creat d1/f20 x:0 0 0 2023-10-08T08:45:26.173 INFO:tasks.workunit.client.0.smithi070.stdout:2/59: mkdir df/d12 0 2023-10-08T08:45:26.175 INFO:tasks.workunit.client.0.smithi070.stdout:4/57: dwrite f9 [0,4194304] 0 2023-10-08T08:45:26.175 INFO:tasks.workunit.client.0.smithi070.stdout:2/60: write fb [53250,25667] 0 2023-10-08T08:45:26.176 INFO:tasks.workunit.client.0.smithi070.stdout:4/58: dread f7 [0,4194304] 0 2023-10-08T08:45:26.181 INFO:tasks.workunit.client.0.smithi070.stdout:4/59: creat dc/f11 x:0 0 0 2023-10-08T08:45:26.186 INFO:tasks.workunit.client.0.smithi070.stdout:5/51: dread d5/da/f11 [0,4194304] 0 2023-10-08T08:45:26.186 INFO:tasks.workunit.client.0.smithi070.stdout:5/52: stat d5/da 0 2023-10-08T08:45:26.189 INFO:tasks.workunit.client.0.smithi070.stdout:5/53: truncate d5/fc 565483 0 2023-10-08T08:45:26.189 INFO:tasks.workunit.client.0.smithi070.stdout:5/54: fsync f0 0 2023-10-08T08:45:26.189 INFO:tasks.workunit.client.0.smithi070.stdout:5/55: truncate d5/f9 1003515 0 2023-10-08T08:45:26.189 INFO:tasks.workunit.client.0.smithi070.stdout:5/56: chown d5/da/f11 197792215 1 2023-10-08T08:45:26.190 INFO:tasks.workunit.client.0.smithi070.stdout:5/57: creat d5/da/f12 x:0 0 0 2023-10-08T08:45:26.211 INFO:tasks.workunit.client.0.smithi070.stdout:7/83: sync 2023-10-08T08:45:26.211 INFO:tasks.workunit.client.0.smithi070.stdout:6/67: sync 2023-10-08T08:45:26.211 INFO:tasks.workunit.client.0.smithi070.stdout:6/68: chown df/f10 835162523 1 2023-10-08T08:45:26.212 INFO:tasks.workunit.client.0.smithi070.stdout:7/84: truncate d3/f6 771835 0 2023-10-08T08:45:26.213 INFO:tasks.workunit.client.0.smithi070.stdout:6/69: creat df/f18 x:0 0 0 2023-10-08T08:45:26.213 INFO:tasks.workunit.client.0.smithi070.stdout:6/70: dread - df/f17 zero size 2023-10-08T08:45:26.213 INFO:tasks.workunit.client.0.smithi070.stdout:6/71: chown lb 13729367 1 2023-10-08T08:45:26.213 INFO:tasks.workunit.client.0.smithi070.stdout:6/72: stat lb 0 2023-10-08T08:45:26.213 INFO:tasks.workunit.client.0.smithi070.stdout:6/73: write df/f17 [793653,47321] 0 2023-10-08T08:45:26.213 INFO:tasks.workunit.client.0.smithi070.stdout:6/74: fdatasync f1 0 2023-10-08T08:45:26.214 INFO:tasks.workunit.client.0.smithi070.stdout:7/85: mkdir d3/d19/d1a 0 2023-10-08T08:45:26.214 INFO:tasks.workunit.client.0.smithi070.stdout:7/86: chown d3/d19/d1a 16 1 2023-10-08T08:45:26.214 INFO:tasks.workunit.client.0.smithi070.stdout:6/75: mknod df/d11/c19 0 2023-10-08T08:45:26.216 INFO:tasks.workunit.client.0.smithi070.stdout:7/87: mkdir d3/d19/d1b 0 2023-10-08T08:45:26.217 INFO:tasks.workunit.client.0.smithi070.stdout:2/61: dwrite f8 [0,4194304] 0 2023-10-08T08:45:26.217 INFO:tasks.workunit.client.0.smithi070.stdout:2/62: truncate fc 4861204 0 2023-10-08T08:45:26.217 INFO:tasks.workunit.client.0.smithi070.stdout:6/76: creat df/d11/f1a x:0 0 0 2023-10-08T08:45:26.218 INFO:tasks.workunit.client.0.smithi070.stdout:6/77: dread f2 [4194304,4194304] 0 2023-10-08T08:45:26.219 INFO:tasks.workunit.client.0.smithi070.stdout:2/63: symlink df/l13 0 2023-10-08T08:45:26.221 INFO:tasks.workunit.client.0.smithi070.stdout:6/78: creat df/f1b x:0 0 0 2023-10-08T08:45:26.224 INFO:tasks.workunit.client.0.smithi070.stdout:5/58: dwrite f0 [0,4194304] 0 2023-10-08T08:45:26.224 INFO:tasks.workunit.client.0.smithi070.stdout:5/59: write d5/fc [1487258,119879] 0 2023-10-08T08:45:26.226 INFO:tasks.workunit.client.0.smithi070.stdout:4/60: dwrite dc/ff [0,4194304] 0 2023-10-08T08:45:26.231 INFO:tasks.workunit.client.0.smithi070.stdout:7/88: write d3/d7/f8 [3444418,63663] 0 2023-10-08T08:45:26.231 INFO:tasks.workunit.client.0.smithi070.stdout:5/60: getdents d5/da 0 2023-10-08T08:45:26.232 INFO:tasks.workunit.client.0.smithi070.stdout:5/61: chown d5/da/f11 7860 1 2023-10-08T08:45:26.247 INFO:tasks.workunit.client.0.smithi070.stdout:7/89: dread d3/d7/f8 [0,4194304] 0 2023-10-08T08:45:26.250 INFO:tasks.workunit.client.0.smithi070.stdout:2/64: dwrite fc [0,4194304] 0 2023-10-08T08:45:26.250 INFO:tasks.workunit.client.0.smithi070.stdout:2/65: fdatasync f8 0 2023-10-08T08:45:26.252 INFO:tasks.workunit.client.0.smithi070.stdout:2/66: mknod df/d12/c14 0 2023-10-08T08:45:26.252 INFO:tasks.workunit.client.0.smithi070.stdout:6/79: dwrite f9 [0,4194304] 0 2023-10-08T08:45:26.252 INFO:tasks.workunit.client.0.smithi070.stdout:6/80: write df/f1b [1031809,93371] 0 2023-10-08T08:45:26.252 INFO:tasks.workunit.client.0.smithi070.stdout:2/67: rmdir df 39 2023-10-08T08:45:26.254 INFO:tasks.workunit.client.0.smithi070.stdout:2/68: mkdir df/d12/d15 0 2023-10-08T08:45:26.255 INFO:tasks.workunit.client.0.smithi070.stdout:2/69: chown fa 290494 1 2023-10-08T08:45:26.255 INFO:tasks.workunit.client.0.smithi070.stdout:4/61: dwrite f7 [0,4194304] 0 2023-10-08T08:45:26.257 INFO:tasks.workunit.client.0.smithi070.stdout:5/62: dwrite d5/f9 [0,4194304] 0 2023-10-08T08:45:26.257 INFO:tasks.workunit.client.0.smithi070.stdout:5/63: write d5/da/f10 [653319,38346] 0 2023-10-08T08:45:26.260 INFO:tasks.workunit.client.0.smithi070.stdout:5/64: mkdir d5/d13 0 2023-10-08T08:45:26.261 INFO:tasks.workunit.client.0.smithi070.stdout:4/62: rename f7 to dc/f12 0 2023-10-08T08:45:26.263 INFO:tasks.workunit.client.0.smithi070.stdout:5/65: truncate d5/da/f11 3863291 0 2023-10-08T08:45:26.265 INFO:tasks.workunit.client.0.smithi070.stdout:4/63: unlink fa 0 2023-10-08T08:45:26.266 INFO:tasks.workunit.client.0.smithi070.stdout:5/66: creat d5/d13/f14 x:0 0 0 2023-10-08T08:45:26.266 INFO:tasks.workunit.client.0.smithi070.stdout:5/67: chown d5/le 369375929 1 2023-10-08T08:45:26.270 INFO:tasks.workunit.client.0.smithi070.stdout:2/70: dread fc [0,4194304] 0 2023-10-08T08:45:26.276 INFO:tasks.workunit.client.0.smithi070.stdout:4/64: dread dc/f10 [0,4194304] 0 2023-10-08T08:45:26.276 INFO:tasks.workunit.client.0.smithi070.stdout:4/65: creat dc/f13 x:0 0 0 2023-10-08T08:45:26.276 INFO:tasks.workunit.client.0.smithi070.stdout:2/71: dread fa [0,4194304] 0 2023-10-08T08:45:26.277 INFO:tasks.workunit.client.0.smithi070.stdout:2/72: creat df/d12/d15/f16 x:0 0 0 2023-10-08T08:45:26.278 INFO:tasks.workunit.client.0.smithi070.stdout:2/73: readlink df/l13 0 2023-10-08T08:45:26.278 INFO:tasks.workunit.client.0.smithi070.stdout:2/74: chown cd 43 1 2023-10-08T08:45:26.278 INFO:tasks.workunit.client.0.smithi070.stdout:2/75: creat df/d12/d15/f17 x:0 0 0 2023-10-08T08:45:26.278 INFO:tasks.workunit.client.0.smithi070.stdout:2/76: creat df/d12/d15/f18 x:0 0 0 2023-10-08T08:45:26.279 INFO:tasks.workunit.client.0.smithi070.stdout:2/77: symlink df/d12/l19 0 2023-10-08T08:45:26.283 INFO:tasks.workunit.client.0.smithi070.stdout:4/66: dread dc/f10 [0,4194304] 0 2023-10-08T08:45:26.284 INFO:tasks.workunit.client.0.smithi070.stdout:4/67: readlink dc/le 0 2023-10-08T08:45:26.285 INFO:tasks.workunit.client.0.smithi070.stdout:4/68: truncate dc/f10 1346712 0 2023-10-08T08:45:26.286 INFO:tasks.workunit.client.0.smithi070.stdout:4/69: fsync dc/ff 0 2023-10-08T08:45:26.286 INFO:tasks.workunit.client.0.smithi070.stdout:4/70: truncate dc/f11 991682 0 2023-10-08T08:45:26.289 INFO:tasks.workunit.client.0.smithi070.stdout:4/71: symlink dc/l14 0 2023-10-08T08:45:26.289 INFO:tasks.workunit.client.0.smithi070.stdout:4/72: creat dc/f15 x:0 0 0 2023-10-08T08:45:26.299 INFO:tasks.workunit.client.0.smithi070.stdout:5/68: write f0 [2135409,5215] 0 2023-10-08T08:45:26.300 INFO:tasks.workunit.client.0.smithi070.stdout:7/90: dwrite d3/f12 [0,4194304] 0 2023-10-08T08:45:26.301 INFO:tasks.workunit.client.0.smithi070.stdout:5/69: rename d5/da/f10 to d5/da/f15 0 2023-10-08T08:45:26.315 INFO:tasks.workunit.client.0.smithi070.stdout:5/70: dread d5/fc [0,4194304] 0 2023-10-08T08:45:26.316 INFO:tasks.workunit.client.0.smithi070.stdout:2/78: dwrite df/f11 [0,4194304] 0 2023-10-08T08:45:26.317 INFO:tasks.workunit.client.0.smithi070.stdout:5/71: write d5/fc [341911,113960] 0 2023-10-08T08:45:26.317 INFO:tasks.workunit.client.0.smithi070.stdout:5/72: chown d5/f9 945932037 1 2023-10-08T08:45:26.320 INFO:tasks.workunit.client.0.smithi070.stdout:4/73: dwrite f6 [0,4194304] 0 2023-10-08T08:45:26.320 INFO:tasks.workunit.client.0.smithi070.stdout:2/79: mkdir df/d12/d15/d1a 0 2023-10-08T08:45:26.320 INFO:tasks.workunit.client.0.smithi070.stdout:2/80: chown l1 7844711 1 2023-10-08T08:45:26.321 INFO:tasks.workunit.client.0.smithi070.stdout:5/73: creat d5/da/f16 x:0 0 0 2023-10-08T08:45:26.321 INFO:tasks.workunit.client.0.smithi070.stdout:7/91: dwrite d3/f6 [0,4194304] 0 2023-10-08T08:45:26.329 INFO:tasks.workunit.client.0.smithi070.stdout:2/81: getdents df/d12/d15 0 2023-10-08T08:45:26.331 INFO:tasks.workunit.client.0.smithi070.stdout:4/74: rmdir dc 39 2023-10-08T08:45:26.333 INFO:tasks.workunit.client.0.smithi070.stdout:5/74: truncate d5/fc 1538757 0 2023-10-08T08:45:26.335 INFO:tasks.workunit.client.0.smithi070.stdout:2/82: mkdir df/d12/d1b 0 2023-10-08T08:45:26.335 INFO:tasks.workunit.client.0.smithi070.stdout:2/83: fdatasync df/d12/d15/f16 0 2023-10-08T08:45:26.336 INFO:tasks.workunit.client.0.smithi070.stdout:4/75: creat dc/f16 x:0 0 0 2023-10-08T08:45:26.336 INFO:tasks.workunit.client.0.smithi070.stdout:4/76: read dc/f11 [736602,4702] 0 2023-10-08T08:45:26.336 INFO:tasks.workunit.client.0.smithi070.stdout:4/77: readlink dc/le 0 2023-10-08T08:45:26.339 INFO:tasks.workunit.client.0.smithi070.stdout:4/78: mkdir dc/d17 0 2023-10-08T08:45:26.342 INFO:tasks.workunit.client.0.smithi070.stdout:2/84: dread fb [0,4194304] 0 2023-10-08T08:45:26.343 INFO:tasks.workunit.client.0.smithi070.stdout:2/85: mkdir df/d12/d1b/d1c 0 2023-10-08T08:45:26.343 INFO:tasks.workunit.client.0.smithi070.stdout:2/86: fsync df/d12/d15/f17 0 2023-10-08T08:45:26.344 INFO:tasks.workunit.client.0.smithi070.stdout:2/87: symlink df/d12/d15/d1a/l1d 0 2023-10-08T08:45:26.345 INFO:tasks.workunit.client.0.smithi070.stdout:7/92: dwrite d3/f12 [0,4194304] 0 2023-10-08T08:45:26.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/79: write dc/f12 [2932125,100801] 0 2023-10-08T08:45:26.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/80: chown dc/le 899 1 2023-10-08T08:45:26.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/81: dread - dc/f16 zero size 2023-10-08T08:45:26.347 INFO:tasks.workunit.client.0.smithi070.stdout:5/75: dread d5/fc [0,4194304] 0 2023-10-08T08:45:26.347 INFO:tasks.workunit.client.0.smithi070.stdout:5/76: chown d5/da/f15 16 1 2023-10-08T08:45:26.349 INFO:tasks.workunit.client.0.smithi070.stdout:5/77: symlink d5/da/l17 0 2023-10-08T08:45:26.350 INFO:tasks.workunit.client.0.smithi070.stdout:4/82: rename dc/f16 to dc/f18 0 2023-10-08T08:45:26.351 INFO:tasks.workunit.client.0.smithi070.stdout:4/83: mknod dc/d17/c19 0 2023-10-08T08:45:26.351 INFO:tasks.workunit.client.0.smithi070.stdout:4/84: write dc/f12 [4207801,120687] 0 2023-10-08T08:45:26.355 INFO:tasks.workunit.client.0.smithi070.stdout:8/124: sync 2023-10-08T08:45:26.355 INFO:tasks.workunit.client.0.smithi070.stdout:0/141: sync 2023-10-08T08:45:26.355 INFO:tasks.workunit.client.0.smithi070.stdout:3/41: sync 2023-10-08T08:45:26.356 INFO:tasks.workunit.client.0.smithi070.stdout:8/125: mknod d1/de/d1a/c2c 0 2023-10-08T08:45:26.356 INFO:tasks.workunit.client.0.smithi070.stdout:3/42: mkdir d0/db/d10 0 2023-10-08T08:45:26.357 INFO:tasks.workunit.client.0.smithi070.stdout:3/43: write d0/f8 [851117,107089] 0 2023-10-08T08:45:26.357 INFO:tasks.workunit.client.0.smithi070.stdout:8/126: creat d1/d2/f2d x:0 0 0 2023-10-08T08:45:26.361 INFO:tasks.workunit.client.0.smithi070.stdout:2/88: dread fc [0,4194304] 0 2023-10-08T08:45:26.361 INFO:tasks.workunit.client.0.smithi070.stdout:2/89: readlink l4 0 2023-10-08T08:45:26.361 INFO:tasks.workunit.client.0.smithi070.stdout:2/90: dread - df/d12/d15/f16 zero size 2023-10-08T08:45:26.362 INFO:tasks.workunit.client.0.smithi070.stdout:2/91: dread - df/d12/d15/f17 zero size 2023-10-08T08:45:26.362 INFO:tasks.workunit.client.0.smithi070.stdout:2/92: chown df/l13 1641351147 1 2023-10-08T08:45:26.362 INFO:tasks.workunit.client.0.smithi070.stdout:8/127: rmdir d1/de 39 2023-10-08T08:45:26.371 INFO:tasks.workunit.client.0.smithi070.stdout:3/44: dread d0/f1 [0,4194304] 0 2023-10-08T08:45:26.371 INFO:tasks.workunit.client.0.smithi070.stdout:3/45: getdents d0/db/d10 0 2023-10-08T08:45:26.371 INFO:tasks.workunit.client.0.smithi070.stdout:3/46: readlink d0/db/lf 0 2023-10-08T08:45:26.372 INFO:tasks.workunit.client.0.smithi070.stdout:8/128: write f0 [6323388,925] 0 2023-10-08T08:45:26.376 INFO:tasks.workunit.client.0.smithi070.stdout:0/142: dread d1/f6 [0,4194304] 0 2023-10-08T08:45:26.379 INFO:tasks.workunit.client.0.smithi070.stdout:3/47: dread d0/f1 [0,4194304] 0 2023-10-08T08:45:26.382 INFO:tasks.workunit.client.0.smithi070.stdout:4/85: dwrite dc/f11 [0,4194304] 0 2023-10-08T08:45:26.382 INFO:tasks.workunit.client.0.smithi070.stdout:5/78: dwrite d5/fc [0,4194304] 0 2023-10-08T08:45:26.382 INFO:tasks.workunit.client.0.smithi070.stdout:5/79: fdatasync d5/f7 0 2023-10-08T08:45:26.382 INFO:tasks.workunit.client.0.smithi070.stdout:2/93: dread fc [0,4194304] 0 2023-10-08T08:45:26.383 INFO:tasks.workunit.client.0.smithi070.stdout:3/48: link d0/f2 d0/db/f11 0 2023-10-08T08:45:26.387 INFO:tasks.workunit.client.0.smithi070.stdout:4/86: unlink dc/d17/c19 0 2023-10-08T08:45:26.389 INFO:tasks.workunit.client.0.smithi070.stdout:5/80: rename d5/le to d5/d13/l18 0 2023-10-08T08:45:26.390 INFO:tasks.workunit.client.0.smithi070.stdout:2/94: creat df/d12/d1b/f1e x:0 0 0 2023-10-08T08:45:26.393 INFO:tasks.workunit.client.0.smithi070.stdout:8/129: dwrite d1/d2/d6/d22/f2b [0,4194304] 0 2023-10-08T08:45:26.394 INFO:tasks.workunit.client.0.smithi070.stdout:3/49: mkdir d0/d12 0 2023-10-08T08:45:26.394 INFO:tasks.workunit.client.0.smithi070.stdout:0/143: dread d1/dd/f13 [0,4194304] 0 2023-10-08T08:45:26.394 INFO:tasks.workunit.client.0.smithi070.stdout:4/87: symlink dc/d17/l1a 0 2023-10-08T08:45:26.394 INFO:tasks.workunit.client.0.smithi070.stdout:2/95: creat df/d12/f1f x:0 0 0 2023-10-08T08:45:26.395 INFO:tasks.workunit.client.0.smithi070.stdout:8/130: dread d1/d2/d6/f14 [0,4194304] 0 2023-10-08T08:45:26.396 INFO:tasks.workunit.client.0.smithi070.stdout:2/96: link fa df/f20 0 2023-10-08T08:45:26.398 INFO:tasks.workunit.client.0.smithi070.stdout:8/131: mkdir d1/de/d2e 0 2023-10-08T08:45:26.398 INFO:tasks.workunit.client.0.smithi070.stdout:8/132: write d1/f24 [357980,87404] 0 2023-10-08T08:45:26.399 INFO:tasks.workunit.client.0.smithi070.stdout:2/97: symlink df/d12/d1b/d1c/l21 0 2023-10-08T08:45:26.399 INFO:tasks.workunit.client.0.smithi070.stdout:2/98: read - df/d12/d15/f17 zero size 2023-10-08T08:45:26.400 INFO:tasks.workunit.client.0.smithi070.stdout:5/81: getdents d5 0 2023-10-08T08:45:26.400 INFO:tasks.workunit.client.0.smithi070.stdout:5/82: readlink d5/d13/l18 0 2023-10-08T08:45:26.404 INFO:tasks.workunit.client.0.smithi070.stdout:4/88: rmdir dc 39 2023-10-08T08:45:26.404 INFO:tasks.workunit.client.0.smithi070.stdout:0/144: dread d1/dd/f18 [0,4194304] 0 2023-10-08T08:45:26.405 INFO:tasks.workunit.client.0.smithi070.stdout:2/99: mknod df/d12/d1b/d1c/c22 0 2023-10-08T08:45:26.406 INFO:tasks.workunit.client.0.smithi070.stdout:5/83: unlink f0 0 2023-10-08T08:45:26.407 INFO:tasks.workunit.client.0.smithi070.stdout:4/89: mkdir dc/d17/d1b 0 2023-10-08T08:45:26.408 INFO:tasks.workunit.client.0.smithi070.stdout:0/145: symlink d1/d14/d1c/l26 0 2023-10-08T08:45:26.408 INFO:tasks.workunit.client.0.smithi070.stdout:0/146: readlink d1/dd/l10 0 2023-10-08T08:45:26.409 INFO:tasks.workunit.client.0.smithi070.stdout:8/133: getdents d1/d2 0 2023-10-08T08:45:26.410 INFO:tasks.workunit.client.0.smithi070.stdout:2/100: rename df/d12/d15/d1a to df/d12/d15/d23 0 2023-10-08T08:45:26.411 INFO:tasks.workunit.client.0.smithi070.stdout:5/84: creat d5/f19 x:0 0 0 2023-10-08T08:45:26.412 INFO:tasks.workunit.client.0.smithi070.stdout:4/90: unlink dc/l14 0 2023-10-08T08:45:26.413 INFO:tasks.workunit.client.0.smithi070.stdout:0/147: creat d1/dd/d1b/f27 x:0 0 0 2023-10-08T08:45:26.414 INFO:tasks.workunit.client.0.smithi070.stdout:8/134: symlink d1/d23/l2f 0 2023-10-08T08:45:26.414 INFO:tasks.workunit.client.0.smithi070.stdout:8/135: read - d1/d23/f28 zero size 2023-10-08T08:45:26.414 INFO:tasks.workunit.client.0.smithi070.stdout:0/148: read d1/dd/f25 [4330769,70643] 0 2023-10-08T08:45:26.415 INFO:tasks.workunit.client.0.smithi070.stdout:2/101: unlink df/d12/d15/d23/l1d 0 2023-10-08T08:45:26.415 INFO:tasks.workunit.client.0.smithi070.stdout:5/85: symlink d5/da/l1a 0 2023-10-08T08:45:26.416 INFO:tasks.workunit.client.0.smithi070.stdout:4/91: rmdir dc/d17/d1b 0 2023-10-08T08:45:26.417 INFO:tasks.workunit.client.0.smithi070.stdout:8/136: symlink d1/de/d2e/l30 0 2023-10-08T08:45:26.419 INFO:tasks.workunit.client.0.smithi070.stdout:5/86: unlink d5/da/f12 0 2023-10-08T08:45:26.420 INFO:tasks.workunit.client.0.smithi070.stdout:4/92: symlink dc/d17/l1c 0 2023-10-08T08:45:26.422 INFO:tasks.workunit.client.0.smithi070.stdout:8/137: creat d1/d2/f31 x:0 0 0 2023-10-08T08:45:26.425 INFO:tasks.workunit.client.0.smithi070.stdout:8/138: mknod d1/d2/d6/d22/c32 0 2023-10-08T08:45:26.430 INFO:tasks.workunit.client.0.smithi070.stdout:2/102: getdents df/d12/d15/d23 0 2023-10-08T08:45:26.430 INFO:tasks.workunit.client.0.smithi070.stdout:8/139: unlink d1/de/f25 0 2023-10-08T08:45:26.430 INFO:tasks.workunit.client.0.smithi070.stdout:2/103: truncate df/d12/d15/f16 500217 0 2023-10-08T08:45:26.432 INFO:tasks.workunit.client.0.smithi070.stdout:8/140: creat d1/d2/d6/d22/f33 x:0 0 0 2023-10-08T08:45:26.432 INFO:tasks.workunit.client.0.smithi070.stdout:8/141: truncate d1/d2/f2d 138085 0 2023-10-08T08:45:26.433 INFO:tasks.workunit.client.0.smithi070.stdout:2/104: write fc [937281,90250] 0 2023-10-08T08:45:26.437 INFO:tasks.workunit.client.0.smithi070.stdout:2/105: read fb [290777,118996] 0 2023-10-08T08:45:26.448 INFO:tasks.workunit.client.0.smithi070.stdout:4/93: dread dc/ff [0,4194304] 0 2023-10-08T08:45:26.449 INFO:tasks.workunit.client.0.smithi070.stdout:0/149: dread d1/fa [0,4194304] 0 2023-10-08T08:45:26.449 INFO:tasks.workunit.client.0.smithi070.stdout:3/50: dread d0/f8 [0,4194304] 0 2023-10-08T08:45:26.449 INFO:tasks.workunit.client.0.smithi070.stdout:3/51: write d0/db/fd [62079,67287] 0 2023-10-08T08:45:26.450 INFO:tasks.workunit.client.0.smithi070.stdout:8/142: dread d1/d2/f17 [0,4194304] 0 2023-10-08T08:45:26.450 INFO:tasks.workunit.client.0.smithi070.stdout:5/87: dwrite d5/da/f16 [0,4194304] 0 2023-10-08T08:45:26.450 INFO:tasks.workunit.client.0.smithi070.stdout:5/88: write d5/f19 [782277,76602] 0 2023-10-08T08:45:26.450 INFO:tasks.workunit.client.0.smithi070.stdout:4/94: write dc/f12 [1581672,78241] 0 2023-10-08T08:45:26.451 INFO:tasks.workunit.client.0.smithi070.stdout:4/95: chown cb 2314681 1 2023-10-08T08:45:26.455 INFO:tasks.workunit.client.0.smithi070.stdout:3/52: stat d0/c7 0 2023-10-08T08:45:26.459 INFO:tasks.workunit.client.0.smithi070.stdout:8/143: truncate d1/d2/d6/fa 173014 0 2023-10-08T08:45:26.459 INFO:tasks.workunit.client.0.smithi070.stdout:5/89: chown d5/da/f11 239 1 2023-10-08T08:45:26.460 INFO:tasks.workunit.client.0.smithi070.stdout:4/96: creat dc/f1d x:0 0 0 2023-10-08T08:45:26.461 INFO:tasks.workunit.client.0.smithi070.stdout:8/144: read d1/d2/d6/f14 [72691,20741] 0 2023-10-08T08:45:26.461 INFO:tasks.workunit.client.0.smithi070.stdout:2/106: dwrite df/d12/d1b/f1e [0,4194304] 0 2023-10-08T08:45:26.461 INFO:tasks.workunit.client.0.smithi070.stdout:0/150: link d1/f5 d1/d14/d1f/f28 0 2023-10-08T08:45:26.463 INFO:tasks.workunit.client.0.smithi070.stdout:3/53: rename d0/db/f11 to d0/d12/f13 0 2023-10-08T08:45:26.465 INFO:tasks.workunit.client.0.smithi070.stdout:4/97: creat dc/f1e x:0 0 0 2023-10-08T08:45:26.465 INFO:tasks.workunit.client.0.smithi070.stdout:5/90: write d5/da/f15 [583151,115465] 0 2023-10-08T08:45:26.466 INFO:tasks.workunit.client.0.smithi070.stdout:8/145: creat d1/de/f34 x:0 0 0 2023-10-08T08:45:26.467 INFO:tasks.workunit.client.0.smithi070.stdout:1/91: sync 2023-10-08T08:45:26.467 INFO:tasks.workunit.client.0.smithi070.stdout:9/76: sync 2023-10-08T08:45:26.469 INFO:tasks.workunit.client.0.smithi070.stdout:2/107: symlink df/l24 0 2023-10-08T08:45:26.469 INFO:tasks.workunit.client.0.smithi070.stdout:2/108: chown df/l24 4511 1 2023-10-08T08:45:26.469 INFO:tasks.workunit.client.0.smithi070.stdout:0/151: getdents d1/d14/d1c 0 2023-10-08T08:45:26.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:26 smithi070 ceph-mon[99513]: pgmap v340: 129 pgs: 129 active+clean; 93 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.4 MiB/s wr, 1.81k op/s 2023-10-08T08:45:26.470 INFO:tasks.workunit.client.0.smithi070.stdout:3/54: mkdir d0/d12/d14 0 2023-10-08T08:45:26.475 INFO:tasks.workunit.client.0.smithi070.stdout:4/98: truncate dc/ff 1484807 0 2023-10-08T08:45:26.475 INFO:tasks.workunit.client.0.smithi070.stdout:4/99: dread - dc/f1d zero size 2023-10-08T08:45:26.477 INFO:tasks.workunit.client.0.smithi070.stdout:1/92: symlink d6/l1a 0 2023-10-08T08:45:26.478 INFO:tasks.workunit.client.0.smithi070.stdout:2/109: rename df/d12/d15/d23 to df/d12/d25 0 2023-10-08T08:45:26.479 INFO:tasks.workunit.client.0.smithi070.stdout:8/146: dread d1/fb [4194304,4194304] 0 2023-10-08T08:45:26.480 INFO:tasks.workunit.client.0.smithi070.stdout:0/152: symlink d1/d1d/d24/l29 0 2023-10-08T08:45:26.482 INFO:tasks.workunit.client.0.smithi070.stdout:3/55: creat d0/db/f15 x:0 0 0 2023-10-08T08:45:26.485 INFO:tasks.workunit.client.0.smithi070.stdout:0/153: dread d1/d14/d1f/f1a [0,4194304] 0 2023-10-08T08:45:26.485 INFO:tasks.workunit.client.0.smithi070.stdout:0/154: truncate d1/d14/d1f/f1a 1786065 0 2023-10-08T08:45:26.485 INFO:tasks.workunit.client.0.smithi070.stdout:5/91: getdents d5 0 2023-10-08T08:45:26.485 INFO:tasks.workunit.client.0.smithi070.stdout:1/93: creat d6/f1b x:0 0 0 2023-10-08T08:45:26.485 INFO:tasks.workunit.client.0.smithi070.stdout:1/94: fsync f5 0 2023-10-08T08:45:26.486 INFO:tasks.workunit.client.0.smithi070.stdout:2/110: creat df/d12/d1b/d1c/f26 x:0 0 0 2023-10-08T08:45:26.487 INFO:tasks.workunit.client.0.smithi070.stdout:3/56: symlink d0/db/d10/l16 0 2023-10-08T08:45:26.488 INFO:tasks.workunit.client.0.smithi070.stdout:2/111: write df/d12/d1b/f1e [2050509,32346] 0 2023-10-08T08:45:26.488 INFO:tasks.workunit.client.0.smithi070.stdout:2/112: write df/d12/d15/f18 [737697,7246] 0 2023-10-08T08:45:26.489 INFO:tasks.workunit.client.0.smithi070.stdout:2/113: write df/d12/d15/f17 [334007,118724] 0 2023-10-08T08:45:26.489 INFO:tasks.workunit.client.0.smithi070.stdout:8/147: dread d1/fb [0,4194304] 0 2023-10-08T08:45:26.489 INFO:tasks.workunit.client.0.smithi070.stdout:8/148: chown d1/d2/d6/d22/c27 52441493 1 2023-10-08T08:45:26.490 INFO:tasks.workunit.client.0.smithi070.stdout:0/155: rmdir d1/d14/d1f 39 2023-10-08T08:45:26.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/149: read d1/fb [4601751,34617] 0 2023-10-08T08:45:26.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/150: chown d1/de/f34 386 1 2023-10-08T08:45:26.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/151: write d1/d2/d6/f14 [1304251,63591] 0 2023-10-08T08:45:26.490 INFO:tasks.workunit.client.0.smithi070.stdout:3/57: write d0/f1 [4558178,38861] 0 2023-10-08T08:45:26.490 INFO:tasks.workunit.client.0.smithi070.stdout:3/58: write d0/f8 [1684805,32038] 0 2023-10-08T08:45:26.491 INFO:tasks.workunit.client.0.smithi070.stdout:1/95: stat d6/lf 0 2023-10-08T08:45:26.491 INFO:tasks.workunit.client.0.smithi070.stdout:1/96: write d6/f18 [4853165,9188] 0 2023-10-08T08:45:26.491 INFO:tasks.workunit.client.0.smithi070.stdout:1/97: chown d6/dc 626 1 2023-10-08T08:45:26.497 INFO:tasks.workunit.client.0.smithi070.stdout:0/156: truncate d1/dd/f18 1751311 0 2023-10-08T08:45:26.497 INFO:tasks.workunit.client.0.smithi070.stdout:8/152: creat d1/de/d21/f35 x:0 0 0 2023-10-08T08:45:26.498 INFO:tasks.workunit.client.0.smithi070.stdout:2/114: symlink df/d12/d1b/l27 0 2023-10-08T08:45:26.498 INFO:tasks.workunit.client.0.smithi070.stdout:9/77: dwrite d1/dd/f10 [0,4194304] 0 2023-10-08T08:45:26.498 INFO:tasks.workunit.client.0.smithi070.stdout:1/98: mknod d6/c1c 0 2023-10-08T08:45:26.500 INFO:tasks.workunit.client.0.smithi070.stdout:1/99: read d6/f18 [2831704,104554] 0 2023-10-08T08:45:26.503 INFO:tasks.workunit.client.0.smithi070.stdout:5/92: rename d5/da/l17 to d5/da/l1b 0 2023-10-08T08:45:26.504 INFO:tasks.workunit.client.0.smithi070.stdout:8/153: symlink d1/de/d1a/l36 0 2023-10-08T08:45:26.514 INFO:tasks.workunit.client.0.smithi070.stdout:1/100: truncate d6/dc/f13 628130 0 2023-10-08T08:45:26.515 INFO:tasks.workunit.client.0.smithi070.stdout:3/59: dwrite d0/db/fd [0,4194304] 0 2023-10-08T08:45:26.515 INFO:tasks.workunit.client.0.smithi070.stdout:8/154: getdents d1/de/d15 0 2023-10-08T08:45:26.516 INFO:tasks.workunit.client.0.smithi070.stdout:1/101: creat d6/dc/f1d x:0 0 0 2023-10-08T08:45:26.516 INFO:tasks.workunit.client.0.smithi070.stdout:1/102: write d6/f12 [606569,6060] 0 2023-10-08T08:45:26.517 INFO:tasks.workunit.client.0.smithi070.stdout:5/93: symlink d5/da/l1c 0 2023-10-08T08:45:26.517 INFO:tasks.workunit.client.0.smithi070.stdout:5/94: truncate d5/da/f11 4870702 0 2023-10-08T08:45:26.519 INFO:tasks.workunit.client.0.smithi070.stdout:3/60: mknod d0/db/d10/c17 0 2023-10-08T08:45:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:26 smithi105 ceph-mon[103798]: pgmap v340: 129 pgs: 129 active+clean; 93 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.4 MiB/s wr, 1.81k op/s 2023-10-08T08:45:26.520 INFO:tasks.workunit.client.0.smithi070.stdout:8/155: creat d1/de/f37 x:0 0 0 2023-10-08T08:45:26.521 INFO:tasks.workunit.client.0.smithi070.stdout:8/156: write d1/fb [8852913,55776] 0 2023-10-08T08:45:26.521 INFO:tasks.workunit.client.0.smithi070.stdout:8/157: readlink d1/d2/l4 0 2023-10-08T08:45:26.522 INFO:tasks.workunit.client.0.smithi070.stdout:5/95: symlink d5/da/l1d 0 2023-10-08T08:45:26.525 INFO:tasks.workunit.client.0.smithi070.stdout:9/78: dwrite d1/dd/d19/f1b [0,4194304] 0 2023-10-08T08:45:26.525 INFO:tasks.workunit.client.0.smithi070.stdout:9/79: fsync d1/dd/d1a/f1c 0 2023-10-08T08:45:26.526 INFO:tasks.workunit.client.0.smithi070.stdout:0/157: dwrite d1/f5 [4194304,4194304] 0 2023-10-08T08:45:26.526 INFO:tasks.workunit.client.0.smithi070.stdout:0/158: fsync d1/f11 0 2023-10-08T08:45:26.527 INFO:tasks.workunit.client.0.smithi070.stdout:0/159: chown d1/d1d 1183 1 2023-10-08T08:45:26.530 INFO:tasks.workunit.client.0.smithi070.stdout:9/80: readlink d1/l3 0 2023-10-08T08:45:26.534 INFO:tasks.workunit.client.0.smithi070.stdout:2/115: dwrite fa [0,4194304] 0 2023-10-08T08:45:26.534 INFO:tasks.workunit.client.0.smithi070.stdout:2/116: stat df/d12/d15/f18 0 2023-10-08T08:45:26.536 INFO:tasks.workunit.client.0.smithi070.stdout:9/81: mknod d1/dd/d1a/c21 0 2023-10-08T08:45:26.537 INFO:tasks.workunit.client.0.smithi070.stdout:9/82: write d1/dd/d19/f1e [718589,36261] 0 2023-10-08T08:45:26.537 INFO:tasks.workunit.client.0.smithi070.stdout:9/83: stat d1/dd/f11 0 2023-10-08T08:45:26.537 INFO:tasks.workunit.client.0.smithi070.stdout:9/84: chown d1/fb 81 1 2023-10-08T08:45:26.537 INFO:tasks.workunit.client.0.smithi070.stdout:9/85: dread - d1/dd/d1a/f1d zero size 2023-10-08T08:45:26.541 INFO:tasks.workunit.client.0.smithi070.stdout:2/117: symlink df/d12/d1b/d1c/l28 0 2023-10-08T08:45:26.545 INFO:tasks.workunit.client.0.smithi070.stdout:5/96: dread d5/da/f11 [0,4194304] 0 2023-10-08T08:45:26.545 INFO:tasks.workunit.client.0.smithi070.stdout:5/97: truncate d5/d13/f14 563442 0 2023-10-08T08:45:26.546 INFO:tasks.workunit.client.0.smithi070.stdout:8/158: dwrite d1/d2/d6/f14 [0,4194304] 0 2023-10-08T08:45:26.546 INFO:tasks.workunit.client.0.smithi070.stdout:8/159: chown d1/d2/d6 7 1 2023-10-08T08:45:26.546 INFO:tasks.workunit.client.0.smithi070.stdout:8/160: read - d1/de/f37 zero size 2023-10-08T08:45:26.546 INFO:tasks.workunit.client.0.smithi070.stdout:5/98: creat d5/d13/f1e x:0 0 0 2023-10-08T08:45:26.546 INFO:tasks.workunit.client.0.smithi070.stdout:8/161: dread d1/d2/f2d [0,4194304] 0 2023-10-08T08:45:26.547 INFO:tasks.workunit.client.0.smithi070.stdout:2/118: write df/f11 [464483,102130] 0 2023-10-08T08:45:26.549 INFO:tasks.workunit.client.0.smithi070.stdout:5/99: unlink d5/f7 0 2023-10-08T08:45:26.551 INFO:tasks.workunit.client.0.smithi070.stdout:2/119: symlink df/l29 0 2023-10-08T08:45:26.563 INFO:tasks.workunit.client.0.smithi070.stdout:6/81: sync 2023-10-08T08:45:26.565 INFO:tasks.workunit.client.0.smithi070.stdout:6/82: creat df/f1c x:0 0 0 2023-10-08T08:45:26.565 INFO:tasks.workunit.client.0.smithi070.stdout:6/83: readlink l6 0 2023-10-08T08:45:26.566 INFO:tasks.workunit.client.0.smithi070.stdout:8/162: dread d1/de/d1a/f1b [0,4194304] 0 2023-10-08T08:45:26.566 INFO:tasks.workunit.client.0.smithi070.stdout:8/163: truncate d1/de/f34 127528 0 2023-10-08T08:45:26.566 INFO:tasks.workunit.client.0.smithi070.stdout:6/84: mkdir df/d11/d1d 0 2023-10-08T08:45:26.570 INFO:tasks.workunit.client.0.smithi070.stdout:8/164: symlink d1/d2/l38 0 2023-10-08T08:45:26.571 INFO:tasks.workunit.client.0.smithi070.stdout:3/61: dwrite d0/d12/f13 [0,4194304] 0 2023-10-08T08:45:26.571 INFO:tasks.workunit.client.0.smithi070.stdout:8/165: mknod d1/d2/c39 0 2023-10-08T08:45:26.572 INFO:tasks.workunit.client.0.smithi070.stdout:3/62: creat d0/db/f18 x:0 0 0 2023-10-08T08:45:26.573 INFO:tasks.workunit.client.0.smithi070.stdout:0/160: dwrite d1/dd/f16 [0,4194304] 0 2023-10-08T08:45:26.573 INFO:tasks.workunit.client.0.smithi070.stdout:0/161: fsync d1/f5 0 2023-10-08T08:45:26.573 INFO:tasks.workunit.client.0.smithi070.stdout:0/162: readlink d1/dd/l10 0 2023-10-08T08:45:26.574 INFO:tasks.workunit.client.0.smithi070.stdout:8/166: mkdir d1/de/d3a 0 2023-10-08T08:45:26.576 INFO:tasks.workunit.client.0.smithi070.stdout:8/167: creat d1/d2/f3b x:0 0 0 2023-10-08T08:45:26.578 INFO:tasks.workunit.client.0.smithi070.stdout:8/168: mknod d1/d2/d6/c3c 0 2023-10-08T08:45:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:26 smithi191 ceph-mon[104220]: pgmap v340: 129 pgs: 129 active+clean; 93 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.4 MiB/s wr, 1.81k op/s 2023-10-08T08:45:26.597 INFO:tasks.workunit.client.0.smithi070.stdout:0/163: dwrite d1/dd/f25 [4194304,4194304] 0 2023-10-08T08:45:26.597 INFO:tasks.workunit.client.0.smithi070.stdout:0/164: stat d1/dd/l10 0 2023-10-08T08:45:26.646 INFO:tasks.workunit.client.0.smithi070.stdout:1/103: write d6/dc/f13 [82861,38710] 0 2023-10-08T08:45:26.646 INFO:tasks.workunit.client.0.smithi070.stdout:1/104: fsync d6/f10 0 2023-10-08T08:45:26.647 INFO:tasks.workunit.client.0.smithi070.stdout:1/105: write d6/f11 [5225267,77639] 0 2023-10-08T08:45:26.648 INFO:tasks.workunit.client.0.smithi070.stdout:1/106: creat d6/dc/f1e x:0 0 0 2023-10-08T08:45:26.658 INFO:tasks.workunit.client.0.smithi070.stdout:3/63: dread d0/d12/f13 [0,4194304] 0 2023-10-08T08:45:26.659 INFO:tasks.workunit.client.0.smithi070.stdout:6/85: dwrite df/f17 [0,4194304] 0 2023-10-08T08:45:26.659 INFO:tasks.workunit.client.0.smithi070.stdout:2/120: dwrite df/d12/d15/f18 [0,4194304] 0 2023-10-08T08:45:26.659 INFO:tasks.workunit.client.0.smithi070.stdout:5/100: dwrite d5/ff [0,4194304] 0 2023-10-08T08:45:26.663 INFO:tasks.workunit.client.0.smithi070.stdout:6/86: truncate f5 730923 0 2023-10-08T08:45:26.664 INFO:tasks.workunit.client.0.smithi070.stdout:2/121: creat df/d12/d25/f2a x:0 0 0 2023-10-08T08:45:26.665 INFO:tasks.workunit.client.0.smithi070.stdout:5/101: creat d5/da/f1f x:0 0 0 2023-10-08T08:45:26.670 INFO:tasks.workunit.client.0.smithi070.stdout:2/122: symlink df/d12/d25/l2b 0 2023-10-08T08:45:26.670 INFO:tasks.workunit.client.0.smithi070.stdout:1/107: dread d6/f11 [0,4194304] 0 2023-10-08T08:45:26.672 INFO:tasks.workunit.client.0.smithi070.stdout:6/87: truncate df/f17 1388459 0 2023-10-08T08:45:26.673 INFO:tasks.workunit.client.0.smithi070.stdout:1/108: mkdir d6/dc/d14/d1f 0 2023-10-08T08:45:26.675 INFO:tasks.workunit.client.0.smithi070.stdout:5/102: symlink d5/da/l20 0 2023-10-08T08:45:26.675 INFO:tasks.workunit.client.0.smithi070.stdout:5/103: write d5/da/f1f [398576,30640] 0 2023-10-08T08:45:26.675 INFO:tasks.workunit.client.0.smithi070.stdout:6/88: mknod df/c1e 0 2023-10-08T08:45:26.676 INFO:tasks.workunit.client.0.smithi070.stdout:1/109: stat d6/ca 0 2023-10-08T08:45:26.677 INFO:tasks.workunit.client.0.smithi070.stdout:6/89: creat df/d11/d1d/f1f x:0 0 0 2023-10-08T08:45:26.678 INFO:tasks.workunit.client.0.smithi070.stdout:6/90: write df/f1c [1029027,112326] 0 2023-10-08T08:45:26.681 INFO:tasks.workunit.client.0.smithi070.stdout:1/110: truncate f5 196041 0 2023-10-08T08:45:26.681 INFO:tasks.workunit.client.0.smithi070.stdout:1/111: chown d6/f12 907820850 1 2023-10-08T08:45:26.683 INFO:tasks.workunit.client.0.smithi070.stdout:2/123: dread df/f11 [0,4194304] 0 2023-10-08T08:45:26.685 INFO:tasks.workunit.client.0.smithi070.stdout:2/124: mknod df/c2c 0 2023-10-08T08:45:26.685 INFO:tasks.workunit.client.0.smithi070.stdout:1/112: dread d6/f12 [0,4194304] 0 2023-10-08T08:45:26.687 INFO:tasks.workunit.client.0.smithi070.stdout:1/113: creat d6/f20 x:0 0 0 2023-10-08T08:45:26.688 INFO:tasks.workunit.client.0.smithi070.stdout:1/114: write d6/dc/f1e [452550,101767] 0 2023-10-08T08:45:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:2/125: dread fc [0,4194304] 0 2023-10-08T08:45:26.697 INFO:tasks.workunit.client.0.smithi070.stdout:2/126: mkdir df/d12/d1b/d1c/d2d 0 2023-10-08T08:45:26.718 INFO:tasks.workunit.client.0.smithi070.stdout:2/127: dwrite fb [0,4194304] 0 2023-10-08T08:45:26.721 INFO:tasks.workunit.client.0.smithi070.stdout:2/128: truncate df/d12/d1b/f1e 3164323 0 2023-10-08T08:45:26.721 INFO:tasks.workunit.client.0.smithi070.stdout:2/129: fdatasync df/d12/d15/f18 0 2023-10-08T08:45:26.723 INFO:tasks.workunit.client.0.smithi070.stdout:1/115: dwrite d6/f10 [4194304,4194304] 0 2023-10-08T08:45:26.725 INFO:tasks.workunit.client.0.smithi070.stdout:2/130: dread df/d12/d15/f17 [0,4194304] 0 2023-10-08T08:45:26.725 INFO:tasks.workunit.client.0.smithi070.stdout:2/131: chown df/d12/d25 10545 1 2023-10-08T08:45:26.726 INFO:tasks.workunit.client.0.smithi070.stdout:1/116: getdents d6 0 2023-10-08T08:45:26.726 INFO:tasks.workunit.client.0.smithi070.stdout:1/117: stat d6/dc/f1d 0 2023-10-08T08:45:26.726 INFO:tasks.workunit.client.0.smithi070.stdout:8/169: dwrite d1/d2/d6/d22/f2b [0,4194304] 0 2023-10-08T08:45:26.727 INFO:tasks.workunit.client.0.smithi070.stdout:2/132: mknod df/d12/d1b/d1c/c2e 0 2023-10-08T08:45:26.727 INFO:tasks.workunit.client.0.smithi070.stdout:2/133: stat df/f20 0 2023-10-08T08:45:26.727 INFO:tasks.workunit.client.0.smithi070.stdout:2/134: chown df/d12/d1b/d1c/l28 11240 1 2023-10-08T08:45:26.727 INFO:tasks.workunit.client.0.smithi070.stdout:2/135: truncate df/d12/d25/f2a 782651 0 2023-10-08T08:45:26.728 INFO:tasks.workunit.client.0.smithi070.stdout:2/136: chown df/d12 1861657 1 2023-10-08T08:45:26.730 INFO:tasks.workunit.client.0.smithi070.stdout:1/118: mknod d6/dc/c21 0 2023-10-08T08:45:26.730 INFO:tasks.workunit.client.0.smithi070.stdout:1/119: rename d6/dc to d6/dc/d14/d22 22 2023-10-08T08:45:26.731 INFO:tasks.workunit.client.0.smithi070.stdout:8/170: mknod d1/de/d2e/c3d 0 2023-10-08T08:45:26.732 INFO:tasks.workunit.client.0.smithi070.stdout:5/104: dread d5/ff [0,4194304] 0 2023-10-08T08:45:26.732 INFO:tasks.workunit.client.0.smithi070.stdout:5/105: dread - d5/d13/f1e zero size 2023-10-08T08:45:26.733 INFO:tasks.workunit.client.0.smithi070.stdout:1/120: unlink d6/lb 0 2023-10-08T08:45:26.733 INFO:tasks.workunit.client.0.smithi070.stdout:1/121: write d6/dc/f13 [1134278,51239] 0 2023-10-08T08:45:26.733 INFO:tasks.workunit.client.0.smithi070.stdout:8/171: symlink d1/de/d1a/l3e 0 2023-10-08T08:45:26.733 INFO:tasks.workunit.client.0.smithi070.stdout:8/172: dread - d1/d2/d6/d22/f33 zero size 2023-10-08T08:45:26.734 INFO:tasks.workunit.client.0.smithi070.stdout:6/91: dwrite df/f1c [0,4194304] 0 2023-10-08T08:45:26.735 INFO:tasks.workunit.client.0.smithi070.stdout:5/106: symlink d5/d13/l21 0 2023-10-08T08:45:26.735 INFO:tasks.workunit.client.0.smithi070.stdout:5/107: write d5/da/f15 [1333062,109732] 0 2023-10-08T08:45:26.736 INFO:tasks.workunit.client.0.smithi070.stdout:5/108: write d5/da/f11 [4036892,56664] 0 2023-10-08T08:45:26.736 INFO:tasks.workunit.client.0.smithi070.stdout:8/173: creat d1/de/d3a/f3f x:0 0 0 2023-10-08T08:45:26.736 INFO:tasks.workunit.client.0.smithi070.stdout:8/174: readlink d1/d2/d6/d22/l29 0 2023-10-08T08:45:26.737 INFO:tasks.workunit.client.0.smithi070.stdout:2/137: write df/d12/d1b/f1e [864018,99021] 0 2023-10-08T08:45:26.740 INFO:tasks.workunit.client.0.smithi070.stdout:7/93: sync 2023-10-08T08:45:26.740 INFO:tasks.workunit.client.0.smithi070.stdout:7/94: truncate d3/d7/fd 751056 0 2023-10-08T08:45:26.742 INFO:tasks.workunit.client.0.smithi070.stdout:8/175: creat d1/de/d15/f40 x:0 0 0 2023-10-08T08:45:26.742 INFO:tasks.workunit.client.0.smithi070.stdout:8/176: truncate d1/d2/d6/fa 512202 0 2023-10-08T08:45:26.743 INFO:tasks.workunit.client.0.smithi070.stdout:6/92: rmdir df/d11 39 2023-10-08T08:45:26.745 INFO:tasks.workunit.client.0.smithi070.stdout:2/138: symlink df/d12/d25/l2f 0 2023-10-08T08:45:26.748 INFO:tasks.workunit.client.0.smithi070.stdout:8/177: rename d1/de/d2e/c3d to d1/d2/d6/c41 0 2023-10-08T08:45:26.748 INFO:tasks.workunit.client.0.smithi070.stdout:2/139: rename df/d12/d15 to df/d12/d15/d30 22 2023-10-08T08:45:26.748 INFO:tasks.workunit.client.0.smithi070.stdout:8/178: dread - d1/de/f37 zero size 2023-10-08T08:45:26.748 INFO:tasks.workunit.client.0.smithi070.stdout:8/179: write d1/de/d15/f20 [643891,97785] 0 2023-10-08T08:45:26.748 INFO:tasks.workunit.client.0.smithi070.stdout:7/95: symlink d3/d7/d9/l1c 0 2023-10-08T08:45:26.750 INFO:tasks.workunit.client.0.smithi070.stdout:2/140: rmdir df/d12/d1b/d1c 39 2023-10-08T08:45:26.752 INFO:tasks.workunit.client.0.smithi070.stdout:7/96: link d3/d7/c11 d3/d19/d1a/c1d 0 2023-10-08T08:45:26.752 INFO:tasks.workunit.client.0.smithi070.stdout:7/97: write d3/d7/fd [379081,72609] 0 2023-10-08T08:45:26.753 INFO:tasks.workunit.client.0.smithi070.stdout:2/141: creat df/d12/d15/f31 x:0 0 0 2023-10-08T08:45:26.754 INFO:tasks.workunit.client.0.smithi070.stdout:7/98: unlink d3/d19/d1a/c1d 0 2023-10-08T08:45:26.757 INFO:tasks.workunit.client.0.smithi070.stdout:7/99: mkdir d3/d19/d1b/d1e 0 2023-10-08T08:45:26.778 INFO:tasks.workunit.client.0.smithi070.stdout:7/100: dwrite d3/d7/fd [0,4194304] 0 2023-10-08T08:45:26.778 INFO:tasks.workunit.client.0.smithi070.stdout:5/109: dread d5/fc [0,4194304] 0 2023-10-08T08:45:26.778 INFO:tasks.workunit.client.0.smithi070.stdout:8/180: dwrite d1/d2/f17 [0,4194304] 0 2023-10-08T08:45:26.779 INFO:tasks.workunit.client.0.smithi070.stdout:8/181: chown d1/de/f37 186 1 2023-10-08T08:45:26.779 INFO:tasks.workunit.client.0.smithi070.stdout:8/182: readlink d1/d2/lc 0 2023-10-08T08:45:26.781 INFO:tasks.workunit.client.0.smithi070.stdout:7/101: write d3/f12 [1702390,17087] 0 2023-10-08T08:45:26.781 INFO:tasks.workunit.client.0.smithi070.stdout:8/183: creat d1/de/d2e/f42 x:0 0 0 2023-10-08T08:45:26.783 INFO:tasks.workunit.client.0.smithi070.stdout:7/102: mknod d3/d19/d1a/c1f 0 2023-10-08T08:45:26.784 INFO:tasks.workunit.client.0.smithi070.stdout:6/93: dread df/f10 [0,4194304] 0 2023-10-08T08:45:26.784 INFO:tasks.workunit.client.0.smithi070.stdout:7/103: rmdir d3/d7 39 2023-10-08T08:45:26.787 INFO:tasks.workunit.client.0.smithi070.stdout:5/110: dread d5/f19 [0,4194304] 0 2023-10-08T08:45:26.789 INFO:tasks.workunit.client.0.smithi070.stdout:5/111: mkdir d5/da/d22 0 2023-10-08T08:45:26.790 INFO:tasks.workunit.client.0.smithi070.stdout:5/112: unlink d5/fc 0 2023-10-08T08:45:26.791 INFO:tasks.workunit.client.0.smithi070.stdout:5/113: truncate d5/d13/f14 242216 0 2023-10-08T08:45:26.791 INFO:tasks.workunit.client.0.smithi070.stdout:5/114: write d5/f9 [4709791,109872] 0 2023-10-08T08:45:26.791 INFO:tasks.workunit.client.0.smithi070.stdout:7/104: dread d3/d7/f8 [0,4194304] 0 2023-10-08T08:45:26.792 INFO:tasks.workunit.client.0.smithi070.stdout:5/115: fsync d5/da/f16 0 2023-10-08T08:45:26.792 INFO:tasks.workunit.client.0.smithi070.stdout:5/116: readlink d5/da/l1b 0 2023-10-08T08:45:26.793 INFO:tasks.workunit.client.0.smithi070.stdout:7/105: creat d3/d19/d1a/f20 x:0 0 0 2023-10-08T08:45:26.800 INFO:tasks.workunit.client.0.smithi070.stdout:6/94: dread f1 [0,4194304] 0 2023-10-08T08:45:26.801 INFO:tasks.workunit.client.0.smithi070.stdout:6/95: creat df/f20 x:0 0 0 2023-10-08T08:45:26.801 INFO:tasks.workunit.client.0.smithi070.stdout:6/96: write df/d11/d1d/f1f [109010,68963] 0 2023-10-08T08:45:26.802 INFO:tasks.workunit.client.0.smithi070.stdout:8/184: dwrite d1/d2/d6/f14 [0,4194304] 0 2023-10-08T08:45:26.802 INFO:tasks.workunit.client.0.smithi070.stdout:5/117: rmdir d5/d13 39 2023-10-08T08:45:26.806 INFO:tasks.workunit.client.0.smithi070.stdout:8/185: rmdir d1/de/d2e 39 2023-10-08T08:45:26.808 INFO:tasks.workunit.client.0.smithi070.stdout:5/118: rename d5/d13/f1e to d5/da/f23 0 2023-10-08T08:45:26.810 INFO:tasks.workunit.client.0.smithi070.stdout:5/119: creat d5/da/f24 x:0 0 0 2023-10-08T08:45:26.810 INFO:tasks.workunit.client.0.smithi070.stdout:5/120: read - d5/da/f23 zero size 2023-10-08T08:45:26.811 INFO:tasks.workunit.client.0.smithi070.stdout:5/121: mknod d5/c25 0 2023-10-08T08:45:26.814 INFO:tasks.workunit.client.0.smithi070.stdout:7/106: dread d3/f12 [0,4194304] 0 2023-10-08T08:45:26.816 INFO:tasks.workunit.client.0.smithi070.stdout:5/122: dread d5/f19 [0,4194304] 0 2023-10-08T08:45:26.817 INFO:tasks.workunit.client.0.smithi070.stdout:7/107: rename d3/f13 to d3/d7/f21 0 2023-10-08T08:45:26.819 INFO:tasks.workunit.client.0.smithi070.stdout:6/97: dread df/f10 [0,4194304] 0 2023-10-08T08:45:26.819 INFO:tasks.workunit.client.0.smithi070.stdout:5/123: link d5/da/f11 d5/f26 0 2023-10-08T08:45:26.820 INFO:tasks.workunit.client.0.smithi070.stdout:5/124: readlink d5/da/l1d 0 2023-10-08T08:45:26.820 INFO:tasks.workunit.client.0.smithi070.stdout:7/108: creat d3/d19/d1a/f22 x:0 0 0 2023-10-08T08:45:26.820 INFO:tasks.workunit.client.0.smithi070.stdout:7/109: stat d3/d7/d9/l1c 0 2023-10-08T08:45:26.820 INFO:tasks.workunit.client.0.smithi070.stdout:7/110: stat d3/d19/d1a/f22 0 2023-10-08T08:45:26.820 INFO:tasks.workunit.client.0.smithi070.stdout:6/98: symlink df/d11/d1d/l21 0 2023-10-08T08:45:26.821 INFO:tasks.workunit.client.0.smithi070.stdout:6/99: chown df/f20 613320 1 2023-10-08T08:45:26.821 INFO:tasks.workunit.client.0.smithi070.stdout:5/125: creat d5/da/f27 x:0 0 0 2023-10-08T08:45:26.822 INFO:tasks.workunit.client.0.smithi070.stdout:7/111: write d3/f12 [2535065,9356] 0 2023-10-08T08:45:26.822 INFO:tasks.workunit.client.0.smithi070.stdout:6/100: truncate f5 429431 0 2023-10-08T08:45:26.822 INFO:tasks.workunit.client.0.smithi070.stdout:6/101: chown df/c1e 25018 1 2023-10-08T08:45:26.823 INFO:tasks.workunit.client.0.smithi070.stdout:5/126: unlink d5/da/f27 0 2023-10-08T08:45:26.823 INFO:tasks.workunit.client.0.smithi070.stdout:4/100: sync 2023-10-08T08:45:26.823 INFO:tasks.workunit.client.0.smithi070.stdout:4/101: stat dc/f11 0 2023-10-08T08:45:26.823 INFO:tasks.workunit.client.0.smithi070.stdout:4/102: write dc/f18 [1040841,58069] 0 2023-10-08T08:45:26.824 INFO:tasks.workunit.client.0.smithi070.stdout:4/103: truncate dc/ff 2005262 0 2023-10-08T08:45:26.824 INFO:tasks.workunit.client.0.smithi070.stdout:4/104: fsync dc/f1e 0 2023-10-08T08:45:26.824 INFO:tasks.workunit.client.0.smithi070.stdout:7/112: mknod d3/d19/d1a/c23 0 2023-10-08T08:45:26.825 INFO:tasks.workunit.client.0.smithi070.stdout:8/186: dwrite d1/d23/f28 [0,4194304] 0 2023-10-08T08:45:26.826 INFO:tasks.workunit.client.0.smithi070.stdout:6/102: rename df/d11/c19 to df/d11/d1d/c22 0 2023-10-08T08:45:26.827 INFO:tasks.workunit.client.0.smithi070.stdout:5/127: truncate d5/da/f16 253183 0 2023-10-08T08:45:26.827 INFO:tasks.workunit.client.0.smithi070.stdout:5/128: dread - d5/da/f24 zero size 2023-10-08T08:45:26.828 INFO:tasks.workunit.client.0.smithi070.stdout:4/105: mkdir dc/d17/d1f 0 2023-10-08T08:45:26.828 INFO:tasks.workunit.client.0.smithi070.stdout:4/106: chown f9 1143 1 2023-10-08T08:45:26.828 INFO:tasks.workunit.client.0.smithi070.stdout:4/107: chown dc/d17/l1a 4323 1 2023-10-08T08:45:26.830 INFO:tasks.workunit.client.0.smithi070.stdout:7/113: unlink d3/f6 0 2023-10-08T08:45:26.833 INFO:tasks.workunit.client.0.smithi070.stdout:8/187: link d1/f24 d1/d23/f43 0 2023-10-08T08:45:26.833 INFO:tasks.workunit.client.0.smithi070.stdout:8/188: chown d1/de/d15/l16 0 1 2023-10-08T08:45:26.834 INFO:tasks.workunit.client.0.smithi070.stdout:6/103: creat df/f23 x:0 0 0 2023-10-08T08:45:26.835 INFO:tasks.workunit.client.0.smithi070.stdout:6/104: chown df/d11 201732 1 2023-10-08T08:45:26.835 INFO:tasks.workunit.client.0.smithi070.stdout:6/105: write df/f10 [5236521,37519] 0 2023-10-08T08:45:26.835 INFO:tasks.workunit.client.0.smithi070.stdout:5/129: mknod d5/da/d22/c28 0 2023-10-08T08:45:26.837 INFO:tasks.workunit.client.0.smithi070.stdout:4/108: link dc/f11 dc/d17/f20 0 2023-10-08T08:45:26.839 INFO:tasks.workunit.client.0.smithi070.stdout:7/114: link d3/ce d3/d19/d1a/c24 0 2023-10-08T08:45:26.841 INFO:tasks.workunit.client.0.smithi070.stdout:8/189: link d1/de/d1a/l36 d1/d23/l44 0 2023-10-08T08:45:26.852 INFO:tasks.workunit.client.0.smithi070.stdout:5/130: mkdir d5/da/d22/d29 0 2023-10-08T08:45:26.854 INFO:tasks.workunit.client.0.smithi070.stdout:4/109: creat dc/d17/f21 x:0 0 0 2023-10-08T08:45:26.855 INFO:tasks.workunit.client.0.smithi070.stdout:4/110: write dc/d17/f20 [4113954,2264] 0 2023-10-08T08:45:26.855 INFO:tasks.workunit.client.0.smithi070.stdout:7/115: creat d3/d7/f25 x:0 0 0 2023-10-08T08:45:26.855 INFO:tasks.workunit.client.0.smithi070.stdout:7/116: chown d3/d19 1 1 2023-10-08T08:45:26.856 INFO:tasks.workunit.client.0.smithi070.stdout:8/190: mkdir d1/de/d2e/d45 0 2023-10-08T08:45:26.856 INFO:tasks.workunit.client.0.smithi070.stdout:8/191: readlink d1/d2/l4 0 2023-10-08T08:45:26.857 INFO:tasks.workunit.client.0.smithi070.stdout:7/117: write d3/d7/f8 [1271320,70146] 0 2023-10-08T08:45:26.857 INFO:tasks.workunit.client.0.smithi070.stdout:6/106: rmdir df 39 2023-10-08T08:45:26.857 INFO:tasks.workunit.client.0.smithi070.stdout:7/118: rename d3/d19/d1b to d3/d19/d1b/d26 22 2023-10-08T08:45:26.857 INFO:tasks.workunit.client.0.smithi070.stdout:7/119: truncate d3/d7/f8 5010579 0 2023-10-08T08:45:26.858 INFO:tasks.workunit.client.0.smithi070.stdout:6/107: creat df/f24 x:0 0 0 2023-10-08T08:45:26.859 INFO:tasks.workunit.client.0.smithi070.stdout:7/120: symlink d3/l27 0 2023-10-08T08:45:26.862 INFO:tasks.workunit.client.0.smithi070.stdout:4/111: symlink dc/l22 0 2023-10-08T08:45:26.862 INFO:tasks.workunit.client.0.smithi070.stdout:4/112: readlink dc/l22 0 2023-10-08T08:45:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:4/113: creat dc/d17/f23 x:0 0 0 2023-10-08T08:45:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:4/114: truncate dc/f15 22579 0 2023-10-08T08:45:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:9/86: sync 2023-10-08T08:45:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:0/165: sync 2023-10-08T08:45:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:3/64: sync 2023-10-08T08:45:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:3/65: stat d0/ca 0 2023-10-08T08:45:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:3/66: dread - d0/db/f18 zero size 2023-10-08T08:45:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:3/67: truncate d0/db/f15 648033 0 2023-10-08T08:45:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:3/68: fsync d0/db/f15 0 2023-10-08T08:45:26.864 INFO:tasks.workunit.client.0.smithi070.stdout:7/121: dread d3/d7/f8 [4194304,4194304] 0 2023-10-08T08:45:26.865 INFO:tasks.workunit.client.0.smithi070.stdout:9/87: symlink d1/dd/l22 0 2023-10-08T08:45:26.865 INFO:tasks.workunit.client.0.smithi070.stdout:0/166: rename d1/d1d/d24/l29 to d1/d1d/d24/l2a 0 2023-10-08T08:45:26.867 INFO:tasks.workunit.client.0.smithi070.stdout:3/69: mknod d0/c19 0 2023-10-08T08:45:26.869 INFO:tasks.workunit.client.0.smithi070.stdout:7/122: mknod d3/d19/d1a/c28 0 2023-10-08T08:45:26.869 INFO:tasks.workunit.client.0.smithi070.stdout:7/123: fsync d3/d7/fd 0 2023-10-08T08:45:26.870 INFO:tasks.workunit.client.0.smithi070.stdout:3/70: write d0/f2 [2607051,113492] 0 2023-10-08T08:45:26.870 INFO:tasks.workunit.client.0.smithi070.stdout:9/88: mknod d1/dd/c23 0 2023-10-08T08:45:26.870 INFO:tasks.workunit.client.0.smithi070.stdout:0/167: creat d1/d1d/f2b x:0 0 0 2023-10-08T08:45:26.882 INFO:tasks.workunit.client.0.smithi070.stdout:7/124: rename d3/d7/l17 to d3/d7/l29 0 2023-10-08T08:45:26.885 INFO:tasks.workunit.client.0.smithi070.stdout:5/131: dwrite d5/da/f11 [0,4194304] 0 2023-10-08T08:45:26.885 INFO:tasks.workunit.client.0.smithi070.stdout:3/71: write d0/db/fd [783095,121447] 0 2023-10-08T08:45:26.886 INFO:tasks.workunit.client.0.smithi070.stdout:3/72: readlink d0/l5 0 2023-10-08T08:45:26.886 INFO:tasks.workunit.client.0.smithi070.stdout:3/73: chown d0/db/lf 147 1 2023-10-08T08:45:26.886 INFO:tasks.workunit.client.0.smithi070.stdout:6/108: dwrite f1 [4194304,4194304] 0 2023-10-08T08:45:26.887 INFO:tasks.workunit.client.0.smithi070.stdout:8/192: dwrite d1/de/d15/f40 [0,4194304] 0 2023-10-08T08:45:26.888 INFO:tasks.workunit.client.0.smithi070.stdout:5/132: mkdir d5/da/d22/d29/d2a 0 2023-10-08T08:45:26.888 INFO:tasks.workunit.client.0.smithi070.stdout:5/133: chown d5/da/l1b 1004426 1 2023-10-08T08:45:26.889 INFO:tasks.workunit.client.0.smithi070.stdout:3/74: getdents d0/d12 0 2023-10-08T08:45:26.889 INFO:tasks.workunit.client.0.smithi070.stdout:3/75: fsync d0/db/f15 0 2023-10-08T08:45:26.889 INFO:tasks.workunit.client.0.smithi070.stdout:3/76: stat d0/c9 0 2023-10-08T08:45:26.890 INFO:tasks.workunit.client.0.smithi070.stdout:6/109: symlink df/d11/d1d/l25 0 2023-10-08T08:45:26.893 INFO:tasks.workunit.client.0.smithi070.stdout:8/193: symlink d1/de/d1a/l46 0 2023-10-08T08:45:26.894 INFO:tasks.workunit.client.0.smithi070.stdout:5/134: truncate d5/da/f15 1385749 0 2023-10-08T08:45:26.897 INFO:tasks.workunit.client.0.smithi070.stdout:3/77: symlink d0/db/l1a 0 2023-10-08T08:45:26.900 INFO:tasks.workunit.client.0.smithi070.stdout:2/142: sync 2023-10-08T08:45:26.900 INFO:tasks.workunit.client.0.smithi070.stdout:1/122: sync 2023-10-08T08:45:26.900 INFO:tasks.workunit.client.0.smithi070.stdout:8/194: getdents d1/de/d15 0 2023-10-08T08:45:26.902 INFO:tasks.workunit.client.0.smithi070.stdout:1/123: symlink d6/dc/d14/d1f/l23 0 2023-10-08T08:45:26.904 INFO:tasks.workunit.client.0.smithi070.stdout:1/124: rmdir d6/dc/d14/d1f 39 2023-10-08T08:45:26.905 INFO:tasks.workunit.client.0.smithi070.stdout:0/168: dwrite d1/d14/d1f/f28 [8388608,4194304] 0 2023-10-08T08:45:26.906 INFO:tasks.workunit.client.0.smithi070.stdout:9/89: dwrite d1/dd/f10 [0,4194304] 0 2023-10-08T08:45:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:7/125: dwrite d3/d7/f8 [0,4194304] 0 2023-10-08T08:45:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:7/126: truncate d3/d19/d1a/f20 175780 0 2023-10-08T08:45:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:1/125: rmdir d6/d17 0 2023-10-08T08:45:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:0/169: rename d1/dd/f25 to d1/d14/d1f/f2c 0 2023-10-08T08:45:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:0/170: stat d1/d1d 0 2023-10-08T08:45:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:0/171: chown d1/d14/d1f/f2c 7 1 2023-10-08T08:45:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:9/90: symlink d1/dd/d19/l24 0 2023-10-08T08:45:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:9/91: chown d1/dd/d19 0 1 2023-10-08T08:45:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:0/172: symlink d1/dd/l2d 0 2023-10-08T08:45:26.913 INFO:tasks.workunit.client.0.smithi070.stdout:0/173: truncate d1/d1d/f2b 317362 0 2023-10-08T08:45:26.913 INFO:tasks.workunit.client.0.smithi070.stdout:0/174: creat d1/d1d/f2e x:0 0 0 2023-10-08T08:45:26.914 INFO:tasks.workunit.client.0.smithi070.stdout:9/92: write f0 [3911376,44226] 0 2023-10-08T08:45:26.914 INFO:tasks.workunit.client.0.smithi070.stdout:9/93: write d1/dd/fa [3566640,63267] 0 2023-10-08T08:45:26.915 INFO:tasks.workunit.client.0.smithi070.stdout:5/135: write d5/da/f15 [1096319,47707] 0 2023-10-08T08:45:26.916 INFO:tasks.workunit.client.0.smithi070.stdout:1/126: write f5 [63336,122663] 0 2023-10-08T08:45:26.918 INFO:tasks.workunit.client.0.smithi070.stdout:6/110: dwrite f1 [4194304,4194304] 0 2023-10-08T08:45:26.919 INFO:tasks.workunit.client.0.smithi070.stdout:6/111: stat cc 0 2023-10-08T08:45:26.919 INFO:tasks.workunit.client.0.smithi070.stdout:6/112: chown df/d11/c13 29725 1 2023-10-08T08:45:26.919 INFO:tasks.workunit.client.0.smithi070.stdout:9/94: getdents d1/dd 0 2023-10-08T08:45:26.919 INFO:tasks.workunit.client.0.smithi070.stdout:9/95: write d1/dd/d1a/f1c [248077,54342] 0 2023-10-08T08:45:26.920 INFO:tasks.workunit.client.0.smithi070.stdout:1/127: dread d6/dc/f13 [0,4194304] 0 2023-10-08T08:45:26.921 INFO:tasks.workunit.client.0.smithi070.stdout:0/175: mknod d1/c2f 0 2023-10-08T08:45:26.923 INFO:tasks.workunit.client.0.smithi070.stdout:5/136: creat d5/da/d22/d29/f2b x:0 0 0 2023-10-08T08:45:26.924 INFO:tasks.workunit.client.0.smithi070.stdout:1/128: unlink d6/l1a 0 2023-10-08T08:45:26.925 INFO:tasks.workunit.client.0.smithi070.stdout:1/129: creat d6/dc/f24 x:0 0 0 2023-10-08T08:45:26.925 INFO:tasks.workunit.client.0.smithi070.stdout:1/130: chown l3 771822 1 2023-10-08T08:45:26.925 INFO:tasks.workunit.client.0.smithi070.stdout:9/96: dread d1/dd/d19/f1e [0,4194304] 0 2023-10-08T08:45:26.926 INFO:tasks.workunit.client.0.smithi070.stdout:5/137: symlink d5/da/d22/d29/l2c 0 2023-10-08T08:45:26.926 INFO:tasks.workunit.client.0.smithi070.stdout:5/138: write d5/da/f24 [699211,98817] 0 2023-10-08T08:45:26.926 INFO:tasks.workunit.client.0.smithi070.stdout:0/176: symlink d1/l30 0 2023-10-08T08:45:26.927 INFO:tasks.workunit.client.0.smithi070.stdout:2/143: dwrite df/d12/f1f [0,4194304] 0 2023-10-08T08:45:26.928 INFO:tasks.workunit.client.0.smithi070.stdout:1/131: rename d6/dc/f1d to d6/dc/d14/d1f/f25 0 2023-10-08T08:45:26.928 INFO:tasks.workunit.client.0.smithi070.stdout:1/132: fsync d6/f18 0 2023-10-08T08:45:26.928 INFO:tasks.workunit.client.0.smithi070.stdout:8/195: dwrite d1/de/d21/f35 [0,4194304] 0 2023-10-08T08:45:26.933 INFO:tasks.workunit.client.0.smithi070.stdout:6/113: dread df/f10 [0,4194304] 0 2023-10-08T08:45:26.934 INFO:tasks.workunit.client.0.smithi070.stdout:5/139: mkdir d5/da/d22/d2d 0 2023-10-08T08:45:26.934 INFO:tasks.workunit.client.0.smithi070.stdout:0/177: link d1/f6 d1/d14/d1c/f31 0 2023-10-08T08:45:26.935 INFO:tasks.workunit.client.0.smithi070.stdout:8/196: dread d1/d2/d6/fa [0,4194304] 0 2023-10-08T08:45:26.936 INFO:tasks.workunit.client.0.smithi070.stdout:8/197: readlink d1/d2/lc 0 2023-10-08T08:45:26.936 INFO:tasks.workunit.client.0.smithi070.stdout:8/198: write d1/d2/f1e [455071,47754] 0 2023-10-08T08:45:26.936 INFO:tasks.workunit.client.0.smithi070.stdout:6/114: mkdir df/d26 0 2023-10-08T08:45:26.936 INFO:tasks.workunit.client.0.smithi070.stdout:6/115: truncate df/f23 586608 0 2023-10-08T08:45:26.936 INFO:tasks.workunit.client.0.smithi070.stdout:7/127: dwrite d3/d7/fd [0,4194304] 0 2023-10-08T08:45:26.939 INFO:tasks.workunit.client.0.smithi070.stdout:2/144: getdents df/d12 0 2023-10-08T08:45:26.940 INFO:tasks.workunit.client.0.smithi070.stdout:0/178: symlink d1/d14/l32 0 2023-10-08T08:45:26.940 INFO:tasks.workunit.client.0.smithi070.stdout:0/179: chown d1/d1d/l1e 1 1 2023-10-08T08:45:26.942 INFO:tasks.workunit.client.0.smithi070.stdout:8/199: getdents d1/de/d21 0 2023-10-08T08:45:26.946 INFO:tasks.workunit.client.0.smithi070.stdout:7/128: truncate d3/f12 2187574 0 2023-10-08T08:45:26.947 INFO:tasks.workunit.client.0.smithi070.stdout:6/116: write f2 [3632345,22495] 0 2023-10-08T08:45:26.948 INFO:tasks.workunit.client.0.smithi070.stdout:0/180: creat d1/dd/d1b/f33 x:0 0 0 2023-10-08T08:45:26.949 INFO:tasks.workunit.client.0.smithi070.stdout:3/78: dwrite d0/db/fd [0,4194304] 0 2023-10-08T08:45:26.950 INFO:tasks.workunit.client.0.smithi070.stdout:7/129: symlink d3/d19/d1b/l2a 0 2023-10-08T08:45:26.951 INFO:tasks.workunit.client.0.smithi070.stdout:6/117: creat df/f27 x:0 0 0 2023-10-08T08:45:26.953 INFO:tasks.workunit.client.0.smithi070.stdout:1/133: dwrite d6/f20 [0,4194304] 0 2023-10-08T08:45:26.953 INFO:tasks.workunit.client.0.smithi070.stdout:1/134: fsync d6/dc/d14/d1f/f25 0 2023-10-08T08:45:26.958 INFO:tasks.workunit.client.0.smithi070.stdout:0/181: rename d1/dd/f18 to d1/dd/d1b/f34 0 2023-10-08T08:45:26.958 INFO:tasks.workunit.client.0.smithi070.stdout:3/79: link d0/ca d0/db/d10/c1b 0 2023-10-08T08:45:26.960 INFO:tasks.workunit.client.0.smithi070.stdout:5/140: dwrite d5/da/f11 [0,4194304] 0 2023-10-08T08:45:26.961 INFO:tasks.workunit.client.0.smithi070.stdout:6/118: getdents df/d11/d1d 0 2023-10-08T08:45:26.963 INFO:tasks.workunit.client.0.smithi070.stdout:1/135: mkdir d6/dc/d14/d1f/d26 0 2023-10-08T08:45:26.963 INFO:tasks.workunit.client.0.smithi070.stdout:7/130: creat d3/f2b x:0 0 0 2023-10-08T08:45:26.963 INFO:tasks.workunit.client.0.smithi070.stdout:1/136: dread - d6/dc/d14/d1f/f25 zero size 2023-10-08T08:45:26.963 INFO:tasks.workunit.client.0.smithi070.stdout:1/137: truncate d6/f1b 740533 0 2023-10-08T08:45:26.964 INFO:tasks.workunit.client.0.smithi070.stdout:1/138: chown d6/dc/f1e 43 1 2023-10-08T08:45:26.964 INFO:tasks.workunit.client.0.smithi070.stdout:1/139: fsync d6/dc/f1e 0 2023-10-08T08:45:26.964 INFO:tasks.workunit.client.0.smithi070.stdout:1/140: chown d6/dc/d14/c16 286240112 1 2023-10-08T08:45:26.964 INFO:tasks.workunit.client.0.smithi070.stdout:3/80: creat d0/d12/d14/f1c x:0 0 0 2023-10-08T08:45:26.964 INFO:tasks.workunit.client.0.smithi070.stdout:6/119: symlink df/d11/l28 0 2023-10-08T08:45:26.966 INFO:tasks.workunit.client.0.smithi070.stdout:1/141: creat d6/dc/f27 x:0 0 0 2023-10-08T08:45:26.966 INFO:tasks.workunit.client.0.smithi070.stdout:7/131: creat d3/d7/d9/f2c x:0 0 0 2023-10-08T08:45:26.967 INFO:tasks.workunit.client.0.smithi070.stdout:2/145: dwrite df/f11 [0,4194304] 0 2023-10-08T08:45:26.967 INFO:tasks.workunit.client.0.smithi070.stdout:2/146: stat df/d12/d25/f2a 0 2023-10-08T08:45:26.971 INFO:tasks.workunit.client.0.smithi070.stdout:8/200: dwrite d1/d2/f2d [0,4194304] 0 2023-10-08T08:45:26.972 INFO:tasks.workunit.client.0.smithi070.stdout:3/81: write d0/f8 [1422175,9738] 0 2023-10-08T08:45:26.972 INFO:tasks.workunit.client.0.smithi070.stdout:2/147: write f8 [413269,51990] 0 2023-10-08T08:45:26.977 INFO:tasks.workunit.client.0.smithi070.stdout:5/141: dread d5/da/f11 [0,4194304] 0 2023-10-08T08:45:26.978 INFO:tasks.workunit.client.0.smithi070.stdout:6/120: getdents df/d11 0 2023-10-08T08:45:26.978 INFO:tasks.workunit.client.0.smithi070.stdout:6/121: write f5 [599756,82255] 0 2023-10-08T08:45:26.980 INFO:tasks.workunit.client.0.smithi070.stdout:7/132: creat d3/f2d x:0 0 0 2023-10-08T08:45:26.980 INFO:tasks.workunit.client.0.smithi070.stdout:7/133: write d3/f2b [329912,79902] 0 2023-10-08T08:45:26.985 INFO:tasks.workunit.client.0.smithi070.stdout:8/201: creat d1/de/d21/f47 x:0 0 0 2023-10-08T08:45:26.988 INFO:tasks.workunit.client.0.smithi070.stdout:2/148: link df/d12/d1b/d1c/l28 df/d12/d1b/d1c/d2d/l32 0 2023-10-08T08:45:26.988 INFO:tasks.workunit.client.0.smithi070.stdout:2/149: truncate df/d12/d15/f31 969298 0 2023-10-08T08:45:26.988 INFO:tasks.workunit.client.0.smithi070.stdout:5/142: symlink d5/l2e 0 2023-10-08T08:45:26.989 INFO:tasks.workunit.client.0.smithi070.stdout:5/143: stat d5/da/d22/d29 0 2023-10-08T08:45:26.990 INFO:tasks.workunit.client.0.smithi070.stdout:6/122: creat df/d11/f29 x:0 0 0 2023-10-08T08:45:26.991 INFO:tasks.workunit.client.0.smithi070.stdout:7/134: creat d3/f2e x:0 0 0 2023-10-08T08:45:26.991 INFO:tasks.workunit.client.0.smithi070.stdout:7/135: write d3/f2e [555638,93107] 0 2023-10-08T08:45:26.992 INFO:tasks.workunit.client.0.smithi070.stdout:2/150: link fa df/f33 0 2023-10-08T08:45:26.992 INFO:tasks.workunit.client.0.smithi070.stdout:2/151: write df/d12/d15/f31 [1912464,36305] 0 2023-10-08T08:45:26.994 INFO:tasks.workunit.client.0.smithi070.stdout:5/144: truncate d5/da/f11 1260105 0 2023-10-08T08:45:26.994 INFO:tasks.workunit.client.0.smithi070.stdout:5/145: fdatasync d5/f9 0 2023-10-08T08:45:26.999 INFO:tasks.workunit.client.0.smithi070.stdout:7/136: creat d3/d19/d1a/f2f x:0 0 0 2023-10-08T08:45:26.999 INFO:tasks.workunit.client.0.smithi070.stdout:7/137: dread - d3/d7/d9/f2c zero size 2023-10-08T08:45:27.001 INFO:tasks.workunit.client.0.smithi070.stdout:0/182: dwrite d1/dd/ff [0,4194304] 0 2023-10-08T08:45:27.004 INFO:tasks.workunit.client.0.smithi070.stdout:3/82: dwrite d0/d12/d14/f1c [0,4194304] 0 2023-10-08T08:45:27.004 INFO:tasks.workunit.client.0.smithi070.stdout:3/83: chown d0/db/f15 385196 1 2023-10-08T08:45:27.004 INFO:tasks.workunit.client.0.smithi070.stdout:3/84: truncate d0/db/f18 390188 0 2023-10-08T08:45:27.006 INFO:tasks.workunit.client.0.smithi070.stdout:5/146: mkdir d5/da/d2f 0 2023-10-08T08:45:27.006 INFO:tasks.workunit.client.0.smithi070.stdout:5/147: dread - d5/da/f23 zero size 2023-10-08T08:45:27.006 INFO:tasks.workunit.client.0.smithi070.stdout:5/148: truncate d5/da/f16 913610 0 2023-10-08T08:45:27.007 INFO:tasks.workunit.client.0.smithi070.stdout:2/152: dread fc [0,4194304] 0 2023-10-08T08:45:27.008 INFO:tasks.workunit.client.0.smithi070.stdout:0/183: stat d1/d1d/d24/l2a 0 2023-10-08T08:45:27.015 INFO:tasks.workunit.client.0.smithi070.stdout:3/85: dread d0/d12/f13 [0,4194304] 0 2023-10-08T08:45:27.015 INFO:tasks.workunit.client.0.smithi070.stdout:3/86: truncate d0/db/fd 4484961 0 2023-10-08T08:45:27.016 INFO:tasks.workunit.client.0.smithi070.stdout:2/153: getdents df/d12/d1b/d1c 0 2023-10-08T08:45:27.017 INFO:tasks.workunit.client.0.smithi070.stdout:0/184: truncate d1/d14/d1f/f2c 5142781 0 2023-10-08T08:45:27.020 INFO:tasks.workunit.client.0.smithi070.stdout:3/87: mkdir d0/d12/d14/d1d 0 2023-10-08T08:45:27.021 INFO:tasks.workunit.client.0.smithi070.stdout:2/154: mkdir df/d12/d15/d34 0 2023-10-08T08:45:27.022 INFO:tasks.workunit.client.0.smithi070.stdout:0/185: link d1/d14/d1f/f1a d1/d14/f35 0 2023-10-08T08:45:27.022 INFO:tasks.workunit.client.0.smithi070.stdout:0/186: fdatasync d1/dd/f13 0 2023-10-08T08:45:27.024 INFO:tasks.workunit.client.0.smithi070.stdout:3/88: creat d0/db/d10/f1e x:0 0 0 2023-10-08T08:45:27.026 INFO:tasks.workunit.client.0.smithi070.stdout:7/138: dwrite d3/d7/f8 [4194304,4194304] 0 2023-10-08T08:45:27.027 INFO:tasks.workunit.client.0.smithi070.stdout:0/187: rmdir d1/d1d/d24 39 2023-10-08T08:45:27.027 INFO:tasks.workunit.client.0.smithi070.stdout:0/188: write d1/d1d/f2b [541355,94308] 0 2023-10-08T08:45:27.029 INFO:tasks.workunit.client.0.smithi070.stdout:3/89: getdents d0/db 0 2023-10-08T08:45:27.029 INFO:tasks.workunit.client.0.smithi070.stdout:3/90: chown d0/c9 4580 1 2023-10-08T08:45:27.029 INFO:tasks.workunit.client.0.smithi070.stdout:3/91: readlink d0/db/l1a 0 2023-10-08T08:45:27.031 INFO:tasks.workunit.client.0.smithi070.stdout:5/149: dwrite d5/f19 [0,4194304] 0 2023-10-08T08:45:27.031 INFO:tasks.workunit.client.0.smithi070.stdout:5/150: getdents d5/da/d2f 0 2023-10-08T08:45:27.031 INFO:tasks.workunit.client.0.smithi070.stdout:7/139: rename d3/d7/f21 to d3/d19/d1a/f30 0 2023-10-08T08:45:27.033 INFO:tasks.workunit.client.0.smithi070.stdout:6/123: dwrite df/f20 [0,4194304] 0 2023-10-08T08:45:27.036 INFO:tasks.workunit.client.0.smithi070.stdout:3/92: fsync d0/db/d10/f1e 0 2023-10-08T08:45:27.037 INFO:tasks.workunit.client.0.smithi070.stdout:3/93: read d0/db/f15 [37544,51371] 0 2023-10-08T08:45:27.039 INFO:tasks.workunit.client.0.smithi070.stdout:7/140: mknod d3/d7/d9/c31 0 2023-10-08T08:45:27.039 INFO:tasks.workunit.client.0.smithi070.stdout:7/141: truncate d3/f12 2455753 0 2023-10-08T08:45:27.043 INFO:tasks.workunit.client.0.smithi070.stdout:5/151: dread d5/ff [0,4194304] 0 2023-10-08T08:45:27.045 INFO:tasks.workunit.client.0.smithi070.stdout:6/124: read - df/d11/f1a zero size 2023-10-08T08:45:27.045 INFO:tasks.workunit.client.0.smithi070.stdout:0/189: getdents d1/dd 0 2023-10-08T08:45:27.045 INFO:tasks.workunit.client.0.smithi070.stdout:3/94: creat d0/f1f x:0 0 0 2023-10-08T08:45:27.045 INFO:tasks.workunit.client.0.smithi070.stdout:7/142: write d3/f12 [900663,59508] 0 2023-10-08T08:45:27.046 INFO:tasks.workunit.client.0.smithi070.stdout:5/152: rename d5/d13 to d5/da/d2f/d30 0 2023-10-08T08:45:27.048 INFO:tasks.workunit.client.0.smithi070.stdout:0/190: creat d1/d1d/d24/f36 x:0 0 0 2023-10-08T08:45:27.048 INFO:tasks.workunit.client.0.smithi070.stdout:0/191: fdatasync d1/d14/f35 0 2023-10-08T08:45:27.049 INFO:tasks.workunit.client.0.smithi070.stdout:0/192: chown d1/dd/l10 1356990 1 2023-10-08T08:45:27.049 INFO:tasks.workunit.client.0.smithi070.stdout:7/143: mknod d3/d7/d9/c32 0 2023-10-08T08:45:27.050 INFO:tasks.workunit.client.0.smithi070.stdout:5/153: creat d5/da/d22/d29/d2a/f31 x:0 0 0 2023-10-08T08:45:27.050 INFO:tasks.workunit.client.0.smithi070.stdout:5/154: truncate d5/da/f16 1542492 0 2023-10-08T08:45:27.051 INFO:tasks.workunit.client.0.smithi070.stdout:2/155: dwrite df/d12/d15/f18 [0,4194304] 0 2023-10-08T08:45:27.052 INFO:tasks.workunit.client.0.smithi070.stdout:5/155: link d5/da/d2f/d30/f14 d5/da/d22/f32 0 2023-10-08T08:45:27.054 INFO:tasks.workunit.client.0.smithi070.stdout:0/193: getdents d1/dd/d1b 0 2023-10-08T08:45:27.055 INFO:tasks.workunit.client.0.smithi070.stdout:5/156: mknod d5/da/d22/c33 0 2023-10-08T08:45:27.061 INFO:tasks.workunit.client.0.smithi070.stdout:0/194: rmdir d1/d14 39 2023-10-08T08:45:27.062 INFO:tasks.workunit.client.0.smithi070.stdout:0/195: mknod d1/dd/c37 0 2023-10-08T08:45:27.063 INFO:tasks.workunit.client.0.smithi070.stdout:0/196: mkdir d1/d14/d1c/d38 0 2023-10-08T08:45:27.065 INFO:tasks.workunit.client.0.smithi070.stdout:7/144: dread d3/d7/fd [0,4194304] 0 2023-10-08T08:45:27.065 INFO:tasks.workunit.client.0.smithi070.stdout:0/197: write d1/d14/d1f/f2c [95304,33642] 0 2023-10-08T08:45:27.066 INFO:tasks.workunit.client.0.smithi070.stdout:0/198: truncate d1/dd/ff 439481 0 2023-10-08T08:45:27.067 INFO:tasks.workunit.client.0.smithi070.stdout:7/145: symlink d3/d7/l33 0 2023-10-08T08:45:27.067 INFO:tasks.workunit.client.0.smithi070.stdout:7/146: chown d3/d7/d9/c32 247417 1 2023-10-08T08:45:27.068 INFO:tasks.workunit.client.0.smithi070.stdout:0/199: creat d1/d14/d1c/d38/f39 x:0 0 0 2023-10-08T08:45:27.069 INFO:tasks.workunit.client.0.smithi070.stdout:3/95: dwrite d0/f1 [4194304,4194304] 0 2023-10-08T08:45:27.069 INFO:tasks.workunit.client.0.smithi070.stdout:3/96: rename d0/d12/d14 to d0/d12/d14/d1d/d20 22 2023-10-08T08:45:27.069 INFO:tasks.workunit.client.0.smithi070.stdout:3/97: dread - d0/f1f zero size 2023-10-08T08:45:27.070 INFO:tasks.workunit.client.0.smithi070.stdout:7/147: unlink d3/d19/d1a/f30 0 2023-10-08T08:45:27.070 INFO:tasks.workunit.client.0.smithi070.stdout:7/148: write d3/d19/d1a/f20 [487959,117988] 0 2023-10-08T08:45:27.070 INFO:tasks.workunit.client.0.smithi070.stdout:2/156: dread f8 [0,4194304] 0 2023-10-08T08:45:27.071 INFO:tasks.workunit.client.0.smithi070.stdout:2/157: fsync fa 0 2023-10-08T08:45:27.071 INFO:tasks.workunit.client.0.smithi070.stdout:2/158: chown df/d12/d15/f16 1330932 1 2023-10-08T08:45:27.071 INFO:tasks.workunit.client.0.smithi070.stdout:2/159: truncate df/d12/d1b/f1e 4172879 0 2023-10-08T08:45:27.072 INFO:tasks.workunit.client.0.smithi070.stdout:3/98: mknod d0/d12/c21 0 2023-10-08T08:45:27.072 INFO:tasks.workunit.client.0.smithi070.stdout:6/125: dwrite df/f1c [0,4194304] 0 2023-10-08T08:45:27.072 INFO:tasks.workunit.client.0.smithi070.stdout:7/149: mknod d3/d19/d1b/c34 0 2023-10-08T08:45:27.075 INFO:tasks.workunit.client.0.smithi070.stdout:3/99: dread d0/db/f15 [0,4194304] 0 2023-10-08T08:45:27.075 INFO:tasks.workunit.client.0.smithi070.stdout:3/100: fsync d0/d12/d14/f1c 0 2023-10-08T08:45:27.075 INFO:tasks.workunit.client.0.smithi070.stdout:0/200: write d1/d14/d1f/f28 [6205858,48649] 0 2023-10-08T08:45:27.076 INFO:tasks.workunit.client.0.smithi070.stdout:2/160: rmdir df 39 2023-10-08T08:45:27.077 INFO:tasks.workunit.client.0.smithi070.stdout:2/161: dread - df/d12/d1b/d1c/f26 zero size 2023-10-08T08:45:27.077 INFO:tasks.workunit.client.0.smithi070.stdout:0/201: creat d1/dd/f3a x:0 0 0 2023-10-08T08:45:27.078 INFO:tasks.workunit.client.0.smithi070.stdout:5/157: dwrite d5/da/f16 [0,4194304] 0 2023-10-08T08:45:27.078 INFO:tasks.workunit.client.0.smithi070.stdout:5/158: fdatasync d5/ff 0 2023-10-08T08:45:27.080 INFO:tasks.workunit.client.0.smithi070.stdout:6/126: rename df/d11/d1d/l25 to df/d11/l2a 0 2023-10-08T08:45:27.084 INFO:tasks.workunit.client.0.smithi070.stdout:3/101: dread d0/f1 [0,4194304] 0 2023-10-08T08:45:27.086 INFO:tasks.workunit.client.0.smithi070.stdout:7/150: dread d3/f2b [0,4194304] 0 2023-10-08T08:45:27.086 INFO:tasks.workunit.client.0.smithi070.stdout:2/162: symlink df/d12/l35 0 2023-10-08T08:45:27.086 INFO:tasks.workunit.client.0.smithi070.stdout:2/163: write df/d12/d15/f31 [2822850,13583] 0 2023-10-08T08:45:27.091 INFO:tasks.workunit.client.0.smithi070.stdout:3/102: mkdir d0/d12/d14/d1d/d22 0 2023-10-08T08:45:27.091 INFO:tasks.workunit.client.0.smithi070.stdout:0/202: unlink d1/c9 0 2023-10-08T08:45:27.094 INFO:tasks.workunit.client.0.smithi070.stdout:3/103: link d0/c7 d0/d12/d14/c23 0 2023-10-08T08:45:27.095 INFO:tasks.workunit.client.0.smithi070.stdout:2/164: getdents df/d12/d25 0 2023-10-08T08:45:27.095 INFO:tasks.workunit.client.0.smithi070.stdout:2/165: fsync fc 0 2023-10-08T08:45:27.104 INFO:tasks.workunit.client.0.smithi070.stdout:3/104: read d0/f1 [72003,38699] 0 2023-10-08T08:45:27.106 INFO:tasks.workunit.client.0.smithi070.stdout:3/105: mkdir d0/db/d10/d24 0 2023-10-08T08:45:27.106 INFO:tasks.workunit.client.0.smithi070.stdout:3/106: getdents d0/db 0 2023-10-08T08:45:27.107 INFO:tasks.workunit.client.0.smithi070.stdout:3/107: creat d0/d12/d14/f25 x:0 0 0 2023-10-08T08:45:27.107 INFO:tasks.workunit.client.0.smithi070.stdout:9/97: sync 2023-10-08T08:45:27.107 INFO:tasks.workunit.client.0.smithi070.stdout:4/115: sync 2023-10-08T08:45:27.108 INFO:tasks.workunit.client.0.smithi070.stdout:9/98: truncate d1/dd/f11 817122 0 2023-10-08T08:45:27.109 INFO:tasks.workunit.client.0.smithi070.stdout:4/116: mkdir dc/d17/d24 0 2023-10-08T08:45:27.109 INFO:tasks.workunit.client.0.smithi070.stdout:4/117: chown f9 19807800 1 2023-10-08T08:45:27.110 INFO:tasks.workunit.client.0.smithi070.stdout:9/99: creat d1/f25 x:0 0 0 2023-10-08T08:45:27.111 INFO:tasks.workunit.client.0.smithi070.stdout:3/108: read d0/f1 [4652697,61522] 0 2023-10-08T08:45:27.111 INFO:tasks.workunit.client.0.smithi070.stdout:3/109: readlink d0/l5 0 2023-10-08T08:45:27.111 INFO:tasks.workunit.client.0.smithi070.stdout:3/110: fdatasync d0/d12/d14/f25 0 2023-10-08T08:45:27.111 INFO:tasks.workunit.client.0.smithi070.stdout:3/111: truncate d0/db/d10/f1e 323470 0 2023-10-08T08:45:27.111 INFO:tasks.workunit.client.0.smithi070.stdout:3/112: chown d0/c9 50552399 1 2023-10-08T08:45:27.111 INFO:tasks.workunit.client.0.smithi070.stdout:9/100: read d1/fb [546795,111463] 0 2023-10-08T08:45:27.112 INFO:tasks.workunit.client.0.smithi070.stdout:9/101: fdatasync d1/dd/d1a/f1d 0 2023-10-08T08:45:27.112 INFO:tasks.workunit.client.0.smithi070.stdout:9/102: dread - d1/f20 zero size 2023-10-08T08:45:27.112 INFO:tasks.workunit.client.0.smithi070.stdout:5/159: dwrite d5/da/d22/d29/f2b [0,4194304] 0 2023-10-08T08:45:27.112 INFO:tasks.workunit.client.0.smithi070.stdout:5/160: chown d5/da/l1d 974588874 1 2023-10-08T08:45:27.112 INFO:tasks.workunit.client.0.smithi070.stdout:7/151: dwrite d3/f2d [0,4194304] 0 2023-10-08T08:45:27.112 INFO:tasks.workunit.client.0.smithi070.stdout:7/152: dread - d3/d7/d9/f2c zero size 2023-10-08T08:45:27.112 INFO:tasks.workunit.client.0.smithi070.stdout:7/153: write d3/d7/d9/f2c [290387,81139] 0 2023-10-08T08:45:27.113 INFO:tasks.workunit.client.0.smithi070.stdout:3/113: creat d0/db/f26 x:0 0 0 2023-10-08T08:45:27.113 INFO:tasks.workunit.client.0.smithi070.stdout:3/114: dread - d0/db/f26 zero size 2023-10-08T08:45:27.122 INFO:tasks.workunit.client.0.smithi070.stdout:3/115: mknod d0/d12/c27 0 2023-10-08T08:45:27.123 INFO:tasks.workunit.client.0.smithi070.stdout:1/142: sync 2023-10-08T08:45:27.125 INFO:tasks.workunit.client.0.smithi070.stdout:5/161: rename d5/da/l1b to d5/da/l34 0 2023-10-08T08:45:27.125 INFO:tasks.workunit.client.0.smithi070.stdout:2/166: dwrite df/f20 [0,4194304] 0 2023-10-08T08:45:27.125 INFO:tasks.workunit.client.0.smithi070.stdout:2/167: readlink l7 0 2023-10-08T08:45:27.126 INFO:tasks.workunit.client.0.smithi070.stdout:3/116: creat d0/d12/d14/f28 x:0 0 0 2023-10-08T08:45:27.126 INFO:tasks.workunit.client.0.smithi070.stdout:3/117: chown d0/db/lf 0 1 2023-10-08T08:45:27.129 INFO:tasks.workunit.client.0.smithi070.stdout:7/154: rename d3/d7/d9/l1c to d3/d7/l35 0 2023-10-08T08:45:27.130 INFO:tasks.workunit.client.0.smithi070.stdout:8/202: sync 2023-10-08T08:45:27.130 INFO:tasks.workunit.client.0.smithi070.stdout:8/203: chown d1/d2/d6/fa 99791111 1 2023-10-08T08:45:27.131 INFO:tasks.workunit.client.0.smithi070.stdout:4/118: dwrite dc/ff [0,4194304] 0 2023-10-08T08:45:27.131 INFO:tasks.workunit.client.0.smithi070.stdout:4/119: write dc/f15 [685140,118720] 0 2023-10-08T08:45:27.135 INFO:tasks.workunit.client.0.smithi070.stdout:1/143: rename d6/dc/f24 to d6/f28 0 2023-10-08T08:45:27.135 INFO:tasks.workunit.client.0.smithi070.stdout:8/204: creat d1/de/d2e/f48 x:0 0 0 2023-10-08T08:45:27.135 INFO:tasks.workunit.client.0.smithi070.stdout:3/118: link d0/db/f15 d0/db/f29 0 2023-10-08T08:45:27.135 INFO:tasks.workunit.client.0.smithi070.stdout:3/119: truncate d0/db/f15 1222344 0 2023-10-08T08:45:27.135 INFO:tasks.workunit.client.0.smithi070.stdout:3/120: truncate d0/db/d10/f1e 1265541 0 2023-10-08T08:45:27.136 INFO:tasks.workunit.client.0.smithi070.stdout:9/103: dwrite d1/fb [0,4194304] 0 2023-10-08T08:45:27.136 INFO:tasks.workunit.client.0.smithi070.stdout:5/162: rename d5/da/d22/c33 to d5/da/d22/d2d/c35 0 2023-10-08T08:45:27.138 INFO:tasks.workunit.client.0.smithi070.stdout:1/144: mkdir d6/dc/d14/d1f/d29 0 2023-10-08T08:45:27.142 INFO:tasks.workunit.client.0.smithi070.stdout:9/104: mkdir d1/dd/d26 0 2023-10-08T08:45:27.142 INFO:tasks.workunit.client.0.smithi070.stdout:9/105: truncate d1/dd/d1a/f1d 547821 0 2023-10-08T08:45:27.142 INFO:tasks.workunit.client.0.smithi070.stdout:9/106: fdatasync d1/dd/fa 0 2023-10-08T08:45:27.142 INFO:tasks.workunit.client.0.smithi070.stdout:9/107: chown d1/dd/d1a/f1c 5658 1 2023-10-08T08:45:27.143 INFO:tasks.workunit.client.0.smithi070.stdout:5/163: mkdir d5/da/d22/d36 0 2023-10-08T08:45:27.144 INFO:tasks.workunit.client.0.smithi070.stdout:5/164: chown d5/da/f15 4 1 2023-10-08T08:45:27.144 INFO:tasks.workunit.client.0.smithi070.stdout:5/165: write d5/da/d2f/d30/f14 [1119863,51124] 0 2023-10-08T08:45:27.144 INFO:tasks.workunit.client.0.smithi070.stdout:5/166: getdents d5/da/d22/d36 0 2023-10-08T08:45:27.145 INFO:tasks.workunit.client.0.smithi070.stdout:1/145: unlink d6/dc/c21 0 2023-10-08T08:45:27.149 INFO:tasks.workunit.client.0.smithi070.stdout:3/121: rmdir d0 39 2023-10-08T08:45:27.154 INFO:tasks.workunit.client.0.smithi070.stdout:9/108: rmdir d1/dd/d1a 39 2023-10-08T08:45:27.160 INFO:tasks.workunit.client.0.smithi070.stdout:5/167: rename d5/da/d22/d29 to d5/da/d22/d36/d37 0 2023-10-08T08:45:27.161 INFO:tasks.workunit.client.0.smithi070.stdout:9/109: getdents d1/dd/d19 0 2023-10-08T08:45:27.161 INFO:tasks.workunit.client.0.smithi070.stdout:9/110: truncate d1/dd/fa 4030788 0 2023-10-08T08:45:27.161 INFO:tasks.workunit.client.0.smithi070.stdout:9/111: fdatasync f0 0 2023-10-08T08:45:27.164 INFO:tasks.workunit.client.0.smithi070.stdout:3/122: rename d0/d12/f13 to d0/d12/d14/f2a 0 2023-10-08T08:45:27.166 INFO:tasks.workunit.client.0.smithi070.stdout:5/168: rename d5/da/d22/d2d to d5/da/d22/d36/d37/d38 0 2023-10-08T08:45:27.168 INFO:tasks.workunit.client.0.smithi070.stdout:5/169: creat d5/da/d22/d36/d37/f39 x:0 0 0 2023-10-08T08:45:27.170 INFO:tasks.workunit.client.0.smithi070.stdout:5/170: mknod d5/c3a 0 2023-10-08T08:45:27.170 INFO:tasks.workunit.client.0.smithi070.stdout:5/171: readlink d5/da/l20 0 2023-10-08T08:45:27.171 INFO:tasks.workunit.client.0.smithi070.stdout:5/172: symlink d5/da/d22/d36/d37/l3b 0 2023-10-08T08:45:27.171 INFO:tasks.workunit.client.0.smithi070.stdout:5/173: fsync d5/da/f16 0 2023-10-08T08:45:27.174 INFO:tasks.workunit.client.0.smithi070.stdout:5/174: write d5/f19 [4060724,75125] 0 2023-10-08T08:45:27.175 INFO:tasks.workunit.client.0.smithi070.stdout:5/175: symlink d5/da/d2f/l3c 0 2023-10-08T08:45:27.177 INFO:tasks.workunit.client.0.smithi070.stdout:5/176: rename d5/f19 to d5/da/d2f/d30/f3d 0 2023-10-08T08:45:27.177 INFO:tasks.workunit.client.0.smithi070.stdout:5/177: readlink d5/da/l34 0 2023-10-08T08:45:27.178 INFO:tasks.workunit.client.0.smithi070.stdout:5/178: mknod d5/c3e 0 2023-10-08T08:45:27.179 INFO:tasks.workunit.client.0.smithi070.stdout:7/155: dwrite d3/f12 [0,4194304] 0 2023-10-08T08:45:27.179 INFO:tasks.workunit.client.0.smithi070.stdout:7/156: readlink d3/l27 0 2023-10-08T08:45:27.180 INFO:tasks.workunit.client.0.smithi070.stdout:5/179: creat d5/da/d22/d36/f3f x:0 0 0 2023-10-08T08:45:27.181 INFO:tasks.workunit.client.0.smithi070.stdout:1/146: dwrite d6/f12 [0,4194304] 0 2023-10-08T08:45:27.182 INFO:tasks.workunit.client.0.smithi070.stdout:7/157: symlink d3/d19/d1b/d1e/l36 0 2023-10-08T08:45:27.182 INFO:tasks.workunit.client.0.smithi070.stdout:7/158: fdatasync d3/d19/d1a/f20 0 2023-10-08T08:45:27.182 INFO:tasks.workunit.client.0.smithi070.stdout:7/159: write d3/d19/d1a/f22 [1042142,76322] 0 2023-10-08T08:45:27.182 INFO:tasks.workunit.client.0.smithi070.stdout:7/160: dread - d3/d19/d1a/f2f zero size 2023-10-08T08:45:27.183 INFO:tasks.workunit.client.0.smithi070.stdout:9/112: dwrite d1/dd/fa [0,4194304] 0 2023-10-08T08:45:27.185 INFO:tasks.workunit.client.0.smithi070.stdout:9/113: write d1/f13 [1924976,64632] 0 2023-10-08T08:45:27.188 INFO:tasks.workunit.client.0.smithi070.stdout:9/114: unlink d1/dd/d19/f1e 0 2023-10-08T08:45:27.188 INFO:tasks.workunit.client.0.smithi070.stdout:9/115: readlink d1/dd/l22 0 2023-10-08T08:45:27.188 INFO:tasks.workunit.client.0.smithi070.stdout:3/123: dwrite d0/f8 [0,4194304] 0 2023-10-08T08:45:27.191 INFO:tasks.workunit.client.0.smithi070.stdout:3/124: write d0/db/fd [3990017,8203] 0 2023-10-08T08:45:27.191 INFO:tasks.workunit.client.0.smithi070.stdout:3/125: fdatasync d0/d12/d14/f28 0 2023-10-08T08:45:27.193 INFO:tasks.workunit.client.0.smithi070.stdout:1/147: dread d6/f20 [0,4194304] 0 2023-10-08T08:45:27.199 INFO:tasks.workunit.client.0.smithi070.stdout:5/180: rename d5/da/d2f/l3c to d5/da/l40 0 2023-10-08T08:45:27.201 INFO:tasks.workunit.client.0.smithi070.stdout:7/161: dwrite d3/f12 [4194304,4194304] 0 2023-10-08T08:45:27.204 INFO:tasks.workunit.client.0.smithi070.stdout:1/148: mknod d6/dc/c2a 0 2023-10-08T08:45:27.207 INFO:tasks.workunit.client.0.smithi070.stdout:1/149: dread d6/dc/f1e [0,4194304] 0 2023-10-08T08:45:27.207 INFO:tasks.workunit.client.0.smithi070.stdout:3/126: rename d0/db/l1a to d0/d12/d14/d1d/d22/l2b 0 2023-10-08T08:45:27.207 INFO:tasks.workunit.client.0.smithi070.stdout:3/127: truncate d0/f2 4964713 0 2023-10-08T08:45:27.207 INFO:tasks.workunit.client.0.smithi070.stdout:3/128: truncate d0/f1 9323726 0 2023-10-08T08:45:27.208 INFO:tasks.workunit.client.0.smithi070.stdout:5/181: mkdir d5/da/d22/d36/d41 0 2023-10-08T08:45:27.208 INFO:tasks.workunit.client.0.smithi070.stdout:5/182: stat d5/da/l1d 0 2023-10-08T08:45:27.209 INFO:tasks.workunit.client.0.smithi070.stdout:9/116: getdents d1 0 2023-10-08T08:45:27.209 INFO:tasks.workunit.client.0.smithi070.stdout:9/117: fdatasync d1/dd/d1a/f1d 0 2023-10-08T08:45:27.213 INFO:tasks.workunit.client.0.smithi070.stdout:7/162: creat d3/f37 x:0 0 0 2023-10-08T08:45:27.214 INFO:tasks.workunit.client.0.smithi070.stdout:1/150: creat d6/dc/d14/d1f/f2b x:0 0 0 2023-10-08T08:45:27.214 INFO:tasks.workunit.client.0.smithi070.stdout:1/151: chown d6/dc/d14 45745 1 2023-10-08T08:45:27.215 INFO:tasks.workunit.client.0.smithi070.stdout:1/152: write f5 [991067,123085] 0 2023-10-08T08:45:27.218 INFO:tasks.workunit.client.0.smithi070.stdout:3/129: creat d0/db/d10/f2c x:0 0 0 2023-10-08T08:45:27.218 INFO:tasks.workunit.client.0.smithi070.stdout:5/183: symlink d5/da/d2f/d30/l42 0 2023-10-08T08:45:27.219 INFO:tasks.workunit.client.0.smithi070.stdout:1/153: symlink d6/dc/d14/l2c 0 2023-10-08T08:45:27.220 INFO:tasks.workunit.client.0.smithi070.stdout:5/184: symlink d5/da/d22/d36/d37/d2a/l43 0 2023-10-08T08:45:27.220 INFO:tasks.workunit.client.0.smithi070.stdout:5/185: readlink d5/da/d2f/d30/l21 0 2023-10-08T08:45:27.223 INFO:tasks.workunit.client.0.smithi070.stdout:5/186: mknod d5/da/d22/d36/d37/d2a/c44 0 2023-10-08T08:45:27.224 INFO:tasks.workunit.client.0.smithi070.stdout:7/163: write d3/d7/f8 [4854593,76407] 0 2023-10-08T08:45:27.224 INFO:tasks.workunit.client.0.smithi070.stdout:9/118: dread d1/dd/f10 [0,4194304] 0 2023-10-08T08:45:27.224 INFO:tasks.workunit.client.0.smithi070.stdout:9/119: dread d1/dd/f11 [0,4194304] 0 2023-10-08T08:45:27.226 INFO:tasks.workunit.client.0.smithi070.stdout:5/187: mkdir d5/da/d2f/d30/d45 0 2023-10-08T08:45:27.227 INFO:tasks.workunit.client.0.smithi070.stdout:7/164: read d3/f2d [3566734,42541] 0 2023-10-08T08:45:27.228 INFO:tasks.workunit.client.0.smithi070.stdout:9/120: mkdir d1/dd/d26/d27 0 2023-10-08T08:45:27.229 INFO:tasks.workunit.client.0.smithi070.stdout:5/188: truncate d5/da/f16 3246950 0 2023-10-08T08:45:27.232 INFO:tasks.workunit.client.0.smithi070.stdout:3/130: dread d0/d12/d14/f1c [0,4194304] 0 2023-10-08T08:45:27.239 INFO:tasks.workunit.client.0.smithi070.stdout:3/131: link d0/d12/d14/f25 d0/d12/f2d 0 2023-10-08T08:45:27.243 INFO:tasks.workunit.client.0.smithi070.stdout:3/132: creat d0/d12/d14/d1d/d22/f2e x:0 0 0 2023-10-08T08:45:27.243 INFO:tasks.workunit.client.0.smithi070.stdout:7/165: truncate d3/f12 7082232 0 2023-10-08T08:45:27.245 INFO:tasks.workunit.client.0.smithi070.stdout:7/166: rmdir d3/d19 39 2023-10-08T08:45:27.245 INFO:tasks.workunit.client.0.smithi070.stdout:7/167: fdatasync d3/d19/d1a/f2f 0 2023-10-08T08:45:27.252 INFO:tasks.workunit.client.0.smithi070.stdout:9/121: dwrite d1/f20 [0,4194304] 0 2023-10-08T08:45:27.254 INFO:tasks.workunit.client.0.smithi070.stdout:5/189: dwrite d5/da/d22/d36/d37/d2a/f31 [0,4194304] 0 2023-10-08T08:45:27.257 INFO:tasks.workunit.client.0.smithi070.stdout:5/190: mknod d5/da/d22/d36/d37/d2a/c46 0 2023-10-08T08:45:27.260 INFO:tasks.workunit.client.0.smithi070.stdout:5/191: creat d5/da/d22/f47 x:0 0 0 2023-10-08T08:45:27.260 INFO:tasks.workunit.client.0.smithi070.stdout:5/192: readlink d5/da/l40 0 2023-10-08T08:45:27.263 INFO:tasks.workunit.client.0.smithi070.stdout:5/193: link d5/da/d22/d36/d37/d2a/l43 d5/da/d22/d36/l48 0 2023-10-08T08:45:27.265 INFO:tasks.workunit.client.0.smithi070.stdout:5/194: symlink d5/da/d22/d36/l49 0 2023-10-08T08:45:27.265 INFO:tasks.workunit.client.0.smithi070.stdout:6/127: sync 2023-10-08T08:45:27.265 INFO:tasks.workunit.client.0.smithi070.stdout:6/128: dread - df/f15 zero size 2023-10-08T08:45:27.267 INFO:tasks.workunit.client.0.smithi070.stdout:6/129: write f1 [745494,14873] 0 2023-10-08T08:45:27.267 INFO:tasks.workunit.client.0.smithi070.stdout:6/130: chown f1 18 1 2023-10-08T08:45:27.267 INFO:tasks.workunit.client.0.smithi070.stdout:5/195: mknod d5/da/c4a 0 2023-10-08T08:45:27.268 INFO:tasks.workunit.client.0.smithi070.stdout:6/131: mknod df/d26/c2b 0 2023-10-08T08:45:27.268 INFO:tasks.workunit.client.0.smithi070.stdout:6/132: write df/d11/f1a [643428,43774] 0 2023-10-08T08:45:27.271 INFO:tasks.workunit.client.0.smithi070.stdout:7/168: dwrite d3/d7/d9/f2c [0,4194304] 0 2023-10-08T08:45:27.271 INFO:tasks.workunit.client.0.smithi070.stdout:7/169: truncate d3/f2e 1046646 0 2023-10-08T08:45:27.273 INFO:tasks.workunit.client.0.smithi070.stdout:7/170: mknod d3/d19/d1b/c38 0 2023-10-08T08:45:27.274 INFO:tasks.workunit.client.0.smithi070.stdout:7/171: creat d3/d7/d9/f39 x:0 0 0 2023-10-08T08:45:27.275 INFO:tasks.workunit.client.0.smithi070.stdout:7/172: creat d3/d19/d1a/f3a x:0 0 0 2023-10-08T08:45:27.276 INFO:tasks.workunit.client.0.smithi070.stdout:7/173: symlink d3/l3b 0 2023-10-08T08:45:27.277 INFO:tasks.workunit.client.0.smithi070.stdout:7/174: creat d3/d19/f3c x:0 0 0 2023-10-08T08:45:27.278 INFO:tasks.workunit.client.0.smithi070.stdout:7/175: creat d3/f3d x:0 0 0 2023-10-08T08:45:27.278 INFO:tasks.workunit.client.0.smithi070.stdout:7/176: dread - d3/d7/f25 zero size 2023-10-08T08:45:27.279 INFO:tasks.workunit.client.0.smithi070.stdout:7/177: symlink d3/l3e 0 2023-10-08T08:45:27.281 INFO:tasks.workunit.client.0.smithi070.stdout:7/178: getdents d3/d7 0 2023-10-08T08:45:27.283 INFO:tasks.workunit.client.0.smithi070.stdout:7/179: symlink d3/d7/d9/l3f 0 2023-10-08T08:45:27.287 INFO:tasks.workunit.client.0.smithi070.stdout:7/180: getdents d3/d19/d1a 0 2023-10-08T08:45:27.287 INFO:tasks.workunit.client.0.smithi070.stdout:7/181: chown d3/l3e 627777 1 2023-10-08T08:45:27.290 INFO:tasks.workunit.client.0.smithi070.stdout:7/182: creat d3/d19/d1a/f40 x:0 0 0 2023-10-08T08:45:27.290 INFO:tasks.workunit.client.0.smithi070.stdout:7/183: readlink d3/d7/l15 0 2023-10-08T08:45:27.291 INFO:tasks.workunit.client.0.smithi070.stdout:7/184: unlink d3/d7/d9/f2c 0 2023-10-08T08:45:27.292 INFO:tasks.workunit.client.0.smithi070.stdout:7/185: creat d3/d19/d1b/f41 x:0 0 0 2023-10-08T08:45:27.293 INFO:tasks.workunit.client.0.smithi070.stdout:7/186: read - d3/d19/d1b/f41 zero size 2023-10-08T08:45:27.293 INFO:tasks.workunit.client.0.smithi070.stdout:7/187: chown d3/d19/d1b/d1e/l36 225 1 2023-10-08T08:45:27.293 INFO:tasks.workunit.client.0.smithi070.stdout:7/188: rename d3/d19/d1b/l2a to d3/d7/d9/l42 0 2023-10-08T08:45:27.294 INFO:tasks.workunit.client.0.smithi070.stdout:7/189: fdatasync d3/f3d 0 2023-10-08T08:45:27.294 INFO:tasks.workunit.client.0.smithi070.stdout:7/190: creat d3/d7/f43 x:0 0 0 2023-10-08T08:45:27.295 INFO:tasks.workunit.client.0.smithi070.stdout:7/191: stat d3/l3e 0 2023-10-08T08:45:27.295 INFO:tasks.workunit.client.0.smithi070.stdout:7/192: fdatasync d3/f37 0 2023-10-08T08:45:27.309 INFO:tasks.workunit.client.0.smithi070.stdout:3/133: dwrite d0/d12/f2d [0,4194304] 0 2023-10-08T08:45:27.311 INFO:tasks.workunit.client.0.smithi070.stdout:3/134: mkdir d0/db/d10/d24/d2f 0 2023-10-08T08:45:27.313 INFO:tasks.workunit.client.0.smithi070.stdout:7/193: dwrite d3/d7/d9/f39 [0,4194304] 0 2023-10-08T08:45:27.313 INFO:tasks.workunit.client.0.smithi070.stdout:5/196: dwrite d5/f26 [0,4194304] 0 2023-10-08T08:45:27.313 INFO:tasks.workunit.client.0.smithi070.stdout:5/197: fdatasync d5/da/f1f 0 2023-10-08T08:45:27.317 INFO:tasks.workunit.client.0.smithi070.stdout:7/194: symlink d3/d7/l44 0 2023-10-08T08:45:27.320 INFO:tasks.workunit.client.0.smithi070.stdout:7/195: creat d3/d19/d1b/f45 x:0 0 0 2023-10-08T08:45:27.320 INFO:tasks.workunit.client.0.smithi070.stdout:7/196: readlink d3/l27 0 2023-10-08T08:45:27.321 INFO:tasks.workunit.client.0.smithi070.stdout:5/198: symlink d5/da/l4b 0 2023-10-08T08:45:27.321 INFO:tasks.workunit.client.0.smithi070.stdout:5/199: write d5/da/d22/f32 [2178356,109688] 0 2023-10-08T08:45:27.321 INFO:tasks.workunit.client.0.smithi070.stdout:6/133: dread df/f10 [0,4194304] 0 2023-10-08T08:45:27.321 INFO:tasks.workunit.client.0.smithi070.stdout:6/134: read - df/f15 zero size 2023-10-08T08:45:27.322 INFO:tasks.workunit.client.0.smithi070.stdout:7/197: rename d3/d19/d1b/f45 to d3/d19/d1b/d1e/f46 0 2023-10-08T08:45:27.328 INFO:tasks.workunit.client.0.smithi070.stdout:5/200: creat d5/da/d22/d36/d41/f4c x:0 0 0 2023-10-08T08:45:27.329 INFO:tasks.workunit.client.0.smithi070.stdout:6/135: mknod df/d11/d1d/c2c 0 2023-10-08T08:45:27.329 INFO:tasks.workunit.client.0.smithi070.stdout:5/201: dread - d5/da/d22/f47 zero size 2023-10-08T08:45:27.330 INFO:tasks.workunit.client.0.smithi070.stdout:7/198: getdents d3/d19/d1a 0 2023-10-08T08:45:27.330 INFO:tasks.workunit.client.0.smithi070.stdout:7/199: readlink d3/d19/d1b/d1e/l36 0 2023-10-08T08:45:27.331 INFO:tasks.workunit.client.0.smithi070.stdout:7/200: chown d3/d19/d1b/d1e/l36 818 1 2023-10-08T08:45:27.331 INFO:tasks.workunit.client.0.smithi070.stdout:3/135: dwrite d0/f1 [0,4194304] 0 2023-10-08T08:45:27.331 INFO:tasks.workunit.client.0.smithi070.stdout:3/136: dread - d0/db/f26 zero size 2023-10-08T08:45:27.332 INFO:tasks.workunit.client.0.smithi070.stdout:6/136: symlink df/d11/d1d/l2d 0 2023-10-08T08:45:27.333 INFO:tasks.workunit.client.0.smithi070.stdout:7/201: creat d3/f47 x:0 0 0 2023-10-08T08:45:27.334 INFO:tasks.workunit.client.0.smithi070.stdout:6/137: write df/f20 [416422,119201] 0 2023-10-08T08:45:27.336 INFO:tasks.workunit.client.0.smithi070.stdout:5/202: rename d5/da/d22/d36 to d5/da/d4d 0 2023-10-08T08:45:27.336 INFO:tasks.workunit.client.0.smithi070.stdout:5/203: write d5/da/d22/f47 [877463,127029] 0 2023-10-08T08:45:27.337 INFO:tasks.workunit.client.0.smithi070.stdout:6/138: symlink df/d11/l2e 0 2023-10-08T08:45:27.337 INFO:tasks.workunit.client.0.smithi070.stdout:6/139: truncate df/d11/d1d/f1f 182258 0 2023-10-08T08:45:27.339 INFO:tasks.workunit.client.0.smithi070.stdout:7/202: rename d3/f2d to d3/d7/d9/f48 0 2023-10-08T08:45:27.339 INFO:tasks.workunit.client.0.smithi070.stdout:7/203: dread - d3/d19/d1b/f41 zero size 2023-10-08T08:45:27.339 INFO:tasks.workunit.client.0.smithi070.stdout:6/140: creat df/d26/f2f x:0 0 0 2023-10-08T08:45:27.339 INFO:tasks.workunit.client.0.smithi070.stdout:6/141: write f7 [5176964,14751] 0 2023-10-08T08:45:27.340 INFO:tasks.workunit.client.0.smithi070.stdout:5/204: dread d5/da/f1f [0,4194304] 0 2023-10-08T08:45:27.342 INFO:tasks.workunit.client.0.smithi070.stdout:7/204: mknod d3/d19/d1b/d1e/c49 0 2023-10-08T08:45:27.342 INFO:tasks.workunit.client.0.smithi070.stdout:3/137: dread d0/d12/d14/f1c [0,4194304] 0 2023-10-08T08:45:27.343 INFO:tasks.workunit.client.0.smithi070.stdout:6/142: creat df/d26/f30 x:0 0 0 2023-10-08T08:45:27.346 INFO:tasks.workunit.client.0.smithi070.stdout:3/138: unlink d0/d12/d14/f25 0 2023-10-08T08:45:27.347 INFO:tasks.workunit.client.0.smithi070.stdout:6/143: creat df/d11/f31 x:0 0 0 2023-10-08T08:45:27.348 INFO:tasks.workunit.client.0.smithi070.stdout:7/205: getdents d3/d7 0 2023-10-08T08:45:27.350 INFO:tasks.workunit.client.0.smithi070.stdout:3/139: creat d0/db/d10/d24/d2f/f30 x:0 0 0 2023-10-08T08:45:27.354 INFO:tasks.workunit.client.0.smithi070.stdout:6/144: rename l6 to df/d26/l32 0 2023-10-08T08:45:27.354 INFO:tasks.workunit.client.0.smithi070.stdout:8/205: sync 2023-10-08T08:45:27.354 INFO:tasks.workunit.client.0.smithi070.stdout:4/120: sync 2023-10-08T08:45:27.354 INFO:tasks.workunit.client.0.smithi070.stdout:0/203: sync 2023-10-08T08:45:27.354 INFO:tasks.workunit.client.0.smithi070.stdout:2/168: sync 2023-10-08T08:45:27.354 INFO:tasks.workunit.client.0.smithi070.stdout:2/169: chown df/l13 534 1 2023-10-08T08:45:27.357 INFO:tasks.workunit.client.0.smithi070.stdout:4/121: symlink dc/d17/d24/l25 0 2023-10-08T08:45:27.361 INFO:tasks.workunit.client.0.smithi070.stdout:8/206: getdents d1/d2/d6/d22 0 2023-10-08T08:45:27.363 INFO:tasks.workunit.client.0.smithi070.stdout:4/122: creat dc/d17/d1f/f26 x:0 0 0 2023-10-08T08:45:27.363 INFO:tasks.workunit.client.0.smithi070.stdout:4/123: chown dc/d17/f21 760070 1 2023-10-08T08:45:27.367 INFO:tasks.workunit.client.0.smithi070.stdout:4/124: creat dc/d17/f27 x:0 0 0 2023-10-08T08:45:27.368 INFO:tasks.workunit.client.0.smithi070.stdout:6/145: dread df/f20 [0,4194304] 0 2023-10-08T08:45:27.369 INFO:tasks.workunit.client.0.smithi070.stdout:4/125: truncate dc/d17/f20 1710101 0 2023-10-08T08:45:27.369 INFO:tasks.workunit.client.0.smithi070.stdout:4/126: chown dc/d17/f20 13 1 2023-10-08T08:45:27.369 INFO:tasks.workunit.client.0.smithi070.stdout:2/170: dread df/d12/d15/f18 [0,4194304] 0 2023-10-08T08:45:27.370 INFO:tasks.workunit.client.0.smithi070.stdout:8/207: write d1/de/d1a/f1b [1053401,121696] 0 2023-10-08T08:45:27.371 INFO:tasks.workunit.client.0.smithi070.stdout:4/127: rename dc/d17/l1c to dc/d17/l28 0 2023-10-08T08:45:27.372 INFO:tasks.workunit.client.0.smithi070.stdout:7/206: rename d3/d7 to d3/d19/d1b/d4a 0 2023-10-08T08:45:27.372 INFO:tasks.workunit.client.0.smithi070.stdout:7/207: truncate d3/d19/d1a/f3a 432094 0 2023-10-08T08:45:27.372 INFO:tasks.workunit.client.0.smithi070.stdout:6/146: getdents df/d26 0 2023-10-08T08:45:27.375 INFO:tasks.workunit.client.0.smithi070.stdout:3/140: rename d0/f8 to d0/db/d10/d24/f31 0 2023-10-08T08:45:27.375 INFO:tasks.workunit.client.0.smithi070.stdout:2/171: rename df/d12/d1b to df/d12/d1b/d36 22 2023-10-08T08:45:27.376 INFO:tasks.workunit.client.0.smithi070.stdout:0/204: dread d1/f5 [8388608,4194304] 0 2023-10-08T08:45:27.376 INFO:tasks.workunit.client.0.smithi070.stdout:7/208: creat d3/d19/d1a/f4b x:0 0 0 2023-10-08T08:45:27.377 INFO:tasks.workunit.client.0.smithi070.stdout:7/209: chown d3/d19/d1a/f3a 8810396 1 2023-10-08T08:45:27.378 INFO:tasks.workunit.client.0.smithi070.stdout:6/147: link df/d11/l2e df/d26/l33 0 2023-10-08T08:45:27.378 INFO:tasks.workunit.client.0.smithi070.stdout:6/148: dread - df/f27 zero size 2023-10-08T08:45:27.378 INFO:tasks.workunit.client.0.smithi070.stdout:0/205: dread d1/dd/ff [0,4194304] 0 2023-10-08T08:45:27.378 INFO:tasks.workunit.client.0.smithi070.stdout:0/206: chown d1/d1d/l1e 21 1 2023-10-08T08:45:27.380 INFO:tasks.workunit.client.0.smithi070.stdout:7/210: mkdir d3/d19/d1b/d1e/d4c 0 2023-10-08T08:45:27.381 INFO:tasks.workunit.client.0.smithi070.stdout:7/211: chown d3/d19/d1b/d1e/l36 21 1 2023-10-08T08:45:27.381 INFO:tasks.workunit.client.0.smithi070.stdout:6/149: chown df/d26/f30 1 1 2023-10-08T08:45:27.381 INFO:tasks.workunit.client.0.smithi070.stdout:0/207: mknod d1/d14/d1c/c3b 0 2023-10-08T08:45:27.381 INFO:tasks.workunit.client.0.smithi070.stdout:0/208: rename d1/d14/d1c to d1/d14/d1c/d3c 22 2023-10-08T08:45:27.382 INFO:tasks.workunit.client.0.smithi070.stdout:3/141: truncate d0/d12/f2d 643635 0 2023-10-08T08:45:27.383 INFO:tasks.workunit.client.0.smithi070.stdout:7/212: symlink d3/d19/d1a/l4d 0 2023-10-08T08:45:27.384 INFO:tasks.workunit.client.0.smithi070.stdout:6/150: truncate df/d11/f1a 76154 0 2023-10-08T08:45:27.387 INFO:tasks.workunit.client.0.smithi070.stdout:0/209: creat d1/dd/f3d x:0 0 0 2023-10-08T08:45:27.387 INFO:tasks.workunit.client.0.smithi070.stdout:0/210: chown d1/dd 208 1 2023-10-08T08:45:27.388 INFO:tasks.workunit.client.0.smithi070.stdout:0/211: dread - d1/dd/f3a zero size 2023-10-08T08:45:27.388 INFO:tasks.workunit.client.0.smithi070.stdout:3/142: symlink d0/db/d10/d24/d2f/l32 0 2023-10-08T08:45:27.388 INFO:tasks.workunit.client.0.smithi070.stdout:0/212: stat d1/d14/d1c/d38/f39 0 2023-10-08T08:45:27.388 INFO:tasks.workunit.client.0.smithi070.stdout:3/143: write d0/db/d10/d24/d2f/f30 [782812,115512] 0 2023-10-08T08:45:27.388 INFO:tasks.workunit.client.0.smithi070.stdout:7/213: creat d3/d19/d1a/f4e x:0 0 0 2023-10-08T08:45:27.388 INFO:tasks.workunit.client.0.smithi070.stdout:2/172: dread fc [0,4194304] 0 2023-10-08T08:45:27.389 INFO:tasks.workunit.client.0.smithi070.stdout:6/151: dread - df/d26/f2f zero size 2023-10-08T08:45:27.390 INFO:tasks.workunit.client.0.smithi070.stdout:6/152: chown f7 181139 1 2023-10-08T08:45:27.391 INFO:tasks.workunit.client.0.smithi070.stdout:0/213: write d1/f7 [169015,33465] 0 2023-10-08T08:45:27.393 INFO:tasks.workunit.client.0.smithi070.stdout:4/128: dwrite dc/d17/f27 [0,4194304] 0 2023-10-08T08:45:27.393 INFO:tasks.workunit.client.0.smithi070.stdout:4/129: dread - dc/d17/d1f/f26 zero size 2023-10-08T08:45:27.395 INFO:tasks.workunit.client.0.smithi070.stdout:7/214: symlink d3/d19/d1b/d4a/d9/l4f 0 2023-10-08T08:45:27.395 INFO:tasks.workunit.client.0.smithi070.stdout:7/215: chown d3/d19/d1a/c24 102265688 1 2023-10-08T08:45:27.399 INFO:tasks.workunit.client.0.smithi070.stdout:8/208: dwrite d1/de/d21/f35 [0,4194304] 0 2023-10-08T08:45:27.402 INFO:tasks.workunit.client.0.smithi070.stdout:6/153: truncate df/f1b 828505 0 2023-10-08T08:45:27.402 INFO:tasks.workunit.client.0.smithi070.stdout:2/173: rmdir df 39 2023-10-08T08:45:27.404 INFO:tasks.workunit.client.0.smithi070.stdout:6/154: getdents df/d26 0 2023-10-08T08:45:27.407 INFO:tasks.workunit.client.0.smithi070.stdout:2/174: rename df/d12/d15/f18 to df/d12/f37 0 2023-10-08T08:45:27.412 INFO:tasks.workunit.client.0.smithi070.stdout:2/175: rename df/c10 to df/d12/d1b/d1c/c38 0 2023-10-08T08:45:27.412 INFO:tasks.workunit.client.0.smithi070.stdout:2/176: readlink df/d12/d1b/l27 0 2023-10-08T08:45:27.412 INFO:tasks.workunit.client.0.smithi070.stdout:3/144: truncate d0/d12/f2d 263568 0 2023-10-08T08:45:27.413 INFO:tasks.workunit.client.0.smithi070.stdout:6/155: mknod df/d11/c34 0 2023-10-08T08:45:27.417 INFO:tasks.workunit.client.0.smithi070.stdout:6/156: rename df/f24 to df/d26/f35 0 2023-10-08T08:45:27.417 INFO:tasks.workunit.client.0.smithi070.stdout:0/214: write d1/f5 [3634854,66701] 0 2023-10-08T08:45:27.417 INFO:tasks.workunit.client.0.smithi070.stdout:4/130: dwrite dc/f1d [0,4194304] 0 2023-10-08T08:45:27.417 INFO:tasks.workunit.client.0.smithi070.stdout:4/131: fdatasync dc/d17/f27 0 2023-10-08T08:45:27.418 INFO:tasks.workunit.client.0.smithi070.stdout:3/145: creat d0/d12/d14/d1d/d22/f33 x:0 0 0 2023-10-08T08:45:27.418 INFO:tasks.workunit.client.0.smithi070.stdout:3/146: truncate d0/db/f29 1697712 0 2023-10-08T08:45:27.419 INFO:tasks.workunit.client.0.smithi070.stdout:2/177: link df/d12/f37 df/f39 0 2023-10-08T08:45:27.421 INFO:tasks.workunit.client.0.smithi070.stdout:6/157: unlink ce 0 2023-10-08T08:45:27.426 INFO:tasks.workunit.client.0.smithi070.stdout:6/158: read f4 [2104388,41013] 0 2023-10-08T08:45:27.426 INFO:tasks.workunit.client.0.smithi070.stdout:8/209: dwrite d1/de/f37 [0,4194304] 0 2023-10-08T08:45:27.426 INFO:tasks.workunit.client.0.smithi070.stdout:7/216: dwrite d3/d19/d1a/f40 [0,4194304] 0 2023-10-08T08:45:27.426 INFO:tasks.workunit.client.0.smithi070.stdout:7/217: chown d3/f37 49 1 2023-10-08T08:45:27.427 INFO:tasks.workunit.client.0.smithi070.stdout:4/132: unlink dc/d17/l28 0 2023-10-08T08:45:27.429 INFO:tasks.workunit.client.0.smithi070.stdout:2/178: mkdir df/d3a 0 2023-10-08T08:45:27.431 INFO:tasks.workunit.client.0.smithi070.stdout:2/179: write fb [1216314,51114] 0 2023-10-08T08:45:27.434 INFO:tasks.workunit.client.0.smithi070.stdout:8/210: write d1/de/f37 [1310274,72532] 0 2023-10-08T08:45:27.435 INFO:tasks.workunit.client.0.smithi070.stdout:8/211: write d1/f24 [1489381,37470] 0 2023-10-08T08:45:27.437 INFO:tasks.workunit.client.0.smithi070.stdout:8/212: write d1/d2/f2d [3912947,54765] 0 2023-10-08T08:45:27.437 INFO:tasks.workunit.client.0.smithi070.stdout:8/213: write d1/d2/d6/fa [543006,124677] 0 2023-10-08T08:45:27.441 INFO:tasks.workunit.client.0.smithi070.stdout:4/133: rename dc/f18 to dc/d17/d1f/f29 0 2023-10-08T08:45:27.442 INFO:tasks.workunit.client.0.smithi070.stdout:3/147: rmdir d0/db/d10/d24/d2f 39 2023-10-08T08:45:27.442 INFO:tasks.workunit.client.0.smithi070.stdout:3/148: fsync d0/db/d10/d24/d2f/f30 0 2023-10-08T08:45:27.443 INFO:tasks.workunit.client.0.smithi070.stdout:6/159: mknod df/d11/c36 0 2023-10-08T08:45:27.446 INFO:tasks.workunit.client.0.smithi070.stdout:8/214: creat d1/de/d1a/f49 x:0 0 0 2023-10-08T08:45:27.446 INFO:tasks.workunit.client.0.smithi070.stdout:8/215: chown d1/de/d1a/l3e 1051 1 2023-10-08T08:45:27.446 INFO:tasks.workunit.client.0.smithi070.stdout:8/216: stat d1/de/f37 0 2023-10-08T08:45:27.446 INFO:tasks.workunit.client.0.smithi070.stdout:8/217: chown d1/d2/d6/fa 712562282 1 2023-10-08T08:45:27.447 INFO:tasks.workunit.client.0.smithi070.stdout:6/160: unlink f1 0 2023-10-08T08:45:27.449 INFO:tasks.workunit.client.0.smithi070.stdout:6/161: creat df/d26/f37 x:0 0 0 2023-10-08T08:45:27.449 INFO:tasks.workunit.client.0.smithi070.stdout:6/162: readlink l0 0 2023-10-08T08:45:27.450 INFO:tasks.workunit.client.0.smithi070.stdout:6/163: dread f2 [4194304,4194304] 0 2023-10-08T08:45:27.450 INFO:tasks.workunit.client.0.smithi070.stdout:6/164: stat f5 0 2023-10-08T08:45:27.450 INFO:tasks.workunit.client.0.smithi070.stdout:6/165: write df/f27 [742370,61748] 0 2023-10-08T08:45:27.452 INFO:tasks.workunit.client.0.smithi070.stdout:6/166: link df/d11/l2a df/d26/l38 0 2023-10-08T08:45:27.452 INFO:tasks.workunit.client.0.smithi070.stdout:7/218: dwrite d3/d19/d1b/d1e/f46 [0,4194304] 0 2023-10-08T08:45:27.455 INFO:tasks.workunit.client.0.smithi070.stdout:7/219: unlink d3/d19/d1b/d4a/d9/l4f 0 2023-10-08T08:45:27.455 INFO:tasks.workunit.client.0.smithi070.stdout:2/180: dwrite df/d12/d15/f17 [0,4194304] 0 2023-10-08T08:45:27.456 INFO:tasks.workunit.client.0.smithi070.stdout:2/181: chown df/d12/d1b/d1c/l21 1046997 1 2023-10-08T08:45:27.459 INFO:tasks.workunit.client.0.smithi070.stdout:7/220: unlink d3/d19/d1a/c24 0 2023-10-08T08:45:27.459 INFO:tasks.workunit.client.0.smithi070.stdout:7/221: fdatasync d3/d19/d1b/f41 0 2023-10-08T08:45:27.459 INFO:tasks.workunit.client.0.smithi070.stdout:7/222: readlink d3/l27 0 2023-10-08T08:45:27.460 INFO:tasks.workunit.client.0.smithi070.stdout:2/182: mknod df/d12/d25/c3b 0 2023-10-08T08:45:27.460 INFO:tasks.workunit.client.0.smithi070.stdout:2/183: chown df/d12/d1b/d1c/f26 0 1 2023-10-08T08:45:27.460 INFO:tasks.workunit.client.0.smithi070.stdout:2/184: stat df/d12/d1b 0 2023-10-08T08:45:27.460 INFO:tasks.workunit.client.0.smithi070.stdout:8/218: dread d1/d2/d6/d22/f2b [0,4194304] 0 2023-10-08T08:45:27.461 INFO:tasks.workunit.client.0.smithi070.stdout:7/223: mkdir d3/d19/d1b/d4a/d50 0 2023-10-08T08:45:27.461 INFO:tasks.workunit.client.0.smithi070.stdout:7/224: truncate d3/d19/d1a/f4b 136322 0 2023-10-08T08:45:27.462 INFO:tasks.workunit.client.0.smithi070.stdout:2/185: creat df/d12/d1b/f3c x:0 0 0 2023-10-08T08:45:27.463 INFO:tasks.workunit.client.0.smithi070.stdout:8/219: creat d1/d2/f4a x:0 0 0 2023-10-08T08:45:27.463 INFO:tasks.workunit.client.0.smithi070.stdout:8/220: readlink d1/d23/l44 0 2023-10-08T08:45:27.464 INFO:tasks.workunit.client.0.smithi070.stdout:7/225: mkdir d3/d19/d1b/d4a/d50/d51 0 2023-10-08T08:45:27.466 INFO:tasks.workunit.client.0.smithi070.stdout:2/186: link df/d12/l35 df/l3d 0 2023-10-08T08:45:27.466 INFO:tasks.workunit.client.0.smithi070.stdout:2/187: chown l1 793745 1 2023-10-08T08:45:27.467 INFO:tasks.workunit.client.0.smithi070.stdout:8/221: write d1/de/f37 [173649,48014] 0 2023-10-08T08:45:27.468 INFO:tasks.workunit.client.0.smithi070.stdout:7/226: unlink d3/d19/d1b/d4a/d9/f39 0 2023-10-08T08:45:27.468 INFO:tasks.workunit.client.0.smithi070.stdout:3/149: dwrite d0/d12/d14/f2a [4194304,4194304] 0 2023-10-08T08:45:27.469 INFO:tasks.workunit.client.0.smithi070.stdout:5/205: sync 2023-10-08T08:45:27.469 INFO:tasks.workunit.client.0.smithi070.stdout:1/154: sync 2023-10-08T08:45:27.470 INFO:tasks.workunit.client.0.smithi070.stdout:9/122: sync 2023-10-08T08:45:27.470 INFO:tasks.workunit.client.0.smithi070.stdout:2/188: creat df/d12/d25/f3e x:0 0 0 2023-10-08T08:45:27.471 INFO:tasks.workunit.client.0.smithi070.stdout:8/222: truncate d1/d2/f2d 3902838 0 2023-10-08T08:45:27.472 INFO:tasks.workunit.client.0.smithi070.stdout:7/227: mknod d3/d19/d1b/d4a/c52 0 2023-10-08T08:45:27.474 INFO:tasks.workunit.client.0.smithi070.stdout:6/167: dwrite df/d11/f31 [0,4194304] 0 2023-10-08T08:45:27.474 INFO:tasks.workunit.client.0.smithi070.stdout:6/168: dread - df/d26/f37 zero size 2023-10-08T08:45:27.474 INFO:tasks.workunit.client.0.smithi070.stdout:6/169: fsync df/f17 0 2023-10-08T08:45:27.475 INFO:tasks.workunit.client.0.smithi070.stdout:3/150: unlink d0/db/lf 0 2023-10-08T08:45:27.475 INFO:tasks.workunit.client.0.smithi070.stdout:4/134: dread dc/f12 [0,4194304] 0 2023-10-08T08:45:27.475 INFO:tasks.workunit.client.0.smithi070.stdout:9/123: mkdir d1/dd/d1a/d28 0 2023-10-08T08:45:27.475 INFO:tasks.workunit.client.0.smithi070.stdout:3/151: write d0/db/f15 [170175,114699] 0 2023-10-08T08:45:27.477 INFO:tasks.workunit.client.0.smithi070.stdout:5/206: symlink d5/da/d4d/d41/l4e 0 2023-10-08T08:45:27.477 INFO:tasks.workunit.client.0.smithi070.stdout:5/207: write d5/da/d22/f47 [1045018,114169] 0 2023-10-08T08:45:27.478 INFO:tasks.workunit.client.0.smithi070.stdout:2/189: mknod df/d12/d1b/d1c/c3f 0 2023-10-08T08:45:27.479 INFO:tasks.workunit.client.0.smithi070.stdout:2/190: write df/d12/d1b/d1c/f26 [635474,26591] 0 2023-10-08T08:45:27.480 INFO:tasks.workunit.client.0.smithi070.stdout:6/170: write f9 [2602950,103690] 0 2023-10-08T08:45:27.481 INFO:tasks.workunit.client.0.smithi070.stdout:7/228: getdents d3/d19/d1b/d4a/d50 0 2023-10-08T08:45:27.482 INFO:tasks.workunit.client.0.smithi070.stdout:7/229: write d3/d19/d1a/f22 [1098733,68205] 0 2023-10-08T08:45:27.488 INFO:tasks.workunit.client.0.smithi070.stdout:4/135: symlink dc/d17/d24/l2a 0 2023-10-08T08:45:27.488 INFO:tasks.workunit.client.0.smithi070.stdout:4/136: dread - dc/d17/f23 zero size 2023-10-08T08:45:27.488 INFO:tasks.workunit.client.0.smithi070.stdout:4/137: chown f6 2627 1 2023-10-08T08:45:27.489 INFO:tasks.workunit.client.0.smithi070.stdout:1/155: dwrite d6/dc/d14/d1f/f25 [0,4194304] 0 2023-10-08T08:45:27.493 INFO:tasks.workunit.client.0.smithi070.stdout:9/124: rmdir d1/dd 39 2023-10-08T08:45:27.493 INFO:tasks.workunit.client.0.smithi070.stdout:9/125: chown d1/dd/d19/l24 27654 1 2023-10-08T08:45:27.493 INFO:tasks.workunit.client.0.smithi070.stdout:9/126: fdatasync f0 0 2023-10-08T08:45:27.493 INFO:tasks.workunit.client.0.smithi070.stdout:3/152: creat d0/d12/d14/d1d/f34 x:0 0 0 2023-10-08T08:45:27.495 INFO:tasks.workunit.client.0.smithi070.stdout:5/208: creat d5/da/d4d/d41/f4f x:0 0 0 2023-10-08T08:45:27.496 INFO:tasks.workunit.client.0.smithi070.stdout:2/191: rename df/d12/l19 to df/d12/d15/d34/l40 0 2023-10-08T08:45:27.498 INFO:tasks.workunit.client.0.smithi070.stdout:7/230: mknod d3/d19/d1b/d4a/d50/c53 0 2023-10-08T08:45:27.501 INFO:tasks.workunit.client.0.smithi070.stdout:8/223: rmdir d1 39 2023-10-08T08:45:27.502 INFO:tasks.workunit.client.0.smithi070.stdout:4/138: truncate dc/f10 441516 0 2023-10-08T08:45:27.502 INFO:tasks.workunit.client.0.smithi070.stdout:4/139: dread - dc/f1e zero size 2023-10-08T08:45:27.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/156: truncate d6/f18 3595658 0 2023-10-08T08:45:27.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/157: getdents d6/dc/d14/d1f/d29 0 2023-10-08T08:45:27.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/158: chown d6 2 1 2023-10-08T08:45:27.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/159: truncate d6/dc/d14/d1f/f2b 184612 0 2023-10-08T08:45:27.510 INFO:tasks.workunit.client.0.smithi070.stdout:9/127: symlink d1/dd/d19/l29 0 2023-10-08T08:45:27.512 INFO:tasks.workunit.client.0.smithi070.stdout:5/209: creat d5/da/f50 x:0 0 0 2023-10-08T08:45:27.512 INFO:tasks.workunit.client.0.smithi070.stdout:2/192: creat df/d12/d15/f41 x:0 0 0 2023-10-08T08:45:27.515 INFO:tasks.workunit.client.0.smithi070.stdout:8/224: creat d1/d2/d6/d22/f4b x:0 0 0 2023-10-08T08:45:27.515 INFO:tasks.workunit.client.0.smithi070.stdout:4/140: symlink dc/d17/d1f/l2b 0 2023-10-08T08:45:27.515 INFO:tasks.workunit.client.0.smithi070.stdout:4/141: readlink dc/d17/d24/l25 0 2023-10-08T08:45:27.516 INFO:tasks.workunit.client.0.smithi070.stdout:6/171: dwrite df/d11/f31 [4194304,4194304] 0 2023-10-08T08:45:27.516 INFO:tasks.workunit.client.0.smithi070.stdout:9/128: creat d1/f2a x:0 0 0 2023-10-08T08:45:27.517 INFO:tasks.workunit.client.0.smithi070.stdout:3/153: rmdir d0/d12/d14 39 2023-10-08T08:45:27.518 INFO:tasks.workunit.client.0.smithi070.stdout:3/154: chown d0/c19 7673835 1 2023-10-08T08:45:27.519 INFO:tasks.workunit.client.0.smithi070.stdout:2/193: creat df/d12/d15/f42 x:0 0 0 2023-10-08T08:45:27.519 INFO:tasks.workunit.client.0.smithi070.stdout:7/231: dwrite d3/d19/d1a/f4b [0,4194304] 0 2023-10-08T08:45:27.519 INFO:tasks.workunit.client.0.smithi070.stdout:7/232: fsync d3/d19/d1a/f2f 0 2023-10-08T08:45:27.521 INFO:tasks.workunit.client.0.smithi070.stdout:0/215: sync 2023-10-08T08:45:27.523 INFO:tasks.workunit.client.0.smithi070.stdout:9/129: symlink d1/dd/l2b 0 2023-10-08T08:45:27.526 INFO:tasks.workunit.client.0.smithi070.stdout:8/225: dread d1/d23/f28 [0,4194304] 0 2023-10-08T08:45:27.527 INFO:tasks.workunit.client.0.smithi070.stdout:2/194: unlink df/d12/d1b/d1c/f26 0 2023-10-08T08:45:27.531 INFO:tasks.workunit.client.0.smithi070.stdout:7/233: unlink d3/f12 0 2023-10-08T08:45:27.531 INFO:tasks.workunit.client.0.smithi070.stdout:7/234: fsync d3/d19/d1b/d4a/fd 0 2023-10-08T08:45:27.532 INFO:tasks.workunit.client.0.smithi070.stdout:4/142: getdents dc/d17/d1f 0 2023-10-08T08:45:27.533 INFO:tasks.workunit.client.0.smithi070.stdout:0/216: truncate d1/f11 3014527 0 2023-10-08T08:45:27.537 INFO:tasks.workunit.client.0.smithi070.stdout:5/210: dwrite d5/da/d4d/d37/f39 [0,4194304] 0 2023-10-08T08:45:27.537 INFO:tasks.workunit.client.0.smithi070.stdout:6/172: getdents df/d11 0 2023-10-08T08:45:27.538 INFO:tasks.workunit.client.0.smithi070.stdout:1/160: truncate d6/dc/d14/d1f/f2b 129410 0 2023-10-08T08:45:27.542 INFO:tasks.workunit.client.0.smithi070.stdout:9/130: unlink d1/dd/c7 0 2023-10-08T08:45:27.545 INFO:tasks.workunit.client.0.smithi070.stdout:3/155: rename d0/db/d10/d24/d2f/f30 to d0/d12/f35 0 2023-10-08T08:45:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:8/226: unlink d1/d2/f1f 0 2023-10-08T08:45:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:7/235: mknod d3/d19/d1b/d1e/c54 0 2023-10-08T08:45:27.554 INFO:tasks.workunit.client.0.smithi070.stdout:5/211: unlink d5/da/l1c 0 2023-10-08T08:45:27.554 INFO:tasks.workunit.client.0.smithi070.stdout:1/161: dread d6/dc/d14/d1f/f2b [0,4194304] 0 2023-10-08T08:45:27.554 INFO:tasks.workunit.client.0.smithi070.stdout:1/162: fsync d6/f10 0 2023-10-08T08:45:27.554 INFO:tasks.workunit.client.0.smithi070.stdout:6/173: symlink df/d11/d1d/l39 0 2023-10-08T08:45:27.555 INFO:tasks.workunit.client.0.smithi070.stdout:9/131: truncate d1/f20 3342974 0 2023-10-08T08:45:27.557 INFO:tasks.workunit.client.0.smithi070.stdout:5/212: write d5/ff [376709,76901] 0 2023-10-08T08:45:27.557 INFO:tasks.workunit.client.0.smithi070.stdout:3/156: link d0/ca d0/db/d10/d24/d2f/c36 0 2023-10-08T08:45:27.559 INFO:tasks.workunit.client.0.smithi070.stdout:8/227: creat d1/d2/d6/d22/f4c x:0 0 0 2023-10-08T08:45:27.559 INFO:tasks.workunit.client.0.smithi070.stdout:8/228: dread - d1/de/d2e/f42 zero size 2023-10-08T08:45:27.559 INFO:tasks.workunit.client.0.smithi070.stdout:2/195: dwrite df/d12/d15/f41 [0,4194304] 0 2023-10-08T08:45:27.561 INFO:tasks.workunit.client.0.smithi070.stdout:6/174: link l8 df/d26/l3a 0 2023-10-08T08:45:27.561 INFO:tasks.workunit.client.0.smithi070.stdout:6/175: chown df/f27 419347 1 2023-10-08T08:45:27.561 INFO:tasks.workunit.client.0.smithi070.stdout:8/229: write d1/d2/f1e [278979,93029] 0 2023-10-08T08:45:27.561 INFO:tasks.workunit.client.0.smithi070.stdout:7/236: write d3/d19/d1a/f40 [3769078,35716] 0 2023-10-08T08:45:27.562 INFO:tasks.workunit.client.0.smithi070.stdout:0/217: dwrite d1/dd/f3d [0,4194304] 0 2023-10-08T08:45:27.562 INFO:tasks.workunit.client.0.smithi070.stdout:5/213: mknod d5/da/d4d/d37/d38/c51 0 2023-10-08T08:45:27.563 INFO:tasks.workunit.client.0.smithi070.stdout:3/157: stat d0/c7 0 2023-10-08T08:45:27.567 INFO:tasks.workunit.client.0.smithi070.stdout:2/196: mknod df/d12/d1b/d1c/d2d/c43 0 2023-10-08T08:45:27.572 INFO:tasks.workunit.client.0.smithi070.stdout:7/237: creat d3/f55 x:0 0 0 2023-10-08T08:45:27.572 INFO:tasks.workunit.client.0.smithi070.stdout:7/238: chown d3/d19/d1b/d4a 0 1 2023-10-08T08:45:27.573 INFO:tasks.workunit.client.0.smithi070.stdout:0/218: truncate d1/d1d/f2b 286425 0 2023-10-08T08:45:27.575 INFO:tasks.workunit.client.0.smithi070.stdout:5/214: getdents d5/da/d4d/d37/d38 0 2023-10-08T08:45:27.579 INFO:tasks.workunit.client.0.smithi070.stdout:7/239: rename d3/d19/d1a/f3a to d3/d19/f56 0 2023-10-08T08:45:27.581 INFO:tasks.workunit.client.0.smithi070.stdout:8/230: mkdir d1/d4d 0 2023-10-08T08:45:27.581 INFO:tasks.workunit.client.0.smithi070.stdout:8/231: write d1/de/d2e/f48 [197395,69502] 0 2023-10-08T08:45:27.582 INFO:tasks.workunit.client.0.smithi070.stdout:0/219: link d1/cc d1/d14/d1f/c3e 0 2023-10-08T08:45:27.582 INFO:tasks.workunit.client.0.smithi070.stdout:0/220: readlink d1/dd/l10 0 2023-10-08T08:45:27.582 INFO:tasks.workunit.client.0.smithi070.stdout:8/232: mknod d1/de/d1a/c4e 0 2023-10-08T08:45:27.584 INFO:tasks.workunit.client.0.smithi070.stdout:0/221: read d1/dd/d1b/f34 [1518568,108969] 0 2023-10-08T08:45:27.584 INFO:tasks.workunit.client.0.smithi070.stdout:8/233: unlink f0 0 2023-10-08T08:45:27.586 INFO:tasks.workunit.client.0.smithi070.stdout:0/222: truncate d1/f11 2160119 0 2023-10-08T08:45:27.587 INFO:tasks.workunit.client.0.smithi070.stdout:8/234: truncate d1/de/d15/f40 2798033 0 2023-10-08T08:45:27.588 INFO:tasks.workunit.client.0.smithi070.stdout:8/235: getdents d1/de/d3a 0 2023-10-08T08:45:27.589 INFO:tasks.workunit.client.0.smithi070.stdout:8/236: creat d1/de/f4f x:0 0 0 2023-10-08T08:45:27.593 INFO:tasks.workunit.client.0.smithi070.stdout:5/215: dread d5/da/d2f/d30/f3d [0,4194304] 0 2023-10-08T08:45:27.593 INFO:tasks.workunit.client.0.smithi070.stdout:5/216: stat d5/da/d22/f32 0 2023-10-08T08:45:27.595 INFO:tasks.workunit.client.0.smithi070.stdout:5/217: link d5/ff d5/da/d22/f52 0 2023-10-08T08:45:27.597 INFO:tasks.workunit.client.0.smithi070.stdout:5/218: getdents d5/da 0 2023-10-08T08:45:27.618 INFO:tasks.workunit.client.0.smithi070.stdout:1/163: dwrite d6/dc/f27 [0,4194304] 0 2023-10-08T08:45:27.618 INFO:tasks.workunit.client.0.smithi070.stdout:1/164: dread - d6/f28 zero size 2023-10-08T08:45:27.626 INFO:tasks.workunit.client.0.smithi070.stdout:9/132: dwrite d1/dd/d19/f1b [0,4194304] 0 2023-10-08T08:45:27.626 INFO:tasks.workunit.client.0.smithi070.stdout:9/133: fsync d1/dd/fa 0 2023-10-08T08:45:27.626 INFO:tasks.workunit.client.0.smithi070.stdout:9/134: fdatasync d1/dd/d1a/f1d 0 2023-10-08T08:45:27.626 INFO:tasks.workunit.client.0.smithi070.stdout:9/135: chown d1/f25 110642311 1 2023-10-08T08:45:27.633 INFO:tasks.workunit.client.0.smithi070.stdout:5/219: dread d5/ff [0,4194304] 0 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:5/220: chown d5/da/d4d/d41/l4e 103145339 1 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:5/221: truncate d5/da/d4d/d41/f4c 879259 0 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:0/223: dwrite d1/dd/d1b/f34 [0,4194304] 0 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:9/136: symlink d1/dd/d26/l2c 0 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:6/176: dwrite df/d11/d1d/f1f [0,4194304] 0 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:6/177: chown df/f1b 1685 1 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:6/178: chown df/d26/l38 66027 1 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:5/222: truncate d5/da/d2f/d30/f3d 2099577 0 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:7/240: dwrite d3/d19/d1b/d4a/f8 [0,4194304] 0 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:9/137: rename d1/dd/d1a/d28 to d1/dd/d26/d27/d2d 0 2023-10-08T08:45:27.634 INFO:tasks.workunit.client.0.smithi070.stdout:2/197: dwrite df/d12/d15/f42 [0,4194304] 0 2023-10-08T08:45:27.635 INFO:tasks.workunit.client.0.smithi070.stdout:0/224: write d1/dd/f3d [2843160,66793] 0 2023-10-08T08:45:27.635 INFO:tasks.workunit.client.0.smithi070.stdout:0/225: truncate d1/d14/d1c/d38/f39 353406 0 2023-10-08T08:45:27.635 INFO:tasks.workunit.client.0.smithi070.stdout:0/226: fsync d1/d14/d1c/f31 0 2023-10-08T08:45:27.635 INFO:tasks.workunit.client.0.smithi070.stdout:5/223: truncate d5/da/d22/f47 525302 0 2023-10-08T08:45:27.635 INFO:tasks.workunit.client.0.smithi070.stdout:5/224: write d5/da/d22/f32 [2469258,9230] 0 2023-10-08T08:45:27.635 INFO:tasks.workunit.client.0.smithi070.stdout:8/237: dwrite d1/de/d15/f20 [0,4194304] 0 2023-10-08T08:45:27.636 INFO:tasks.workunit.client.0.smithi070.stdout:0/227: dread d1/d1d/f2b [0,4194304] 0 2023-10-08T08:45:27.641 INFO:tasks.workunit.client.0.smithi070.stdout:7/241: rename d3/d19/d1b/d4a/c52 to d3/d19/d1b/d4a/c57 0 2023-10-08T08:45:27.641 INFO:tasks.workunit.client.0.smithi070.stdout:7/242: dread - d3/d19/d1b/d4a/f43 zero size 2023-10-08T08:45:27.641 INFO:tasks.workunit.client.0.smithi070.stdout:7/243: chown d3/d19/d1b/d4a/cf 12 1 2023-10-08T08:45:27.642 INFO:tasks.workunit.client.0.smithi070.stdout:9/138: symlink d1/dd/d1a/l2e 0 2023-10-08T08:45:27.644 INFO:tasks.workunit.client.0.smithi070.stdout:2/198: creat df/d12/d25/f44 x:0 0 0 2023-10-08T08:45:27.644 INFO:tasks.workunit.client.0.smithi070.stdout:2/199: chown df/l29 386 1 2023-10-08T08:45:27.645 INFO:tasks.workunit.client.0.smithi070.stdout:7/244: dread d3/d19/d1a/f20 [0,4194304] 0 2023-10-08T08:45:27.645 INFO:tasks.workunit.client.0.smithi070.stdout:6/179: dread df/d11/f1a [0,4194304] 0 2023-10-08T08:45:27.646 INFO:tasks.workunit.client.0.smithi070.stdout:1/165: dwrite d6/dc/f1e [0,4194304] 0 2023-10-08T08:45:27.646 INFO:tasks.workunit.client.0.smithi070.stdout:5/225: creat d5/da/d4d/d41/f53 x:0 0 0 2023-10-08T08:45:27.648 INFO:tasks.workunit.client.0.smithi070.stdout:2/200: write df/d12/d15/f42 [194781,41317] 0 2023-10-08T08:45:27.653 INFO:tasks.workunit.client.0.smithi070.stdout:6/180: truncate f4 3342072 0 2023-10-08T08:45:27.653 INFO:tasks.workunit.client.0.smithi070.stdout:6/181: fdatasync df/d11/d1d/f1f 0 2023-10-08T08:45:27.653 INFO:tasks.workunit.client.0.smithi070.stdout:6/182: truncate f9 4748095 0 2023-10-08T08:45:27.657 INFO:tasks.workunit.client.0.smithi070.stdout:7/245: rmdir d3/d19/d1b/d4a/d50 39 2023-10-08T08:45:27.657 INFO:tasks.workunit.client.0.smithi070.stdout:7/246: readlink d3/l3e 0 2023-10-08T08:45:27.659 INFO:tasks.workunit.client.0.smithi070.stdout:1/166: creat d6/dc/f2d x:0 0 0 2023-10-08T08:45:27.661 INFO:tasks.workunit.client.0.smithi070.stdout:6/183: creat df/d26/f3b x:0 0 0 2023-10-08T08:45:27.661 INFO:tasks.workunit.client.0.smithi070.stdout:9/139: dread d1/dd/f10 [0,4194304] 0 2023-10-08T08:45:27.662 INFO:tasks.workunit.client.0.smithi070.stdout:2/201: read df/d12/d15/f42 [2888571,63053] 0 2023-10-08T08:45:27.662 INFO:tasks.workunit.client.0.smithi070.stdout:7/247: creat d3/d19/d1b/f58 x:0 0 0 2023-10-08T08:45:27.665 INFO:tasks.workunit.client.0.smithi070.stdout:1/167: symlink d6/dc/d14/d1f/d26/l2e 0 2023-10-08T08:45:27.666 INFO:tasks.workunit.client.0.smithi070.stdout:6/184: creat df/d11/d1d/f3c x:0 0 0 2023-10-08T08:45:27.666 INFO:tasks.workunit.client.0.smithi070.stdout:6/185: dread - df/d26/f37 zero size 2023-10-08T08:45:27.669 INFO:tasks.workunit.client.0.smithi070.stdout:7/248: mknod d3/d19/d1b/d4a/c59 0 2023-10-08T08:45:27.669 INFO:tasks.workunit.client.0.smithi070.stdout:7/249: fsync d3/d19/d1b/f41 0 2023-10-08T08:45:27.669 INFO:tasks.workunit.client.0.smithi070.stdout:7/250: write d3/d19/d1b/d4a/f25 [139473,73723] 0 2023-10-08T08:45:27.672 INFO:tasks.workunit.client.0.smithi070.stdout:1/168: creat d6/dc/d14/d1f/d29/f2f x:0 0 0 2023-10-08T08:45:27.674 INFO:tasks.workunit.client.0.smithi070.stdout:1/169: write d6/f20 [1771067,111802] 0 2023-10-08T08:45:27.675 INFO:tasks.workunit.client.0.smithi070.stdout:1/170: read d6/f20 [2550448,116798] 0 2023-10-08T08:45:27.676 INFO:tasks.workunit.client.0.smithi070.stdout:6/186: creat df/d11/d1d/f3d x:0 0 0 2023-10-08T08:45:27.676 INFO:tasks.workunit.client.0.smithi070.stdout:8/238: dwrite d1/d2/d6/fa [0,4194304] 0 2023-10-08T08:45:27.677 INFO:tasks.workunit.client.0.smithi070.stdout:8/239: chown d1/de/f37 865931 1 2023-10-08T08:45:27.677 INFO:tasks.workunit.client.0.smithi070.stdout:2/202: truncate df/d12/d15/f42 186733 0 2023-10-08T08:45:27.680 INFO:tasks.workunit.client.0.smithi070.stdout:1/171: symlink d6/dc/d14/d1f/l30 0 2023-10-08T08:45:27.680 INFO:tasks.workunit.client.0.smithi070.stdout:0/228: rename d1/d14/d1c to d1/d3f 0 2023-10-08T08:45:27.681 INFO:tasks.workunit.client.0.smithi070.stdout:0/229: write d1/d1d/d24/f36 [63818,89231] 0 2023-10-08T08:45:27.681 INFO:tasks.workunit.client.0.smithi070.stdout:6/187: symlink df/l3e 0 2023-10-08T08:45:27.687 INFO:tasks.workunit.client.0.smithi070.stdout:2/203: mknod df/d12/d1b/d1c/c45 0 2023-10-08T08:45:27.687 INFO:tasks.workunit.client.0.smithi070.stdout:2/204: chown df/d12/d25/c3b 0 1 2023-10-08T08:45:27.687 INFO:tasks.workunit.client.0.smithi070.stdout:2/205: dread - df/d12/d1b/f3c zero size 2023-10-08T08:45:27.687 INFO:tasks.workunit.client.0.smithi070.stdout:7/251: dread d3/d19/d1a/f40 [0,4194304] 0 2023-10-08T08:45:27.688 INFO:tasks.workunit.client.0.smithi070.stdout:9/140: dwrite d1/dd/f11 [0,4194304] 0 2023-10-08T08:45:27.688 INFO:tasks.workunit.client.0.smithi070.stdout:9/141: stat d1/dd/f11 0 2023-10-08T08:45:27.688 INFO:tasks.workunit.client.0.smithi070.stdout:9/142: dread - d1/f25 zero size 2023-10-08T08:45:27.688 INFO:tasks.workunit.client.0.smithi070.stdout:9/143: dread - d1/f25 zero size 2023-10-08T08:45:27.688 INFO:tasks.workunit.client.0.smithi070.stdout:6/188: creat df/d11/f3f x:0 0 0 2023-10-08T08:45:27.689 INFO:tasks.workunit.client.0.smithi070.stdout:8/240: getdents d1/d2/d6/d22 0 2023-10-08T08:45:27.690 INFO:tasks.workunit.client.0.smithi070.stdout:2/206: creat df/d12/f46 x:0 0 0 2023-10-08T08:45:27.694 INFO:tasks.workunit.client.0.smithi070.stdout:4/143: sync 2023-10-08T08:45:27.694 INFO:tasks.workunit.client.0.smithi070.stdout:4/144: fsync f6 0 2023-10-08T08:45:27.700 INFO:tasks.workunit.client.0.smithi070.stdout:1/172: dread d6/dc/d14/d1f/f25 [0,4194304] 0 2023-10-08T08:45:27.700 INFO:tasks.workunit.client.0.smithi070.stdout:1/173: chown d6/c1c 162778319 1 2023-10-08T08:45:27.702 INFO:tasks.workunit.client.0.smithi070.stdout:9/144: rmdir d1/dd/d1a 39 2023-10-08T08:45:27.702 INFO:tasks.workunit.client.0.smithi070.stdout:9/145: chown d1/dd/f18 2 1 2023-10-08T08:45:27.702 INFO:tasks.workunit.client.0.smithi070.stdout:6/189: creat df/d11/f40 x:0 0 0 2023-10-08T08:45:27.703 INFO:tasks.workunit.client.0.smithi070.stdout:7/252: rmdir d3/d19/d1b/d4a/d50/d51 0 2023-10-08T08:45:27.703 INFO:tasks.workunit.client.0.smithi070.stdout:8/241: mknod d1/de/d3a/c50 0 2023-10-08T08:45:27.703 INFO:tasks.workunit.client.0.smithi070.stdout:0/230: dwrite d1/d14/d1f/f28 [4194304,4194304] 0 2023-10-08T08:45:27.703 INFO:tasks.workunit.client.0.smithi070.stdout:0/231: readlink d1/d3f/l26 0 2023-10-08T08:45:27.704 INFO:tasks.workunit.client.0.smithi070.stdout:9/146: creat d1/dd/d26/d27/d2d/f2f x:0 0 0 2023-10-08T08:45:27.706 INFO:tasks.workunit.client.0.smithi070.stdout:7/253: dread d3/f2b [0,4194304] 0 2023-10-08T08:45:27.706 INFO:tasks.workunit.client.0.smithi070.stdout:7/254: dread - d3/f47 zero size 2023-10-08T08:45:27.706 INFO:tasks.workunit.client.0.smithi070.stdout:7/255: truncate d3/f37 252877 0 2023-10-08T08:45:27.707 INFO:tasks.workunit.client.0.smithi070.stdout:6/190: creat df/d11/f41 x:0 0 0 2023-10-08T08:45:27.707 INFO:tasks.workunit.client.0.smithi070.stdout:6/191: fdatasync df/d11/f41 0 2023-10-08T08:45:27.707 INFO:tasks.workunit.client.0.smithi070.stdout:6/192: truncate df/d11/d1d/f1f 4834343 0 2023-10-08T08:45:27.709 INFO:tasks.workunit.client.0.smithi070.stdout:7/256: rename d3/c14 to d3/d19/d1b/d4a/d9/c5a 0 2023-10-08T08:45:27.710 INFO:tasks.workunit.client.0.smithi070.stdout:6/193: mkdir df/d26/d42 0 2023-10-08T08:45:27.710 INFO:tasks.workunit.client.0.smithi070.stdout:7/257: symlink d3/l5b 0 2023-10-08T08:45:27.711 INFO:tasks.workunit.client.0.smithi070.stdout:6/194: mkdir df/d26/d42/d43 0 2023-10-08T08:45:27.712 INFO:tasks.workunit.client.0.smithi070.stdout:7/258: creat d3/f5c x:0 0 0 2023-10-08T08:45:27.714 INFO:tasks.workunit.client.0.smithi070.stdout:6/195: rename df/f20 to df/d11/d1d/f44 0 2023-10-08T08:45:27.714 INFO:tasks.workunit.client.0.smithi070.stdout:6/196: dread - df/d11/d1d/f3d zero size 2023-10-08T08:45:27.714 INFO:tasks.workunit.client.0.smithi070.stdout:9/147: dread d1/f20 [0,4194304] 0 2023-10-08T08:45:27.716 INFO:tasks.workunit.client.0.smithi070.stdout:9/148: rename d1/dd/d26/l2c to d1/dd/d26/l30 0 2023-10-08T08:45:27.717 INFO:tasks.workunit.client.0.smithi070.stdout:0/232: dread d1/d3f/f31 [0,4194304] 0 2023-10-08T08:45:27.717 INFO:tasks.workunit.client.0.smithi070.stdout:0/233: readlink d1/dd/l21 0 2023-10-08T08:45:27.717 INFO:tasks.workunit.client.0.smithi070.stdout:0/234: fsync d1/dd/d1b/f27 0 2023-10-08T08:45:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:6/197: write df/f1b [74102,1901] 0 2023-10-08T08:45:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:6/198: fsync df/d26/f3b 0 2023-10-08T08:45:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:6/199: mkdir df/d26/d42/d43/d45 0 2023-10-08T08:45:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:6/200: dread - df/f18 zero size 2023-10-08T08:45:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:0/235: write d1/d3f/f31 [109576,90018] 0 2023-10-08T08:45:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:0/236: chown d1/d1d 4896217 1 2023-10-08T08:45:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:0/237: chown d1/dd/le 249 1 2023-10-08T08:45:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:6/201: mknod df/d26/c46 0 2023-10-08T08:45:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:6/202: fsync f9 0 2023-10-08T08:45:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:6/203: chown df/d11/d1d/c22 438663677 1 2023-10-08T08:45:27.736 INFO:tasks.workunit.client.0.smithi070.stdout:2/207: dwrite df/d12/d1b/f1e [4194304,4194304] 0 2023-10-08T08:45:27.742 INFO:tasks.workunit.client.0.smithi070.stdout:0/238: link d1/c17 d1/d14/d1f/c40 0 2023-10-08T08:45:27.743 INFO:tasks.workunit.client.0.smithi070.stdout:4/145: dwrite dc/d17/f23 [0,4194304] 0 2023-10-08T08:45:27.743 INFO:tasks.workunit.client.0.smithi070.stdout:4/146: write dc/d17/f20 [2542848,104025] 0 2023-10-08T08:45:27.744 INFO:tasks.workunit.client.0.smithi070.stdout:2/208: rmdir df 39 2023-10-08T08:45:27.744 INFO:tasks.workunit.client.0.smithi070.stdout:0/239: rename d1/d14/d1f/l22 to d1/d1d/l41 0 2023-10-08T08:45:27.744 INFO:tasks.workunit.client.0.smithi070.stdout:0/240: write d1/f11 [2173162,24357] 0 2023-10-08T08:45:27.748 INFO:tasks.workunit.client.0.smithi070.stdout:4/147: symlink dc/d17/l2c 0 2023-10-08T08:45:27.749 INFO:tasks.workunit.client.0.smithi070.stdout:2/209: write df/d12/d15/f17 [2902633,32213] 0 2023-10-08T08:45:27.750 INFO:tasks.workunit.client.0.smithi070.stdout:0/241: rename d1/d3f/d38/f39 to d1/d14/d1f/f42 0 2023-10-08T08:45:27.750 INFO:tasks.workunit.client.0.smithi070.stdout:0/242: chown d1/dd/d1b/f27 322621 1 2023-10-08T08:45:27.751 INFO:tasks.workunit.client.0.smithi070.stdout:8/242: dwrite d1/de/f34 [0,4194304] 0 2023-10-08T08:45:27.752 INFO:tasks.workunit.client.0.smithi070.stdout:4/148: unlink f6 0 2023-10-08T08:45:27.752 INFO:tasks.workunit.client.0.smithi070.stdout:4/149: chown dc/f12 39812303 1 2023-10-08T08:45:27.752 INFO:tasks.workunit.client.0.smithi070.stdout:4/150: fdatasync dc/d17/f27 0 2023-10-08T08:45:27.760 INFO:tasks.workunit.client.0.smithi070.stdout:4/151: mknod dc/d17/d1f/c2d 0 2023-10-08T08:45:27.760 INFO:tasks.workunit.client.0.smithi070.stdout:7/259: dwrite d3/d19/d1a/f20 [0,4194304] 0 2023-10-08T08:45:27.761 INFO:tasks.workunit.client.0.smithi070.stdout:7/260: truncate d3/d19/d1b/d4a/f25 873010 0 2023-10-08T08:45:27.761 INFO:tasks.workunit.client.0.smithi070.stdout:7/261: write d3/d19/d1a/f4e [486811,120069] 0 2023-10-08T08:45:27.761 INFO:tasks.workunit.client.0.smithi070.stdout:4/152: creat dc/d17/f2e x:0 0 0 2023-10-08T08:45:27.763 INFO:tasks.workunit.client.0.smithi070.stdout:2/210: dread df/f11 [0,4194304] 0 2023-10-08T08:45:27.767 INFO:tasks.workunit.client.0.smithi070.stdout:6/204: dwrite df/d11/d1d/f3d [0,4194304] 0 2023-10-08T08:45:27.767 INFO:tasks.workunit.client.0.smithi070.stdout:6/205: dread - df/d11/f29 zero size 2023-10-08T08:45:27.768 INFO:tasks.workunit.client.0.smithi070.stdout:4/153: creat dc/d17/d24/f2f x:0 0 0 2023-10-08T08:45:27.769 INFO:tasks.workunit.client.0.smithi070.stdout:0/243: dread d1/f5 [4194304,4194304] 0 2023-10-08T08:45:27.770 INFO:tasks.workunit.client.0.smithi070.stdout:2/211: link l1 df/d12/d1b/d1c/l47 0 2023-10-08T08:45:27.770 INFO:tasks.workunit.client.0.smithi070.stdout:2/212: chown l1 15280 1 2023-10-08T08:45:27.772 INFO:tasks.workunit.client.0.smithi070.stdout:8/243: dwrite d1/d23/f28 [0,4194304] 0 2023-10-08T08:45:27.773 INFO:tasks.workunit.client.0.smithi070.stdout:4/154: symlink dc/d17/l30 0 2023-10-08T08:45:27.773 INFO:tasks.workunit.client.0.smithi070.stdout:4/155: chown dc/d17/d1f 842 1 2023-10-08T08:45:27.777 INFO:tasks.workunit.client.0.smithi070.stdout:3/158: sync 2023-10-08T08:45:27.777 INFO:tasks.workunit.client.0.smithi070.stdout:3/159: chown d0/d12/d14 3925 1 2023-10-08T08:45:27.777 INFO:tasks.workunit.client.0.smithi070.stdout:7/262: dread d3/d19/d1a/f4b [0,4194304] 0 2023-10-08T08:45:27.777 INFO:tasks.workunit.client.0.smithi070.stdout:6/206: creat df/d11/f47 x:0 0 0 2023-10-08T08:45:27.777 INFO:tasks.workunit.client.0.smithi070.stdout:3/160: dread d0/f1 [8388608,4194304] 0 2023-10-08T08:45:27.778 INFO:tasks.workunit.client.0.smithi070.stdout:3/161: write d0/db/d10/f1e [1508939,45013] 0 2023-10-08T08:45:27.778 INFO:tasks.workunit.client.0.smithi070.stdout:6/207: rmdir df/d26/d42/d43 39 2023-10-08T08:45:27.779 INFO:tasks.workunit.client.0.smithi070.stdout:3/162: creat d0/db/d10/d24/f37 x:0 0 0 2023-10-08T08:45:27.779 INFO:tasks.workunit.client.0.smithi070.stdout:6/208: mknod df/c48 0 2023-10-08T08:45:27.780 INFO:tasks.workunit.client.0.smithi070.stdout:6/209: fdatasync df/f10 0 2023-10-08T08:45:27.780 INFO:tasks.workunit.client.0.smithi070.stdout:6/210: write df/f23 [61772,60796] 0 2023-10-08T08:45:27.784 INFO:tasks.workunit.client.0.smithi070.stdout:6/211: mknod df/d11/c49 0 2023-10-08T08:45:27.792 INFO:tasks.workunit.client.0.smithi070.stdout:3/163: rename d0/db/d10/d24 to d0/db/d10/d38 0 2023-10-08T08:45:27.793 INFO:tasks.workunit.client.0.smithi070.stdout:2/213: dwrite df/f20 [0,4194304] 0 2023-10-08T08:45:27.793 INFO:tasks.workunit.client.0.smithi070.stdout:4/156: read dc/f1d [3386260,112610] 0 2023-10-08T08:45:27.796 INFO:tasks.workunit.client.0.smithi070.stdout:6/212: rmdir df 39 2023-10-08T08:45:27.797 INFO:tasks.workunit.client.0.smithi070.stdout:3/164: creat d0/d12/d14/f39 x:0 0 0 2023-10-08T08:45:27.798 INFO:tasks.workunit.client.0.smithi070.stdout:4/157: creat dc/d17/f31 x:0 0 0 2023-10-08T08:45:27.798 INFO:tasks.workunit.client.0.smithi070.stdout:4/158: chown dc/ff 8 1 2023-10-08T08:45:27.799 INFO:tasks.workunit.client.0.smithi070.stdout:6/213: mkdir df/d26/d42/d43/d4a 0 2023-10-08T08:45:27.799 INFO:tasks.workunit.client.0.smithi070.stdout:3/165: creat d0/d12/d14/d1d/f3a x:0 0 0 2023-10-08T08:45:27.801 INFO:tasks.workunit.client.0.smithi070.stdout:6/214: getdents df/d26/d42 0 2023-10-08T08:45:27.802 INFO:tasks.workunit.client.0.smithi070.stdout:3/166: rename d0/d12/d14/d1d/d22/f2e to d0/d12/d14/d1d/d22/f3b 0 2023-10-08T08:45:27.802 INFO:tasks.workunit.client.0.smithi070.stdout:3/167: dread - d0/d12/d14/d1d/f34 zero size 2023-10-08T08:45:27.803 INFO:tasks.workunit.client.0.smithi070.stdout:8/244: dwrite d1/d2/d6/f14 [0,4194304] 0 2023-10-08T08:45:27.806 INFO:tasks.workunit.client.0.smithi070.stdout:8/245: creat d1/de/d2e/d45/f51 x:0 0 0 2023-10-08T08:45:27.808 INFO:tasks.workunit.client.0.smithi070.stdout:8/246: symlink d1/d2/d6/l52 0 2023-10-08T08:45:27.810 INFO:tasks.workunit.client.0.smithi070.stdout:8/247: chown d1/c5 9 1 2023-10-08T08:45:27.812 INFO:tasks.workunit.client.0.smithi070.stdout:3/168: getdents d0/d12/d14 0 2023-10-08T08:45:27.812 INFO:tasks.workunit.client.0.smithi070.stdout:3/169: write d0/db/f18 [1401742,22803] 0 2023-10-08T08:45:27.814 INFO:tasks.workunit.client.0.smithi070.stdout:8/248: creat d1/de/d2e/d45/f53 x:0 0 0 2023-10-08T08:45:27.817 INFO:tasks.workunit.client.0.smithi070.stdout:0/244: dwrite d1/f6 [0,4194304] 0 2023-10-08T08:45:27.817 INFO:tasks.workunit.client.0.smithi070.stdout:7/263: dwrite d3/f37 [0,4194304] 0 2023-10-08T08:45:27.818 INFO:tasks.workunit.client.0.smithi070.stdout:3/170: mknod d0/db/c3c 0 2023-10-08T08:45:27.820 INFO:tasks.workunit.client.0.smithi070.stdout:0/245: creat d1/d14/f43 x:0 0 0 2023-10-08T08:45:27.820 INFO:tasks.workunit.client.0.smithi070.stdout:0/246: write d1/f11 [2500021,98903] 0 2023-10-08T08:45:27.826 INFO:tasks.workunit.client.0.smithi070.stdout:2/214: dwrite df/f20 [0,4194304] 0 2023-10-08T08:45:27.826 INFO:tasks.workunit.client.0.smithi070.stdout:2/215: chown df/l3d 549570990 1 2023-10-08T08:45:27.828 INFO:tasks.workunit.client.0.smithi070.stdout:8/249: mknod d1/c54 0 2023-10-08T08:45:27.829 INFO:tasks.workunit.client.0.smithi070.stdout:6/215: dwrite df/d11/f29 [0,4194304] 0 2023-10-08T08:45:27.829 INFO:tasks.workunit.client.0.smithi070.stdout:0/247: mknod d1/d1d/d24/c44 0 2023-10-08T08:45:27.832 INFO:tasks.workunit.client.0.smithi070.stdout:2/216: unlink df/d12/d1b/d1c/l47 0 2023-10-08T08:45:27.832 INFO:tasks.workunit.client.0.smithi070.stdout:2/217: chown df/d12/d15/f17 114 1 2023-10-08T08:45:27.832 INFO:tasks.workunit.client.0.smithi070.stdout:2/218: readlink df/d12/d25/l2f 0 2023-10-08T08:45:27.833 INFO:tasks.workunit.client.0.smithi070.stdout:7/264: mknod d3/d19/d1b/d4a/d50/c5d 0 2023-10-08T08:45:27.835 INFO:tasks.workunit.client.0.smithi070.stdout:8/250: link d1/d2/d6/fa d1/de/d3a/f55 0 2023-10-08T08:45:27.838 INFO:tasks.workunit.client.0.smithi070.stdout:6/216: rmdir df/d26/d42/d43/d45 0 2023-10-08T08:45:27.839 INFO:tasks.workunit.client.0.smithi070.stdout:3/171: dwrite d0/db/fd [0,4194304] 0 2023-10-08T08:45:27.840 INFO:tasks.workunit.client.0.smithi070.stdout:0/248: rename d1/dd/l21 to d1/dd/d1b/l45 0 2023-10-08T08:45:27.841 INFO:tasks.workunit.client.0.smithi070.stdout:8/251: mkdir d1/de/d3a/d56 0 2023-10-08T08:45:27.843 INFO:tasks.workunit.client.0.smithi070.stdout:5/226: sync 2023-10-08T08:45:27.845 INFO:tasks.workunit.client.0.smithi070.stdout:3/172: getdents d0/d12/d14/d1d/d22 0 2023-10-08T08:45:27.845 INFO:tasks.workunit.client.0.smithi070.stdout:1/174: sync 2023-10-08T08:45:27.845 INFO:tasks.workunit.client.0.smithi070.stdout:9/149: sync 2023-10-08T08:45:27.846 INFO:tasks.workunit.client.0.smithi070.stdout:9/150: readlink d1/dd/lf 0 2023-10-08T08:45:27.846 INFO:tasks.workunit.client.0.smithi070.stdout:9/151: chown d1/dd/d26 105046 1 2023-10-08T08:45:27.846 INFO:tasks.workunit.client.0.smithi070.stdout:9/152: write d1/dd/f18 [3680969,26747] 0 2023-10-08T08:45:27.846 INFO:tasks.workunit.client.0.smithi070.stdout:2/219: rename cd to df/c48 0 2023-10-08T08:45:27.849 INFO:tasks.workunit.client.0.smithi070.stdout:8/252: symlink d1/d2/d6/l57 0 2023-10-08T08:45:27.852 INFO:tasks.workunit.client.0.smithi070.stdout:5/227: rename d5/da/d2f/d30/d45 to d5/da/d2f/d30/d54 0 2023-10-08T08:45:27.852 INFO:tasks.workunit.client.0.smithi070.stdout:5/228: stat d5/da/f16 0 2023-10-08T08:45:27.853 INFO:tasks.workunit.client.0.smithi070.stdout:7/265: rmdir d3/d19/d1a 39 2023-10-08T08:45:27.853 INFO:tasks.workunit.client.0.smithi070.stdout:7/266: fsync d3/f47 0 2023-10-08T08:45:27.855 INFO:tasks.workunit.client.0.smithi070.stdout:3/173: link d0/c19 d0/db/d10/c3d 0 2023-10-08T08:45:27.855 INFO:tasks.workunit.client.0.smithi070.stdout:3/174: truncate d0/db/d10/f2c 297856 0 2023-10-08T08:45:27.855 INFO:tasks.workunit.client.0.smithi070.stdout:2/220: truncate df/d12/d15/f16 497440 0 2023-10-08T08:45:27.856 INFO:tasks.workunit.client.0.smithi070.stdout:8/253: creat d1/d2/d6/d22/f58 x:0 0 0 2023-10-08T08:45:27.858 INFO:tasks.workunit.client.0.smithi070.stdout:7/267: symlink d3/d19/d1b/d1e/d4c/l5e 0 2023-10-08T08:45:27.858 INFO:tasks.workunit.client.0.smithi070.stdout:7/268: fdatasync d3/d19/f56 0 2023-10-08T08:45:27.861 INFO:tasks.workunit.client.0.smithi070.stdout:7/269: write d3/d19/d1a/f40 [3385955,90028] 0 2023-10-08T08:45:27.861 INFO:tasks.workunit.client.0.smithi070.stdout:3/175: link d0/db/d10/c1b d0/d12/d14/d1d/c3e 0 2023-10-08T08:45:27.861 INFO:tasks.workunit.client.0.smithi070.stdout:3/176: truncate d0/db/f18 1477188 0 2023-10-08T08:45:27.862 INFO:tasks.workunit.client.0.smithi070.stdout:2/221: mkdir df/d12/d15/d49 0 2023-10-08T08:45:27.862 INFO:tasks.workunit.client.0.smithi070.stdout:8/254: mknod d1/de/d2e/d45/c59 0 2023-10-08T08:45:27.864 INFO:tasks.workunit.client.0.smithi070.stdout:3/177: unlink d0/d12/d14/d1d/d22/l2b 0 2023-10-08T08:45:27.864 INFO:tasks.workunit.client.0.smithi070.stdout:7/270: truncate d3/d19/d1a/f22 19556 0 2023-10-08T08:45:27.864 INFO:tasks.workunit.client.0.smithi070.stdout:3/178: readlink d0/l5 0 2023-10-08T08:45:27.864 INFO:tasks.workunit.client.0.smithi070.stdout:3/179: dread - d0/d12/d14/d1d/f3a zero size 2023-10-08T08:45:27.865 INFO:tasks.workunit.client.0.smithi070.stdout:2/222: mknod df/d12/c4a 0 2023-10-08T08:45:27.868 INFO:tasks.workunit.client.0.smithi070.stdout:3/180: creat d0/db/d10/d38/f3f x:0 0 0 2023-10-08T08:45:27.871 INFO:tasks.workunit.client.0.smithi070.stdout:3/181: dread d0/d12/f2d [0,4194304] 0 2023-10-08T08:45:27.872 INFO:tasks.workunit.client.0.smithi070.stdout:6/217: dwrite df/d11/d1d/f1f [4194304,4194304] 0 2023-10-08T08:45:27.873 INFO:tasks.workunit.client.0.smithi070.stdout:0/249: dwrite d1/dd/d1b/f34 [0,4194304] 0 2023-10-08T08:45:27.882 INFO:tasks.workunit.client.0.smithi070.stdout:6/218: mkdir df/d26/d42/d4b 0 2023-10-08T08:45:27.883 INFO:tasks.workunit.client.0.smithi070.stdout:3/182: getdents d0/d12/d14/d1d/d22 0 2023-10-08T08:45:27.883 INFO:tasks.workunit.client.0.smithi070.stdout:9/153: dwrite d1/dd/d19/f1b [0,4194304] 0 2023-10-08T08:45:27.884 INFO:tasks.workunit.client.0.smithi070.stdout:6/219: symlink df/d26/d42/d43/d4a/l4c 0 2023-10-08T08:45:27.887 INFO:tasks.workunit.client.0.smithi070.stdout:5/229: dread d5/f26 [0,4194304] 0 2023-10-08T08:45:27.887 INFO:tasks.workunit.client.0.smithi070.stdout:5/230: chown d5/da/d4d/d37/l3b 264035 1 2023-10-08T08:45:27.887 INFO:tasks.workunit.client.0.smithi070.stdout:5/231: chown d5/da/d2f/d30/f3d 30 1 2023-10-08T08:45:27.890 INFO:tasks.workunit.client.0.smithi070.stdout:1/175: dwrite d6/dc/d14/d1f/f2b [0,4194304] 0 2023-10-08T08:45:27.892 INFO:tasks.workunit.client.0.smithi070.stdout:8/255: dwrite d1/d2/d6/d22/f4c [0,4194304] 0 2023-10-08T08:45:27.894 INFO:tasks.workunit.client.0.smithi070.stdout:3/183: creat d0/d12/d14/f40 x:0 0 0 2023-10-08T08:45:27.894 INFO:tasks.workunit.client.0.smithi070.stdout:3/184: read - d0/db/d10/d38/f37 zero size 2023-10-08T08:45:27.894 INFO:tasks.workunit.client.0.smithi070.stdout:3/185: chown d0/db/f15 507005 1 2023-10-08T08:45:27.896 INFO:tasks.workunit.client.0.smithi070.stdout:8/256: mknod d1/de/d2e/c5a 0 2023-10-08T08:45:27.897 INFO:tasks.workunit.client.0.smithi070.stdout:3/186: creat d0/d12/d14/d1d/d22/f41 x:0 0 0 2023-10-08T08:45:27.900 INFO:tasks.workunit.client.0.smithi070.stdout:5/232: rename d5/da/d4d/d41 to d5/da/d4d/d37/d38/d55 0 2023-10-08T08:45:27.900 INFO:tasks.workunit.client.0.smithi070.stdout:5/233: dread - d5/da/f23 zero size 2023-10-08T08:45:27.900 INFO:tasks.workunit.client.0.smithi070.stdout:3/187: mknod d0/db/d10/d38/c42 0 2023-10-08T08:45:27.900 INFO:tasks.workunit.client.0.smithi070.stdout:5/234: chown d5/da/f11 704 1 2023-10-08T08:45:27.901 INFO:tasks.workunit.client.0.smithi070.stdout:0/250: dwrite d1/dd/f16 [0,4194304] 0 2023-10-08T08:45:27.904 INFO:tasks.workunit.client.0.smithi070.stdout:0/251: link d1/dd/d1b/f34 d1/d14/f46 0 2023-10-08T08:45:27.906 INFO:tasks.workunit.client.0.smithi070.stdout:5/235: symlink d5/da/l56 0 2023-10-08T08:45:27.907 INFO:tasks.workunit.client.0.smithi070.stdout:3/188: symlink d0/d12/l43 0 2023-10-08T08:45:27.907 INFO:tasks.workunit.client.0.smithi070.stdout:3/189: readlink d0/db/d10/d38/d2f/l32 0 2023-10-08T08:45:27.908 INFO:tasks.workunit.client.0.smithi070.stdout:5/236: symlink d5/da/d4d/d37/d38/d55/l57 0 2023-10-08T08:45:27.908 INFO:tasks.workunit.client.0.smithi070.stdout:9/154: dwrite d1/dd/d1a/f1d [0,4194304] 0 2023-10-08T08:45:27.908 INFO:tasks.workunit.client.0.smithi070.stdout:9/155: fdatasync f0 0 2023-10-08T08:45:27.914 INFO:tasks.workunit.client.0.smithi070.stdout:9/156: getdents d1/dd/d26/d27/d2d 0 2023-10-08T08:45:27.915 INFO:tasks.workunit.client.0.smithi070.stdout:1/176: dread d6/dc/f27 [0,4194304] 0 2023-10-08T08:45:27.915 INFO:tasks.workunit.client.0.smithi070.stdout:1/177: readlink d6/dc/d14/d1f/l30 0 2023-10-08T08:45:27.915 INFO:tasks.workunit.client.0.smithi070.stdout:1/178: readlink d6/dc/d14/d1f/l23 0 2023-10-08T08:45:27.917 INFO:tasks.workunit.client.0.smithi070.stdout:6/220: dwrite f2 [0,4194304] 0 2023-10-08T08:45:27.917 INFO:tasks.workunit.client.0.smithi070.stdout:6/221: readlink df/d11/d1d/l39 0 2023-10-08T08:45:27.917 INFO:tasks.workunit.client.0.smithi070.stdout:6/222: dread - df/d11/f41 zero size 2023-10-08T08:45:27.917 INFO:tasks.workunit.client.0.smithi070.stdout:9/157: symlink d1/dd/d26/d27/d2d/l31 0 2023-10-08T08:45:27.917 INFO:tasks.workunit.client.0.smithi070.stdout:6/223: write df/d11/f1a [205931,13851] 0 2023-10-08T08:45:27.920 INFO:tasks.workunit.client.0.smithi070.stdout:9/158: mknod d1/c32 0 2023-10-08T08:45:27.921 INFO:tasks.workunit.client.0.smithi070.stdout:0/252: rename d1/d3f to d1/d1d/d24/d47 0 2023-10-08T08:45:27.923 INFO:tasks.workunit.client.0.smithi070.stdout:9/159: mknod d1/dd/d26/d27/c33 0 2023-10-08T08:45:27.924 INFO:tasks.workunit.client.0.smithi070.stdout:2/223: dread fb [0,4194304] 0 2023-10-08T08:45:27.924 INFO:tasks.workunit.client.0.smithi070.stdout:8/257: dwrite d1/d2/d6/d22/f33 [0,4194304] 0 2023-10-08T08:45:27.924 INFO:tasks.workunit.client.0.smithi070.stdout:7/271: dwrite d3/d19/d1b/d4a/d9/f48 [0,4194304] 0 2023-10-08T08:45:27.925 INFO:tasks.workunit.client.0.smithi070.stdout:0/253: truncate d1/d14/d1f/f1a 1094551 0 2023-10-08T08:45:27.925 INFO:tasks.workunit.client.0.smithi070.stdout:0/254: chown d1/d1d/d24/d47/c3b 786036197 1 2023-10-08T08:45:27.925 INFO:tasks.workunit.client.0.smithi070.stdout:0/255: truncate d1/f6 5215146 0 2023-10-08T08:45:27.925 INFO:tasks.workunit.client.0.smithi070.stdout:0/256: write d1/d1d/f2b [1222294,125637] 0 2023-10-08T08:45:27.930 INFO:tasks.workunit.client.0.smithi070.stdout:6/224: write df/d11/f31 [2027115,129413] 0 2023-10-08T08:45:27.940 INFO:tasks.workunit.client.0.smithi070.stdout:8/258: mkdir d1/d2/d6/d22/d5b 0 2023-10-08T08:45:27.941 INFO:tasks.workunit.client.0.smithi070.stdout:7/272: mknod d3/d19/c5f 0 2023-10-08T08:45:27.944 INFO:tasks.workunit.client.0.smithi070.stdout:0/257: link d1/dd/c15 d1/d14/c48 0 2023-10-08T08:45:27.945 INFO:tasks.workunit.client.0.smithi070.stdout:6/225: truncate f7 48304 0 2023-10-08T08:45:27.945 INFO:tasks.workunit.client.0.smithi070.stdout:9/160: dwrite d1/dd/d1a/f1d [0,4194304] 0 2023-10-08T08:45:27.948 INFO:tasks.workunit.client.0.smithi070.stdout:8/259: mkdir d1/d2/d6/d22/d5c 0 2023-10-08T08:45:27.948 INFO:tasks.workunit.client.0.smithi070.stdout:8/260: readlink d1/d2/l4 0 2023-10-08T08:45:27.948 INFO:tasks.workunit.client.0.smithi070.stdout:2/224: dread df/f20 [0,4194304] 0 2023-10-08T08:45:27.948 INFO:tasks.workunit.client.0.smithi070.stdout:7/273: creat d3/d19/f60 x:0 0 0 2023-10-08T08:45:27.949 INFO:tasks.workunit.client.0.smithi070.stdout:2/225: read f8 [1854846,5416] 0 2023-10-08T08:45:27.950 INFO:tasks.workunit.client.0.smithi070.stdout:4/159: sync 2023-10-08T08:45:27.950 INFO:tasks.workunit.client.0.smithi070.stdout:8/261: symlink d1/d2/d6/d22/d5c/l5d 0 2023-10-08T08:45:27.950 INFO:tasks.workunit.client.0.smithi070.stdout:8/262: chown d1/d2/d6/c2a 1013289 1 2023-10-08T08:45:27.951 INFO:tasks.workunit.client.0.smithi070.stdout:0/258: symlink d1/l49 0 2023-10-08T08:45:27.952 INFO:tasks.workunit.client.0.smithi070.stdout:1/179: dwrite d6/dc/f2d [0,4194304] 0 2023-10-08T08:45:27.953 INFO:tasks.workunit.client.0.smithi070.stdout:0/259: symlink d1/d1d/d24/d47/l4a 0 2023-10-08T08:45:27.953 INFO:tasks.workunit.client.0.smithi070.stdout:2/226: write df/f11 [3551700,58885] 0 2023-10-08T08:45:27.953 INFO:tasks.workunit.client.0.smithi070.stdout:3/190: dwrite d0/db/f15 [0,4194304] 0 2023-10-08T08:45:27.954 INFO:tasks.workunit.client.0.smithi070.stdout:4/160: getdents dc 0 2023-10-08T08:45:27.955 INFO:tasks.workunit.client.0.smithi070.stdout:8/263: write d1/de/d1a/f1b [702805,88306] 0 2023-10-08T08:45:27.955 INFO:tasks.workunit.client.0.smithi070.stdout:5/237: dwrite d5/da/d4d/f3f [0,4194304] 0 2023-10-08T08:45:27.956 INFO:tasks.workunit.client.0.smithi070.stdout:4/161: write dc/d17/d1f/f29 [355675,103922] 0 2023-10-08T08:45:27.958 INFO:tasks.workunit.client.0.smithi070.stdout:9/161: dread d1/dd/d19/f1b [0,4194304] 0 2023-10-08T08:45:27.960 INFO:tasks.workunit.client.0.smithi070.stdout:1/180: creat d6/dc/d14/d1f/d26/f31 x:0 0 0 2023-10-08T08:45:27.961 INFO:tasks.workunit.client.0.smithi070.stdout:0/260: truncate d1/f7 1455381 0 2023-10-08T08:45:27.966 INFO:tasks.workunit.client.0.smithi070.stdout:3/191: creat d0/d12/d14/d1d/d22/f44 x:0 0 0 2023-10-08T08:45:27.966 INFO:tasks.workunit.client.0.smithi070.stdout:3/192: write d0/db/d10/d38/f37 [764449,2223] 0 2023-10-08T08:45:27.966 INFO:tasks.workunit.client.0.smithi070.stdout:3/193: truncate d0/d12/d14/f28 712520 0 2023-10-08T08:45:27.967 INFO:tasks.workunit.client.0.smithi070.stdout:8/264: unlink d1/d2/f2d 0 2023-10-08T08:45:27.967 INFO:tasks.workunit.client.0.smithi070.stdout:8/265: write d1/d2/f4a [758599,59710] 0 2023-10-08T08:45:27.970 INFO:tasks.workunit.client.0.smithi070.stdout:5/238: creat d5/da/d4d/d37/d2a/f58 x:0 0 0 2023-10-08T08:45:27.970 INFO:tasks.workunit.client.0.smithi070.stdout:5/239: chown d5/da/d22 395 1 2023-10-08T08:45:27.971 INFO:tasks.workunit.client.0.smithi070.stdout:9/162: mknod d1/dd/d26/d27/d2d/c34 0 2023-10-08T08:45:27.974 INFO:tasks.workunit.client.0.smithi070.stdout:0/261: unlink d1/dd/l10 0 2023-10-08T08:45:27.975 INFO:tasks.workunit.client.0.smithi070.stdout:2/227: getdents df/d12/d1b 0 2023-10-08T08:45:27.975 INFO:tasks.workunit.client.0.smithi070.stdout:2/228: write df/d12/d25/f3e [469375,128137] 0 2023-10-08T08:45:27.976 INFO:tasks.workunit.client.0.smithi070.stdout:2/229: chown df/d12/d1b/d1c/c45 20 1 2023-10-08T08:45:27.977 INFO:tasks.workunit.client.0.smithi070.stdout:3/194: mknod d0/db/d10/c45 0 2023-10-08T08:45:27.977 INFO:tasks.workunit.client.0.smithi070.stdout:3/195: chown d0 0 1 2023-10-08T08:45:27.978 INFO:tasks.workunit.client.0.smithi070.stdout:8/266: symlink d1/d23/l5e 0 2023-10-08T08:45:27.979 INFO:tasks.workunit.client.0.smithi070.stdout:5/240: creat d5/da/d22/f59 x:0 0 0 2023-10-08T08:45:27.979 INFO:tasks.workunit.client.0.smithi070.stdout:5/241: readlink d5/da/d4d/l48 0 2023-10-08T08:45:27.979 INFO:tasks.workunit.client.0.smithi070.stdout:9/163: mkdir d1/dd/d19/d35 0 2023-10-08T08:45:27.982 INFO:tasks.workunit.client.0.smithi070.stdout:1/181: rmdir d6/dc 39 2023-10-08T08:45:27.982 INFO:tasks.workunit.client.0.smithi070.stdout:1/182: truncate d6/dc/d14/d1f/d26/f31 171921 0 2023-10-08T08:45:27.983 INFO:tasks.workunit.client.0.smithi070.stdout:0/262: mknod d1/d1d/d24/d47/c4b 0 2023-10-08T08:45:27.983 INFO:tasks.workunit.client.0.smithi070.stdout:6/226: dread df/d11/f31 [4194304,4194304] 0 2023-10-08T08:45:27.983 INFO:tasks.workunit.client.0.smithi070.stdout:6/227: write df/d11/f3f [240189,105189] 0 2023-10-08T08:45:27.984 INFO:tasks.workunit.client.0.smithi070.stdout:3/196: unlink d0/db/d10/d38/f31 0 2023-10-08T08:45:27.984 INFO:tasks.workunit.client.0.smithi070.stdout:3/197: chown d0/ca 307147450 1 2023-10-08T08:45:27.985 INFO:tasks.workunit.client.0.smithi070.stdout:0/263: creat d1/d1d/d24/f4c x:0 0 0 2023-10-08T08:45:27.986 INFO:tasks.workunit.client.0.smithi070.stdout:1/183: dread d6/dc/f13 [0,4194304] 0 2023-10-08T08:45:27.989 INFO:tasks.workunit.client.0.smithi070.stdout:3/198: symlink d0/db/d10/l46 0 2023-10-08T08:45:27.992 INFO:tasks.workunit.client.0.smithi070.stdout:0/264: unlink d1/d1d/d24/d47/f31 0 2023-10-08T08:45:27.993 INFO:tasks.workunit.client.0.smithi070.stdout:6/228: rename df/f18 to df/d11/f4d 0 2023-10-08T08:45:27.995 INFO:tasks.workunit.client.0.smithi070.stdout:1/184: getdents d6/dc/d14/d1f 0 2023-10-08T08:45:28.003 INFO:tasks.workunit.client.0.smithi070.stdout:1/185: write d6/f20 [332246,58765] 0 2023-10-08T08:45:28.005 INFO:tasks.workunit.client.0.smithi070.stdout:4/162: dwrite dc/d17/f21 [0,4194304] 0 2023-10-08T08:45:28.005 INFO:tasks.workunit.client.0.smithi070.stdout:4/163: rename dc/d17/d24 to dc/d17/d24/d32 22 2023-10-08T08:45:28.008 INFO:tasks.workunit.client.0.smithi070.stdout:2/230: dwrite df/f33 [0,4194304] 0 2023-10-08T08:45:28.010 INFO:tasks.workunit.client.0.smithi070.stdout:2/231: write df/d12/d25/f2a [218882,26082] 0 2023-10-08T08:45:28.011 INFO:tasks.workunit.client.0.smithi070.stdout:4/164: rename dc/f1d to dc/d17/f33 0 2023-10-08T08:45:28.013 INFO:tasks.workunit.client.0.smithi070.stdout:8/267: dwrite d1/d2/f31 [0,4194304] 0 2023-10-08T08:45:28.018 INFO:tasks.workunit.client.0.smithi070.stdout:8/268: creat d1/d4d/f5f x:0 0 0 2023-10-08T08:45:28.018 INFO:tasks.workunit.client.0.smithi070.stdout:4/165: write dc/d17/f21 [1344857,120621] 0 2023-10-08T08:45:28.018 INFO:tasks.workunit.client.0.smithi070.stdout:9/164: dwrite d1/dd/d1a/f1c [0,4194304] 0 2023-10-08T08:45:28.020 INFO:tasks.workunit.client.0.smithi070.stdout:8/269: truncate d1/de/d21/f35 622766 0 2023-10-08T08:45:28.021 INFO:tasks.workunit.client.0.smithi070.stdout:4/166: creat dc/d17/d1f/f34 x:0 0 0 2023-10-08T08:45:28.024 INFO:tasks.workunit.client.0.smithi070.stdout:9/165: creat d1/dd/d26/d27/f36 x:0 0 0 2023-10-08T08:45:28.024 INFO:tasks.workunit.client.0.smithi070.stdout:9/166: truncate d1/dd/d26/d27/f36 260111 0 2023-10-08T08:45:28.026 INFO:tasks.workunit.client.0.smithi070.stdout:5/242: dwrite d5/da/d4d/d37/d2a/f31 [0,4194304] 0 2023-10-08T08:45:28.026 INFO:tasks.workunit.client.0.smithi070.stdout:5/243: chown d5/da/f50 439 1 2023-10-08T08:45:28.026 INFO:tasks.workunit.client.0.smithi070.stdout:5/244: fdatasync d5/da/d4d/d37/d38/d55/f4f 0 2023-10-08T08:45:28.026 INFO:tasks.workunit.client.0.smithi070.stdout:5/245: readlink d5/da/d2f/d30/l18 0 2023-10-08T08:45:28.027 INFO:tasks.workunit.client.0.smithi070.stdout:5/246: chown d5/l2e 0 1 2023-10-08T08:45:28.027 INFO:tasks.workunit.client.0.smithi070.stdout:8/270: link d1/d2/f17 d1/d2/d6/d22/f60 0 2023-10-08T08:45:28.027 INFO:tasks.workunit.client.0.smithi070.stdout:4/167: creat dc/d17/d1f/f35 x:0 0 0 2023-10-08T08:45:28.028 INFO:tasks.workunit.client.0.smithi070.stdout:5/247: read d5/da/f15 [925341,109819] 0 2023-10-08T08:45:28.032 INFO:tasks.workunit.client.0.smithi070.stdout:1/186: dwrite d6/dc/f19 [0,4194304] 0 2023-10-08T08:45:28.032 INFO:tasks.workunit.client.0.smithi070.stdout:1/187: chown d6/dc/d14/d1f/f2b 4 1 2023-10-08T08:45:28.032 INFO:tasks.workunit.client.0.smithi070.stdout:1/188: stat d6/dc/d14 0 2023-10-08T08:45:28.033 INFO:tasks.workunit.client.0.smithi070.stdout:0/265: dwrite d1/fa [0,4194304] 0 2023-10-08T08:45:28.033 INFO:tasks.workunit.client.0.smithi070.stdout:0/266: chown d1/d1d/d24/d47/c4b 45 1 2023-10-08T08:45:28.034 INFO:tasks.workunit.client.0.smithi070.stdout:6/229: dwrite df/d11/f47 [0,4194304] 0 2023-10-08T08:45:28.034 INFO:tasks.workunit.client.0.smithi070.stdout:6/230: stat df/d11/f29 0 2023-10-08T08:45:28.037 INFO:tasks.workunit.client.0.smithi070.stdout:2/232: dwrite df/d12/d15/f17 [0,4194304] 0 2023-10-08T08:45:28.044 INFO:tasks.workunit.client.0.smithi070.stdout:5/248: unlink d5/da/d4d/d37/d2a/l43 0 2023-10-08T08:45:28.048 INFO:tasks.workunit.client.0.smithi070.stdout:1/189: unlink d6/dc/f1e 0 2023-10-08T08:45:28.051 INFO:tasks.workunit.client.0.smithi070.stdout:0/267: mkdir d1/d1d/d4d 0 2023-10-08T08:45:28.051 INFO:tasks.workunit.client.0.smithi070.stdout:0/268: chown d1/d1d 196 1 2023-10-08T08:45:28.051 INFO:tasks.workunit.client.0.smithi070.stdout:0/269: chown d1/dd/f13 120817 1 2023-10-08T08:45:28.054 INFO:tasks.workunit.client.0.smithi070.stdout:6/231: creat df/d26/d42/d43/f4e x:0 0 0 2023-10-08T08:45:28.059 INFO:tasks.workunit.client.0.smithi070.stdout:8/271: rmdir d1/d2/d6/d22 39 2023-10-08T08:45:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:2/233: dwrite df/d12/d15/f17 [0,4194304] 0 2023-10-08T08:45:28.066 INFO:tasks.workunit.client.0.smithi070.stdout:1/190: link d6/f28 d6/dc/d14/d1f/f32 0 2023-10-08T08:45:28.066 INFO:tasks.workunit.client.0.smithi070.stdout:1/191: dread - d6/dc/d14/d1f/f32 zero size 2023-10-08T08:45:28.068 INFO:tasks.workunit.client.0.smithi070.stdout:0/270: link d1/fb d1/d14/d1f/f4e 0 2023-10-08T08:45:28.069 INFO:tasks.workunit.client.0.smithi070.stdout:6/232: truncate df/d11/f47 792863 0 2023-10-08T08:45:28.073 INFO:tasks.workunit.client.0.smithi070.stdout:0/271: creat d1/d1d/d24/d47/d38/f4f x:0 0 0 2023-10-08T08:45:28.073 INFO:tasks.workunit.client.0.smithi070.stdout:0/272: getdents d1/d1d/d4d 0 2023-10-08T08:45:28.075 INFO:tasks.workunit.client.0.smithi070.stdout:6/233: creat df/d26/d42/d43/d4a/f4f x:0 0 0 2023-10-08T08:45:28.150 INFO:tasks.workunit.client.0.smithi070.stdout:8/272: dwrite d1/d2/d6/d22/f58 [0,4194304] 0 2023-10-08T08:45:28.150 INFO:tasks.workunit.client.0.smithi070.stdout:9/167: dwrite d1/dd/fa [0,4194304] 0 2023-10-08T08:45:28.150 INFO:tasks.workunit.client.0.smithi070.stdout:9/168: chown d1/dd/d26/d27/d2d 444733140 1 2023-10-08T08:45:28.153 INFO:tasks.workunit.client.0.smithi070.stdout:8/273: mkdir d1/d4d/d61 0 2023-10-08T08:45:28.154 INFO:tasks.workunit.client.0.smithi070.stdout:5/249: dwrite d5/da/f23 [0,4194304] 0 2023-10-08T08:45:28.154 INFO:tasks.workunit.client.0.smithi070.stdout:5/250: write d5/da/d22/f32 [3113322,30484] 0 2023-10-08T08:45:28.154 INFO:tasks.workunit.client.0.smithi070.stdout:5/251: rename d5/da/d2f/d30/d54 to d5/da/d2f/d30/d54/d5a 22 2023-10-08T08:45:28.156 INFO:tasks.workunit.client.0.smithi070.stdout:2/234: dwrite df/d12/d25/f3e [0,4194304] 0 2023-10-08T08:45:28.157 INFO:tasks.workunit.client.0.smithi070.stdout:9/169: rmdir d1/dd/d19 39 2023-10-08T08:45:28.157 INFO:tasks.workunit.client.0.smithi070.stdout:6/234: dwrite df/d11/d1d/f44 [0,4194304] 0 2023-10-08T08:45:28.159 INFO:tasks.workunit.client.0.smithi070.stdout:5/252: mknod d5/da/d4d/d37/d2a/c5b 0 2023-10-08T08:45:28.160 INFO:tasks.workunit.client.0.smithi070.stdout:5/253: fsync d5/da/d4d/d37/d2a/f58 0 2023-10-08T08:45:28.160 INFO:tasks.workunit.client.0.smithi070.stdout:5/254: readlink d5/da/d2f/d30/l21 0 2023-10-08T08:45:28.162 INFO:tasks.workunit.client.0.smithi070.stdout:2/235: rmdir df/d12/d15/d49 0 2023-10-08T08:45:28.163 INFO:tasks.workunit.client.0.smithi070.stdout:0/273: dwrite d1/dd/ff [0,4194304] 0 2023-10-08T08:45:28.164 INFO:tasks.workunit.client.0.smithi070.stdout:6/235: mknod df/d26/d42/d43/d4a/c50 0 2023-10-08T08:45:28.164 INFO:tasks.workunit.client.0.smithi070.stdout:6/236: write f9 [5741895,40613] 0 2023-10-08T08:45:28.165 INFO:tasks.workunit.client.0.smithi070.stdout:8/274: symlink d1/l62 0 2023-10-08T08:45:28.165 INFO:tasks.workunit.client.0.smithi070.stdout:8/275: stat d1/d2/f3b 0 2023-10-08T08:45:28.165 INFO:tasks.workunit.client.0.smithi070.stdout:5/255: symlink d5/da/d2f/d30/d54/l5c 0 2023-10-08T08:45:28.166 INFO:tasks.workunit.client.0.smithi070.stdout:2/236: truncate df/d12/f1f 1775677 0 2023-10-08T08:45:28.166 INFO:tasks.workunit.client.0.smithi070.stdout:0/274: symlink d1/dd/l50 0 2023-10-08T08:45:28.167 INFO:tasks.workunit.client.0.smithi070.stdout:0/275: stat d1/d14/d1f/f4e 0 2023-10-08T08:45:28.169 INFO:tasks.workunit.client.0.smithi070.stdout:8/276: link d1/d23/f43 d1/de/d3a/f63 0 2023-10-08T08:45:28.170 INFO:tasks.workunit.client.0.smithi070.stdout:8/277: truncate d1/de/d21/f35 1403619 0 2023-10-08T08:45:28.170 INFO:tasks.workunit.client.0.smithi070.stdout:2/237: creat df/d3a/f4b x:0 0 0 2023-10-08T08:45:28.172 INFO:tasks.workunit.client.0.smithi070.stdout:6/237: rmdir df/d11 39 2023-10-08T08:45:28.173 INFO:tasks.workunit.client.0.smithi070.stdout:0/276: truncate d1/f5 6561102 0 2023-10-08T08:45:28.175 INFO:tasks.workunit.client.0.smithi070.stdout:8/278: unlink d1/c54 0 2023-10-08T08:45:28.175 INFO:tasks.workunit.client.0.smithi070.stdout:8/279: getdents d1/de/d15 0 2023-10-08T08:45:28.179 INFO:tasks.workunit.client.0.smithi070.stdout:8/280: creat d1/de/f64 x:0 0 0 2023-10-08T08:45:28.192 INFO:tasks.workunit.client.0.smithi070.stdout:9/170: dwrite d1/f25 [0,4194304] 0 2023-10-08T08:45:28.192 INFO:tasks.workunit.client.0.smithi070.stdout:6/238: dread df/f1b [0,4194304] 0 2023-10-08T08:45:28.192 INFO:tasks.workunit.client.0.smithi070.stdout:6/239: truncate df/f23 1525547 0 2023-10-08T08:45:28.194 INFO:tasks.workunit.client.0.smithi070.stdout:9/171: dread d1/dd/d26/d27/f36 [0,4194304] 0 2023-10-08T08:45:28.194 INFO:tasks.workunit.client.0.smithi070.stdout:2/238: dwrite df/d12/d15/f16 [0,4194304] 0 2023-10-08T08:45:28.194 INFO:tasks.workunit.client.0.smithi070.stdout:5/256: dwrite d5/da/d2f/d30/f14 [0,4194304] 0 2023-10-08T08:45:28.196 INFO:tasks.workunit.client.0.smithi070.stdout:0/277: dwrite d1/d1d/d24/f4c [0,4194304] 0 2023-10-08T08:45:28.196 INFO:tasks.workunit.client.0.smithi070.stdout:0/278: readlink d1/d14/l32 0 2023-10-08T08:45:28.199 INFO:tasks.workunit.client.0.smithi070.stdout:6/240: getdents df/d26/d42/d43 0 2023-10-08T08:45:28.199 INFO:tasks.workunit.client.0.smithi070.stdout:6/241: read - df/f15 zero size 2023-10-08T08:45:28.199 INFO:tasks.workunit.client.0.smithi070.stdout:6/242: write df/d11/f40 [180621,19879] 0 2023-10-08T08:45:28.200 INFO:tasks.workunit.client.0.smithi070.stdout:6/243: read df/f23 [1475118,120082] 0 2023-10-08T08:45:28.200 INFO:tasks.workunit.client.0.smithi070.stdout:6/244: chown df/d26 51576 1 2023-10-08T08:45:28.200 INFO:tasks.workunit.client.0.smithi070.stdout:6/245: write df/d11/f4d [837137,23189] 0 2023-10-08T08:45:28.200 INFO:tasks.workunit.client.0.smithi070.stdout:6/246: truncate df/d26/d42/d43/d4a/f4f 942549 0 2023-10-08T08:45:28.200 INFO:tasks.workunit.client.0.smithi070.stdout:0/279: write d1/f7 [1001696,14020] 0 2023-10-08T08:45:28.205 INFO:tasks.workunit.client.0.smithi070.stdout:0/280: creat d1/d1d/f51 x:0 0 0 2023-10-08T08:45:28.205 INFO:tasks.workunit.client.0.smithi070.stdout:2/239: write fb [1060508,107288] 0 2023-10-08T08:45:28.212 INFO:tasks.workunit.client.0.smithi070.stdout:9/172: dread d1/f13 [0,4194304] 0 2023-10-08T08:45:28.217 INFO:tasks.workunit.client.0.smithi070.stdout:5/257: dread d5/da/d2f/d30/f3d [0,4194304] 0 2023-10-08T08:45:28.217 INFO:tasks.workunit.client.0.smithi070.stdout:8/281: dwrite d1/d2/d6/f14 [0,4194304] 0 2023-10-08T08:45:28.223 INFO:tasks.workunit.client.0.smithi070.stdout:5/258: rmdir d5/da/d4d 39 2023-10-08T08:45:28.224 INFO:tasks.workunit.client.0.smithi070.stdout:5/259: write d5/da/d22/f52 [5223154,33866] 0 2023-10-08T08:45:28.224 INFO:tasks.workunit.client.0.smithi070.stdout:5/260: readlink d5/da/l20 0 2023-10-08T08:45:28.226 INFO:tasks.workunit.client.0.smithi070.stdout:5/261: symlink d5/da/d2f/d30/l5d 0 2023-10-08T08:45:28.226 INFO:tasks.workunit.client.0.smithi070.stdout:9/173: dread d1/dd/f18 [0,4194304] 0 2023-10-08T08:45:28.226 INFO:tasks.workunit.client.0.smithi070.stdout:5/262: chown d5/da/d2f/d30/f14 43334 1 2023-10-08T08:45:28.226 INFO:tasks.workunit.client.0.smithi070.stdout:5/263: write d5/da/d4d/d37/d38/d55/f4f [139080,66680] 0 2023-10-08T08:45:28.229 INFO:tasks.workunit.client.0.smithi070.stdout:8/282: rmdir d1 39 2023-10-08T08:45:28.230 INFO:tasks.workunit.client.0.smithi070.stdout:9/174: truncate d1/dd/d1a/f1c 2611540 0 2023-10-08T08:45:28.230 INFO:tasks.workunit.client.0.smithi070.stdout:9/175: chown d1/dd/c16 2 1 2023-10-08T08:45:28.232 INFO:tasks.workunit.client.0.smithi070.stdout:2/240: dwrite df/d12/d25/f3e [0,4194304] 0 2023-10-08T08:45:28.232 INFO:tasks.workunit.client.0.smithi070.stdout:2/241: fsync df/d12/d25/f3e 0 2023-10-08T08:45:28.237 INFO:tasks.workunit.client.0.smithi070.stdout:8/283: mkdir d1/de/d3a/d56/d65 0 2023-10-08T08:45:28.237 INFO:tasks.workunit.client.0.smithi070.stdout:5/264: creat d5/da/d22/f5e x:0 0 0 2023-10-08T08:45:28.237 INFO:tasks.workunit.client.0.smithi070.stdout:5/265: readlink d5/da/l34 0 2023-10-08T08:45:28.237 INFO:tasks.workunit.client.0.smithi070.stdout:5/266: chown d5/da/l40 25 1 2023-10-08T08:45:28.237 INFO:tasks.workunit.client.0.smithi070.stdout:5/267: truncate d5/da/d22/f59 1003016 0 2023-10-08T08:45:28.242 INFO:tasks.workunit.client.0.smithi070.stdout:2/242: mkdir df/d4c 0 2023-10-08T08:45:28.242 INFO:tasks.workunit.client.0.smithi070.stdout:2/243: chown fa 15432 1 2023-10-08T08:45:28.242 INFO:tasks.workunit.client.0.smithi070.stdout:2/244: stat df/d12/c14 0 2023-10-08T08:45:28.242 INFO:tasks.workunit.client.0.smithi070.stdout:2/245: chown c6 2 1 2023-10-08T08:45:28.242 INFO:tasks.workunit.client.0.smithi070.stdout:8/284: creat d1/de/d1a/f66 x:0 0 0 2023-10-08T08:45:28.243 INFO:tasks.workunit.client.0.smithi070.stdout:0/281: dwrite d1/d14/f46 [0,4194304] 0 2023-10-08T08:45:28.247 INFO:tasks.workunit.client.0.smithi070.stdout:5/268: mkdir d5/d5f 0 2023-10-08T08:45:28.247 INFO:tasks.workunit.client.0.smithi070.stdout:2/246: rename df/d12/l35 to df/d12/d1b/l4d 0 2023-10-08T08:45:28.247 INFO:tasks.workunit.client.0.smithi070.stdout:2/247: dread - df/d3a/f4b zero size 2023-10-08T08:45:28.254 INFO:tasks.workunit.client.0.smithi070.stdout:5/269: unlink d5/da/d2f/d30/l5d 0 2023-10-08T08:45:28.254 INFO:tasks.workunit.client.0.smithi070.stdout:9/176: dwrite d1/dd/f10 [0,4194304] 0 2023-10-08T08:45:28.254 INFO:tasks.workunit.client.0.smithi070.stdout:9/177: stat d1/dd/d1a/f1c 0 2023-10-08T08:45:28.254 INFO:tasks.workunit.client.0.smithi070.stdout:9/178: readlink d1/dd/lf 0 2023-10-08T08:45:28.256 INFO:tasks.workunit.client.0.smithi070.stdout:5/270: creat d5/da/d2f/f60 x:0 0 0 2023-10-08T08:45:28.257 INFO:tasks.workunit.client.0.smithi070.stdout:9/179: symlink d1/dd/d1a/l37 0 2023-10-08T08:45:28.259 INFO:tasks.workunit.client.0.smithi070.stdout:9/180: truncate d1/f13 2811771 0 2023-10-08T08:45:28.260 INFO:tasks.workunit.client.0.smithi070.stdout:9/181: mkdir d1/dd/d19/d38 0 2023-10-08T08:45:28.260 INFO:tasks.workunit.client.0.smithi070.stdout:9/182: fsync d1/fb 0 2023-10-08T08:45:28.266 INFO:tasks.workunit.client.0.smithi070.stdout:5/271: rename d5/da/d2f to d5/d5f/d61 0 2023-10-08T08:45:28.280 INFO:tasks.workunit.client.0.smithi070.stdout:5/272: dread d5/da/d4d/d37/f2b [0,4194304] 0 2023-10-08T08:45:28.280 INFO:tasks.workunit.client.0.smithi070.stdout:5/273: write d5/da/d4d/d37/d38/d55/f4c [1041548,29903] 0 2023-10-08T08:45:28.280 INFO:tasks.workunit.client.0.smithi070.stdout:5/274: write d5/da/d4d/d37/d2a/f58 [602876,110708] 0 2023-10-08T08:45:28.281 INFO:tasks.workunit.client.0.smithi070.stdout:5/275: mkdir d5/d5f/d61/d30/d54/d62 0 2023-10-08T08:45:28.282 INFO:tasks.workunit.client.0.smithi070.stdout:5/276: mkdir d5/d5f/d63 0 2023-10-08T08:45:28.282 INFO:tasks.workunit.client.0.smithi070.stdout:5/277: fdatasync d5/da/f50 0 2023-10-08T08:45:28.290 INFO:tasks.workunit.client.0.smithi070.stdout:3/199: sync 2023-10-08T08:45:28.291 INFO:tasks.workunit.client.0.smithi070.stdout:7/274: sync 2023-10-08T08:45:28.291 INFO:tasks.workunit.client.0.smithi070.stdout:3/200: stat d0/db/fd 0 2023-10-08T08:45:28.291 INFO:tasks.workunit.client.0.smithi070.stdout:7/275: dread - d3/d19/f3c zero size 2023-10-08T08:45:28.291 INFO:tasks.workunit.client.0.smithi070.stdout:3/201: chown d0/d12/d14/d1d/f3a 25563 1 2023-10-08T08:45:28.293 INFO:tasks.workunit.client.0.smithi070.stdout:7/276: link d3/l27 d3/d19/l61 0 2023-10-08T08:45:28.293 INFO:tasks.workunit.client.0.smithi070.stdout:7/277: chown d3/d19/d1b/d4a/f25 3 1 2023-10-08T08:45:28.294 INFO:tasks.workunit.client.0.smithi070.stdout:3/202: symlink d0/d12/d14/d1d/l47 0 2023-10-08T08:45:28.294 INFO:tasks.workunit.client.0.smithi070.stdout:3/203: fdatasync d0/db/f26 0 2023-10-08T08:45:28.297 INFO:tasks.workunit.client.0.smithi070.stdout:7/278: symlink d3/d19/d1b/l62 0 2023-10-08T08:45:28.297 INFO:tasks.workunit.client.0.smithi070.stdout:3/204: mkdir d0/d12/d14/d48 0 2023-10-08T08:45:28.300 INFO:tasks.workunit.client.0.smithi070.stdout:7/279: stat d3/l27 0 2023-10-08T08:45:28.300 INFO:tasks.workunit.client.0.smithi070.stdout:7/280: dread - d3/f5c zero size 2023-10-08T08:45:28.301 INFO:tasks.workunit.client.0.smithi070.stdout:3/205: symlink d0/d12/d14/d1d/d22/l49 0 2023-10-08T08:45:28.301 INFO:tasks.workunit.client.0.smithi070.stdout:3/206: truncate d0/db/d10/f1e 1894806 0 2023-10-08T08:45:28.301 INFO:tasks.workunit.client.0.smithi070.stdout:8/285: dwrite d1/de/d15/f20 [0,4194304] 0 2023-10-08T08:45:28.310 INFO:tasks.workunit.client.0.smithi070.stdout:2/248: dwrite fc [0,4194304] 0 2023-10-08T08:45:28.313 INFO:tasks.workunit.client.0.smithi070.stdout:0/282: dwrite d1/d1d/d24/f4c [0,4194304] 0 2023-10-08T08:45:28.313 INFO:tasks.workunit.client.0.smithi070.stdout:9/183: dwrite d1/f20 [0,4194304] 0 2023-10-08T08:45:28.313 INFO:tasks.workunit.client.0.smithi070.stdout:5/278: dwrite d5/da/d4d/d37/d2a/f31 [0,4194304] 0 2023-10-08T08:45:28.313 INFO:tasks.workunit.client.0.smithi070.stdout:0/283: rename d1/d14/f46 to d1/d1d/f52 0 2023-10-08T08:45:28.314 INFO:tasks.workunit.client.0.smithi070.stdout:0/284: dread - d1/d1d/f51 zero size 2023-10-08T08:45:28.314 INFO:tasks.workunit.client.0.smithi070.stdout:0/285: write d1/d1d/d24/d47/d38/f4f [13723,54389] 0 2023-10-08T08:45:28.317 INFO:tasks.workunit.client.0.smithi070.stdout:9/184: unlink d1/f20 0 2023-10-08T08:45:28.318 INFO:tasks.workunit.client.0.smithi070.stdout:7/281: dread d3/d19/d1a/f20 [0,4194304] 0 2023-10-08T08:45:28.327 INFO:tasks.workunit.client.0.smithi070.stdout:9/185: rmdir d1/dd/d19/d35 0 2023-10-08T08:45:28.328 INFO:tasks.workunit.client.0.smithi070.stdout:7/282: creat d3/d19/d1b/d1e/d4c/f63 x:0 0 0 2023-10-08T08:45:28.330 INFO:tasks.workunit.client.0.smithi070.stdout:8/286: dwrite d1/d4d/f5f [0,4194304] 0 2023-10-08T08:45:28.330 INFO:tasks.workunit.client.0.smithi070.stdout:8/287: dread - d1/de/d3a/f3f zero size 2023-10-08T08:45:28.330 INFO:tasks.workunit.client.0.smithi070.stdout:9/186: mkdir d1/dd/d39 0 2023-10-08T08:45:28.332 INFO:tasks.workunit.client.0.smithi070.stdout:5/279: rmdir d5 39 2023-10-08T08:45:28.336 INFO:tasks.workunit.client.0.smithi070.stdout:3/207: dwrite d0/d12/f35 [0,4194304] 0 2023-10-08T08:45:28.336 INFO:tasks.workunit.client.0.smithi070.stdout:0/286: dread d1/d1d/f2b [0,4194304] 0 2023-10-08T08:45:28.337 INFO:tasks.workunit.client.0.smithi070.stdout:8/288: rename d1/d2/l38 to d1/d2/d6/l67 0 2023-10-08T08:45:28.338 INFO:tasks.workunit.client.0.smithi070.stdout:9/187: mknod d1/dd/d26/d27/c3a 0 2023-10-08T08:45:28.339 INFO:tasks.workunit.client.0.smithi070.stdout:8/289: write d1/de/d3a/f55 [1943457,52468] 0 2023-10-08T08:45:28.341 INFO:tasks.workunit.client.0.smithi070.stdout:0/287: dread d1/d1d/d24/d47/d38/f4f [0,4194304] 0 2023-10-08T08:45:28.346 INFO:tasks.workunit.client.0.smithi070.stdout:7/283: getdents d3 0 2023-10-08T08:45:28.346 INFO:tasks.workunit.client.0.smithi070.stdout:4/168: sync 2023-10-08T08:45:28.346 INFO:tasks.workunit.client.0.smithi070.stdout:1/192: sync 2023-10-08T08:45:28.346 INFO:tasks.workunit.client.0.smithi070.stdout:5/280: creat d5/da/d4d/f64 x:0 0 0 2023-10-08T08:45:28.346 INFO:tasks.workunit.client.0.smithi070.stdout:3/208: symlink d0/d12/d14/l4a 0 2023-10-08T08:45:28.346 INFO:tasks.workunit.client.0.smithi070.stdout:2/249: dwrite f8 [0,4194304] 0 2023-10-08T08:45:28.346 INFO:tasks.workunit.client.0.smithi070.stdout:2/250: chown df/d12/d25/f2a 292905 1 2023-10-08T08:45:28.346 INFO:tasks.workunit.client.0.smithi070.stdout:2/251: dread - df/d12/f46 zero size 2023-10-08T08:45:28.347 INFO:tasks.workunit.client.0.smithi070.stdout:8/290: creat d1/d4d/f68 x:0 0 0 2023-10-08T08:45:28.347 INFO:tasks.workunit.client.0.smithi070.stdout:1/193: write d6/f1b [176912,74364] 0 2023-10-08T08:45:28.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/169: truncate dc/f11 2006157 0 2023-10-08T08:45:28.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/170: chown dc/f13 4 1 2023-10-08T08:45:28.348 INFO:tasks.workunit.client.0.smithi070.stdout:4/171: chown dc/f10 651 1 2023-10-08T08:45:28.348 INFO:tasks.workunit.client.0.smithi070.stdout:7/284: dread d3/f2e [0,4194304] 0 2023-10-08T08:45:28.348 INFO:tasks.workunit.client.0.smithi070.stdout:7/285: truncate d3/d19/d1b/d4a/f8 8810921 0 2023-10-08T08:45:28.349 INFO:tasks.workunit.client.0.smithi070.stdout:0/288: write d1/fb [3949091,61078] 0 2023-10-08T08:45:28.349 INFO:tasks.workunit.client.0.smithi070.stdout:0/289: chown d1/dd/le 21584101 1 2023-10-08T08:45:28.349 INFO:tasks.workunit.client.0.smithi070.stdout:3/209: creat d0/d12/d14/d1d/d22/f4b x:0 0 0 2023-10-08T08:45:28.351 INFO:tasks.workunit.client.0.smithi070.stdout:2/252: symlink df/d12/d15/d34/l4e 0 2023-10-08T08:45:28.352 INFO:tasks.workunit.client.0.smithi070.stdout:8/291: rmdir d1/d2/d6/d22/d5c 39 2023-10-08T08:45:28.355 INFO:tasks.workunit.client.0.smithi070.stdout:1/194: unlink d6/c1c 0 2023-10-08T08:45:28.355 INFO:tasks.workunit.client.0.smithi070.stdout:1/195: fdatasync f5 0 2023-10-08T08:45:28.356 INFO:tasks.workunit.client.0.smithi070.stdout:4/172: creat dc/d17/d1f/f36 x:0 0 0 2023-10-08T08:45:28.356 INFO:tasks.workunit.client.0.smithi070.stdout:4/173: truncate dc/ff 4575889 0 2023-10-08T08:45:28.357 INFO:tasks.workunit.client.0.smithi070.stdout:7/286: getdents d3/d19/d1a 0 2023-10-08T08:45:28.362 INFO:tasks.workunit.client.0.smithi070.stdout:3/210: unlink d0/f2 0 2023-10-08T08:45:28.362 INFO:tasks.workunit.client.0.smithi070.stdout:2/253: rename df/d12/f1f to df/d4c/f4f 0 2023-10-08T08:45:28.363 INFO:tasks.workunit.client.0.smithi070.stdout:3/211: chown d0/d12/d14/d1d/c3e 430 1 2023-10-08T08:45:28.363 INFO:tasks.workunit.client.0.smithi070.stdout:2/254: fsync df/f39 0 2023-10-08T08:45:28.365 INFO:tasks.workunit.client.0.smithi070.stdout:8/292: creat d1/d4d/d61/f69 x:0 0 0 2023-10-08T08:45:28.365 INFO:tasks.workunit.client.0.smithi070.stdout:7/287: creat d3/d19/d1b/f64 x:0 0 0 2023-10-08T08:45:28.366 INFO:tasks.workunit.client.0.smithi070.stdout:7/288: chown d3/l5b 48 1 2023-10-08T08:45:28.366 INFO:tasks.workunit.client.0.smithi070.stdout:9/188: dwrite d1/f25 [0,4194304] 0 2023-10-08T08:45:28.366 INFO:tasks.workunit.client.0.smithi070.stdout:2/255: rmdir df/d4c 39 2023-10-08T08:45:28.366 INFO:tasks.workunit.client.0.smithi070.stdout:2/256: write df/d3a/f4b [1040608,15983] 0 2023-10-08T08:45:28.366 INFO:tasks.workunit.client.0.smithi070.stdout:3/212: mknod d0/db/d10/c4c 0 2023-10-08T08:45:28.376 INFO:tasks.workunit.client.0.smithi070.stdout:5/281: dread d5/da/f23 [0,4194304] 0 2023-10-08T08:45:28.376 INFO:tasks.workunit.client.0.smithi070.stdout:5/282: write d5/da/f50 [834155,82823] 0 2023-10-08T08:45:28.378 INFO:tasks.workunit.client.0.smithi070.stdout:7/289: mknod d3/d19/d1b/c65 0 2023-10-08T08:45:28.378 INFO:tasks.workunit.client.0.smithi070.stdout:7/290: chown d3/d19/d1b/d4a/c11 114 1 2023-10-08T08:45:28.378 INFO:tasks.workunit.client.0.smithi070.stdout:2/257: truncate df/d12/d15/f41 2674633 0 2023-10-08T08:45:28.379 INFO:tasks.workunit.client.0.smithi070.stdout:4/174: dwrite dc/d17/d1f/f35 [0,4194304] 0 2023-10-08T08:45:28.380 INFO:tasks.workunit.client.0.smithi070.stdout:0/290: dread d1/fa [0,4194304] 0 2023-10-08T08:45:28.380 INFO:tasks.workunit.client.0.smithi070.stdout:0/291: dread - d1/dd/d1b/f33 zero size 2023-10-08T08:45:28.380 INFO:tasks.workunit.client.0.smithi070.stdout:5/283: truncate d5/da/f15 644980 0 2023-10-08T08:45:28.380 INFO:tasks.workunit.client.0.smithi070.stdout:3/213: write d0/d12/f35 [924176,10363] 0 2023-10-08T08:45:28.380 INFO:tasks.workunit.client.0.smithi070.stdout:5/284: truncate d5/da/d4d/d37/d38/d55/f4f 457583 0 2023-10-08T08:45:28.383 INFO:tasks.workunit.client.0.smithi070.stdout:7/291: creat d3/d19/d1b/d4a/d50/f66 x:0 0 0 2023-10-08T08:45:28.383 INFO:tasks.workunit.client.0.smithi070.stdout:7/292: dread - d3/d19/f3c zero size 2023-10-08T08:45:28.383 INFO:tasks.workunit.client.0.smithi070.stdout:7/293: chown d3/l3b 2138258974 1 2023-10-08T08:45:28.384 INFO:tasks.workunit.client.0.smithi070.stdout:7/294: write d3/d19/d1b/d4a/fd [3804026,14376] 0 2023-10-08T08:45:28.385 INFO:tasks.workunit.client.0.smithi070.stdout:2/258: symlink df/d12/d1b/l50 0 2023-10-08T08:45:28.387 INFO:tasks.workunit.client.0.smithi070.stdout:4/175: mkdir dc/d17/d24/d37 0 2023-10-08T08:45:28.387 INFO:tasks.workunit.client.0.smithi070.stdout:4/176: write dc/d17/f31 [914420,107204] 0 2023-10-08T08:45:28.389 INFO:tasks.workunit.client.0.smithi070.stdout:3/214: rename d0/c9 to d0/db/d10/d38/c4d 0 2023-10-08T08:45:28.389 INFO:tasks.workunit.client.0.smithi070.stdout:4/177: read dc/d17/f27 [3311289,108123] 0 2023-10-08T08:45:28.389 INFO:tasks.workunit.client.0.smithi070.stdout:4/178: write dc/d17/f23 [4755954,52412] 0 2023-10-08T08:45:28.390 INFO:tasks.workunit.client.0.smithi070.stdout:5/285: mknod d5/da/d4d/d37/d38/d55/c65 0 2023-10-08T08:45:28.392 INFO:tasks.workunit.client.0.smithi070.stdout:7/295: creat d3/d19/f67 x:0 0 0 2023-10-08T08:45:28.392 INFO:tasks.workunit.client.0.smithi070.stdout:7/296: chown d3/d19/d1b/d4a/d9 216824753 1 2023-10-08T08:45:28.395 INFO:tasks.workunit.client.0.smithi070.stdout:7/297: symlink d3/d19/d1b/d4a/d9/l68 0 2023-10-08T08:45:28.395 INFO:tasks.workunit.client.0.smithi070.stdout:7/298: stat d3 0 2023-10-08T08:45:28.396 INFO:tasks.workunit.client.0.smithi070.stdout:2/259: getdents df/d12/d1b/d1c 0 2023-10-08T08:45:28.398 INFO:tasks.workunit.client.0.smithi070.stdout:3/215: link d0/db/f29 d0/d12/f4e 0 2023-10-08T08:45:28.404 INFO:tasks.workunit.client.0.smithi070.stdout:2/260: unlink df/d12/d25/c3b 0 2023-10-08T08:45:28.404 INFO:tasks.workunit.client.0.smithi070.stdout:2/261: write df/d12/f46 [218691,125709] 0 2023-10-08T08:45:28.408 INFO:tasks.workunit.client.0.smithi070.stdout:2/262: getdents df 0 2023-10-08T08:45:28.408 INFO:tasks.workunit.client.0.smithi070.stdout:1/196: dwrite d6/f11 [4194304,4194304] 0 2023-10-08T08:45:28.409 INFO:tasks.workunit.client.0.smithi070.stdout:3/216: rename d0/d12/d14/d1d/d22/f4b to d0/d12/d14/d48/f4f 0 2023-10-08T08:45:28.409 INFO:tasks.workunit.client.0.smithi070.stdout:1/197: rename d6 to d6/d33 22 2023-10-08T08:45:28.411 INFO:tasks.workunit.client.0.smithi070.stdout:8/293: dwrite d1/d2/f17 [0,4194304] 0 2023-10-08T08:45:28.411 INFO:tasks.workunit.client.0.smithi070.stdout:0/292: write d1/dd/f16 [3217810,83631] 0 2023-10-08T08:45:28.412 INFO:tasks.workunit.client.0.smithi070.stdout:0/293: truncate d1/dd/f3a 928463 0 2023-10-08T08:45:28.412 INFO:tasks.workunit.client.0.smithi070.stdout:2/263: write df/d12/d25/f3e [2172943,81922] 0 2023-10-08T08:45:28.418 INFO:tasks.workunit.client.0.smithi070.stdout:3/217: unlink d0/db/f15 0 2023-10-08T08:45:28.420 INFO:tasks.workunit.client.0.smithi070.stdout:8/294: link d1/d4d/f68 d1/d2/d6/d22/f6a 0 2023-10-08T08:45:28.421 INFO:tasks.workunit.client.0.smithi070.stdout:2/264: getdents df/d4c 0 2023-10-08T08:45:28.421 INFO:tasks.workunit.client.0.smithi070.stdout:2/265: stat df/d12/d1b/d1c 0 2023-10-08T08:45:28.424 INFO:tasks.workunit.client.0.smithi070.stdout:8/295: mknod d1/de/d3a/d56/d65/c6b 0 2023-10-08T08:45:28.425 INFO:tasks.workunit.client.0.smithi070.stdout:6/247: sync 2023-10-08T08:45:28.428 INFO:tasks.workunit.client.0.smithi070.stdout:0/294: getdents d1/d14 0 2023-10-08T08:45:28.429 INFO:tasks.workunit.client.0.smithi070.stdout:6/248: dread df/d11/f4d [0,4194304] 0 2023-10-08T08:45:28.429 INFO:tasks.workunit.client.0.smithi070.stdout:6/249: write df/d11/f1a [766718,65056] 0 2023-10-08T08:45:28.430 INFO:tasks.workunit.client.0.smithi070.stdout:1/198: dwrite d6/dc/d14/d1f/f25 [4194304,4194304] 0 2023-10-08T08:45:28.430 INFO:tasks.workunit.client.0.smithi070.stdout:1/199: stat d6/dc/d14/d1f/f32 0 2023-10-08T08:45:28.430 INFO:tasks.workunit.client.0.smithi070.stdout:1/200: dread - d6/dc/d14/d1f/f32 zero size 2023-10-08T08:45:28.430 INFO:tasks.workunit.client.0.smithi070.stdout:2/266: creat df/d4c/f51 x:0 0 0 2023-10-08T08:45:28.431 INFO:tasks.workunit.client.0.smithi070.stdout:8/296: rename d1/d2/f17 to d1/de/d3a/f6c 0 2023-10-08T08:45:28.431 INFO:tasks.workunit.client.0.smithi070.stdout:8/297: fsync d1/f24 0 2023-10-08T08:45:28.432 INFO:tasks.workunit.client.0.smithi070.stdout:8/298: truncate d1/de/d2e/f42 319508 0 2023-10-08T08:45:28.432 INFO:tasks.workunit.client.0.smithi070.stdout:0/295: link d1/d14/d1f/f2c d1/dd/f53 0 2023-10-08T08:45:28.434 INFO:tasks.workunit.client.0.smithi070.stdout:6/250: symlink df/d26/l51 0 2023-10-08T08:45:28.436 INFO:tasks.workunit.client.0.smithi070.stdout:1/201: link d6/dc/d14/d1f/d26/l2e d6/dc/d14/d1f/d29/l34 0 2023-10-08T08:45:28.437 INFO:tasks.workunit.client.0.smithi070.stdout:1/202: write d6/dc/f19 [1773873,21894] 0 2023-10-08T08:45:28.440 INFO:tasks.workunit.client.0.smithi070.stdout:2/267: creat df/d3a/f52 x:0 0 0 2023-10-08T08:45:28.440 INFO:tasks.workunit.client.0.smithi070.stdout:0/296: truncate d1/d1d/d24/d47/d38/f4f 34439 0 2023-10-08T08:45:28.440 INFO:tasks.workunit.client.0.smithi070.stdout:0/297: fsync d1/dd/d1b/f27 0 2023-10-08T08:45:28.440 INFO:tasks.workunit.client.0.smithi070.stdout:8/299: mknod d1/d4d/c6d 0 2023-10-08T08:45:28.440 INFO:tasks.workunit.client.0.smithi070.stdout:6/251: symlink df/d26/l52 0 2023-10-08T08:45:28.442 INFO:tasks.workunit.client.0.smithi070.stdout:1/203: mknod d6/dc/d14/d1f/c35 0 2023-10-08T08:45:28.442 INFO:tasks.workunit.client.0.smithi070.stdout:3/218: dwrite d0/db/f29 [0,4194304] 0 2023-10-08T08:45:28.443 INFO:tasks.workunit.client.0.smithi070.stdout:2/268: creat df/d12/d1b/f53 x:0 0 0 2023-10-08T08:45:28.445 INFO:tasks.workunit.client.0.smithi070.stdout:0/298: mkdir d1/d1d/d24/d47/d54 0 2023-10-08T08:45:28.445 INFO:tasks.workunit.client.0.smithi070.stdout:0/299: readlink d1/dd/l2d 0 2023-10-08T08:45:28.445 INFO:tasks.workunit.client.0.smithi070.stdout:0/300: write d1/d14/f43 [16102,67147] 0 2023-10-08T08:45:28.446 INFO:tasks.workunit.client.0.smithi070.stdout:0/301: dread - d1/d1d/f2e zero size 2023-10-08T08:45:28.446 INFO:tasks.workunit.client.0.smithi070.stdout:6/252: mkdir df/d53 0 2023-10-08T08:45:28.447 INFO:tasks.workunit.client.0.smithi070.stdout:1/204: mknod d6/dc/d14/d1f/c36 0 2023-10-08T08:45:28.448 INFO:tasks.workunit.client.0.smithi070.stdout:8/300: dread d1/f24 [0,4194304] 0 2023-10-08T08:45:28.448 INFO:tasks.workunit.client.0.smithi070.stdout:8/301: fdatasync d1/d2/f4a 0 2023-10-08T08:45:28.448 INFO:tasks.workunit.client.0.smithi070.stdout:3/219: write d0/db/d10/d38/f37 [970718,94095] 0 2023-10-08T08:45:28.449 INFO:tasks.workunit.client.0.smithi070.stdout:1/205: write d6/dc/d14/d1f/f25 [2418938,27411] 0 2023-10-08T08:45:28.450 INFO:tasks.workunit.client.0.smithi070.stdout:6/253: creat df/d26/d42/d4b/f54 x:0 0 0 2023-10-08T08:45:28.453 INFO:tasks.workunit.client.0.smithi070.stdout:3/220: creat d0/db/d10/d38/f50 x:0 0 0 2023-10-08T08:45:28.454 INFO:tasks.workunit.client.0.smithi070.stdout:3/221: getdents d0/d12/d14 0 2023-10-08T08:45:28.463 INFO:tasks.workunit.client.0.smithi070.stdout:8/302: read d1/f24 [1053138,122509] 0 2023-10-08T08:45:28.465 INFO:tasks.workunit.client.0.smithi070.stdout:8/303: rename d1/d2/f4a to d1/de/d2e/f6e 0 2023-10-08T08:45:28.466 INFO:tasks.workunit.client.0.smithi070.stdout:8/304: creat d1/d2/d6/d22/d5c/f6f x:0 0 0 2023-10-08T08:45:28.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:28 smithi070 ceph-mon[99513]: pgmap v341: 129 pgs: 129 active+clean; 207 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 23 MiB/s wr, 1.71k op/s 2023-10-08T08:45:28.475 INFO:tasks.workunit.client.0.smithi070.stdout:3/222: dread d0/d12/d14/f2a [4194304,4194304] 0 2023-10-08T08:45:28.476 INFO:tasks.workunit.client.0.smithi070.stdout:3/223: write d0/db/f26 [196541,55874] 0 2023-10-08T08:45:28.479 INFO:tasks.workunit.client.0.smithi070.stdout:3/224: mknod d0/d12/c51 0 2023-10-08T08:45:28.480 INFO:tasks.workunit.client.0.smithi070.stdout:0/302: dwrite d1/d1d/f52 [0,4194304] 0 2023-10-08T08:45:28.480 INFO:tasks.workunit.client.0.smithi070.stdout:3/225: mkdir d0/d12/d14/d1d/d22/d52 0 2023-10-08T08:45:28.482 INFO:tasks.workunit.client.0.smithi070.stdout:8/305: dread d1/de/d2e/f42 [0,4194304] 0 2023-10-08T08:45:28.482 INFO:tasks.workunit.client.0.smithi070.stdout:8/306: write d1/de/d2e/f42 [992734,48194] 0 2023-10-08T08:45:28.483 INFO:tasks.workunit.client.0.smithi070.stdout:0/303: creat d1/d1d/d24/d47/f55 x:0 0 0 2023-10-08T08:45:28.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/226: creat d0/d12/d14/d48/f53 x:0 0 0 2023-10-08T08:45:28.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/227: readlink d0/db/d10/d38/d2f/l32 0 2023-10-08T08:45:28.483 INFO:tasks.workunit.client.0.smithi070.stdout:1/206: dwrite d6/dc/d14/d1f/d29/f2f [0,4194304] 0 2023-10-08T08:45:28.488 INFO:tasks.workunit.client.0.smithi070.stdout:2/269: dwrite df/d12/d15/f41 [0,4194304] 0 2023-10-08T08:45:28.490 INFO:tasks.workunit.client.0.smithi070.stdout:1/207: mknod d6/dc/d14/c37 0 2023-10-08T08:45:28.497 INFO:tasks.workunit.client.0.smithi070.stdout:2/270: mkdir df/d12/d15/d54 0 2023-10-08T08:45:28.497 INFO:tasks.workunit.client.0.smithi070.stdout:2/271: write df/d4c/f51 [555054,26177] 0 2023-10-08T08:45:28.498 INFO:tasks.workunit.client.0.smithi070.stdout:0/304: symlink d1/l56 0 2023-10-08T08:45:28.500 INFO:tasks.workunit.client.0.smithi070.stdout:2/272: creat df/d12/d15/d54/f55 x:0 0 0 2023-10-08T08:45:28.503 INFO:tasks.workunit.client.0.smithi070.stdout:0/305: creat d1/f57 x:0 0 0 2023-10-08T08:45:28.505 INFO:tasks.workunit.client.0.smithi070.stdout:0/306: write d1/d14/d1f/f2c [338038,105737] 0 2023-10-08T08:45:28.507 INFO:tasks.workunit.client.0.smithi070.stdout:1/208: rmdir d6 39 2023-10-08T08:45:28.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/209: mkdir d6/dc/d14/d1f/d26/d38 0 2023-10-08T08:45:28.511 INFO:tasks.workunit.client.0.smithi070.stdout:1/210: unlink d6/dc/f27 0 2023-10-08T08:45:28.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:28 smithi105 ceph-mon[103798]: pgmap v341: 129 pgs: 129 active+clean; 207 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 23 MiB/s wr, 1.71k op/s 2023-10-08T08:45:28.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/211: dwrite f5 [0,4194304] 0 2023-10-08T08:45:28.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:45:28.532 INFO:tasks.workunit.client.0.smithi070.stdout:1/212: mknod d6/dc/d14/d1f/d29/c39 0 2023-10-08T08:45:28.558 INFO:tasks.workunit.client.0.smithi070.stdout:1/213: read d6/f11 [185154,94129] 0 2023-10-08T08:45:28.560 INFO:tasks.workunit.client.0.smithi070.stdout:8/307: dwrite d1/d23/f28 [4194304,4194304] 0 2023-10-08T08:45:28.561 INFO:tasks.workunit.client.0.smithi070.stdout:3/228: dwrite d0/db/fd [0,4194304] 0 2023-10-08T08:45:28.561 INFO:tasks.workunit.client.0.smithi070.stdout:8/308: chown d1/de/d2e/d45/f51 81350773 1 2023-10-08T08:45:28.561 INFO:tasks.workunit.client.0.smithi070.stdout:3/229: stat d0/d12/d14/d1d/l47 0 2023-10-08T08:45:28.562 INFO:tasks.workunit.client.0.smithi070.stdout:1/214: write d6/dc/d14/d1f/d29/f2f [521477,55242] 0 2023-10-08T08:45:28.564 INFO:tasks.workunit.client.0.smithi070.stdout:8/309: rename d1/de/f37 to d1/de/d2e/d45/f70 0 2023-10-08T08:45:28.566 INFO:tasks.workunit.client.0.smithi070.stdout:3/230: link d0/l5 d0/db/d10/d38/l54 0 2023-10-08T08:45:28.566 INFO:tasks.workunit.client.0.smithi070.stdout:3/231: write d0/d12/d14/d48/f53 [768008,111356] 0 2023-10-08T08:45:28.567 INFO:tasks.workunit.client.0.smithi070.stdout:1/215: mknod d6/dc/d14/d1f/c3a 0 2023-10-08T08:45:28.567 INFO:tasks.workunit.client.0.smithi070.stdout:1/216: write d6/f20 [4212791,78197] 0 2023-10-08T08:45:28.571 INFO:tasks.workunit.client.0.smithi070.stdout:8/310: rename d1/d4d/d61/f69 to d1/de/d3a/d56/d65/f71 0 2023-10-08T08:45:28.571 INFO:tasks.workunit.client.0.smithi070.stdout:8/311: chown d1/de/d3a/f55 813 1 2023-10-08T08:45:28.571 INFO:tasks.workunit.client.0.smithi070.stdout:3/232: write d0/d12/f4e [5022705,76313] 0 2023-10-08T08:45:28.573 INFO:tasks.workunit.client.0.smithi070.stdout:1/217: creat d6/f3b x:0 0 0 2023-10-08T08:45:28.574 INFO:tasks.workunit.client.0.smithi070.stdout:1/218: fsync f5 0 2023-10-08T08:45:28.574 INFO:tasks.workunit.client.0.smithi070.stdout:8/312: mknod d1/d2/d6/c72 0 2023-10-08T08:45:28.574 INFO:tasks.workunit.client.0.smithi070.stdout:3/233: write d0/db/f18 [2260449,57602] 0 2023-10-08T08:45:28.576 INFO:tasks.workunit.client.0.smithi070.stdout:1/219: creat d6/dc/d14/d1f/f3c x:0 0 0 2023-10-08T08:45:28.577 INFO:tasks.workunit.client.0.smithi070.stdout:8/313: creat d1/f73 x:0 0 0 2023-10-08T08:45:28.577 INFO:tasks.workunit.client.0.smithi070.stdout:8/314: write d1/de/f64 [627075,86631] 0 2023-10-08T08:45:28.577 INFO:tasks.workunit.client.0.smithi070.stdout:1/220: creat d6/dc/d14/d1f/f3d x:0 0 0 2023-10-08T08:45:28.579 INFO:tasks.workunit.client.0.smithi070.stdout:8/315: unlink d1/d2/d6/d22/f6a 0 2023-10-08T08:45:28.580 INFO:tasks.workunit.client.0.smithi070.stdout:1/221: creat d6/dc/d14/d1f/d26/d38/f3e x:0 0 0 2023-10-08T08:45:28.581 INFO:tasks.workunit.client.0.smithi070.stdout:8/316: truncate d1/de/d3a/f6c 2756481 0 2023-10-08T08:45:28.581 INFO:tasks.workunit.client.0.smithi070.stdout:8/317: dread - d1/de/d3a/f3f zero size 2023-10-08T08:45:28.582 INFO:tasks.workunit.client.0.smithi070.stdout:1/222: rmdir d6/dc/d14 39 2023-10-08T08:45:28.585 INFO:tasks.workunit.client.0.smithi070.stdout:0/307: dread d1/fa [0,4194304] 0 2023-10-08T08:45:28.586 INFO:tasks.workunit.client.0.smithi070.stdout:0/308: getdents d1/d1d/d24/d47/d38 0 2023-10-08T08:45:28.586 INFO:tasks.workunit.client.0.smithi070.stdout:0/309: write d1/f57 [689237,87175] 0 2023-10-08T08:45:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:28 smithi191 ceph-mon[104220]: pgmap v341: 129 pgs: 129 active+clean; 207 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 23 MiB/s wr, 1.71k op/s 2023-10-08T08:45:28.603 INFO:tasks.workunit.client.0.smithi070.stdout:3/234: dread d0/db/f29 [0,4194304] 0 2023-10-08T08:45:28.604 INFO:tasks.workunit.client.0.smithi070.stdout:8/318: dwrite d1/fb [0,4194304] 0 2023-10-08T08:45:28.604 INFO:tasks.workunit.client.0.smithi070.stdout:3/235: write d0/db/f18 [2025545,47699] 0 2023-10-08T08:45:28.604 INFO:tasks.workunit.client.0.smithi070.stdout:8/319: fsync d1/de/d3a/d56/d65/f71 0 2023-10-08T08:45:28.605 INFO:tasks.workunit.client.0.smithi070.stdout:8/320: mkdir d1/d2/d6/d22/d5b/d74 0 2023-10-08T08:45:28.605 INFO:tasks.workunit.client.0.smithi070.stdout:8/321: fdatasync d1/de/d3a/f6c 0 2023-10-08T08:45:28.607 INFO:tasks.workunit.client.0.smithi070.stdout:8/322: rename d1/d2/d6/c2a to d1/de/c75 0 2023-10-08T08:45:28.607 INFO:tasks.workunit.client.0.smithi070.stdout:8/323: write d1/d2/d6/d22/f4b [761374,18662] 0 2023-10-08T08:45:28.607 INFO:tasks.workunit.client.0.smithi070.stdout:4/179: sync 2023-10-08T08:45:28.607 INFO:tasks.workunit.client.0.smithi070.stdout:7/299: sync 2023-10-08T08:45:28.607 INFO:tasks.workunit.client.0.smithi070.stdout:9/189: sync 2023-10-08T08:45:28.607 INFO:tasks.workunit.client.0.smithi070.stdout:9/190: write d1/dd/d26/d27/d2d/f2f [177948,97917] 0 2023-10-08T08:45:28.608 INFO:tasks.workunit.client.0.smithi070.stdout:8/324: unlink d1/de/d3a/f55 0 2023-10-08T08:45:28.608 INFO:tasks.workunit.client.0.smithi070.stdout:4/180: mknod dc/d17/d24/d37/c38 0 2023-10-08T08:45:28.609 INFO:tasks.workunit.client.0.smithi070.stdout:9/191: write d1/dd/d1a/f1d [2669667,41606] 0 2023-10-08T08:45:28.609 INFO:tasks.workunit.client.0.smithi070.stdout:4/181: mknod dc/d17/d24/d37/c39 0 2023-10-08T08:45:28.611 INFO:tasks.workunit.client.0.smithi070.stdout:8/325: dread d1/d2/f1e [0,4194304] 0 2023-10-08T08:45:28.611 INFO:tasks.workunit.client.0.smithi070.stdout:8/326: readlink d1/d2/d6/l52 0 2023-10-08T08:45:28.611 INFO:tasks.workunit.client.0.smithi070.stdout:8/327: chown d1/d2/d6/l67 1 1 2023-10-08T08:45:28.611 INFO:tasks.workunit.client.0.smithi070.stdout:8/328: write d1/d2/f3b [210183,83212] 0 2023-10-08T08:45:28.611 INFO:tasks.workunit.client.0.smithi070.stdout:4/182: creat dc/d17/d24/d37/f3a x:0 0 0 2023-10-08T08:45:28.612 INFO:tasks.workunit.client.0.smithi070.stdout:9/192: write d1/dd/d1a/f1c [1486980,68255] 0 2023-10-08T08:45:28.613 INFO:tasks.workunit.client.0.smithi070.stdout:1/223: dwrite d6/dc/f13 [0,4194304] 0 2023-10-08T08:45:28.613 INFO:tasks.workunit.client.0.smithi070.stdout:0/310: dread d1/d14/d1f/f4e [0,4194304] 0 2023-10-08T08:45:28.613 INFO:tasks.workunit.client.0.smithi070.stdout:0/311: stat d1/d1d/d24/d47/c4b 0 2023-10-08T08:45:28.613 INFO:tasks.workunit.client.0.smithi070.stdout:8/329: link d1/d23/l2f d1/de/d1a/l76 0 2023-10-08T08:45:28.613 INFO:tasks.workunit.client.0.smithi070.stdout:4/183: rename dc/f10 to dc/d17/d24/d37/f3b 0 2023-10-08T08:45:28.615 INFO:tasks.workunit.client.0.smithi070.stdout:1/224: mknod d6/dc/d14/d1f/c3f 0 2023-10-08T08:45:28.617 INFO:tasks.workunit.client.0.smithi070.stdout:0/312: creat d1/d1d/d24/d47/d54/f58 x:0 0 0 2023-10-08T08:45:28.618 INFO:tasks.workunit.client.0.smithi070.stdout:4/184: write dc/ff [4328539,88281] 0 2023-10-08T08:45:28.618 INFO:tasks.workunit.client.0.smithi070.stdout:4/185: write dc/d17/f2e [297701,25529] 0 2023-10-08T08:45:28.621 INFO:tasks.workunit.client.0.smithi070.stdout:1/225: mknod d6/c40 0 2023-10-08T08:45:28.621 INFO:tasks.workunit.client.0.smithi070.stdout:8/330: mknod d1/de/c77 0 2023-10-08T08:45:28.623 INFO:tasks.workunit.client.0.smithi070.stdout:4/186: mknod dc/c3c 0 2023-10-08T08:45:28.623 INFO:tasks.workunit.client.0.smithi070.stdout:3/236: dread d0/db/fd [0,4194304] 0 2023-10-08T08:45:28.625 INFO:tasks.workunit.client.0.smithi070.stdout:1/226: mknod d6/dc/d14/d1f/d29/c41 0 2023-10-08T08:45:28.626 INFO:tasks.workunit.client.0.smithi070.stdout:8/331: mkdir d1/d2/d6/d22/d5c/d78 0 2023-10-08T08:45:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:4/187: symlink dc/d17/d1f/l3d 0 2023-10-08T08:45:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:1/227: creat d6/dc/d14/d1f/d29/f42 x:0 0 0 2023-10-08T08:45:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:1/228: symlink d6/dc/d14/d1f/d26/d38/l43 0 2023-10-08T08:45:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:4/188: rmdir dc 39 2023-10-08T08:45:28.632 INFO:tasks.workunit.client.0.smithi070.stdout:1/229: creat d6/dc/f44 x:0 0 0 2023-10-08T08:45:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:7/300: dwrite d3/d19/d1b/d4a/d9/f48 [0,4194304] 0 2023-10-08T08:45:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:0/313: dwrite d1/d1d/d24/f36 [0,4194304] 0 2023-10-08T08:45:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:8/332: dread d1/d2/f3b [0,4194304] 0 2023-10-08T08:45:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:3/237: read d0/d12/d14/f2a [3326978,111712] 0 2023-10-08T08:45:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:3/238: fsync d0/d12/d14/f39 0 2023-10-08T08:45:28.657 INFO:tasks.workunit.client.0.smithi070.stdout:3/239: symlink d0/d12/d14/d1d/l55 0 2023-10-08T08:45:28.659 INFO:tasks.workunit.client.0.smithi070.stdout:4/189: dwrite dc/d17/f33 [4194304,4194304] 0 2023-10-08T08:45:28.663 INFO:tasks.workunit.client.0.smithi070.stdout:1/230: dwrite d6/dc/f13 [0,4194304] 0 2023-10-08T08:45:28.665 INFO:tasks.workunit.client.0.smithi070.stdout:0/314: rmdir d1/d1d 39 2023-10-08T08:45:28.668 INFO:tasks.workunit.client.0.smithi070.stdout:4/190: mknod dc/c3e 0 2023-10-08T08:45:28.670 INFO:tasks.workunit.client.0.smithi070.stdout:1/231: truncate f5 753726 0 2023-10-08T08:45:28.672 INFO:tasks.workunit.client.0.smithi070.stdout:4/191: mknod dc/d17/d24/c3f 0 2023-10-08T08:45:28.673 INFO:tasks.workunit.client.0.smithi070.stdout:7/301: dwrite d3/f47 [0,4194304] 0 2023-10-08T08:45:28.674 INFO:tasks.workunit.client.0.smithi070.stdout:0/315: rmdir d1/d1d/d24 39 2023-10-08T08:45:28.675 INFO:tasks.workunit.client.0.smithi070.stdout:8/333: dwrite d1/fb [8388608,4194304] 0 2023-10-08T08:45:28.675 INFO:tasks.workunit.client.0.smithi070.stdout:8/334: fsync d1/d2/d6/d22/f33 0 2023-10-08T08:45:28.676 INFO:tasks.workunit.client.0.smithi070.stdout:4/192: rename dc/d17/f23 to dc/d17/d24/f40 0 2023-10-08T08:45:28.680 INFO:tasks.workunit.client.0.smithi070.stdout:7/302: creat d3/f69 x:0 0 0 2023-10-08T08:45:28.682 INFO:tasks.workunit.client.0.smithi070.stdout:4/193: truncate f9 3174613 0 2023-10-08T08:45:28.682 INFO:tasks.workunit.client.0.smithi070.stdout:3/240: dwrite d0/d12/d14/f28 [0,4194304] 0 2023-10-08T08:45:28.682 INFO:tasks.workunit.client.0.smithi070.stdout:3/241: write d0/d12/d14/d1d/f34 [27520,32395] 0 2023-10-08T08:45:28.683 INFO:tasks.workunit.client.0.smithi070.stdout:1/232: dread d6/f11 [4194304,4194304] 0 2023-10-08T08:45:28.683 INFO:tasks.workunit.client.0.smithi070.stdout:8/335: rmdir d1/de 39 2023-10-08T08:45:28.684 INFO:tasks.workunit.client.0.smithi070.stdout:8/336: write d1/de/d2e/d45/f51 [551599,105190] 0 2023-10-08T08:45:28.688 INFO:tasks.workunit.client.0.smithi070.stdout:4/194: link dc/d17/f27 dc/d17/d1f/f41 0 2023-10-08T08:45:28.688 INFO:tasks.workunit.client.0.smithi070.stdout:4/195: fsync dc/d17/d1f/f36 0 2023-10-08T08:45:28.689 INFO:tasks.workunit.client.0.smithi070.stdout:3/242: mknod d0/d12/d14/d1d/d22/c56 0 2023-10-08T08:45:28.690 INFO:tasks.workunit.client.0.smithi070.stdout:1/233: creat d6/dc/d14/d1f/f45 x:0 0 0 2023-10-08T08:45:28.691 INFO:tasks.workunit.client.0.smithi070.stdout:3/243: getdents d0/db 0 2023-10-08T08:45:28.693 INFO:tasks.workunit.client.0.smithi070.stdout:1/234: write d6/f1b [288634,104522] 0 2023-10-08T08:45:28.693 INFO:tasks.workunit.client.0.smithi070.stdout:1/235: readlink d6/dc/d14/d1f/l30 0 2023-10-08T08:45:28.693 INFO:tasks.workunit.client.0.smithi070.stdout:1/236: truncate d6/dc/d14/d1f/f2b 4301672 0 2023-10-08T08:45:28.694 INFO:tasks.workunit.client.0.smithi070.stdout:3/244: mknod d0/d12/d14/d1d/d22/c57 0 2023-10-08T08:45:28.694 INFO:tasks.workunit.client.0.smithi070.stdout:5/286: sync 2023-10-08T08:45:28.694 INFO:tasks.workunit.client.0.smithi070.stdout:6/254: sync 2023-10-08T08:45:28.694 INFO:tasks.workunit.client.0.smithi070.stdout:5/287: chown d5/d5f/d61/d30/l18 462 1 2023-10-08T08:45:28.698 INFO:tasks.workunit.client.0.smithi070.stdout:8/337: dread d1/d4d/f5f [0,4194304] 0 2023-10-08T08:45:28.698 INFO:tasks.workunit.client.0.smithi070.stdout:1/237: rename d6/dc/f19 to d6/dc/f46 0 2023-10-08T08:45:28.698 INFO:tasks.workunit.client.0.smithi070.stdout:8/338: fdatasync d1/d2/d6/d22/f33 0 2023-10-08T08:45:28.699 INFO:tasks.workunit.client.0.smithi070.stdout:3/245: symlink d0/db/l58 0 2023-10-08T08:45:28.699 INFO:tasks.workunit.client.0.smithi070.stdout:3/246: fsync d0/d12/d14/d1d/d22/f33 0 2023-10-08T08:45:28.699 INFO:tasks.workunit.client.0.smithi070.stdout:3/247: readlink d0/db/d10/l16 0 2023-10-08T08:45:28.699 INFO:tasks.workunit.client.0.smithi070.stdout:3/248: write d0/db/d10/d38/f37 [1078549,33342] 0 2023-10-08T08:45:28.699 INFO:tasks.workunit.client.0.smithi070.stdout:1/238: symlink d6/l47 0 2023-10-08T08:45:28.700 INFO:tasks.workunit.client.0.smithi070.stdout:0/316: dwrite d1/d14/d1f/f2c [0,4194304] 0 2023-10-08T08:45:28.700 INFO:tasks.workunit.client.0.smithi070.stdout:0/317: fsync d1/dd/f53 0 2023-10-08T08:45:28.700 INFO:tasks.workunit.client.0.smithi070.stdout:3/249: creat d0/db/d10/f59 x:0 0 0 2023-10-08T08:45:28.701 INFO:tasks.workunit.client.0.smithi070.stdout:1/239: mknod d6/dc/d14/d1f/d26/c48 0 2023-10-08T08:45:28.705 INFO:tasks.workunit.client.0.smithi070.stdout:0/318: creat d1/dd/d1b/f59 x:0 0 0 2023-10-08T08:45:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.707+0000 7f44018db700 1 -- 172.21.15.70:0/2641074805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc0ff640 msgr2=0x7f43fc0ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.707+0000 7f44018db700 1 --2- 172.21.15.70:0/2641074805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc0ff640 0x7f43fc0ffac0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009990 tx=0x7f43f0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.707+0000 7f44018db700 1 -- 172.21.15.70:0/2641074805 shutdown_connections 2023-10-08T08:45:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.707+0000 7f44018db700 1 --2- 172.21.15.70:0/2641074805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43fc100000 0x7f43fc10c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.707+0000 7f44018db700 1 --2- 172.21.15.70:0/2641074805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43fc105650 0x7f43fc105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.707+0000 7f44018db700 1 --2- 172.21.15.70:0/2641074805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc0ff640 0x7f43fc0ffac0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.707+0000 7f44018db700 1 -- 172.21.15.70:0/2641074805 >> 172.21.15.70:0/2641074805 conn(0x7f43fc0767c0 msgr2=0x7f43fc076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.707+0000 7f44018db700 1 -- 172.21.15.70:0/2641074805 shutdown_connections 2023-10-08T08:45:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.707+0000 7f44018db700 1 -- 172.21.15.70:0/2641074805 wait complete. 2023-10-08T08:45:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.708+0000 7f44018db700 1 Processor -- start 2023-10-08T08:45:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.708+0000 7f44018db700 1 -- start start 2023-10-08T08:45:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.708+0000 7f44018db700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43fc0ff640 0x7f43fc197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.708+0000 7f44018db700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc100000 0x7f43fc197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.708+0000 7f44018db700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43fc105650 0x7f43fc198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.708+0000 7f44018db700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1a2d90 con 0x7f43fc100000 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.708+0000 7f44018db700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1a2f00 con 0x7f43fc0ff640 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.708+0000 7f44018db700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1a30c0 con 0x7f43fc105650 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.709+0000 7f43fa7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc100000 0x7f43fc197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.709+0000 7f43fa7fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc100000 0x7f43fc197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52328/0 (socket says 172.21.15.70:52328) 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.709+0000 7f43fa7fc700 1 -- 172.21.15.70:0/1714323148 learned_addr learned my addr 172.21.15.70:0/1714323148 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.709+0000 7f43fa7fc700 1 -- 172.21.15.70:0/1714323148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43fc105650 msgr2=0x7f43fc198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.709+0000 7f43fa7fc700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43fc105650 0x7f43fc198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.709+0000 7f43fa7fc700 1 -- 172.21.15.70:0/1714323148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43fc0ff640 msgr2=0x7f43fc197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.709+0000 7f43fa7fc700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43fc0ff640 0x7f43fc197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.709+0000 7f43fa7fc700 1 -- 172.21.15.70:0/1714323148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f00095f0 con 0x7f43fc100000 2023-10-08T08:45:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.709+0000 7f43fa7fc700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc100000 0x7f43fc197fe0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f43f00098e0 tx=0x7f43f000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.710+0000 7f44008d9700 1 -- 172.21.15.70:0/1714323148 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f001d070 con 0x7f43fc100000 2023-10-08T08:45:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.710+0000 7f44018db700 1 -- 172.21.15.70:0/1714323148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc1a3340 con 0x7f43fc100000 2023-10-08T08:45:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.710+0000 7f44018db700 1 -- 172.21.15.70:0/1714323148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc1a3870 con 0x7f43fc100000 2023-10-08T08:45:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.710+0000 7f44008d9700 1 -- 172.21.15.70:0/1714323148 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43f000fb90 con 0x7f43fc100000 2023-10-08T08:45:28.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.710+0000 7f44008d9700 1 -- 172.21.15.70:0/1714323148 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00173f0 con 0x7f43fc100000 2023-10-08T08:45:28.713 INFO:tasks.workunit.client.0.smithi070.stdout:6/255: dread df/d11/f47 [0,4194304] 0 2023-10-08T08:45:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.713+0000 7f44008d9700 1 -- 172.21.15.70:0/1714323148 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f43f0017550 con 0x7f43fc100000 2023-10-08T08:45:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.714+0000 7f44008d9700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43e40a15f0 0x7f43e40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.714+0000 7f44008d9700 1 -- 172.21.15.70:0/1714323148 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f43f00ce420 con 0x7f43fc100000 2023-10-08T08:45:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.714+0000 7f43faffd700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43e40a15f0 0x7f43e40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.715 INFO:tasks.workunit.client.0.smithi070.stdout:8/339: dread d1/de/d3a/f6c [0,4194304] 0 2023-10-08T08:45:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.714+0000 7f43faffd700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43e40a15f0 0x7f43e40a3ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0060b0 tx=0x7f43ec006040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f440dac4b80 1 Processor -- start 2023-10-08T08:45:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f440dac4b80 1 -- start start 2023-10-08T08:45:28.717 INFO:tasks.workunit.client.0.smithi070.stdout:7/303: dwrite d3/d19/d1b/d1e/f46 [4194304,4194304] 0 2023-10-08T08:45:28.717 INFO:tasks.workunit.client.0.smithi070.stdout:7/304: chown d3/ce 3 1 2023-10-08T08:45:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab017d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017e0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017e0650 0x55ab017e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f440dac4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0173e460 con 0x55ab017d4e80 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f440dac4b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0172fc20 con 0x55ab017d57a0 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f440dac4b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0172d540 con 0x55ab017e0650 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f43faffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab017d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f43faffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab017d5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52334/0 (socket says 172.21.15.70:52334) 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.716+0000 7f43faffd700 1 -- 172.21.15.70:0/398845609 learned_addr learned my addr 172.21.15.70:0/398845609 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.717+0000 7f43faffd700 1 -- 172.21.15.70:0/398845609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017e0650 msgr2=0x55ab017e2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.717+0000 7f43faffd700 1 --2- 172.21.15.70:0/398845609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017e0650 0x55ab017e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.717+0000 7f43faffd700 1 -- 172.21.15.70:0/398845609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 msgr2=0x55ab017e0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.717+0000 7f43faffd700 1 --2- 172.21.15.70:0/398845609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.717+0000 7f43faffd700 1 -- 172.21.15.70:0/398845609 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab01553de0 con 0x55ab017d4e80 2023-10-08T08:45:28.719 INFO:tasks.workunit.client.0.smithi070.stdout:8/340: unlink d1/d2/d6/c41 0 2023-10-08T08:45:28.719 INFO:tasks.workunit.client.0.smithi070.stdout:8/341: chown d1/d2/f31 7773 1 2023-10-08T08:45:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.717+0000 7f43faffd700 1 --2- 172.21.15.70:0/398845609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab017d5260 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f43ec007f70 tx=0x7f43ec010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6265156e2c8daa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.717+0000 7f43e1ffb700 1 -- 172.21.15.70:0/398845609 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec01c070 con 0x55ab017d4e80 2023-10-08T08:45:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.717+0000 7f43e1ffb700 1 -- 172.21.15.70:0/398845609 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43ec00f040 con 0x55ab017d4e80 2023-10-08T08:45:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.717+0000 7f43e1ffb700 1 -- 172.21.15.70:0/398845609 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec020bc0 con 0x55ab017d4e80 2023-10-08T08:45:28.720 INFO:tasks.workunit.client.0.smithi070.stdout:0/319: getdents d1/dd/d1b 0 2023-10-08T08:45:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 -- 172.21.15.70:0/398845609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 msgr2=0x55ab017d5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 --2- 172.21.15.70:0/398845609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab017d5260 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f43ec007f70 tx=0x7f43ec010000 comp rx=0 tx=0).stop 2023-10-08T08:45:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 -- 172.21.15.70:0/398845609 shutdown_connections 2023-10-08T08:45:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 --2- 172.21.15.70:0/398845609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017e0650 0x55ab017e2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 --2- 172.21.15.70:0/398845609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab017d5260 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 --2- 172.21.15.70:0/398845609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017e0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 -- 172.21.15.70:0/398845609 >> 172.21.15.70:0/398845609 conn(0x55ab0174a260 msgr2=0x55ab017d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 -- 172.21.15.70:0/398845609 shutdown_connections 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 -- 172.21.15.70:0/398845609 wait complete. 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.719+0000 7f440dac4b80 1 -- start start 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.720+0000 7f440dac4b80 1 Processor -- start 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.720+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 0x55ab017e0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.720+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017dd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.720+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.720+0000 7f440dac4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab01728e30 con 0x55ab017e0650 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.720+0000 7f440dac4b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab016c5710 con 0x55ab017d57a0 2023-10-08T08:45:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.720+0000 7f440dac4b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab016c53b0 con 0x55ab017d4e80 2023-10-08T08:45:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.720+0000 7f440dac4b80 10 client.0 _ll_register_callbacks cb 0x55ab01522800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:28.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.721+0000 7f43fb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.721+0000 7f43fb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017dd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52344/0 (socket says 172.21.15.70:52344) 2023-10-08T08:45:28.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.721+0000 7f43fb7fe700 1 -- 172.21.15.70:0/823148956 learned_addr learned my addr 172.21.15.70:0/823148956 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:28.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.721+0000 7f43fa7fc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017dd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.721+0000 7f43faffd700 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 0x55ab017e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f43fb7fe700 1 -- 172.21.15.70:0/823148956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 msgr2=0x55ab017e0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f43fb7fe700 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 0x55ab017e0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f43fb7fe700 1 -- 172.21.15.70:0/823148956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 msgr2=0x55ab017dd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f43fb7fe700 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017dd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f43fb7fe700 1 -- 172.21.15.70:0/823148956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec007c20 con 0x55ab017e0650 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f43fb7fe700 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017dd9f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009e20 tx=0x7f43f400b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae68efbc1d1acaf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f43daffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f43daffd700 1 -- 172.21.15.70:0/823148956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f400bdb0 con 0x55ab017e0650 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f43daffd700 1 -- 172.21.15.70:0/823148956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f43f4011420 con 0x55ab017e0650 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.722+0000 7f440dac4b80 1 -- 172.21.15.70:0/823148956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab016f0eb0 con 0x55ab017e0650 2023-10-08T08:45:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f43daffd700 1 -- 172.21.15.70:0/823148956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43f40115e0 con 0x55ab017e0650 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f440dac4b80 10 client.16257 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f440dac4b80 1 -- 172.21.15.70:0/823148956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ab0153cc60 con 0x55ab017e0650 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f43daffd700 1 -- 172.21.15.70:0/823148956 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ab016f0eb0 con 0x55ab017e0650 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f43daffd700 1 -- 172.21.15.70:0/823148956 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f43f40197a0 con 0x55ab017e0650 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f440dac4b80 10 client.16257 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f440dac4b80 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f440dac4b80 20 client.16257 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f440dac4b80 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ab01801380 0x55ab018037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f440dac4b80 4 client.16257 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.723+0000 7f440dac4b80 1 -- 172.21.15.70:0/823148956 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab01721e10 con 0x55ab01801380 2023-10-08T08:45:28.727 INFO:tasks.workunit.client.0.smithi070.stdout:8/342: creat d1/de/d1a/f79 x:0 0 0 2023-10-08T08:45:28.727 INFO:tasks.workunit.client.0.smithi070.stdout:8/343: fsync d1/de/d1a/f66 0 2023-10-08T08:45:28.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.724+0000 7f43faffd700 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ab01801380 0x55ab018037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.725+0000 7f43faffd700 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ab01801380 0x55ab018037a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=460e6aba20c95639 server_cookie=87adf0803a5b5bb7 in_seq=0 out_seq=0 2023-10-08T08:45:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.725+0000 7f43daffd700 10 client.16257 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:28.728 INFO:tasks.workunit.client.0.smithi070.stdout:4/196: dread dc/d17/f21 [0,4194304] 0 2023-10-08T08:45:28.728 INFO:tasks.workunit.client.0.smithi070.stdout:5/288: dread d5/da/d4d/d37/f39 [0,4194304] 0 2023-10-08T08:45:28.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f43daffd700 1 -- 172.21.15.70:0/823148956 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ab01721e10 con 0x55ab01801380 2023-10-08T08:45:28.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f43daffd700 10 client.16257 handle_command_reply: tid=0 2023-10-08T08:45:28.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 client.16257 shutdown 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 -- 172.21.15.70:0/823148956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 msgr2=0x55ab017dd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017dd9f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009e20 tx=0x7f43f400b3c0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 -- 172.21.15.70:0/823148956 shutdown_connections 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017dd9f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 0x55ab017e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ab01801380 0x55ab018037a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 --2- 172.21.15.70:0/823148956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017dd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 -- 172.21.15.70:0/823148956 >> 172.21.15.70:0/823148956 conn(0x55ab0174a260 msgr2=0x55ab017d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f43daffd700 0 client.16257 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 -- 172.21.15.70:0/823148956 shutdown_connections 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.727+0000 7f440dac4b80 1 -- 172.21.15.70:0/823148956 wait complete. 2023-10-08T08:45:28.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.728+0000 7f440dac4b80 20 client.16257 trim_cache size 0 max 16384 2023-10-08T08:45:28.731 INFO:tasks.workunit.client.0.smithi070.stdout:4/197: rename dc/d17/l1a to dc/l42 0 2023-10-08T08:45:28.732 INFO:tasks.workunit.client.0.smithi070.stdout:8/344: write d1/fb [5500003,1189] 0 2023-10-08T08:45:28.732 INFO:tasks.workunit.client.0.smithi070.stdout:4/198: creat dc/d17/d1f/f43 x:0 0 0 2023-10-08T08:45:28.734 INFO:tasks.workunit.client.0.smithi070.stdout:3/250: dwrite d0/d12/d14/d1d/d22/f44 [0,4194304] 0 2023-10-08T08:45:28.735 INFO:tasks.workunit.client.0.smithi070.stdout:8/345: mknod d1/de/d3a/d56/d65/c7a 0 2023-10-08T08:45:28.738 INFO:tasks.workunit.client.0.smithi070.stdout:3/251: mkdir d0/d12/d14/d1d/d22/d52/d5a 0 2023-10-08T08:45:28.738 INFO:tasks.workunit.client.0.smithi070.stdout:3/252: write d0/d12/f2d [716894,118113] 0 2023-10-08T08:45:28.739 INFO:tasks.workunit.client.0.smithi070.stdout:8/346: mkdir d1/de/d2e/d45/d7b 0 2023-10-08T08:45:28.739 INFO:tasks.workunit.client.0.smithi070.stdout:8/347: write d1/d2/d6/d22/f4b [1762986,24280] 0 2023-10-08T08:45:28.739 INFO:tasks.workunit.client.0.smithi070.stdout:8/348: readlink d1/d23/l44 0 2023-10-08T08:45:28.739 INFO:tasks.workunit.client.0.smithi070.stdout:8/349: getdents d1/d2/d6/d22/d5c/d78 0 2023-10-08T08:45:28.740 INFO:tasks.workunit.client.0.smithi070.stdout:3/253: read d0/d12/d14/f2a [1568912,8391] 0 2023-10-08T08:45:28.740 INFO:tasks.workunit.client.0.smithi070.stdout:8/350: symlink d1/de/l7c 0 2023-10-08T08:45:28.740 INFO:tasks.workunit.client.0.smithi070.stdout:8/351: rename d1/d2/d6/d22 to d1/d2/d6/d22/d5c/d7d 22 2023-10-08T08:45:28.741 INFO:tasks.workunit.client.0.smithi070.stdout:3/254: symlink d0/d12/d14/d1d/d22/d52/d5a/l5b 0 2023-10-08T08:45:28.741 INFO:tasks.workunit.client.0.smithi070.stdout:3/255: write d0/db/d10/f59 [929119,74547] 0 2023-10-08T08:45:28.741 INFO:tasks.workunit.client.0.smithi070.stdout:3/256: truncate d0/d12/d14/d1d/d22/f41 59849 0 2023-10-08T08:45:28.741 INFO:tasks.workunit.client.0.smithi070.stdout:1/240: write d6/f12 [408000,46454] 0 2023-10-08T08:45:28.742 INFO:tasks.workunit.client.0.smithi070.stdout:8/352: rmdir d1/d2/d6/d22/d5b 39 2023-10-08T08:45:28.742 INFO:tasks.workunit.client.0.smithi070.stdout:8/353: truncate d1/d2/f31 5213815 0 2023-10-08T08:45:28.744 INFO:tasks.workunit.client.0.smithi070.stdout:4/199: dread dc/d17/d24/f40 [0,4194304] 0 2023-10-08T08:45:28.744 INFO:tasks.workunit.client.0.smithi070.stdout:7/305: dwrite d3/d19/d1b/f64 [0,4194304] 0 2023-10-08T08:45:28.745 INFO:tasks.workunit.client.0.smithi070.stdout:4/200: chown dc/d17/d24/d37 0 1 2023-10-08T08:45:28.746 INFO:tasks.workunit.client.0.smithi070.stdout:6/256: dwrite df/d11/f4d [0,4194304] 0 2023-10-08T08:45:28.746 INFO:tasks.workunit.client.0.smithi070.stdout:3/257: write d0/db/d10/d38/f37 [932939,2643] 0 2023-10-08T08:45:28.746 INFO:tasks.workunit.client.0.smithi070.stdout:6/257: chown df/d11/l2a 29835758 1 2023-10-08T08:45:28.746 INFO:tasks.workunit.client.0.smithi070.stdout:3/258: dread - d0/d12/d14/d48/f4f zero size 2023-10-08T08:45:28.746 INFO:tasks.workunit.client.0.smithi070.stdout:3/259: truncate d0/d12/f2d 1771426 0 2023-10-08T08:45:28.746 INFO:tasks.workunit.client.0.smithi070.stdout:3/260: chown d0/db/d10/c3d 156640883 1 2023-10-08T08:45:28.747 INFO:tasks.workunit.client.0.smithi070.stdout:8/354: write d1/d23/f43 [1184521,97362] 0 2023-10-08T08:45:28.749 INFO:tasks.workunit.client.0.smithi070.stdout:2/273: sync 2023-10-08T08:45:28.749 INFO:tasks.workunit.client.0.smithi070.stdout:1/241: link d6/f28 d6/dc/d14/d1f/d26/f49 0 2023-10-08T08:45:28.752 INFO:tasks.workunit.client.0.smithi070.stdout:7/306: mknod d3/d19/c6a 0 2023-10-08T08:45:28.752 INFO:tasks.workunit.client.0.smithi070.stdout:7/307: stat d3/d19/d1b/d4a/d9/c31 0 2023-10-08T08:45:28.752 INFO:tasks.workunit.client.0.smithi070.stdout:4/201: mknod dc/d17/c44 0 2023-10-08T08:45:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.752+0000 7f440dac4b80 1 Processor -- start 2023-10-08T08:45:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.752+0000 7f440dac4b80 1 -- start start 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 0x55ab017e7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017eb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017d8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f440dac4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab015a9920 con 0x55ab017e0650 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f440dac4b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab017d60d0 con 0x55ab017d57a0 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f440dac4b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab017cdae0 con 0x55ab017d4e80 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017d8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017d8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52350/0 (socket says 172.21.15.70:52350) 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fb7fe700 1 -- 172.21.15.70:0/1243936990 learned_addr learned my addr 172.21.15.70:0/1243936990 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43faffd700 1 --2- 172.21.15.70:0/1243936990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 0x55ab017e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fa7fc700 1 --2- 172.21.15.70:0/1243936990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fb7fe700 1 -- 172.21.15.70:0/1243936990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 msgr2=0x55ab017e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fb7fe700 1 --2- 172.21.15.70:0/1243936990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 0x55ab017e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fb7fe700 1 -- 172.21.15.70:0/1243936990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 msgr2=0x55ab017eb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fb7fe700 1 --2- 172.21.15.70:0/1243936990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017eb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fb7fe700 1 -- 172.21.15.70:0/1243936990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0157a250 con 0x55ab017e0650 2023-10-08T08:45:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43fb7fe700 1 --2- 172.21.15.70:0/1243936990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017d8650 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009df0 tx=0x7f43f4006ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf4fe4732f575b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.753+0000 7f43e27fc700 1 -- 172.21.15.70:0/1243936990 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f40197a0 con 0x55ab017e0650 2023-10-08T08:45:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.754+0000 7f43e27fc700 1 -- 172.21.15.70:0/1243936990 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43f4019900 con 0x55ab017e0650 2023-10-08T08:45:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.754+0000 7f43e27fc700 1 -- 172.21.15.70:0/1243936990 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4024b50 con 0x55ab017e0650 2023-10-08T08:45:28.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.754+0000 7f440dac4b80 1 -- 172.21.15.70:0/1243936990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 msgr2=0x55ab017d8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.754+0000 7f440dac4b80 1 --2- 172.21.15.70:0/1243936990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017d8650 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009df0 tx=0x7f43f4006ce0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.755+0000 7f440dac4b80 1 -- 172.21.15.70:0/1243936990 shutdown_connections 2023-10-08T08:45:28.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.755+0000 7f440dac4b80 1 --2- 172.21.15.70:0/1243936990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017e0650 0x55ab017d8650 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.755+0000 7f440dac4b80 1 --2- 172.21.15.70:0/1243936990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d4e80 0x55ab017e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.755+0000 7f440dac4b80 1 --2- 172.21.15.70:0/1243936990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017d57a0 0x55ab017eb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.755+0000 7f440dac4b80 1 -- 172.21.15.70:0/1243936990 >> 172.21.15.70:0/1243936990 conn(0x55ab0174a260 msgr2=0x55ab017dfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:28.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.755+0000 7f440dac4b80 1 -- 172.21.15.70:0/1243936990 shutdown_connections 2023-10-08T08:45:28.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.755+0000 7f440dac4b80 1 -- 172.21.15.70:0/1243936990 wait complete. 2023-10-08T08:45:28.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.755+0000 7f440dac4b80 1 -- start start 2023-10-08T08:45:28.758 INFO:tasks.workunit.client.0.smithi070.stdout:1/242: dread f5 [0,4194304] 0 2023-10-08T08:45:28.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f440dac4b80 1 Processor -- start 2023-10-08T08:45:28.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab0184e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d57a0 0x55ab0184e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f440dac4b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017e0650 0x55ab017e5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f440dac4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab017e5c40 con 0x55ab017d4e80 2023-10-08T08:45:28.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f440dac4b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab017e5db0 con 0x55ab017e0650 2023-10-08T08:45:28.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f440dac4b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab017e5f70 con 0x55ab017d57a0 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f440dac4b80 10 client.0 _ll_register_callbacks cb 0x55ab01522800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43faffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab0184e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43fa7fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d57a0 0x55ab0184e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43faffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab0184e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52354/0 (socket says 172.21.15.70:52354) 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43faffd700 1 -- 172.21.15.70:0/684664874 learned_addr learned my addr 172.21.15.70:0/684664874 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43fb7fe700 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017e0650 0x55ab017e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43fa7fc700 1 -- 172.21.15.70:0/684664874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017e0650 msgr2=0x55ab017e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43fa7fc700 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017e0650 0x55ab017e5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43fa7fc700 1 -- 172.21.15.70:0/684664874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 msgr2=0x55ab0184e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43fa7fc700 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab0184e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.756+0000 7f43fa7fc700 1 -- 172.21.15.70:0/684664874 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab0153cc60 con 0x55ab017d57a0 2023-10-08T08:45:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f43fa7fc700 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d57a0 0x55ab0184e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43f00cb8a0 tx=0x7f43f009ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1366eee34801db1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f43daffd700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f43daffd700 1 -- 172.21.15.70:0/684664874 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f009b620 con 0x55ab017d57a0 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f43daffd700 1 -- 172.21.15.70:0/684664874 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f43f009f310 con 0x55ab017d57a0 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f440dac4b80 1 -- 172.21.15.70:0/684664874 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43ec00f040 con 0x55ab017d57a0 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f43daffd700 1 -- 172.21.15.70:0/684664874 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43f00a34c0 con 0x55ab017d57a0 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f440dac4b80 10 client.25642 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f440dac4b80 1 -- 172.21.15.70:0/684664874 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ab015522b0 con 0x55ab017d57a0 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f43daffd700 1 -- 172.21.15.70:0/684664874 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43f0081080 con 0x55ab017d57a0 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f43daffd700 1 -- 172.21.15.70:0/684664874 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f43f00a3030 con 0x55ab017d57a0 2023-10-08T08:45:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f440dac4b80 10 client.25642 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:28.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f440dac4b80 10 client.25642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:28.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f440dac4b80 20 client.25642 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:28.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f440dac4b80 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ab018560f0 0x55ab01858510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f440dac4b80 4 client.25642 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:45:28.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.757+0000 7f440dac4b80 1 -- 172.21.15.70:0/684664874 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ab01721b30 con 0x55ab018560f0 2023-10-08T08:45:28.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.758+0000 7f43faffd700 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ab018560f0 0x55ab01858510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.758+0000 7f43faffd700 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ab018560f0 0x55ab01858510 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6af4e277baae52ff server_cookie=3cb6be2610216c35 in_seq=0 out_seq=0 2023-10-08T08:45:28.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.758+0000 7f43daffd700 10 client.25642 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:28.764 INFO:tasks.workunit.client.0.smithi070.stdout:5/289: dwrite d5/f26 [0,4194304] 0 2023-10-08T08:45:28.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f43daffd700 1 -- 172.21.15.70:0/684664874 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ab01721b30 con 0x55ab018560f0 2023-10-08T08:45:28.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f43daffd700 10 client.25642 handle_command_reply: tid=0 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 client.25642 shutdown 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 -- 172.21.15.70:0/684664874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d57a0 msgr2=0x55ab0184e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d57a0 0x55ab0184e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43f00cb8a0 tx=0x7f43f009ab90 comp rx=0 tx=0).stop 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 -- 172.21.15.70:0/684664874 shutdown_connections 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ab018560f0 0x55ab01858510 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab017e0650 0x55ab017e5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ab017d4e80 0x55ab0184e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f43daffd700 0 client.25642 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 --2- 172.21.15.70:0/684664874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ab017d57a0 0x55ab0184e9f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 -- 172.21.15.70:0/684664874 >> 172.21.15.70:0/684664874 conn(0x55ab0174a260 msgr2=0x55ab017eb990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 -- 172.21.15.70:0/684664874 shutdown_connections 2023-10-08T08:45:28.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 1 -- 172.21.15.70:0/684664874 wait complete. 2023-10-08T08:45:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.760+0000 7f440dac4b80 20 client.25642 trim_cache size 0 max 16384 2023-10-08T08:45:28.767 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:45:28.767 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2023-10-08T08:45:28.767 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2023-10-08T08:45:28.767 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:45:28.767 INFO:tasks.workunit.client.0.smithi070.stdout:6/258: mkdir df/d26/d42/d55 0 2023-10-08T08:45:28.768 INFO:tasks.workunit.client.0.smithi070.stdout:6/259: write df/d11/f41 [23830,89970] 0 2023-10-08T08:45:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 -- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43e40a15f0 msgr2=0x7f43e40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43e40a15f0 0x7f43e40a3ab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0060b0 tx=0x7f43ec006040 comp rx=0 tx=0).stop 2023-10-08T08:45:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 -- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc100000 msgr2=0x7f43fc197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc100000 0x7f43fc197fe0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f43f00098e0 tx=0x7f43f000f720 comp rx=0 tx=0).stop 2023-10-08T08:45:28.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 -- 172.21.15.70:0/1714323148 shutdown_connections 2023-10-08T08:45:28.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f43e40a15f0 0x7f43e40a3ab0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43fc105650 0x7f43fc198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43fc0ff640 0x7f43fc197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 --2- 172.21.15.70:0/1714323148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43fc100000 0x7f43fc197fe0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 -- 172.21.15.70:0/1714323148 >> 172.21.15.70:0/1714323148 conn(0x7f43fc0767c0 msgr2=0x7f43fc0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:28.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 -- 172.21.15.70:0/1714323148 shutdown_connections 2023-10-08T08:45:28.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.761+0000 7f44018db700 1 -- 172.21.15.70:0/1714323148 wait complete. 2023-10-08T08:45:28.770 INFO:tasks.workunit.client.0.smithi070.stdout:3/261: unlink d0/d12/f35 0 2023-10-08T08:45:28.770 INFO:tasks.workunit.client.0.smithi070.stdout:8/355: rename d1/de/c75 to d1/de/d3a/d56/d65/c7e 0 2023-10-08T08:45:28.770 INFO:tasks.workunit.client.0.smithi070.stdout:8/356: dread - d1/de/d1a/f49 zero size 2023-10-08T08:45:28.770 INFO:tasks.workunit.client.0.smithi070.stdout:7/308: mknod d3/d19/d1b/d1e/c6b 0 2023-10-08T08:45:28.771 INFO:tasks.workunit.client.0.smithi070.stdout:7/309: read - d3/d19/d1a/f2f zero size 2023-10-08T08:45:28.771 INFO:tasks.workunit.client.0.smithi070.stdout:7/310: write d3/f2e [1622684,104134] 0 2023-10-08T08:45:28.771 INFO:tasks.workunit.client.0.smithi070.stdout:4/202: mknod dc/d17/c45 0 2023-10-08T08:45:28.771 INFO:tasks.workunit.client.0.smithi070.stdout:4/203: write dc/f12 [4234611,729] 0 2023-10-08T08:45:28.771 INFO:tasks.workunit.client.0.smithi070.stdout:4/204: chown dc/d17/f20 5 1 2023-10-08T08:45:28.771 INFO:tasks.workunit.client.0.smithi070.stdout:9/193: sync 2023-10-08T08:45:28.772 INFO:tasks.workunit.client.0.smithi070.stdout:6/260: creat df/d26/d42/d4b/f56 x:0 0 0 2023-10-08T08:45:28.773 INFO:tasks.workunit.client.0.smithi070.stdout:3/262: mkdir d0/d12/d14/d5c 0 2023-10-08T08:45:28.773 INFO:tasks.workunit.client.0.smithi070.stdout:3/263: fsync d0/d12/d14/d1d/d22/f3b 0 2023-10-08T08:45:28.773 INFO:tasks.workunit.client.0.smithi070.stdout:3/264: dread - d0/d12/d14/d1d/d22/f3b zero size 2023-10-08T08:45:28.774 INFO:tasks.workunit.client.0.smithi070.stdout:1/243: dread d6/f10 [0,4194304] 0 2023-10-08T08:45:28.774 INFO:tasks.workunit.client.0.smithi070.stdout:1/244: chown d6/dc/d14/d1f/d26/d38 438927 1 2023-10-08T08:45:28.774 INFO:tasks.workunit.client.0.smithi070.stdout:2/274: getdents df/d12/d15/d54 0 2023-10-08T08:45:28.775 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T08:45:28.775 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:45:28.777 INFO:tasks.workunit.client.0.smithi070.stdout:8/357: unlink d1/de/d3a/d56/d65/c7e 0 2023-10-08T08:45:28.783 INFO:tasks.workunit.client.0.smithi070.stdout:1/245: getdents d6/dc/d14/d1f/d26 0 2023-10-08T08:45:28.783 INFO:tasks.workunit.client.0.smithi070.stdout:1/246: dread - d6/dc/f44 zero size 2023-10-08T08:45:28.783 INFO:tasks.workunit.client.0.smithi070.stdout:7/311: mknod d3/d19/d1b/d4a/d50/c6c 0 2023-10-08T08:45:28.784 INFO:tasks.workunit.client.0.smithi070.stdout:8/358: mknod d1/d2/d6/d22/d5c/d78/c7f 0 2023-10-08T08:45:28.787 INFO:tasks.workunit.client.0.smithi070.stdout:9/194: getdents d1/dd 0 2023-10-08T08:45:28.787 INFO:tasks.workunit.client.0.smithi070.stdout:2/275: write df/d12/f37 [1330839,28852] 0 2023-10-08T08:45:28.792 INFO:tasks.workunit.client.0.smithi070.stdout:5/290: rename d5/da/l20 to d5/da/d4d/l66 0 2023-10-08T08:45:28.792 INFO:tasks.workunit.client.0.smithi070.stdout:7/312: mkdir d3/d19/d6d 0 2023-10-08T08:45:28.792 INFO:tasks.workunit.client.0.smithi070.stdout:8/359: stat d1/d2/d6/fa 0 2023-10-08T08:45:28.796 INFO:tasks.workunit.client.0.smithi070.stdout:1/247: rename d6/dc/d14/d1f/d26/f49 to d6/dc/d14/d1f/d26/d38/f4a 0 2023-10-08T08:45:28.796 INFO:tasks.workunit.client.0.smithi070.stdout:1/248: dread - d6/dc/f44 zero size 2023-10-08T08:45:28.797 INFO:tasks.workunit.client.0.smithi070.stdout:8/360: mkdir d1/de/d2e/d45/d80 0 2023-10-08T08:45:28.797 INFO:tasks.workunit.client.0.smithi070.stdout:8/361: write d1/d2/f1e [921747,124087] 0 2023-10-08T08:45:28.797 INFO:tasks.workunit.client.0.smithi070.stdout:8/362: fdatasync d1/de/d1a/f1b 0 2023-10-08T08:45:28.797 INFO:tasks.workunit.client.0.smithi070.stdout:4/205: dwrite dc/d17/d1f/f34 [0,4194304] 0 2023-10-08T08:45:28.797 INFO:tasks.workunit.client.0.smithi070.stdout:4/206: fsync dc/ff 0 2023-10-08T08:45:28.801 INFO:tasks.workunit.client.0.smithi070.stdout:4/207: rename dc/d17/d1f/f41 to dc/f46 0 2023-10-08T08:45:28.801 INFO:tasks.workunit.client.0.smithi070.stdout:4/208: chown dc/d17 3009 1 2023-10-08T08:45:28.801 INFO:tasks.workunit.client.0.smithi070.stdout:4/209: stat dc/f1e 0 2023-10-08T08:45:28.802 INFO:tasks.workunit.client.0.smithi070.stdout:3/265: dwrite d0/db/d10/d38/f3f [0,4194304] 0 2023-10-08T08:45:28.802 INFO:tasks.workunit.client.0.smithi070.stdout:6/261: dwrite df/d26/d42/d4b/f56 [0,4194304] 0 2023-10-08T08:45:28.803 INFO:tasks.workunit.client.0.smithi070.stdout:1/249: write d6/f11 [7008957,80920] 0 2023-10-08T08:45:28.803 INFO:tasks.workunit.client.0.smithi070.stdout:1/250: read d6/dc/d14/d1f/d26/f31 [116960,75163] 0 2023-10-08T08:45:28.807 INFO:tasks.workunit.client.0.smithi070.stdout:1/251: write f5 [544872,83755] 0 2023-10-08T08:45:28.807 INFO:tasks.workunit.client.0.smithi070.stdout:1/252: truncate d6/dc/d14/d1f/d29/f42 883589 0 2023-10-08T08:45:28.809 INFO:tasks.workunit.client.0.smithi070.stdout:1/253: write d6/dc/f13 [1693144,68544] 0 2023-10-08T08:45:28.810 INFO:tasks.workunit.client.0.smithi070.stdout:3/266: mkdir d0/d12/d14/d5c/d5d 0 2023-10-08T08:45:28.812 INFO:tasks.workunit.client.0.smithi070.stdout:1/254: mkdir d6/dc/d14/d1f/d26/d38/d4b 0 2023-10-08T08:45:28.817 INFO:tasks.workunit.client.0.smithi070.stdout:1/255: link d6/dc/d14/d1f/f45 d6/dc/d14/d1f/f4c 0 2023-10-08T08:45:28.817 INFO:tasks.workunit.client.0.smithi070.stdout:1/256: fsync d6/f20 0 2023-10-08T08:45:28.820 INFO:tasks.workunit.client.0.smithi070.stdout:1/257: creat d6/dc/d14/d1f/d26/f4d x:0 0 0 2023-10-08T08:45:28.820 INFO:tasks.workunit.client.0.smithi070.stdout:7/313: read d3/d19/d1b/d4a/d9/f48 [1407522,122951] 0 2023-10-08T08:45:28.822 INFO:tasks.workunit.client.0.smithi070.stdout:4/210: dread dc/f15 [0,4194304] 0 2023-10-08T08:45:28.823 INFO:tasks.workunit.client.0.smithi070.stdout:1/258: creat d6/dc/d14/d1f/d26/d38/f4e x:0 0 0 2023-10-08T08:45:28.823 INFO:tasks.workunit.client.0.smithi070.stdout:1/259: write d6/dc/d14/d1f/f3c [689334,33827] 0 2023-10-08T08:45:28.826 INFO:tasks.workunit.client.0.smithi070.stdout:7/314: unlink d3/d19/d1b/d4a/c59 0 2023-10-08T08:45:28.826 INFO:tasks.workunit.client.0.smithi070.stdout:7/315: fdatasync d3/d19/d1b/d4a/fd 0 2023-10-08T08:45:28.826 INFO:tasks.workunit.client.0.smithi070.stdout:7/316: chown d3/l3b 8080574 1 2023-10-08T08:45:28.827 INFO:tasks.workunit.client.0.smithi070.stdout:4/211: rename dc/c3e to dc/c47 0 2023-10-08T08:45:28.828 INFO:tasks.workunit.client.0.smithi070.stdout:7/317: creat d3/d19/d1a/f6e x:0 0 0 2023-10-08T08:45:28.829 INFO:tasks.workunit.client.0.smithi070.stdout:4/212: rename dc/d17/f31 to dc/f48 0 2023-10-08T08:45:28.829 INFO:tasks.workunit.client.0.smithi070.stdout:4/213: stat dc/f11 0 2023-10-08T08:45:28.831 INFO:tasks.workunit.client.0.smithi070.stdout:4/214: rmdir dc/d17/d24 39 2023-10-08T08:45:28.840 INFO:tasks.workunit.client.0.smithi070.stdout:2/276: dwrite fa [0,4194304] 0 2023-10-08T08:45:28.842 INFO:tasks.workunit.client.0.smithi070.stdout:4/215: creat dc/d17/d24/f49 x:0 0 0 2023-10-08T08:45:28.844 INFO:tasks.workunit.client.0.smithi070.stdout:8/363: dwrite d1/d2/d6/d22/d5c/f6f [0,4194304] 0 2023-10-08T08:45:28.844 INFO:tasks.workunit.client.0.smithi070.stdout:5/291: dwrite d5/da/d4d/d37/f39 [0,4194304] 0 2023-10-08T08:45:28.844 INFO:tasks.workunit.client.0.smithi070.stdout:5/292: readlink d5/da/l4b 0 2023-10-08T08:45:28.844 INFO:tasks.workunit.client.0.smithi070.stdout:4/216: mknod dc/c4a 0 2023-10-08T08:45:28.846 INFO:tasks.workunit.client.0.smithi070.stdout:9/195: dwrite d1/dd/f10 [4194304,4194304] 0 2023-10-08T08:45:28.846 INFO:tasks.workunit.client.0.smithi070.stdout:8/364: creat d1/d4d/f81 x:0 0 0 2023-10-08T08:45:28.848 INFO:tasks.workunit.client.0.smithi070.stdout:4/217: creat dc/f4b x:0 0 0 2023-10-08T08:45:28.850 INFO:tasks.workunit.client.0.smithi070.stdout:8/365: creat d1/de/d2e/d45/d7b/f82 x:0 0 0 2023-10-08T08:45:28.851 INFO:tasks.workunit.client.0.smithi070.stdout:9/196: symlink d1/dd/d39/l3b 0 2023-10-08T08:45:28.852 INFO:tasks.workunit.client.0.smithi070.stdout:9/197: dread - d1/f2a zero size 2023-10-08T08:45:28.853 INFO:tasks.workunit.client.0.smithi070.stdout:5/293: write d5/da/f16 [2883069,27167] 0 2023-10-08T08:45:28.854 INFO:tasks.workunit.client.0.smithi070.stdout:4/218: write dc/d17/d1f/f34 [833396,9283] 0 2023-10-08T08:45:28.854 INFO:tasks.workunit.client.0.smithi070.stdout:8/366: mknod d1/de/d2e/d45/d7b/c83 0 2023-10-08T08:45:28.857 INFO:tasks.workunit.client.0.smithi070.stdout:8/367: write d1/de/d2e/f48 [314608,17763] 0 2023-10-08T08:45:28.857 INFO:tasks.workunit.client.0.smithi070.stdout:5/294: write d5/da/d4d/d37/f39 [2485172,57012] 0 2023-10-08T08:45:28.857 INFO:tasks.workunit.client.0.smithi070.stdout:8/368: unlink d1/d2/d6/d22/d5c/d78/c7f 0 2023-10-08T08:45:28.858 INFO:tasks.workunit.client.0.smithi070.stdout:5/295: creat d5/da/d4d/f67 x:0 0 0 2023-10-08T08:45:28.858 INFO:tasks.workunit.client.0.smithi070.stdout:3/267: dwrite d0/d12/d14/d48/f4f [0,4194304] 0 2023-10-08T08:45:28.858 INFO:tasks.workunit.client.0.smithi070.stdout:7/318: dwrite d3/d19/d1b/d4a/f43 [0,4194304] 0 2023-10-08T08:45:28.858 INFO:tasks.workunit.client.0.smithi070.stdout:3/268: fdatasync d0/d12/d14/d48/f53 0 2023-10-08T08:45:28.859 INFO:tasks.workunit.client.0.smithi070.stdout:8/369: link d1/d2/d6/d22/d5c/f6f d1/d4d/f84 0 2023-10-08T08:45:28.859 INFO:tasks.workunit.client.0.smithi070.stdout:5/296: creat d5/da/f68 x:0 0 0 2023-10-08T08:45:28.864 INFO:tasks.workunit.client.0.smithi070.stdout:7/319: mknod d3/c6f 0 2023-10-08T08:45:28.864 INFO:tasks.workunit.client.0.smithi070.stdout:1/260: dread d6/f20 [0,4194304] 0 2023-10-08T08:45:28.865 INFO:tasks.workunit.client.0.smithi070.stdout:8/370: creat d1/d2/d6/d22/d5c/d78/f85 x:0 0 0 2023-10-08T08:45:28.873 INFO:tasks.workunit.client.0.smithi070.stdout:2/277: dwrite df/d12/d15/d54/f55 [0,4194304] 0 2023-10-08T08:45:28.873 INFO:tasks.workunit.client.0.smithi070.stdout:7/320: creat d3/d19/d1a/f70 x:0 0 0 2023-10-08T08:45:28.876 INFO:tasks.workunit.client.0.smithi070.stdout:1/261: truncate d6/f18 2344537 0 2023-10-08T08:45:28.876 INFO:tasks.workunit.client.0.smithi070.stdout:1/262: write d6/dc/d14/d1f/d26/d38/f4a [833067,101997] 0 2023-10-08T08:45:28.876 INFO:tasks.workunit.client.0.smithi070.stdout:1/263: dread - d6/dc/d14/d1f/f3d zero size 2023-10-08T08:45:28.877 INFO:tasks.workunit.client.0.smithi070.stdout:1/264: dread d6/dc/d14/d1f/d29/f42 [0,4194304] 0 2023-10-08T08:45:28.884 INFO:tasks.workunit.client.0.smithi070.stdout:4/219: dwrite dc/f15 [0,4194304] 0 2023-10-08T08:45:28.884 INFO:tasks.workunit.client.0.smithi070.stdout:4/220: dread - dc/f1e zero size 2023-10-08T08:45:28.884 INFO:tasks.workunit.client.0.smithi070.stdout:8/371: mkdir d1/de/d3a/d56/d86 0 2023-10-08T08:45:28.884 INFO:tasks.workunit.client.0.smithi070.stdout:7/321: creat d3/f71 x:0 0 0 2023-10-08T08:45:28.886 INFO:tasks.workunit.client.0.smithi070.stdout:4/221: mkdir dc/d17/d24/d4c 0 2023-10-08T08:45:28.887 INFO:tasks.workunit.client.0.smithi070.stdout:8/372: link d1/de/d2e/f42 d1/de/d2e/d45/d7b/f87 0 2023-10-08T08:45:28.888 INFO:tasks.workunit.client.0.smithi070.stdout:7/322: symlink d3/d19/d1a/l72 0 2023-10-08T08:45:28.890 INFO:tasks.workunit.client.0.smithi070.stdout:9/198: dwrite d1/dd/d1a/f1d [0,4194304] 0 2023-10-08T08:45:28.890 INFO:tasks.workunit.client.0.smithi070.stdout:9/199: write d1/dd/f18 [3398799,104886] 0 2023-10-08T08:45:28.890 INFO:tasks.workunit.client.0.smithi070.stdout:4/222: rename dc/d17/f33 to dc/f4d 0 2023-10-08T08:45:28.890 INFO:tasks.workunit.client.0.smithi070.stdout:4/223: readlink dc/l42 0 2023-10-08T08:45:28.890 INFO:tasks.workunit.client.0.smithi070.stdout:3/269: dwrite d0/d12/d14/d1d/d22/f44 [0,4194304] 0 2023-10-08T08:45:28.891 INFO:tasks.workunit.client.0.smithi070.stdout:8/373: truncate d1/d23/f28 4734297 0 2023-10-08T08:45:28.893 INFO:tasks.workunit.client.0.smithi070.stdout:4/224: mkdir dc/d17/d24/d4c/d4e 0 2023-10-08T08:45:28.897 INFO:tasks.workunit.client.0.smithi070.stdout:3/270: unlink d0/f1 0 2023-10-08T08:45:28.897 INFO:tasks.workunit.client.0.smithi070.stdout:3/271: read - d0/d12/d14/d1d/d22/f3b zero size 2023-10-08T08:45:28.897 INFO:tasks.workunit.client.0.smithi070.stdout:3/272: readlink d0/d12/l43 0 2023-10-08T08:45:28.897 INFO:tasks.workunit.client.0.smithi070.stdout:3/273: fsync d0/d12/d14/d48/f53 0 2023-10-08T08:45:28.898 INFO:tasks.workunit.client.0.smithi070.stdout:5/297: dwrite d5/d5f/d61/d30/f14 [0,4194304] 0 2023-10-08T08:45:28.898 INFO:tasks.workunit.client.0.smithi070.stdout:8/374: link d1/de/d1a/l3e d1/d2/d6/d22/d5b/l88 0 2023-10-08T08:45:28.898 INFO:tasks.workunit.client.0.smithi070.stdout:8/375: truncate d1/de/d2e/f6e 977831 0 2023-10-08T08:45:28.898 INFO:tasks.workunit.client.0.smithi070.stdout:8/376: chown d1/de/d3a 33224 1 2023-10-08T08:45:28.901 INFO:tasks.workunit.client.0.smithi070.stdout:3/274: rename d0/d12/f2d to d0/d12/d14/d1d/f5e 0 2023-10-08T08:45:28.902 INFO:tasks.workunit.client.0.smithi070.stdout:8/377: symlink d1/de/d3a/l89 0 2023-10-08T08:45:28.902 INFO:tasks.workunit.client.0.smithi070.stdout:7/323: dread d3/d19/d1a/f4b [0,4194304] 0 2023-10-08T08:45:28.905 INFO:tasks.workunit.client.0.smithi070.stdout:2/278: dread fc [0,4194304] 0 2023-10-08T08:45:28.905 INFO:tasks.workunit.client.0.smithi070.stdout:1/265: dwrite d6/dc/d14/d1f/d26/d38/f4e [0,4194304] 0 2023-10-08T08:45:28.905 INFO:tasks.workunit.client.0.smithi070.stdout:1/266: write d6/f28 [1049412,53123] 0 2023-10-08T08:45:28.905 INFO:tasks.workunit.client.0.smithi070.stdout:8/378: rename d1/d2/d6/d22/d5c/l5d to d1/de/d3a/d56/l8a 0 2023-10-08T08:45:28.906 INFO:tasks.workunit.client.0.smithi070.stdout:3/275: rmdir d0/d12/d14/d48 39 2023-10-08T08:45:28.918 INFO:tasks.workunit.client.0.smithi070.stdout:1/267: write d6/dc/d14/d1f/f2b [2997699,37753] 0 2023-10-08T08:45:28.918 INFO:tasks.workunit.client.0.smithi070.stdout:2/279: creat df/d12/d1b/d1c/f56 x:0 0 0 2023-10-08T08:45:28.918 INFO:tasks.workunit.client.0.smithi070.stdout:2/280: fdatasync df/d12/d15/f42 0 2023-10-08T08:45:28.919 INFO:tasks.workunit.client.0.smithi070.stdout:8/379: creat d1/d2/d6/d22/d5b/d74/f8b x:0 0 0 2023-10-08T08:45:28.919 INFO:tasks.workunit.client.0.smithi070.stdout:8/380: readlink d1/l62 0 2023-10-08T08:45:28.920 INFO:tasks.workunit.client.0.smithi070.stdout:9/200: dwrite d1/dd/f18 [0,4194304] 0 2023-10-08T08:45:28.921 INFO:tasks.workunit.client.0.smithi070.stdout:9/201: stat d1/dd/d39/l3b 0 2023-10-08T08:45:28.921 INFO:tasks.workunit.client.0.smithi070.stdout:5/298: dwrite d5/da/d4d/f64 [0,4194304] 0 2023-10-08T08:45:28.921 INFO:tasks.workunit.client.0.smithi070.stdout:4/225: dwrite dc/f46 [0,4194304] 0 2023-10-08T08:45:28.921 INFO:tasks.workunit.client.0.smithi070.stdout:5/299: write d5/da/f15 [1475621,50814] 0 2023-10-08T08:45:28.922 INFO:tasks.workunit.client.0.smithi070.stdout:1/268: symlink d6/dc/l4f 0 2023-10-08T08:45:28.926 INFO:tasks.workunit.client.0.smithi070.stdout:2/281: mkdir df/d12/d25/d57 0 2023-10-08T08:45:28.927 INFO:tasks.workunit.client.0.smithi070.stdout:1/269: write d6/dc/f2d [1198872,69752] 0 2023-10-08T08:45:28.929 INFO:tasks.workunit.client.0.smithi070.stdout:3/276: dread d0/db/f18 [0,4194304] 0 2023-10-08T08:45:28.931 INFO:tasks.workunit.client.0.smithi070.stdout:4/226: creat dc/d17/d24/d4c/f4f x:0 0 0 2023-10-08T08:45:28.934 INFO:tasks.workunit.client.0.smithi070.stdout:2/282: creat df/d12/d1b/d1c/d2d/f58 x:0 0 0 2023-10-08T08:45:28.934 INFO:tasks.workunit.client.0.smithi070.stdout:2/283: write df/f11 [4234641,26261] 0 2023-10-08T08:45:28.934 INFO:tasks.workunit.client.0.smithi070.stdout:2/284: dread - df/d12/d1b/f3c zero size 2023-10-08T08:45:28.934 INFO:tasks.workunit.client.0.smithi070.stdout:7/324: dwrite d3/f71 [0,4194304] 0 2023-10-08T08:45:28.935 INFO:tasks.workunit.client.0.smithi070.stdout:1/270: creat d6/dc/d14/d1f/d29/f50 x:0 0 0 2023-10-08T08:45:28.937 INFO:tasks.workunit.client.0.smithi070.stdout:4/227: link dc/ff dc/f50 0 2023-10-08T08:45:28.938 INFO:tasks.workunit.client.0.smithi070.stdout:4/228: fsync dc/d17/d24/d37/f3b 0 2023-10-08T08:45:28.939 INFO:tasks.workunit.client.0.smithi070.stdout:8/381: rename d1/d2/d6/d22/d5c/d78 to d1/d2/d8c 0 2023-10-08T08:45:28.939 INFO:tasks.workunit.client.0.smithi070.stdout:8/382: truncate d1/f24 2196794 0 2023-10-08T08:45:28.939 INFO:tasks.workunit.client.0.smithi070.stdout:8/383: truncate d1/de/d21/f47 299372 0 2023-10-08T08:45:28.940 INFO:tasks.workunit.client.0.smithi070.stdout:2/285: creat df/f59 x:0 0 0 2023-10-08T08:45:28.943 INFO:tasks.workunit.client.0.smithi070.stdout:7/325: mknod d3/d19/d1b/d4a/c73 0 2023-10-08T08:45:28.944 INFO:tasks.workunit.client.0.smithi070.stdout:1/271: creat d6/dc/d14/d1f/d26/f51 x:0 0 0 2023-10-08T08:45:28.946 INFO:tasks.workunit.client.0.smithi070.stdout:4/229: unlink dc/d17/d24/d4c/f4f 0 2023-10-08T08:45:28.947 INFO:tasks.workunit.client.0.smithi070.stdout:9/202: dwrite d1/fb [0,4194304] 0 2023-10-08T08:45:28.947 INFO:tasks.workunit.client.0.smithi070.stdout:9/203: chown d1/dd/d26/d27/d2d/c34 1686018304 1 2023-10-08T08:45:28.947 INFO:tasks.workunit.client.0.smithi070.stdout:8/384: link d1/d2/d6/d22/f33 d1/d2/d6/d22/d5c/f8d 0 2023-10-08T08:45:28.949 INFO:tasks.workunit.client.0.smithi070.stdout:0/320: sync 2023-10-08T08:45:28.949 INFO:tasks.workunit.client.0.smithi070.stdout:6/262: sync 2023-10-08T08:45:28.949 INFO:tasks.workunit.client.0.smithi070.stdout:2/286: rmdir df/d12/d25/d57 0 2023-10-08T08:45:28.950 INFO:tasks.workunit.client.0.smithi070.stdout:1/272: creat d6/f52 x:0 0 0 2023-10-08T08:45:28.950 INFO:tasks.workunit.client.0.smithi070.stdout:1/273: fdatasync d6/dc/d14/d1f/f3c 0 2023-10-08T08:45:28.951 INFO:tasks.workunit.client.0.smithi070.stdout:9/204: creat d1/dd/d19/d38/f3c x:0 0 0 2023-10-08T08:45:28.953 INFO:tasks.workunit.client.0.smithi070.stdout:8/385: write d1/de/f64 [333141,117948] 0 2023-10-08T08:45:28.954 INFO:tasks.workunit.client.0.smithi070.stdout:8/386: write d1/f73 [879025,56197] 0 2023-10-08T08:45:28.957 INFO:tasks.workunit.client.0.smithi070.stdout:2/287: creat df/d12/d15/d54/f5a x:0 0 0 2023-10-08T08:45:28.958 INFO:tasks.workunit.client.0.smithi070.stdout:9/205: mknod d1/dd/d19/c3d 0 2023-10-08T08:45:28.964 INFO:tasks.workunit.client.0.smithi070.stdout:5/300: dwrite d5/f9 [0,4194304] 0 2023-10-08T08:45:28.964 INFO:tasks.workunit.client.0.smithi070.stdout:3/277: dwrite d0/d12/d14/f39 [0,4194304] 0 2023-10-08T08:45:28.964 INFO:tasks.workunit.client.0.smithi070.stdout:4/230: read dc/d17/d24/f40 [4177431,107880] 0 2023-10-08T08:45:28.965 INFO:tasks.workunit.client.0.smithi070.stdout:6/263: getdents df/d26/d42/d43/d4a 0 2023-10-08T08:45:28.965 INFO:tasks.workunit.client.0.smithi070.stdout:6/264: readlink df/d11/d1d/l39 0 2023-10-08T08:45:28.973 INFO:tasks.workunit.client.0.smithi070.stdout:1/274: rmdir d6/dc 39 2023-10-08T08:45:28.973 INFO:tasks.workunit.client.0.smithi070.stdout:1/275: chown d6/dc/d14/d1f/d29/c41 13927 1 2023-10-08T08:45:28.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.972+0000 7fd696383700 1 -- 172.21.15.70:0/1111912347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 msgr2=0x7fd6900ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.972+0000 7fd696383700 1 --2- 172.21.15.70:0/1111912347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 0x7fd6900ff9c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd6840099c0 tx=0x7fd684009cd0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.974 INFO:tasks.workunit.client.0.smithi070.stdout:3/278: symlink d0/db/d10/l5f 0 2023-10-08T08:45:28.975 INFO:tasks.workunit.client.0.smithi070.stdout:2/288: rmdir df/d12/d1b/d1c 39 2023-10-08T08:45:28.978 INFO:tasks.workunit.client.0.smithi070.stdout:3/279: symlink d0/d12/d14/d48/l60 0 2023-10-08T08:45:28.978 INFO:tasks.workunit.client.0.smithi070.stdout:3/280: stat d0/d12/f4e 0 2023-10-08T08:45:28.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.976+0000 7fd696383700 1 -- 172.21.15.70:0/1111912347 shutdown_connections 2023-10-08T08:45:28.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.976+0000 7fd696383700 1 --2- 172.21.15.70:0/1111912347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6900fff00 0x7fd69010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.976+0000 7fd696383700 1 --2- 172.21.15.70:0/1111912347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd690105600 0x7fd6901059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.976+0000 7fd696383700 1 --2- 172.21.15.70:0/1111912347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 0x7fd6900ff9c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.976+0000 7fd696383700 1 -- 172.21.15.70:0/1111912347 >> 172.21.15.70:0/1111912347 conn(0x7fd6900fb030 msgr2=0x7fd6900fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:28.979 INFO:tasks.workunit.client.0.smithi070.stdout:2/289: getdents df/d12/d1b 0 2023-10-08T08:45:28.979 INFO:tasks.workunit.client.0.smithi070.stdout:2/290: read - df/d12/d1b/d1c/f56 zero size 2023-10-08T08:45:28.979 INFO:tasks.workunit.client.0.smithi070.stdout:2/291: stat fa 0 2023-10-08T08:45:28.983 INFO:tasks.workunit.client.0.smithi070.stdout:3/281: rename d0/db/d10/d38/f37 to d0/d12/d14/d5c/f61 0 2023-10-08T08:45:28.983 INFO:tasks.workunit.client.0.smithi070.stdout:3/282: read d0/d12/d14/d1d/f34 [54688,122615] 0 2023-10-08T08:45:28.983 INFO:tasks.workunit.client.0.smithi070.stdout:6/265: symlink df/d11/l57 0 2023-10-08T08:45:28.983 INFO:tasks.workunit.client.0.smithi070.stdout:3/283: truncate d0/d12/d14/d48/f4f 2948386 0 2023-10-08T08:45:28.985 INFO:tasks.workunit.client.0.smithi070.stdout:6/266: creat df/d11/f58 x:0 0 0 2023-10-08T08:45:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.986+0000 7fd696383700 1 -- 172.21.15.70:0/1111912347 shutdown_connections 2023-10-08T08:45:28.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.987+0000 7fd696383700 1 -- 172.21.15.70:0/1111912347 wait complete. 2023-10-08T08:45:28.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.987+0000 7fd696383700 1 Processor -- start 2023-10-08T08:45:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd696383700 1 -- start start 2023-10-08T08:45:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd696383700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 0x7fd690071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd696383700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6900fff00 0x7fd690072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd696383700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd690105600 0x7fd69006ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd696383700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69006b4a0 con 0x7fd6900ff540 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd696383700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69006b610 con 0x7fd6900fff00 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd696383700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69006b7d0 con 0x7fd690105600 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd68ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 0x7fd690071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd68ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 0x7fd690071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52368/0 (socket says 172.21.15.70:52368) 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.988+0000 7fd68ffff700 1 -- 172.21.15.70:0/826139964 learned_addr learned my addr 172.21.15.70:0/826139964 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.989+0000 7fd68f7fe700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6900fff00 0x7fd690072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.989+0000 7fd694920700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd690105600 0x7fd69006ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.989+0000 7fd68ffff700 1 -- 172.21.15.70:0/826139964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd690105600 msgr2=0x7fd69006ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.989+0000 7fd68ffff700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd690105600 0x7fd69006ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.989+0000 7fd68ffff700 1 -- 172.21.15.70:0/826139964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6900fff00 msgr2=0x7fd690072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.989+0000 7fd68ffff700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6900fff00 0x7fd690072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.989+0000 7fd68ffff700 1 -- 172.21.15.70:0/826139964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6840095f0 con 0x7fd6900ff540 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.989+0000 7fd68ffff700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 0x7fd690071df0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd68000b550 tx=0x7fd68000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.990+0000 7fd68d7fa700 1 -- 172.21.15.70:0/826139964 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680011830 con 0x7fd6900ff540 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.990+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69006bab0 con 0x7fd6900ff540 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.990+0000 7fd68d7fa700 1 -- 172.21.15.70:0/826139964 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd680011e50 con 0x7fd6900ff540 2023-10-08T08:45:28.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.990+0000 7fd68d7fa700 1 -- 172.21.15.70:0/826139964 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680010dc0 con 0x7fd6900ff540 2023-10-08T08:45:28.993 INFO:tasks.workunit.client.0.smithi070.stdout:0/321: dwrite d1/dd/d1b/f59 [0,4194304] 0 2023-10-08T08:45:28.993 INFO:tasks.workunit.client.0.smithi070.stdout:8/387: dwrite d1/de/d1a/f1b [0,4194304] 0 2023-10-08T08:45:28.994 INFO:tasks.workunit.client.0.smithi070.stdout:6/267: read df/d11/f31 [7424256,1921] 0 2023-10-08T08:45:28.995 INFO:tasks.workunit.client.0.smithi070.stdout:9/206: dwrite d1/dd/d19/f1b [0,4194304] 0 2023-10-08T08:45:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.995+0000 7fd68d7fa700 1 -- 172.21.15.70:0/826139964 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd680010380 con 0x7fd6900ff540 2023-10-08T08:45:28.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.996+0000 7fd68d7fa700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6780a1670 0x7fd6780a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:28.998 INFO:tasks.workunit.client.0.smithi070.stdout:8/388: rename d1/d2/c13 to d1/d2/d6/d22/d5b/c8e 0 2023-10-08T08:45:29.001 INFO:tasks.workunit.client.0.smithi070.stdout:5/301: dwrite d5/d5f/d61/f60 [0,4194304] 0 2023-10-08T08:45:29.001 INFO:tasks.workunit.client.0.smithi070.stdout:6/268: mknod df/d26/d42/d55/c59 0 2023-10-08T08:45:29.002 INFO:tasks.workunit.client.0.smithi070.stdout:8/389: symlink d1/de/d1a/l8f 0 2023-10-08T08:45:29.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.997+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6901a5ef0 con 0x7fd6900ff540 2023-10-08T08:45:29.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:28.999+0000 7fd68f7fe700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6780a1670 0x7fd6780a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.000+0000 7fd68d7fa700 1 -- 172.21.15.70:0/826139964 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd680099400 con 0x7fd6900ff540 2023-10-08T08:45:29.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.000+0000 7fd68f7fe700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6780a1670 0x7fd6780a3b30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd684009990 tx=0x7fd684000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.003 INFO:tasks.workunit.client.0.smithi070.stdout:5/302: unlink d5/d5f/d61/d30/f3d 0 2023-10-08T08:45:29.003 INFO:tasks.workunit.client.0.smithi070.stdout:4/231: dwrite dc/d17/d24/f40 [4194304,4194304] 0 2023-10-08T08:45:29.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.003+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd690107a80 con 0x7fd6900ff540 2023-10-08T08:45:29.006 INFO:tasks.workunit.client.0.smithi070.stdout:4/232: link dc/f15 dc/f51 0 2023-10-08T08:45:29.006 INFO:tasks.workunit.client.0.smithi070.stdout:4/233: truncate dc/ff 5380789 0 2023-10-08T08:45:29.007 INFO:tasks.workunit.client.0.smithi070.stdout:4/234: fsync dc/d17/f21 0 2023-10-08T08:45:29.008 INFO:tasks.workunit.client.0.smithi070.stdout:4/235: creat dc/d17/d24/f52 x:0 0 0 2023-10-08T08:45:29.008 INFO:tasks.workunit.client.0.smithi070.stdout:3/284: dread d0/d12/d14/f39 [0,4194304] 0 2023-10-08T08:45:29.009 INFO:tasks.workunit.client.0.smithi070.stdout:6/269: dread df/d11/f1a [0,4194304] 0 2023-10-08T08:45:29.011 INFO:tasks.workunit.client.0.smithi070.stdout:4/236: creat dc/d17/d24/d37/f53 x:0 0 0 2023-10-08T08:45:29.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.011+0000 7fd68d7fa700 1 -- 172.21.15.70:0/826139964 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd680015060 con 0x7fd6900ff540 2023-10-08T08:45:29.012 INFO:tasks.workunit.client.0.smithi070.stdout:3/285: creat d0/d12/d14/f62 x:0 0 0 2023-10-08T08:45:29.012 INFO:tasks.workunit.client.0.smithi070.stdout:7/326: dwrite d3/d19/d1a/f4e [0,4194304] 0 2023-10-08T08:45:29.012 INFO:tasks.workunit.client.0.smithi070.stdout:7/327: readlink d3/d19/d1b/d4a/l35 0 2023-10-08T08:45:29.013 INFO:tasks.workunit.client.0.smithi070.stdout:6/270: creat df/d53/f5a x:0 0 0 2023-10-08T08:45:29.013 INFO:tasks.workunit.client.0.smithi070.stdout:6/271: read df/d26/d42/d43/d4a/f4f [289924,66824] 0 2023-10-08T08:45:29.014 INFO:tasks.workunit.client.0.smithi070.stdout:8/390: write d1/de/d2e/f42 [264118,90536] 0 2023-10-08T08:45:29.014 INFO:tasks.workunit.client.0.smithi070.stdout:4/237: mkdir dc/d17/d1f/d54 0 2023-10-08T08:45:29.014 INFO:tasks.workunit.client.0.smithi070.stdout:0/322: dwrite d1/f5 [4194304,4194304] 0 2023-10-08T08:45:29.014 INFO:tasks.workunit.client.0.smithi070.stdout:0/323: read d1/d1d/d24/d47/d38/f4f [32769,99487] 0 2023-10-08T08:45:29.015 INFO:tasks.workunit.client.0.smithi070.stdout:3/286: mkdir d0/db/d10/d38/d63 0 2023-10-08T08:45:29.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/272: truncate df/f1b 432664 0 2023-10-08T08:45:29.027 INFO:tasks.workunit.client.0.smithi070.stdout:8/391: link d1/de/d3a/d56/l8a d1/d2/d6/d22/d5c/l90 0 2023-10-08T08:45:29.027 INFO:tasks.workunit.client.0.smithi070.stdout:8/392: truncate d1/de/d3a/d56/d65/f71 169630 0 2023-10-08T08:45:29.027 INFO:tasks.workunit.client.0.smithi070.stdout:8/393: write d1/de/d2e/d45/d7b/f87 [1994300,46393] 0 2023-10-08T08:45:29.027 INFO:tasks.workunit.client.0.smithi070.stdout:4/238: truncate f9 1441716 0 2023-10-08T08:45:29.030 INFO:tasks.workunit.client.0.smithi070.stdout:3/287: link d0/d12/d14/f28 d0/db/d10/d38/f64 0 2023-10-08T08:45:29.030 INFO:tasks.workunit.client.0.smithi070.stdout:3/288: stat d0/d12/d14/d5c/d5d 0 2023-10-08T08:45:29.030 INFO:tasks.workunit.client.0.smithi070.stdout:3/289: truncate d0/d12/d14/d1d/f3a 755107 0 2023-10-08T08:45:29.030 INFO:tasks.workunit.client.0.smithi070.stdout:3/290: truncate d0/db/d10/d38/f50 313581 0 2023-10-08T08:45:29.031 INFO:tasks.workunit.client.0.smithi070.stdout:3/291: dread d0/db/d10/d38/f50 [0,4194304] 0 2023-10-08T08:45:29.031 INFO:tasks.workunit.client.0.smithi070.stdout:3/292: chown d0/db/d10/d38/c4d 37235035 1 2023-10-08T08:45:29.032 INFO:tasks.workunit.client.0.smithi070.stdout:5/303: dwrite d5/da/d22/f47 [0,4194304] 0 2023-10-08T08:45:29.035 INFO:tasks.workunit.client.0.smithi070.stdout:7/328: rmdir d3/d19 39 2023-10-08T08:45:29.036 INFO:tasks.workunit.client.0.smithi070.stdout:7/329: dread - d3/d19/d1a/f6e zero size 2023-10-08T08:45:29.037 INFO:tasks.workunit.client.0.smithi070.stdout:8/394: truncate d1/de/d15/f40 2723191 0 2023-10-08T08:45:29.050 INFO:tasks.workunit.client.0.smithi070.stdout:5/304: getdents d5 0 2023-10-08T08:45:29.051 INFO:tasks.workunit.client.0.smithi070.stdout:0/324: dwrite d1/fa [0,4194304] 0 2023-10-08T08:45:29.054 INFO:tasks.workunit.client.0.smithi070.stdout:3/293: rename d0/d12/d14/d1d/l47 to d0/d12/l65 0 2023-10-08T08:45:29.054 INFO:tasks.workunit.client.0.smithi070.stdout:3/294: write d0/d12/d14/d1d/f5e [2298207,98775] 0 2023-10-08T08:45:29.054 INFO:tasks.workunit.client.0.smithi070.stdout:6/273: dwrite df/d26/d42/d43/d4a/f4f [0,4194304] 0 2023-10-08T08:45:29.054 INFO:tasks.workunit.client.0.smithi070.stdout:6/274: dread - df/d11/d1d/f3c zero size 2023-10-08T08:45:29.054 INFO:tasks.workunit.client.0.smithi070.stdout:6/275: chown df/l3e 8216451 1 2023-10-08T08:45:29.056 INFO:tasks.workunit.client.0.smithi070.stdout:5/305: symlink d5/d5f/d61/d30/d54/l69 0 2023-10-08T08:45:29.056 INFO:tasks.workunit.client.0.smithi070.stdout:5/306: chown d5/da/l1d 26 1 2023-10-08T08:45:29.060 INFO:tasks.workunit.client.0.smithi070.stdout:0/325: link d1/d14/d1f/f42 d1/d1d/d24/d47/d38/f5a 0 2023-10-08T08:45:29.061 INFO:tasks.workunit.client.0.smithi070.stdout:5/307: dread d5/da/d4d/d37/d38/d55/f4c [0,4194304] 0 2023-10-08T08:45:29.062 INFO:tasks.workunit.client.0.smithi070.stdout:3/295: creat d0/db/d10/d38/d2f/f66 x:0 0 0 2023-10-08T08:45:29.062 INFO:tasks.workunit.client.0.smithi070.stdout:8/395: dwrite d1/d2/d6/fa [0,4194304] 0 2023-10-08T08:45:29.064 INFO:tasks.workunit.client.0.smithi070.stdout:0/326: read d1/dd/d1b/f59 [3516857,79750] 0 2023-10-08T08:45:29.066 INFO:tasks.workunit.client.0.smithi070.stdout:7/330: dwrite d3/d19/d1b/d4a/fd [0,4194304] 0 2023-10-08T08:45:29.066 INFO:tasks.workunit.client.0.smithi070.stdout:6/276: rename df/d11/f3f to df/d26/d42/d4b/f5b 0 2023-10-08T08:45:29.074 INFO:tasks.workunit.client.0.smithi070.stdout:4/239: dwrite dc/d17/d1f/f29 [0,4194304] 0 2023-10-08T08:45:29.074 INFO:tasks.workunit.client.0.smithi070.stdout:4/240: dread - dc/d17/d1f/f43 zero size 2023-10-08T08:45:29.074 INFO:tasks.workunit.client.0.smithi070.stdout:5/308: creat d5/da/d4d/d37/d38/f6a x:0 0 0 2023-10-08T08:45:29.074 INFO:tasks.workunit.client.0.smithi070.stdout:6/277: creat df/f5c x:0 0 0 2023-10-08T08:45:29.074 INFO:tasks.workunit.client.0.smithi070.stdout:0/327: dread d1/d14/d1f/f1a [0,4194304] 0 2023-10-08T08:45:29.074 INFO:tasks.workunit.client.0.smithi070.stdout:0/328: truncate d1/d14/f43 395986 0 2023-10-08T08:45:29.074 INFO:tasks.workunit.client.0.smithi070.stdout:3/296: getdents d0/db/d10/d38/d2f 0 2023-10-08T08:45:29.075 INFO:tasks.workunit.client.0.smithi070.stdout:6/278: mkdir df/d26/d42/d43/d5d 0 2023-10-08T08:45:29.076 INFO:tasks.workunit.client.0.smithi070.stdout:5/309: write d5/da/f24 [404450,16461] 0 2023-10-08T08:45:29.078 INFO:tasks.workunit.client.0.smithi070.stdout:0/329: rmdir d1/d14/d1f 39 2023-10-08T08:45:29.078 INFO:tasks.workunit.client.0.smithi070.stdout:0/330: read - d1/d1d/d24/d47/d54/f58 zero size 2023-10-08T08:45:29.078 INFO:tasks.workunit.client.0.smithi070.stdout:0/331: truncate d1/d1d/d24/f36 4381686 0 2023-10-08T08:45:29.078 INFO:tasks.workunit.client.0.smithi070.stdout:0/332: chown d1/d1d/d4d 2014 1 2023-10-08T08:45:29.088 INFO:tasks.workunit.client.0.smithi070.stdout:3/297: truncate d0/db/d10/f2c 30783 0 2023-10-08T08:45:29.088 INFO:tasks.workunit.client.0.smithi070.stdout:3/298: write d0/d12/d14/d1d/f3a [970131,3758] 0 2023-10-08T08:45:29.088 INFO:tasks.workunit.client.0.smithi070.stdout:0/333: symlink d1/d1d/l5b 0 2023-10-08T08:45:29.088 INFO:tasks.workunit.client.0.smithi070.stdout:6/279: rmdir df/d26/d42/d43/d5d 0 2023-10-08T08:45:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.093+0000 7f8731b0f700 1 -- 172.21.15.70:0/1554265767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c109190 msgr2=0x7f872c109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.094 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.093+0000 7f8731b0f700 1 --2- 172.21.15.70:0/1554265767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c109190 0x7f872c109570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8714009990 tx=0x7f8714009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.095 INFO:tasks.workunit.client.0.smithi070.stdout:8/396: dwrite d1/de/d1a/f79 [0,4194304] 0 2023-10-08T08:45:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.095+0000 7f8731b0f700 1 -- 172.21.15.70:0/1554265767 shutdown_connections 2023-10-08T08:45:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.095+0000 7f8731b0f700 1 --2- 172.21.15.70:0/1554265767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f872c112740 0x7f872c114b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.095+0000 7f8731b0f700 1 --2- 172.21.15.70:0/1554265767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c109190 0x7f872c109570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.095+0000 7f8731b0f700 1 --2- 172.21.15.70:0/1554265767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f872c109ab0 0x7f872c112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.095+0000 7f8731b0f700 1 -- 172.21.15.70:0/1554265767 >> 172.21.15.70:0/1554265767 conn(0x7f872c06b7c0 msgr2=0x7f872c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.095+0000 7f8731b0f700 1 -- 172.21.15.70:0/1554265767 shutdown_connections 2023-10-08T08:45:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.095+0000 7f8731b0f700 1 -- 172.21.15.70:0/1554265767 wait complete. 2023-10-08T08:45:29.097 INFO:tasks.workunit.client.0.smithi070.stdout:7/331: dwrite d3/d19/d1a/f70 [0,4194304] 0 2023-10-08T08:45:29.097 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.096+0000 7f8731b0f700 1 Processor -- start 2023-10-08T08:45:29.097 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.096+0000 7f8731b0f700 1 -- start start 2023-10-08T08:45:29.097 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.096+0000 7f8731b0f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f872c109190 0x7f872c19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.098 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.096+0000 7f8731b0f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c109ab0 0x7f872c19d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.098 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.096+0000 7f8731b0f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f872c112740 0x7f872c1a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.098 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.096+0000 7f8731b0f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c1a2300 con 0x7f872c112740 2023-10-08T08:45:29.098 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.096+0000 7f8731b0f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c1a2470 con 0x7f872c109ab0 2023-10-08T08:45:29.098 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.096+0000 7f8731b0f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c1a2630 con 0x7f872c109190 2023-10-08T08:45:29.098 INFO:tasks.workunit.client.0.smithi070.stdout:5/310: dread d5/da/d4d/d37/f39 [0,4194304] 0 2023-10-08T08:45:29.099 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.097+0000 7f872b7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f872c109190 0x7f872c19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.099 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.097+0000 7f872b7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f872c109190 0x7f872c19d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:39960/0 (socket says 172.21.15.70:39960) 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.097+0000 7f872b7fe700 1 -- 172.21.15.70:0/776332929 learned_addr learned my addr 172.21.15.70:0/776332929 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.097+0000 7f872bfff700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f872c112740 0x7f872c1a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.097+0000 7f872b7fe700 1 -- 172.21.15.70:0/776332929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c109ab0 msgr2=0x7f872c19d920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.097+0000 7f872b7fe700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c109ab0 0x7f872c19d920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.097+0000 7f872b7fe700 1 -- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f872c112740 msgr2=0x7f872c1a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.097+0000 7f872b7fe700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f872c112740 0x7f872c1a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.097+0000 7f872b7fe700 1 -- 172.21.15.70:0/776332929 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140095f0 con 0x7f872c109190 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.098+0000 7f872b7fe700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f872c109190 0x7f872c19d3e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8714005910 tx=0x7f8714004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.098+0000 7f8728ff9700 1 -- 172.21.15.70:0/776332929 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871401d070 con 0x7f872c109190 2023-10-08T08:45:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.098+0000 7f8731b0f700 1 -- 172.21.15.70:0/776332929 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c1a28b0 con 0x7f872c109190 2023-10-08T08:45:29.103 INFO:tasks.workunit.client.0.smithi070.stdout:8/397: rmdir d1/d2 39 2023-10-08T08:45:29.103 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.098+0000 7f8728ff9700 1 -- 172.21.15.70:0/776332929 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87140173f0 con 0x7f872c109190 2023-10-08T08:45:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.098+0000 7f8731b0f700 1 -- 172.21.15.70:0/776332929 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c1aa150 con 0x7f872c109190 2023-10-08T08:45:29.104 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.098+0000 7f8728ff9700 1 -- 172.21.15.70:0/776332929 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714021620 con 0x7f872c109190 2023-10-08T08:45:29.105 INFO:tasks.workunit.client.0.smithi070.stdout:0/334: dread d1/dd/d1b/f59 [0,4194304] 0 2023-10-08T08:45:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.104+0000 7f8728ff9700 1 -- 172.21.15.70:0/776332929 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f871400fac0 con 0x7f872c109190 2023-10-08T08:45:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.105+0000 7f873dcf8b80 1 Processor -- start 2023-10-08T08:45:29.106 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.105+0000 7f873dcf8b80 1 -- start start 2023-10-08T08:45:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.105+0000 7f8728ff9700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87180a16b0 0x7f87180a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.105+0000 7f872bfff700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87180a16b0 0x7f87180a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.107 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f8728ff9700 1 -- 172.21.15.70:0/776332929 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f87140ce7c0 con 0x7f872c109190 2023-10-08T08:45:29.107 INFO:tasks.workunit.client.0.smithi070.stdout:4/241: dwrite dc/f4d [4194304,4194304] 0 2023-10-08T08:45:29.108 INFO:tasks.workunit.client.0.smithi070.stdout:4/242: getdents dc/d17/d24/d4c/d4e 0 2023-10-08T08:45:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12257470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f12251380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122518c0 0x563f12251d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f121b1400 con 0x563f12257090 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f872bfff700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87180a16b0 0x7f87180a3b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f871c009be0 tx=0x7f871c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f121a2bc0 con 0x563f122579b0 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f121a04e0 con 0x563f122518c0 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f872b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12257470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f872b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12257470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52388/0 (socket says 172.21.15.70:52388) 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.106+0000 7f872b7fe700 1 -- 172.21.15.70:0/493204218 learned_addr learned my addr 172.21.15.70:0/493204218 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f872affd700 1 --2- 172.21.15.70:0/493204218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f12251380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f872b7fe700 1 -- 172.21.15.70:0/493204218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122518c0 msgr2=0x563f12251d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f872b7fe700 1 --2- 172.21.15.70:0/493204218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122518c0 0x563f12251d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f872b7fe700 1 -- 172.21.15.70:0/493204218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 msgr2=0x563f12251380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f872b7fe700 1 --2- 172.21.15.70:0/493204218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f12251380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f872b7fe700 1 -- 172.21.15.70:0/493204218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f11fc6d80 con 0x563f12257090 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f872b7fe700 1 --2- 172.21.15.70:0/493204218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12257470 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f87140a32d0 tx=0x7f871409b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2474de33577cfc6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f8721ffb700 1 -- 172.21.15.70:0/493204218 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871409bc00 con 0x563f12257090 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f8721ffb700 1 -- 172.21.15.70:0/493204218 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f871409b500 con 0x563f12257090 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.107+0000 7f8721ffb700 1 -- 172.21.15.70:0/493204218 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140ce430 con 0x563f12257090 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 -- 172.21.15.70:0/493204218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 msgr2=0x563f12257470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/493204218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12257470 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f87140a32d0 tx=0x7f871409b3a0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 -- 172.21.15.70:0/493204218 shutdown_connections 2023-10-08T08:45:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/493204218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122518c0 0x563f12251d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/493204218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12257470 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/493204218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f12251380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 -- 172.21.15.70:0/493204218 >> 172.21.15.70:0/493204218 conn(0x563f121bd200 msgr2=0x563f12243b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 -- 172.21.15.70:0/493204218 shutdown_connections 2023-10-08T08:45:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 -- 172.21.15.70:0/493204218 wait complete. 2023-10-08T08:45:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.108+0000 7f873dcf8b80 1 -- start start 2023-10-08T08:45:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.109+0000 7f873dcf8b80 1 Processor -- start 2023-10-08T08:45:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.109+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f122518c0 0x563f1225d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.109+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f12257090 0x563f1225ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.109+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f1225b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.109+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f1219bdd0 con 0x563f122518c0 2023-10-08T08:45:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.109+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f121386b0 con 0x563f122579b0 2023-10-08T08:45:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.109+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f12138350 con 0x563f12257090 2023-10-08T08:45:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.109+0000 7f873dcf8b80 10 client.0 _ll_register_callbacks cb 0x563f11f957a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.109+0000 7f872bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f1225b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f1225b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39854/0 (socket says 172.21.15.70:39854) 2023-10-08T08:45:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872bfff700 1 -- 172.21.15.70:0/535564195 learned_addr learned my addr 172.21.15.70:0/535564195 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872affd700 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f12257090 0x563f1225ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872bfff700 1 -- 172.21.15.70:0/535564195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f12257090 msgr2=0x563f1225ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872bfff700 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f12257090 0x563f1225ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872bfff700 1 -- 172.21.15.70:0/535564195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f122518c0 msgr2=0x563f1225d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872b7fe700 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f122518c0 0x563f1225d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872bfff700 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f122518c0 0x563f1225d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872bfff700 1 -- 172.21.15.70:0/535564195 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c1aa150 con 0x563f122579b0 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872affd700 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f12257090 0x563f1225ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f872bfff700 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f1225b300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e660 tx=0x7f871c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab825d03c94a6aa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f870affd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f870affd700 1 -- 172.21.15.70:0/535564195 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00ee30 con 0x563f122579b0 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f870affd700 1 -- 172.21.15.70:0/535564195 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f871c01e630 con 0x563f122579b0 2023-10-08T08:45:29.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.110+0000 7f873dcf8b80 1 -- 172.21.15.70:0/535564195 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f12163e50 con 0x563f122579b0 2023-10-08T08:45:29.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f870affd700 1 -- 172.21.15.70:0/535564195 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f871c01e7f0 con 0x563f122579b0 2023-10-08T08:45:29.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f873dcf8b80 10 client.25712 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:29.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f873dcf8b80 1 -- 172.21.15.70:0/535564195 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563f11fafc00 con 0x563f122579b0 2023-10-08T08:45:29.117 INFO:tasks.workunit.client.0.smithi070.stdout:6/280: dread df/d26/d42/d43/d4a/f4f [0,4194304] 0 2023-10-08T08:45:29.118 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f870affd700 1 -- 172.21.15.70:0/535564195 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563f12163e50 con 0x563f122579b0 2023-10-08T08:45:29.118 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f870affd700 1 -- 172.21.15.70:0/535564195 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f871c024020 con 0x563f122579b0 2023-10-08T08:45:29.118 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f873dcf8b80 10 client.25712 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:29.118 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f873dcf8b80 10 client.25712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f873dcf8b80 20 client.25712 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563f1226b260 0x563f1226d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f873dcf8b80 4 client.25712 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.111+0000 7f873dcf8b80 1 -- 172.21.15.70:0/535564195 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f12194db0 con 0x563f1226b260 2023-10-08T08:45:29.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.112+0000 7f872b7fe700 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563f1226b260 0x563f1226d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.119 INFO:tasks.workunit.client.0.smithi070.stdout:5/311: rmdir d5/da/d4d/d37/d2a 39 2023-10-08T08:45:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.113+0000 7f870affd700 10 client.25712 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.113+0000 7f872b7fe700 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563f1226b260 0x563f1226d680 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f134108d5d9cfb9 server_cookie=2ac66758643cd842 in_seq=0 out_seq=0 2023-10-08T08:45:29.120 INFO:tasks.workunit.client.0.smithi070.stdout:3/299: dwrite d0/db/f18 [0,4194304] 0 2023-10-08T08:45:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.117+0000 7f870affd700 1 -- 172.21.15.70:0/535564195 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563f12194db0 con 0x563f1226b260 2023-10-08T08:45:29.120 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.117+0000 7f870affd700 10 client.25712 handle_command_reply: tid=0 2023-10-08T08:45:29.121 INFO:tasks.workunit.client.0.smithi070.stdout:4/243: getdents dc/d17 0 2023-10-08T08:45:29.121 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.117+0000 7f873dcf8b80 1 client.25712 shutdown 2023-10-08T08:45:29.121 INFO:tasks.workunit.client.0.smithi070.stdout:8/398: rmdir d1/d2/d6/d22/d5c 39 2023-10-08T08:45:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 -- 172.21.15.70:0/535564195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 msgr2=0x563f1225b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f1225b300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e660 tx=0x7f871c004750 comp rx=0 tx=0).stop 2023-10-08T08:45:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 -- 172.21.15.70:0/535564195 shutdown_connections 2023-10-08T08:45:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563f1226b260 0x563f1226d680 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f1225b300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f122518c0 0x563f1225d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.122 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f870affd700 0 client.25712 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:29.123 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/535564195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f12257090 0x563f1225ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.123 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 -- 172.21.15.70:0/535564195 >> 172.21.15.70:0/535564195 conn(0x563f121bd200 msgr2=0x563f12243010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.123 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 -- 172.21.15.70:0/535564195 shutdown_connections 2023-10-08T08:45:29.123 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 1 -- 172.21.15.70:0/535564195 wait complete. 2023-10-08T08:45:29.123 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.118+0000 7f873dcf8b80 20 client.25712 trim_cache size 0 max 16384 2023-10-08T08:45:29.123 INFO:tasks.workunit.client.0.smithi070.stdout:5/312: rmdir d5/da 39 2023-10-08T08:45:29.123 INFO:tasks.workunit.client.0.smithi070.stdout:4/244: mkdir dc/d17/d24/d55 0 2023-10-08T08:45:29.124 INFO:tasks.workunit.client.0.smithi070.stdout:5/313: rename d5/d5f/d61/d30/d54/l69 to d5/d5f/d63/l6b 0 2023-10-08T08:45:29.124 INFO:tasks.workunit.client.0.smithi070.stdout:4/245: unlink dc/d17/f20 0 2023-10-08T08:45:29.125 INFO:tasks.workunit.client.0.smithi070.stdout:4/246: fsync dc/d17/d24/d37/f3a 0 2023-10-08T08:45:29.125 INFO:tasks.workunit.client.0.smithi070.stdout:4/247: truncate dc/d17/d24/f2f 854901 0 2023-10-08T08:45:29.125 INFO:tasks.workunit.client.0.smithi070.stdout:4/248: dread - dc/f4b zero size 2023-10-08T08:45:29.125 INFO:tasks.workunit.client.0.smithi070.stdout:5/314: creat d5/da/d4d/d37/f6c x:0 0 0 2023-10-08T08:45:29.126 INFO:tasks.workunit.client.0.smithi070.stdout:4/249: symlink dc/d17/d24/d4c/d4e/l56 0 2023-10-08T08:45:29.127 INFO:tasks.workunit.client.0.smithi070.stdout:6/281: write f9 [507341,78627] 0 2023-10-08T08:45:29.127 INFO:tasks.workunit.client.0.smithi070.stdout:0/335: dread d1/fa [0,4194304] 0 2023-10-08T08:45:29.127 INFO:tasks.workunit.client.0.smithi070.stdout:6/282: readlink df/d11/l2e 0 2023-10-08T08:45:29.127 INFO:tasks.workunit.client.0.smithi070.stdout:7/332: dwrite d3/f69 [0,4194304] 0 2023-10-08T08:45:29.127 INFO:tasks.workunit.client.0.smithi070.stdout:6/283: write df/d11/f29 [4888782,3948] 0 2023-10-08T08:45:29.128 INFO:tasks.workunit.client.0.smithi070.stdout:4/250: creat dc/d17/d24/d4c/d4e/f57 x:0 0 0 2023-10-08T08:45:29.128 INFO:tasks.workunit.client.0.smithi070.stdout:4/251: readlink dc/le 0 2023-10-08T08:45:29.128 INFO:tasks.workunit.client.0.smithi070.stdout:5/315: symlink d5/da/l6d 0 2023-10-08T08:45:29.128 INFO:tasks.workunit.client.0.smithi070.stdout:8/399: write d1/d2/d6/d22/f60 [2040917,19367] 0 2023-10-08T08:45:29.129 INFO:tasks.workunit.client.0.smithi070.stdout:0/336: creat d1/d1d/d4d/f5c x:0 0 0 2023-10-08T08:45:29.130 INFO:tasks.workunit.client.0.smithi070.stdout:8/400: write d1/de/d3a/f6c [1865305,7421] 0 2023-10-08T08:45:29.132 INFO:tasks.workunit.client.0.smithi070.stdout:7/333: rename d3/d19/d1b/f41 to d3/d19/d1b/d4a/d9/f74 0 2023-10-08T08:45:29.133 INFO:tasks.workunit.client.0.smithi070.stdout:5/316: mkdir d5/d5f/d61/d30/d54/d62/d6e 0 2023-10-08T08:45:29.134 INFO:tasks.workunit.client.0.smithi070.stdout:6/284: getdents df/d53 0 2023-10-08T08:45:29.136 INFO:tasks.workunit.client.0.smithi070.stdout:8/401: getdents d1/de 0 2023-10-08T08:45:29.140 INFO:tasks.workunit.client.0.smithi070.stdout:3/300: dwrite d0/d12/d14/f2a [4194304,4194304] 0 2023-10-08T08:45:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.140+0000 7f873dcf8b80 1 Processor -- start 2023-10-08T08:45:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.140+0000 7f873dcf8b80 1 -- start start 2023-10-08T08:45:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122518c0 0x563f12243790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12243cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f122668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f1201c8c0 con 0x563f12257090 2023-10-08T08:45:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f12244b60 con 0x563f122579b0 2023-10-08T08:45:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f1225bc10 con 0x563f122518c0 2023-10-08T08:45:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f872bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f122668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f872bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f122668c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39864/0 (socket says 172.21.15.70:39864) 2023-10-08T08:45:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f872bfff700 1 -- 172.21.15.70:0/636147837 learned_addr learned my addr 172.21.15.70:0/636147837 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f872b7fe700 1 --2- 172.21.15.70:0/636147837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122518c0 0x563f12243790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.141+0000 7f872affd700 1 --2- 172.21.15.70:0/636147837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12243cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.143 INFO:tasks.workunit.client.0.smithi070.stdout:7/334: write d3/f2e [724660,29221] 0 2023-10-08T08:45:29.144 INFO:tasks.workunit.client.0.smithi070.stdout:7/335: readlink d3/d19/d1b/d4a/d9/l3f 0 2023-10-08T08:45:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.142+0000 7f872bfff700 1 -- 172.21.15.70:0/636147837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122518c0 msgr2=0x563f12243790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.142+0000 7f872bfff700 1 --2- 172.21.15.70:0/636147837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122518c0 0x563f12243790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.142+0000 7f872bfff700 1 -- 172.21.15.70:0/636147837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 msgr2=0x563f12243cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.142+0000 7f872bfff700 1 --2- 172.21.15.70:0/636147837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12243cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.142+0000 7f872bfff700 1 -- 172.21.15.70:0/636147837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f11fed1f0 con 0x563f122579b0 2023-10-08T08:45:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.142+0000 7f872bfff700 1 --2- 172.21.15.70:0/636147837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f122668c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f871c01c420 tx=0x7f871c005980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6cbc470fc705a8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.142+0000 7f87227fc700 1 -- 172.21.15.70:0/636147837 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00ed00 con 0x563f122579b0 2023-10-08T08:45:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.142+0000 7f87227fc700 1 -- 172.21.15.70:0/636147837 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f871c00ee60 con 0x563f122579b0 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.142+0000 7f87227fc700 1 -- 172.21.15.70:0/636147837 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c005020 con 0x563f122579b0 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.143+0000 7f873dcf8b80 1 -- 172.21.15.70:0/636147837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 msgr2=0x563f122668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.144+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/636147837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f122668c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f871c01c420 tx=0x7f871c005980 comp rx=0 tx=0).stop 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.144+0000 7f873dcf8b80 1 -- 172.21.15.70:0/636147837 shutdown_connections 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.144+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/636147837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122579b0 0x563f122668c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.144+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/636147837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122518c0 0x563f12243790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.144+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/636147837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f12243cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.144+0000 7f873dcf8b80 1 -- 172.21.15.70:0/636147837 >> 172.21.15.70:0/636147837 conn(0x563f121bd200 msgr2=0x563f12259530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.144+0000 7f873dcf8b80 1 -- 172.21.15.70:0/636147837 shutdown_connections 2023-10-08T08:45:29.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.144+0000 7f873dcf8b80 1 -- 172.21.15.70:0/636147837 wait complete. 2023-10-08T08:45:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.145+0000 7f873dcf8b80 1 -- start start 2023-10-08T08:45:29.147 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.145+0000 7f873dcf8b80 1 Processor -- start 2023-10-08T08:45:29.149 INFO:tasks.workunit.client.0.smithi070.stdout:6/285: creat df/d53/f5e x:0 0 0 2023-10-08T08:45:29.149 INFO:tasks.workunit.client.0.smithi070.stdout:5/317: truncate d5/da/d22/f59 291736 0 2023-10-08T08:45:29.149 INFO:tasks.workunit.client.0.smithi070.stdout:0/337: rename d1/d1d/l20 to d1/dd/l5d 0 2023-10-08T08:45:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.145+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122518c0 0x563f12253d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.145+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f122542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.145+0000 7f873dcf8b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122579b0 0x563f12252ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.145+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f12254940 con 0x563f12257090 2023-10-08T08:45:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.145+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f12253010 con 0x563f122518c0 2023-10-08T08:45:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.145+0000 7f873dcf8b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f122531d0 con 0x563f122579b0 2023-10-08T08:45:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.145+0000 7f873dcf8b80 10 client.0 _ll_register_callbacks cb 0x7f871c011e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.146+0000 7f872affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f122542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.146+0000 7f872affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f122542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52410/0 (socket says 172.21.15.70:52410) 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.146+0000 7f872affd700 1 -- 172.21.15.70:0/1110655548 learned_addr learned my addr 172.21.15.70:0/1110655548 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.146+0000 7f872b7fe700 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122518c0 0x563f12253d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.146+0000 7f872affd700 1 -- 172.21.15.70:0/1110655548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122579b0 msgr2=0x563f12252ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.146+0000 7f872affd700 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122579b0 0x563f12252ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.146+0000 7f872affd700 1 -- 172.21.15.70:0/1110655548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122518c0 msgr2=0x563f12253d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.146+0000 7f872affd700 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122518c0 0x563f12253d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.147+0000 7f872affd700 1 -- 172.21.15.70:0/1110655548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f11fafc00 con 0x563f12257090 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.147+0000 7f872affd700 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f122542b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x563f1225c1a0 tx=0x7f8724003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57814a98748cf9f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.147+0000 7f870affd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.147+0000 7f870affd700 1 -- 172.21.15.70:0/1110655548 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400e030 con 0x563f12257090 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.147+0000 7f870affd700 1 -- 172.21.15.70:0/1110655548 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8724008aa0 con 0x563f12257090 2023-10-08T08:45:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.147+0000 7f873dcf8b80 1 -- 172.21.15.70:0/1110655548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f871409b500 con 0x563f12257090 2023-10-08T08:45:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.147+0000 7f870affd700 1 -- 172.21.15.70:0/1110655548 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8724008c60 con 0x563f12257090 2023-10-08T08:45:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.147+0000 7f873dcf8b80 10 client.16284 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.147+0000 7f873dcf8b80 1 -- 172.21.15.70:0/1110655548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563f11fc5250 con 0x563f12257090 2023-10-08T08:45:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.148+0000 7f870affd700 1 -- 172.21.15.70:0/1110655548 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f871409b500 con 0x563f12257090 2023-10-08T08:45:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.148+0000 7f870affd700 1 -- 172.21.15.70:0/1110655548 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8724039420 con 0x563f12257090 2023-10-08T08:45:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.148+0000 7f873dcf8b80 10 client.16284 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.148+0000 7f873dcf8b80 10 client.16284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.148+0000 7f873dcf8b80 20 client.16284 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:29.152 INFO:tasks.workunit.client.0.smithi070.stdout:8/402: rmdir d1/de/d2e/d45 39 2023-10-08T08:45:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.148+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563f12246b40 0x563f12248f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.148+0000 7f873dcf8b80 4 client.16284 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:45:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.148+0000 7f873dcf8b80 1 -- 172.21.15.70:0/1110655548 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563f12194ad0 con 0x563f12246b40 2023-10-08T08:45:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.149+0000 7f872b7fe700 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563f12246b40 0x563f12248f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.150+0000 7f872b7fe700 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563f12246b40 0x563f12248f80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38754e13d8dd8afe server_cookie=847d80d405360cba in_seq=0 out_seq=0 2023-10-08T08:45:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:29.150+0000 7f870affd700 10 client.16284 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:29.154 INFO:tasks.workunit.client.0.smithi070.stdout:0/338: read d1/d14/d1f/f2c [1013470,37771] 0 2023-10-08T08:45:29.160 INFO:tasks.workunit.client.0.smithi070.stdout:5/318: rename d5/da/d4d/l66 to d5/d5f/d61/d30/d54/d62/l6f 0 2023-10-08T08:45:29.160 INFO:tasks.workunit.client.0.smithi070.stdout:4/252: dwrite dc/d17/d24/f52 [0,4194304] 0 2023-10-08T08:45:29.169 INFO:tasks.workunit.client.0.smithi070.stdout:3/301: dwrite d0/d12/f4e [0,4194304] 0 2023-10-08T08:45:29.173 INFO:tasks.workunit.client.0.smithi070.stdout:7/336: dwrite d3/d19/d1b/d4a/d9/f48 [4194304,4194304] 0 2023-10-08T08:45:29.180 INFO:tasks.workunit.client.0.smithi070.stdout:8/403: dwrite d1/de/d2e/f6e [0,4194304] 0 2023-10-08T08:45:29.180 INFO:tasks.workunit.client.0.smithi070.stdout:8/404: fsync d1/de/d2e/f42 0 2023-10-08T08:45:29.180 INFO:tasks.workunit.client.0.smithi070.stdout:8/405: truncate d1/f24 2659330 0 2023-10-08T08:45:29.181 INFO:tasks.workunit.client.0.smithi070.stdout:0/339: dwrite d1/d14/d1f/f42 [0,4194304] 0 2023-10-08T08:45:29.193 INFO:tasks.workunit.client.0.smithi070.stdout:5/319: dwrite d5/da/d22/f47 [0,4194304] 0 2023-10-08T08:45:29.193 INFO:tasks.workunit.client.0.smithi070.stdout:7/337: dread d3/d19/d1b/d4a/f8 [4194304,4194304] 0 2023-10-08T08:45:29.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.315+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd690067e30 con 0x7fd6900ff540 2023-10-08T08:45:29.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.316+0000 7fd68d7fa700 1 -- 172.21.15.70:0/826139964 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+11382 (secure 0 0 0) 0x7fd680095040 con 0x7fd6900ff540 2023-10-08T08:45:29.317 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:45:29.317 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:45:19.776560+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_25670":{"gid":25670,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3069500316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3069500316},{"type":"v1","addr":"172.21.15.105:6835","nonce":3069500316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:45:29.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6780a1670 msgr2=0x7fd6780a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6780a1670 0x7fd6780a3b30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd684009990 tx=0x7fd684000bc0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 msgr2=0x7fd690071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 0x7fd690071df0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd68000b550 tx=0x7fd68000b860 comp rx=0 tx=0).stop 2023-10-08T08:45:29.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 shutdown_connections 2023-10-08T08:45:29.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6780a1670 0x7fd6780a3b30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd690105600 0x7fd69006ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6900ff540 0x7fd690071df0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 --2- 172.21.15.70:0/826139964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6900fff00 0x7fd690072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 >> 172.21.15.70:0/826139964 conn(0x7fd6900fb030 msgr2=0x7fd6900fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 shutdown_connections 2023-10-08T08:45:29.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.318+0000 7fd696383700 1 -- 172.21.15.70:0/826139964 wait complete. 2023-10-08T08:45:29.320 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 31 2023-10-08T08:45:29.331 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T08:45:29.364 INFO:tasks.workunit.client.0.smithi070.stdout:6/286: rmdir df 39 2023-10-08T08:45:29.401 INFO:tasks.workunit.client.0.smithi070.stdout:0/340: getdents d1/d1d/d24/d47/d54 0 2023-10-08T08:45:29.401 INFO:tasks.workunit.client.0.smithi070.stdout:0/341: read - d1/d1d/f51 zero size 2023-10-08T08:45:29.438 INFO:tasks.workunit.client.0.smithi070.stdout:6/287: getdents df/d26/d42 0 2023-10-08T08:45:29.442 INFO:tasks.workunit.client.0.smithi070.stdout:8/406: getdents d1/de/d1a 0 2023-10-08T08:45:29.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.635+0000 7f8afea17700 1 -- 172.21.15.70:0/3813834687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af810ef80 msgr2=0x7f8af81077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.635+0000 7f8afea17700 1 --2- 172.21.15.70:0/3813834687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af810ef80 0x7f8af81077f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009920 tx=0x7f8aec009c30 comp rx=0 tx=0).stop 2023-10-08T08:45:29.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.647+0000 7f8afea17700 1 -- 172.21.15.70:0/3813834687 shutdown_connections 2023-10-08T08:45:29.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.647+0000 7f8afea17700 1 --2- 172.21.15.70:0/3813834687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af8119fd0 0x7f8af811c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.647+0000 7f8afea17700 1 --2- 172.21.15.70:0/3813834687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af810ef80 0x7f8af81077f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.647+0000 7f8afea17700 1 --2- 172.21.15.70:0/3813834687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8107d30 0x7f8af81081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.647+0000 7f8afea17700 1 -- 172.21.15.70:0/3813834687 >> 172.21.15.70:0/3813834687 conn(0x7f8af806b830 msgr2=0x7f8af806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.655+0000 7f8afea17700 1 -- 172.21.15.70:0/3813834687 shutdown_connections 2023-10-08T08:45:29.664 INFO:tasks.workunit.client.0.smithi070.stdout:6/288: read f5 [83158,28881] 0 2023-10-08T08:45:29.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.661+0000 7f8afea17700 1 -- 172.21.15.70:0/3813834687 wait complete. 2023-10-08T08:45:29.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.662+0000 7f8afea17700 1 Processor -- start 2023-10-08T08:45:29.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.667+0000 7f8afea17700 1 -- start start 2023-10-08T08:45:29.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.667+0000 7f8afea17700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8107d30 0x7f8af81ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.667+0000 7f8afea17700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af810ef80 0x7f8af81abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.667+0000 7f8afea17700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8119fd0 0x7f8af81a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.667+0000 7f8afea17700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af81a60a0 con 0x7f8af8119fd0 2023-10-08T08:45:29.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.667+0000 7f8afea17700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af81a61e0 con 0x7f8af810ef80 2023-10-08T08:45:29.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.667+0000 7f8afea17700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af81a63a0 con 0x7f8af8107d30 2023-10-08T08:45:29.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.672+0000 7f8af77fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af810ef80 0x7f8af81abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.672+0000 7f8af77fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af810ef80 0x7f8af81abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39880/0 (socket says 172.21.15.70:39880) 2023-10-08T08:45:29.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.672+0000 7f8af77fe700 1 -- 172.21.15.70:0/2582161695 learned_addr learned my addr 172.21.15.70:0/2582161695 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.675+0000 7f8af77fe700 1 -- 172.21.15.70:0/2582161695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8107d30 msgr2=0x7f8af81ab830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T08:45:29.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.675+0000 7f8af77fe700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8107d30 0x7f8af81ab830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.675+0000 7f8af77fe700 1 -- 172.21.15.70:0/2582161695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8119fd0 msgr2=0x7f8af81a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.675+0000 7f8af77fe700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8119fd0 0x7f8af81a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.675+0000 7f8af77fe700 1 -- 172.21.15.70:0/2582161695 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec009520 con 0x7f8af810ef80 2023-10-08T08:45:29.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.680+0000 7f8af77fe700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af810ef80 0x7f8af81abd70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800d980 tx=0x7f8ae800dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.694+0000 7f8af57fa700 1 -- 172.21.15.70:0/2582161695 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8009b40 con 0x7f8af810ef80 2023-10-08T08:45:29.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.694+0000 7f8af57fa700 1 -- 172.21.15.70:0/2582161695 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ae800de60 con 0x7f8af810ef80 2023-10-08T08:45:29.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.694+0000 7f8af57fa700 1 -- 172.21.15.70:0/2582161695 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800f620 con 0x7f8af810ef80 2023-10-08T08:45:29.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.694+0000 7f8afea17700 1 -- 172.21.15.70:0/2582161695 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af81a6680 con 0x7f8af810ef80 2023-10-08T08:45:29.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.694+0000 7f8afea17700 1 -- 172.21.15.70:0/2582161695 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af810f990 con 0x7f8af810ef80 2023-10-08T08:45:29.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.699+0000 7f8b0ac00b80 1 Processor -- start 2023-10-08T08:45:29.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.701+0000 7f8b0ac00b80 1 -- start start 2023-10-08T08:45:29.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.701+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a19e80 0x5605d6a1a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.701+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a25110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.701+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 0x5605d6a27a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.701+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d6983460 con 0x5605d6a1a7a0 2023-10-08T08:45:29.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.701+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d6974c20 con 0x5605d6a25650 2023-10-08T08:45:29.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.701+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d6972540 con 0x5605d6a19e80 2023-10-08T08:45:29.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.705+0000 7f8af7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a25110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.705+0000 7f8af7fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a25110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52428/0 (socket says 172.21.15.70:52428) 2023-10-08T08:45:29.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.705+0000 7f8af7fff700 1 -- 172.21.15.70:0/3997373806 learned_addr learned my addr 172.21.15.70:0/3997373806 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.707 INFO:tasks.workunit.client.0.smithi070.stdout:8/407: dwrite d1/d2/d6/d22/f4b [0,4194304] 0 2023-10-08T08:45:29.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.706+0000 7f8af77fe700 1 --2- 172.21.15.70:0/3997373806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 0x5605d6a27a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.706+0000 7f8afcfb4700 1 --2- 172.21.15.70:0/3997373806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a19e80 0x5605d6a1a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.706+0000 7f8af7fff700 1 -- 172.21.15.70:0/3997373806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a19e80 msgr2=0x5605d6a1a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.706+0000 7f8af7fff700 1 --2- 172.21.15.70:0/3997373806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a19e80 0x5605d6a1a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.706+0000 7f8af7fff700 1 -- 172.21.15.70:0/3997373806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 msgr2=0x5605d6a27a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.706+0000 7f8af7fff700 1 --2- 172.21.15.70:0/3997373806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 0x5605d6a27a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.706+0000 7f8af7fff700 1 -- 172.21.15.70:0/3997373806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605d6798de0 con 0x5605d6a1a7a0 2023-10-08T08:45:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.706+0000 7f8af7fff700 1 --2- 172.21.15.70:0/3997373806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a25110 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8aec000c00 tx=0x7f8aec010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faff46d4af0d4c2b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.708+0000 7f8af57fa700 1 -- 172.21.15.70:0/2582161695 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8ae8010460 con 0x7f8af810ef80 2023-10-08T08:45:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.708+0000 7f8af57fa700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a1800 0x7f8ae00a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.709+0000 7f8af57fa700 1 -- 172.21.15.70:0/2582161695 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8ae80cd220 con 0x7f8af810ef80 2023-10-08T08:45:29.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.711+0000 7f8afcfb4700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a1800 0x7f8ae00a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.713+0000 7f8afcfb4700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a1800 0x7f8ae00a3cc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8af81ac4c0 tx=0x7f8af0007770 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.716+0000 7f8ade7fc700 1 -- 172.21.15.70:0/3997373806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec01c070 con 0x5605d6a1a7a0 2023-10-08T08:45:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.716+0000 7f8ade7fc700 1 -- 172.21.15.70:0/3997373806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8aec010e30 con 0x5605d6a1a7a0 2023-10-08T08:45:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.716+0000 7f8ade7fc700 1 -- 172.21.15.70:0/3997373806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec00b790 con 0x5605d6a1a7a0 2023-10-08T08:45:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.717+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/3997373806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 msgr2=0x5605d6a25110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.717+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/3997373806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a25110 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8aec000c00 tx=0x7f8aec010c90 comp rx=0 tx=0).stop 2023-10-08T08:45:29.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.718+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/3997373806 shutdown_connections 2023-10-08T08:45:29.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.718+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/3997373806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 0x5605d6a27a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.718+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/3997373806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a19e80 0x5605d6a1a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.718+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/3997373806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a25110 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.718+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/3997373806 >> 172.21.15.70:0/3997373806 conn(0x5605d698f260 msgr2=0x5605d6a162d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.724+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/3997373806 shutdown_connections 2023-10-08T08:45:29.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.724+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/3997373806 wait complete. 2023-10-08T08:45:29.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.724+0000 7f8b0ac00b80 1 -- start start 2023-10-08T08:45:29.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.725+0000 7f8b0ac00b80 1 Processor -- start 2023-10-08T08:45:29.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.725+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a19e80 0x5605d6a25020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.725+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a22360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.725+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a25650 0x5605d6a22970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.725+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d696de30 con 0x5605d6a1a7a0 2023-10-08T08:45:29.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.725+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d690a710 con 0x5605d6a19e80 2023-10-08T08:45:29.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.725+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d690a3b0 con 0x5605d6a25650 2023-10-08T08:45:29.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.725+0000 7f8b0ac00b80 10 client.0 _ll_register_callbacks cb 0x5605d6767800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:29.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.726+0000 7f8af77fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a22360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.726+0000 7f8af77fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a22360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52436/0 (socket says 172.21.15.70:52436) 2023-10-08T08:45:29.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.726+0000 7f8af77fe700 1 -- 172.21.15.70:0/2898674042 learned_addr learned my addr 172.21.15.70:0/2898674042 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.726+0000 7f8af7fff700 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a19e80 0x5605d6a25020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.727+0000 7f8af77fe700 1 -- 172.21.15.70:0/2898674042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a25650 msgr2=0x5605d6a22970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T08:45:29.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.727+0000 7f8af77fe700 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a25650 0x5605d6a22970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.727+0000 7f8af77fe700 1 -- 172.21.15.70:0/2898674042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a19e80 msgr2=0x5605d6a25020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.727+0000 7f8af77fe700 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a19e80 0x5605d6a25020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.727+0000 7f8af77fe700 1 -- 172.21.15.70:0/2898674042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af811ccc0 con 0x5605d6a1a7a0 2023-10-08T08:45:29.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.728+0000 7f8af77fe700 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a22360 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80963d0 tx=0x7f8ae8099960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb45400f11f3aa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.735+0000 7f8ad77fe700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.735+0000 7f8ad77fe700 1 -- 172.21.15.70:0/2898674042 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae809a330 con 0x5605d6a1a7a0 2023-10-08T08:45:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.735+0000 7f8ad77fe700 1 -- 172.21.15.70:0/2898674042 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8ae809e020 con 0x5605d6a1a7a0 2023-10-08T08:45:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.735+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/2898674042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605d6935eb0 con 0x5605d6a1a7a0 2023-10-08T08:45:29.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.739+0000 7f8ad77fe700 1 -- 172.21.15.70:0/2898674042 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ae80a2260 con 0x5605d6a1a7a0 2023-10-08T08:45:29.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.739+0000 7f8b0ac00b80 10 client.16293 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:29.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.739+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/2898674042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5605d6781c60 con 0x5605d6a1a7a0 2023-10-08T08:45:29.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.741+0000 7f8ad77fe700 1 -- 172.21.15.70:0/2898674042 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5605d6935eb0 con 0x5605d6a1a7a0 2023-10-08T08:45:29.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.741+0000 7f8ad77fe700 1 -- 172.21.15.70:0/2898674042 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8ae80a1f10 con 0x5605d6a1a7a0 2023-10-08T08:45:29.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.741+0000 7f8b0ac00b80 10 client.16293 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:29.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.741+0000 7f8b0ac00b80 10 client.16293 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-10-08T08:45:29.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.741+0000 7f8b0ac00b80 20 client.16293 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:29.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.741+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5605d6a35120 0x5605d6a37540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.741+0000 7f8b0ac00b80 4 client.16293 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:29.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.741+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/2898674042 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5605d6966e10 con 0x5605d6a35120 2023-10-08T08:45:29.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.745+0000 7f8af7fff700 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5605d6a35120 0x5605d6a37540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.755+0000 7f8ad77fe700 10 client.16293 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:45:29.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.755+0000 7f8af7fff700 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5605d6a35120 0x5605d6a37540 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=99d6fe3efc42248e server_cookie=85379409f2d5856 in_seq=0 out_seq=0 2023-10-08T08:45:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.771+0000 7f8ad77fe700 1 -- 172.21.15.70:0/2898674042 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5605d6966e10 con 0x5605d6a35120 2023-10-08T08:45:29.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.771+0000 7f8ad77fe700 10 client.16293 handle_command_reply: tid=0 2023-10-08T08:45:29.774 INFO:tasks.workunit.client.0.smithi070.stdout:8/408: dread d1/de/d15/f20 [0,4194304] 0 2023-10-08T08:45:29.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.777+0000 7f8b0ac00b80 1 client.16293 shutdown 2023-10-08T08:45:29.783 INFO:tasks.workunit.client.0.smithi070.stdout:8/409: link d1/de/d3a/d56/d65/c7a d1/d2/d6/d22/d5b/d74/c91 0 2023-10-08T08:45:29.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.783+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/2898674042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 msgr2=0x5605d6a22360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.783+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a22360 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80963d0 tx=0x7f8ae8099960 comp rx=0 tx=0).stop 2023-10-08T08:45:29.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.783+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/2898674042 shutdown_connections 2023-10-08T08:45:29.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.783+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a25650 0x5605d6a22970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.783+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a19e80 0x5605d6a25020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.783+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5605d6a35120 0x5605d6a37540 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.783+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/2898674042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a1a7a0 0x5605d6a22360 secure :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80963d0 tx=0x7f8ae8099960 comp rx=0 tx=0).stop 2023-10-08T08:45:29.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.783+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/2898674042 >> 172.21.15.70:0/2898674042 conn(0x5605d698f260 msgr2=0x5605d6a15ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.788+0000 7f8ad77fe700 0 client.16293 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:45:29.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.790+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/2898674042 shutdown_connections 2023-10-08T08:45:29.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.794+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/2898674042 wait complete. 2023-10-08T08:45:29.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.804+0000 7f8b0ac00b80 20 client.16293 trim_cache size 0 max 16384 2023-10-08T08:45:29.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.836+0000 7f8b0ac00b80 1 Processor -- start 2023-10-08T08:45:29.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.836+0000 7f8b0ac00b80 1 -- start start 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.836+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a19e80 0x5605d6a1cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.836+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a25650 0x5605d6a2c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.836+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 0x5605d6a1d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.836+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d67ee920 con 0x5605d6a25650 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.836+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d6a23940 con 0x5605d6a19e80 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.836+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d6a10570 con 0x5605d6a15890 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.837+0000 7f8af77fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a25650 0x5605d6a2c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.837+0000 7f8af77fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a25650 0x5605d6a2c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52446/0 (socket says 172.21.15.70:52446) 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.837+0000 7f8af77fe700 1 -- 172.21.15.70:0/760432817 learned_addr learned my addr 172.21.15.70:0/760432817 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.837+0000 7f8afcfb4700 1 --2- 172.21.15.70:0/760432817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 0x5605d6a1d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.837+0000 7f8af77fe700 1 -- 172.21.15.70:0/760432817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 msgr2=0x5605d6a1d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.837+0000 7f8af77fe700 1 --2- 172.21.15.70:0/760432817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 0x5605d6a1d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.837+0000 7f8af77fe700 1 -- 172.21.15.70:0/760432817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a19e80 msgr2=0x5605d6a1cdb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T08:45:29.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.837+0000 7f8af77fe700 1 --2- 172.21.15.70:0/760432817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a19e80 0x5605d6a1cdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.837+0000 7f8af77fe700 1 -- 172.21.15.70:0/760432817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605d6a3c170 con 0x5605d6a25650 2023-10-08T08:45:29.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.838+0000 7f8af77fe700 1 --2- 172.21.15.70:0/760432817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a25650 0x5605d6a2c140 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80cd190 tx=0x7f8ae8098480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad80784c64b4aac6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.838+0000 7f8adeffd700 1 -- 172.21.15.70:0/760432817 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae809a330 con 0x5605d6a25650 2023-10-08T08:45:29.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.838+0000 7f8adeffd700 1 -- 172.21.15.70:0/760432817 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ae809e020 con 0x5605d6a25650 2023-10-08T08:45:29.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.838+0000 7f8adeffd700 1 -- 172.21.15.70:0/760432817 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80a2030 con 0x5605d6a25650 2023-10-08T08:45:29.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.839+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/760432817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a25650 msgr2=0x5605d6a2c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.839+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/760432817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a25650 0x5605d6a2c140 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80cd190 tx=0x7f8ae8098480 comp rx=0 tx=0).stop 2023-10-08T08:45:29.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.840+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/760432817 shutdown_connections 2023-10-08T08:45:29.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.840+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/760432817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 0x5605d6a1d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.840+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/760432817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a19e80 0x5605d6a1cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.840+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/760432817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a25650 0x5605d6a2c140 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.840+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/760432817 >> 172.21.15.70:0/760432817 conn(0x5605d698f260 msgr2=0x5605d6a15d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.851+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/760432817 shutdown_connections 2023-10-08T08:45:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.852+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/760432817 wait complete. 2023-10-08T08:45:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.852+0000 7f8b0ac00b80 1 -- start start 2023-10-08T08:45:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.853+0000 7f8b0ac00b80 1 Processor -- start 2023-10-08T08:45:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.853+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 0x5605d6a2c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.853+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 0x5605d6a2a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.853+0000 7f8b0ac00b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a2ad50 0x5605d6a88f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.853+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d6a2b3a0 con 0x5605d6a2ad50 2023-10-08T08:45:29.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.853+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d6a2b510 con 0x5605d6a25650 2023-10-08T08:45:29.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.853+0000 7f8b0ac00b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605d6a894a0 con 0x5605d6a15890 2023-10-08T08:45:29.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.853+0000 7f8b0ac00b80 10 client.0 _ll_register_callbacks cb 0x7f8ae8099ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:29.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.854+0000 7f8afcfb4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a2ad50 0x5605d6a88f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.854+0000 7f8afcfb4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a2ad50 0x5605d6a88f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52452/0 (socket says 172.21.15.70:52452) 2023-10-08T08:45:29.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.854+0000 7f8afcfb4700 1 -- 172.21.15.70:0/350748091 learned_addr learned my addr 172.21.15.70:0/350748091 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:29.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.854+0000 7f8af7fff700 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 0x5605d6a2c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.854+0000 7f8af77fe700 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 0x5605d6a2a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.855+0000 7f8af7fff700 1 -- 172.21.15.70:0/350748091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 msgr2=0x5605d6a2a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.855+0000 7f8af7fff700 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 0x5605d6a2a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.855+0000 7f8af7fff700 1 -- 172.21.15.70:0/350748091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a2ad50 msgr2=0x5605d6a88f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.855+0000 7f8af7fff700 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a2ad50 0x5605d6a88f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.855+0000 7f8af7fff700 1 -- 172.21.15.70:0/350748091 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605d6781c60 con 0x5605d6a15890 2023-10-08T08:45:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.856+0000 7f8af7fff700 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 0x5605d6a2c310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009810 tx=0x7f8aec0058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a32cd5f09c729d96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.857+0000 7f8ad77fe700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:45:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.857+0000 7f8ad77fe700 1 -- 172.21.15.70:0/350748091 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec01c040 con 0x5605d6a15890 2023-10-08T08:45:29.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.857+0000 7f8ad77fe700 1 -- 172.21.15.70:0/350748091 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8aec0050c0 con 0x5605d6a15890 2023-10-08T08:45:29.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.857+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/350748091 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8aec010e30 con 0x5605d6a15890 2023-10-08T08:45:29.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.857+0000 7f8ad77fe700 1 -- 172.21.15.70:0/350748091 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aec02ea10 con 0x5605d6a15890 2023-10-08T08:45:29.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.858+0000 7f8b0ac00b80 10 client.25669 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:29.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.858+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/350748091 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5605d67bf250 con 0x5605d6a15890 2023-10-08T08:45:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.864+0000 7f8ad77fe700 1 -- 172.21.15.70:0/350748091 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8aec010e30 con 0x5605d6a15890 2023-10-08T08:45:29.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.864+0000 7f8ad77fe700 1 -- 172.21.15.70:0/350748091 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8aec009950 con 0x5605d6a15890 2023-10-08T08:45:29.869 INFO:tasks.workunit.client.0.smithi070.stdout:8/410: dwrite d1/de/f64 [0,4194304] 0 2023-10-08T08:45:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.864+0000 7f8b0ac00b80 10 client.25669 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:29.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.864+0000 7f8b0ac00b80 10 client.25669 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-10-08T08:45:29.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.864+0000 7f8b0ac00b80 20 client.25669 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:29.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.864+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5605d6a8a7a0 0x5605d6a8cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:29.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.864+0000 7f8b0ac00b80 4 client.25669 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:45:29.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.864+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/350748091 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5605d6966b30 con 0x5605d6a8a7a0 2023-10-08T08:45:29.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.868+0000 7f8af77fe700 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5605d6a8a7a0 0x5605d6a8cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:29.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.869+0000 7f8af77fe700 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5605d6a8a7a0 0x5605d6a8cb90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9760e46bd6e7b20a server_cookie=f7fb0197a0630e71 in_seq=0 out_seq=0 2023-10-08T08:45:29.875 INFO:tasks.workunit.client.0.smithi070.stdout:7/338: symlink d3/l75 0 2023-10-08T08:45:29.875 INFO:tasks.workunit.client.0.smithi070.stdout:7/339: read - d3/f3d zero size 2023-10-08T08:45:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.875+0000 7f8ad77fe700 10 client.25669 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:45:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.875+0000 7f8ad77fe700 1 -- 172.21.15.70:0/350748091 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5605d6966b30 con 0x5605d6a8a7a0 2023-10-08T08:45:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.875+0000 7f8ad77fe700 10 client.25669 handle_command_reply: tid=0 2023-10-08T08:45:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.875+0000 7f8b0ac00b80 1 client.25669 shutdown 2023-10-08T08:45:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/350748091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 msgr2=0x5605d6a2c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 0x5605d6a2c310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009810 tx=0x7f8aec0058e0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/350748091 shutdown_connections 2023-10-08T08:45:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x5605d6a8a7a0 0x5605d6a8cb90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605d6a2ad50 0x5605d6a88f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8ad77fe700 0 client.25669 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:45:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605d6a15890 0x5605d6a2c310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 --2- 172.21.15.70:0/350748091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5605d6a25650 0x5605d6a2a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/350748091 >> 172.21.15.70:0/350748091 conn(0x5605d698f260 msgr2=0x5605d6a15c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/350748091 shutdown_connections 2023-10-08T08:45:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 1 -- 172.21.15.70:0/350748091 wait complete. 2023-10-08T08:45:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.877+0000 7f8b0ac00b80 20 client.25669 trim_cache size 0 max 16384 2023-10-08T08:45:29.879 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:45:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 -- 172.21.15.70:0/2582161695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a1800 msgr2=0x7f8ae00a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a1800 0x7f8ae00a3cc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8af81ac4c0 tx=0x7f8af0007770 comp rx=0 tx=0).stop 2023-10-08T08:45:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 -- 172.21.15.70:0/2582161695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af810ef80 msgr2=0x7f8af81abd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af810ef80 0x7f8af81abd70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800d980 tx=0x7f8ae800dd40 comp rx=0 tx=0).stop 2023-10-08T08:45:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 -- 172.21.15.70:0/2582161695 shutdown_connections 2023-10-08T08:45:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ae00a1800 0x7f8ae00a3cc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8af8119fd0 0x7f8af81a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8af8107d30 0x7f8af81ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 --2- 172.21.15.70:0/2582161695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8af810ef80 0x7f8af81abd70 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800d980 tx=0x7f8ae800dd40 comp rx=0 tx=0).stop 2023-10-08T08:45:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.878+0000 7f8afea17700 1 -- 172.21.15.70:0/2582161695 >> 172.21.15.70:0/2582161695 conn(0x7f8af806b830 msgr2=0x7f8af8117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:29.881 INFO:tasks.workunit.client.0.smithi070.stdout:7/340: read d3/f71 [1881037,98606] 0 2023-10-08T08:45:29.881 INFO:tasks.workunit.client.0.smithi070.stdout:3/302: truncate d0/db/f29 2246200 0 2023-10-08T08:45:29.881 INFO:tasks.workunit.client.0.smithi070.stdout:3/303: chown d0/db/d10/d38/d63 27 1 2023-10-08T08:45:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.879+0000 7f8afea17700 1 -- 172.21.15.70:0/2582161695 shutdown_connections 2023-10-08T08:45:29.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:29.881+0000 7f8afea17700 1 -- 172.21.15.70:0/2582161695 wait complete. 2023-10-08T08:45:29.884 INFO:tasks.workunit.client.0.smithi070.stdout:7/341: unlink d3/d19/d1b/d4a/d9/c31 0 2023-10-08T08:45:29.884 INFO:tasks.workunit.client.0.smithi070.stdout:7/342: chown d3/d19/f3c 1 1 2023-10-08T08:45:29.891 INFO:tasks.workunit.client.0.smithi070.stdout:5/320: symlink d5/d5f/d61/d30/l70 0 2023-10-08T08:45:29.891 INFO:tasks.workunit.client.0.smithi070.stdout:5/321: dread - d5/da/d4d/d37/d38/d55/f53 zero size 2023-10-08T08:45:29.893 INFO:tasks.workunit.client.0.smithi070.stdout:8/411: mkdir d1/de/d3a/d92 0 2023-10-08T08:45:29.906 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T08:45:29.917 INFO:tasks.workunit.client.0.smithi070.stdout:4/253: symlink dc/d17/l58 0 2023-10-08T08:45:29.920 INFO:tasks.workunit.client.0.smithi070.stdout:0/342: write d1/d14/d1f/f4e [595044,85463] 0 2023-10-08T08:45:29.920 INFO:tasks.workunit.client.0.smithi070.stdout:0/343: dread - d1/dd/d1b/f27 zero size 2023-10-08T08:45:29.921 INFO:tasks.workunit.client.0.smithi070.stdout:8/412: write d1/de/d2e/d45/d7b/f87 [385125,83820] 0 2023-10-08T08:45:29.922 INFO:tasks.workunit.client.0.smithi070.stdout:0/344: mkdir d1/d1d/d24/d47/d54/d5e 0 2023-10-08T08:45:29.930 INFO:tasks.workunit.client.0.smithi070.stdout:3/304: dwrite d0/d12/d14/f39 [0,4194304] 0 2023-10-08T08:45:29.930 INFO:tasks.workunit.client.0.smithi070.stdout:6/289: rename df/c48 to df/d11/d1d/c5f 0 2023-10-08T08:45:29.932 INFO:tasks.workunit.client.0.smithi070.stdout:7/343: rmdir d3/d19/d1b/d4a/d50 39 2023-10-08T08:45:29.935 INFO:tasks.workunit.client.0.smithi070.stdout:4/254: dread dc/d17/d1f/f29 [0,4194304] 0 2023-10-08T08:45:29.935 INFO:tasks.workunit.client.0.smithi070.stdout:4/255: fdatasync dc/d17/d1f/f26 0 2023-10-08T08:45:29.936 INFO:tasks.workunit.client.0.smithi070.stdout:4/256: readlink dc/l42 0 2023-10-08T08:45:29.936 INFO:tasks.workunit.client.0.smithi070.stdout:0/345: rename d1/dd/c15 to d1/dd/d1b/c5f 0 2023-10-08T08:45:29.938 INFO:tasks.workunit.client.0.smithi070.stdout:6/290: unlink df/l16 0 2023-10-08T08:45:29.941 INFO:tasks.workunit.client.0.smithi070.stdout:5/322: symlink d5/d5f/d61/l71 0 2023-10-08T08:45:29.941 INFO:tasks.workunit.client.0.smithi070.stdout:3/305: rmdir d0/db/d10/d38/d2f 39 2023-10-08T08:45:29.942 INFO:tasks.workunit.client.0.smithi070.stdout:5/323: fsync d5/f26 0 2023-10-08T08:45:29.942 INFO:tasks.workunit.client.0.smithi070.stdout:5/324: readlink d5/l2e 0 2023-10-08T08:45:29.946 INFO:tasks.workunit.client.0.smithi070.stdout:6/291: mknod df/d26/c60 0 2023-10-08T08:45:29.952 INFO:tasks.workunit.client.0.smithi070.stdout:6/292: truncate df/d11/f47 678567 0 2023-10-08T08:45:29.969 INFO:tasks.workunit.client.0.smithi070.stdout:3/306: dwrite d0/d12/d14/d1d/f5e [0,4194304] 0 2023-10-08T08:45:29.969 INFO:tasks.workunit.client.0.smithi070.stdout:3/307: stat d0/d12/d14/d1d/d22/f3b 0 2023-10-08T08:45:29.979 INFO:tasks.workunit.client.0.smithi070.stdout:5/325: dwrite d5/da/d4d/f3f [0,4194304] 0 2023-10-08T08:45:29.979 INFO:tasks.workunit.client.0.smithi070.stdout:5/326: chown d5/d5f/d61/d30 146 1 2023-10-08T08:45:29.988 INFO:tasks.workunit.client.0.smithi070.stdout:1/276: sync 2023-10-08T08:45:29.988 INFO:tasks.workunit.client.0.smithi070.stdout:2/292: sync 2023-10-08T08:45:29.988 INFO:tasks.workunit.client.0.smithi070.stdout:9/207: sync 2023-10-08T08:45:29.993 INFO:tasks.workunit.client.0.smithi070.stdout:7/344: dread d3/d19/d1a/f22 [0,4194304] 0 2023-10-08T08:45:29.996 INFO:tasks.workunit.client.0.smithi070.stdout:5/327: dread d5/da/d4d/d37/d2a/f58 [0,4194304] 0 2023-10-08T08:45:29.998 INFO:tasks.workunit.client.0.smithi070.stdout:5/328: dread d5/da/f1f [0,4194304] 0 2023-10-08T08:45:30.000 INFO:tasks.workunit.client.0.smithi070.stdout:3/308: rmdir d0/d12/d14 39 2023-10-08T08:45:30.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/208: unlink d1/f13 0 2023-10-08T08:45:30.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/209: truncate d1/dd/d19/d38/f3c 710755 0 2023-10-08T08:45:30.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/210: fsync d1/dd/f18 0 2023-10-08T08:45:30.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/211: truncate d1/f2a 94302 0 2023-10-08T08:45:30.001 INFO:tasks.workunit.client.0.smithi070.stdout:2/293: write df/f39 [3265784,1964] 0 2023-10-08T08:45:30.001 INFO:tasks.workunit.client.0.smithi070.stdout:3/309: dread d0/d12/d14/d1d/f34 [0,4194304] 0 2023-10-08T08:45:30.001 INFO:tasks.workunit.client.0.smithi070.stdout:2/294: write f8 [1310667,103616] 0 2023-10-08T08:45:30.002 INFO:tasks.workunit.client.0.smithi070.stdout:1/277: rmdir d6 39 2023-10-08T08:45:30.002 INFO:tasks.workunit.client.0.smithi070.stdout:1/278: fsync d6/dc/d14/d1f/d26/f4d 0 2023-10-08T08:45:30.003 INFO:tasks.workunit.client.0.smithi070.stdout:1/279: fsync d6/dc/d14/d1f/f3c 0 2023-10-08T08:45:30.010 INFO:tasks.workunit.client.0.smithi070.stdout:5/329: dread d5/da/f50 [0,4194304] 0 2023-10-08T08:45:30.014 INFO:tasks.workunit.client.0.smithi070.stdout:7/345: rmdir d3/d19/d1b/d4a 39 2023-10-08T08:45:30.015 INFO:tasks.workunit.client.0.smithi070.stdout:7/346: dread - d3/d19/d1a/f6e zero size 2023-10-08T08:45:30.015 INFO:tasks.workunit.client.0.smithi070.stdout:9/212: symlink d1/dd/d26/d27/d2d/l3e 0 2023-10-08T08:45:30.016 INFO:tasks.workunit.client.0.smithi070.stdout:3/310: dread d0/d12/d14/f39 [0,4194304] 0 2023-10-08T08:45:30.016 INFO:tasks.workunit.client.0.smithi070.stdout:2/295: symlink df/d3a/l5b 0 2023-10-08T08:45:30.018 INFO:tasks.workunit.client.0.smithi070.stdout:7/347: mkdir d3/d19/d1b/d1e/d76 0 2023-10-08T08:45:30.021 INFO:tasks.workunit.client.0.smithi070.stdout:1/280: dread d6/dc/d14/d1f/f2b [0,4194304] 0 2023-10-08T08:45:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f870affd700 1 -- 172.21.15.70:0/1110655548 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563f12194ad0 con 0x563f12246b40 2023-10-08T08:45:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f870affd700 10 client.16284 handle_command_reply: tid=0 2023-10-08T08:45:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 client.16284 shutdown 2023-10-08T08:45:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 -- 172.21.15.70:0/1110655548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 msgr2=0x563f122542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f122542b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x563f1225c1a0 tx=0x7f8724003f10 comp rx=0 tx=0).stop 2023-10-08T08:45:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 -- 172.21.15.70:0/1110655548 shutdown_connections 2023-10-08T08:45:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f122579b0 0x563f12252ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563f12246b40 0x563f12248f80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f122518c0 0x563f12253d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 --2- 172.21.15.70:0/1110655548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f12257090 0x563f122542b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 -- 172.21.15.70:0/1110655548 >> 172.21.15.70:0/1110655548 conn(0x563f121bd200 msgr2=0x563f122668c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f870affd700 0 client.16284 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:30.024 INFO:tasks.workunit.client.0.smithi070.stdout:3/311: mknod d0/db/d10/c67 0 2023-10-08T08:45:30.024 INFO:tasks.workunit.client.0.smithi070.stdout:3/312: dread - d0/d12/d14/d1d/d22/f33 zero size 2023-10-08T08:45:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 -- 172.21.15.70:0/1110655548 shutdown_connections 2023-10-08T08:45:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 1 -- 172.21.15.70:0/1110655548 wait complete. 2023-10-08T08:45:30.025 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.022+0000 7f873dcf8b80 20 client.16284 trim_cache size 0 max 16384 2023-10-08T08:45:30.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:45:30.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:45:30.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:45:30.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:45:30.026 INFO:tasks.workunit.client.0.smithi070.stdout:9/213: rmdir d1/dd/d26 39 2023-10-08T08:45:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 -- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87180a16b0 msgr2=0x7f87180a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87180a16b0 0x7f87180a3b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f871c009be0 tx=0x7f871c009260 comp rx=0 tx=0).stop 2023-10-08T08:45:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 -- 172.21.15.70:0/776332929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f872c109190 msgr2=0x7f872c19d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f872c109190 0x7f872c19d3e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8714005910 tx=0x7f8714004730 comp rx=0 tx=0).stop 2023-10-08T08:45:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 -- 172.21.15.70:0/776332929 shutdown_connections 2023-10-08T08:45:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f87180a16b0 0x7f87180a3b70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f872c112740 0x7f872c1a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f872c109190 0x7f872c19d3e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 --2- 172.21.15.70:0/776332929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c109ab0 0x7f872c19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 -- 172.21.15.70:0/776332929 >> 172.21.15.70:0/776332929 conn(0x7f872c06b7c0 msgr2=0x7f872c06f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 -- 172.21.15.70:0/776332929 shutdown_connections 2023-10-08T08:45:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:30.023+0000 7f8731b0f700 1 -- 172.21.15.70:0/776332929 wait complete. 2023-10-08T08:45:30.029 INFO:tasks.workunit.client.0.smithi070.stdout:7/348: getdents d3/d19/d1a 0 2023-10-08T08:45:30.029 INFO:tasks.workunit.client.0.smithi070.stdout:7/349: truncate d3/d19/d1b/f58 152772 0 2023-10-08T08:45:30.029 INFO:tasks.workunit.client.0.smithi070.stdout:1/281: truncate d6/dc/d14/d1f/d29/f42 775855 0 2023-10-08T08:45:30.031 INFO:tasks.workunit.client.0.smithi070.stdout:1/282: write d6/f10 [2662579,82399] 0 2023-10-08T08:45:30.033 INFO:tasks.workunit.client.0.smithi070.stdout:5/330: dwrite d5/da/d4d/d37/d38/d55/f4c [0,4194304] 0 2023-10-08T08:45:30.037 INFO:tasks.workunit.client.0.smithi070.stdout:7/350: mkdir d3/d77 0 2023-10-08T08:45:30.041 INFO:tasks.workunit.client.0.smithi070.stdout:3/313: dread d0/d12/f4e [0,4194304] 0 2023-10-08T08:45:30.041 INFO:tasks.workunit.client.0.smithi070.stdout:2/296: rmdir df/d12 39 2023-10-08T08:45:30.041 INFO:tasks.workunit.client.0.smithi070.stdout:9/214: truncate d1/dd/f10 4249055 0 2023-10-08T08:45:30.041 INFO:tasks.workunit.client.0.smithi070.stdout:7/351: symlink d3/l78 0 2023-10-08T08:45:30.042 INFO:tasks.workunit.client.0.smithi070.stdout:2/297: truncate df/f33 1801983 0 2023-10-08T08:45:30.051 INFO:tasks.workunit.client.0.smithi070.stdout:7/352: getdents d3/d19/d1b/d1e/d4c 0 2023-10-08T08:45:30.051 INFO:tasks.workunit.client.0.smithi070.stdout:2/298: creat df/f5c x:0 0 0 2023-10-08T08:45:30.053 INFO:tasks.workunit.client.0.smithi070.stdout:9/215: read d1/dd/f10 [2086483,1951] 0 2023-10-08T08:45:30.057 INFO:tasks.workunit.client.0.smithi070.stdout:2/299: write df/d3a/f4b [659446,19736] 0 2023-10-08T08:45:30.058 INFO:tasks.workunit.client.0.smithi070.stdout:3/314: dread d0/db/d10/d38/f64 [0,4194304] 0 2023-10-08T08:45:30.062 INFO:tasks.workunit.client.0.smithi070.stdout:5/331: dwrite d5/ff [0,4194304] 0 2023-10-08T08:45:30.068 INFO:tasks.workunit.client.0.smithi070.stdout:3/315: creat d0/f68 x:0 0 0 2023-10-08T08:45:30.069 INFO:tasks.workunit.client.0.smithi070.stdout:5/332: link d5/d5f/d61/d30/l70 d5/da/d22/l72 0 2023-10-08T08:45:30.071 INFO:tasks.workunit.client.0.smithi070.stdout:9/216: mknod d1/dd/d26/d27/d2d/c3f 0 2023-10-08T08:45:30.071 INFO:tasks.workunit.client.0.smithi070.stdout:9/217: readlink d1/l1f 0 2023-10-08T08:45:30.075 INFO:tasks.workunit.client.0.smithi070.stdout:5/333: rename d5/da/c4a to d5/d5f/d63/c73 0 2023-10-08T08:45:30.087 INFO:tasks.workunit.client.0.smithi070.stdout:9/218: getdents d1/dd/d26 0 2023-10-08T08:45:30.091 INFO:tasks.workunit.client.0.smithi070.stdout:8/413: creat d1/de/d3a/d56/d65/f93 x:0 0 0 2023-10-08T08:45:30.092 INFO:tasks.workunit.client.0.smithi070.stdout:1/283: dwrite d6/dc/d14/d1f/d26/f4d [0,4194304] 0 2023-10-08T08:45:30.092 INFO:tasks.workunit.client.0.smithi070.stdout:1/284: truncate d6/dc/d14/d1f/d26/f31 420624 0 2023-10-08T08:45:30.093 INFO:tasks.workunit.client.0.smithi070.stdout:7/353: dwrite d3/d19/d1b/d1e/d4c/f63 [0,4194304] 0 2023-10-08T08:45:30.093 INFO:tasks.workunit.client.0.smithi070.stdout:7/354: dread - d3/d19/d1a/f6e zero size 2023-10-08T08:45:30.093 INFO:tasks.workunit.client.0.smithi070.stdout:4/257: symlink dc/d17/d24/d55/l59 0 2023-10-08T08:45:30.099 INFO:tasks.workunit.client.0.smithi070.stdout:2/300: rmdir df 39 2023-10-08T08:45:30.101 INFO:tasks.workunit.client.0.smithi070.stdout:5/334: mknod d5/d5f/d63/c74 0 2023-10-08T08:45:30.108 INFO:tasks.workunit.client.0.smithi070.stdout:8/414: mknod d1/de/d3a/c94 0 2023-10-08T08:45:30.108 INFO:tasks.workunit.client.0.smithi070.stdout:8/415: write d1/d2/d6/d22/f2b [4674085,82114] 0 2023-10-08T08:45:30.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.112+0000 7f4de1088700 1 -- 172.21.15.70:0/4108747799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ddc109ab0 msgr2=0x7f4ddc112200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.112+0000 7f4de1088700 1 --2- 172.21.15.70:0/4108747799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ddc109ab0 0x7f4ddc112200 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40098f0 tx=0x7f4dc4009c00 comp rx=0 tx=0).stop 2023-10-08T08:45:30.116 INFO:tasks.workunit.client.0.smithi070.stdout:7/355: truncate d3/d19/d1b/d4a/fd 3907176 0 2023-10-08T08:45:30.116 INFO:tasks.workunit.client.0.smithi070.stdout:7/356: chown d3/f55 43853998 1 2023-10-08T08:45:30.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.115+0000 7f4de1088700 1 -- 172.21.15.70:0/4108747799 shutdown_connections 2023-10-08T08:45:30.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.115+0000 7f4de1088700 1 --2- 172.21.15.70:0/4108747799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ddc112740 0x7f4ddc114b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.115+0000 7f4de1088700 1 --2- 172.21.15.70:0/4108747799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ddc109190 0x7f4ddc109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.115+0000 7f4de1088700 1 --2- 172.21.15.70:0/4108747799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ddc109ab0 0x7f4ddc112200 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.115+0000 7f4de1088700 1 -- 172.21.15.70:0/4108747799 >> 172.21.15.70:0/4108747799 conn(0x7f4ddc06b830 msgr2=0x7f4ddc06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.117+0000 7f4de1088700 1 -- 172.21.15.70:0/4108747799 shutdown_connections 2023-10-08T08:45:30.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.117+0000 7f4de1088700 1 -- 172.21.15.70:0/4108747799 wait complete. 2023-10-08T08:45:30.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.118+0000 7f4de1088700 1 Processor -- start 2023-10-08T08:45:30.120 INFO:tasks.workunit.client.0.smithi070.stdout:9/219: mkdir d1/dd/d1a/d40 0 2023-10-08T08:45:30.120 INFO:tasks.workunit.client.0.smithi070.stdout:1/285: dwrite d6/dc/d14/d1f/f3d [0,4194304] 0 2023-10-08T08:45:30.121 INFO:tasks.workunit.client.0.smithi070.stdout:1/286: readlink d6/dc/d14/d1f/d26/l2e 0 2023-10-08T08:45:30.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.120+0000 7f4de1088700 1 -- start start 2023-10-08T08:45:30.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.120+0000 7f4de1088700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ddc109190 0x7f4ddc111b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.120+0000 7f4de1088700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ddc109ab0 0x7f4ddc112090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.120+0000 7f4de1088700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ddc112740 0x7f4ddc10bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.120+0000 7f4de1088700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc10c4e0 con 0x7f4ddc109190 2023-10-08T08:45:30.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.120+0000 7f4de1088700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc10c650 con 0x7f4ddc112740 2023-10-08T08:45:30.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.120+0000 7f4de1088700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc10c810 con 0x7f4ddc109ab0 2023-10-08T08:45:30.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.121+0000 7f4ddad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ddc109190 0x7f4ddc111b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.121+0000 7f4ddad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ddc109190 0x7f4ddc111b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52464/0 (socket says 172.21.15.70:52464) 2023-10-08T08:45:30.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.121+0000 7f4ddad9d700 1 -- 172.21.15.70:0/2512276871 learned_addr learned my addr 172.21.15.70:0/2512276871 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.121+0000 7f4ddb59e700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ddc112740 0x7f4ddc10bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.121+0000 7f4ddad9d700 1 -- 172.21.15.70:0/2512276871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ddc109ab0 msgr2=0x7f4ddc112090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T08:45:30.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.121+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ddc109ab0 0x7f4ddc112090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.121+0000 7f4ddad9d700 1 -- 172.21.15.70:0/2512276871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ddc112740 msgr2=0x7f4ddc10bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.121+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ddc112740 0x7f4ddc10bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.121+0000 7f4ddad9d700 1 -- 172.21.15.70:0/2512276871 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4009520 con 0x7f4ddc109190 2023-10-08T08:45:30.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.122+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ddc109190 0x7f4ddc111b50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00e9c0 tx=0x7f4dcc00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.122+0000 7f4dd8d99700 1 -- 172.21.15.70:0/2512276871 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00cbd0 con 0x7f4ddc109190 2023-10-08T08:45:30.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.122+0000 7f4dd8d99700 1 -- 172.21.15.70:0/2512276871 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dcc00cd30 con 0x7f4ddc109190 2023-10-08T08:45:30.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.122+0000 7f4de1088700 1 -- 172.21.15.70:0/2512276871 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc1babc0 con 0x7f4ddc109190 2023-10-08T08:45:30.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.122+0000 7f4dd8d99700 1 -- 172.21.15.70:0/2512276871 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc005580 con 0x7f4ddc109190 2023-10-08T08:45:30.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.122+0000 7f4de1088700 1 -- 172.21.15.70:0/2512276871 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc1baf80 con 0x7f4ddc109190 2023-10-08T08:45:30.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.126+0000 7f4dd8d99700 1 -- 172.21.15.70:0/2512276871 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4dcc004830 con 0x7f4ddc109190 2023-10-08T08:45:30.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.127+0000 7f4ded271b80 1 Processor -- start 2023-10-08T08:45:30.128 INFO:tasks.workunit.client.0.smithi070.stdout:1/287: dread d6/dc/d14/d1f/f32 [0,4194304] 0 2023-10-08T08:45:30.129 INFO:tasks.workunit.client.0.smithi070.stdout:5/335: dwrite d5/da/d22/f52 [0,4194304] 0 2023-10-08T08:45:30.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.128+0000 7f4dd8d99700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4dc80a16a0 0x7f4dc80a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.128+0000 7f4dd8d99700 1 -- 172.21.15.70:0/2512276871 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4dcc014070 con 0x7f4ddc109190 2023-10-08T08:45:30.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.129+0000 7f4ded271b80 1 -- start start 2023-10-08T08:45:30.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.129+0000 7f4ddb59e700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4dc80a16a0 0x7f4dc80a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.129+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269effae80 0x56269effb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.129+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.129+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269f006650 0x56269f008a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.129+0000 7f4ded271b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269ef64460 con 0x56269effae80 2023-10-08T08:45:30.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.129+0000 7f4ded271b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269ef55c20 con 0x56269f006650 2023-10-08T08:45:30.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.129+0000 7f4ded271b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269ef53540 con 0x56269effb7a0 2023-10-08T08:45:30.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269effae80 0x56269effb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269effae80 0x56269effb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52472/0 (socket says 172.21.15.70:52472) 2023-10-08T08:45:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddad9d700 1 -- 172.21.15.70:0/2694457194 learned_addr learned my addr 172.21.15.70:0/2694457194 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddad9d700 1 -- 172.21.15.70:0/2694457194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 msgr2=0x56269f006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/2694457194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddad9d700 1 -- 172.21.15.70:0/2694457194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269f006650 msgr2=0x56269f008a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T08:45:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/2694457194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269f006650 0x56269f008a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddad9d700 1 -- 172.21.15.70:0/2694457194 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56269ed79de0 con 0x56269effae80 2023-10-08T08:45:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/2694457194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269effae80 0x56269effb260 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc096dd0 tx=0x7f4dcc099ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6be20b21deab63 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.130+0000 7f4ddb59e700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4dc80a16a0 0x7f4dc80a3b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc069dd0 tx=0x7f4dd4009040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.132 INFO:tasks.workunit.client.0.smithi070.stdout:9/220: creat d1/dd/d26/d27/d2d/f41 x:0 0 0 2023-10-08T08:45:30.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.131+0000 7f4dd17fa700 1 -- 172.21.15.70:0/2694457194 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc09e4b0 con 0x56269effae80 2023-10-08T08:45:30.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.131+0000 7f4dd17fa700 1 -- 172.21.15.70:0/2694457194 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dcc0af070 con 0x56269effae80 2023-10-08T08:45:30.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.131+0000 7f4dd17fa700 1 -- 172.21.15.70:0/2694457194 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0cd340 con 0x56269effae80 2023-10-08T08:45:30.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 -- 172.21.15.70:0/2694457194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269effae80 msgr2=0x56269effb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 --2- 172.21.15.70:0/2694457194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269effae80 0x56269effb260 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc096dd0 tx=0x7f4dcc099ea0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 -- 172.21.15.70:0/2694457194 shutdown_connections 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 --2- 172.21.15.70:0/2694457194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269f006650 0x56269f008a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 --2- 172.21.15.70:0/2694457194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269effae80 0x56269effb260 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 --2- 172.21.15.70:0/2694457194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f006110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 -- 172.21.15.70:0/2694457194 >> 172.21.15.70:0/2694457194 conn(0x56269ef70260 msgr2=0x56269eff72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 -- 172.21.15.70:0/2694457194 shutdown_connections 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 -- 172.21.15.70:0/2694457194 wait complete. 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 -- start start 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.132+0000 7f4ded271b80 1 Processor -- start 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269f006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f003430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ded271b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269ef4ee30 con 0x56269f006650 2023-10-08T08:45:30.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ded271b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269eeeb710 con 0x56269effae80 2023-10-08T08:45:30.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ded271b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269eeeb3b0 con 0x56269effb7a0 2023-10-08T08:45:30.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ded271b80 10 client.0 _ll_register_callbacks cb 0x56269ed48800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:30.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ddb59e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ddb59e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f003b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52480/0 (socket says 172.21.15.70:52480) 2023-10-08T08:45:30.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.133+0000 7f4ddb59e700 1 -- 172.21.15.70:0/4035154673 learned_addr learned my addr 172.21.15.70:0/4035154673 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4ddb59e700 1 -- 172.21.15.70:0/4035154673 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 msgr2=0x56269f003430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T08:45:30.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4ddb59e700 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f003430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4ddb59e700 1 -- 172.21.15.70:0/4035154673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 msgr2=0x56269f006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4ddb59e700 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269f006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4ddb59e700 1 -- 172.21.15.70:0/4035154673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc1baf80 con 0x56269f006650 2023-10-08T08:45:30.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4ddb59e700 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f003b70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4018690 tx=0x7f4dd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21dab77ab558187 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4dc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:30.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4dc27fc700 1 -- 172.21.15.70:0/4035154673 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd401d070 con 0x56269f006650 2023-10-08T08:45:30.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4dc27fc700 1 -- 172.21.15.70:0/4035154673 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4dd4021410 con 0x56269f006650 2023-10-08T08:45:30.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.134+0000 7f4ded271b80 1 -- 172.21.15.70:0/4035154673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56269ef16eb0 con 0x56269f006650 2023-10-08T08:45:30.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.135+0000 7f4dc27fc700 1 -- 172.21.15.70:0/4035154673 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dd40215d0 con 0x56269f006650 2023-10-08T08:45:30.138 INFO:tasks.workunit.client.0.smithi070.stdout:1/288: symlink d6/dc/l53 0 2023-10-08T08:45:30.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.135+0000 7f4ded271b80 10 client.16311 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:30.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.135+0000 7f4ded271b80 1 -- 172.21.15.70:0/4035154673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56269ed62c60 con 0x56269f006650 2023-10-08T08:45:30.139 INFO:tasks.workunit.client.0.smithi070.stdout:5/336: dread d5/da/f24 [0,4194304] 0 2023-10-08T08:45:30.139 INFO:tasks.workunit.client.0.smithi070.stdout:5/337: readlink d5/da/l34 0 2023-10-08T08:45:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.137+0000 7f4dc27fc700 1 -- 172.21.15.70:0/4035154673 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56269ef16eb0 con 0x56269f006650 2023-10-08T08:45:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.137+0000 7f4dc27fc700 1 -- 172.21.15.70:0/4035154673 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4dd4029070 con 0x56269f006650 2023-10-08T08:45:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.138+0000 7f4ded271b80 10 client.16311 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.138+0000 7f4ded271b80 10 client.16311 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-08T08:45:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.138+0000 7f4ded271b80 20 client.16311 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.138+0000 7f4ded271b80 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56269f038250 0x56269f03a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.138+0000 7f4ded271b80 4 client.16311 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.138+0000 7f4ded271b80 1 -- 172.21.15.70:0/4035154673 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56269ef47e10 con 0x56269f038250 2023-10-08T08:45:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.138+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56269f038250 0x56269f03a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.141 INFO:tasks.workunit.client.0.smithi070.stdout:4/258: dwrite dc/d17/d24/d4c/d4e/f57 [0,4194304] 0 2023-10-08T08:45:30.141 INFO:tasks.workunit.client.0.smithi070.stdout:4/259: chown dc/d17/d24/d37/c39 45196262 1 2023-10-08T08:45:30.141 INFO:tasks.workunit.client.0.smithi070.stdout:4/260: chown dc/ff 38 1 2023-10-08T08:45:30.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.139+0000 7f4dc27fc700 10 client.16311 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:45:30.142 INFO:tasks.workunit.client.0.smithi070.stdout:1/289: stat c4 0 2023-10-08T08:45:30.142 INFO:tasks.workunit.client.0.smithi070.stdout:1/290: dread - d6/dc/d14/d1f/f4c zero size 2023-10-08T08:45:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.139+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56269f038250 0x56269f03a670 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a9ecfc0ee37f44d4 server_cookie=fda5043f42e38f2b in_seq=0 out_seq=0 2023-10-08T08:45:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.140+0000 7f4dc27fc700 1 -- 172.21.15.70:0/4035154673 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56269ef47e10 con 0x56269f038250 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.140+0000 7f4dc27fc700 10 client.16311 handle_command_reply: tid=0 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.140+0000 7f4ded271b80 1 client.16311 shutdown 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.141+0000 7f4ded271b80 1 -- 172.21.15.70:0/4035154673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 msgr2=0x56269f003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.141+0000 7f4ded271b80 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f003b70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4018690 tx=0x7f4dd4004ad0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.141+0000 7f4ded271b80 1 -- 172.21.15.70:0/4035154673 shutdown_connections 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.141+0000 7f4ded271b80 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f003b70 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.141+0000 7f4ded271b80 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269f006110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.141+0000 7f4ded271b80 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56269f038250 0x56269f03a670 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.141+0000 7f4ded271b80 1 --2- 172.21.15.70:0/4035154673 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f003430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.142+0000 7f4ded271b80 1 -- 172.21.15.70:0/4035154673 >> 172.21.15.70:0/4035154673 conn(0x56269ef70260 msgr2=0x56269eff6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.144 INFO:tasks.workunit.client.0.smithi070.stdout:1/291: unlink d6/f20 0 2023-10-08T08:45:30.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.144+0000 7f4dc27fc700 0 client.16311 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:45:30.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.144+0000 7f4ded271b80 1 -- 172.21.15.70:0/4035154673 shutdown_connections 2023-10-08T08:45:30.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.145+0000 7f4ded271b80 1 -- 172.21.15.70:0/4035154673 wait complete. 2023-10-08T08:45:30.146 INFO:tasks.workunit.client.0.smithi070.stdout:2/301: write fb [1046797,3807] 0 2023-10-08T08:45:30.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.145+0000 7f4ded271b80 20 client.16311 trim_cache size 0 max 16384 2023-10-08T08:45:30.148 INFO:tasks.workunit.client.0.smithi070.stdout:4/261: mkdir dc/d5a 0 2023-10-08T08:45:30.148 INFO:tasks.workunit.client.0.smithi070.stdout:4/262: stat dc/d17/l30 0 2023-10-08T08:45:30.149 INFO:tasks.workunit.client.0.smithi070.stdout:4/263: fsync dc/f15 0 2023-10-08T08:45:30.149 INFO:tasks.workunit.client.0.smithi070.stdout:2/302: creat df/d12/d1b/d1c/f5d x:0 0 0 2023-10-08T08:45:30.152 INFO:tasks.workunit.client.0.smithi070.stdout:2/303: mknod df/d12/d15/d54/c5e 0 2023-10-08T08:45:30.152 INFO:tasks.workunit.client.0.smithi070.stdout:7/357: dwrite d3/f5c [0,4194304] 0 2023-10-08T08:45:30.152 INFO:tasks.workunit.client.0.smithi070.stdout:2/304: fdatasync df/d12/d15/f41 0 2023-10-08T08:45:30.153 INFO:tasks.workunit.client.0.smithi070.stdout:2/305: fdatasync df/d12/d1b/f3c 0 2023-10-08T08:45:30.153 INFO:tasks.workunit.client.0.smithi070.stdout:7/358: write d3/d19/d1b/d4a/d9/f74 [55439,105797] 0 2023-10-08T08:45:30.153 INFO:tasks.workunit.client.0.smithi070.stdout:5/338: dread d5/d5f/d61/f60 [0,4194304] 0 2023-10-08T08:45:30.156 INFO:tasks.workunit.client.0.smithi070.stdout:2/306: unlink df/d12/d1b/d1c/l21 0 2023-10-08T08:45:30.156 INFO:tasks.workunit.client.0.smithi070.stdout:2/307: truncate df/d12/d15/d54/f5a 446336 0 2023-10-08T08:45:30.157 INFO:tasks.workunit.client.0.smithi070.stdout:2/308: mknod df/c5f 0 2023-10-08T08:45:30.159 INFO:tasks.workunit.client.0.smithi070.stdout:2/309: rename df/c2c to df/c60 0 2023-10-08T08:45:30.160 INFO:tasks.workunit.client.0.smithi070.stdout:2/310: mknod df/d12/d1b/d1c/c61 0 2023-10-08T08:45:30.160 INFO:tasks.workunit.client.0.smithi070.stdout:2/311: truncate df/d4c/f51 758672 0 2023-10-08T08:45:30.162 INFO:tasks.workunit.client.0.smithi070.stdout:9/221: dwrite d1/dd/d1a/f1d [0,4194304] 0 2023-10-08T08:45:30.162 INFO:tasks.workunit.client.0.smithi070.stdout:9/222: write d1/dd/d26/d27/d2d/f2f [891866,98875] 0 2023-10-08T08:45:30.162 INFO:tasks.workunit.client.0.smithi070.stdout:2/312: symlink df/l62 0 2023-10-08T08:45:30.164 INFO:tasks.workunit.client.0.smithi070.stdout:2/313: truncate df/f11 3852367 0 2023-10-08T08:45:30.165 INFO:tasks.workunit.client.0.smithi070.stdout:2/314: write df/f39 [5119947,55555] 0 2023-10-08T08:45:30.167 INFO:tasks.workunit.client.0.smithi070.stdout:4/264: dread dc/d17/d24/f52 [0,4194304] 0 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.167+0000 7f4ded271b80 1 Processor -- start 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.167+0000 7f4ded271b80 1 -- start start 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.168+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269effde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.168+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f02f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.168+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f005c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.168+0000 7f4ded271b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269edcf920 con 0x56269f006650 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.168+0000 7f4ded271b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269eff3ae0 con 0x56269effae80 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.168+0000 7f4ded271b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269eff1570 con 0x56269effb7a0 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddad9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269effde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddad9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269effde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39946/0 (socket says 172.21.15.70:39946) 2023-10-08T08:45:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddad9d700 1 -- 172.21.15.70:0/1094618997 learned_addr learned my addr 172.21.15.70:0/1094618997 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddad9d700 1 -- 172.21.15.70:0/1094618997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 msgr2=0x56269f02f270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/1094618997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f02f270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddb59e700 1 --2- 172.21.15.70:0/1094618997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f005c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddad9d700 1 -- 172.21.15.70:0/1094618997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 msgr2=0x56269f005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/1094618997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f005c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddad9d700 1 -- 172.21.15.70:0/1094618997 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56269eda0250 con 0x56269effae80 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.169+0000 7f4ddb59e700 1 --2- 172.21.15.70:0/1094618997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f005c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.170+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/1094618997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269effde70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c5b0 tx=0x7f4dcc096040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71740d862e79375a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.170+0000 7f4dd1ffb700 1 -- 172.21.15.70:0/1094618997 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0b6040 con 0x56269effae80 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.170+0000 7f4dd1ffb700 1 -- 172.21.15.70:0/1094618997 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dcc062070 con 0x56269effae80 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.170+0000 7f4dd1ffb700 1 -- 172.21.15.70:0/1094618997 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc09e280 con 0x56269effae80 2023-10-08T08:45:30.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.171+0000 7f4ded271b80 1 -- 172.21.15.70:0/1094618997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 msgr2=0x56269effde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.171+0000 7f4ded271b80 1 --2- 172.21.15.70:0/1094618997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269effde70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c5b0 tx=0x7f4dcc096040 comp rx=0 tx=0).stop 2023-10-08T08:45:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.171+0000 7f4ded271b80 1 -- 172.21.15.70:0/1094618997 shutdown_connections 2023-10-08T08:45:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.171+0000 7f4ded271b80 1 --2- 172.21.15.70:0/1094618997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f005c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.171+0000 7f4ded271b80 1 --2- 172.21.15.70:0/1094618997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269effde70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.171+0000 7f4ded271b80 1 --2- 172.21.15.70:0/1094618997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f02f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.171+0000 7f4ded271b80 1 -- 172.21.15.70:0/1094618997 >> 172.21.15.70:0/1094618997 conn(0x56269ef70260 msgr2=0x56269f03a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.172+0000 7f4ded271b80 1 -- 172.21.15.70:0/1094618997 shutdown_connections 2023-10-08T08:45:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.172+0000 7f4ded271b80 1 -- 172.21.15.70:0/1094618997 wait complete. 2023-10-08T08:45:30.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.172+0000 7f4ded271b80 1 -- start start 2023-10-08T08:45:30.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.172+0000 7f4ded271b80 1 Processor -- start 2023-10-08T08:45:30.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.173+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269f02ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.173+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f02f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.173+0000 7f4ded271b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f02d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.173+0000 7f4ded271b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269f02d930 con 0x56269f006650 2023-10-08T08:45:30.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.173+0000 7f4ded271b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269f02daa0 con 0x56269effae80 2023-10-08T08:45:30.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.173+0000 7f4ded271b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269f02dc60 con 0x56269effb7a0 2023-10-08T08:45:30.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.173+0000 7f4ded271b80 10 client.0 _ll_register_callbacks cb 0x7f4dd4007c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:30.176 INFO:tasks.workunit.client.0.smithi070.stdout:1/292: dread d6/f10 [4194304,4194304] 0 2023-10-08T08:45:30.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.174+0000 7f4ddad9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269f02ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.174+0000 7f4ddad9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269f02ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:39952/0 (socket says 172.21.15.70:39952) 2023-10-08T08:45:30.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.174+0000 7f4ddad9d700 1 -- 172.21.15.70:0/806073404 learned_addr learned my addr 172.21.15.70:0/806073404 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.174+0000 7f4ddad9d700 1 -- 172.21.15.70:0/806073404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 msgr2=0x56269f02f110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T08:45:30.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.174+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f02f110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.174+0000 7f4ddad9d700 1 -- 172.21.15.70:0/806073404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 msgr2=0x56269f02d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.174+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f02d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.175+0000 7f4ddad9d700 1 -- 172.21.15.70:0/806073404 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56269ed79de0 con 0x56269effae80 2023-10-08T08:45:30.178 INFO:tasks.workunit.client.0.smithi070.stdout:2/315: mknod df/d12/d15/d54/c63 0 2023-10-08T08:45:30.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.176+0000 7f4ddad9d700 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269f02ebd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009fd0 tx=0x7f4dcc0097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce3b45eef1eee81e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.176+0000 7f4dc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:45:30.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.176+0000 7f4dc27fc700 1 -- 172.21.15.70:0/806073404 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0b6070 con 0x56269effae80 2023-10-08T08:45:30.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.176+0000 7f4dc27fc700 1 -- 172.21.15.70:0/806073404 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4dcc016df0 con 0x56269effae80 2023-10-08T08:45:30.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.178+0000 7f4ded271b80 1 -- 172.21.15.70:0/806073404 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4dcc0af070 con 0x56269effae80 2023-10-08T08:45:30.181 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:30 smithi070 ceph-mon[99513]: pgmap v342: 129 pgs: 129 active+clean; 292 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 33 MiB/s wr, 1.43k op/s 2023-10-08T08:45:30.181 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:30 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/826139964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:45:30.181 INFO:tasks.workunit.client.0.smithi070.stdout:1/293: creat d6/dc/f54 x:0 0 0 2023-10-08T08:45:30.185 INFO:tasks.workunit.client.0.smithi070.stdout:2/316: getdents df/d12/d15/d34 0 2023-10-08T08:45:30.185 INFO:tasks.workunit.client.0.smithi070.stdout:2/317: stat df 0 2023-10-08T08:45:30.188 INFO:tasks.workunit.client.0.smithi070.stdout:9/223: dwrite f0 [0,4194304] 0 2023-10-08T08:45:30.188 INFO:tasks.workunit.client.0.smithi070.stdout:7/359: dwrite d3/d19/d1a/f20 [0,4194304] 0 2023-10-08T08:45:30.189 INFO:tasks.workunit.client.0.smithi070.stdout:2/318: read fc [2092297,80961] 0 2023-10-08T08:45:30.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.191+0000 7f4dc27fc700 1 -- 172.21.15.70:0/806073404 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dcc09e170 con 0x56269effae80 2023-10-08T08:45:30.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.191+0000 7f4ded271b80 10 client.25736 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:30.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.191+0000 7f4ded271b80 1 -- 172.21.15.70:0/806073404 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56269ed782b0 con 0x56269effae80 2023-10-08T08:45:30.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.191+0000 7f4dc27fc700 1 -- 172.21.15.70:0/806073404 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dcc0af070 con 0x56269effae80 2023-10-08T08:45:30.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.192+0000 7f4dc27fc700 1 -- 172.21.15.70:0/806073404 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4dcc065370 con 0x56269effae80 2023-10-08T08:45:30.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.192+0000 7f4ded271b80 10 client.25736 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:30.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.192+0000 7f4ded271b80 10 client.25736 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-08T08:45:30.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.192+0000 7f4ded271b80 20 client.25736 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:30.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.192+0000 7f4ded271b80 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56269f08cd80 0x56269f08f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.192+0000 7f4ded271b80 4 client.25736 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:45:30.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.192+0000 7f4ded271b80 1 -- 172.21.15.70:0/806073404 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56269ef47b30 con 0x56269f08cd80 2023-10-08T08:45:30.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.192+0000 7f4dd3fff700 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56269f08cd80 0x56269f08f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.194 INFO:tasks.workunit.client.0.smithi070.stdout:9/224: chown d1/dd/d19 7732227 1 2023-10-08T08:45:30.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4dd3fff700 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56269f08cd80 0x56269f08f170 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f96d60d4122e4b44 server_cookie=ccb9b61bb5e218ef in_seq=0 out_seq=0 2023-10-08T08:45:30.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4dc27fc700 10 client.25736 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:45:30.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4dc27fc700 1 -- 172.21.15.70:0/806073404 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56269ef47b30 con 0x56269f08cd80 2023-10-08T08:45:30.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4dc27fc700 10 client.25736 handle_command_reply: tid=0 2023-10-08T08:45:30.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 client.25736 shutdown 2023-10-08T08:45:30.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 -- 172.21.15.70:0/806073404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 msgr2=0x56269f02ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269f02ebd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009fd0 tx=0x7f4dcc0097d0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 -- 172.21.15.70:0/806073404 shutdown_connections 2023-10-08T08:45:30.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56269f006650 0x56269f02d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56269effae80 0x56269f02ebd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56269f08cd80 0x56269f08f170 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 --2- 172.21.15.70:0/806073404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56269effb7a0 0x56269f02f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4dc27fc700 0 client.25736 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:45:30.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 -- 172.21.15.70:0/806073404 >> 172.21.15.70:0/806073404 conn(0x56269ef70260 msgr2=0x56269effe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 -- 172.21.15.70:0/806073404 shutdown_connections 2023-10-08T08:45:30.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.193+0000 7f4ded271b80 1 -- 172.21.15.70:0/806073404 wait complete. 2023-10-08T08:45:30.196 INFO:tasks.workunit.client.0.smithi070.stdout:2/319: rename df/d12/d1b/f53 to df/d12/d1b/d1c/f64 0 2023-10-08T08:45:30.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.196+0000 7f4ded271b80 20 client.25736 trim_cache size 0 max 16384 2023-10-08T08:45:30.197 INFO:tasks.workunit.client.0.smithi070.stdout:1/294: getdents d6/dc 0 2023-10-08T08:45:30.197 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:45:30.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 -- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4dc80a16a0 msgr2=0x7f4dc80a3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4dc80a16a0 0x7f4dc80a3b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc069dd0 tx=0x7f4dd4009040 comp rx=0 tx=0).stop 2023-10-08T08:45:30.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 -- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ddc109190 msgr2=0x7f4ddc111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ddc109190 0x7f4ddc111b50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00e9c0 tx=0x7f4dcc00ed80 comp rx=0 tx=0).stop 2023-10-08T08:45:30.200 INFO:tasks.workunit.client.0.smithi070.stdout:2/320: truncate df/d12/d1b/f1e 7755554 0 2023-10-08T08:45:30.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 -- 172.21.15.70:0/2512276871 shutdown_connections 2023-10-08T08:45:30.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4dc80a16a0 0x7f4dc80a3b60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ddc112740 0x7f4ddc10bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ddc109190 0x7f4ddc111b50 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 --2- 172.21.15.70:0/2512276871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ddc109ab0 0x7f4ddc112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.198+0000 7f4de1088700 1 -- 172.21.15.70:0/2512276871 >> 172.21.15.70:0/2512276871 conn(0x7f4ddc06b830 msgr2=0x7f4ddc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.199+0000 7f4de1088700 1 -- 172.21.15.70:0/2512276871 shutdown_connections 2023-10-08T08:45:30.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.199+0000 7f4de1088700 1 -- 172.21.15.70:0/2512276871 wait complete. 2023-10-08T08:45:30.201 INFO:tasks.workunit.client.0.smithi070.stdout:4/265: unlink dc/d17/d1f/f35 0 2023-10-08T08:45:30.202 INFO:tasks.workunit.client.0.smithi070.stdout:2/321: mkdir df/d12/d15/d34/d65 0 2023-10-08T08:45:30.202 INFO:tasks.workunit.client.0.smithi070.stdout:2/322: chown df/d3a/l5b 7017 1 2023-10-08T08:45:30.203 INFO:tasks.workunit.client.0.smithi070.stdout:1/295: dread d6/dc/d14/d1f/f3c [0,4194304] 0 2023-10-08T08:45:30.203 INFO:tasks.workunit.client.0.smithi070.stdout:3/316: getdents d0/d12/d14/d1d/d22 0 2023-10-08T08:45:30.203 INFO:tasks.workunit.client.0.smithi070.stdout:1/296: write d6/dc/d14/d1f/d26/d38/f4a [1970086,17516] 0 2023-10-08T08:45:30.203 INFO:tasks.workunit.client.0.smithi070.stdout:2/323: creat df/d3a/f66 x:0 0 0 2023-10-08T08:45:30.205 INFO:tasks.workunit.client.0.smithi070.stdout:1/297: getdents d6/dc/d14/d1f/d29 0 2023-10-08T08:45:30.210 INFO:tasks.workunit.client.0.smithi070.stdout:3/317: mkdir d0/d12/d14/d1d/d22/d69 0 2023-10-08T08:45:30.211 INFO:tasks.workunit.client.0.smithi070.stdout:3/318: write d0/d12/d14/f62 [113667,43511] 0 2023-10-08T08:45:30.217 INFO:tasks.workunit.client.0.smithi070.stdout:4/266: dread dc/d17/f21 [0,4194304] 0 2023-10-08T08:45:30.217 INFO:tasks.workunit.client.0.smithi070.stdout:4/267: dread - dc/f13 zero size 2023-10-08T08:45:30.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T08:45:30.219 INFO:tasks.workunit.client.0.smithi070.stdout:9/225: dwrite d1/dd/d1a/f1d [4194304,4194304] 0 2023-10-08T08:45:30.220 INFO:tasks.workunit.client.0.smithi070.stdout:5/339: write d5/da/f16 [4141091,118703] 0 2023-10-08T08:45:30.220 INFO:tasks.workunit.client.0.smithi070.stdout:4/268: dread dc/d17/f2e [0,4194304] 0 2023-10-08T08:45:30.220 INFO:tasks.workunit.client.0.smithi070.stdout:4/269: fsync dc/d17/f2e 0 2023-10-08T08:45:30.221 INFO:tasks.workunit.client.0.smithi070.stdout:1/298: creat d6/f55 x:0 0 0 2023-10-08T08:45:30.225 INFO:tasks.workunit.client.0.smithi070.stdout:5/340: rmdir d5/d5f/d61/d30/d54/d62/d6e 0 2023-10-08T08:45:30.226 INFO:tasks.workunit.client.0.smithi070.stdout:5/341: dread - d5/da/d4d/d37/d38/f6a zero size 2023-10-08T08:45:30.226 INFO:tasks.workunit.client.0.smithi070.stdout:5/342: chown d5 1 1 2023-10-08T08:45:30.226 INFO:tasks.workunit.client.0.smithi070.stdout:1/299: symlink d6/dc/d14/l56 0 2023-10-08T08:45:30.227 INFO:tasks.workunit.client.0.smithi070.stdout:2/324: rmdir df/d12/d15/d34 39 2023-10-08T08:45:30.228 INFO:tasks.workunit.client.0.smithi070.stdout:5/343: truncate d5/d5f/d61/d30/f14 1381659 0 2023-10-08T08:45:30.228 INFO:tasks.workunit.client.0.smithi070.stdout:5/344: dread - d5/da/f68 zero size 2023-10-08T08:45:30.231 INFO:tasks.workunit.client.0.smithi070.stdout:2/325: dread df/d12/d25/f2a [0,4194304] 0 2023-10-08T08:45:30.231 INFO:tasks.workunit.client.0.smithi070.stdout:2/326: chown df/d12/d1b/l50 47324655 1 2023-10-08T08:45:30.231 INFO:tasks.workunit.client.0.smithi070.stdout:2/327: readlink df/l62 0 2023-10-08T08:45:30.232 INFO:tasks.workunit.client.0.smithi070.stdout:1/300: link d6/dc/d14/d1f/d26/f51 d6/dc/d14/d1f/d26/f57 0 2023-10-08T08:45:30.232 INFO:tasks.workunit.client.0.smithi070.stdout:1/301: chown d6/f18 480871666 1 2023-10-08T08:45:30.232 INFO:tasks.workunit.client.0.smithi070.stdout:1/302: chown d6/l47 200771753 1 2023-10-08T08:45:30.233 INFO:tasks.workunit.client.0.smithi070.stdout:3/319: dwrite d0/db/d10/f2c [0,4194304] 0 2023-10-08T08:45:30.234 INFO:tasks.workunit.client.0.smithi070.stdout:5/345: dread d5/da/f50 [0,4194304] 0 2023-10-08T08:45:30.238 INFO:tasks.workunit.client.0.smithi070.stdout:1/303: mkdir d6/dc/d58 0 2023-10-08T08:45:30.242 INFO:tasks.workunit.client.0.smithi070.stdout:3/320: rename d0/d12/d14/d1d/d22/d69 to d0/d12/d14/d1d/d22/d52/d5a/d6a 0 2023-10-08T08:45:30.248 INFO:tasks.workunit.client.0.smithi070.stdout:9/226: dwrite d1/dd/fa [0,4194304] 0 2023-10-08T08:45:30.249 INFO:tasks.workunit.client.0.smithi070.stdout:1/304: rename d6/dc/d14/d1f/d29/f42 to d6/dc/f59 0 2023-10-08T08:45:30.250 INFO:tasks.workunit.client.0.smithi070.stdout:9/227: write d1/fb [2947695,23494] 0 2023-10-08T08:45:30.254 INFO:tasks.workunit.client.0.smithi070.stdout:3/321: unlink d0/d12/d14/c23 0 2023-10-08T08:45:30.255 INFO:tasks.workunit.client.0.smithi070.stdout:1/305: creat d6/dc/d14/d1f/d29/f5a x:0 0 0 2023-10-08T08:45:30.255 INFO:tasks.workunit.client.0.smithi070.stdout:1/306: chown d6/dc/d14/d1f/d26/d38/l43 532 1 2023-10-08T08:45:30.258 INFO:tasks.workunit.client.0.smithi070.stdout:1/307: rmdir d6/dc/d58 0 2023-10-08T08:45:30.258 INFO:tasks.workunit.client.0.smithi070.stdout:1/308: write d6/dc/f54 [394075,94594] 0 2023-10-08T08:45:30.259 INFO:tasks.workunit.client.0.smithi070.stdout:1/309: chown d6/f28 150070773 1 2023-10-08T08:45:30.260 INFO:tasks.workunit.client.0.smithi070.stdout:1/310: symlink d6/dc/d14/d1f/l5b 0 2023-10-08T08:45:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:3/322: read d0/db/d10/d38/f3f [586820,43126] 0 2023-10-08T08:45:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:1/311: link d6/dc/d14/d1f/f32 d6/dc/d14/f5c 0 2023-10-08T08:45:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:7/360: mkdir d3/d79 0 2023-10-08T08:45:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:7/361: write d3/f37 [502936,86926] 0 2023-10-08T08:45:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:7/362: dread - d3/d19/f60 zero size 2023-10-08T08:45:30.268 INFO:tasks.workunit.client.0.smithi070.stdout:7/363: mknod d3/d19/d1b/d1e/d4c/c7a 0 2023-10-08T08:45:30.268 INFO:tasks.workunit.client.0.smithi070.stdout:7/364: dread - d3/d19/d1a/f2f zero size 2023-10-08T08:45:30.269 INFO:tasks.workunit.client.0.smithi070.stdout:5/346: dwrite d5/da/d22/f47 [0,4194304] 0 2023-10-08T08:45:30.272 INFO:tasks.workunit.client.0.smithi070.stdout:5/347: mkdir d5/da/d22/d75 0 2023-10-08T08:45:30.272 INFO:tasks.workunit.client.0.smithi070.stdout:5/348: fdatasync d5/da/d4d/d37/d38/d55/f53 0 2023-10-08T08:45:30.272 INFO:tasks.workunit.client.0.smithi070.stdout:5/349: mknod d5/d5f/c76 0 2023-10-08T08:45:30.275 INFO:tasks.workunit.client.0.smithi070.stdout:5/350: symlink d5/da/l77 0 2023-10-08T08:45:30.275 INFO:tasks.workunit.client.0.smithi070.stdout:5/351: write d5/da/d4d/d37/d38/d55/f53 [296949,92354] 0 2023-10-08T08:45:30.275 INFO:tasks.workunit.client.0.smithi070.stdout:5/352: chown d5/d5f/d61/d30/l70 708096 1 2023-10-08T08:45:30.276 INFO:tasks.workunit.client.0.smithi070.stdout:7/365: mknod d3/d19/d1b/c7b 0 2023-10-08T08:45:30.276 INFO:tasks.workunit.client.0.smithi070.stdout:7/366: chown d3/l5b 566596 1 2023-10-08T08:45:30.277 INFO:tasks.workunit.client.0.smithi070.stdout:7/367: chown d3/l3e 0 1 2023-10-08T08:45:30.277 INFO:tasks.workunit.client.0.smithi070.stdout:7/368: truncate d3/f3d 908496 0 2023-10-08T08:45:30.277 INFO:tasks.workunit.client.0.smithi070.stdout:7/369: readlink d3/l3e 0 2023-10-08T08:45:30.277 INFO:tasks.workunit.client.0.smithi070.stdout:9/228: dwrite d1/f25 [0,4194304] 0 2023-10-08T08:45:30.278 INFO:tasks.workunit.client.0.smithi070.stdout:9/229: readlink d1/dd/d26/d27/d2d/l3e 0 2023-10-08T08:45:30.283 INFO:tasks.workunit.client.0.smithi070.stdout:9/230: dread d1/dd/d26/d27/d2d/f2f [0,4194304] 0 2023-10-08T08:45:30.284 INFO:tasks.workunit.client.0.smithi070.stdout:5/353: truncate d5/f26 2557010 0 2023-10-08T08:45:30.284 INFO:tasks.workunit.client.0.smithi070.stdout:5/354: fsync d5/f9 0 2023-10-08T08:45:30.285 INFO:tasks.workunit.client.0.smithi070.stdout:9/231: rmdir d1/dd/d19/d38 39 2023-10-08T08:45:30.285 INFO:tasks.workunit.client.0.smithi070.stdout:5/355: getdents d5/d5f 0 2023-10-08T08:45:30.285 INFO:tasks.workunit.client.0.smithi070.stdout:7/370: symlink d3/d19/l7c 0 2023-10-08T08:45:30.286 INFO:tasks.workunit.client.0.smithi070.stdout:1/312: dwrite f5 [0,4194304] 0 2023-10-08T08:45:30.289 INFO:tasks.workunit.client.0.smithi070.stdout:1/313: mknod d6/c5d 0 2023-10-08T08:45:30.289 INFO:tasks.workunit.client.0.smithi070.stdout:3/323: dwrite d0/d12/d14/f40 [0,4194304] 0 2023-10-08T08:45:30.290 INFO:tasks.workunit.client.0.smithi070.stdout:1/314: creat d6/f5e x:0 0 0 2023-10-08T08:45:30.290 INFO:tasks.workunit.client.0.smithi070.stdout:1/315: chown d6/c5d 31477 1 2023-10-08T08:45:30.293 INFO:tasks.workunit.client.0.smithi070.stdout:3/324: dread d0/d12/d14/d1d/f3a [0,4194304] 0 2023-10-08T08:45:30.295 INFO:tasks.workunit.client.0.smithi070.stdout:7/371: rmdir d3/d19 39 2023-10-08T08:45:30.295 INFO:tasks.workunit.client.0.smithi070.stdout:5/356: write d5/f26 [595160,9446] 0 2023-10-08T08:45:30.295 INFO:tasks.workunit.client.0.smithi070.stdout:5/357: fsync d5/d5f/d61/f60 0 2023-10-08T08:45:30.296 INFO:tasks.workunit.client.0.smithi070.stdout:5/358: creat d5/d5f/f78 x:0 0 0 2023-10-08T08:45:30.297 INFO:tasks.workunit.client.0.smithi070.stdout:5/359: chown d5/da/d4d/d37/d38/d55 1 1 2023-10-08T08:45:30.297 INFO:tasks.workunit.client.0.smithi070.stdout:5/360: fdatasync d5/da/f16 0 2023-10-08T08:45:30.297 INFO:tasks.workunit.client.0.smithi070.stdout:5/361: readlink d5/da/l77 0 2023-10-08T08:45:30.297 INFO:tasks.workunit.client.0.smithi070.stdout:7/372: link d3/d19/d1b/d1e/c49 d3/d19/d1b/d4a/d9/c7d 0 2023-10-08T08:45:30.297 INFO:tasks.workunit.client.0.smithi070.stdout:9/232: write d1/dd/d19/d38/f3c [221647,7939] 0 2023-10-08T08:45:30.299 INFO:tasks.workunit.client.0.smithi070.stdout:7/373: link d3/d19/d1b/d4a/d50/f66 d3/d19/d1b/d1e/d4c/f7e 0 2023-10-08T08:45:30.299 INFO:tasks.workunit.client.0.smithi070.stdout:7/374: stat d3/d19/d1a/f20 0 2023-10-08T08:45:30.299 INFO:tasks.workunit.client.0.smithi070.stdout:9/233: creat d1/dd/d19/d38/f42 x:0 0 0 2023-10-08T08:45:30.301 INFO:tasks.workunit.client.0.smithi070.stdout:7/375: link d3/c6f d3/d19/d6d/c7f 0 2023-10-08T08:45:30.302 INFO:tasks.workunit.client.0.smithi070.stdout:7/376: read - d3/d19/d1a/f6e zero size 2023-10-08T08:45:30.313 INFO:tasks.workunit.client.0.smithi070.stdout:7/377: creat d3/d19/d1b/d1e/d4c/f80 x:0 0 0 2023-10-08T08:45:30.315 INFO:tasks.workunit.client.0.smithi070.stdout:7/378: unlink d3/f5c 0 2023-10-08T08:45:30.315 INFO:tasks.workunit.client.0.smithi070.stdout:7/379: chown d3/d19/d1b/d1e 7352 1 2023-10-08T08:45:30.315 INFO:tasks.workunit.client.0.smithi070.stdout:7/380: readlink d3/d19/d1b/d4a/l44 0 2023-10-08T08:45:30.319 INFO:tasks.workunit.client.0.smithi070.stdout:5/362: dread d5/da/f11 [0,4194304] 0 2023-10-08T08:45:30.319 INFO:tasks.workunit.client.0.smithi070.stdout:1/316: dwrite f5 [0,4194304] 0 2023-10-08T08:45:30.319 INFO:tasks.workunit.client.0.smithi070.stdout:3/325: dwrite d0/d12/d14/f62 [0,4194304] 0 2023-10-08T08:45:30.322 INFO:tasks.workunit.client.0.smithi070.stdout:1/317: rename d6/dc/d14/d1f/d26/d38/f3e to d6/dc/d14/d1f/d26/d38/f5f 0 2023-10-08T08:45:30.327 INFO:tasks.workunit.client.0.smithi070.stdout:3/326: mknod d0/db/d10/c6b 0 2023-10-08T08:45:30.329 INFO:tasks.workunit.client.0.smithi070.stdout:3/327: write d0/db/fd [3526158,92224] 0 2023-10-08T08:45:30.329 INFO:tasks.workunit.client.0.smithi070.stdout:3/328: chown d0/db/l58 136274314 1 2023-10-08T08:45:30.329 INFO:tasks.workunit.client.0.smithi070.stdout:3/329: getdents d0/d12/d14/d1d/d22/d52 0 2023-10-08T08:45:30.331 INFO:tasks.workunit.client.0.smithi070.stdout:1/318: getdents d6/dc 0 2023-10-08T08:45:30.341 INFO:tasks.workunit.client.0.smithi070.stdout:3/330: creat d0/d12/d14/d1d/f6c x:0 0 0 2023-10-08T08:45:30.341 INFO:tasks.workunit.client.0.smithi070.stdout:3/331: chown d0/d12/d14/f39 1746484 1 2023-10-08T08:45:30.341 INFO:tasks.workunit.client.0.smithi070.stdout:3/332: chown d0/db 92 1 2023-10-08T08:45:30.341 INFO:tasks.workunit.client.0.smithi070.stdout:3/333: stat d0/d12/d14/d1d/d22/f41 0 2023-10-08T08:45:30.344 INFO:tasks.workunit.client.0.smithi070.stdout:5/363: creat d5/da/d4d/f79 x:0 0 0 2023-10-08T08:45:30.344 INFO:tasks.workunit.client.0.smithi070.stdout:2/328: symlink df/d4c/l67 0 2023-10-08T08:45:30.345 INFO:tasks.workunit.client.0.smithi070.stdout:2/329: fsync df/d3a/f66 0 2023-10-08T08:45:30.347 INFO:tasks.workunit.client.0.smithi070.stdout:5/364: rename d5/d5f/d61/d30/l70 to d5/l7a 0 2023-10-08T08:45:30.347 INFO:tasks.workunit.client.0.smithi070.stdout:2/330: link fc df/d4c/f68 0 2023-10-08T08:45:30.354 INFO:tasks.workunit.client.0.smithi070.stdout:2/331: mkdir df/d12/d1b/d1c/d69 0 2023-10-08T08:45:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 -- 172.21.15.70:0/3547470091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b5c0ffcd0 msgr2=0x7f4b5c105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 --2- 172.21.15.70:0/3547470091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b5c0ffcd0 0x7f4b5c105400 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009990 tx=0x7f4b58009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 -- 172.21.15.70:0/3547470091 shutdown_connections 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 --2- 172.21.15.70:0/3547470091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b5c105b30 0x7f4b5c10d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 --2- 172.21.15.70:0/3547470091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5c0ff320 0x7f4b5c0ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 --2- 172.21.15.70:0/3547470091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b5c0ffcd0 0x7f4b5c105400 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 -- 172.21.15.70:0/3547470091 >> 172.21.15.70:0/3547470091 conn(0x7f4b5c074940 msgr2=0x7f4b5c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 -- 172.21.15.70:0/3547470091 shutdown_connections 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 -- 172.21.15.70:0/3547470091 wait complete. 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 Processor -- start 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.370+0000 7f4b647ec700 1 -- start start 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b647ec700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b5c0ff320 0x7f4b5c19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b647ec700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5c105b30 0x7f4b5c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b647ec700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b5c196a60 0x7f4b5c196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b647ec700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1974e0 con 0x7f4b5c196a60 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b647ec700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c197650 con 0x7f4b5c105b30 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b647ec700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c197810 con 0x7f4b5c0ff320 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62d89700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b5c196a60 0x7f4b5c196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62588700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b5c0ff320 0x7f4b5c19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62588700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b5c0ff320 0x7f4b5c19c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40080/0 (socket says 172.21.15.70:40080) 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62588700 1 -- 172.21.15.70:0/1092691936 learned_addr learned my addr 172.21.15.70:0/1092691936 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b61d87700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5c105b30 0x7f4b5c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62d89700 1 -- 172.21.15.70:0/1092691936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b5c0ff320 msgr2=0x7f4b5c19c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62d89700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b5c0ff320 0x7f4b5c19c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62d89700 1 -- 172.21.15.70:0/1092691936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5c105b30 msgr2=0x7f4b5c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62d89700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5c105b30 0x7f4b5c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62d89700 1 -- 172.21.15.70:0/1092691936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580095f0 con 0x7f4b5c196a60 2023-10-08T08:45:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b62d89700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b5c196a60 0x7f4b5c196f10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400cc50 tx=0x7f4b5400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b537fe700 1 -- 172.21.15.70:0/1092691936 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400ab40 con 0x7f4b5c196a60 2023-10-08T08:45:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b647ec700 1 -- 172.21.15.70:0/1092691936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c1a3800 con 0x7f4b5c196a60 2023-10-08T08:45:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b537fe700 1 -- 172.21.15.70:0/1092691936 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b5400aca0 con 0x7f4b5c196a60 2023-10-08T08:45:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b537fe700 1 -- 172.21.15.70:0/1092691936 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540115c0 con 0x7f4b5c196a60 2023-10-08T08:45:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.371+0000 7f4b647ec700 1 -- 172.21.15.70:0/1092691936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c1a3c90 con 0x7f4b5c196a60 2023-10-08T08:45:30.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.374+0000 7f4b537fe700 1 -- 172.21.15.70:0/1092691936 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f4b54012420 con 0x7f4b5c196a60 2023-10-08T08:45:30.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.374+0000 7f4b537fe700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b480a15f0 0x7f4b480a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.374+0000 7f4b537fe700 1 -- 172.21.15.70:0/1092691936 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4b540cd3a0 con 0x7f4b5c196a60 2023-10-08T08:45:30.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.374+0000 7f4b62588700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b480a15f0 0x7f4b480a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b62588700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b480a15f0 0x7f4b480a3ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c005950 tx=0x7f4b4c00a400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b709d5b80 1 Processor -- start 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b709d5b80 1 -- start start 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4a8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4b9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a411460 con 0x55e16a4a87a0 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a402c20 con 0x55e16a4a7e80 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a400540 con 0x55e16a4b7a60 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b61d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b62588700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b61d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52512/0 (socket says 172.21.15.70:52512) 2023-10-08T08:45:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.375+0000 7f4b61d87700 1 -- 172.21.15.70:0/3122705377 learned_addr learned my addr 172.21.15.70:0/3122705377 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b62d89700 1 --2- 172.21.15.70:0/3122705377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4b9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b61d87700 1 -- 172.21.15.70:0/3122705377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 msgr2=0x55e16a4b9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b61d87700 1 --2- 172.21.15.70:0/3122705377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4b9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b61d87700 1 -- 172.21.15.70:0/3122705377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 msgr2=0x55e16a4a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b61d87700 1 --2- 172.21.15.70:0/3122705377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4a8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b61d87700 1 -- 172.21.15.70:0/3122705377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e16a226de0 con 0x55e16a4a87a0 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b61d87700 1 --2- 172.21.15.70:0/3122705377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b7520 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800b5c0 tx=0x7f4b58009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c02429080bc4c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b50ff9700 1 -- 172.21.15.70:0/3122705377 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b580052c0 con 0x55e16a4a87a0 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b50ff9700 1 -- 172.21.15.70:0/3122705377 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b5801e040 con 0x55e16a4a87a0 2023-10-08T08:45:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.376+0000 7f4b50ff9700 1 -- 172.21.15.70:0/3122705377 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58004700 con 0x55e16a4a87a0 2023-10-08T08:45:30.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 -- 172.21.15.70:0/3122705377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 msgr2=0x55e16a4b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/3122705377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b7520 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800b5c0 tx=0x7f4b58009f60 comp rx=0 tx=0).stop 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 -- 172.21.15.70:0/3122705377 shutdown_connections 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/3122705377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4b9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/3122705377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/3122705377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b7520 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 -- 172.21.15.70:0/3122705377 >> 172.21.15.70:0/3122705377 conn(0x55e16a41d260 msgr2=0x55e16a4a42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 -- 172.21.15.70:0/3122705377 shutdown_connections 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 -- 172.21.15.70:0/3122705377 wait complete. 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 -- start start 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.377+0000 7f4b709d5b80 1 Processor -- start 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4b7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a3fbe30 con 0x55e16a4a87a0 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a398710 con 0x55e16a4a7e80 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a3983b0 con 0x55e16a4b7a60 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b709d5b80 10 client.0 _ll_register_callbacks cb 0x55e16a1f5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b61d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b61d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52518/0 (socket says 172.21.15.70:52518) 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b61d87700 1 -- 172.21.15.70:0/4240455082 learned_addr learned my addr 172.21.15.70:0/4240455082 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b62588700 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b62d89700 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b61d87700 1 -- 172.21.15.70:0/4240455082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 msgr2=0x55e16a4b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b61d87700 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b61d87700 1 -- 172.21.15.70:0/4240455082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 msgr2=0x55e16a4b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b61d87700 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b61d87700 1 -- 172.21.15.70:0/4240455082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c10df40 con 0x55e16a4a87a0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b61d87700 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b47a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4b58006010 tx=0x7f4b58009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f171463cc1b34e6e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b45ffb700 1 -- 172.21.15.70:0/4240455082 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58004500 con 0x55e16a4a87a0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b45ffb700 1 -- 172.21.15.70:0/4240455082 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4b58004660 con 0x55e16a4a87a0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.378+0000 7f4b709d5b80 1 -- 172.21.15.70:0/4240455082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e16a3c3eb0 con 0x55e16a4a87a0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b45ffb700 1 -- 172.21.15.70:0/4240455082 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b58005c00 con 0x55e16a4a87a0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b709d5b80 10 client.16323 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b709d5b80 1 -- 172.21.15.70:0/4240455082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e16a20fc60 con 0x55e16a4a87a0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b45ffb700 1 -- 172.21.15.70:0/4240455082 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e16a3c3eb0 con 0x55e16a4a87a0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b45ffb700 1 -- 172.21.15.70:0/4240455082 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4b5800f8a0 con 0x55e16a4a87a0 2023-10-08T08:45:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b709d5b80 10 client.16323 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:30.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b709d5b80 10 client.16323 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-08T08:45:30.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b709d5b80 20 client.16323 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:30.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55e16a4c7010 0x55e16a4c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b709d5b80 4 client.16323 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:30.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.379+0000 7f4b709d5b80 1 -- 172.21.15.70:0/4240455082 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e16a3f4e10 con 0x55e16a4c7010 2023-10-08T08:45:30.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.410+0000 7f4b62588700 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55e16a4c7010 0x55e16a4c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.410+0000 7f4b62588700 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55e16a4c7010 0x55e16a4c9400 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=94aa7da7b797ae9a server_cookie=59cc01bfd9df2435 in_seq=0 out_seq=0 2023-10-08T08:45:30.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.410+0000 7f4b45ffb700 10 client.16323 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:45:30.412 INFO:tasks.workunit.client.0.smithi070.stdout:5/365: creat d5/d5f/d61/d30/d54/f7b x:0 0 0 2023-10-08T08:45:30.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b45ffb700 1 -- 172.21.15.70:0/4240455082 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e16a3f4e10 con 0x55e16a4c7010 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b45ffb700 10 client.16323 handle_command_reply: tid=0 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 client.16323 shutdown 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 -- 172.21.15.70:0/4240455082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 msgr2=0x55e16a4b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b47a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4b58006010 tx=0x7f4b58009580 comp rx=0 tx=0).stop 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 -- 172.21.15.70:0/4240455082 shutdown_connections 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55e16a4c7010 0x55e16a4c9400 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b45ffb700 0 client.16323 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/4240455082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4b47a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 -- 172.21.15.70:0/4240455082 >> 172.21.15.70:0/4240455082 conn(0x55e16a41d260 msgr2=0x55e16a4a3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 -- 172.21.15.70:0/4240455082 shutdown_connections 2023-10-08T08:45:30.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.412+0000 7f4b709d5b80 1 -- 172.21.15.70:0/4240455082 wait complete. 2023-10-08T08:45:30.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.413+0000 7f4b709d5b80 20 client.16323 trim_cache size 0 max 16384 2023-10-08T08:45:30.415 INFO:tasks.workunit.client.0.smithi070.stdout:5/366: creat d5/f7c x:0 0 0 2023-10-08T08:45:30.417 INFO:tasks.workunit.client.0.smithi070.stdout:2/332: getdents df/d12/d15 0 2023-10-08T08:45:30.418 INFO:tasks.workunit.client.0.smithi070.stdout:2/333: rename df/d12/d1b/f3c to df/d12/d1b/d1c/f6a 0 2023-10-08T08:45:30.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.426+0000 7f4b709d5b80 1 Processor -- start 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.426+0000 7f4b709d5b80 1 -- start start 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4be550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4a4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a27c920 con 0x55e16a4a87a0 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a4b5d50 con 0x55e16a4a7e80 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a4a8b80 con 0x55e16a4b7a60 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b61d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b61d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4a3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52526/0 (socket says 172.21.15.70:52526) 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b61d87700 1 -- 172.21.15.70:0/1174875185 learned_addr learned my addr 172.21.15.70:0/1174875185 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b62d89700 1 --2- 172.21.15.70:0/1174875185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b62588700 1 --2- 172.21.15.70:0/1174875185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b61d87700 1 -- 172.21.15.70:0/1174875185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 msgr2=0x55e16a4a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b61d87700 1 --2- 172.21.15.70:0/1174875185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4a4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b61d87700 1 -- 172.21.15.70:0/1174875185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 msgr2=0x55e16a4be550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b61d87700 1 --2- 172.21.15.70:0/1174875185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4be550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b61d87700 1 -- 172.21.15.70:0/1174875185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e16a24d250 con 0x55e16a4a87a0 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b61d87700 1 --2- 172.21.15.70:0/1174875185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4a3c40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009990 tx=0x7f4b58009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e40af30d85917d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.427+0000 7f4b517fa700 1 -- 172.21.15.70:0/1174875185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58005440 con 0x55e16a4a87a0 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b517fa700 1 -- 172.21.15.70:0/1174875185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b580055a0 con 0x55e16a4a87a0 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b517fa700 1 -- 172.21.15.70:0/1174875185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5802cb60 con 0x55e16a4a87a0 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b709d5b80 1 -- 172.21.15.70:0/1174875185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 msgr2=0x55e16a4a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/1174875185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4a3c40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009990 tx=0x7f4b58009fc0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b709d5b80 1 -- 172.21.15.70:0/1174875185 shutdown_connections 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/1174875185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a4a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/1174875185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4be550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/1174875185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4a3c40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b709d5b80 1 -- 172.21.15.70:0/1174875185 >> 172.21.15.70:0/1174875185 conn(0x55e16a41d260 msgr2=0x55e16a4b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b709d5b80 1 -- 172.21.15.70:0/1174875185 shutdown_connections 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.428+0000 7f4b709d5b80 1 -- 172.21.15.70:0/1174875185 wait complete. 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b709d5b80 1 -- start start 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b709d5b80 1 Processor -- start 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4bc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b709d5b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a513da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a5142e0 con 0x55e16a4a87a0 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a514450 con 0x55e16a4a7e80 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b709d5b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e16a514610 con 0x55e16a4b7a60 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b709d5b80 10 client.0 _ll_register_callbacks cb 0x7f4b4c00a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b61d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b61d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4bcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52532/0 (socket says 172.21.15.70:52532) 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b61d87700 1 -- 172.21.15.70:0/2506633831 learned_addr learned my addr 172.21.15.70:0/2506633831 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b62d89700 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a513da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b62588700 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b61d87700 1 -- 172.21.15.70:0/2506633831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 msgr2=0x55e16a513da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b61d87700 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a513da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b61d87700 1 -- 172.21.15.70:0/2506633831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 msgr2=0x55e16a4bc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b61d87700 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4bc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b61d87700 1 -- 172.21.15.70:0/2506633831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e16a20fc60 con 0x55e16a4a87a0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b62588700 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b61d87700 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4bcc60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800fac0 tx=0x7f4b58005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4381caba6e43139b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.429+0000 7f4b45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b45ffb700 1 -- 172.21.15.70:0/2506633831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b580053d0 con 0x55e16a4a87a0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b709d5b80 1 -- 172.21.15.70:0/2506633831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b5801e040 con 0x55e16a4a87a0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b45ffb700 1 -- 172.21.15.70:0/2506633831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4b58000e40 con 0x55e16a4a87a0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b45ffb700 1 -- 172.21.15.70:0/2506633831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b5802c760 con 0x55e16a4a87a0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b709d5b80 10 client.16329 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b709d5b80 1 -- 172.21.15.70:0/2506633831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e16a2252b0 con 0x55e16a4a87a0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b45ffb700 1 -- 172.21.15.70:0/2506633831 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b5801e040 con 0x55e16a4a87a0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b45ffb700 1 -- 172.21.15.70:0/2506633831 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4b5803b070 con 0x55e16a4a87a0 2023-10-08T08:45:30.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b709d5b80 10 client.16329 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b709d5b80 10 client.16329 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b709d5b80 20 client.16329 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55e16a51baa0 0x55e16a51dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b709d5b80 4 client.16329 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b709d5b80 1 -- 172.21.15.70:0/2506633831 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e16a3f4b30 con 0x55e16a51baa0 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.430+0000 7f4b62588700 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55e16a51baa0 0x55e16a51dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b45ffb700 10 client.16329 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b62588700 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55e16a51baa0 0x55e16a51dec0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28c87a90e0ac4e0c server_cookie=b4a3b1ab7b3ee48e in_seq=0 out_seq=0 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b45ffb700 1 -- 172.21.15.70:0/2506633831 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e16a3f4b30 con 0x55e16a51baa0 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b45ffb700 10 client.16329 handle_command_reply: tid=0 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 client.16329 shutdown 2023-10-08T08:45:30.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 -- 172.21.15.70:0/2506633831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 msgr2=0x55e16a4bcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4bcc60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800fac0 tx=0x7f4b58005a00 comp rx=0 tx=0).stop 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 -- 172.21.15.70:0/2506633831 shutdown_connections 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x55e16a51baa0 0x55e16a51dec0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e16a4b7a60 0x55e16a513da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e16a4a7e80 0x55e16a4bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 --2- 172.21.15.70:0/2506633831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e16a4a87a0 0x55e16a4bcc60 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b45ffb700 0 client.16329 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 -- 172.21.15.70:0/2506633831 >> 172.21.15.70:0/2506633831 conn(0x55e16a41d260 msgr2=0x55e16a4a3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 -- 172.21.15.70:0/2506633831 shutdown_connections 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 1 -- 172.21.15.70:0/2506633831 wait complete. 2023-10-08T08:45:30.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.431+0000 7f4b709d5b80 20 client.16329 trim_cache size 0 max 16384 2023-10-08T08:45:30.440 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:45:30.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 -- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b480a15f0 msgr2=0x7f4b480a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b480a15f0 0x7f4b480a3ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c005950 tx=0x7f4b4c00a400 comp rx=0 tx=0).stop 2023-10-08T08:45:30.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 -- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b5c196a60 msgr2=0x7f4b5c196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b5c196a60 0x7f4b5c196f10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400cc50 tx=0x7f4b5400cf60 comp rx=0 tx=0).stop 2023-10-08T08:45:30.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 -- 172.21.15.70:0/1092691936 shutdown_connections 2023-10-08T08:45:30.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f4b480a15f0 0x7f4b480a3ab0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b5c196a60 0x7f4b5c196f10 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b5c0ff320 0x7f4b5c19c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 --2- 172.21.15.70:0/1092691936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5c105b30 0x7f4b5c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 -- 172.21.15.70:0/1092691936 >> 172.21.15.70:0/1092691936 conn(0x7f4b5c074940 msgr2=0x7f4b5c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 -- 172.21.15.70:0/1092691936 shutdown_connections 2023-10-08T08:45:30.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.432+0000 7f4b647ec700 1 -- 172.21.15.70:0/1092691936 wait complete. 2023-10-08T08:45:30.442 INFO:tasks.workunit.client.0.smithi070.stdout:2/334: dwrite fa [0,4194304] 0 2023-10-08T08:45:30.442 INFO:tasks.workunit.client.0.smithi070.stdout:2/335: chown df/f20 856656 1 2023-10-08T08:45:30.442 INFO:tasks.workunit.client.0.smithi070.stdout:2/336: write fc [3344065,69978] 0 2023-10-08T08:45:30.442 INFO:tasks.workunit.client.0.smithi070.stdout:2/337: read df/d4c/f4f [1557269,97258] 0 2023-10-08T08:45:30.442 INFO:tasks.workunit.client.0.smithi070.stdout:2/338: symlink df/d3a/l6b 0 2023-10-08T08:45:30.442 INFO:tasks.workunit.client.0.smithi070.stdout:2/339: stat df/d12/d15/d34/d65 0 2023-10-08T08:45:30.443 INFO:tasks.workunit.client.0.smithi070.stdout:2/340: rename df/d12/d1b/d1c/c22 to df/d12/d1b/d1c/d69/c6c 0 2023-10-08T08:45:30.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T08:45:30.458 INFO:tasks.workunit.client.0.smithi070.stdout:1/319: creat d6/dc/d14/d1f/d26/f60 x:0 0 0 2023-10-08T08:45:30.458 INFO:tasks.workunit.client.0.smithi070.stdout:1/320: chown d6/f5e 1 1 2023-10-08T08:45:30.461 INFO:tasks.workunit.client.0.smithi070.stdout:1/321: mknod d6/c61 0 2023-10-08T08:45:30.463 INFO:tasks.workunit.client.0.smithi070.stdout:1/322: mkdir d6/dc/d14/d62 0 2023-10-08T08:45:30.466 INFO:tasks.workunit.client.0.smithi070.stdout:1/323: mkdir d6/dc/d14/d1f/d63 0 2023-10-08T08:45:30.466 INFO:tasks.workunit.client.0.smithi070.stdout:1/324: chown d6/dc/d14/d1f/d26/c48 113657 1 2023-10-08T08:45:30.468 INFO:tasks.workunit.client.0.smithi070.stdout:1/325: link d6/dc/d14/l2c d6/dc/d14/l64 0 2023-10-08T08:45:30.469 INFO:tasks.workunit.client.0.smithi070.stdout:2/341: getdents df 0 2023-10-08T08:45:30.470 INFO:tasks.workunit.client.0.smithi070.stdout:2/342: creat df/d4c/f6d x:0 0 0 2023-10-08T08:45:30.470 INFO:tasks.workunit.client.0.smithi070.stdout:2/343: fdatasync df/d12/d15/f17 0 2023-10-08T08:45:30.471 INFO:tasks.workunit.client.0.smithi070.stdout:1/326: rename d6/dc/f44 to d6/f65 0 2023-10-08T08:45:30.471 INFO:tasks.workunit.client.0.smithi070.stdout:1/327: chown d6/dc/f59 3 1 2023-10-08T08:45:30.473 INFO:tasks.workunit.client.0.smithi070.stdout:1/328: link l1 d6/dc/d14/d1f/d63/l66 0 2023-10-08T08:45:30.473 INFO:tasks.workunit.client.0.smithi070.stdout:1/329: write d6/f1b [220022,100420] 0 2023-10-08T08:45:30.473 INFO:tasks.workunit.client.0.smithi070.stdout:1/330: mknod d6/dc/d14/d62/c67 0 2023-10-08T08:45:30.475 INFO:tasks.workunit.client.0.smithi070.stdout:1/331: mkdir d6/dc/d68 0 2023-10-08T08:45:30.475 INFO:tasks.workunit.client.0.smithi070.stdout:2/344: getdents df/d12/d15/d34 0 2023-10-08T08:45:30.476 INFO:tasks.workunit.client.0.smithi070.stdout:2/345: chown df/l62 175751756 1 2023-10-08T08:45:30.476 INFO:tasks.workunit.client.0.smithi070.stdout:1/332: symlink d6/dc/d14/d1f/d26/l69 0 2023-10-08T08:45:30.478 INFO:tasks.workunit.client.0.smithi070.stdout:2/346: link df/c60 df/d12/d1b/d1c/c6e 0 2023-10-08T08:45:30.480 INFO:tasks.workunit.client.0.smithi070.stdout:2/347: symlink df/d12/d1b/d1c/d2d/l6f 0 2023-10-08T08:45:30.480 INFO:tasks.workunit.client.0.smithi070.stdout:2/348: chown df/d12/d1b/l27 20174515 1 2023-10-08T08:45:30.480 INFO:tasks.workunit.client.0.smithi070.stdout:2/349: dread - df/d12/d1b/d1c/d2d/f58 zero size 2023-10-08T08:45:30.481 INFO:tasks.workunit.client.0.smithi070.stdout:2/350: link df/d12/d25/f3e df/d12/d15/d34/f70 0 2023-10-08T08:45:30.481 INFO:tasks.workunit.client.0.smithi070.stdout:2/351: write df/d12/d15/f42 [646381,55920] 0 2023-10-08T08:45:30.487 INFO:tasks.workunit.client.0.smithi070.stdout:2/352: write f8 [3830205,77196] 0 2023-10-08T08:45:30.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/333: dwrite d6/dc/d14/d1f/d29/f2f [0,4194304] 0 2023-10-08T08:45:30.511 INFO:tasks.workunit.client.0.smithi070.stdout:2/353: dread df/d12/d15/f41 [0,4194304] 0 2023-10-08T08:45:30.511 INFO:tasks.workunit.client.0.smithi070.stdout:2/354: truncate df/d12/d15/f31 2220005 0 2023-10-08T08:45:30.513 INFO:tasks.workunit.client.0.smithi070.stdout:1/334: write d6/dc/d14/d1f/f2b [1069561,81510] 0 2023-10-08T08:45:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:30 smithi105 ceph-mon[103798]: pgmap v342: 129 pgs: 129 active+clean; 292 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 33 MiB/s wr, 1.43k op/s 2023-10-08T08:45:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:30 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/826139964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:45:30.532 INFO:tasks.workunit.client.0.smithi070.stdout:1/335: dwrite d6/dc/f54 [0,4194304] 0 2023-10-08T08:45:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.591+0000 7f61488c7700 1 -- 172.21.15.70:0/334243746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6144105630 msgr2=0x7f6144105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.591+0000 7f61488c7700 1 --2- 172.21.15.70:0/334243746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6144105630 0x7f6144105a10 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6138009990 tx=0x7f6138009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.591+0000 7f61488c7700 1 -- 172.21.15.70:0/334243746 shutdown_connections 2023-10-08T08:45:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.591+0000 7f61488c7700 1 --2- 172.21.15.70:0/334243746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6144100750 0x7f614410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.591+0000 7f61488c7700 1 --2- 172.21.15.70:0/334243746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6144105630 0x7f6144105a10 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.591+0000 7f61488c7700 1 --2- 172.21.15.70:0/334243746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61440ffd90 0x7f6144100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.591+0000 7f61488c7700 1 -- 172.21.15.70:0/334243746 >> 172.21.15.70:0/334243746 conn(0x7f6144075c20 msgr2=0x7f61440fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.591+0000 7f61488c7700 1 -- 172.21.15.70:0/334243746 shutdown_connections 2023-10-08T08:45:30.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.592+0000 7f61488c7700 1 -- 172.21.15.70:0/334243746 wait complete. 2023-10-08T08:45:30.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.592+0000 7f61488c7700 1 Processor -- start 2023-10-08T08:45:30.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.592+0000 7f61488c7700 1 -- start start 2023-10-08T08:45:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:30 smithi191 ceph-mon[104220]: pgmap v342: 129 pgs: 129 active+clean; 292 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 33 MiB/s wr, 1.43k op/s 2023-10-08T08:45:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:30 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/826139964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:45:30.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.592+0000 7f61488c7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61440ffd90 0x7f614419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.592+0000 7f61488c7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6144100750 0x7f614419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.592+0000 7f61488c7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6144105630 0x7f61441969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.592+0000 7f61488c7700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144197050 con 0x7f61440ffd90 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.592+0000 7f61488c7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61441971c0 con 0x7f6144100750 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.592+0000 7f61488c7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144197380 con 0x7f6144105630 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f614259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61440ffd90 0x7f614419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f614259c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61440ffd90 0x7f614419c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52542/0 (socket says 172.21.15.70:52542) 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f614259c700 1 -- 172.21.15.70:0/1213619593 learned_addr learned my addr 172.21.15.70:0/1213619593 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f6142d9d700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6144105630 0x7f61441969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f6141d9b700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6144100750 0x7f614419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f614259c700 1 -- 172.21.15.70:0/1213619593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6144105630 msgr2=0x7f61441969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f614259c700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6144105630 0x7f61441969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f614259c700 1 -- 172.21.15.70:0/1213619593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6144100750 msgr2=0x7f614419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f614259c700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6144100750 0x7f614419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f614259c700 1 -- 172.21.15.70:0/1213619593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61380095f0 con 0x7f61440ffd90 2023-10-08T08:45:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f614259c700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61440ffd90 0x7f614419c8c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6138000c00 tx=0x7f6138004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f61337fe700 1 -- 172.21.15.70:0/1213619593 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613801d070 con 0x7f61440ffd90 2023-10-08T08:45:30.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f61337fe700 1 -- 172.21.15.70:0/1213619593 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6138022470 con 0x7f61440ffd90 2023-10-08T08:45:30.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f61488c7700 1 -- 172.21.15.70:0/1213619593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6144197600 con 0x7f61440ffd90 2023-10-08T08:45:30.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f61337fe700 1 -- 172.21.15.70:0/1213619593 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138017650 con 0x7f61440ffd90 2023-10-08T08:45:30.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.593+0000 7f61488c7700 1 -- 172.21.15.70:0/1213619593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61441a38b0 con 0x7f61440ffd90 2023-10-08T08:45:30.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.595+0000 7f61337fe700 1 -- 172.21.15.70:0/1213619593 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f61380225e0 con 0x7f61440ffd90 2023-10-08T08:45:30.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.596+0000 7f61337fe700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f612c0a15f0 0x7f612c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.596+0000 7f6141d9b700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f612c0a15f0 0x7f612c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.596+0000 7f61337fe700 1 -- 172.21.15.70:0/1213619593 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f61380ce5d0 con 0x7f61440ffd90 2023-10-08T08:45:30.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.596+0000 7f6141d9b700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f612c0a15f0 0x7f612c0a3ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6144197bb0 tx=0x7f613400a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6154ab0b80 1 Processor -- start 2023-10-08T08:45:30.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6154ab0b80 1 -- start start 2023-10-08T08:45:30.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 0x55ed8dd85260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd94520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 0x55ed8dd96e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dcee460 con 0x55ed8dd857a0 2023-10-08T08:45:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dcdfc20 con 0x55ed8dd84e80 2023-10-08T08:45:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dcdd540 con 0x55ed8dd94a60 2023-10-08T08:45:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6141d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd94520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6141d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd94520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52552/0 (socket says 172.21.15.70:52552) 2023-10-08T08:45:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6141d9b700 1 -- 172.21.15.70:0/1241959280 learned_addr learned my addr 172.21.15.70:0/1241959280 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.597+0000 7f6142d9d700 1 --2- 172.21.15.70:0/1241959280 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 0x55ed8dd96e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f614259c700 1 --2- 172.21.15.70:0/1241959280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 0x55ed8dd85260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f6141d9b700 1 -- 172.21.15.70:0/1241959280 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 msgr2=0x55ed8dd96e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f6141d9b700 1 --2- 172.21.15.70:0/1241959280 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 0x55ed8dd96e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f6141d9b700 1 -- 172.21.15.70:0/1241959280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 msgr2=0x55ed8dd85260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f6141d9b700 1 --2- 172.21.15.70:0/1241959280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 0x55ed8dd85260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f6141d9b700 1 -- 172.21.15.70:0/1241959280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed8db03de0 con 0x55ed8dd857a0 2023-10-08T08:45:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f6141d9b700 1 --2- 172.21.15.70:0/1241959280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd94520 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f613400fdb0 tx=0x7f6134012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617a588348aa4b19 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f6130ff9700 1 -- 172.21.15.70:0/1241959280 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340108c0 con 0x55ed8dd857a0 2023-10-08T08:45:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f6130ff9700 1 -- 172.21.15.70:0/1241959280 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6134020070 con 0x55ed8dd857a0 2023-10-08T08:45:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.598+0000 7f6130ff9700 1 -- 172.21.15.70:0/1241959280 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134025e60 con 0x55ed8dd857a0 2023-10-08T08:45:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1241959280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 msgr2=0x55ed8dd94520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/1241959280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd94520 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f613400fdb0 tx=0x7f6134012000 comp rx=0 tx=0).stop 2023-10-08T08:45:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1241959280 shutdown_connections 2023-10-08T08:45:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/1241959280 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 0x55ed8dd96e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/1241959280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 0x55ed8dd85260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/1241959280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd94520 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1241959280 >> 172.21.15.70:0/1241959280 conn(0x55ed8dcfa260 msgr2=0x55ed8dd812d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1241959280 shutdown_connections 2023-10-08T08:45:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1241959280 wait complete. 2023-10-08T08:45:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 -- start start 2023-10-08T08:45:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 Processor -- start 2023-10-08T08:45:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 0x55ed8dd94490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd91820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 0x55ed8dd91f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dcd8e30 con 0x55ed8dd857a0 2023-10-08T08:45:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dc75710 con 0x55ed8dd84e80 2023-10-08T08:45:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dc753b0 con 0x55ed8dd94a60 2023-10-08T08:45:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.599+0000 7f6154ab0b80 10 client.0 _ll_register_callbacks cb 0x55ed8dad2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6141d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd91820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6141d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd91820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52560/0 (socket says 172.21.15.70:52560) 2023-10-08T08:45:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6141d9b700 1 -- 172.21.15.70:0/831942304 learned_addr learned my addr 172.21.15.70:0/831942304 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6142d9d700 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 0x55ed8dd91f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f614259c700 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 0x55ed8dd94490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6141d9b700 1 -- 172.21.15.70:0/831942304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 msgr2=0x55ed8dd91f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6141d9b700 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 0x55ed8dd91f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6141d9b700 1 -- 172.21.15.70:0/831942304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 msgr2=0x55ed8dd94490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6141d9b700 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 0x55ed8dd94490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6141d9b700 1 -- 172.21.15.70:0/831942304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613400fa60 con 0x55ed8dd857a0 2023-10-08T08:45:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f614259c700 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 0x55ed8dd94490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6142d9d700 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 0x55ed8dd91f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6141d9b700 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd91820 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f613400fd80 tx=0x7f6134005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596fd2ff934d1eb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6129ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6129ffb700 1 -- 172.21.15.70:0/831942304 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613402a070 con 0x55ed8dd857a0 2023-10-08T08:45:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6129ffb700 1 -- 172.21.15.70:0/831942304 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6134010ad0 con 0x55ed8dd857a0 2023-10-08T08:45:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6154ab0b80 1 -- 172.21.15.70:0/831942304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed8dca0eb0 con 0x55ed8dd857a0 2023-10-08T08:45:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6129ffb700 1 -- 172.21.15.70:0/831942304 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6134010c90 con 0x55ed8dd857a0 2023-10-08T08:45:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6154ab0b80 10 client.16341 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6154ab0b80 1 -- 172.21.15.70:0/831942304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ed8daecc60 con 0x55ed8dd857a0 2023-10-08T08:45:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.600+0000 7f6129ffb700 1 -- 172.21.15.70:0/831942304 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ed8dca0eb0 con 0x55ed8dd857a0 2023-10-08T08:45:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f6129ffb700 1 -- 172.21.15.70:0/831942304 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6134005410 con 0x55ed8dd857a0 2023-10-08T08:45:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f6154ab0b80 10 client.16341 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f6154ab0b80 10 client.16341 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-10-08T08:45:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f6154ab0b80 20 client.16341 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55ed8dda44a0 0x55ed8dda68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f6154ab0b80 4 client.16341 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f6154ab0b80 1 -- 172.21.15.70:0/831942304 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed8dcd1e10 con 0x55ed8dda44a0 2023-10-08T08:45:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f614259c700 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55ed8dda44a0 0x55ed8dda68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f614259c700 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55ed8dda44a0 0x55ed8dda68c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b49f3026abaa6517 server_cookie=23844f92f8f7e139 in_seq=0 out_seq=0 2023-10-08T08:45:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.601+0000 7f6129ffb700 10 client.16341 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:45:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6129ffb700 1 -- 172.21.15.70:0/831942304 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ed8dcd1e10 con 0x55ed8dda44a0 2023-10-08T08:45:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6129ffb700 10 client.16341 handle_command_reply: tid=0 2023-10-08T08:45:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 client.16341 shutdown 2023-10-08T08:45:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 -- 172.21.15.70:0/831942304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 msgr2=0x55ed8dd91820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd91820 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f613400fd80 tx=0x7f6134005de0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 -- 172.21.15.70:0/831942304 shutdown_connections 2023-10-08T08:45:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55ed8dda44a0 0x55ed8dda68c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd94a60 0x55ed8dd91f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd84e80 0x55ed8dd94490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/831942304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd857a0 0x55ed8dd91820 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6129ffb700 0 client.16341 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:45:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 -- 172.21.15.70:0/831942304 >> 172.21.15.70:0/831942304 conn(0x55ed8dcfa260 msgr2=0x55ed8dd80ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 -- 172.21.15.70:0/831942304 shutdown_connections 2023-10-08T08:45:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 1 -- 172.21.15.70:0/831942304 wait complete. 2023-10-08T08:45:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.602+0000 7f6154ab0b80 20 client.16341 trim_cache size 0 max 16384 2023-10-08T08:45:30.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6154ab0b80 1 Processor -- start 2023-10-08T08:45:30.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6154ab0b80 1 -- start start 2023-10-08T08:45:30.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 0x55ed8dd91f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd9b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 0x55ed8dd8cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8db59920 con 0x55ed8dd94a60 2023-10-08T08:45:30.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dd7b5e0 con 0x55ed8dd857a0 2023-10-08T08:45:30.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dd9bb70 con 0x55ed8dd84e80 2023-10-08T08:45:30.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6141d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd9b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6142d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 0x55ed8dd8cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.615+0000 7f6141d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd9b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40024/0 (socket says 172.21.15.70:40024) 2023-10-08T08:45:30.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f6141d9b700 1 -- 172.21.15.70:0/1945605065 learned_addr learned my addr 172.21.15.70:0/1945605065 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f614259c700 1 --2- 172.21.15.70:0/1945605065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 0x55ed8dd91f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f6141d9b700 1 -- 172.21.15.70:0/1945605065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 msgr2=0x55ed8dd91f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f6141d9b700 1 --2- 172.21.15.70:0/1945605065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 0x55ed8dd91f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f6141d9b700 1 -- 172.21.15.70:0/1945605065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 msgr2=0x55ed8dd8cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f6141d9b700 1 --2- 172.21.15.70:0/1945605065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 0x55ed8dd8cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f6141d9b700 1 -- 172.21.15.70:0/1945605065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed8db2a250 con 0x55ed8dd857a0 2023-10-08T08:45:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f6142d9d700 1 --2- 172.21.15.70:0/1945605065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 0x55ed8dd8cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f6141d9b700 1 --2- 172.21.15.70:0/1945605065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd9b5b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61340257f0 tx=0x7f6134025bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48aa606e30997aee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f61317fa700 1 -- 172.21.15.70:0/1945605065 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613402a070 con 0x55ed8dd857a0 2023-10-08T08:45:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f61317fa700 1 -- 172.21.15.70:0/1945605065 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6134014070 con 0x55ed8dd857a0 2023-10-08T08:45:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.616+0000 7f61317fa700 1 -- 172.21.15.70:0/1945605065 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134005520 con 0x55ed8dd857a0 2023-10-08T08:45:30.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1945605065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 msgr2=0x55ed8dd9b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/1945605065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd9b5b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61340257f0 tx=0x7f6134025bd0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1945605065 shutdown_connections 2023-10-08T08:45:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/1945605065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 0x55ed8dd8cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/1945605065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 0x55ed8dd91f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/1945605065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd9b5b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1945605065 >> 172.21.15.70:0/1945605065 conn(0x55ed8dcfa260 msgr2=0x55ed8dd804d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1945605065 shutdown_connections 2023-10-08T08:45:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 -- 172.21.15.70:0/1945605065 wait complete. 2023-10-08T08:45:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 -- start start 2023-10-08T08:45:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 Processor -- start 2023-10-08T08:45:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 0x55ed8dd98ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 0x55ed8ddf7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dd99bc0 con 0x55ed8dd94a60 2023-10-08T08:45:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8dd99d30 con 0x55ed8dd857a0 2023-10-08T08:45:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8ddf7820 con 0x55ed8dd84e80 2023-10-08T08:45:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6154ab0b80 10 client.0 _ll_register_callbacks cb 0x55ed8dad2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6141d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f614259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 0x55ed8dd98ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6141d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40030/0 (socket says 172.21.15.70:40030) 2023-10-08T08:45:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.617+0000 7f6141d9b700 1 -- 172.21.15.70:0/3729744451 learned_addr learned my addr 172.21.15.70:0/3729744451 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6141d9b700 1 -- 172.21.15.70:0/3729744451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 msgr2=0x55ed8dd98ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6141d9b700 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 0x55ed8dd98ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6141d9b700 1 -- 172.21.15.70:0/3729744451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 msgr2=0x55ed8ddf7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6141d9b700 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 0x55ed8ddf7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6141d9b700 1 -- 172.21.15.70:0/3729744451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c0118c0 con 0x55ed8dd857a0 2023-10-08T08:45:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6141d9b700 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd993e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6134010010 tx=0x7f6134005d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dc3e0c576a5c26d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6129ffb700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:45:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6129ffb700 1 -- 172.21.15.70:0/3729744451 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613402a040 con 0x55ed8dd857a0 2023-10-08T08:45:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6154ab0b80 1 -- 172.21.15.70:0/3729744451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6134020070 con 0x55ed8dd857a0 2023-10-08T08:45:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6129ffb700 1 -- 172.21.15.70:0/3729744451 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f613402f9b0 con 0x55ed8dd857a0 2023-10-08T08:45:30.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6129ffb700 1 -- 172.21.15.70:0/3729744451 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f613402fb90 con 0x55ed8dd857a0 2023-10-08T08:45:30.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6154ab0b80 10 client.25766 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:30.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6154ab0b80 1 -- 172.21.15.70:0/3729744451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ed8daecc60 con 0x55ed8dd857a0 2023-10-08T08:45:30.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.618+0000 7f6129ffb700 1 -- 172.21.15.70:0/3729744451 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6134020070 con 0x55ed8dd857a0 2023-10-08T08:45:30.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6129ffb700 1 -- 172.21.15.70:0/3729744451 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6134004810 con 0x55ed8dd857a0 2023-10-08T08:45:30.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6154ab0b80 10 client.25766 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6154ab0b80 10 client.25766 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-10-08T08:45:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6154ab0b80 20 client.25766 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55ed8ddf8c30 0x55ed8ddfb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6154ab0b80 4 client.25766 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:45:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6154ab0b80 1 -- 172.21.15.70:0/3729744451 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ed8dcd1b30 con 0x55ed8ddf8c30 2023-10-08T08:45:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f614259c700 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55ed8ddf8c30 0x55ed8ddfb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6129ffb700 10 client.25766 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:45:30.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f614259c700 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55ed8ddf8c30 0x55ed8ddfb050 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b98b05ddc63317af server_cookie=bc534afa8f74ebec in_seq=0 out_seq=0 2023-10-08T08:45:30.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6129ffb700 1 -- 172.21.15.70:0/3729744451 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ed8dcd1b30 con 0x55ed8ddf8c30 2023-10-08T08:45:30.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6129ffb700 10 client.25766 handle_command_reply: tid=0 2023-10-08T08:45:30.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6154ab0b80 1 client.25766 shutdown 2023-10-08T08:45:30.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6154ab0b80 1 -- 172.21.15.70:0/3729744451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 msgr2=0x55ed8dd993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.619+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd993e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6134010010 tx=0x7f6134005d70 comp rx=0 tx=0).stop 2023-10-08T08:45:30.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6154ab0b80 1 -- 172.21.15.70:0/3729744451 shutdown_connections 2023-10-08T08:45:30.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x55ed8ddf8c30 0x55ed8ddfb050 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8dd94a60 0x55ed8ddf7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6129ffb700 0 client.25766 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:45:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8dd84e80 0x55ed8dd98ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6154ab0b80 1 --2- 172.21.15.70:0/3729744451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8dd857a0 0x55ed8dd993e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6154ab0b80 1 -- 172.21.15.70:0/3729744451 >> 172.21.15.70:0/3729744451 conn(0x55ed8dcfa260 msgr2=0x55ed8dd8cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6154ab0b80 1 -- 172.21.15.70:0/3729744451 shutdown_connections 2023-10-08T08:45:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6154ab0b80 1 -- 172.21.15.70:0/3729744451 wait complete. 2023-10-08T08:45:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f6154ab0b80 20 client.25766 trim_cache size 0 max 16384 2023-10-08T08:45:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:45:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 -- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f612c0a15f0 msgr2=0x7f612c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f612c0a15f0 0x7f612c0a3ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6144197bb0 tx=0x7f613400a300 comp rx=0 tx=0).stop 2023-10-08T08:45:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 -- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61440ffd90 msgr2=0x7f614419c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61440ffd90 0x7f614419c8c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6138000c00 tx=0x7f6138004730 comp rx=0 tx=0).stop 2023-10-08T08:45:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 -- 172.21.15.70:0/1213619593 shutdown_connections 2023-10-08T08:45:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f612c0a15f0 0x7f612c0a3ab0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6144105630 0x7f61441969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61440ffd90 0x7f614419c8c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 --2- 172.21.15.70:0/1213619593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6144100750 0x7f614419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 -- 172.21.15.70:0/1213619593 >> 172.21.15.70:0/1213619593 conn(0x7f6144075c20 msgr2=0x7f61440fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 -- 172.21.15.70:0/1213619593 shutdown_connections 2023-10-08T08:45:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.620+0000 7f61488c7700 1 -- 172.21.15.70:0/1213619593 wait complete. 2023-10-08T08:45:30.642 INFO:tasks.workunit.client.0.smithi070.stdout:2/355: creat df/d12/f71 x:0 0 0 2023-10-08T08:45:30.642 INFO:tasks.workunit.client.0.smithi070.stdout:2/356: dread - df/f59 zero size 2023-10-08T08:45:30.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T08:45:30.645 INFO:tasks.workunit.client.0.smithi070.stdout:1/336: link d6/f1b d6/dc/d14/d1f/d63/f6a 0 2023-10-08T08:45:30.645 INFO:tasks.workunit.client.0.smithi070.stdout:1/337: rmdir d6/dc/d68 0 2023-10-08T08:45:30.645 INFO:tasks.workunit.client.0.smithi070.stdout:1/338: truncate d6/dc/d14/d1f/f45 766728 0 2023-10-08T08:45:30.645 INFO:tasks.workunit.client.0.smithi070.stdout:1/339: mknod d6/dc/d14/d1f/d63/c6b 0 2023-10-08T08:45:30.645 INFO:tasks.workunit.client.0.smithi070.stdout:1/340: write d6/dc/d14/d1f/d26/f4d [5012600,11615] 0 2023-10-08T08:45:30.645 INFO:tasks.workunit.client.0.smithi070.stdout:1/341: truncate d6/dc/d14/d1f/d29/f2f 4782877 0 2023-10-08T08:45:30.646 INFO:tasks.workunit.client.0.smithi070.stdout:1/342: chown d6/dc/d14/d1f/f45 5936134 1 2023-10-08T08:45:30.646 INFO:tasks.workunit.client.0.smithi070.stdout:1/343: readlink d6/lf 0 2023-10-08T08:45:30.646 INFO:tasks.workunit.client.0.smithi070.stdout:1/344: readlink d6/dc/d14/l64 0 2023-10-08T08:45:30.646 INFO:tasks.workunit.client.0.smithi070.stdout:1/345: rename l3 to d6/dc/d14/d1f/d26/d38/d4b/l6c 0 2023-10-08T08:45:30.646 INFO:tasks.workunit.client.0.smithi070.stdout:1/346: truncate d6/dc/d14/d1f/d26/f31 1276948 0 2023-10-08T08:45:30.648 INFO:tasks.workunit.client.0.smithi070.stdout:2/357: truncate df/d12/d15/f42 320829 0 2023-10-08T08:45:30.672 INFO:tasks.workunit.client.0.smithi070.stdout:1/347: dwrite d6/f52 [0,4194304] 0 2023-10-08T08:45:30.672 INFO:tasks.workunit.client.0.smithi070.stdout:1/348: truncate d6/dc/f54 4777562 0 2023-10-08T08:45:30.672 INFO:tasks.workunit.client.0.smithi070.stdout:2/358: dwrite df/d12/d15/d54/f5a [0,4194304] 0 2023-10-08T08:45:30.678 INFO:tasks.workunit.client.0.smithi070.stdout:1/349: read d6/dc/d14/d1f/d26/d38/f4e [2915600,103278] 0 2023-10-08T08:45:30.697 INFO:tasks.workunit.client.0.smithi070.stdout:2/359: dwrite df/d12/d15/f41 [0,4194304] 0 2023-10-08T08:45:30.699 INFO:tasks.workunit.client.0.smithi070.stdout:2/360: unlink df/d12/f46 0 2023-10-08T08:45:30.699 INFO:tasks.workunit.client.0.smithi070.stdout:2/361: truncate df/d12/d15/f17 4578146 0 2023-10-08T08:45:30.702 INFO:tasks.workunit.client.0.smithi070.stdout:2/362: link df/f59 df/d12/d25/f72 0 2023-10-08T08:45:30.703 INFO:tasks.workunit.client.0.smithi070.stdout:1/350: dwrite d6/dc/d14/d1f/d26/f4d [0,4194304] 0 2023-10-08T08:45:30.708 INFO:tasks.workunit.client.0.smithi070.stdout:1/351: rename d6/dc/d14/c16 to d6/dc/d14/d1f/d29/c6d 0 2023-10-08T08:45:30.708 INFO:tasks.workunit.client.0.smithi070.stdout:1/352: chown d6/f18 670 1 2023-10-08T08:45:30.709 INFO:tasks.workunit.client.0.smithi070.stdout:1/353: creat d6/dc/d14/d62/f6e x:0 0 0 2023-10-08T08:45:30.709 INFO:tasks.workunit.client.0.smithi070.stdout:1/354: chown d6/dc/d14/d1f/d29/c41 2015211318 1 2023-10-08T08:45:30.723 INFO:tasks.workunit.client.0.smithi070.stdout:2/363: dwrite df/f20 [0,4194304] 0 2023-10-08T08:45:30.729 INFO:tasks.workunit.client.0.smithi070.stdout:1/355: dwrite d6/dc/d14/d1f/f25 [0,4194304] 0 2023-10-08T08:45:30.729 INFO:tasks.workunit.client.0.smithi070.stdout:1/356: rename d6/dc/d14/d1f/d26 to d6/dc/d14/d1f/d26/d6f 22 2023-10-08T08:45:30.738 INFO:tasks.workunit.client.0.smithi070.stdout:1/357: dread d6/f18 [0,4194304] 0 2023-10-08T08:45:30.744 INFO:tasks.workunit.client.0.smithi070.stdout:2/364: rmdir df/d4c 39 2023-10-08T08:45:30.745 INFO:tasks.workunit.client.0.smithi070.stdout:1/358: mkdir d6/dc/d14/d70 0 2023-10-08T08:45:30.746 INFO:tasks.workunit.client.0.smithi070.stdout:2/365: write df/d12/f37 [509997,97738] 0 2023-10-08T08:45:30.746 INFO:tasks.workunit.client.0.smithi070.stdout:1/359: write d6/dc/d14/d1f/d63/f6a [423470,81023] 0 2023-10-08T08:45:30.747 INFO:tasks.workunit.client.0.smithi070.stdout:2/366: mkdir df/d73 0 2023-10-08T08:45:30.748 INFO:tasks.workunit.client.0.smithi070.stdout:1/360: creat d6/dc/d14/f71 x:0 0 0 2023-10-08T08:45:30.749 INFO:tasks.workunit.client.0.smithi070.stdout:2/367: unlink df/d12/d1b/f1e 0 2023-10-08T08:45:30.750 INFO:tasks.workunit.client.0.smithi070.stdout:1/361: rename d6/f28 to d6/dc/d14/d1f/f72 0 2023-10-08T08:45:30.751 INFO:tasks.workunit.client.0.smithi070.stdout:1/362: mknod d6/dc/d14/d1f/c73 0 2023-10-08T08:45:30.754 INFO:tasks.workunit.client.0.smithi070.stdout:2/368: dread df/d3a/f4b [0,4194304] 0 2023-10-08T08:45:30.754 INFO:tasks.workunit.client.0.smithi070.stdout:2/369: write df/d12/d25/f44 [403940,41674] 0 2023-10-08T08:45:30.773 INFO:tasks.workunit.client.0.smithi070.stdout:2/370: write df/d12/d15/f41 [1147176,117844] 0 2023-10-08T08:45:30.774 INFO:tasks.workunit.client.0.smithi070.stdout:1/363: dwrite d6/dc/d14/d1f/d29/f2f [0,4194304] 0 2023-10-08T08:45:30.779 INFO:tasks.workunit.client.0.smithi070.stdout:2/371: symlink df/d12/d15/d34/d65/l74 0 2023-10-08T08:45:30.780 INFO:tasks.workunit.client.0.smithi070.stdout:2/372: symlink df/d12/d1b/l75 0 2023-10-08T08:45:30.781 INFO:tasks.workunit.client.0.smithi070.stdout:2/373: chown df/d12/d1b/d1c/d69 796 1 2023-10-08T08:45:30.793 INFO:tasks.workunit.client.0.smithi070.stdout:1/364: dwrite d6/dc/d14/d1f/d26/f31 [0,4194304] 0 2023-10-08T08:45:30.801 INFO:tasks.workunit.client.0.smithi070.stdout:1/365: creat d6/dc/d14/d1f/d26/d38/f74 x:0 0 0 2023-10-08T08:45:30.802 INFO:tasks.workunit.client.0.smithi070.stdout:1/366: unlink d6/f10 0 2023-10-08T08:45:30.802 INFO:tasks.workunit.client.0.smithi070.stdout:1/367: chown d6/dc/d14/d1f/d29/c6d 8859 1 2023-10-08T08:45:30.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.802+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2589342593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 msgr2=0x7f22d40ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.802+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2589342593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 0x7f22d40ffaa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009990 tx=0x7f22c8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.802+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2589342593 shutdown_connections 2023-10-08T08:45:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.802+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2589342593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d40fffe0 0x7f22d410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.802+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2589342593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22d41056b0 0x7f22d4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.802+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2589342593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 0x7f22d40ffaa0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.802+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2589342593 >> 172.21.15.70:0/2589342593 conn(0x7f22d4076780 msgr2=0x7f22d4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.802+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2589342593 shutdown_connections 2023-10-08T08:45:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.802+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2589342593 wait complete. 2023-10-08T08:45:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d9ef8700 1 Processor -- start 2023-10-08T08:45:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d9ef8700 1 -- start start 2023-10-08T08:45:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d9ef8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 0x7f22d4195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d9ef8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d40fffe0 0x7f22d4195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d9ef8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22d41056b0 0x7f22d419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d9ef8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d419a900 con 0x7f22d40ff620 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d9ef8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d419aa70 con 0x7f22d40fffe0 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d9ef8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d419ac30 con 0x7f22d41056b0 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 0x7f22d4195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.803+0000 7f22d37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 0x7f22d4195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52584/0 (socket says 172.21.15.70:52584) 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d37fe700 1 -- 172.21.15.70:0/2980645352 learned_addr learned my addr 172.21.15.70:0/2980645352 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d40fffe0 0x7f22d4195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d3fff700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22d41056b0 0x7f22d419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d37fe700 1 -- 172.21.15.70:0/2980645352 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22d41056b0 msgr2=0x7f22d419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d37fe700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22d41056b0 0x7f22d419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d37fe700 1 -- 172.21.15.70:0/2980645352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d40fffe0 msgr2=0x7f22d4195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d37fe700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d40fffe0 0x7f22d4195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d37fe700 1 -- 172.21.15.70:0/2980645352 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c80095f0 con 0x7f22d40ff620 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d37fe700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 0x7f22d4195a20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f22c400ea60 tx=0x7f22c400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d0ff9700 1 -- 172.21.15.70:0/2980645352 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4013070 con 0x7f22d40ff620 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d0ff9700 1 -- 172.21.15.70:0/2980645352 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22c400be80 con 0x7f22d40ff620 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2980645352 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d419af10 con 0x7f22d40ff620 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d0ff9700 1 -- 172.21.15.70:0/2980645352 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4003ae0 con 0x7f22d40ff620 2023-10-08T08:45:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.804+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2980645352 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d4067a10 con 0x7f22d40ff620 2023-10-08T08:45:30.809 INFO:tasks.workunit.client.0.smithi070.stdout:1/368: rename d6/dc/d14/d1f/d29 to d6/dc/d14/d1f/d75 0 2023-10-08T08:45:30.809 INFO:tasks.workunit.client.0.smithi070.stdout:1/369: dread - d6/dc/d14/d1f/d26/f51 zero size 2023-10-08T08:45:30.809 INFO:tasks.workunit.client.0.smithi070.stdout:1/370: symlink d6/dc/d14/d1f/d26/d38/d4b/l76 0 2023-10-08T08:45:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.807+0000 7f22d0ff9700 1 -- 172.21.15.70:0/2980645352 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f22c40041c0 con 0x7f22d40ff620 2023-10-08T08:45:30.810 INFO:tasks.workunit.client.0.smithi070.stdout:1/371: creat d6/dc/d14/d62/f77 x:0 0 0 2023-10-08T08:45:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.807+0000 7f22d0ff9700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22bc0a1670 0x7f22bc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.807+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22bc0a1670 0x7f22bc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.807+0000 7f22d0ff9700 1 -- 172.21.15.70:0/2980645352 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f22c40ceb60 con 0x7f22d40ff620 2023-10-08T08:45:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22e60e1b80 1 Processor -- start 2023-10-08T08:45:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22bc0a1670 0x7f22bc0a3b30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f22d4196f70 tx=0x7f22c8005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.811 INFO:tasks.workunit.client.0.smithi070.stdout:1/372: truncate d6/dc/d14/d1f/d26/f4d 3532039 0 2023-10-08T08:45:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22e60e1b80 1 -- start start 2023-10-08T08:45:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c35190260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c3519f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c351a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c350f9460 con 0x557c351907a0 2023-10-08T08:45:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c350eac20 con 0x557c3518fe80 2023-10-08T08:45:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c350e8540 con 0x557c3519fa60 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d2ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c3519f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d3fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c351a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d2ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c3519f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52594/0 (socket says 172.21.15.70:52594) 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d2ffd700 1 -- 172.21.15.70:0/979204714 learned_addr learned my addr 172.21.15.70:0/979204714 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d37fe700 1 --2- 172.21.15.70:0/979204714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c35190260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d2ffd700 1 -- 172.21.15.70:0/979204714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 msgr2=0x557c351a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/979204714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c351a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d2ffd700 1 -- 172.21.15.70:0/979204714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 msgr2=0x557c35190260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/979204714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c35190260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d2ffd700 1 -- 172.21.15.70:0/979204714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c34f0ede0 con 0x557c351907a0 2023-10-08T08:45:30.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.808+0000 7f22d37fe700 1 --2- 172.21.15.70:0/979204714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c35190260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:45:30.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.809+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/979204714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c3519f520 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009990 tx=0x7f22c8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256cf9f4956907dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.809+0000 7f22b9ffb700 1 -- 172.21.15.70:0/979204714 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8004700 con 0x557c351907a0 2023-10-08T08:45:30.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.809+0000 7f22b9ffb700 1 -- 172.21.15.70:0/979204714 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22c801e040 con 0x557c351907a0 2023-10-08T08:45:30.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.809+0000 7f22b9ffb700 1 -- 172.21.15.70:0/979204714 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800fa50 con 0x557c351907a0 2023-10-08T08:45:30.815 INFO:tasks.workunit.client.0.smithi070.stdout:1/373: symlink d6/dc/d14/d1f/d26/d38/d4b/l78 0 2023-10-08T08:45:30.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 -- 172.21.15.70:0/979204714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 msgr2=0x557c3519f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/979204714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c3519f520 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009990 tx=0x7f22c8020000 comp rx=0 tx=0).stop 2023-10-08T08:45:30.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 -- 172.21.15.70:0/979204714 shutdown_connections 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/979204714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c351a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/979204714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c35190260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/979204714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c3519f520 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 -- 172.21.15.70:0/979204714 >> 172.21.15.70:0/979204714 conn(0x557c35105260 msgr2=0x557c3518c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 -- 172.21.15.70:0/979204714 shutdown_connections 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 -- 172.21.15.70:0/979204714 wait complete. 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 -- start start 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.810+0000 7f22e60e1b80 1 Processor -- start 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c3519f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c3519c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c3519cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c350e3e30 con 0x557c3518fe80 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c35080710 con 0x557c351907a0 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c350803b0 con 0x557c3519fa60 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 10 client.0 _ll_register_callbacks cb 0x557c34edd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c3519f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c3519f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52598/0 (socket says 172.21.15.70:52598) 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d37fe700 1 -- 172.21.15.70:0/3996063647 learned_addr learned my addr 172.21.15.70:0/3996063647 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d3fff700 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c3519cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c3519c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d37fe700 1 -- 172.21.15.70:0/3996063647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 msgr2=0x557c3519cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d37fe700 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c3519cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d37fe700 1 -- 172.21.15.70:0/3996063647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 msgr2=0x557c3519c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d37fe700 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c3519c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d37fe700 1 -- 172.21.15.70:0/3996063647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d410cde0 con 0x557c3518fe80 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c3519c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22d37fe700 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c3519f490 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f22c40982e0 tx=0x7f22c409c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affa3d0eeb971509 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22b2ffd700 1 -- 172.21.15.70:0/3996063647 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c40862c0 con 0x557c3518fe80 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22b2ffd700 1 -- 172.21.15.70:0/3996063647 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f22c409f9c0 con 0x557c3518fe80 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 1 -- 172.21.15.70:0/3996063647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c350abeb0 con 0x557c3518fe80 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22b2ffd700 1 -- 172.21.15.70:0/3996063647 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22c40b4150 con 0x557c3518fe80 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 10 client.16356 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.811+0000 7f22e60e1b80 1 -- 172.21.15.70:0/3996063647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x557c34ef7c60 con 0x557c3518fe80 2023-10-08T08:45:30.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22b2ffd700 1 -- 172.21.15.70:0/3996063647 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557c350abeb0 con 0x557c3518fe80 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22b2ffd700 1 -- 172.21.15.70:0/3996063647 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f22c40a3870 con 0x557c3518fe80 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22e60e1b80 10 client.16356 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22e60e1b80 10 client.16356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22e60e1b80 20 client.16356 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557c351af560 0x557c351b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22e60e1b80 4 client.16356 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22e60e1b80 1 -- 172.21.15.70:0/3996063647 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c350dce10 con 0x557c351af560 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557c351af560 0x557c351b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22b2ffd700 10 client.16356 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.812+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557c351af560 0x557c351b1980 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f35b4e6814efd5 server_cookie=ef1bbf9dd1170513 in_seq=0 out_seq=0 2023-10-08T08:45:30.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22b2ffd700 1 -- 172.21.15.70:0/3996063647 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557c350dce10 con 0x557c351af560 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22b2ffd700 10 client.16356 handle_command_reply: tid=0 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 client.16356 shutdown 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 -- 172.21.15.70:0/3996063647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 msgr2=0x557c3519f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c3519f490 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f22c40982e0 tx=0x7f22c409c0b0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 -- 172.21.15.70:0/3996063647 shutdown_connections 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c3519cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c3519f490 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557c351af560 0x557c351b1980 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/3996063647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c3519c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 -- 172.21.15.70:0/3996063647 >> 172.21.15.70:0/3996063647 conn(0x557c35105260 msgr2=0x557c3518bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22b2ffd700 0 client.16356 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:30.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 -- 172.21.15.70:0/3996063647 shutdown_connections 2023-10-08T08:45:30.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.813+0000 7f22e60e1b80 1 -- 172.21.15.70:0/3996063647 wait complete. 2023-10-08T08:45:30.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.814+0000 7f22e60e1b80 20 client.16356 trim_cache size 0 max 16384 2023-10-08T08:45:30.825 INFO:tasks.workunit.client.0.smithi070.stdout:1/374: dread d6/dc/d14/d1f/d26/d38/f4e [0,4194304] 0 2023-10-08T08:45:30.825 INFO:tasks.workunit.client.0.smithi070.stdout:1/375: symlink d6/dc/d14/d70/l79 0 2023-10-08T08:45:30.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22e60e1b80 1 Processor -- start 2023-10-08T08:45:30.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22e60e1b80 1 -- start start 2023-10-08T08:45:30.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c351a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c351a6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c35197b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c34f64920 con 0x557c351907a0 2023-10-08T08:45:30.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3519dd50 con 0x557c3518fe80 2023-10-08T08:45:30.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c35186570 con 0x557c3519fa60 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d2ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c351a6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d2ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c351a6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52606/0 (socket says 172.21.15.70:52606) 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d2ffd700 1 -- 172.21.15.70:0/2655317487 learned_addr learned my addr 172.21.15.70:0/2655317487 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d37fe700 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c351a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d3fff700 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c35197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d2ffd700 1 -- 172.21.15.70:0/2655317487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 msgr2=0x557c35197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c35197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d2ffd700 1 -- 172.21.15.70:0/2655317487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 msgr2=0x557c351a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c351a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d2ffd700 1 -- 172.21.15.70:0/2655317487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c34f35250 con 0x557c351907a0 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d37fe700 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c351a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:30.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.828+0000 7f22d3fff700 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c35197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:45:30.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.829+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c351a6550 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f22c8000c00 tx=0x7f22c801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741180c981f8160c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.829+0000 7f22ba7fc700 1 -- 172.21.15.70:0/2655317487 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c803dad0 con 0x557c351907a0 2023-10-08T08:45:30.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.829+0000 7f22ba7fc700 1 -- 172.21.15.70:0/2655317487 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22c803dc30 con 0x557c351907a0 2023-10-08T08:45:30.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.829+0000 7f22ba7fc700 1 -- 172.21.15.70:0/2655317487 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8004be0 con 0x557c351907a0 2023-10-08T08:45:30.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.829+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2655317487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 msgr2=0x557c351a6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.829+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c351a6550 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f22c8000c00 tx=0x7f22c801a040 comp rx=0 tx=0).stop 2023-10-08T08:45:30.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2655317487 shutdown_connections 2023-10-08T08:45:30.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c35197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c3518fe80 0x557c351a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2655317487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c351907a0 0x557c351a6550 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2655317487 >> 172.21.15.70:0/2655317487 conn(0x557c35105260 msgr2=0x557c3518b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2655317487 shutdown_connections 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2655317487 wait complete. 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 -- start start 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 Processor -- start 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c351a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c351a6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c351a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c351a49d0 con 0x557c3518fe80 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c351a4b40 con 0x557c351907a0 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c351a4d00 con 0x557c3519fa60 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.830+0000 7f22e60e1b80 10 client.0 _ll_register_callbacks cb 0x7f22c409b1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c351a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c351a5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52610/0 (socket says 172.21.15.70:52610) 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d37fe700 1 -- 172.21.15.70:0/2159302762 learned_addr learned my addr 172.21.15.70:0/2159302762 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c351a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d3fff700 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c351a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d2ffd700 1 -- 172.21.15.70:0/2159302762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 msgr2=0x557c351a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c351a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d2ffd700 1 -- 172.21.15.70:0/2159302762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 msgr2=0x557c351a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c351a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d2ffd700 1 -- 172.21.15.70:0/2159302762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c34ef7c60 con 0x557c351907a0 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d37fe700 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c351a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22d2ffd700 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c351a6360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22c8032040 tx=0x7f22c800b380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f273ed666801ddf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:30.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22b2ffd700 1 -- 172.21.15.70:0/2159302762 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c803d370 con 0x557c351907a0 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2159302762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22c801e040 con 0x557c351907a0 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22b2ffd700 1 -- 172.21.15.70:0/2159302762 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f22c803d4d0 con 0x557c351907a0 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22b2ffd700 1 -- 172.21.15.70:0/2159302762 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22c8004840 con 0x557c351907a0 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22e60e1b80 10 client.25781 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.831+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2159302762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x557c34f0ede0 con 0x557c351907a0 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22b2ffd700 1 -- 172.21.15.70:0/2159302762 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22c801e040 con 0x557c351907a0 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22b2ffd700 1 -- 172.21.15.70:0/2159302762 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f22c804f080 con 0x557c351907a0 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22e60e1b80 10 client.25781 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22e60e1b80 10 client.25781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22e60e1b80 20 client.25781 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:30.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557c352040d0 0x557c352064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22e60e1b80 4 client.25781 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2159302762 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557c350dcb30 con 0x557c352040d0 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22d37fe700 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557c352040d0 0x557c352064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22b2ffd700 10 client.25781 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22d37fe700 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557c352040d0 0x557c352064f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9247f00818a1dbe7 server_cookie=d5d3b7dba64be3c5 in_seq=0 out_seq=0 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22b2ffd700 1 -- 172.21.15.70:0/2159302762 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557c350dcb30 con 0x557c352040d0 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22b2ffd700 10 client.25781 handle_command_reply: tid=0 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.832+0000 7f22e60e1b80 1 client.25781 shutdown 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2159302762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 msgr2=0x557c351a6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c351a6360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22c8032040 tx=0x7f22c800b380 comp rx=0 tx=0).stop 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2159302762 shutdown_connections 2023-10-08T08:45:30.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557c3519fa60 0x557c351a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c3518fe80 0x557c351a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557c352040d0 0x557c352064f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 --2- 172.21.15.70:0/2159302762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c351907a0 0x557c351a6360 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22b2ffd700 0 client.25781 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:30.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2159302762 >> 172.21.15.70:0/2159302762 conn(0x557c35105260 msgr2=0x557c35197b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2159302762 shutdown_connections 2023-10-08T08:45:30.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 1 -- 172.21.15.70:0/2159302762 wait complete. 2023-10-08T08:45:30.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22e60e1b80 20 client.25781 trim_cache size 0 max 16384 2023-10-08T08:45:30.841 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:45:30.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22bc0a1670 msgr2=0x7f22bc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22bc0a1670 0x7f22bc0a3b30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f22d4196f70 tx=0x7f22c8005fd0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 msgr2=0x7f22d4195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:30.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 0x7f22d4195a20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f22c400ea60 tx=0x7f22c400ed70 comp rx=0 tx=0).stop 2023-10-08T08:45:30.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2980645352 shutdown_connections 2023-10-08T08:45:30.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22bc0a1670 0x7f22bc0a3b30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22d41056b0 0x7f22d419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d40ff620 0x7f22d4195a20 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 --2- 172.21.15.70:0/2980645352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d40fffe0 0x7f22d4195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:30.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2980645352 >> 172.21.15.70:0/2980645352 conn(0x7f22d4076780 msgr2=0x7f22d40fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:30.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2980645352 shutdown_connections 2023-10-08T08:45:30.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:30.833+0000 7f22d9ef8700 1 -- 172.21.15.70:0/2980645352 wait complete. 2023-10-08T08:45:30.843 INFO:tasks.workunit.client.0.smithi070.stdout:1/376: dwrite d6/dc/f2d [0,4194304] 0 2023-10-08T08:45:30.878 INFO:tasks.workunit.client.0.smithi070.stdout:1/377: dwrite d6/dc/d14/d1f/d26/f31 [0,4194304] 0 2023-10-08T08:45:30.880 INFO:tasks.workunit.client.0.smithi070.stdout:1/378: rename d6/dc/d14/d1f/d63/c6b to d6/dc/d14/d70/c7a 0 2023-10-08T08:45:30.880 INFO:tasks.workunit.client.0.smithi070.stdout:1/379: dread - d6/dc/d14/d1f/d75/f50 zero size 2023-10-08T08:45:30.881 INFO:tasks.workunit.client.0.smithi070.stdout:1/380: symlink d6/dc/d14/d1f/l7b 0 2023-10-08T08:45:30.882 INFO:tasks.workunit.client.0.smithi070.stdout:1/381: unlink d6/dc/l53 0 2023-10-08T08:45:30.883 INFO:tasks.workunit.client.0.smithi070.stdout:1/382: truncate d6/f18 168709 0 2023-10-08T08:45:30.914 INFO:tasks.workunit.client.0.smithi070.stdout:1/383: truncate d6/dc/d14/d1f/d26/f4d 319206 0 2023-10-08T08:45:30.930 INFO:tasks.workunit.client.0.smithi070.stdout:1/384: dwrite d6/dc/d14/d62/f6e [0,4194304] 0 2023-10-08T08:45:30.930 INFO:tasks.workunit.client.0.smithi070.stdout:1/385: stat d6/dc/d14/d70/l79 0 2023-10-08T08:45:30.930 INFO:tasks.workunit.client.0.smithi070.stdout:1/386: write d6/dc/d14/d1f/d26/d38/f5f [561078,14188] 0 2023-10-08T08:45:30.933 INFO:tasks.workunit.client.0.smithi070.stdout:1/387: mknod d6/c7c 0 2023-10-08T08:45:30.934 INFO:tasks.workunit.client.0.smithi070.stdout:1/388: link d6/dc/d14/d1f/c3f d6/dc/d14/d1f/c7d 0 2023-10-08T08:45:30.935 INFO:tasks.workunit.client.0.smithi070.stdout:1/389: unlink d6/dc/d14/d1f/d26/l69 0 2023-10-08T08:45:30.936 INFO:tasks.workunit.client.0.smithi070.stdout:1/390: stat d6/f55 0 2023-10-08T08:45:30.936 INFO:tasks.workunit.client.0.smithi070.stdout:1/391: stat d6/dc/d14/d1f/d75/f2f 0 2023-10-08T08:45:30.936 INFO:tasks.workunit.client.0.smithi070.stdout:1/392: mkdir d6/dc/d14/d1f/d75/d7e 0 2023-10-08T08:45:30.937 INFO:tasks.workunit.client.0.smithi070.stdout:1/393: fdatasync d6/dc/f54 0 2023-10-08T08:45:30.937 INFO:tasks.workunit.client.0.smithi070.stdout:1/394: write d6/dc/d14/d1f/f4c [412334,20264] 0 2023-10-08T08:45:30.938 INFO:tasks.workunit.client.0.smithi070.stdout:1/395: creat d6/dc/d14/f7f x:0 0 0 2023-10-08T08:45:30.939 INFO:tasks.workunit.client.0.smithi070.stdout:1/396: creat d6/dc/d14/f80 x:0 0 0 2023-10-08T08:45:30.958 INFO:tasks.workunit.client.0.smithi070.stdout:1/397: dwrite d6/f55 [0,4194304] 0 2023-10-08T08:45:30.958 INFO:tasks.workunit.client.0.smithi070.stdout:1/398: truncate d6/f5e 53262 0 2023-10-08T08:45:30.958 INFO:tasks.workunit.client.0.smithi070.stdout:1/399: truncate d6/f65 116041 0 2023-10-08T08:45:30.960 INFO:tasks.workunit.client.0.smithi070.stdout:1/400: symlink d6/dc/d14/d1f/d63/l81 0 2023-10-08T08:45:30.962 INFO:tasks.workunit.client.0.smithi070.stdout:1/401: link d6/dc/c2a d6/c82 0 2023-10-08T08:45:30.963 INFO:tasks.workunit.client.0.smithi070.stdout:1/402: read d6/dc/d14/d1f/d26/d38/f4e [2615948,96943] 0 2023-10-08T08:45:30.963 INFO:tasks.workunit.client.0.smithi070.stdout:1/403: fdatasync d6/dc/f13 0 2023-10-08T08:45:30.963 INFO:tasks.workunit.client.0.smithi070.stdout:1/404: readlink d6/dc/d14/d1f/d63/l66 0 2023-10-08T08:45:31.061 INFO:tasks.workunit.client.0.smithi070.stdout:0/346: sync 2023-10-08T08:45:31.062 INFO:tasks.workunit.client.0.smithi070.stdout:4/270: sync 2023-10-08T08:45:31.062 INFO:tasks.workunit.client.0.smithi070.stdout:9/234: sync 2023-10-08T08:45:31.062 INFO:tasks.workunit.client.0.smithi070.stdout:4/271: dread - dc/d17/d1f/f36 zero size 2023-10-08T08:45:31.062 INFO:tasks.workunit.client.0.smithi070.stdout:4/272: fdatasync dc/d17/f2e 0 2023-10-08T08:45:31.062 INFO:tasks.workunit.client.0.smithi070.stdout:8/416: sync 2023-10-08T08:45:31.062 INFO:tasks.workunit.client.0.smithi070.stdout:6/293: sync 2023-10-08T08:45:31.062 INFO:tasks.workunit.client.0.smithi070.stdout:4/273: truncate dc/d17/d24/f49 105829 0 2023-10-08T08:45:31.062 INFO:tasks.workunit.client.0.smithi070.stdout:8/417: fdatasync d1/d2/f31 0 2023-10-08T08:45:31.063 INFO:tasks.workunit.client.0.smithi070.stdout:8/418: chown d1/d2/c39 1474265578 1 2023-10-08T08:45:31.063 INFO:tasks.workunit.client.0.smithi070.stdout:8/419: write d1/d2/d6/d22/d5c/f6f [2139735,78975] 0 2023-10-08T08:45:31.063 INFO:tasks.workunit.client.0.smithi070.stdout:8/420: write d1/d2/d6/d22/d5b/d74/f8b [95431,71571] 0 2023-10-08T08:45:31.063 INFO:tasks.workunit.client.0.smithi070.stdout:8/421: dread - d1/de/f4f zero size 2023-10-08T08:45:31.064 INFO:tasks.workunit.client.0.smithi070.stdout:0/347: mknod d1/d1d/d24/d47/d54/d5e/c60 0 2023-10-08T08:45:31.067 INFO:tasks.workunit.client.0.smithi070.stdout:6/294: rename df/d26/f35 to df/f61 0 2023-10-08T08:45:31.073 INFO:tasks.workunit.client.0.smithi070.stdout:9/235: dread d1/dd/d1a/f1c [0,4194304] 0 2023-10-08T08:45:31.074 INFO:tasks.workunit.client.0.smithi070.stdout:9/236: stat d1/dd/lf 0 2023-10-08T08:45:31.076 INFO:tasks.workunit.client.0.smithi070.stdout:0/348: dread d1/fb [0,4194304] 0 2023-10-08T08:45:31.076 INFO:tasks.workunit.client.0.smithi070.stdout:0/349: readlink d1/d1d/d24/l2a 0 2023-10-08T08:45:31.078 INFO:tasks.workunit.client.0.smithi070.stdout:9/237: mknod d1/dd/d1a/d40/c43 0 2023-10-08T08:45:31.079 INFO:tasks.workunit.client.0.smithi070.stdout:9/238: chown d1/dd/d19/l24 2517291 1 2023-10-08T08:45:31.081 INFO:tasks.workunit.client.0.smithi070.stdout:4/274: dwrite dc/f4b [0,4194304] 0 2023-10-08T08:45:31.082 INFO:tasks.workunit.client.0.smithi070.stdout:9/239: creat d1/dd/d26/d27/f44 x:0 0 0 2023-10-08T08:45:31.082 INFO:tasks.workunit.client.0.smithi070.stdout:0/350: unlink d1/d1d/l5b 0 2023-10-08T08:45:31.083 INFO:tasks.workunit.client.0.smithi070.stdout:0/351: symlink d1/d1d/l61 0 2023-10-08T08:45:31.095 INFO:tasks.workunit.client.0.smithi070.stdout:6/295: dwrite df/f15 [0,4194304] 0 2023-10-08T08:45:31.095 INFO:tasks.workunit.client.0.smithi070.stdout:6/296: stat df/d11/f1a 0 2023-10-08T08:45:31.095 INFO:tasks.workunit.client.0.smithi070.stdout:0/352: rename d1/d1d/d24/d47 to d1/d62 0 2023-10-08T08:45:31.098 INFO:tasks.workunit.client.0.smithi070.stdout:0/353: rename d1/d14/l32 to d1/d62/d54/d5e/l63 0 2023-10-08T08:45:31.098 INFO:tasks.workunit.client.0.smithi070.stdout:0/354: chown d1/d14/d1f/f28 10 1 2023-10-08T08:45:31.099 INFO:tasks.workunit.client.0.smithi070.stdout:0/355: stat d1/d1d/f52 0 2023-10-08T08:45:31.106 INFO:tasks.workunit.client.0.smithi070.stdout:8/422: dwrite d1/d4d/f81 [0,4194304] 0 2023-10-08T08:45:31.106 INFO:tasks.workunit.client.0.smithi070.stdout:4/275: dread dc/d17/d24/f40 [4194304,4194304] 0 2023-10-08T08:45:31.107 INFO:tasks.workunit.client.0.smithi070.stdout:6/297: creat df/d53/f62 x:0 0 0 2023-10-08T08:45:31.108 INFO:tasks.workunit.client.0.smithi070.stdout:4/276: symlink dc/d17/d24/d55/l5b 0 2023-10-08T08:45:31.108 INFO:tasks.workunit.client.0.smithi070.stdout:6/298: chown lb 6979 1 2023-10-08T08:45:31.109 INFO:tasks.workunit.client.0.smithi070.stdout:4/277: mknod dc/d17/d24/d37/c5c 0 2023-10-08T08:45:31.114 INFO:tasks.workunit.client.0.smithi070.stdout:6/299: creat df/d26/f63 x:0 0 0 2023-10-08T08:45:31.119 INFO:tasks.workunit.client.0.smithi070.stdout:6/300: write df/d26/d42/d4b/f56 [2780363,114333] 0 2023-10-08T08:45:31.124 INFO:tasks.workunit.client.0.smithi070.stdout:6/301: write f7 [858149,80625] 0 2023-10-08T08:45:31.128 INFO:tasks.workunit.client.0.smithi070.stdout:6/302: creat df/d26/d42/d4b/f64 x:0 0 0 2023-10-08T08:45:31.128 INFO:tasks.workunit.client.0.smithi070.stdout:6/303: truncate df/d26/d42/d43/f4e 269730 0 2023-10-08T08:45:31.131 INFO:tasks.workunit.client.0.smithi070.stdout:6/304: unlink df/f15 0 2023-10-08T08:45:31.133 INFO:tasks.workunit.client.0.smithi070.stdout:4/278: dwrite dc/f11 [0,4194304] 0 2023-10-08T08:45:31.133 INFO:tasks.workunit.client.0.smithi070.stdout:8/423: dwrite d1/de/f64 [4194304,4194304] 0 2023-10-08T08:45:31.133 INFO:tasks.workunit.client.0.smithi070.stdout:0/356: dwrite d1/dd/d1b/f33 [0,4194304] 0 2023-10-08T08:45:31.135 INFO:tasks.workunit.client.0.smithi070.stdout:6/305: creat df/d11/f65 x:0 0 0 2023-10-08T08:45:31.135 INFO:tasks.workunit.client.0.smithi070.stdout:6/306: write df/d26/f30 [101304,38526] 0 2023-10-08T08:45:31.135 INFO:tasks.workunit.client.0.smithi070.stdout:4/279: rename dc/f12 to dc/d17/d24/d4c/d4e/f5d 0 2023-10-08T08:45:31.136 INFO:tasks.workunit.client.0.smithi070.stdout:4/280: readlink dc/le 0 2023-10-08T08:45:31.136 INFO:tasks.workunit.client.0.smithi070.stdout:4/281: chown dc/d5a 209 1 2023-10-08T08:45:31.136 INFO:tasks.workunit.client.0.smithi070.stdout:4/282: write dc/d17/d1f/f26 [804240,67240] 0 2023-10-08T08:45:31.137 INFO:tasks.workunit.client.0.smithi070.stdout:4/283: mkdir dc/d17/d1f/d5e 0 2023-10-08T08:45:31.190 INFO:tasks.workunit.client.0.smithi070.stdout:8/424: dwrite d1/de/d1a/f66 [0,4194304] 0 2023-10-08T08:45:31.192 INFO:tasks.workunit.client.0.smithi070.stdout:0/357: dwrite d1/fa [0,4194304] 0 2023-10-08T08:45:31.193 INFO:tasks.workunit.client.0.smithi070.stdout:0/358: truncate d1/d1d/d4d/f5c 564165 0 2023-10-08T08:45:31.194 INFO:tasks.workunit.client.0.smithi070.stdout:0/359: mknod d1/d62/d54/d5e/c64 0 2023-10-08T08:45:31.194 INFO:tasks.workunit.client.0.smithi070.stdout:0/360: chown d1/d14/d1f/f4e 4019 1 2023-10-08T08:45:31.194 INFO:tasks.workunit.client.0.smithi070.stdout:0/361: write d1/d62/f55 [551612,44901] 0 2023-10-08T08:45:31.194 INFO:tasks.workunit.client.0.smithi070.stdout:0/362: truncate d1/f7 466489 0 2023-10-08T08:45:31.196 INFO:tasks.workunit.client.0.smithi070.stdout:0/363: read d1/d1d/d24/f4c [1595002,86631] 0 2023-10-08T08:45:31.196 INFO:tasks.workunit.client.0.smithi070.stdout:0/364: readlink d1/d62/l26 0 2023-10-08T08:45:31.199 INFO:tasks.workunit.client.0.smithi070.stdout:0/365: rmdir d1/d62/d54/d5e 39 2023-10-08T08:45:31.201 INFO:tasks.workunit.client.0.smithi070.stdout:0/366: symlink d1/d62/d38/l65 0 2023-10-08T08:45:31.204 INFO:tasks.workunit.client.0.smithi070.stdout:0/367: read d1/dd/d1b/f59 [3446530,100676] 0 2023-10-08T08:45:31.205 INFO:tasks.workunit.client.0.smithi070.stdout:0/368: dread d1/d1d/d4d/f5c [0,4194304] 0 2023-10-08T08:45:31.207 INFO:tasks.workunit.client.0.smithi070.stdout:0/369: link d1/d62/d54/f58 d1/d14/d1f/f66 0 2023-10-08T08:45:31.209 INFO:tasks.workunit.client.0.smithi070.stdout:8/425: dwrite d1/de/d2e/d45/d7b/f82 [0,4194304] 0 2023-10-08T08:45:31.209 INFO:tasks.workunit.client.0.smithi070.stdout:0/370: creat d1/d14/f67 x:0 0 0 2023-10-08T08:45:31.211 INFO:tasks.workunit.client.0.smithi070.stdout:0/371: rename d1/d62/l4a to d1/d1d/d4d/l68 0 2023-10-08T08:45:31.211 INFO:tasks.workunit.client.0.smithi070.stdout:8/426: dread d1/de/d2e/f48 [0,4194304] 0 2023-10-08T08:45:31.212 INFO:tasks.workunit.client.0.smithi070.stdout:8/427: creat d1/de/d3a/d56/f95 x:0 0 0 2023-10-08T08:45:31.213 INFO:tasks.workunit.client.0.smithi070.stdout:0/372: creat d1/d1d/f69 x:0 0 0 2023-10-08T08:45:31.214 INFO:tasks.workunit.client.0.smithi070.stdout:0/373: link d1/fa d1/d62/d38/f6a 0 2023-10-08T08:45:31.215 INFO:tasks.workunit.client.0.smithi070.stdout:0/374: truncate d1/dd/f16 4657607 0 2023-10-08T08:45:31.215 INFO:tasks.workunit.client.0.smithi070.stdout:0/375: write d1/d14/f43 [1326565,20574] 0 2023-10-08T08:45:31.215 INFO:tasks.workunit.client.0.smithi070.stdout:0/376: creat d1/f6b x:0 0 0 2023-10-08T08:45:31.219 INFO:tasks.workunit.client.0.smithi070.stdout:0/377: link d1/d14/d1f/f28 d1/dd/d1b/f6c 0 2023-10-08T08:45:31.219 INFO:tasks.workunit.client.0.smithi070.stdout:0/378: chown d1/d1d/d24/c44 255 1 2023-10-08T08:45:31.225 INFO:tasks.workunit.client.0.smithi070.stdout:8/428: dread d1/d2/d6/d22/d5c/f6f [0,4194304] 0 2023-10-08T08:45:31.226 INFO:tasks.workunit.client.0.smithi070.stdout:8/429: truncate d1/d2/f1e 894046 0 2023-10-08T08:45:31.226 INFO:tasks.workunit.client.0.smithi070.stdout:8/430: dread - d1/d2/d8c/f85 zero size 2023-10-08T08:45:31.226 INFO:tasks.workunit.client.0.smithi070.stdout:8/431: rmdir d1/de/d2e/d45 39 2023-10-08T08:45:31.243 INFO:tasks.workunit.client.0.smithi070.stdout:0/379: dwrite d1/dd/f53 [0,4194304] 0 2023-10-08T08:45:31.244 INFO:tasks.workunit.client.0.smithi070.stdout:0/380: symlink d1/d1d/d4d/l6d 0 2023-10-08T08:45:31.246 INFO:tasks.workunit.client.0.smithi070.stdout:0/381: rename d1/l49 to d1/d62/d54/d5e/l6e 0 2023-10-08T08:45:31.249 INFO:tasks.workunit.client.0.smithi070.stdout:8/432: dwrite d1/d2/d6/d22/f60 [0,4194304] 0 2023-10-08T08:45:31.249 INFO:tasks.workunit.client.0.smithi070.stdout:8/433: chown d1/d4d/f5f 6 1 2023-10-08T08:45:31.264 INFO:tasks.workunit.client.0.smithi070.stdout:0/382: dwrite d1/dd/f3d [0,4194304] 0 2023-10-08T08:45:31.265 INFO:tasks.workunit.client.0.smithi070.stdout:8/434: dwrite d1/fb [8388608,4194304] 0 2023-10-08T08:45:31.265 INFO:tasks.workunit.client.0.smithi070.stdout:8/435: chown d1/d2/d6/d22/d5c/f6f 3241613 1 2023-10-08T08:45:31.266 INFO:tasks.workunit.client.0.smithi070.stdout:8/436: chown d1/d2/d6/fa 766860 1 2023-10-08T08:45:31.266 INFO:tasks.workunit.client.0.smithi070.stdout:8/437: chown d1/de/d1a/l3e 5319530 1 2023-10-08T08:45:31.267 INFO:tasks.workunit.client.0.smithi070.stdout:0/383: mkdir d1/d14/d1f/d6f 0 2023-10-08T08:45:31.267 INFO:tasks.workunit.client.0.smithi070.stdout:0/384: creat d1/f70 x:0 0 0 2023-10-08T08:45:31.268 INFO:tasks.workunit.client.0.smithi070.stdout:8/438: mknod d1/de/d2e/d45/c96 0 2023-10-08T08:45:31.270 INFO:tasks.workunit.client.0.smithi070.stdout:8/439: symlink d1/d2/d6/d22/d5b/l97 0 2023-10-08T08:45:31.274 INFO:tasks.workunit.client.0.smithi070.stdout:8/440: creat d1/d2/d6/d22/f98 x:0 0 0 2023-10-08T08:45:31.275 INFO:tasks.workunit.client.0.smithi070.stdout:8/441: mkdir d1/d2/d6/d22/d5c/d99 0 2023-10-08T08:45:31.277 INFO:tasks.workunit.client.0.smithi070.stdout:8/442: write d1/de/d2e/f6e [2589819,9429] 0 2023-10-08T08:45:31.286 INFO:tasks.workunit.client.0.smithi070.stdout:0/385: dwrite d1/d14/d1f/f42 [0,4194304] 0 2023-10-08T08:45:31.288 INFO:tasks.workunit.client.0.smithi070.stdout:0/386: truncate d1/dd/f3d 3912852 0 2023-10-08T08:45:31.288 INFO:tasks.workunit.client.0.smithi070.stdout:0/387: chown d1/dd/l50 185 1 2023-10-08T08:45:31.288 INFO:tasks.workunit.client.0.smithi070.stdout:0/388: write d1/d1d/f51 [130234,110474] 0 2023-10-08T08:45:31.289 INFO:tasks.workunit.client.0.smithi070.stdout:0/389: write d1/d1d/d24/f36 [757094,88019] 0 2023-10-08T08:45:31.292 INFO:tasks.workunit.client.0.smithi070.stdout:0/390: rmdir d1/d62 39 2023-10-08T08:45:31.292 INFO:tasks.workunit.client.0.smithi070.stdout:0/391: readlink d1/dd/l2d 0 2023-10-08T08:45:31.295 INFO:tasks.workunit.client.0.smithi070.stdout:8/443: dread d1/de/d2e/f6e [0,4194304] 0 2023-10-08T08:45:31.295 INFO:tasks.workunit.client.0.smithi070.stdout:8/444: truncate d1/de/d3a/f63 3662234 0 2023-10-08T08:45:31.295 INFO:tasks.workunit.client.0.smithi070.stdout:0/392: creat d1/d1d/d24/f71 x:0 0 0 2023-10-08T08:45:31.296 INFO:tasks.workunit.client.0.smithi070.stdout:8/445: rmdir d1/d23 39 2023-10-08T08:45:31.296 INFO:tasks.workunit.client.0.smithi070.stdout:8/446: write d1/de/d3a/d56/f95 [498820,124731] 0 2023-10-08T08:45:31.296 INFO:tasks.workunit.client.0.smithi070.stdout:0/393: creat d1/d1d/d24/f72 x:0 0 0 2023-10-08T08:45:31.298 INFO:tasks.workunit.client.0.smithi070.stdout:0/394: creat d1/d62/d54/f73 x:0 0 0 2023-10-08T08:45:31.312 INFO:tasks.workunit.client.0.smithi070.stdout:8/447: dread d1/de/f64 [4194304,4194304] 0 2023-10-08T08:45:31.313 INFO:tasks.workunit.client.0.smithi070.stdout:8/448: write d1/de/d2e/d45/d7b/f82 [4309439,97735] 0 2023-10-08T08:45:31.313 INFO:tasks.workunit.client.0.smithi070.stdout:8/449: mknod d1/de/d2e/c9a 0 2023-10-08T08:45:31.315 INFO:tasks.workunit.client.0.smithi070.stdout:8/450: getdents d1/de/d3a/d56/d65 0 2023-10-08T08:45:31.317 INFO:tasks.workunit.client.0.smithi070.stdout:0/395: dwrite d1/d14/f67 [0,4194304] 0 2023-10-08T08:45:31.318 INFO:tasks.workunit.client.0.smithi070.stdout:0/396: write d1/d14/f67 [2205782,81977] 0 2023-10-08T08:45:31.319 INFO:tasks.workunit.client.0.smithi070.stdout:0/397: truncate d1/d14/d1f/f4e 4768778 0 2023-10-08T08:45:31.320 INFO:tasks.workunit.client.0.smithi070.stdout:8/451: dread d1/de/d3a/f63 [0,4194304] 0 2023-10-08T08:45:31.323 INFO:tasks.workunit.client.0.smithi070.stdout:0/398: dread d1/d1d/f2b [0,4194304] 0 2023-10-08T08:45:31.327 INFO:tasks.workunit.client.0.smithi070.stdout:0/399: getdents d1/dd 0 2023-10-08T08:45:31.329 INFO:tasks.workunit.client.0.smithi070.stdout:0/400: write d1/f57 [537782,83824] 0 2023-10-08T08:45:31.329 INFO:tasks.workunit.client.0.smithi070.stdout:0/401: truncate d1/d14/d1f/f4e 5787052 0 2023-10-08T08:45:31.330 INFO:tasks.workunit.client.0.smithi070.stdout:0/402: write d1/d1d/d24/f4c [3208263,20834] 0 2023-10-08T08:45:31.331 INFO:tasks.workunit.client.0.smithi070.stdout:0/403: symlink d1/d62/d38/l74 0 2023-10-08T08:45:31.356 INFO:tasks.workunit.client.0.smithi070.stdout:8/452: dwrite d1/d2/f31 [4194304,4194304] 0 2023-10-08T08:45:31.359 INFO:tasks.workunit.client.0.smithi070.stdout:8/453: mknod d1/de/d3a/d56/d65/c9b 0 2023-10-08T08:45:31.360 INFO:tasks.workunit.client.0.smithi070.stdout:8/454: creat d1/de/d2e/d45/d7b/f9c x:0 0 0 2023-10-08T08:45:31.370 INFO:tasks.workunit.client.0.smithi070.stdout:8/455: dread d1/d23/f28 [0,4194304] 0 2023-10-08T08:45:31.371 INFO:tasks.workunit.client.0.smithi070.stdout:8/456: creat d1/d2/d6/d22/d5c/d99/f9d x:0 0 0 2023-10-08T08:45:31.374 INFO:tasks.workunit.client.0.smithi070.stdout:8/457: write d1/de/f34 [3374636,49835] 0 2023-10-08T08:45:31.522 INFO:tasks.workunit.client.0.smithi070.stdout:5/367: sync 2023-10-08T08:45:31.522 INFO:tasks.workunit.client.0.smithi070.stdout:4/284: sync 2023-10-08T08:45:31.522 INFO:tasks.workunit.client.0.smithi070.stdout:1/405: sync 2023-10-08T08:45:31.523 INFO:tasks.workunit.client.0.smithi070.stdout:9/240: sync 2023-10-08T08:45:31.523 INFO:tasks.workunit.client.0.smithi070.stdout:1/406: stat d6/dc/d14/d70/l79 0 2023-10-08T08:45:31.523 INFO:tasks.workunit.client.0.smithi070.stdout:3/334: sync 2023-10-08T08:45:31.523 INFO:tasks.workunit.client.0.smithi070.stdout:7/381: sync 2023-10-08T08:45:31.523 INFO:tasks.workunit.client.0.smithi070.stdout:9/241: dread - d1/dd/d26/d27/d2d/f41 zero size 2023-10-08T08:45:31.523 INFO:tasks.workunit.client.0.smithi070.stdout:2/374: sync 2023-10-08T08:45:31.523 INFO:tasks.workunit.client.0.smithi070.stdout:0/404: sync 2023-10-08T08:45:31.523 INFO:tasks.workunit.client.0.smithi070.stdout:6/307: sync 2023-10-08T08:45:31.524 INFO:tasks.workunit.client.0.smithi070.stdout:4/285: rmdir dc/d17/d24/d4c/d4e 39 2023-10-08T08:45:31.524 INFO:tasks.workunit.client.0.smithi070.stdout:0/405: mknod d1/dd/c75 0 2023-10-08T08:45:31.524 INFO:tasks.workunit.client.0.smithi070.stdout:6/308: truncate df/f1b 226299 0 2023-10-08T08:45:31.524 INFO:tasks.workunit.client.0.smithi070.stdout:4/286: mkdir dc/d5f 0 2023-10-08T08:45:31.524 INFO:tasks.workunit.client.0.smithi070.stdout:6/309: chown df/d26/d42/d4b/f54 0 1 2023-10-08T08:45:31.525 INFO:tasks.workunit.client.0.smithi070.stdout:4/287: creat dc/d17/d24/d4c/f60 x:0 0 0 2023-10-08T08:45:31.525 INFO:tasks.workunit.client.0.smithi070.stdout:4/288: stat dc/d17/d24/l25 0 2023-10-08T08:45:31.525 INFO:tasks.workunit.client.0.smithi070.stdout:5/368: rename d5/d5f/d63/c73 to d5/d5f/d61/d30/c7d 0 2023-10-08T08:45:31.526 INFO:tasks.workunit.client.0.smithi070.stdout:6/310: truncate df/d11/f40 182220 0 2023-10-08T08:45:31.527 INFO:tasks.workunit.client.0.smithi070.stdout:3/335: mkdir d0/db/d10/d6d 0 2023-10-08T08:45:31.527 INFO:tasks.workunit.client.0.smithi070.stdout:9/242: link d1/dd/d19/l29 d1/dd/d1a/l45 0 2023-10-08T08:45:31.528 INFO:tasks.workunit.client.0.smithi070.stdout:5/369: symlink d5/d5f/l7e 0 2023-10-08T08:45:31.528 INFO:tasks.workunit.client.0.smithi070.stdout:9/243: creat d1/dd/d1a/d40/f46 x:0 0 0 2023-10-08T08:45:31.529 INFO:tasks.workunit.client.0.smithi070.stdout:6/311: creat df/d11/f66 x:0 0 0 2023-10-08T08:45:31.531 INFO:tasks.workunit.client.0.smithi070.stdout:3/336: write d0/d12/d14/f1c [94114,61338] 0 2023-10-08T08:45:31.531 INFO:tasks.workunit.client.0.smithi070.stdout:7/382: creat d3/d19/d1b/d4a/d50/f81 x:0 0 0 2023-10-08T08:45:31.531 INFO:tasks.workunit.client.0.smithi070.stdout:7/383: rename d3/d19/d1b/d1e to d3/d19/d1b/d1e/d76/d82 22 2023-10-08T08:45:31.532 INFO:tasks.workunit.client.0.smithi070.stdout:6/312: creat df/d53/f67 x:0 0 0 2023-10-08T08:45:31.532 INFO:tasks.workunit.client.0.smithi070.stdout:3/337: write d0/d12/d14/d1d/d22/f3b [424095,24263] 0 2023-10-08T08:45:31.532 INFO:tasks.workunit.client.0.smithi070.stdout:3/338: chown d0/d12/l43 3 1 2023-10-08T08:45:31.534 INFO:tasks.workunit.client.0.smithi070.stdout:7/384: link d3/d19/d1b/d4a/d50/f66 d3/d19/d1b/d4a/f83 0 2023-10-08T08:45:31.534 INFO:tasks.workunit.client.0.smithi070.stdout:7/385: truncate d3/d19/d1b/d1e/d4c/f80 53397 0 2023-10-08T08:45:31.535 INFO:tasks.workunit.client.0.smithi070.stdout:7/386: readlink d3/d19/l7c 0 2023-10-08T08:45:31.535 INFO:tasks.workunit.client.0.smithi070.stdout:5/370: dread d5/ff [4194304,4194304] 0 2023-10-08T08:45:31.535 INFO:tasks.workunit.client.0.smithi070.stdout:5/371: fdatasync d5/da/d4d/d37/d38/d55/f4f 0 2023-10-08T08:45:31.536 INFO:tasks.workunit.client.0.smithi070.stdout:6/313: creat df/d26/d42/d43/d4a/f68 x:0 0 0 2023-10-08T08:45:31.536 INFO:tasks.workunit.client.0.smithi070.stdout:6/314: dread - df/f61 zero size 2023-10-08T08:45:31.536 INFO:tasks.workunit.client.0.smithi070.stdout:6/315: chown df/d26/d42/d4b/f54 286030708 1 2023-10-08T08:45:31.538 INFO:tasks.workunit.client.0.smithi070.stdout:9/244: write d1/dd/d19/f1b [3435051,63649] 0 2023-10-08T08:45:31.539 INFO:tasks.workunit.client.0.smithi070.stdout:9/245: fdatasync d1/dd/f10 0 2023-10-08T08:45:31.541 INFO:tasks.workunit.client.0.smithi070.stdout:7/387: mknod d3/d19/d1b/d4a/d9/c84 0 2023-10-08T08:45:31.541 INFO:tasks.workunit.client.0.smithi070.stdout:5/372: mknod d5/da/d4d/d37/d38/c7f 0 2023-10-08T08:45:31.546 INFO:tasks.workunit.client.0.smithi070.stdout:1/407: dwrite d6/dc/d14/d1f/f3d [0,4194304] 0 2023-10-08T08:45:31.547 INFO:tasks.workunit.client.0.smithi070.stdout:7/388: unlink d3/d19/d1b/d4a/d50/c6c 0 2023-10-08T08:45:31.548 INFO:tasks.workunit.client.0.smithi070.stdout:4/289: dread dc/f4d [0,4194304] 0 2023-10-08T08:45:31.549 INFO:tasks.workunit.client.0.smithi070.stdout:4/290: fsync dc/f11 0 2023-10-08T08:45:31.549 INFO:tasks.workunit.client.0.smithi070.stdout:4/291: stat dc/c4a 0 2023-10-08T08:45:31.549 INFO:tasks.workunit.client.0.smithi070.stdout:4/292: write dc/d17/d24/d37/f3a [350546,47293] 0 2023-10-08T08:45:31.549 INFO:tasks.workunit.client.0.smithi070.stdout:4/293: write dc/d17/d24/d37/f3a [65181,116272] 0 2023-10-08T08:45:31.549 INFO:tasks.workunit.client.0.smithi070.stdout:4/294: getdents dc/d17/d1f/d5e 0 2023-10-08T08:45:31.550 INFO:tasks.workunit.client.0.smithi070.stdout:4/295: creat dc/f61 x:0 0 0 2023-10-08T08:45:31.550 INFO:tasks.workunit.client.0.smithi070.stdout:6/316: mknod df/d26/d42/d43/c69 0 2023-10-08T08:45:31.552 INFO:tasks.workunit.client.0.smithi070.stdout:4/296: mknod dc/d17/c62 0 2023-10-08T08:45:31.553 INFO:tasks.workunit.client.0.smithi070.stdout:6/317: rmdir df/d11/d1d 39 2023-10-08T08:45:31.553 INFO:tasks.workunit.client.0.smithi070.stdout:6/318: truncate df/d26/d42/d43/d4a/f68 770070 0 2023-10-08T08:45:31.553 INFO:tasks.workunit.client.0.smithi070.stdout:4/297: rmdir dc/d17/d24 39 2023-10-08T08:45:31.554 INFO:tasks.workunit.client.0.smithi070.stdout:6/319: truncate df/f23 348099 0 2023-10-08T08:45:31.558 INFO:tasks.workunit.client.0.smithi070.stdout:6/320: readlink l0 0 2023-10-08T08:45:31.558 INFO:tasks.workunit.client.0.smithi070.stdout:0/406: dwrite d1/f11 [0,4194304] 0 2023-10-08T08:45:31.560 INFO:tasks.workunit.client.0.smithi070.stdout:6/321: creat df/d26/f6a x:0 0 0 2023-10-08T08:45:31.560 INFO:tasks.workunit.client.0.smithi070.stdout:1/408: dread d6/dc/d14/d1f/f32 [0,4194304] 0 2023-10-08T08:45:31.562 INFO:tasks.workunit.client.0.smithi070.stdout:3/339: dread d0/d12/d14/f39 [0,4194304] 0 2023-10-08T08:45:31.562 INFO:tasks.workunit.client.0.smithi070.stdout:7/389: dread d3/d19/d1b/d4a/d9/f74 [0,4194304] 0 2023-10-08T08:45:31.563 INFO:tasks.workunit.client.0.smithi070.stdout:6/322: link df/d11/d1d/f3d df/d26/f6b 0 2023-10-08T08:45:31.564 INFO:tasks.workunit.client.0.smithi070.stdout:1/409: symlink d6/dc/d14/d1f/d63/l83 0 2023-10-08T08:45:31.564 INFO:tasks.workunit.client.0.smithi070.stdout:5/373: read d5/da/d4d/f3f [2978009,77820] 0 2023-10-08T08:45:31.566 INFO:tasks.workunit.client.0.smithi070.stdout:3/340: mknod d0/d12/d14/d1d/d22/d52/d5a/c6e 0 2023-10-08T08:45:31.566 INFO:tasks.workunit.client.0.smithi070.stdout:3/341: read d0/d12/d14/d1d/f34 [57051,48682] 0 2023-10-08T08:45:31.566 INFO:tasks.workunit.client.0.smithi070.stdout:7/390: symlink d3/d19/d1b/d4a/d9/l85 0 2023-10-08T08:45:31.566 INFO:tasks.workunit.client.0.smithi070.stdout:7/391: fdatasync d3/f47 0 2023-10-08T08:45:31.566 INFO:tasks.workunit.client.0.smithi070.stdout:7/392: chown d3/d19/d1b/d1e/c54 13424 1 2023-10-08T08:45:31.566 INFO:tasks.workunit.client.0.smithi070.stdout:0/407: mkdir d1/d76 0 2023-10-08T08:45:31.567 INFO:tasks.workunit.client.0.smithi070.stdout:6/323: mknod df/d26/d42/d4b/c6c 0 2023-10-08T08:45:31.567 INFO:tasks.workunit.client.0.smithi070.stdout:2/375: dwrite df/d12/d15/d54/f55 [0,4194304] 0 2023-10-08T08:45:31.569 INFO:tasks.workunit.client.0.smithi070.stdout:1/410: mknod d6/dc/d14/d1f/c84 0 2023-10-08T08:45:31.569 INFO:tasks.workunit.client.0.smithi070.stdout:1/411: stat d6/dc/d14/d1f/c35 0 2023-10-08T08:45:31.571 INFO:tasks.workunit.client.0.smithi070.stdout:5/374: truncate d5/d5f/d61/f60 3191945 0 2023-10-08T08:45:31.571 INFO:tasks.workunit.client.0.smithi070.stdout:5/375: chown d5/d5f/d61/l71 0 1 2023-10-08T08:45:31.573 INFO:tasks.workunit.client.0.smithi070.stdout:2/376: creat df/d12/d1b/f76 x:0 0 0 2023-10-08T08:45:31.573 INFO:tasks.workunit.client.0.smithi070.stdout:2/377: write df/d12/d1b/d1c/f64 [136550,83361] 0 2023-10-08T08:45:31.573 INFO:tasks.workunit.client.0.smithi070.stdout:2/378: fdatasync df/d12/d25/f44 0 2023-10-08T08:45:31.574 INFO:tasks.workunit.client.0.smithi070.stdout:9/246: dwrite d1/dd/d1a/f1d [4194304,4194304] 0 2023-10-08T08:45:31.574 INFO:tasks.workunit.client.0.smithi070.stdout:2/379: mkdir df/d3a/d77 0 2023-10-08T08:45:31.577 INFO:tasks.workunit.client.0.smithi070.stdout:2/380: stat df/d12/d1b/d1c/d2d/l32 0 2023-10-08T08:45:31.577 INFO:tasks.workunit.client.0.smithi070.stdout:3/342: read d0/db/f26 [82833,127617] 0 2023-10-08T08:45:31.577 INFO:tasks.workunit.client.0.smithi070.stdout:2/381: fsync df/d12/d15/f42 0 2023-10-08T08:45:31.577 INFO:tasks.workunit.client.0.smithi070.stdout:2/382: chown df/d12/d1b/l50 1166678 1 2023-10-08T08:45:31.577 INFO:tasks.workunit.client.0.smithi070.stdout:3/343: write d0/db/d10/d38/d2f/f66 [207837,103870] 0 2023-10-08T08:45:31.577 INFO:tasks.workunit.client.0.smithi070.stdout:3/344: read d0/db/d10/f59 [981100,36675] 0 2023-10-08T08:45:31.578 INFO:tasks.workunit.client.0.smithi070.stdout:3/345: creat d0/d12/d14/d1d/d22/d52/d5a/f6f x:0 0 0 2023-10-08T08:45:31.579 INFO:tasks.workunit.client.0.smithi070.stdout:7/393: dread d3/d19/d1b/f64 [0,4194304] 0 2023-10-08T08:45:31.581 INFO:tasks.workunit.client.0.smithi070.stdout:9/247: dread d1/dd/d19/d38/f3c [0,4194304] 0 2023-10-08T08:45:31.583 INFO:tasks.workunit.client.0.smithi070.stdout:9/248: creat d1/dd/d26/f47 x:0 0 0 2023-10-08T08:45:31.590 INFO:tasks.workunit.client.0.smithi070.stdout:6/324: dwrite df/f17 [0,4194304] 0 2023-10-08T08:45:31.590 INFO:tasks.workunit.client.0.smithi070.stdout:5/376: dread d5/d5f/d61/d30/f14 [0,4194304] 0 2023-10-08T08:45:31.591 INFO:tasks.workunit.client.0.smithi070.stdout:7/394: mknod d3/d79/c86 0 2023-10-08T08:45:31.591 INFO:tasks.workunit.client.0.smithi070.stdout:3/346: link d0/db/d10/c4c d0/d12/c70 0 2023-10-08T08:45:31.592 INFO:tasks.workunit.client.0.smithi070.stdout:0/408: dwrite d1/dd/ff [0,4194304] 0 2023-10-08T08:45:31.593 INFO:tasks.workunit.client.0.smithi070.stdout:0/409: stat d1/d62/c3b 0 2023-10-08T08:45:31.593 INFO:tasks.workunit.client.0.smithi070.stdout:0/410: chown d1/d14/d1f/f42 4978821 1 2023-10-08T08:45:31.593 INFO:tasks.workunit.client.0.smithi070.stdout:0/411: write d1/d1d/d24/f71 [1024315,23515] 0 2023-10-08T08:45:31.593 INFO:tasks.workunit.client.0.smithi070.stdout:5/377: mknod d5/d5f/d61/d30/c80 0 2023-10-08T08:45:31.594 INFO:tasks.workunit.client.0.smithi070.stdout:3/347: truncate d0/d12/d14/d48/f53 684754 0 2023-10-08T08:45:31.594 INFO:tasks.workunit.client.0.smithi070.stdout:6/325: truncate df/d11/f29 1948515 0 2023-10-08T08:45:31.595 INFO:tasks.workunit.client.0.smithi070.stdout:5/378: unlink d5/da/d4d/d37/d38/c35 0 2023-10-08T08:45:31.596 INFO:tasks.workunit.client.0.smithi070.stdout:7/395: rename d3/d19/f60 to d3/d19/d1b/d1e/d76/f87 0 2023-10-08T08:45:31.596 INFO:tasks.workunit.client.0.smithi070.stdout:8/458: sync 2023-10-08T08:45:31.597 INFO:tasks.workunit.client.0.smithi070.stdout:3/348: creat d0/d12/f71 x:0 0 0 2023-10-08T08:45:31.597 INFO:tasks.workunit.client.0.smithi070.stdout:3/349: stat d0/db/d10/d38/c42 0 2023-10-08T08:45:31.597 INFO:tasks.workunit.client.0.smithi070.stdout:3/350: dread - d0/d12/f71 zero size 2023-10-08T08:45:31.597 INFO:tasks.workunit.client.0.smithi070.stdout:3/351: write d0/db/d10/d38/f50 [1170435,43481] 0 2023-10-08T08:45:31.601 INFO:tasks.workunit.client.0.smithi070.stdout:2/383: rmdir df/d12 39 2023-10-08T08:45:31.601 INFO:tasks.workunit.client.0.smithi070.stdout:6/326: creat df/d26/d42/d43/d4a/f6d x:0 0 0 2023-10-08T08:45:31.601 INFO:tasks.workunit.client.0.smithi070.stdout:2/384: fdatasync df/d12/d25/f3e 0 2023-10-08T08:45:31.601 INFO:tasks.workunit.client.0.smithi070.stdout:7/396: symlink d3/d19/d1b/d4a/l88 0 2023-10-08T08:45:31.603 INFO:tasks.workunit.client.0.smithi070.stdout:8/459: unlink d1/de/d1a/f49 0 2023-10-08T08:45:31.603 INFO:tasks.workunit.client.0.smithi070.stdout:8/460: chown d1/de/d3a/d56/d65/c9b 0 1 2023-10-08T08:45:31.603 INFO:tasks.workunit.client.0.smithi070.stdout:2/385: creat df/d12/d15/d34/f78 x:0 0 0 2023-10-08T08:45:31.603 INFO:tasks.workunit.client.0.smithi070.stdout:6/327: readlink df/d11/l28 0 2023-10-08T08:45:31.604 INFO:tasks.workunit.client.0.smithi070.stdout:8/461: mkdir d1/d2/d6/d22/d9e 0 2023-10-08T08:45:31.605 INFO:tasks.workunit.client.0.smithi070.stdout:2/386: mkdir df/d12/d1b/d1c/d79 0 2023-10-08T08:45:31.605 INFO:tasks.workunit.client.0.smithi070.stdout:2/387: chown df/d12/c4a 3 1 2023-10-08T08:45:31.606 INFO:tasks.workunit.client.0.smithi070.stdout:6/328: creat df/d26/d42/f6e x:0 0 0 2023-10-08T08:45:31.606 INFO:tasks.workunit.client.0.smithi070.stdout:6/329: chown l0 100 1 2023-10-08T08:45:31.608 INFO:tasks.workunit.client.0.smithi070.stdout:8/462: mknod d1/de/d15/c9f 0 2023-10-08T08:45:31.608 INFO:tasks.workunit.client.0.smithi070.stdout:0/412: dread d1/dd/f3d [0,4194304] 0 2023-10-08T08:45:31.609 INFO:tasks.workunit.client.0.smithi070.stdout:8/463: mkdir d1/de/d3a/d56/d65/da0 0 2023-10-08T08:45:31.609 INFO:tasks.workunit.client.0.smithi070.stdout:8/464: chown d1/d4d/c6d 362164 1 2023-10-08T08:45:31.619 INFO:tasks.workunit.client.0.smithi070.stdout:1/412: dwrite d6/dc/d14/d1f/d75/f50 [0,4194304] 0 2023-10-08T08:45:31.619 INFO:tasks.workunit.client.0.smithi070.stdout:1/413: chown d6/dc/d14/d1f/l7b 0 1 2023-10-08T08:45:31.619 INFO:tasks.workunit.client.0.smithi070.stdout:1/414: dread - d6/dc/d14/d1f/d26/f60 zero size 2023-10-08T08:45:31.624 INFO:tasks.workunit.client.0.smithi070.stdout:1/415: truncate d6/dc/d14/d1f/d26/f4d 183630 0 2023-10-08T08:45:31.626 INFO:tasks.workunit.client.0.smithi070.stdout:3/352: fdatasync d0/db/d10/d38/f50 0 2023-10-08T08:45:31.626 INFO:tasks.workunit.client.0.smithi070.stdout:0/413: dread d1/d1d/f52 [0,4194304] 0 2023-10-08T08:45:31.627 INFO:tasks.workunit.client.0.smithi070.stdout:1/416: creat d6/dc/f85 x:0 0 0 2023-10-08T08:45:31.630 INFO:tasks.workunit.client.0.smithi070.stdout:0/414: getdents d1/d14 0 2023-10-08T08:45:31.631 INFO:tasks.workunit.client.0.smithi070.stdout:3/353: dread d0/d12/d14/d1d/d22/f3b [0,4194304] 0 2023-10-08T08:45:31.633 INFO:tasks.workunit.client.0.smithi070.stdout:0/415: creat d1/d1d/f77 x:0 0 0 2023-10-08T08:45:31.635 INFO:tasks.workunit.client.0.smithi070.stdout:7/397: dwrite d3/d19/d1b/d4a/d50/f66 [0,4194304] 0 2023-10-08T08:45:31.635 INFO:tasks.workunit.client.0.smithi070.stdout:2/388: dwrite df/d12/d25/f2a [0,4194304] 0 2023-10-08T08:45:31.635 INFO:tasks.workunit.client.0.smithi070.stdout:2/389: truncate df/d12/d25/f3e 4233879 0 2023-10-08T08:45:31.635 INFO:tasks.workunit.client.0.smithi070.stdout:2/390: read - df/d12/d1b/d1c/f5d zero size 2023-10-08T08:45:31.636 INFO:tasks.workunit.client.0.smithi070.stdout:5/379: dwrite d5/da/d22/f52 [0,4194304] 0 2023-10-08T08:45:31.636 INFO:tasks.workunit.client.0.smithi070.stdout:1/417: mknod d6/c86 0 2023-10-08T08:45:31.638 INFO:tasks.workunit.client.0.smithi070.stdout:5/380: mknod d5/d5f/d61/d30/c81 0 2023-10-08T08:45:31.638 INFO:tasks.workunit.client.0.smithi070.stdout:5/381: chown d5/da/d4d/d37/d2a/c46 20 1 2023-10-08T08:45:31.638 INFO:tasks.workunit.client.0.smithi070.stdout:7/398: dread d3/d19/d1a/f22 [0,4194304] 0 2023-10-08T08:45:31.640 INFO:tasks.workunit.client.0.smithi070.stdout:6/330: dwrite df/d11/f31 [0,4194304] 0 2023-10-08T08:45:31.640 INFO:tasks.workunit.client.0.smithi070.stdout:6/331: chown df/d11/d1d/f44 83449 1 2023-10-08T08:45:31.641 INFO:tasks.workunit.client.0.smithi070.stdout:5/382: mkdir d5/da/d22/d75/d82 0 2023-10-08T08:45:31.641 INFO:tasks.workunit.client.0.smithi070.stdout:2/391: truncate fa 4086447 0 2023-10-08T08:45:31.641 INFO:tasks.workunit.client.0.smithi070.stdout:2/392: write df/d12/d15/f31 [2305077,73143] 0 2023-10-08T08:45:31.643 INFO:tasks.workunit.client.0.smithi070.stdout:1/418: creat d6/dc/d14/d1f/d75/d7e/f87 x:0 0 0 2023-10-08T08:45:31.646 INFO:tasks.workunit.client.0.smithi070.stdout:1/419: dread d6/dc/d14/d1f/f4c [0,4194304] 0 2023-10-08T08:45:31.646 INFO:tasks.workunit.client.0.smithi070.stdout:3/354: dread d0/db/d10/f2c [0,4194304] 0 2023-10-08T08:45:31.649 INFO:tasks.workunit.client.0.smithi070.stdout:3/355: link d0/d12/d14/d5c/f61 d0/d12/d14/f72 0 2023-10-08T08:45:31.649 INFO:tasks.workunit.client.0.smithi070.stdout:1/420: mkdir d6/dc/d14/d1f/d75/d88 0 2023-10-08T08:45:31.649 INFO:tasks.workunit.client.0.smithi070.stdout:1/421: dread - d6/dc/d14/d1f/d75/f5a zero size 2023-10-08T08:45:31.661 INFO:tasks.workunit.client.0.smithi070.stdout:0/416: dwrite d1/d1d/f52 [0,4194304] 0 2023-10-08T08:45:31.661 INFO:tasks.workunit.client.0.smithi070.stdout:0/417: fsync d1/dd/d1b/f33 0 2023-10-08T08:45:31.661 INFO:tasks.workunit.client.0.smithi070.stdout:0/418: chown d1/f6b 4020592 1 2023-10-08T08:45:31.661 INFO:tasks.workunit.client.0.smithi070.stdout:0/419: chown d1/d14/d1f/f42 1 1 2023-10-08T08:45:31.662 INFO:tasks.workunit.client.0.smithi070.stdout:0/420: mknod d1/d1d/c78 0 2023-10-08T08:45:31.663 INFO:tasks.workunit.client.0.smithi070.stdout:0/421: chown d1/d14/d1f/d6f 7 1 2023-10-08T08:45:31.663 INFO:tasks.workunit.client.0.smithi070.stdout:0/422: chown d1/d14/d1f/f2c 61761933 1 2023-10-08T08:45:31.663 INFO:tasks.workunit.client.0.smithi070.stdout:0/423: write d1/dd/d1b/f27 [361994,19329] 0 2023-10-08T08:45:31.666 INFO:tasks.workunit.client.0.smithi070.stdout:0/424: mknod d1/c79 0 2023-10-08T08:45:31.667 INFO:tasks.workunit.client.0.smithi070.stdout:0/425: mkdir d1/d76/d7a 0 2023-10-08T08:45:31.669 INFO:tasks.workunit.client.0.smithi070.stdout:7/399: write d3/d19/d1b/d1e/f46 [813912,47284] 0 2023-10-08T08:45:31.669 INFO:tasks.workunit.client.0.smithi070.stdout:7/400: fdatasync d3/d19/d1b/d1e/d4c/f63 0 2023-10-08T08:45:31.669 INFO:tasks.workunit.client.0.smithi070.stdout:0/426: mknod d1/dd/c7b 0 2023-10-08T08:45:31.672 INFO:tasks.workunit.client.0.smithi070.stdout:0/427: rename d1/dd/f16 to d1/d62/d54/f7c 0 2023-10-08T08:45:31.673 INFO:tasks.workunit.client.0.smithi070.stdout:7/401: dread d3/f2e [0,4194304] 0 2023-10-08T08:45:31.676 INFO:tasks.workunit.client.0.smithi070.stdout:7/402: unlink d3/d19/d1b/d1e/f46 0 2023-10-08T08:45:31.676 INFO:tasks.workunit.client.0.smithi070.stdout:7/403: symlink d3/d19/d1b/d1e/d76/l89 0 2023-10-08T08:45:31.678 INFO:tasks.workunit.client.0.smithi070.stdout:1/422: dwrite d6/dc/d14/f5c [0,4194304] 0 2023-10-08T08:45:31.678 INFO:tasks.workunit.client.0.smithi070.stdout:1/423: read - d6/dc/f85 zero size 2023-10-08T08:45:31.680 INFO:tasks.workunit.client.0.smithi070.stdout:6/332: dwrite df/d26/d42/d4b/f64 [0,4194304] 0 2023-10-08T08:45:31.681 INFO:tasks.workunit.client.0.smithi070.stdout:3/356: dread d0/d12/d14/f40 [0,4194304] 0 2023-10-08T08:45:31.681 INFO:tasks.workunit.client.0.smithi070.stdout:2/393: dwrite df/d12/d15/f16 [0,4194304] 0 2023-10-08T08:45:31.681 INFO:tasks.workunit.client.0.smithi070.stdout:6/333: fdatasync df/f23 0 2023-10-08T08:45:31.682 INFO:tasks.workunit.client.0.smithi070.stdout:1/424: creat d6/dc/d14/d70/f89 x:0 0 0 2023-10-08T08:45:31.682 INFO:tasks.workunit.client.0.smithi070.stdout:1/425: chown d6/dc/d14/d1f/l30 14 1 2023-10-08T08:45:31.684 INFO:tasks.workunit.client.0.smithi070.stdout:3/357: mkdir d0/db/d73 0 2023-10-08T08:45:31.685 INFO:tasks.workunit.client.0.smithi070.stdout:5/383: dwrite d5/d5f/f78 [0,4194304] 0 2023-10-08T08:45:31.686 INFO:tasks.workunit.client.0.smithi070.stdout:0/428: unlink d1/d62/d54/f7c 0 2023-10-08T08:45:31.688 INFO:tasks.workunit.client.0.smithi070.stdout:2/394: symlink df/d12/d1b/d1c/d79/l7a 0 2023-10-08T08:45:31.689 INFO:tasks.workunit.client.0.smithi070.stdout:3/358: symlink d0/d12/d14/l74 0 2023-10-08T08:45:31.690 INFO:tasks.workunit.client.0.smithi070.stdout:1/426: rename d6/dc/d14/d1f/d26/d38/l43 to d6/dc/d14/d1f/l8a 0 2023-10-08T08:45:31.691 INFO:tasks.workunit.client.0.smithi070.stdout:5/384: getdents d5/d5f/d61/d30/d54 0 2023-10-08T08:45:31.692 INFO:tasks.workunit.client.0.smithi070.stdout:0/429: creat d1/d62/d54/f7d x:0 0 0 2023-10-08T08:45:31.696 INFO:tasks.workunit.client.0.smithi070.stdout:1/427: symlink d6/dc/d14/d1f/d63/l8b 0 2023-10-08T08:45:31.696 INFO:tasks.workunit.client.0.smithi070.stdout:1/428: readlink d6/dc/d14/d1f/l5b 0 2023-10-08T08:45:31.698 INFO:tasks.workunit.client.0.smithi070.stdout:0/430: truncate d1/dd/ff 3463518 0 2023-10-08T08:45:31.698 INFO:tasks.workunit.client.0.smithi070.stdout:0/431: chown d1/d1d/f2b 10 1 2023-10-08T08:45:31.698 INFO:tasks.workunit.client.0.smithi070.stdout:0/432: readlink d1/d62/d38/l74 0 2023-10-08T08:45:31.698 INFO:tasks.workunit.client.0.smithi070.stdout:0/433: readlink d1/dd/d1b/l45 0 2023-10-08T08:45:31.698 INFO:tasks.workunit.client.0.smithi070.stdout:0/434: write d1/f11 [4662333,50336] 0 2023-10-08T08:45:31.699 INFO:tasks.workunit.client.0.smithi070.stdout:2/395: write fb [3689839,47648] 0 2023-10-08T08:45:31.699 INFO:tasks.workunit.client.0.smithi070.stdout:1/429: creat d6/dc/d14/d1f/d75/f8c x:0 0 0 2023-10-08T08:45:31.699 INFO:tasks.workunit.client.0.smithi070.stdout:1/430: stat d6/dc/d14/d1f/d26/f57 0 2023-10-08T08:45:31.703 INFO:tasks.workunit.client.0.smithi070.stdout:3/359: rename d0/d12/d14/d1d/d22 to d0/d12/d14/d5c/d5d/d75 0 2023-10-08T08:45:31.704 INFO:tasks.workunit.client.0.smithi070.stdout:3/360: truncate d0/d12/d14/d1d/f5e 3355135 0 2023-10-08T08:45:31.704 INFO:tasks.workunit.client.0.smithi070.stdout:7/404: dwrite d3/d19/d1a/f22 [0,4194304] 0 2023-10-08T08:45:31.705 INFO:tasks.workunit.client.0.smithi070.stdout:7/405: truncate d3/d19/d1a/f20 4285658 0 2023-10-08T08:45:31.705 INFO:tasks.workunit.client.0.smithi070.stdout:7/406: fsync d3/d19/d1b/d4a/d50/f81 0 2023-10-08T08:45:31.705 INFO:tasks.workunit.client.0.smithi070.stdout:3/361: symlink d0/d12/d14/d48/l76 0 2023-10-08T08:45:31.706 INFO:tasks.workunit.client.0.smithi070.stdout:3/362: truncate d0/d12/d14/d1d/f3a 647007 0 2023-10-08T08:45:31.706 INFO:tasks.workunit.client.0.smithi070.stdout:7/407: dread d3/d19/d1b/d4a/d9/f74 [0,4194304] 0 2023-10-08T08:45:31.707 INFO:tasks.workunit.client.0.smithi070.stdout:7/408: stat d3/d19/d1a/l72 0 2023-10-08T08:45:31.707 INFO:tasks.workunit.client.0.smithi070.stdout:7/409: dread - d3/f55 zero size 2023-10-08T08:45:31.707 INFO:tasks.workunit.client.0.smithi070.stdout:7/410: write d3/d19/d1b/d4a/d50/f81 [520810,62571] 0 2023-10-08T08:45:31.707 INFO:tasks.workunit.client.0.smithi070.stdout:5/385: dread d5/da/d4d/d37/d2a/f31 [0,4194304] 0 2023-10-08T08:45:31.707 INFO:tasks.workunit.client.0.smithi070.stdout:2/396: unlink df/d12/d15/d34/l4e 0 2023-10-08T08:45:31.707 INFO:tasks.workunit.client.0.smithi070.stdout:5/386: chown d5/da/f15 0 1 2023-10-08T08:45:31.708 INFO:tasks.workunit.client.0.smithi070.stdout:5/387: chown d5/da/d22 3593069 1 2023-10-08T08:45:31.708 INFO:tasks.workunit.client.0.smithi070.stdout:3/363: write d0/db/d10/f1e [115575,50347] 0 2023-10-08T08:45:31.708 INFO:tasks.workunit.client.0.smithi070.stdout:5/388: mkdir d5/d5f/d61/d30/d83 0 2023-10-08T08:45:31.709 INFO:tasks.workunit.client.0.smithi070.stdout:5/389: chown d5/da/d4d 438300 1 2023-10-08T08:45:31.709 INFO:tasks.workunit.client.0.smithi070.stdout:0/435: rename d1/d62/l26 to d1/d14/l7e 0 2023-10-08T08:45:31.711 INFO:tasks.workunit.client.0.smithi070.stdout:3/364: symlink d0/db/d10/d6d/l77 0 2023-10-08T08:45:31.713 INFO:tasks.workunit.client.0.smithi070.stdout:5/390: mknod d5/da/d4d/d37/d2a/c84 0 2023-10-08T08:45:31.717 INFO:tasks.workunit.client.0.smithi070.stdout:7/411: creat d3/d19/d1b/d1e/d76/f8a x:0 0 0 2023-10-08T08:45:31.718 INFO:tasks.workunit.client.0.smithi070.stdout:3/365: rename d0/db/f29 to d0/d12/d14/d1d/f78 0 2023-10-08T08:45:31.719 INFO:tasks.workunit.client.0.smithi070.stdout:5/391: unlink d5/da/f24 0 2023-10-08T08:45:31.719 INFO:tasks.workunit.client.0.smithi070.stdout:2/397: link df/d12/d1b/d1c/d2d/f58 df/d12/d1b/f7b 0 2023-10-08T08:45:31.720 INFO:tasks.workunit.client.0.smithi070.stdout:1/431: dwrite d6/f52 [0,4194304] 0 2023-10-08T08:45:31.721 INFO:tasks.workunit.client.0.smithi070.stdout:5/392: unlink d5/da/f11 0 2023-10-08T08:45:31.723 INFO:tasks.workunit.client.0.smithi070.stdout:5/393: creat d5/da/d4d/f85 x:0 0 0 2023-10-08T08:45:31.723 INFO:tasks.workunit.client.0.smithi070.stdout:5/394: write d5/da/d4d/d37/d2a/f58 [1733431,11967] 0 2023-10-08T08:45:31.723 INFO:tasks.workunit.client.0.smithi070.stdout:0/436: unlink d1/d14/d1f/f4e 0 2023-10-08T08:45:31.725 INFO:tasks.workunit.client.0.smithi070.stdout:5/395: symlink d5/da/d4d/d37/l86 0 2023-10-08T08:45:31.725 INFO:tasks.workunit.client.0.smithi070.stdout:5/396: readlink d5/da/l40 0 2023-10-08T08:45:31.726 INFO:tasks.workunit.client.0.smithi070.stdout:7/412: chown c2 131114 1 2023-10-08T08:45:31.726 INFO:tasks.workunit.client.0.smithi070.stdout:7/413: write d3/d19/d1b/d4a/d9/f74 [59494,43530] 0 2023-10-08T08:45:31.726 INFO:tasks.workunit.client.0.smithi070.stdout:0/437: read d1/d62/d38/f5a [2690796,106695] 0 2023-10-08T08:45:31.727 INFO:tasks.workunit.client.0.smithi070.stdout:0/438: dread d1/dd/f3a [0,4194304] 0 2023-10-08T08:45:31.730 INFO:tasks.workunit.client.0.smithi070.stdout:3/366: rmdir d0 39 2023-10-08T08:45:31.730 INFO:tasks.workunit.client.0.smithi070.stdout:5/397: readlink d5/da/d4d/l49 0 2023-10-08T08:45:31.730 INFO:tasks.workunit.client.0.smithi070.stdout:7/414: link d3/l3b d3/d19/d6d/l8b 0 2023-10-08T08:45:31.731 INFO:tasks.workunit.client.0.smithi070.stdout:7/415: creat d3/d19/d6d/f8c x:0 0 0 2023-10-08T08:45:31.731 INFO:tasks.workunit.client.0.smithi070.stdout:3/367: rmdir d0/db/d73 0 2023-10-08T08:45:31.733 INFO:tasks.workunit.client.0.smithi070.stdout:2/398: mknod df/d12/d15/d54/c7c 0 2023-10-08T08:45:31.734 INFO:tasks.workunit.client.0.smithi070.stdout:5/398: symlink d5/d5f/d61/d30/d83/l87 0 2023-10-08T08:45:31.735 INFO:tasks.workunit.client.0.smithi070.stdout:7/416: symlink d3/d19/d1b/d1e/d76/l8d 0 2023-10-08T08:45:31.736 INFO:tasks.workunit.client.0.smithi070.stdout:2/399: creat df/d12/d25/f7d x:0 0 0 2023-10-08T08:45:31.736 INFO:tasks.workunit.client.0.smithi070.stdout:2/400: chown fc 2 1 2023-10-08T08:45:31.737 INFO:tasks.workunit.client.0.smithi070.stdout:2/401: write df/d12/d25/f72 [74476,27807] 0 2023-10-08T08:45:31.738 INFO:tasks.workunit.client.0.smithi070.stdout:5/399: rmdir d5/da/d22 39 2023-10-08T08:45:31.741 INFO:tasks.workunit.client.0.smithi070.stdout:2/402: getdents df 0 2023-10-08T08:45:31.742 INFO:tasks.workunit.client.0.smithi070.stdout:2/403: chown l7 34885 1 2023-10-08T08:45:31.742 INFO:tasks.workunit.client.0.smithi070.stdout:2/404: chown df/d3a 3 1 2023-10-08T08:45:31.743 INFO:tasks.workunit.client.0.smithi070.stdout:1/432: dwrite d6/f52 [0,4194304] 0 2023-10-08T08:45:31.743 INFO:tasks.workunit.client.0.smithi070.stdout:2/405: mkdir df/d12/d7e 0 2023-10-08T08:45:31.745 INFO:tasks.workunit.client.0.smithi070.stdout:1/433: creat d6/dc/d14/d1f/d75/d7e/f8d x:0 0 0 2023-10-08T08:45:31.745 INFO:tasks.workunit.client.0.smithi070.stdout:1/434: write d6/dc/d14/d1f/d75/d7e/f8d [390271,124552] 0 2023-10-08T08:45:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:0/439: dread d1/d62/d38/f5a [0,4194304] 0 2023-10-08T08:45:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:0/440: write d1/d1d/d24/f71 [1890166,21814] 0 2023-10-08T08:45:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:0/441: write d1/d14/f43 [1888450,56656] 0 2023-10-08T08:45:31.755 INFO:tasks.workunit.client.0.smithi070.stdout:7/417: dread d3/f71 [0,4194304] 0 2023-10-08T08:45:31.757 INFO:tasks.workunit.client.0.smithi070.stdout:7/418: creat d3/d19/d1b/d4a/f8e x:0 0 0 2023-10-08T08:45:31.760 INFO:tasks.workunit.client.0.smithi070.stdout:3/368: dread d0/d12/d14/d5c/d5d/d75/f44 [0,4194304] 0 2023-10-08T08:45:31.762 INFO:tasks.workunit.client.0.smithi070.stdout:7/419: dread d3/f2e [0,4194304] 0 2023-10-08T08:45:31.763 INFO:tasks.workunit.client.0.smithi070.stdout:3/369: rmdir d0/d12/d14 39 2023-10-08T08:45:31.763 INFO:tasks.workunit.client.0.smithi070.stdout:0/442: write d1/d62/d38/f5a [1445630,104575] 0 2023-10-08T08:45:31.763 INFO:tasks.workunit.client.0.smithi070.stdout:0/443: fsync d1/d14/f35 0 2023-10-08T08:45:31.764 INFO:tasks.workunit.client.0.smithi070.stdout:0/444: chown d1/d1d/f52 378638286 1 2023-10-08T08:45:31.764 INFO:tasks.workunit.client.0.smithi070.stdout:0/445: chown d1/d62/d54/d5e/l6e 8 1 2023-10-08T08:45:31.764 INFO:tasks.workunit.client.0.smithi070.stdout:0/446: write d1/d62/d54/f73 [436218,118826] 0 2023-10-08T08:45:31.764 INFO:tasks.workunit.client.0.smithi070.stdout:0/447: readlink d1/dd/l2d 0 2023-10-08T08:45:31.765 INFO:tasks.workunit.client.0.smithi070.stdout:7/420: creat d3/d19/d6d/f8f x:0 0 0 2023-10-08T08:45:31.765 INFO:tasks.workunit.client.0.smithi070.stdout:3/370: symlink d0/d12/d14/d5c/d5d/d75/d52/d5a/l79 0 2023-10-08T08:45:31.765 INFO:tasks.workunit.client.0.smithi070.stdout:0/448: creat d1/d1d/d24/f7f x:0 0 0 2023-10-08T08:45:31.765 INFO:tasks.workunit.client.0.smithi070.stdout:0/449: getdents d1/d76/d7a 0 2023-10-08T08:45:31.765 INFO:tasks.workunit.client.0.smithi070.stdout:1/435: dread d6/f11 [0,4194304] 0 2023-10-08T08:45:31.765 INFO:tasks.workunit.client.0.smithi070.stdout:7/421: mknod d3/d79/c90 0 2023-10-08T08:45:31.767 INFO:tasks.workunit.client.0.smithi070.stdout:0/450: mkdir d1/d62/d54/d5e/d80 0 2023-10-08T08:45:31.768 INFO:tasks.workunit.client.0.smithi070.stdout:7/422: creat d3/d77/f91 x:0 0 0 2023-10-08T08:45:31.768 INFO:tasks.workunit.client.0.smithi070.stdout:3/371: link d0/d12/d14/f62 d0/d12/f7a 0 2023-10-08T08:45:31.769 INFO:tasks.workunit.client.0.smithi070.stdout:0/451: symlink d1/d62/d54/l81 0 2023-10-08T08:45:31.769 INFO:tasks.workunit.client.0.smithi070.stdout:3/372: mknod d0/d12/d14/d1d/c7b 0 2023-10-08T08:45:31.769 INFO:tasks.workunit.client.0.smithi070.stdout:5/400: dwrite d5/da/d4d/d37/d38/f6a [0,4194304] 0 2023-10-08T08:45:31.774 INFO:tasks.workunit.client.0.smithi070.stdout:3/373: creat d0/d12/f7c x:0 0 0 2023-10-08T08:45:31.774 INFO:tasks.workunit.client.0.smithi070.stdout:3/374: chown d0/d12/d14/d48/l60 439 1 2023-10-08T08:45:31.774 INFO:tasks.workunit.client.0.smithi070.stdout:7/423: rename d3/l5b to d3/d77/l92 0 2023-10-08T08:45:31.775 INFO:tasks.workunit.client.0.smithi070.stdout:0/452: getdents d1/d76 0 2023-10-08T08:45:31.775 INFO:tasks.workunit.client.0.smithi070.stdout:0/453: chown d1/d14/d1f/f28 27 1 2023-10-08T08:45:31.776 INFO:tasks.workunit.client.0.smithi070.stdout:0/454: link d1/d1d/d24/c44 d1/d62/d38/c82 0 2023-10-08T08:45:31.779 INFO:tasks.workunit.client.0.smithi070.stdout:2/406: dwrite df/d3a/f4b [0,4194304] 0 2023-10-08T08:45:31.780 INFO:tasks.workunit.client.0.smithi070.stdout:0/455: rename d1/dd/d1b/f27 to d1/d62/d54/d5e/f83 0 2023-10-08T08:45:31.785 INFO:tasks.workunit.client.0.smithi070.stdout:2/407: creat df/d73/f7f x:0 0 0 2023-10-08T08:45:31.799 INFO:tasks.workunit.client.0.smithi070.stdout:1/436: dwrite d6/dc/d14/d1f/f25 [4194304,4194304] 0 2023-10-08T08:45:31.800 INFO:tasks.workunit.client.0.smithi070.stdout:1/437: truncate d6/dc/d14/d1f/d26/d38/f74 79531 0 2023-10-08T08:45:31.800 INFO:tasks.workunit.client.0.smithi070.stdout:0/456: dwrite d1/d62/d38/f4f [0,4194304] 0 2023-10-08T08:45:31.801 INFO:tasks.workunit.client.0.smithi070.stdout:3/375: dwrite d0/db/fd [0,4194304] 0 2023-10-08T08:45:31.801 INFO:tasks.workunit.client.0.smithi070.stdout:2/408: dread df/f39 [0,4194304] 0 2023-10-08T08:45:31.801 INFO:tasks.workunit.client.0.smithi070.stdout:2/409: chown df/d12/d1b 576499483 1 2023-10-08T08:45:31.801 INFO:tasks.workunit.client.0.smithi070.stdout:2/410: dread - df/d12/d1b/f76 zero size 2023-10-08T08:45:31.802 INFO:tasks.workunit.client.0.smithi070.stdout:1/438: rename d6/dc/d14/d1f/c7d to d6/dc/c8e 0 2023-10-08T08:45:31.805 INFO:tasks.workunit.client.0.smithi070.stdout:0/457: mknod d1/d14/d1f/c84 0 2023-10-08T08:45:31.806 INFO:tasks.workunit.client.0.smithi070.stdout:0/458: read d1/fa [812027,53441] 0 2023-10-08T08:45:31.806 INFO:tasks.workunit.client.0.smithi070.stdout:7/424: dwrite d3/d19/d1b/d4a/d9/f74 [0,4194304] 0 2023-10-08T08:45:31.807 INFO:tasks.workunit.client.0.smithi070.stdout:7/425: dread - d3/d19/f3c zero size 2023-10-08T08:45:31.808 INFO:tasks.workunit.client.0.smithi070.stdout:1/439: creat d6/dc/d14/d1f/d75/d7e/f8f x:0 0 0 2023-10-08T08:45:31.808 INFO:tasks.workunit.client.0.smithi070.stdout:1/440: chown l1 24581171 1 2023-10-08T08:45:31.808 INFO:tasks.workunit.client.0.smithi070.stdout:1/441: fsync d6/dc/d14/d1f/f45 0 2023-10-08T08:45:31.808 INFO:tasks.workunit.client.0.smithi070.stdout:1/442: write d6/dc/d14/f80 [425605,19514] 0 2023-10-08T08:45:31.808 INFO:tasks.workunit.client.0.smithi070.stdout:1/443: write d6/f11 [9185116,125010] 0 2023-10-08T08:45:31.808 INFO:tasks.workunit.client.0.smithi070.stdout:1/444: write d6/dc/d14/d1f/d75/d7e/f87 [770025,109216] 0 2023-10-08T08:45:31.809 INFO:tasks.workunit.client.0.smithi070.stdout:1/445: dread d6/f65 [0,4194304] 0 2023-10-08T08:45:31.809 INFO:tasks.workunit.client.0.smithi070.stdout:2/411: mknod df/d4c/c80 0 2023-10-08T08:45:31.812 INFO:tasks.workunit.client.0.smithi070.stdout:0/459: creat d1/d62/f85 x:0 0 0 2023-10-08T08:45:31.813 INFO:tasks.workunit.client.0.smithi070.stdout:2/412: symlink df/d12/d15/l81 0 2023-10-08T08:45:31.815 INFO:tasks.workunit.client.0.smithi070.stdout:7/426: getdents d3/d19/d1b/d4a 0 2023-10-08T08:45:31.815 INFO:tasks.workunit.client.0.smithi070.stdout:7/427: readlink d3/d19/d1b/d4a/l44 0 2023-10-08T08:45:31.815 INFO:tasks.workunit.client.0.smithi070.stdout:7/428: readlink d3/l27 0 2023-10-08T08:45:31.817 INFO:tasks.workunit.client.0.smithi070.stdout:0/460: mknod d1/d62/d54/d5e/d80/c86 0 2023-10-08T08:45:31.817 INFO:tasks.workunit.client.0.smithi070.stdout:0/461: readlink d1/d62/d54/d5e/l6e 0 2023-10-08T08:45:31.817 INFO:tasks.workunit.client.0.smithi070.stdout:0/462: chown d1/d62/d54/f58 6 1 2023-10-08T08:45:31.819 INFO:tasks.workunit.client.0.smithi070.stdout:2/413: mkdir df/d12/d1b/d82 0 2023-10-08T08:45:31.821 INFO:tasks.workunit.client.0.smithi070.stdout:7/429: creat d3/d79/f93 x:0 0 0 2023-10-08T08:45:31.821 INFO:tasks.workunit.client.0.smithi070.stdout:7/430: fsync d3/d19/d1b/d1e/d4c/f63 0 2023-10-08T08:45:31.821 INFO:tasks.workunit.client.0.smithi070.stdout:7/431: write d3/f3d [1143273,72549] 0 2023-10-08T08:45:31.821 INFO:tasks.workunit.client.0.smithi070.stdout:7/432: chown d3/d19/c6a 32169236 1 2023-10-08T08:45:31.822 INFO:tasks.workunit.client.0.smithi070.stdout:7/433: fdatasync d3/d19/d1a/f40 0 2023-10-08T08:45:31.822 INFO:tasks.workunit.client.0.smithi070.stdout:2/414: mkdir df/d12/d25/d83 0 2023-10-08T08:45:31.822 INFO:tasks.workunit.client.0.smithi070.stdout:2/415: write df/d12/d15/d34/f78 [640077,34664] 0 2023-10-08T08:45:31.823 INFO:tasks.workunit.client.0.smithi070.stdout:7/434: creat d3/d19/d1b/d4a/d50/f94 x:0 0 0 2023-10-08T08:45:31.824 INFO:tasks.workunit.client.0.smithi070.stdout:7/435: truncate d3/f37 917012 0 2023-10-08T08:45:31.824 INFO:tasks.workunit.client.0.smithi070.stdout:2/416: mknod df/d4c/c84 0 2023-10-08T08:45:31.825 INFO:tasks.workunit.client.0.smithi070.stdout:2/417: chown df/d12/d1b/d1c/d69 400618214 1 2023-10-08T08:45:31.827 INFO:tasks.workunit.client.0.smithi070.stdout:3/376: dwrite d0/d12/d14/f40 [0,4194304] 0 2023-10-08T08:45:31.829 INFO:tasks.workunit.client.0.smithi070.stdout:3/377: symlink d0/d12/d14/d1d/l7d 0 2023-10-08T08:45:31.831 INFO:tasks.workunit.client.0.smithi070.stdout:0/463: dread d1/d14/d1f/f2c [4194304,4194304] 0 2023-10-08T08:45:31.832 INFO:tasks.workunit.client.0.smithi070.stdout:7/436: mkdir d3/d19/d95 0 2023-10-08T08:45:31.833 INFO:tasks.workunit.client.0.smithi070.stdout:3/378: unlink d0/db/d10/d38/f64 0 2023-10-08T08:45:31.834 INFO:tasks.workunit.client.0.smithi070.stdout:3/379: creat d0/db/d10/d38/d2f/f7e x:0 0 0 2023-10-08T08:45:31.840 INFO:tasks.workunit.client.0.smithi070.stdout:1/446: dwrite d6/dc/d14/d1f/f2b [0,4194304] 0 2023-10-08T08:45:31.845 INFO:tasks.workunit.client.0.smithi070.stdout:1/447: rmdir d6/dc/d14/d1f/d75 39 2023-10-08T08:45:31.846 INFO:tasks.workunit.client.0.smithi070.stdout:1/448: mkdir d6/dc/d14/d90 0 2023-10-08T08:45:31.846 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T08:45:31.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T08:45:31.848 INFO:tasks.workunit.client.0.smithi070.stdout:2/418: dwrite df/d12/f37 [0,4194304] 0 2023-10-08T08:45:31.850 INFO:tasks.workunit.client.0.smithi070.stdout:2/419: getdents df/d12 0 2023-10-08T08:45:31.855 INFO:tasks.workunit.client.0.smithi070.stdout:0/464: dwrite d1/dd/f3d [0,4194304] 0 2023-10-08T08:45:31.855 INFO:tasks.workunit.client.0.smithi070.stdout:0/465: chown d1/d14/d1f/c84 12205 1 2023-10-08T08:45:31.855 INFO:tasks.workunit.client.0.smithi070.stdout:1/449: fdatasync d6/f11 0 2023-10-08T08:45:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:1/450: symlink d6/dc/d14/l91 0 2023-10-08T08:45:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:2/420: rename df/d12/d15/d34 to df/d12/d1b/d82/d85 0 2023-10-08T08:45:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:1/451: unlink d6/dc/d14/l56 0 2023-10-08T08:45:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:3/380: dwrite d0/d12/d14/d1d/f78 [0,4194304] 0 2023-10-08T08:45:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:2/421: rename df/d3a/f4b to df/d12/d15/f86 0 2023-10-08T08:45:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:1/452: stat f5 0 2023-10-08T08:45:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:3/381: creat d0/db/f7f x:0 0 0 2023-10-08T08:45:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:2/422: creat df/d12/d15/d54/f87 x:0 0 0 2023-10-08T08:45:31.865 INFO:tasks.workunit.client.0.smithi070.stdout:7/437: dread d3/d19/d1b/d1e/d4c/f63 [0,4194304] 0 2023-10-08T08:45:31.867 INFO:tasks.workunit.client.0.smithi070.stdout:7/438: creat d3/f96 x:0 0 0 2023-10-08T08:45:31.869 INFO:tasks.workunit.client.0.smithi070.stdout:7/439: mkdir d3/d19/d1b/d4a/d9/d97 0 2023-10-08T08:45:31.869 INFO:tasks.workunit.client.0.smithi070.stdout:7/440: stat d3/d19/d1a/f70 0 2023-10-08T08:45:31.870 INFO:tasks.workunit.client.0.smithi070.stdout:7/441: readlink d3/d19/d1b/d4a/l35 0 2023-10-08T08:45:31.875 INFO:tasks.workunit.client.0.smithi070.stdout:2/423: dread df/d12/d25/f3e [0,4194304] 0 2023-10-08T08:45:31.877 INFO:tasks.workunit.client.0.smithi070.stdout:2/424: creat df/d12/d25/d83/f88 x:0 0 0 2023-10-08T08:45:31.878 INFO:tasks.workunit.client.0.smithi070.stdout:2/425: mknod df/d12/d1b/d1c/c89 0 2023-10-08T08:45:31.878 INFO:tasks.workunit.client.0.smithi070.stdout:2/426: chown l1 209111 1 2023-10-08T08:45:31.879 INFO:tasks.workunit.client.0.smithi070.stdout:2/427: creat df/d12/d25/f8a x:0 0 0 2023-10-08T08:45:31.881 INFO:tasks.workunit.client.0.smithi070.stdout:2/428: mknod df/d12/d15/c8b 0 2023-10-08T08:45:31.881 INFO:tasks.workunit.client.0.smithi070.stdout:2/429: chown df/d12/d1b/d1c/d69/c6c 379 1 2023-10-08T08:45:31.883 INFO:tasks.workunit.client.0.smithi070.stdout:2/430: creat df/d12/d1b/f8c x:0 0 0 2023-10-08T08:45:31.884 INFO:tasks.workunit.client.0.smithi070.stdout:1/453: dread d6/dc/d14/d1f/d75/f2f [0,4194304] 0 2023-10-08T08:45:31.884 INFO:tasks.workunit.client.0.smithi070.stdout:2/431: symlink df/d12/l8d 0 2023-10-08T08:45:31.885 INFO:tasks.workunit.client.0.smithi070.stdout:1/454: mknod d6/dc/d14/d1f/c92 0 2023-10-08T08:45:31.886 INFO:tasks.workunit.client.0.smithi070.stdout:2/432: creat df/d12/d7e/f8e x:0 0 0 2023-10-08T08:45:31.888 INFO:tasks.workunit.client.0.smithi070.stdout:1/455: rename d6/c5d to d6/dc/d14/d1f/d75/c93 0 2023-10-08T08:45:31.888 INFO:tasks.workunit.client.0.smithi070.stdout:2/433: mkdir df/d4c/d8f 0 2023-10-08T08:45:31.890 INFO:tasks.workunit.client.0.smithi070.stdout:2/434: link df/d12/d1b/d1c/d2d/l6f df/d12/d25/l90 0 2023-10-08T08:45:31.895 INFO:tasks.workunit.client.0.smithi070.stdout:2/435: write df/d12/f37 [1529801,52308] 0 2023-10-08T08:45:31.895 INFO:tasks.workunit.client.0.smithi070.stdout:0/466: dwrite d1/d1d/d24/f7f [0,4194304] 0 2023-10-08T08:45:31.895 INFO:tasks.workunit.client.0.smithi070.stdout:7/442: dwrite d3/d19/f67 [0,4194304] 0 2023-10-08T08:45:31.899 INFO:tasks.workunit.client.0.smithi070.stdout:7/443: write d3/d19/f67 [3794885,115062] 0 2023-10-08T08:45:31.903 INFO:tasks.workunit.client.0.smithi070.stdout:0/467: mknod d1/d1d/d4d/c87 0 2023-10-08T08:45:31.903 INFO:tasks.workunit.client.0.smithi070.stdout:0/468: chown d1/fa 2888 1 2023-10-08T08:45:31.904 INFO:tasks.workunit.client.0.smithi070.stdout:0/469: link d1/d1d/f52 d1/d76/d7a/f88 0 2023-10-08T08:45:31.908 INFO:tasks.workunit.client.0.smithi070.stdout:7/444: link d3/d19/d1b/d4a/cf d3/d19/d1a/c98 0 2023-10-08T08:45:31.909 INFO:tasks.workunit.client.0.smithi070.stdout:1/456: dwrite d6/dc/d14/d1f/f3c [0,4194304] 0 2023-10-08T08:45:31.909 INFO:tasks.workunit.client.0.smithi070.stdout:1/457: write d6/f3b [795230,10257] 0 2023-10-08T08:45:31.911 INFO:tasks.workunit.client.0.smithi070.stdout:7/445: unlink d3/d19/d1b/d1e/c6b 0 2023-10-08T08:45:31.917 INFO:tasks.workunit.client.0.smithi070.stdout:1/458: link d6/dc/d14/d1f/c35 d6/dc/d14/d90/c94 0 2023-10-08T08:45:31.925 INFO:tasks.workunit.client.0.smithi070.stdout:1/459: mkdir d6/dc/d14/d62/d95 0 2023-10-08T08:45:31.927 INFO:tasks.workunit.client.0.smithi070.stdout:1/460: creat d6/dc/d14/d1f/d26/d38/f96 x:0 0 0 2023-10-08T08:45:31.929 INFO:tasks.workunit.client.0.smithi070.stdout:1/461: mkdir d6/dc/d97 0 2023-10-08T08:45:31.932 INFO:tasks.workunit.client.0.smithi070.stdout:1/462: rename d6/dc/d14/d1f/c92 to d6/dc/d14/d1f/d26/d38/c98 0 2023-10-08T08:45:31.936 INFO:tasks.workunit.client.0.smithi070.stdout:7/446: dwrite d3/d19/d1b/d4a/d9/f74 [0,4194304] 0 2023-10-08T08:45:31.937 INFO:tasks.workunit.client.0.smithi070.stdout:0/470: dread d1/f11 [0,4194304] 0 2023-10-08T08:45:31.937 INFO:tasks.workunit.client.0.smithi070.stdout:2/436: dwrite df/f59 [0,4194304] 0 2023-10-08T08:45:31.938 INFO:tasks.workunit.client.0.smithi070.stdout:1/463: rmdir d6/dc/d14/d1f/d26 39 2023-10-08T08:45:31.938 INFO:tasks.workunit.client.0.smithi070.stdout:1/464: write d6/dc/d14/d1f/d75/f50 [4472611,17388] 0 2023-10-08T08:45:31.938 INFO:tasks.workunit.client.0.smithi070.stdout:1/465: write d6/dc/d14/d1f/d26/d38/f5f [717055,85582] 0 2023-10-08T08:45:31.939 INFO:tasks.workunit.client.0.smithi070.stdout:7/447: creat d3/d19/d1a/f99 x:0 0 0 2023-10-08T08:45:31.941 INFO:tasks.workunit.client.0.smithi070.stdout:1/466: mknod d6/dc/d14/c99 0 2023-10-08T08:45:31.943 INFO:tasks.workunit.client.0.smithi070.stdout:0/471: getdents d1/d1d/d24 0 2023-10-08T08:45:31.946 INFO:tasks.workunit.client.0.smithi070.stdout:1/467: rename d6/l47 to d6/dc/d14/d1f/d75/l9a 0 2023-10-08T08:45:31.946 INFO:tasks.workunit.client.0.smithi070.stdout:1/468: chown d6/dc/d14/c37 1 1 2023-10-08T08:45:31.949 INFO:tasks.workunit.client.0.smithi070.stdout:0/472: truncate d1/dd/d1b/f34 3650318 0 2023-10-08T08:45:31.950 INFO:tasks.workunit.client.0.smithi070.stdout:2/437: dread df/d12/d15/f86 [0,4194304] 0 2023-10-08T08:45:31.950 INFO:tasks.workunit.client.0.smithi070.stdout:2/438: truncate df/d12/d15/d54/f87 905845 0 2023-10-08T08:45:31.950 INFO:tasks.workunit.client.0.smithi070.stdout:7/448: rmdir d3/d19/d1b/d1e 39 2023-10-08T08:45:31.951 INFO:tasks.workunit.client.0.smithi070.stdout:7/449: fdatasync d3/f2b 0 2023-10-08T08:45:31.953 INFO:tasks.workunit.client.0.smithi070.stdout:7/450: creat d3/d19/d1b/d4a/d9/d97/f9a x:0 0 0 2023-10-08T08:45:31.959 INFO:tasks.workunit.client.0.smithi070.stdout:0/473: rmdir d1/d1d 39 2023-10-08T08:45:31.962 INFO:tasks.workunit.client.0.smithi070.stdout:0/474: symlink d1/d1d/l89 0 2023-10-08T08:45:31.968 INFO:tasks.workunit.client.0.smithi070.stdout:2/439: dread f8 [0,4194304] 0 2023-10-08T08:45:31.968 INFO:tasks.workunit.client.0.smithi070.stdout:2/440: truncate df/d12/d1b/d1c/d2d/f58 188652 0 2023-10-08T08:45:31.969 INFO:tasks.workunit.client.0.smithi070.stdout:1/469: dwrite d6/dc/d14/d1f/d26/f60 [0,4194304] 0 2023-10-08T08:45:31.970 INFO:tasks.workunit.client.0.smithi070.stdout:2/441: mkdir df/d4c/d91 0 2023-10-08T08:45:31.971 INFO:tasks.workunit.client.0.smithi070.stdout:1/470: creat d6/dc/d14/d90/f9b x:0 0 0 2023-10-08T08:45:31.972 INFO:tasks.workunit.client.0.smithi070.stdout:1/471: stat d6/dc/d14/d1f/c36 0 2023-10-08T08:45:31.972 INFO:tasks.workunit.client.0.smithi070.stdout:2/442: mkdir df/d12/d25/d83/d92 0 2023-10-08T08:45:31.981 INFO:tasks.workunit.client.0.smithi070.stdout:0/475: dwrite d1/dd/f3d [0,4194304] 0 2023-10-08T08:45:31.982 INFO:tasks.workunit.client.0.smithi070.stdout:0/476: mkdir d1/d62/d54/d5e/d80/d8a 0 2023-10-08T08:45:31.983 INFO:tasks.workunit.client.0.smithi070.stdout:0/477: mknod d1/d14/c8b 0 2023-10-08T08:45:31.999 INFO:tasks.workunit.client.0.smithi070.stdout:2/443: dwrite df/d12/d15/f16 [4194304,4194304] 0 2023-10-08T08:45:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 -- 172.21.15.70:0/1970513277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948105630 msgr2=0x7f6948105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 --2- 172.21.15.70:0/1970513277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948105630 0x7f6948105a10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6944009990 tx=0x7f6944009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 -- 172.21.15.70:0/1970513277 shutdown_connections 2023-10-08T08:45:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 --2- 172.21.15.70:0/1970513277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6948100750 0x7f694810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 --2- 172.21.15.70:0/1970513277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948105630 0x7f6948105a10 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 --2- 172.21.15.70:0/1970513277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69480ffd90 0x7f6948100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 -- 172.21.15.70:0/1970513277 >> 172.21.15.70:0/1970513277 conn(0x7f6948075c20 msgr2=0x7f69480fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 -- 172.21.15.70:0/1970513277 shutdown_connections 2023-10-08T08:45:32.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 -- 172.21.15.70:0/1970513277 wait complete. 2023-10-08T08:45:32.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.014+0000 7f694fef5700 1 Processor -- start 2023-10-08T08:45:32.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694fef5700 1 -- start start 2023-10-08T08:45:32.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694fef5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69480ffd90 0x7f694819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694fef5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948100750 0x7f694819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694fef5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6948105630 0x7f69481958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694fef5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6948195f50 con 0x7f6948100750 2023-10-08T08:45:32.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694fef5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69481960c0 con 0x7f69480ffd90 2023-10-08T08:45:32.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694fef5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6948196280 con 0x7f6948105630 2023-10-08T08:45:32.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694d490700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948100750 0x7f694819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694d490700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948100750 0x7f694819bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52626/0 (socket says 172.21.15.70:52626) 2023-10-08T08:45:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694d490700 1 -- 172.21.15.70:0/2233658256 learned_addr learned my addr 172.21.15.70:0/2233658256 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694dc91700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69480ffd90 0x7f694819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694e492700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6948105630 0x7f69481958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694d490700 1 -- 172.21.15.70:0/2233658256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6948105630 msgr2=0x7f69481958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694d490700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6948105630 0x7f69481958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694d490700 1 -- 172.21.15.70:0/2233658256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69480ffd90 msgr2=0x7f694819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694d490700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69480ffd90 0x7f694819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694d490700 1 -- 172.21.15.70:0/2233658256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69440095f0 con 0x7f6948100750 2023-10-08T08:45:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.015+0000 7f694d490700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948100750 0x7f694819bd00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f693800d980 tx=0x7f693800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.016+0000 7f693effd700 1 -- 172.21.15.70:0/2233658256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938004220 con 0x7f6948100750 2023-10-08T08:45:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.016+0000 7f694fef5700 1 -- 172.21.15.70:0/2233658256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948196560 con 0x7f6948100750 2023-10-08T08:45:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.016+0000 7f693effd700 1 -- 172.21.15.70:0/2233658256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6938007640 con 0x7f6948100750 2023-10-08T08:45:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.016+0000 7f693effd700 1 -- 172.21.15.70:0/2233658256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938005690 con 0x7f6948100750 2023-10-08T08:45:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.016+0000 7f694fef5700 1 -- 172.21.15.70:0/2233658256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69481a27b0 con 0x7f6948100750 2023-10-08T08:45:32.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.018+0000 7f693effd700 1 -- 172.21.15.70:0/2233658256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6938004750 con 0x7f6948100750 2023-10-08T08:45:32.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.018+0000 7f693effd700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f69340a15f0 0x7f69340a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.018+0000 7f694dc91700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f69340a15f0 0x7f69340a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.018+0000 7f693effd700 1 -- 172.21.15.70:0/2233658256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f69380cd140 con 0x7f6948100750 2023-10-08T08:45:32.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.019+0000 7f694dc91700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f69340a15f0 0x7f69340a3ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f69440098e0 tx=0x7f6944005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.019+0000 7f695c0deb80 1 Processor -- start 2023-10-08T08:45:32.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.019+0000 7f695c0deb80 1 -- start start 2023-10-08T08:45:32.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013ddd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 0x55c013ddfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f695c0deb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013d3b4e0 con 0x55c013dd2820 2023-10-08T08:45:32.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f695c0deb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013d2cca0 con 0x55c013ddd6d0 2023-10-08T08:45:32.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f695c0deb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013d2a5c0 con 0x55c013dd1f00 2023-10-08T08:45:32.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694d490700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013ddd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694d490700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013ddd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52634/0 (socket says 172.21.15.70:52634) 2023-10-08T08:45:32.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694dc91700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694d490700 1 -- 172.21.15.70:0/2087931867 learned_addr learned my addr 172.21.15.70:0/2087931867 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694e492700 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 0x55c013ddfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694d490700 1 -- 172.21.15.70:0/2087931867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 msgr2=0x55c013dd22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694d490700 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694d490700 1 -- 172.21.15.70:0/2087931867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 msgr2=0x55c013ddfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694d490700 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 0x55c013ddfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694d490700 1 -- 172.21.15.70:0/2087931867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c013b50e60 con 0x55c013dd2820 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694dc91700 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694e492700 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 0x55c013ddfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f694d490700 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013ddd190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6938099b50 tx=0x7f693809a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc56d29b5ee141d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f6933fff700 1 -- 172.21.15.70:0/2087931867 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380a21e0 con 0x55c013dd2820 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f6933fff700 1 -- 172.21.15.70:0/2087931867 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69380981f0 con 0x55c013dd2820 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.020+0000 7f6933fff700 1 -- 172.21.15.70:0/2087931867 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938099580 con 0x55c013dd2820 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.021+0000 7f695c0deb80 1 -- 172.21.15.70:0/2087931867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 msgr2=0x55c013ddd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.021+0000 7f695c0deb80 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013ddd190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6938099b50 tx=0x7f693809a620 comp rx=0 tx=0).stop 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.021+0000 7f695c0deb80 1 -- 172.21.15.70:0/2087931867 shutdown_connections 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.021+0000 7f695c0deb80 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 0x55c013ddfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.021+0000 7f695c0deb80 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.021+0000 7f695c0deb80 1 --2- 172.21.15.70:0/2087931867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013ddd190 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.021+0000 7f695c0deb80 1 -- 172.21.15.70:0/2087931867 >> 172.21.15.70:0/2087931867 conn(0x55c013d472e0 msgr2=0x55c013dce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.021+0000 7f695c0deb80 1 -- 172.21.15.70:0/2087931867 shutdown_connections 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.021+0000 7f695c0deb80 1 -- 172.21.15.70:0/2087931867 wait complete. 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f695c0deb80 1 -- start start 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f695c0deb80 1 Processor -- start 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd1f00 0x55c013ddd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013dda3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013ddd6d0 0x55c013ddaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f695c0deb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013d25eb0 con 0x55c013dd1f00 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f695c0deb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013cc2790 con 0x55c013dd2820 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f695c0deb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013cc2430 con 0x55c013ddd6d0 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f695c0deb80 10 client.0 _ll_register_callbacks cb 0x55c013b1f880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694dc91700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd1f00 0x55c013ddd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694dc91700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd1f00 0x55c013ddd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52638/0 (socket says 172.21.15.70:52638) 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694dc91700 1 -- 172.21.15.70:0/3480831030 learned_addr learned my addr 172.21.15.70:0/3480831030 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694d490700 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013dda3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694e492700 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013ddd6d0 0x55c013ddaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694dc91700 1 -- 172.21.15.70:0/3480831030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013ddd6d0 msgr2=0x55c013ddaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694dc91700 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013ddd6d0 0x55c013ddaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694dc91700 1 -- 172.21.15.70:0/3480831030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 msgr2=0x55c013dda3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694dc91700 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013dda3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694dc91700 1 -- 172.21.15.70:0/3480831030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694810cdf0 con 0x55c013dd1f00 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694d490700 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013dda3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.022+0000 7f694e492700 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013ddd6d0 0x55c013ddaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f694dc91700 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd1f00 0x55c013ddd0f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6944009990 tx=0x7f6944009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ac3bdcbe6dc5da server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f69317fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f69317fa700 1 -- 172.21.15.70:0/3480831030 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944029050 con 0x55c013dd1f00 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f69317fa700 1 -- 172.21.15.70:0/3480831030 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f694400f660 con 0x55c013dd1f00 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f695c0deb80 1 -- 172.21.15.70:0/3480831030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c013cedf30 con 0x55c013dd1f00 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f69317fa700 1 -- 172.21.15.70:0/3480831030 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f694400bb30 con 0x55c013dd1f00 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f695c0deb80 10 client.16374 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f695c0deb80 1 -- 172.21.15.70:0/3480831030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f69481a27b0 con 0x55c013dd1f00 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f69317fa700 1 -- 172.21.15.70:0/3480831030 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c013cedf30 con 0x55c013dd1f00 2023-10-08T08:45:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f69317fa700 1 -- 172.21.15.70:0/3480831030 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6944022910 con 0x55c013dd1f00 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f695c0deb80 10 client.16374 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f695c0deb80 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f695c0deb80 20 client.16374 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f695c0deb80 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55c013ded280 0x55c013def6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f695c0deb80 4 client.16374 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.023+0000 7f695c0deb80 1 -- 172.21.15.70:0/3480831030 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c013d1ee90 con 0x55c013ded280 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.024+0000 7f694d490700 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55c013ded280 0x55c013def6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.024+0000 7f69317fa700 10 client.16374 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.024+0000 7f694d490700 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55c013ded280 0x55c013def6a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e2a73aa71760f61 server_cookie=830ed2a17813d929 in_seq=0 out_seq=0 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.024+0000 7f69317fa700 1 -- 172.21.15.70:0/3480831030 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c013d1ee90 con 0x55c013ded280 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.024+0000 7f69317fa700 10 client.16374 handle_command_reply: tid=0 2023-10-08T08:45:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.024+0000 7f695c0deb80 1 client.16374 shutdown 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 -- 172.21.15.70:0/3480831030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd1f00 msgr2=0x55c013ddd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd1f00 0x55c013ddd0f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6944009990 tx=0x7f6944009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 -- 172.21.15.70:0/3480831030 shutdown_connections 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013ddd6d0 0x55c013ddaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd1f00 0x55c013ddd0f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55c013ded280 0x55c013def6a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 --2- 172.21.15.70:0/3480831030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013dda3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f69317fa700 0 client.16374 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 -- 172.21.15.70:0/3480831030 >> 172.21.15.70:0/3480831030 conn(0x55c013d472e0 msgr2=0x55c013dcdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 -- 172.21.15.70:0/3480831030 shutdown_connections 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 1 -- 172.21.15.70:0/3480831030 wait complete. 2023-10-08T08:45:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.025+0000 7f695c0deb80 20 client.16374 trim_cache size 0 max 16384 2023-10-08T08:45:32.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.041+0000 7f695c0deb80 1 Processor -- start 2023-10-08T08:45:32.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.041+0000 7f695c0deb80 1 -- start start 2023-10-08T08:45:32.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013de91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013ddd6d0 0x55c013dd4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f695c0deb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013ba69a0 con 0x55c013ddd6d0 2023-10-08T08:45:32.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f695c0deb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013dd5310 con 0x55c013dd2820 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f695c0deb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013dcefa0 con 0x55c013dd1f00 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694e492700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013ddd6d0 0x55c013dd4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694e492700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013ddd6d0 0x55c013dd4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52650/0 (socket says 172.21.15.70:52650) 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694e492700 1 -- 172.21.15.70:0/2949710842 learned_addr learned my addr 172.21.15.70:0/2949710842 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694dc91700 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694d490700 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013de91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694e492700 1 -- 172.21.15.70:0/2949710842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 msgr2=0x55c013dd9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694e492700 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694e492700 1 -- 172.21.15.70:0/2949710842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 msgr2=0x55c013de91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694e492700 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013de91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694e492700 1 -- 172.21.15.70:0/2949710842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c013b39ce0 con 0x55c013ddd6d0 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694dc91700 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694d490700 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013de91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f694e492700 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013ddd6d0 0x55c013dd4dd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6940003fa0 tx=0x7f6940009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c2d87f611f9e81 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f693cff9700 1 -- 172.21.15.70:0/2949710842 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940004910 con 0x55c013ddd6d0 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f693cff9700 1 -- 172.21.15.70:0/2949710842 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f694000f040 con 0x55c013ddd6d0 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.042+0000 7f693cff9700 1 -- 172.21.15.70:0/2949710842 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400167e0 con 0x55c013ddd6d0 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 -- 172.21.15.70:0/2949710842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013ddd6d0 msgr2=0x55c013dd4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013ddd6d0 0x55c013dd4dd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6940003fa0 tx=0x7f6940009c20 comp rx=0 tx=0).stop 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 -- 172.21.15.70:0/2949710842 shutdown_connections 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013ddd6d0 0x55c013dd4dd0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013dd9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 --2- 172.21.15.70:0/2949710842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013dd2820 0x55c013de91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 -- 172.21.15.70:0/2949710842 >> 172.21.15.70:0/2949710842 conn(0x55c013d472e0 msgr2=0x55c013dd9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 -- 172.21.15.70:0/2949710842 shutdown_connections 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 -- 172.21.15.70:0/2949710842 wait complete. 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 -- start start 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.043+0000 7f695c0deb80 1 Processor -- start 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013e3b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013e3bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f695c0deb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 0x55c013de3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f695c0deb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013de3dd0 con 0x55c013dd2820 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f695c0deb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013de3f40 con 0x55c013ddd6d0 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f695c0deb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c013de4100 con 0x55c013dd1f00 2023-10-08T08:45:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f695c0deb80 10 client.0 _ll_register_callbacks cb 0x7f69440053e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694d490700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013e3bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694d490700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013e3bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52654/0 (socket says 172.21.15.70:52654) 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694d490700 1 -- 172.21.15.70:0/1900043682 learned_addr learned my addr 172.21.15.70:0/1900043682 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694dc91700 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013e3b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694e492700 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 0x55c013de3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694d490700 1 -- 172.21.15.70:0/1900043682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 msgr2=0x55c013e3b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694d490700 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013e3b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694d490700 1 -- 172.21.15.70:0/1900043682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 msgr2=0x55c013de3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694d490700 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 0x55c013de3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694d490700 1 -- 172.21.15.70:0/1900043682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6940003c80 con 0x55c013dd2820 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f694d490700 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013e3bec0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6938017000 tx=0x7f693809a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2846e270ea5df447 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f69317fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f69317fa700 1 -- 172.21.15.70:0/1900043682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380b8040 con 0x55c013dd2820 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f69317fa700 1 -- 172.21.15.70:0/1900043682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f69380a21e0 con 0x55c013dd2820 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.044+0000 7f695c0deb80 1 -- 172.21.15.70:0/1900043682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69380981f0 con 0x55c013dd2820 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f69317fa700 1 -- 172.21.15.70:0/1900043682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6938099340 con 0x55c013dd2820 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f695c0deb80 10 client.16380 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f695c0deb80 1 -- 172.21.15.70:0/1900043682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55c013b772d0 con 0x55c013dd2820 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f69317fa700 1 -- 172.21.15.70:0/1900043682 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69380981f0 con 0x55c013dd2820 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f69317fa700 1 -- 172.21.15.70:0/1900043682 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f693805fbd0 con 0x55c013dd2820 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f695c0deb80 10 client.16380 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f695c0deb80 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f695c0deb80 20 client.16380 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f695c0deb80 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55c013e434b0 0x55c013e458d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f695c0deb80 4 client.16380 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T08:45:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f695c0deb80 1 -- 172.21.15.70:0/1900043682 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c013d1ebb0 con 0x55c013e434b0 2023-10-08T08:45:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.045+0000 7f694dc91700 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55c013e434b0 0x55c013e458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.046+0000 7f69317fa700 10 client.16380 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.046+0000 7f694dc91700 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55c013e434b0 0x55c013e458d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4b52ef5736b009c server_cookie=8ebca3e8ca69fa4f in_seq=0 out_seq=0 2023-10-08T08:45:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f69317fa700 1 -- 172.21.15.70:0/1900043682 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c013d1ebb0 con 0x55c013e434b0 2023-10-08T08:45:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f69317fa700 10 client.16380 handle_command_reply: tid=0 2023-10-08T08:45:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 client.16380 shutdown 2023-10-08T08:45:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 -- 172.21.15.70:0/1900043682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 msgr2=0x55c013e3bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013e3bec0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6938017000 tx=0x7f693809a570 comp rx=0 tx=0).stop 2023-10-08T08:45:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 -- 172.21.15.70:0/1900043682 shutdown_connections 2023-10-08T08:45:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55c013e434b0 0x55c013e458d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c013ddd6d0 0x55c013de3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c013dd1f00 0x55c013e3b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 --2- 172.21.15.70:0/1900043682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c013dd2820 0x55c013e3bec0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f69317fa700 0 client.16380 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 -- 172.21.15.70:0/1900043682 >> 172.21.15.70:0/1900043682 conn(0x55c013d472e0 msgr2=0x55c013dd9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 -- 172.21.15.70:0/1900043682 shutdown_connections 2023-10-08T08:45:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 1 -- 172.21.15.70:0/1900043682 wait complete. 2023-10-08T08:45:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.047+0000 7f695c0deb80 20 client.16380 trim_cache size 0 max 16384 2023-10-08T08:45:32.055 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:45:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2023-10-08T08:45:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "1fdc564a-5636-4203-adbe-f48f96886df6", 2023-10-08T08:45:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2023-10-08T08:45:32.056 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 -- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f69340a15f0 msgr2=0x7f69340a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f69340a15f0 0x7f69340a3ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f69440098e0 tx=0x7f6944005960 comp rx=0 tx=0).stop 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 -- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948100750 msgr2=0x7f694819bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948100750 0x7f694819bd00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f693800d980 tx=0x7f693800dc90 comp rx=0 tx=0).stop 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 -- 172.21.15.70:0/2233658256 shutdown_connections 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f69340a15f0 0x7f69340a3ab0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6948105630 0x7f69481958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69480ffd90 0x7f694819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 --2- 172.21.15.70:0/2233658256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6948100750 0x7f694819bd00 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 -- 172.21.15.70:0/2233658256 >> 172.21.15.70:0/2233658256 conn(0x7f6948075c20 msgr2=0x7f69480fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 -- 172.21.15.70:0/2233658256 shutdown_connections 2023-10-08T08:45:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.048+0000 7f694fef5700 1 -- 172.21.15.70:0/2233658256 wait complete. 2023-10-08T08:45:32.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:45:32.075 INFO:tasks.workunit.client.0.smithi070.stdout:1/472: dwrite d6/dc/d14/d1f/d26/f31 [0,4194304] 0 2023-10-08T08:45:32.075 INFO:tasks.workunit.client.0.smithi070.stdout:1/473: fsync d6/dc/f85 0 2023-10-08T08:45:32.078 INFO:tasks.workunit.client.0.smithi070.stdout:1/474: unlink d6/dc/f13 0 2023-10-08T08:45:32.078 INFO:tasks.workunit.client.0.smithi070.stdout:1/475: chown d6/dc/d14/d1f/d26/c48 1087 1 2023-10-08T08:45:32.079 INFO:tasks.workunit.client.0.smithi070.stdout:0/478: dwrite d1/d62/f85 [0,4194304] 0 2023-10-08T08:45:32.082 INFO:tasks.workunit.client.0.smithi070.stdout:0/479: creat d1/d62/d38/f8c x:0 0 0 2023-10-08T08:45:32.082 INFO:tasks.workunit.client.0.smithi070.stdout:0/480: chown d1/d62/f55 1 1 2023-10-08T08:45:32.088 INFO:tasks.workunit.client.0.smithi070.stdout:2/444: dwrite df/d12/d1b/d82/d85/f70 [0,4194304] 0 2023-10-08T08:45:32.088 INFO:tasks.workunit.client.0.smithi070.stdout:2/445: chown df/d12/d15/c8b 2139092 1 2023-10-08T08:45:32.088 INFO:tasks.workunit.client.0.smithi070.stdout:0/481: rename d1/fb to d1/dd/f8d 0 2023-10-08T08:45:32.088 INFO:tasks.workunit.client.0.smithi070.stdout:2/446: dread df/d12/d15/d54/f87 [0,4194304] 0 2023-10-08T08:45:32.092 INFO:tasks.workunit.client.0.smithi070.stdout:2/447: write df/d4c/f4f [199019,124359] 0 2023-10-08T08:45:32.096 INFO:tasks.workunit.client.0.smithi070.stdout:0/482: creat d1/d1d/f8e x:0 0 0 2023-10-08T08:45:32.096 INFO:tasks.workunit.client.0.smithi070.stdout:1/476: dread d6/dc/d14/d1f/f2b [0,4194304] 0 2023-10-08T08:45:32.097 INFO:tasks.workunit.client.0.smithi070.stdout:2/448: truncate df/d12/d15/d54/f5a 2064119 0 2023-10-08T08:45:32.102 INFO:tasks.workunit.client.0.smithi070.stdout:1/477: creat d6/dc/d14/d1f/f9c x:0 0 0 2023-10-08T08:45:32.106 INFO:tasks.workunit.client.0.smithi070.stdout:1/478: rename d6/dc/d14/d1f/f4c to d6/dc/d14/d70/f9d 0 2023-10-08T08:45:32.108 INFO:tasks.workunit.client.0.smithi070.stdout:1/479: symlink d6/dc/d14/d62/d95/l9e 0 2023-10-08T08:45:32.108 INFO:tasks.workunit.client.0.smithi070.stdout:1/480: truncate d6/dc/d14/d62/f77 696022 0 2023-10-08T08:45:32.108 INFO:tasks.workunit.client.0.smithi070.stdout:0/483: dread d1/dd/f53 [0,4194304] 0 2023-10-08T08:45:32.111 INFO:tasks.workunit.client.0.smithi070.stdout:0/484: write d1/d1d/d24/f71 [1618267,117020] 0 2023-10-08T08:45:32.111 INFO:tasks.workunit.client.0.smithi070.stdout:1/481: creat d6/dc/d14/d1f/d26/d38/f9f x:0 0 0 2023-10-08T08:45:32.111 INFO:tasks.workunit.client.0.smithi070.stdout:0/485: chown d1/d14/f35 4138 1 2023-10-08T08:45:32.118 INFO:tasks.workunit.client.0.smithi070.stdout:2/449: dwrite df/f11 [0,4194304] 0 2023-10-08T08:45:32.118 INFO:tasks.workunit.client.0.smithi070.stdout:0/486: creat d1/d62/d54/d5e/d80/f8f x:0 0 0 2023-10-08T08:45:32.118 INFO:tasks.workunit.client.0.smithi070.stdout:0/487: chown d1/d14/d1f/c84 22378381 1 2023-10-08T08:45:32.118 INFO:tasks.workunit.client.0.smithi070.stdout:0/488: stat d1/d14/f43 0 2023-10-08T08:45:32.121 INFO:tasks.workunit.client.0.smithi070.stdout:0/489: creat d1/dd/d1b/f90 x:0 0 0 2023-10-08T08:45:32.128 INFO:tasks.workunit.client.0.smithi070.stdout:1/482: rmdir d6/dc/d14/d1f/d26/d38 39 2023-10-08T08:45:32.128 INFO:tasks.workunit.client.0.smithi070.stdout:2/450: write df/d12/f37 [116502,119637] 0 2023-10-08T08:45:32.142 INFO:tasks.workunit.client.0.smithi070.stdout:2/451: dread df/d12/d25/f72 [0,4194304] 0 2023-10-08T08:45:32.142 INFO:tasks.workunit.client.0.smithi070.stdout:2/452: readlink df/l13 0 2023-10-08T08:45:32.142 INFO:tasks.workunit.client.0.smithi070.stdout:2/453: mkdir df/d93 0 2023-10-08T08:45:32.145 INFO:tasks.workunit.client.0.smithi070.stdout:1/483: dread d6/dc/d14/d1f/f72 [0,4194304] 0 2023-10-08T08:45:32.145 INFO:tasks.workunit.client.0.smithi070.stdout:1/484: chown d6/c7c 698 1 2023-10-08T08:45:32.145 INFO:tasks.workunit.client.0.smithi070.stdout:1/485: fsync d6/dc/f2d 0 2023-10-08T08:45:32.147 INFO:tasks.workunit.client.0.smithi070.stdout:0/490: dwrite d1/d1d/d24/f36 [0,4194304] 0 2023-10-08T08:45:32.147 INFO:tasks.workunit.client.0.smithi070.stdout:0/491: fdatasync d1/d62/d54/f58 0 2023-10-08T08:45:32.171 INFO:tasks.workunit.client.0.smithi070.stdout:2/454: dwrite df/d12/d1b/d1c/f5d [0,4194304] 0 2023-10-08T08:45:32.171 INFO:tasks.workunit.client.0.smithi070.stdout:2/455: write df/d73/f7f [916214,3877] 0 2023-10-08T08:45:32.171 INFO:tasks.workunit.client.0.smithi070.stdout:2/456: dread - df/d12/d25/f8a zero size 2023-10-08T08:45:32.172 INFO:tasks.workunit.client.0.smithi070.stdout:0/492: dwrite d1/dd/f13 [4194304,4194304] 0 2023-10-08T08:45:32.184 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:32 smithi070 ceph-mon[99513]: pgmap v343: 129 pgs: 129 active+clean; 696 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s rd, 107 MiB/s wr, 1.47k op/s 2023-10-08T08:45:32.188 INFO:tasks.workunit.client.0.smithi070.stdout:1/486: dwrite d6/dc/d14/d1f/d75/d7e/f8f [0,4194304] 0 2023-10-08T08:45:32.189 INFO:tasks.workunit.client.0.smithi070.stdout:2/457: rmdir df/d3a 39 2023-10-08T08:45:32.191 INFO:tasks.workunit.client.0.smithi070.stdout:2/458: read df/d12/d25/f2a [1054680,71744] 0 2023-10-08T08:45:32.195 INFO:tasks.workunit.client.0.smithi070.stdout:2/459: creat df/d12/d15/f94 x:0 0 0 2023-10-08T08:45:32.195 INFO:tasks.workunit.client.0.smithi070.stdout:2/460: fsync df/d12/d15/f42 0 2023-10-08T08:45:32.198 INFO:tasks.workunit.client.0.smithi070.stdout:0/493: dwrite d1/dd/f8d [0,4194304] 0 2023-10-08T08:45:32.200 INFO:tasks.workunit.client.0.smithi070.stdout:0/494: mknod d1/d62/d54/d5e/c91 0 2023-10-08T08:45:32.203 INFO:tasks.workunit.client.0.smithi070.stdout:0/495: dread d1/f7 [0,4194304] 0 2023-10-08T08:45:32.203 INFO:tasks.workunit.client.0.smithi070.stdout:0/496: write d1/d1d/f69 [463071,21589] 0 2023-10-08T08:45:32.205 INFO:tasks.workunit.client.0.smithi070.stdout:0/497: mknod d1/d14/d1f/d6f/c92 0 2023-10-08T08:45:32.218 INFO:tasks.workunit.client.0.smithi070.stdout:2/461: dread fc [0,4194304] 0 2023-10-08T08:45:32.218 INFO:tasks.workunit.client.0.smithi070.stdout:2/462: stat df/f5c 0 2023-10-08T08:45:32.219 INFO:tasks.workunit.client.0.smithi070.stdout:1/487: dwrite d6/f65 [0,4194304] 0 2023-10-08T08:45:32.219 INFO:tasks.workunit.client.0.smithi070.stdout:1/488: write d6/f1b [1242451,75597] 0 2023-10-08T08:45:32.220 INFO:tasks.workunit.client.0.smithi070.stdout:2/463: read df/d12/d25/f3e [2767428,8828] 0 2023-10-08T08:45:32.220 INFO:tasks.workunit.client.0.smithi070.stdout:2/464: write df/d12/d25/f7d [945541,52360] 0 2023-10-08T08:45:32.224 INFO:tasks.workunit.client.0.smithi070.stdout:1/489: rename d6/dc/d14/d1f/f3c to d6/dc/d14/fa0 0 2023-10-08T08:45:32.226 INFO:tasks.workunit.client.0.smithi070.stdout:2/465: getdents df/d3a 0 2023-10-08T08:45:32.230 INFO:tasks.workunit.client.0.smithi070.stdout:2/466: creat df/d4c/d8f/f95 x:0 0 0 2023-10-08T08:45:32.235 INFO:tasks.workunit.client.0.smithi070.stdout:2/467: symlink df/d3a/l96 0 2023-10-08T08:45:32.235 INFO:tasks.workunit.client.0.smithi070.stdout:2/468: dread - df/d12/d15/f94 zero size 2023-10-08T08:45:32.235 INFO:tasks.workunit.client.0.smithi070.stdout:0/498: dwrite d1/d1d/f52 [0,4194304] 0 2023-10-08T08:45:32.237 INFO:tasks.workunit.client.0.smithi070.stdout:2/469: symlink df/d12/d25/d83/l97 0 2023-10-08T08:45:32.238 INFO:tasks.workunit.client.0.smithi070.stdout:0/499: symlink d1/d62/l93 0 2023-10-08T08:45:32.240 INFO:tasks.workunit.client.0.smithi070.stdout:2/470: unlink df/c48 0 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.251+0000 7f2c69744700 1 -- 172.21.15.70:0/1557836762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c641056b0 msgr2=0x7f2c64105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.251+0000 7f2c69744700 1 --2- 172.21.15.70:0/1557836762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c641056b0 0x7f2c64105a90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009990 tx=0x7f2c54009ca0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.252+0000 7f2c69744700 1 -- 172.21.15.70:0/1557836762 shutdown_connections 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.252+0000 7f2c69744700 1 --2- 172.21.15.70:0/1557836762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c640fffe0 0x7f2c64067830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.252+0000 7f2c69744700 1 --2- 172.21.15.70:0/1557836762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c641056b0 0x7f2c64105a90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.252+0000 7f2c69744700 1 --2- 172.21.15.70:0/1557836762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640ff620 0x7f2c640ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.252+0000 7f2c69744700 1 -- 172.21.15.70:0/1557836762 >> 172.21.15.70:0/1557836762 conn(0x7f2c64076780 msgr2=0x7f2c64076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.252+0000 7f2c69744700 1 -- 172.21.15.70:0/1557836762 shutdown_connections 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.252+0000 7f2c69744700 1 -- 172.21.15.70:0/1557836762 wait complete. 2023-10-08T08:45:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.253+0000 7f2c69744700 1 Processor -- start 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.253+0000 7f2c69744700 1 -- start start 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.253+0000 7f2c69744700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c640ff620 0x7f2c641122c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.253+0000 7f2c69744700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640fffe0 0x7f2c6410f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.253+0000 7f2c69744700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c641056b0 0x7f2c6410f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.253+0000 7f2c69744700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6410ff70 con 0x7f2c640ff620 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.253+0000 7f2c69744700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c641100e0 con 0x7f2c641056b0 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.253+0000 7f2c69744700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6419ef60 con 0x7f2c640fffe0 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.254+0000 7f2c637fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c641056b0 0x7f2c6410f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.254+0000 7f2c637fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c641056b0 0x7f2c6410f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40126/0 (socket says 172.21.15.70:40126) 2023-10-08T08:45:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.254+0000 7f2c637fe700 1 -- 172.21.15.70:0/2076759820 learned_addr learned my addr 172.21.15.70:0/2076759820 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.254+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c640ff620 0x7f2c641122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.254+0000 7f2c5bfff700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640fffe0 0x7f2c6410f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c637fe700 1 -- 172.21.15.70:0/2076759820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640fffe0 msgr2=0x7f2c6410f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c637fe700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640fffe0 0x7f2c6410f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c637fe700 1 -- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c640ff620 msgr2=0x7f2c641122c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c637fe700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c640ff620 0x7f2c641122c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c637fe700 1 -- 172.21.15.70:0/2076759820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c540095f0 con 0x7f2c641056b0 2023-10-08T08:45:32.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c637fe700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c641056b0 0x7f2c6410f8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c007ee0 tx=0x7f2c5c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.258 INFO:tasks.workunit.client.0.smithi070.stdout:1/490: dwrite d6/dc/d14/d1f/f32 [0,4194304] 0 2023-10-08T08:45:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c60ff9700 1 -- 172.21.15.70:0/2076759820 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c017070 con 0x7f2c641056b0 2023-10-08T08:45:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c60ff9700 1 -- 172.21.15.70:0/2076759820 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c5c00f040 con 0x7f2c641056b0 2023-10-08T08:45:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c60ff9700 1 -- 172.21.15.70:0/2076759820 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c005740 con 0x7f2c641056b0 2023-10-08T08:45:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c69744700 1 -- 172.21.15.70:0/2076759820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6419f240 con 0x7f2c641056b0 2023-10-08T08:45:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.255+0000 7f2c69744700 1 -- 172.21.15.70:0/2076759820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6419f700 con 0x7f2c641056b0 2023-10-08T08:45:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.258+0000 7f2c60ff9700 1 -- 172.21.15.70:0/2076759820 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2c5c0058a0 con 0x7f2c641056b0 2023-10-08T08:45:32.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.259+0000 7f2c60ff9700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2c500a1670 0x7f2c500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.259+0000 7f2c60ff9700 1 -- 172.21.15.70:0/2076759820 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2c5c0ccbd0 con 0x7f2c641056b0 2023-10-08T08:45:32.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.260+0000 7f2c7592db80 1 Processor -- start 2023-10-08T08:45:32.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.260+0000 7f2c7592db80 1 -- start start 2023-10-08T08:45:32.261 INFO:tasks.workunit.client.0.smithi070.stdout:0/500: dwrite d1/d1d/f51 [0,4194304] 0 2023-10-08T08:45:32.261 INFO:tasks.workunit.client.0.smithi070.stdout:0/501: readlink d1/d1d/l61 0 2023-10-08T08:45:32.261 INFO:tasks.workunit.client.0.smithi070.stdout:0/502: write d1/d62/d54/f73 [1102903,109214] 0 2023-10-08T08:45:32.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/503: chown d1/dd/le 3829 1 2023-10-08T08:45:32.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.260+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668d9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.260+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668d97a0 0x560e668e4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.260+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668e4650 0x560e668e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.260+0000 7f2c7592db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e66842460 con 0x560e668e4650 2023-10-08T08:45:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c7592db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e66833c20 con 0x560e668d8e80 2023-10-08T08:45:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c7592db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e66831540 con 0x560e668d97a0 2023-10-08T08:45:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c62ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668d9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c62ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668d9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40132/0 (socket says 172.21.15.70:40132) 2023-10-08T08:45:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c62ffd700 1 -- 172.21.15.70:0/2571411795 learned_addr learned my addr 172.21.15.70:0/2571411795 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c637fe700 1 --2- 172.21.15.70:0/2571411795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668e4650 0x560e668e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.263 INFO:tasks.workunit.client.0.smithi070.stdout:2/471: dread df/d12/d15/f17 [0,4194304] 0 2023-10-08T08:45:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c637fe700 1 -- 172.21.15.70:0/2571411795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668d97a0 msgr2=0x560e668e4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c637fe700 1 --2- 172.21.15.70:0/2571411795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668d97a0 0x560e668e4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c637fe700 1 -- 172.21.15.70:0/2571411795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 msgr2=0x560e668d9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c637fe700 1 --2- 172.21.15.70:0/2571411795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668d9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.261+0000 7f2c637fe700 1 -- 172.21.15.70:0/2571411795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e66657de0 con 0x560e668e4650 2023-10-08T08:45:32.265 INFO:tasks.workunit.client.0.smithi070.stdout:1/491: mkdir d6/dc/d14/d1f/d75/da1 0 2023-10-08T08:45:32.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.262+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2c500a1670 0x7f2c500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.262+0000 7f2c637fe700 1 --2- 172.21.15.70:0/2571411795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668e4650 0x560e668e6a40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0ca050 tx=0x7f2c5c00df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4deae3ac38682a3d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.262+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2c500a1670 0x7f2c500a3b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2c54003730 tx=0x7f2c54005040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.263+0000 7f2c597fa700 1 -- 172.21.15.70:0/2571411795 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c09ae90 con 0x560e668e4650 2023-10-08T08:45:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.263+0000 7f2c597fa700 1 -- 172.21.15.70:0/2571411795 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c5c09a790 con 0x560e668e4650 2023-10-08T08:45:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.263+0000 7f2c597fa700 1 -- 172.21.15.70:0/2571411795 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c085220 con 0x560e668e4650 2023-10-08T08:45:32.266 INFO:tasks.workunit.client.0.smithi070.stdout:1/492: read d6/dc/d14/d1f/d75/f50 [3653180,74924] 0 2023-10-08T08:45:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.264+0000 7f2c7592db80 1 -- 172.21.15.70:0/2571411795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668e4650 msgr2=0x560e668e6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.264+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2571411795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668e4650 0x560e668e6a40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0ca050 tx=0x7f2c5c00df60 comp rx=0 tx=0).stop 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.264+0000 7f2c7592db80 1 -- 172.21.15.70:0/2571411795 shutdown_connections 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.264+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2571411795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668e4650 0x560e668e6a40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.264+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2571411795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668d9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.264+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2571411795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668d97a0 0x560e668e4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.264+0000 7f2c7592db80 1 -- 172.21.15.70:0/2571411795 >> 172.21.15.70:0/2571411795 conn(0x560e6684e260 msgr2=0x560e668d52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.264+0000 7f2c7592db80 1 -- 172.21.15.70:0/2571411795 shutdown_connections 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.264+0000 7f2c7592db80 1 -- 172.21.15.70:0/2571411795 wait complete. 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.265+0000 7f2c7592db80 1 -- start start 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.265+0000 7f2c7592db80 1 Processor -- start 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.265+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.265+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d97a0 0x560e668e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.265+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.266+0000 7f2c7592db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e6682ce30 con 0x560e668d97a0 2023-10-08T08:45:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.266+0000 7f2c7592db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e667c9710 con 0x560e668d8e80 2023-10-08T08:45:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.266+0000 7f2c7592db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e667c93b0 con 0x560e668e4650 2023-10-08T08:45:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.266+0000 7f2c7592db80 10 client.0 _ll_register_callbacks cb 0x560e66626800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.266+0000 7f2c62ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.266+0000 7f2c62ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668e40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40138/0 (socket says 172.21.15.70:40138) 2023-10-08T08:45:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.266+0000 7f2c62ffd700 1 -- 172.21.15.70:0/1445075034 learned_addr learned my addr 172.21.15.70:0/1445075034 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.266+0000 7f2c637fe700 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.270 INFO:tasks.workunit.client.0.smithi070.stdout:0/504: link d1/d1d/f77 d1/d1d/d24/f94 0 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.267+0000 7f2c62ffd700 1 -- 172.21.15.70:0/1445075034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 msgr2=0x560e668e1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.267+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668e1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.267+0000 7f2c5bfff700 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d97a0 0x560e668e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.267+0000 7f2c62ffd700 1 -- 172.21.15.70:0/1445075034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d97a0 msgr2=0x560e668e13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.267+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d97a0 0x560e668e13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.267+0000 7f2c62ffd700 1 -- 172.21.15.70:0/1445075034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6419f700 con 0x560e668d8e80 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.267+0000 7f2c5bfff700 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d97a0 0x560e668e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.267+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668e40c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c5400b920 tx=0x7f2c54005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=399feb697db1c767 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.267+0000 7f2c4a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:45:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.268+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/1445075034 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c540056c0 con 0x560e668d8e80 2023-10-08T08:45:32.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.268+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/1445075034 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2c5402a460 con 0x560e668d8e80 2023-10-08T08:45:32.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.268+0000 7f2c7592db80 1 -- 172.21.15.70:0/1445075034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e667f4eb0 con 0x560e668d8e80 2023-10-08T08:45:32.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.268+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/1445075034 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c5402a620 con 0x560e668d8e80 2023-10-08T08:45:32.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.268+0000 7f2c7592db80 10 client.25805 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:32.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.268+0000 7f2c7592db80 1 -- 172.21.15.70:0/1445075034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560e66640c60 con 0x560e668d8e80 2023-10-08T08:45:32.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.269+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/1445075034 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560e667f4eb0 con 0x560e668d8e80 2023-10-08T08:45:32.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.269+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/1445075034 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2c5400f950 con 0x560e668d8e80 2023-10-08T08:45:32.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.269+0000 7f2c7592db80 10 client.25805 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:32.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.269+0000 7f2c7592db80 10 client.25805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.269+0000 7f2c7592db80 20 client.25805 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.269+0000 7f2c7592db80 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560e668f4290 0x560e668f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.269+0000 7f2c7592db80 4 client.25805 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.269+0000 7f2c7592db80 1 -- 172.21.15.70:0/1445075034 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e66825e10 con 0x560e668f4290 2023-10-08T08:45:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.270+0000 7f2c5bfff700 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560e668f4290 0x560e668f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.271+0000 7f2c4a7fc700 10 client.25805 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:32.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.271+0000 7f2c5bfff700 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560e668f4290 0x560e668f66b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=550e4a1ee64162 server_cookie=92e629bdbde6ad26 in_seq=0 out_seq=0 2023-10-08T08:45:32.274 INFO:tasks.workunit.client.0.smithi070.stdout:0/505: unlink d1/f11 0 2023-10-08T08:45:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/1445075034 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e66825e10 con 0x560e668f4290 2023-10-08T08:45:32.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c4a7fc700 10 client.25805 handle_command_reply: tid=0 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 client.25805 shutdown 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 -- 172.21.15.70:0/1445075034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 msgr2=0x560e668e40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668e40c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c5400b920 tx=0x7f2c54005fd0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 -- 172.21.15.70:0/1445075034 shutdown_connections 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668e1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560e668f4290 0x560e668f66b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d8e80 0x560e668e40c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 --2- 172.21.15.70:0/1445075034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d97a0 0x560e668e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c4a7fc700 0 client.25805 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 -- 172.21.15.70:0/1445075034 >> 172.21.15.70:0/1445075034 conn(0x560e6684e260 msgr2=0x560e668d4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 -- 172.21.15.70:0/1445075034 shutdown_connections 2023-10-08T08:45:32.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 1 -- 172.21.15.70:0/1445075034 wait complete. 2023-10-08T08:45:32.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.272+0000 7f2c7592db80 20 client.25805 trim_cache size 0 max 16384 2023-10-08T08:45:32.277 INFO:tasks.workunit.client.0.smithi070.stdout:0/506: mknod d1/d76/c95 0 2023-10-08T08:45:32.277 INFO:tasks.workunit.client.0.smithi070.stdout:0/507: chown d1/d62/d54/f58 14022 1 2023-10-08T08:45:32.279 INFO:tasks.workunit.client.0.smithi070.stdout:0/508: creat d1/d14/d1f/f96 x:0 0 0 2023-10-08T08:45:32.283 INFO:tasks.workunit.client.0.smithi070.stdout:0/509: creat d1/d62/d54/f97 x:0 0 0 2023-10-08T08:45:32.283 INFO:tasks.workunit.client.0.smithi070.stdout:0/510: fdatasync d1/d14/f43 0 2023-10-08T08:45:32.283 INFO:tasks.workunit.client.0.smithi070.stdout:0/511: write d1/dd/d1b/f90 [122463,42614] 0 2023-10-08T08:45:32.289 INFO:tasks.workunit.client.0.smithi070.stdout:0/512: creat d1/d14/d1f/d6f/f98 x:0 0 0 2023-10-08T08:45:32.293 INFO:tasks.workunit.client.0.smithi070.stdout:0/513: creat d1/d1d/d24/f99 x:0 0 0 2023-10-08T08:45:32.295 INFO:tasks.workunit.client.0.smithi070.stdout:2/472: dwrite f8 [4194304,4194304] 0 2023-10-08T08:45:32.295 INFO:tasks.workunit.client.0.smithi070.stdout:2/473: chown df/d12/d7e 186796 1 2023-10-08T08:45:32.295 INFO:tasks.workunit.client.0.smithi070.stdout:1/493: dwrite d6/f55 [0,4194304] 0 2023-10-08T08:45:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c7592db80 1 Processor -- start 2023-10-08T08:45:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c7592db80 1 -- start start 2023-10-08T08:45:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668dfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c7592db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e666ad920 con 0x560e668d8e80 2023-10-08T08:45:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c7592db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e668cf570 con 0x560e668d97a0 2023-10-08T08:45:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c7592db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e668eb6e0 con 0x560e668e4650 2023-10-08T08:45:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c62ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c62ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668e1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52688/0 (socket says 172.21.15.70:52688) 2023-10-08T08:45:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c62ffd700 1 -- 172.21.15.70:0/274741891 learned_addr learned my addr 172.21.15.70:0/274741891 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.295+0000 7f2c5bfff700 1 --2- 172.21.15.70:0/274741891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c637fe700 1 --2- 172.21.15.70:0/274741891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668dfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c62ffd700 1 -- 172.21.15.70:0/274741891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 msgr2=0x560e668dfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/274741891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668dfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c62ffd700 1 -- 172.21.15.70:0/274741891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 msgr2=0x560e668eb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/274741891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c62ffd700 1 -- 172.21.15.70:0/274741891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e6667e250 con 0x560e668d8e80 2023-10-08T08:45:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/274741891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668e1aa0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2c54000c00 tx=0x7f2c54009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05560eae949ab1e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c59ffb700 1 -- 172.21.15.70:0/274741891 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c540056c0 con 0x560e668d8e80 2023-10-08T08:45:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c59ffb700 1 -- 172.21.15.70:0/274741891 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c5401e040 con 0x560e668d8e80 2023-10-08T08:45:32.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.296+0000 7f2c59ffb700 1 -- 172.21.15.70:0/274741891 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c540287a0 con 0x560e668d8e80 2023-10-08T08:45:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 -- 172.21.15.70:0/274741891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 msgr2=0x560e668e1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 --2- 172.21.15.70:0/274741891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668e1aa0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2c54000c00 tx=0x7f2c54009ee0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 -- 172.21.15.70:0/274741891 shutdown_connections 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 --2- 172.21.15.70:0/274741891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668dfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 --2- 172.21.15.70:0/274741891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668e1aa0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 --2- 172.21.15.70:0/274741891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 -- 172.21.15.70:0/274741891 >> 172.21.15.70:0/274741891 conn(0x560e6684e260 msgr2=0x560e668dc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 -- 172.21.15.70:0/274741891 shutdown_connections 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 -- 172.21.15.70:0/274741891 wait complete. 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 -- start start 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.297+0000 7f2c7592db80 1 Processor -- start 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668ea930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c7592db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c7592db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e668e97f0 con 0x560e668d8e80 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c7592db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e668e9960 con 0x560e668d97a0 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c7592db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e668e9b20 con 0x560e668e4650 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c7592db80 10 client.0 _ll_register_callbacks cb 0x7f2c54009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c62ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c5bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c5bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40154/0 (socket says 172.21.15.70:40154) 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c5bfff700 1 -- 172.21.15.70:0/2821626830 learned_addr learned my addr 172.21.15.70:0/2821626830 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c637fe700 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c5bfff700 1 -- 172.21.15.70:0/2821626830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 msgr2=0x560e668e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c5bfff700 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668e9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c5bfff700 1 -- 172.21.15.70:0/2821626830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 msgr2=0x560e668ea930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:32.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c5bfff700 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668ea930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c5bfff700 1 -- 172.21.15.70:0/2821626830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e66640c60 con 0x560e668d97a0 2023-10-08T08:45:32.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.298+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668ea930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:32.303 INFO:tasks.workunit.client.0.smithi070.stdout:1/494: stat d6/dc/d14/d1f/d75/c6d 0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.299+0000 7f2c5bfff700 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eae70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x560e668e4620 tx=0x7f2c4c00b2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3dc3b653011a678 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.299+0000 7f2c4a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.299+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/2821626830 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c004440 con 0x560e668d97a0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.299+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/2821626830 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2c4c0188e0 con 0x560e668d97a0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.299+0000 7f2c7592db80 1 -- 172.21.15.70:0/2821626830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c5c09a790 con 0x560e668d97a0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.299+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/2821626830 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c4c018aa0 con 0x560e668d97a0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.299+0000 7f2c7592db80 10 client.25811 fetch_fsmap learned FSMap version 31 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.299+0000 7f2c7592db80 1 -- 172.21.15.70:0/2821626830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560e666562b0 con 0x560e668d97a0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.300+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/2821626830 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c5c09a790 con 0x560e668d97a0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.300+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/2821626830 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2c4c012450 con 0x560e668d97a0 2023-10-08T08:45:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.300+0000 7f2c7592db80 10 client.25811 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T08:45:32.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.300+0000 7f2c7592db80 10 client.25811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:32.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.300+0000 7f2c7592db80 20 client.25811 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:32.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.300+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560e669494c0 0x560e6694b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:32.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.300+0000 7f2c7592db80 4 client.25811 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:45:32.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.300+0000 7f2c7592db80 1 -- 172.21.15.70:0/2821626830 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560e66825b30 con 0x560e669494c0 2023-10-08T08:45:32.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.300+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560e669494c0 0x560e6694b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:32.306 INFO:tasks.workunit.client.0.smithi070.stdout:2/474: write f8 [1176540,78828] 0 2023-10-08T08:45:32.307 INFO:tasks.workunit.client.0.smithi070.stdout:2/475: chown df/d12/d15/f41 682166 1 2023-10-08T08:45:32.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.301+0000 7f2c62ffd700 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560e669494c0 0x560e6694b8e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a7df0c93aa02a94 server_cookie=17951c501e9b51c in_seq=0 out_seq=0 2023-10-08T08:45:32.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.301+0000 7f2c4a7fc700 10 client.25811 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:32.307 INFO:tasks.workunit.client.0.smithi070.stdout:1/495: mknod d6/dc/d14/d90/ca2 0 2023-10-08T08:45:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c4a7fc700 1 -- 172.21.15.70:0/2821626830 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x560e66825b30 con 0x560e669494c0 2023-10-08T08:45:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c4a7fc700 10 client.25811 handle_command_reply: tid=0 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 client.25811 shutdown 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 -- 172.21.15.70:0/2821626830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 msgr2=0x560e668eae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eae70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x560e668e4620 tx=0x7f2c4c00b2c0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 -- 172.21.15.70:0/2821626830 shutdown_connections 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560e668e4650 0x560e668e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e668d8e80 0x560e668ea930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560e669494c0 0x560e6694b8e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 --2- 172.21.15.70:0/2821626830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e668d97a0 0x560e668eae70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 -- 172.21.15.70:0/2821626830 >> 172.21.15.70:0/2821626830 conn(0x560e6684e260 msgr2=0x560e668dfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c4a7fc700 0 client.25811 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 -- 172.21.15.70:0/2821626830 shutdown_connections 2023-10-08T08:45:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 1 -- 172.21.15.70:0/2821626830 wait complete. 2023-10-08T08:45:32.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.302+0000 7f2c7592db80 20 client.25811 trim_cache size 0 max 16384 2023-10-08T08:45:32.310 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:45:32.310 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "scrub active (317 inodes in the stack)", 2023-10-08T08:45:32.310 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2023-10-08T08:45:32.310 INFO:teuthology.orchestra.run.smithi070.stdout: "1fdc564a-5636-4203-adbe-f48f96886df6": { 2023-10-08T08:45:32.310 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2023-10-08T08:45:32.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "1fdc564a-5636-4203-adbe-f48f96886df6", 2023-10-08T08:45:32.310 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2023-10-08T08:45:32.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:45:32.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:45:32.311 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 -- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2c500a1670 msgr2=0x7f2c500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2c500a1670 0x7f2c500a3b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2c54003730 tx=0x7f2c54005040 comp rx=0 tx=0).stop 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 -- 172.21.15.70:0/2076759820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c641056b0 msgr2=0x7f2c6410f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c641056b0 0x7f2c6410f8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c007ee0 tx=0x7f2c5c00d3b0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 -- 172.21.15.70:0/2076759820 shutdown_connections 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f2c500a1670 0x7f2c500a3b30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c641056b0 0x7f2c6410f8d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c640ff620 0x7f2c641122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 --2- 172.21.15.70:0/2076759820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640fffe0 0x7f2c6410f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 -- 172.21.15.70:0/2076759820 >> 172.21.15.70:0/2076759820 conn(0x7f2c64076780 msgr2=0x7f2c640fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:32.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 -- 172.21.15.70:0/2076759820 shutdown_connections 2023-10-08T08:45:32.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:45:32.303+0000 7f2c69744700 1 -- 172.21.15.70:0/2076759820 wait complete. 2023-10-08T08:45:32.313 INFO:tasks.workunit.client.0.smithi070.stdout:1/496: symlink d6/dc/d14/d1f/d75/da1/la3 0 2023-10-08T08:45:32.313 INFO:tasks.workunit.client.0.smithi070.stdout:1/497: chown d6/dc/d14/d1f/l30 120 1 2023-10-08T08:45:32.313 INFO:tasks.workunit.client.0.smithi070.stdout:1/498: dread d6/dc/d14/d62/f77 [0,4194304] 0 2023-10-08T08:45:32.313 INFO:tasks.workunit.client.0.smithi070.stdout:1/499: creat d6/dc/d14/d1f/d75/d7e/fa4 x:0 0 0 2023-10-08T08:45:32.314 INFO:tasks.workunit.client.0.smithi070.stdout:1/500: chown d6/dc/d14/d90/c94 20431 1 2023-10-08T08:45:32.315 INFO:tasks.workunit.client.0.smithi070.stdout:0/514: getdents d1/d14/d1f 0 2023-10-08T08:45:32.317 INFO:tasks.workunit.client.0.smithi070.stdout:2/476: dread df/d12/d25/f7d [0,4194304] 0 2023-10-08T08:45:32.317 INFO:tasks.workunit.client.0.smithi070.stdout:0/515: symlink d1/d1d/l9a 0 2023-10-08T08:45:32.321 INFO:tasks.workunit.client.0.smithi070.stdout:2/477: mkdir df/d12/d98 0 2023-10-08T08:45:32.321 INFO:tasks.workunit.client.0.smithi070.stdout:0/516: dread d1/d14/d1f/f1a [0,4194304] 0 2023-10-08T08:45:32.322 INFO:tasks.cephfs.filesystem:scrub status for tag:1fdc564a-5636-4203-adbe-f48f96886df6 - {'path': '/', 'tag': '1fdc564a-5636-4203-adbe-f48f96886df6', 'options': 'recursive,force'} 2023-10-08T08:45:32.325 INFO:tasks.workunit.client.0.smithi070.stdout:0/517: write d1/d1d/f2b [288670,23586] 0 2023-10-08T08:45:32.325 INFO:tasks.workunit.client.0.smithi070.stdout:2/478: truncate fa 2587407 0 2023-10-08T08:45:32.330 INFO:tasks.workunit.client.0.smithi070.stdout:0/518: creat d1/d62/d54/d5e/f9b x:0 0 0 2023-10-08T08:45:32.332 INFO:tasks.workunit.client.0.smithi070.stdout:2/479: creat df/d4c/d91/f99 x:0 0 0 2023-10-08T08:45:32.334 INFO:tasks.workunit.client.0.smithi070.stdout:0/519: creat d1/d76/f9c x:0 0 0 2023-10-08T08:45:32.337 INFO:tasks.workunit.client.0.smithi070.stdout:2/480: mknod df/d12/c9a 0 2023-10-08T08:45:32.338 INFO:tasks.workunit.client.0.smithi070.stdout:2/481: fsync df/d12/d15/d54/f87 0 2023-10-08T08:45:32.339 INFO:tasks.workunit.client.0.smithi070.stdout:1/501: dwrite d6/dc/d14/d1f/f25 [4194304,4194304] 0 2023-10-08T08:45:32.341 INFO:tasks.workunit.client.0.smithi070.stdout:1/502: dread d6/f18 [0,4194304] 0 2023-10-08T08:45:32.342 INFO:tasks.workunit.client.0.smithi070.stdout:1/503: fsync f5 0 2023-10-08T08:45:32.348 INFO:tasks.workunit.client.0.smithi070.stdout:1/504: creat d6/dc/d14/d1f/fa5 x:0 0 0 2023-10-08T08:45:32.354 INFO:tasks.workunit.client.0.smithi070.stdout:1/505: unlink d6/dc/d14/d1f/l5b 0 2023-10-08T08:45:32.369 INFO:tasks.workunit.client.0.smithi070.stdout:0/520: rename d1/d62/d38 to d1/d1d/d4d/d9d 0 2023-10-08T08:45:32.370 INFO:tasks.workunit.client.0.smithi070.stdout:1/506: dread d6/dc/d14/d1f/f72 [0,4194304] 0 2023-10-08T08:45:32.371 INFO:tasks.workunit.client.0.smithi070.stdout:0/521: mknod d1/dd/c9e 0 2023-10-08T08:45:32.371 INFO:tasks.workunit.client.0.smithi070.stdout:0/522: write d1/d62/d54/d5e/d80/f8f [746674,11546] 0 2023-10-08T08:45:32.371 INFO:tasks.workunit.client.0.smithi070.stdout:0/523: fdatasync d1/d1d/d4d/d9d/f6a 0 2023-10-08T08:45:32.371 INFO:tasks.workunit.client.0.smithi070.stdout:0/524: dread - d1/d1d/d24/f94 zero size 2023-10-08T08:45:32.373 INFO:tasks.workunit.client.0.smithi070.stdout:0/525: mknod d1/dd/d1b/c9f 0 2023-10-08T08:45:32.376 INFO:tasks.workunit.client.0.smithi070.stdout:0/526: rename d1/d1d/l61 to d1/d14/d1f/la0 0 2023-10-08T08:45:32.377 INFO:tasks.workunit.client.0.smithi070.stdout:2/482: dwrite fb [0,4194304] 0 2023-10-08T08:45:32.380 INFO:tasks.workunit.client.0.smithi070.stdout:0/527: creat d1/d1d/d4d/d9d/fa1 x:0 0 0 2023-10-08T08:45:32.385 INFO:tasks.workunit.client.0.smithi070.stdout:1/507: dread d6/dc/d14/d1f/d75/f50 [0,4194304] 0 2023-10-08T08:45:32.385 INFO:tasks.workunit.client.0.smithi070.stdout:1/508: fsync d6/f55 0 2023-10-08T08:45:32.385 INFO:tasks.workunit.client.0.smithi070.stdout:1/509: fdatasync d6/dc/d14/d1f/f2b 0 2023-10-08T08:45:32.385 INFO:tasks.workunit.client.0.smithi070.stdout:1/510: chown d6/dc/d14/d1f/d26/d38/f5f 7423251 1 2023-10-08T08:45:32.385 INFO:tasks.workunit.client.0.smithi070.stdout:1/511: read - d6/dc/d14/d1f/d75/f5a zero size 2023-10-08T08:45:32.385 INFO:tasks.workunit.client.0.smithi070.stdout:2/483: mknod df/d12/d98/c9b 0 2023-10-08T08:45:32.387 INFO:tasks.workunit.client.0.smithi070.stdout:2/484: creat df/d4c/f9c x:0 0 0 2023-10-08T08:45:32.388 INFO:tasks.workunit.client.0.smithi070.stdout:2/485: chown df/d12/d98 56650 1 2023-10-08T08:45:32.388 INFO:tasks.workunit.client.0.smithi070.stdout:1/512: write d6/dc/d14/d1f/f25 [4104378,75369] 0 2023-10-08T08:45:32.388 INFO:tasks.workunit.client.0.smithi070.stdout:1/513: fsync d6/dc/f85 0 2023-10-08T08:45:32.392 INFO:tasks.workunit.client.0.smithi070.stdout:2/486: mknod df/d3a/c9d 0 2023-10-08T08:45:32.392 INFO:tasks.workunit.client.0.smithi070.stdout:2/487: truncate df/d12/f37 5582034 0 2023-10-08T08:45:32.393 INFO:tasks.workunit.client.0.smithi070.stdout:1/514: creat d6/dc/d14/d70/fa6 x:0 0 0 2023-10-08T08:45:32.396 INFO:tasks.workunit.client.0.smithi070.stdout:1/515: write d6/dc/f54 [3296070,99277] 0 2023-10-08T08:45:32.396 INFO:tasks.workunit.client.0.smithi070.stdout:1/516: chown d6/dc/d14/d1f/d26/d38/c98 496 1 2023-10-08T08:45:32.398 INFO:tasks.workunit.client.0.smithi070.stdout:1/517: getdents d6/dc/d14/d1f/d75 0 2023-10-08T08:45:32.401 INFO:tasks.workunit.client.0.smithi070.stdout:1/518: mknod d6/dc/d97/ca7 0 2023-10-08T08:45:32.402 INFO:tasks.workunit.client.0.smithi070.stdout:1/519: mknod d6/dc/d14/d62/d95/ca8 0 2023-10-08T08:45:32.402 INFO:tasks.workunit.client.0.smithi070.stdout:1/520: chown d6/f18 493687628 1 2023-10-08T08:45:32.409 INFO:tasks.workunit.client.0.smithi070.stdout:0/528: dwrite d1/d1d/d4d/f5c [0,4194304] 0 2023-10-08T08:45:32.409 INFO:tasks.workunit.client.0.smithi070.stdout:0/529: dread - d1/d62/d54/f58 zero size 2023-10-08T08:45:32.419 INFO:tasks.workunit.client.0.smithi070.stdout:2/488: dwrite df/d12/d15/f42 [0,4194304] 0 2023-10-08T08:45:32.421 INFO:tasks.workunit.client.0.smithi070.stdout:2/489: symlink df/d12/d25/l9e 0 2023-10-08T08:45:32.446 INFO:tasks.workunit.client.0.smithi070.stdout:0/530: dwrite d1/d62/d54/f7d [0,4194304] 0 2023-10-08T08:45:32.446 INFO:tasks.workunit.client.0.smithi070.stdout:0/531: read - d1/d14/d1f/f96 zero size 2023-10-08T08:45:32.452 INFO:tasks.workunit.client.0.smithi070.stdout:0/532: write d1/dd/f8d [4077982,126610] 0 2023-10-08T08:45:32.453 INFO:tasks.workunit.client.0.smithi070.stdout:1/521: dwrite d6/dc/d14/d1f/f25 [8388608,4194304] 0 2023-10-08T08:45:32.455 INFO:tasks.workunit.client.0.smithi070.stdout:0/533: unlink d1/d14/d1f/d6f/f98 0 2023-10-08T08:45:32.457 INFO:tasks.workunit.client.0.smithi070.stdout:1/522: creat d6/dc/d14/d1f/d63/fa9 x:0 0 0 2023-10-08T08:45:32.458 INFO:tasks.workunit.client.0.smithi070.stdout:0/534: creat d1/d62/d54/d5e/fa2 x:0 0 0 2023-10-08T08:45:32.459 INFO:tasks.workunit.client.0.smithi070.stdout:2/490: dwrite df/d12/d25/d83/f88 [0,4194304] 0 2023-10-08T08:45:32.459 INFO:tasks.workunit.client.0.smithi070.stdout:2/491: rename df/d12/d98 to df/d12/d98/d9f 22 2023-10-08T08:45:32.460 INFO:tasks.workunit.client.0.smithi070.stdout:2/492: write df/d73/f7f [697446,93916] 0 2023-10-08T08:45:32.461 INFO:tasks.workunit.client.0.smithi070.stdout:1/523: mkdir d6/dc/d14/d1f/d63/daa 0 2023-10-08T08:45:32.461 INFO:tasks.workunit.client.0.smithi070.stdout:1/524: chown d6/dc/d14/l64 1138689934 1 2023-10-08T08:45:32.464 INFO:tasks.workunit.client.0.smithi070.stdout:2/493: write df/d12/d15/f86 [1627082,34104] 0 2023-10-08T08:45:32.464 INFO:tasks.workunit.client.0.smithi070.stdout:2/494: write df/f5c [124432,5631] 0 2023-10-08T08:45:32.464 INFO:tasks.workunit.client.0.smithi070.stdout:2/495: write df/d12/d1b/f8c [356843,64599] 0 2023-10-08T08:45:32.468 INFO:tasks.workunit.client.0.smithi070.stdout:0/535: write d1/d1d/d4d/f5c [2878899,41908] 0 2023-10-08T08:45:32.482 INFO:tasks.workunit.client.0.smithi070.stdout:1/525: dwrite d6/dc/f46 [0,4194304] 0 2023-10-08T08:45:32.492 INFO:tasks.workunit.client.0.smithi070.stdout:2/496: rmdir df 39 2023-10-08T08:45:32.498 INFO:tasks.workunit.client.0.smithi070.stdout:2/497: fsync df/d12/d15/d54/f55 0 2023-10-08T08:45:32.500 INFO:tasks.workunit.client.0.smithi070.stdout:0/536: rename d1/d14/f67 to d1/fa3 0 2023-10-08T08:45:32.500 INFO:tasks.workunit.client.0.smithi070.stdout:0/537: chown d1/d1d/d24/c44 124 1 2023-10-08T08:45:32.500 INFO:tasks.workunit.client.0.smithi070.stdout:0/538: truncate d1/d62/d54/d5e/f83 554829 0 2023-10-08T08:45:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:2/498: truncate df/d12/d25/f2a 2488944 0 2023-10-08T08:45:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:2/499: chown df/d4c/f51 43608799 1 2023-10-08T08:45:32.503 INFO:tasks.workunit.client.0.smithi070.stdout:0/539: rename d1/d62/f85 to d1/d1d/fa4 0 2023-10-08T08:45:32.505 INFO:tasks.workunit.client.0.smithi070.stdout:0/540: mknod d1/d62/d54/d5e/d80/ca5 0 2023-10-08T08:45:32.505 INFO:tasks.workunit.client.0.smithi070.stdout:0/541: chown d1/dd/f8d 143683934 1 2023-10-08T08:45:32.508 INFO:tasks.workunit.client.0.smithi070.stdout:0/542: read d1/dd/d1b/f33 [196145,111349] 0 2023-10-08T08:45:32.513 INFO:tasks.workunit.client.0.smithi070.stdout:0/543: mknod d1/d14/ca6 0 2023-10-08T08:45:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:32 smithi105 ceph-mon[103798]: pgmap v343: 129 pgs: 129 active+clean; 696 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s rd, 107 MiB/s wr, 1.47k op/s 2023-10-08T08:45:32.523 INFO:tasks.workunit.client.0.smithi070.stdout:2/500: dread df/d12/d25/f72 [0,4194304] 0 2023-10-08T08:45:32.523 INFO:tasks.workunit.client.0.smithi070.stdout:2/501: write df/d12/d1b/f76 [856948,47423] 0 2023-10-08T08:45:32.527 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-mon[104220]: pgmap v343: 129 pgs: 129 active+clean; 696 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s rd, 107 MiB/s wr, 1.47k op/s 2023-10-08T08:45:32.535 INFO:tasks.workunit.client.0.smithi070.stdout:0/544: dwrite d1/dd/f13 [4194304,4194304] 0 2023-10-08T08:45:32.549 INFO:tasks.workunit.client.0.smithi070.stdout:0/545: rmdir d1/dd/d1b 39 2023-10-08T08:45:32.549 INFO:tasks.workunit.client.0.smithi070.stdout:0/546: chown d1/c79 14610255 1 2023-10-08T08:45:32.550 INFO:tasks.workunit.client.0.smithi070.stdout:0/547: dread - d1/d1d/f77 zero size 2023-10-08T08:45:32.551 INFO:tasks.workunit.client.0.smithi070.stdout:0/548: creat d1/fa7 x:0 0 0 2023-10-08T08:45:32.552 INFO:tasks.workunit.client.0.smithi070.stdout:0/549: mknod d1/d62/d54/d5e/d80/d8a/ca8 0 2023-10-08T08:45:32.554 INFO:tasks.workunit.client.0.smithi070.stdout:0/550: creat d1/fa9 x:0 0 0 2023-10-08T08:45:32.556 INFO:tasks.workunit.client.0.smithi070.stdout:0/551: write d1/dd/d1b/f33 [1558114,130630] 0 2023-10-08T08:45:32.559 INFO:tasks.workunit.client.0.smithi070.stdout:0/552: getdents d1/d1d/d24 0 2023-10-08T08:45:32.559 INFO:tasks.workunit.client.0.smithi070.stdout:0/553: truncate d1/dd/d1b/f90 223826 0 2023-10-08T08:45:32.559 INFO:tasks.workunit.client.0.smithi070.stdout:0/554: fdatasync d1/f6b 0 2023-10-08T08:45:32.559 INFO:tasks.workunit.client.0.smithi070.stdout:0/555: chown d1/d1d/l41 37860 1 2023-10-08T08:45:32.562 INFO:tasks.workunit.client.0.smithi070.stdout:0/556: creat d1/faa x:0 0 0 2023-10-08T08:45:32.563 INFO:tasks.workunit.client.0.smithi070.stdout:0/557: creat d1/fab x:0 0 0 2023-10-08T08:45:32.564 INFO:tasks.workunit.client.0.smithi070.stdout:0/558: creat d1/d14/fac x:0 0 0 2023-10-08T08:45:32.564 INFO:tasks.workunit.client.0.smithi070.stdout:0/559: readlink d1/l30 0 2023-10-08T08:45:32.585 INFO:tasks.workunit.client.0.smithi070.stdout:2/502: dwrite fb [0,4194304] 0 2023-10-08T08:45:32.587 INFO:tasks.workunit.client.0.smithi070.stdout:0/560: dwrite d1/d14/d1f/f96 [0,4194304] 0 2023-10-08T08:45:32.588 INFO:tasks.workunit.client.0.smithi070.stdout:2/503: mkdir df/d12/d1b/d82/d85/d65/da0 0 2023-10-08T08:45:32.599 INFO:tasks.workunit.client.0.smithi070.stdout:0/561: dread d1/d1d/d24/f4c [0,4194304] 0 2023-10-08T08:45:32.602 INFO:tasks.workunit.client.0.smithi070.stdout:0/562: rename d1/d1d/f52 to d1/d14/d1f/fad 0 2023-10-08T08:45:32.605 INFO:tasks.workunit.client.0.smithi070.stdout:0/563: mkdir d1/dd/dae 0 2023-10-08T08:45:32.605 INFO:tasks.workunit.client.0.smithi070.stdout:0/564: write d1/d14/fac [744774,85173] 0 2023-10-08T08:45:32.608 INFO:tasks.workunit.client.0.smithi070.stdout:0/565: creat d1/d76/d7a/faf x:0 0 0 2023-10-08T08:45:32.609 INFO:tasks.workunit.client.0.smithi070.stdout:0/566: readlink d1/d62/d54/l81 0 2023-10-08T08:45:32.610 INFO:tasks.workunit.client.0.smithi070.stdout:0/567: creat d1/d62/d54/d5e/fb0 x:0 0 0 2023-10-08T08:45:32.615 INFO:tasks.workunit.client.0.smithi070.stdout:2/504: dwrite df/f39 [0,4194304] 0 2023-10-08T08:45:32.634 INFO:tasks.workunit.client.0.smithi070.stdout:0/568: dwrite d1/d1d/d24/f4c [0,4194304] 0 2023-10-08T08:45:32.634 INFO:tasks.workunit.client.0.smithi070.stdout:0/569: chown d1/d1d/d4d/f5c 201642578 1 2023-10-08T08:45:32.641 INFO:tasks.workunit.client.0.smithi070.stdout:2/505: dwrite df/d3a/f52 [0,4194304] 0 2023-10-08T08:45:32.645 INFO:tasks.workunit.client.0.smithi070.stdout:2/506: creat df/d12/d1b/d1c/d2d/fa1 x:0 0 0 2023-10-08T08:45:32.646 INFO:tasks.workunit.client.0.smithi070.stdout:2/507: truncate df/d12/d15/f16 1570943 0 2023-10-08T08:45:32.648 INFO:tasks.workunit.client.0.smithi070.stdout:2/508: write df/d12/d15/d54/f55 [1022087,1701] 0 2023-10-08T08:45:32.651 INFO:tasks.workunit.client.0.smithi070.stdout:2/509: write fb [2510718,114787] 0 2023-10-08T08:45:32.654 INFO:tasks.workunit.client.0.smithi070.stdout:2/510: mknod df/d12/d1b/ca2 0 2023-10-08T08:45:32.654 INFO:tasks.workunit.client.0.smithi070.stdout:2/511: chown df/d12/d15/f41 47669109 1 2023-10-08T08:45:32.658 INFO:tasks.workunit.client.0.smithi070.stdout:2/512: rename df/d12/d1b/d1c/d2d/l32 to df/d12/d1b/d1c/la3 0 2023-10-08T08:45:32.681 INFO:tasks.workunit.client.0.smithi070.stdout:2/513: dwrite df/f59 [0,4194304] 0 2023-10-08T08:45:32.706 INFO:tasks.workunit.client.0.smithi070.stdout:2/514: read df/f5c [60796,69742] 0 2023-10-08T08:45:32.709 INFO:tasks.workunit.client.0.smithi070.stdout:2/515: rename df/d4c/d8f to df/d12/d1b/d1c/d79/da4 0 2023-10-08T08:45:32.709 INFO:tasks.workunit.client.0.smithi070.stdout:0/570: dwrite d1/d14/d1f/f1a [0,4194304] 0 2023-10-08T08:45:32.712 INFO:tasks.workunit.client.0.smithi070.stdout:2/516: symlink df/d12/d1b/d82/d85/d65/la5 0 2023-10-08T08:45:32.712 INFO:tasks.workunit.client.0.smithi070.stdout:2/517: read df/d12/d1b/f7b [158346,116365] 0 2023-10-08T08:45:32.714 INFO:tasks.workunit.client.0.smithi070.stdout:0/571: mknod d1/d62/d54/d5e/d80/d8a/cb1 0 2023-10-08T08:45:32.716 INFO:tasks.workunit.client.0.smithi070.stdout:2/518: truncate df/d12/d1b/d82/d85/f70 1555666 0 2023-10-08T08:45:32.727 INFO:tasks.workunit.client.0.smithi070.stdout:2/519: dread df/d12/d15/f31 [0,4194304] 0 2023-10-08T08:45:32.727 INFO:tasks.workunit.client.0.smithi070.stdout:2/520: chown df/d4c/d91 83 1 2023-10-08T08:45:32.734 INFO:tasks.workunit.client.0.smithi070.stdout:2/521: dread df/d12/d1b/f8c [0,4194304] 0 2023-10-08T08:45:32.735 INFO:tasks.workunit.client.0.smithi070.stdout:0/572: dwrite d1/d14/d1f/f66 [0,4194304] 0 2023-10-08T08:45:32.735 INFO:tasks.workunit.client.0.smithi070.stdout:0/573: write d1/dd/d1b/f33 [5068500,20894] 0 2023-10-08T08:45:32.735 INFO:tasks.workunit.client.0.smithi070.stdout:0/574: write d1/f7 [1510250,43269] 0 2023-10-08T08:45:32.735 INFO:tasks.workunit.client.0.smithi070.stdout:2/522: getdents df/d12/d1b/d1c/d2d 0 2023-10-08T08:45:32.736 INFO:tasks.workunit.client.0.smithi070.stdout:2/523: write df/d12/d1b/d1c/d2d/fa1 [534044,113271] 0 2023-10-08T08:45:32.739 INFO:tasks.workunit.client.0.smithi070.stdout:0/575: read d1/dd/f53 [4288188,95058] 0 2023-10-08T08:45:32.739 INFO:tasks.workunit.client.0.smithi070.stdout:2/524: write df/f59 [4077178,19984] 0 2023-10-08T08:45:32.744 INFO:tasks.workunit.client.0.smithi070.stdout:0/576: symlink d1/d62/lb2 0 2023-10-08T08:45:32.744 INFO:tasks.workunit.client.0.smithi070.stdout:0/577: chown d1/fa9 593 1 2023-10-08T08:45:32.746 INFO:tasks.workunit.client.0.smithi070.stdout:0/578: symlink d1/d1d/d4d/d9d/lb3 0 2023-10-08T08:45:32.746 INFO:tasks.workunit.client.0.smithi070.stdout:0/579: chown d1/d1d/d4d/c87 224164975 1 2023-10-08T08:45:32.749 INFO:tasks.workunit.client.0.smithi070.stdout:0/580: truncate d1/f5 3146112 0 2023-10-08T08:45:32.749 INFO:tasks.workunit.client.0.smithi070.stdout:0/581: readlink d1/d62/d54/d5e/l6e 0 2023-10-08T08:45:32.749 INFO:tasks.workunit.client.0.smithi070.stdout:0/582: write d1/d1d/d4d/d9d/fa1 [963357,78005] 0 2023-10-08T08:45:32.754 INFO:tasks.workunit.client.0.smithi070.stdout:0/583: creat d1/dd/fb4 x:0 0 0 2023-10-08T08:45:32.764 INFO:tasks.workunit.client.0.smithi070.stdout:0/584: mknod d1/d14/cb5 0 2023-10-08T08:45:32.774 INFO:tasks.workunit.client.0.smithi070.stdout:0/585: symlink d1/dd/lb6 0 2023-10-08T08:45:32.774 INFO:tasks.workunit.client.0.smithi070.stdout:2/525: dwrite df/d12/d15/f17 [0,4194304] 0 2023-10-08T08:45:32.774 INFO:tasks.workunit.client.0.smithi070.stdout:2/526: truncate df/d12/d1b/d1c/f64 792980 0 2023-10-08T08:45:32.774 INFO:tasks.workunit.client.0.smithi070.stdout:2/527: fsync fb 0 2023-10-08T08:45:32.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.524+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a13 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/ auth v2234 ap=1 f(v0 m2023-10-08T08:45:16.634021+0000 4=4+0) n(v0 rc2023-10-08T08:45:16.635021+0000 b27471 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579b61600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002a13:[<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002a13:[<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.634021+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.635021+0000 b27471 5=4+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.634021+0000 4=4+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.635021+0000 b27471 5=4+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.526+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a3e [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/ auth v2232 ap=1 f(v0 m2023-10-08T08:45:16.669020+0000 7=7+0) n(v0 rc2023-10-08T08:45:16.669020+0000 b37010 8=7+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579b63700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002a3e:[<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002a3e:[<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.669020+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.669020+0000 b37010 8=7+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.669020+0000 7=7+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.669020+0000 b37010 8=7+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.527+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027cf [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/ auth v2270 ap=1 f(v0 m2023-10-08T08:45:16.144036+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.145036+0000 b8604 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579958580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027cf:[<0x10000002414/vmsplice v2270>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027cf:[<0x10000002414/vmsplice v2270>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.144036+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.145036+0000 b8604 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.144036+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.145036+0000 b8604 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.527+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002817 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/ auth v2252 ap=1 f(v0 m2023-10-08T08:45:16.197034+0000 5=5+0) n(v0 rc2023-10-08T08:45:16.198034+0000 b19046 6=5+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579958000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002817:[<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002817:[<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.197034+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.198034+0000 b19046 6=5+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.197034+0000 5=5+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.198034+0000 b19046 6=5+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.528+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027f5 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/ auth v2256 ap=1 f(v0 m2023-10-08T08:45:16.172035+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.173035+0000 b7391 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579959080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027f5:[<0x10000002414/profil v2256>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027f5:[<0x10000002414/profil v2256>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.172035+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.173035+0000 b7391 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.172035+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.173035+0000 b7391 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.528+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002978 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/ auth v2244 ap=1 f(v0 m2023-10-08T08:45:16.510025+0000 4=4+0) n(v0 rc2023-10-08T08:45:16.511025+0000 b31323 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257995a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002978:[<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002978:[<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.510025+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.511025+0000 b31323 5=4+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.510025+0000 4=4+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.511025+0000 b31323 5=4+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.529+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002940 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/ auth v2246 ap=1 f(v0 m2023-10-08T08:45:16.460026+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.461026+0000 b5506 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579b62c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002940:[<0x10000002414/memmap v2246>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002940:[<0x10000002414/memmap v2246>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.460026+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.461026+0000 b5506 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.460026+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.461026+0000 b5506 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.530+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029d2 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ auth v2236 ap=1 f(v0 m2023-10-08T08:45:16.584022+0000 6=6+0) n(v0 rc2023-10-08T08:45:16.584022+0000 b33228 7=6+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579959600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000029d2:[<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000029d2:[<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.584022+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.584022+0000 b33228 7=6+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.584022+0000 6=6+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.584022+0000 b33228 7=6+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.783 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.531+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000275e [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/ auth v2272 ap=1 f(v0 m2023-10-08T08:45:16.023039+0000 4=4+0) n(v0 rc2023-10-08T08:45:16.024039+0000 b14292 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257995e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000275e:[<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x1000000275e:[<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.023039+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.024039+0000 b14292 5=4+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.023039+0000 4=4+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.024039+0000 b14292 5=4+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.531+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002879 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/ auth v2250 ap=1 f(v0 m2023-10-08T08:45:16.287031+0000 6=6+0) n(v0 rc2023-10-08T08:45:16.288031+0000 b21874 7=6+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257995e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002879:[<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002879:[<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.287031+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.288031+0000 b21874 7=6+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.287031+0000 6=6+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.288031+0000 b21874 7=6+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.532+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d2 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/ auth v2268 ap=1 f(v0 m2023-10-08T08:45:16.146036+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.147036+0000 b7696 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257995fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027d2:[<0x10000002414/fmtmsg v2268>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027d2:[<0x10000002414/fmtmsg v2268>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.146036+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.147036+0000 b7696 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.146036+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.147036+0000 b7696 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.532+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029a2 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/ auth v2240 ap=1 f(v0 m2023-10-08T08:45:16.543024+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.543024+0000 b5744 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257995eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000029a2:[<0x10000002414/memcpy v2240>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000029a2:[<0x10000002414/memcpy v2240>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.543024+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.543024+0000 b5744 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.543024+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.543024+0000 b5744 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.534+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029cc [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/ auth v2238 ap=1 f(v0 m2023-10-08T08:45:16.576023+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.577023+0000 b8072 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579960100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000029cc:[<0x10000002414/unlinkat v2238>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000029cc:[<0x10000002414/unlinkat v2238>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.576023+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.577023+0000 b8072 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.576023+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.577023+0000 b8072 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.534+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d5 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/ auth v2279 ap=1 f(v0 m2023-10-08T08:45:16.161035+0000 4=0+4) n(v1 rc2023-10-08T08:45:16.164035+0000 b131224 23=18+5) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257995f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027d5:[<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027d5:[<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.161035+0000 4=0+4)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.164035+0000 b131224 23=18+5)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.161035+0000 4=0+4)","memory_value.rstat":"n(v1 rc2023-10-08T08:45:16.164035+0000 b131224 23=18+5)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.534+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002811 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/ auth v2254 ap=1 f(v0 m2023-10-08T08:45:16.191034+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.192034+0000 b9168 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579960680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002811:[<0x10000002414/readlinkat v2254>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002811:[<0x10000002414/readlinkat v2254>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.191034+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.192034+0000 b9168 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.191034+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.192034+0000 b9168 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.536+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002988 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/ auth v2242 ap=1 f(v0 m2023-10-08T08:45:16.522024+0000 3=3+0) n(v0 rc2023-10-08T08:45:16.522024+0000 b10302 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579960c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002988:[<0x10000002414/getrlimit v2242>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002988:[<0x10000002414/getrlimit v2242>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.522024+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.522024+0000 b10302 4=3+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.522024+0000 3=3+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.522024+0000 b10302 4=3+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.537+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002880 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/ auth v2248 ap=1 f(v0 m2023-10-08T08:45:16.292031+0000 4=4+0) n(v0 rc2023-10-08T08:45:16.293031+0000 b17236 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579969600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002880:[<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002880:[<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.292031+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.293031+0000 b17236 5=4+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.292031+0000 4=4+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.293031+0000 b17236 5=4+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.538+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002739 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/ auth v2274 ap=1 f(v0 m2023-10-08T08:45:15.971041+0000 12=12+0) n(v0 rc2023-10-08T08:45:15.975041+0000 b51758 13=12+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257996a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002739:[<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002739:[<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:15.971041+0000 12=12+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:15.975041+0000 b51758 13=12+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:15.971041+0000 12=12+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:15.975041+0000 b51758 13=12+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.539+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029f3 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/ auth{0=1} v2350 ap=1 f(v0 m2023-10-08T08:45:16.610022+0000 6=6+0) n(v0 rc2023-10-08T08:45:16.610022+0000 b33778 7=6+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579c9d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000029f3:[<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000029f3:[<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.610022+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.610022+0000 b33778 7=6+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.610022+0000 6=6+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.610022+0000 b33778 7=6+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.784 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.540+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000282a [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/ auth{0=1} v2366 ap=1 f(v0 m2023-10-08T08:45:16.209034+0000 3=3+0) n(v0 rc2023-10-08T08:45:16.210034+0000 b21756 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579ca6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000282a:[<0x10000002414/unshare v2366>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x1000000282a:[<0x10000002414/unshare v2366>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.209034+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.210034+0000 b21756 4=3+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.209034+0000 3=3+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.210034+0000 b21756 4=3+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.541+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002704 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/ auth{0=1} v2384 ap=1 f(v0 m2023-10-08T08:45:15.844045+0000 2=2+0) n(v0 rc2023-10-08T08:45:15.846045+0000 b7090 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579ca7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002704:[<0x10000002414/mkdirat v2384>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002704:[<0x10000002414/mkdirat v2384>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:15.844045+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:15.846045+0000 b7090 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:15.844045+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:15.846045+0000 b7090 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.541+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000294a [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/ auth{0=1} v2360 ap=1 f(v0 m2023-10-08T08:45:16.470026+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.471026+0000 b8847 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579ca7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000294a:[<0x10000002414/connect v2360>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x1000000294a:[<0x10000002414/connect v2360>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.470026+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.471026+0000 b8847 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.470026+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.471026+0000 b8847 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.543+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029ae [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/ auth{0=1} v2356 ap=1 f(v0 m2023-10-08T08:45:16.553023+0000 3=3+0) n(v0 rc2023-10-08T08:45:16.554023+0000 b17999 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579ca8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000029ae:[<0x10000002414/readdir v2356>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000029ae:[<0x10000002414/readdir v2356>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.553023+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.554023+0000 b17999 4=3+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.553023+0000 3=3+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.554023+0000 b17999 4=3+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.543+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000279e [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/ auth{0=1} v2376 ap=1 f(v0 m2023-10-08T08:45:16.112037+0000 10=10+0) n(v0 rc2023-10-08T08:45:16.113037+0000 b57783 11=10+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579ca8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000279e:[<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x1000000279e:[<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.112037+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.113037+0000 b57783 11=10+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.112037+0000 10=10+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.113037+0000 b57783 11=10+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.544+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a1f [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/ auth{0=1} v2344 ap=1 f(v0 m2023-10-08T08:45:16.646021+0000 7=7+0) n(v0 rc2023-10-08T08:45:16.646021+0000 b37708 8=7+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579ca9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002a1f:[<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002a1f:[<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.646021+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.646021+0000 b37708 8=7+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.646021+0000 7=7+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.646021+0000 b37708 8=7+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.544+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029ec [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/ auth{0=1} v2352 ap=1 f(v0 m2023-10-08T08:45:16.602022+0000 3=3+0) n(v0 rc2023-10-08T08:45:16.602022+0000 b17710 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579ca9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000029ec:[<0x10000002414/tkill v2352>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000029ec:[<0x10000002414/tkill v2352>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.602022+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.602022+0000 b17710 4=3+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.602022+0000 3=3+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.602022+0000 b17710 4=3+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.545+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000277d [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/ auth{0=1} v2378 ap=1 f(v0 m2023-10-08T08:45:16.091037+0000 11=11+0) n(v0 rc2023-10-08T08:45:16.091037+0000 b57327 12=11+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e08000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000277d:[<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x1000000277d:[<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.091037+0000 11=11+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.091037+0000 b57327 12=11+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.091037+0000 11=11+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.091037+0000 b57327 12=11+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.545+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a02 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/ auth{0=1} v2348 ap=1 f(v0 m2023-10-08T08:45:16.623021+0000 7=7+0) n(v0 rc2023-10-08T08:45:16.624021+0000 b36026 8=7+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e08b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002a02:[<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002a02:[<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.623021+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.624021+0000 b36026 8=7+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.623021+0000 7=7+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.624021+0000 b36026 8=7+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.546+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a18 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/ auth{0=1} v2346 ap=1 f(v0 m2023-10-08T08:45:16.636021+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.637021+0000 b7898 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e09080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002a18:[<0x10000002414/tee v2346>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002a18:[<0x10000002414/tee v2346>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.636021+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.637021+0000 b7898 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.636021+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.637021+0000 b7898 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.785 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.548+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002891 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/ auth{0=1} v2364 ap=1 f(v0 m2023-10-08T08:45:16.309031+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.310031+0000 b3822 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e09600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002891:[<0x10000002414/memset v2364>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002891:[<0x10000002414/memset v2364>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.309031+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.310031+0000 b3822 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.309031+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.310031+0000 b3822 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.548+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027b1 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/ auth{0=1} v2374 ap=1 f(v0 m2023-10-08T08:45:16.123036+0000 5=5+0) n(v0 rc2023-10-08T08:45:16.123036+0000 b19258 6=5+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e0a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027b1:[<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027b1:[<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.123036+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.123036+0000 b19258 6=5+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.123036+0000 5=5+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.123036+0000 b19258 6=5+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.551+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000275b [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/ auth{0=1} v2380 ap=1 f(v0 m2023-10-08T08:45:16.015040+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.016039+0000 b24619 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e0b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000275b:[<0x10000002414/sigrelse v2380>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x1000000275b:[<0x10000002414/sigrelse v2380>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.015040+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.016039+0000 b24619 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.015040+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.016039+0000 b24619 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.551+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029b7 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/ auth{0=1} v2354 ap=1 f(v0 m2023-10-08T08:45:16.567023+0000 13=13+0) n(v0 rc2023-10-08T08:45:16.568023+0000 b109605 14=13+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e12000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000029b7:[<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000029b7:[<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.567023+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.568023+0000 b109605 14=13+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.567023+0000 13=13+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.568023+0000 b109605 14=13+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.552+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002732 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/ auth{0=1} v2382 ap=1 f(v0 m2023-10-08T08:45:15.954041+0000 3=3+0) n(v0 rc2023-10-08T08:45:15.957041+0000 b13692 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e12b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002732:[<0x10000002414/capset v2382>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002732:[<0x10000002414/capset v2382>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:15.954041+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:15.957041+0000 b13692 4=3+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:15.954041+0000 3=3+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:15.957041+0000 b13692 4=3+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.553+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002827 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/ auth{0=1} v2368 ap=1 f(v0 m2023-10-08T08:45:16.206034+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.207034+0000 b8264 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e13b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002827:[<0x10000002414/sbrk v2368>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002827:[<0x10000002414/sbrk v2368>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.206034+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.207034+0000 b8264 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.206034+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.207034+0000 b8264 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.553+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a49 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/ auth{0=1} v2342 ap=1 f(v0 m2023-10-08T08:45:16.675020+0000 4=4+0) n(v0 rc2023-10-08T08:45:16.676020+0000 b18946 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e14680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002a49:[<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002a49:[<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.675020+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.676020+0000 b18946 5=4+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.675020+0000 4=4+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.676020+0000 b18946 5=4+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.554+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002805 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/ auth{0=1} v2370 ap=1 f(v0 m2023-10-08T08:45:16.184034+0000 3=3+0) n(v0 rc2023-10-08T08:45:16.184034+0000 b14598 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e15180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002805:[<0x10000002414/sigaltstack v2370>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002805:[<0x10000002414/sigaltstack v2370>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.184034+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.184034+0000 b14598 4=3+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.184034+0000 3=3+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.184034+0000 b14598 4=3+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.555+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a53 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/ auth{0=1} v2340 ap=1 f(v0 m2023-10-08T08:45:16.681020+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.682020+0000 b12623 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e15700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002a53:[<0x10000002414/linkat v2340>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002a53:[<0x10000002414/linkat v2340>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.681020+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.682020+0000 b12623 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.681020+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.682020+0000 b12623 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.555+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002943 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/ auth{0=1} v2362 ap=1 f(v0 m2023-10-08T08:45:16.464026+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.465026+0000 b10255 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002943:[<0x10000002414/string v2362>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002943:[<0x10000002414/string v2362>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.464026+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.465026+0000 b10255 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.464026+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.465026+0000 b10255 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.555+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002991 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/ auth{0=1} v2358 ap=1 f(v0 m2023-10-08T08:45:16.532024+0000 7=7+0) n(v0 rc2023-10-08T08:45:16.533024+0000 b52787 8=7+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e1c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002991:[<0x10000002414/link v2358>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x10000002991:[<0x10000002414/link v2358>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.532024+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.533024+0000 b52787 8=7+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.532024+0000 7=7+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.533024+0000 b52787 8=7+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.786 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.583+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027c3 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/ auth{0=1} v2372 ap=1 f(v0 m2023-10-08T08:45:16.136036+0000 4=4+0) n(v0 rc2023-10-08T08:45:16.137036+0000 b15556 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x562579e13080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027c3:[<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027c3:[<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.136036+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.137036+0000 b15556 5=4+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.136036+0000 4=4+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.137036+0000 b15556 5=4+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.641+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a17 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread03.c auth v14 ap=1 s=6411 n(v0 rc2023-10-08T08:45:16.635021+0000 b6411 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579974000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a17:[<0x10000002a13/pread03.c v14>,<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a17:[<0x10000002a13/pread03.c v14>,<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.642+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a14 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread01.c auth v10 ap=1 s=11134 n(v0 rc2023-10-08T08:45:16.633021+0000 b11134 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579974b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a14:[<0x10000002a13/pread01.c v10>,<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a14:[<0x10000002a13/pread01.c v10>,<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.643+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a15 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/Makefile auth v12 ap=1 s=1001 n(v0 rc2009-10-09T17:55:59.000000+0000 b1001 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579974580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a15:[<0x10000002a13/Makefile v12>,<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a15:[<0x10000002a13/Makefile v12>,<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.643+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a16 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread02.c auth v16 ap=1 s=8925 n(v0 rc2023-10-08T08:45:16.634021+0000 b8925 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579975080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a16:[<0x10000002a13/pread02.c v16>,<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a16:[<0x10000002a13/pread02.c v16>,<0x10000002414/pread v2234>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.646+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002941 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/Makefile auth v8 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.460026+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257997d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002941:[<0x10000002940/Makefile v8>,<0x10000002414/memmap v2246>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002941:[<0x10000002940/Makefile v8>,<0x10000002414/memmap v2246>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.647+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002942 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/mem03.c auth v6 ap=1 s=4591 n(v0 rc2023-10-08T08:45:16.461026+0000 b4591 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257997d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002942:[<0x10000002940/mem03.c v6>,<0x10000002414/memmap v2246>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002942:[<0x10000002940/mem03.c v6>,<0x10000002414/memmap v2246>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.650+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a42 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock05.c auth v28 ap=1 s=6200 n(v0 rc2009-03-23T13:35:41.000000+0000 b6200 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257997e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a42:[<0x10000002a3e/flock05.c v28>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a42:[<0x10000002a3e/flock05.c v28>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.652+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a40 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock02.c auth v16 ap=1 s=6264 n(v0 rc2023-10-08T08:45:16.666020+0000 b6264 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257997ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a40:[<0x10000002a3e/flock02.c v16>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a40:[<0x10000002a3e/flock02.c v16>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.652+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a3f [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock04.c auth v26 ap=1 s=6137 n(v0 rc2023-10-08T08:45:16.665020+0000 b6137 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257997f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a3f:[<0x10000002a3e/flock04.c v26>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a3f:[<0x10000002a3e/flock04.c v26>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.653+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a45 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock06.c auth v24 ap=1 s=5576 n(v0 rc2009-03-23T13:35:41.000000+0000 b5576 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579984000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a45:[<0x10000002a3e/flock06.c v24>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a45:[<0x10000002a3e/flock06.c v24>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.787 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.654+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a44 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock03.c auth v18 ap=1 s=6577 n(v0 rc2023-10-08T08:45:16.669020+0000 b6577 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579984580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a44:[<0x10000002a3e/flock03.c v18>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a44:[<0x10000002a3e/flock03.c v18>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.706+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000281b [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall01.c auth v16 ap=1 s=4513 n(v0 rc2009-11-02T13:57:19.000000+0000 b4513 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579985080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000281b:[<0x10000002817/socketcall01.c v16>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000281b:[<0x10000002817/socketcall01.c v16>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.706+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002819 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall04.c auth v20 ap=1 s=4507 n(v0 rc2023-10-08T08:45:16.196034+0000 b4507 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579985600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002819:[<0x10000002817/socketcall04.c v20>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002819:[<0x10000002817/socketcall04.c v20>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.707+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000281c [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall02.c auth v18 ap=1 s=4486 n(v0 rc2023-10-08T08:45:16.198034+0000 b4486 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579985b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000281c:[<0x10000002817/socketcall02.c v18>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000281c:[<0x10000002817/socketcall02.c v18>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.707+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000281a [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/Makefile auth v14 ap=1 s=915 n(v0 rc2009-10-09T17:56:01.000000+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579986100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000281a:[<0x10000002817/Makefile v14>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000281a:[<0x10000002817/Makefile v14>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.707+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a43 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock01.c auth v22 ap=1 s=5341 n(v0 rc2023-10-08T08:45:16.668020+0000 b5341 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56257997f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a43:[<0x10000002a3e/flock01.c v22>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a43:[<0x10000002a3e/flock01.c v22>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.708+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d0 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/Makefile auth v8 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.144036+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579986c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027d0:[<0x100000027cf/Makefile v8>,<0x10000002414/vmsplice v2270>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027d0:[<0x100000027cf/Makefile v8>,<0x10000002414/vmsplice v2270>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.708+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a41 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/Makefile auth v20 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.667020+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579984b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a41:[<0x10000002a3e/Makefile v20>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a41:[<0x10000002a3e/Makefile v20>,<0x10000002414/flock v2232>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.708+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d1 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/vmsplice01.c auth v6 ap=1 s=7689 n(v0 rc2023-10-08T08:45:16.145036+0000 b7689 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579987180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027d1:[<0x100000027cf/vmsplice01.c v6>,<0x10000002414/vmsplice v2270>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027d1:[<0x100000027cf/vmsplice01.c v6>,<0x10000002414/vmsplice v2270>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.708+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002818 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall03.c auth v12 ap=1 s=4625 n(v0 rc2009-11-02T13:57:19.000000+0000 b4625 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579986680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002818:[<0x10000002817/socketcall03.c v12>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002818:[<0x10000002817/socketcall03.c v12>,<0x10000002414/socketcall v2252>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.788 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.709+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027f7 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/Makefile auth v6 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.173035+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027f7:[<0x100000027f5/Makefile v6>,<0x10000002414/profil v2256>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027f7:[<0x100000027f5/Makefile v6>,<0x10000002414/profil v2256>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.789 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.709+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027f6 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/profil01.c auth v8 ap=1 s=6476 n(v0 rc2023-10-08T08:45:16.172035+0000 b6476 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027f6:[<0x100000027f5/profil01.c v8>,<0x10000002414/profil v2256>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027f6:[<0x100000027f5/profil01.c v8>,<0x10000002414/profil v2256>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.789 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.709+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029d5 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate03.c auth v22 ap=1 s=5100 n(v0 rc2009-08-28T13:00:33.000000+0000 b5100 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029d5:[<0x100000029d2/ftruncate03.c v22>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029d5:[<0x100000029d2/ftruncate03.c v22>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.789 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.710+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029d6 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate02.c auth v14 ap=1 s=9068 n(v0 rc2023-10-08T08:45:16.583022+0000 b9068 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029d6:[<0x100000029d2/ftruncate02.c v14>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029d6:[<0x100000029d2/ftruncate02.c v14>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.789 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.710+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029d3 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate01.c auth v20 ap=1 s=6637 n(v0 rc2023-10-08T08:45:16.581023+0000 b6637 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029d3:[<0x100000029d2/ftruncate01.c v20>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029d3:[<0x100000029d2/ftruncate01.c v20>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.789 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.710+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029d4 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/Makefile auth v16 ap=1 s=1036 n(v0 rc2023-10-08T08:45:16.582023+0000 b1036 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029d4:[<0x100000029d2/Makefile v16>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029d4:[<0x100000029d2/Makefile v16>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.789 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.710+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029d8 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.sh auth v24 ap=1 s=951 n(v0 rc2009-12-11T15:21:59.000000+0000 b951 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029d8:[<0x100000029d2/ftruncate04.sh v24>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029d8:[<0x100000029d2/ftruncate04.sh v24>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.789 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.711+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029d7 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.c auth v18 ap=1 s=10436 n(v0 rc2023-10-08T08:45:16.584022+0000 b10436 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029d7:[<0x100000029d2/ftruncate04.c v18>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029d7:[<0x100000029d2/ftruncate04.c v18>,<0x10000002414/ftruncate v2236>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.789 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.711+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000297c [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon02.c auth v16 ap=1 s=11291 n(v0 rc2023-10-08T08:45:16.511025+0000 b11291 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000297c:[<0x10000002978/swapon02.c v16>,<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000297c:[<0x10000002978/swapon02.c v16>,<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.792 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.712+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002979 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon03.c auth v10 ap=1 s=13309 n(v0 rc2023-10-08T08:45:16.509025+0000 b13309 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002979:[<0x10000002978/swapon03.c v10>,<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002979:[<0x10000002978/swapon03.c v10>,<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.792 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.712+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000297b [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon01.c auth v12 ap=1 s=5603 n(v0 rc2023-10-08T08:45:16.510025+0000 b5603 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000297b:[<0x10000002978/swapon01.c v12>,<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000297b:[<0x10000002978/swapon01.c v12>,<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.792 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.712+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000297a [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/Makefile auth v14 ap=1 s=1120 n(v0 rc2009-10-09T17:56:02.000000+0000 b1120 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798d4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000297a:[<0x10000002978/Makefile v14>,<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000297a:[<0x10000002978/Makefile v14>,<0x10000002414/swapon v2244>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.792 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.716+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002762 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area02.c auth v16 ap=1 s=6884 n(v0 rc2023-10-08T08:45:16.024039+0000 b6884 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002762:[<0x1000000275e/set_thread_area02.c v16>,<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002762:[<0x1000000275e/set_thread_area02.c v16>,<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.792 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.717+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002761 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/Makefile auth v10 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.023039+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002761:[<0x1000000275e/Makefile v10>,<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002761:[<0x1000000275e/Makefile v10>,<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.717+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000275f [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area01.c auth v14 ap=1 s=5691 n(v0 rc2023-10-08T08:45:16.020039+0000 b5691 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000275f:[<0x1000000275e/set_thread_area01.c v14>,<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000275f:[<0x1000000275e/set_thread_area01.c v14>,<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.718+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000287c [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority05.c auth v22 ap=1 s=4268 n(v0 rc2023-10-08T08:45:16.285031+0000 b4268 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000287c:[<0x10000002879/setpriority05.c v22>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000287c:[<0x10000002879/setpriority05.c v22>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.719+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002760 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area.h auth v12 ap=1 s=802 n(v0 rc2023-10-08T08:45:16.022039+0000 b802 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002760:[<0x1000000275e/set_thread_area.h v12>,<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002760:[<0x1000000275e/set_thread_area.h v12>,<0x10000002414/set_thread_area v2272>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.720+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000287e [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority02.c auth v18 ap=1 s=4287 n(v0 rc2023-10-08T08:45:16.287031+0000 b4287 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000287e:[<0x10000002879/setpriority02.c v18>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000287e:[<0x10000002879/setpriority02.c v18>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.720+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000287d [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority01.c auth v20 ap=1 s=4274 n(v0 rc2023-10-08T08:45:16.286031+0000 b4274 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000287d:[<0x10000002879/setpriority01.c v20>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000287d:[<0x10000002879/setpriority01.c v20>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.720+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000287a [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority04.c auth v24 ap=1 s=4291 n(v0 rc2023-10-08T08:45:16.283031+0000 b4291 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798ec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000287a:[<0x10000002879/setpriority04.c v24>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000287a:[<0x10000002879/setpriority04.c v24>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.720+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000287f [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority03.c auth v16 ap=1 s=3839 n(v0 rc2023-10-08T08:45:16.288031+0000 b3839 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798ebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000287f:[<0x10000002879/setpriority03.c v16>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000287f:[<0x10000002879/setpriority03.c v16>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.721+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000287b [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/Makefile auth v14 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.284031+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798eb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000287b:[<0x10000002879/Makefile v14>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000287b:[<0x10000002879/Makefile v14>,<0x10000002414/setpriority v2250>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.722+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029a4 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/Makefile auth v6 ap=1 s=915 n(v0 rc2009-10-09T17:55:57.000000+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798ec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029a4:[<0x100000029a2/Makefile v6>,<0x10000002414/memcpy v2240>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029a4:[<0x100000029a2/Makefile v6>,<0x10000002414/memcpy v2240>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.793 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.722+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029a3 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/memcpy01.c auth v8 ap=1 s=4829 n(v0 rc2023-10-08T08:45:16.543024+0000 b4829 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798ecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029a3:[<0x100000029a2/memcpy01.c v8>,<0x10000002414/memcpy v2240>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029a3:[<0x100000029a2/memcpy01.c v8>,<0x10000002414/memcpy v2240>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.723+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d6 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/ auth v88 ap=1 f(v0 m2023-10-08T08:45:16.157035+0000 13=13+0) n(v0 rc2023-10-08T08:45:16.158035+0000 b102190 14=13+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798ed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027d6:[<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027d6:[<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.157035+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.158035+0000 b102190 14=13+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.157035+0000 13=13+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.158035+0000 b102190 14=13+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.723+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e7 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src/ auth v84 ap=1 f(v0 m2023-10-08T08:45:16.160035+0000 1=1+0) n(v0 rc2023-10-08T08:45:16.161035+0000 b983 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027e7:[<0x100000027d5/src v84>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027e7:[<0x100000027d5/src v84>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.160035+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.161035+0000 b983 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.160035+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.161035+0000 b983 2=1+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.723+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e4 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/ auth v86 ap=1 f(v0 m2023-10-08T08:45:16.159035+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.160035+0000 b21818 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027e4:[<0x100000027d5/examples v86>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027e4:[<0x100000027d5/examples v86>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.159035+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.160035+0000 b21818 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.159035+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.160035+0000 b21818 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.726+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d4 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/fmtmsg01.c auth v6 ap=1 s=6781 n(v0 rc2023-10-08T08:45:16.147036+0000 b6781 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c67b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027d4:[<0x100000027d2/fmtmsg01.c v6>,<0x10000002414/fmtmsg v2268>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027d4:[<0x100000027d2/fmtmsg01.c v6>,<0x10000002414/fmtmsg v2268>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.726+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d3 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/Makefile auth v8 ap=1 s=915 n(v0 rc2009-10-09T17:55:54.000000+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c68100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027d3:[<0x100000027d2/Makefile v8>,<0x10000002414/fmtmsg v2268>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027d3:[<0x100000027d2/Makefile v8>,<0x10000002414/fmtmsg v2268>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.727+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002813 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/Makefile auth v6 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.192034+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c69180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002813:[<0x10000002811/Makefile v6>,<0x10000002414/readlinkat v2254>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002813:[<0x10000002811/Makefile v6>,<0x10000002414/readlinkat v2254>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.727+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002812 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/readlinkat01.c auth v8 ap=1 s=8253 n(v0 rc2023-10-08T08:45:16.191034+0000 b8253 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c69700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002812:[<0x10000002811/readlinkat01.c v8>,<0x10000002414/readlinkat v2254>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002812:[<0x10000002811/readlinkat01.c v8>,<0x10000002414/readlinkat v2254>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.727+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000298b [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit01.c auth v12 ap=1 s=4497 n(v0 rc2009-03-23T13:35:45.000000+0000 b4497 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c74000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000298b:[<0x10000002988/getrlimit01.c v12>,<0x10000002414/getrlimit v2242>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000298b:[<0x10000002988/getrlimit01.c v12>,<0x10000002414/getrlimit v2242>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.728+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029cd [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/Makefile auth v6 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.576023+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c68680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029cd:[<0x100000029cc/Makefile v6>,<0x10000002414/unlinkat v2238>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029cd:[<0x100000029cc/Makefile v6>,<0x10000002414/unlinkat v2238>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.794 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.728+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000298a [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/Makefile auth v10 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.522024+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c74580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000298a:[<0x10000002988/Makefile v10>,<0x10000002414/getrlimit v2242>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000298a:[<0x10000002988/Makefile v10>,<0x10000002414/getrlimit v2242>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.731+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002989 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit02.c auth v8 ap=1 s=4890 n(v0 rc2023-10-08T08:45:16.521024+0000 b4890 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c74b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002989:[<0x10000002988/getrlimit02.c v8>,<0x10000002414/getrlimit v2242>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002989:[<0x10000002988/getrlimit02.c v8>,<0x10000002414/getrlimit v2242>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.731+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e9 [...4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/ auth v82 ap=1 f(v0 m2023-10-08T08:45:16.163035+0000 2=2+0) n(v0 rc2023-10-08T08:45:16.164035+0000 b6233 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15648=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15648 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000027e9:[<0x100000027d5/include v82>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[]","memoryvalue":"(2)0x100000027e9:[<0x100000027d5/include v82>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T08:45:16.163035+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T08:45:16.164035+0000 b6233 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T08:45:16.163035+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T08:45:16.164035+0000 b6233 3=2+1)","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.732+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029ce [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/unlinkat01.c auth v8 ap=1 s=7157 n(v0 rc2023-10-08T08:45:16.577023+0000 b7157 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c68c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029ce:[<0x100000029cc/unlinkat01.c v8>,<0x10000002414/unlinkat v2238>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029ce:[<0x100000029cc/unlinkat01.c v8>,<0x10000002414/unlinkat v2238>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.738+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002881 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname01.c auth v16 ap=1 s=4819 n(v0 rc2023-10-08T08:45:16.290031+0000 b4819 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c8b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002881:[<0x10000002880/sethostname01.c v16>,<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002881:[<0x10000002880/sethostname01.c v16>,<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.738+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002882 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname02.c auth v12 ap=1 s=6078 n(v0 rc2023-10-08T08:45:16.291031+0000 b6078 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c92580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002882:[<0x10000002880/sethostname02.c v12>,<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002882:[<0x10000002880/sethostname02.c v12>,<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.739+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002884 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname03.c auth v14 ap=1 s=5424 n(v0 rc2023-10-08T08:45:16.293031+0000 b5424 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c92b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002884:[<0x10000002880/sethostname03.c v14>,<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002884:[<0x10000002880/sethostname03.c v14>,<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.740+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002883 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/Makefile auth v10 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.292031+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c92000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002883:[<0x10000002880/Makefile v10>,<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002883:[<0x10000002880/Makefile v10>,<0x10000002414/sethostname v2248>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.741+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002742 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe03.c auth v48 ap=1 s=3688 n(v0 rc2023-10-08T08:45:15.969041+0000 b3688 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c95700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002742:[<0x10000002739/pipe03.c v48>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002742:[<0x10000002739/pipe03.c v48>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.741+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000273c [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe09.c auth v42 ap=1 s=5599 n(v0 rc2023-10-08T08:45:15.964041+0000 b5599 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c95180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000273c:[<0x10000002739/pipe09.c v42>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000273c:[<0x10000002739/pipe09.c v42>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.795 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.741+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002741 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe10.c auth v38 ap=1 s=4407 n(v0 rc2023-10-08T08:45:15.968041+0000 b4407 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002741:[<0x10000002739/pipe10.c v38>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002741:[<0x10000002739/pipe10.c v38>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.741+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002745 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe07.c auth v28 ap=1 s=4798 n(v0 rc2023-10-08T08:45:15.975041+0000 b4798 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002745:[<0x10000002739/pipe07.c v28>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002745:[<0x10000002739/pipe07.c v28>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.742+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000273d [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/Makefile auth v40 ap=1 s=915 n(v0 rc2009-10-09T17:55:58.000000+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000273d:[<0x10000002739/Makefile v40>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000273d:[<0x10000002739/Makefile v40>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.742+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002744 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe08.c auth v46 ap=1 s=3707 n(v0 rc2023-10-08T08:45:15.971041+0000 b3707 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002744:[<0x10000002739/pipe08.c v46>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002744:[<0x10000002739/pipe08.c v46>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.742+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000273a [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe11.c auth v34 ap=1 s=6115 n(v0 rc2009-03-23T13:35:59.000000+0000 b6115 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000273a:[<0x10000002739/pipe11.c v34>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000273a:[<0x10000002739/pipe11.c v34>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.743+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002743 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe05.c auth v44 ap=1 s=3754 n(v0 rc2023-10-08T08:45:15.970041+0000 b3754 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002743:[<0x10000002739/pipe05.c v44>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002743:[<0x10000002739/pipe05.c v44>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.743+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002740 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe06.c auth v36 ap=1 s=3364 n(v0 rc2023-10-08T08:45:15.967041+0000 b3364 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002740:[<0x10000002739/pipe06.c v36>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002740:[<0x10000002739/pipe06.c v36>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.743+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000273e [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe01.c auth v30 ap=1 s=4136 n(v0 rc2023-10-08T08:45:15.965041+0000 b4136 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000273e:[<0x10000002739/pipe01.c v30>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000273e:[<0x10000002739/pipe01.c v30>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.743+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000273f [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe04.c auth v32 ap=1 s=6408 n(v0 rc2023-10-08T08:45:15.966041+0000 b6408 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000273f:[<0x10000002739/pipe04.c v32>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000273f:[<0x10000002739/pipe04.c v32>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.743+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029f8 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat03.c auth v16 ap=1 s=4983 n(v0 rc2023-10-08T08:45:16.610022+0000 b4983 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e1cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029f8:[<0x100000029f3/fstat03.c v16>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029f8:[<0x100000029f3/fstat03.c v16>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.744+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029f7 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat05.c auth v24 ap=1 s=7799 n(v0 rc2023-10-08T08:45:16.609022+0000 b7799 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029f7:[<0x100000029f3/fstat05.c v24>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029f7:[<0x100000029f3/fstat05.c v24>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.796 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.745+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029f9 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat02.c auth v22 ap=1 s=6684 n(v0 rc2009-08-28T12:51:34.000000+0000 b6684 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e1e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029f9:[<0x100000029f3/fstat02.c v22>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029f9:[<0x100000029f3/fstat02.c v22>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.745+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029f4 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat01.c auth v20 ap=1 s=6587 n(v0 rc2023-10-08T08:45:16.607022+0000 b6587 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e1d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029f4:[<0x100000029f3/fstat01.c v20>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029f4:[<0x100000029f3/fstat01.c v20>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.745+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029f6 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/Makefile auth v14 ap=1 s=1000 n(v0 rc2023-10-08T08:45:16.608022+0000 b1000 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029f6:[<0x100000029f3/Makefile v14>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029f6:[<0x100000029f3/Makefile v14>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.746+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029f5 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat04.c auth v18 ap=1 s=6725 n(v0 rc2009-08-28T12:51:34.000000+0000 b6725 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e1db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029f5:[<0x100000029f3/fstat04.c v18>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029f5:[<0x100000029f3/fstat04.c v18>,<0x10000002414/fstat v2350>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.746+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000273b [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe02.c auth v26 ap=1 s=4867 n(v0 rc2023-10-08T08:45:15.963041+0000 b4867 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c9cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000273b:[<0x10000002739/pipe02.c v26>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000273b:[<0x10000002739/pipe02.c v26>,<0x10000002414/pipe v2274>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.747+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000282d [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare02.c auth v8 ap=1 s=9123 n(v0 rc2023-10-08T08:45:16.210034+0000 b9123 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e28000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000282d:[<0x1000000282a/unshare02.c v8>,<0x10000002414/unshare v2366>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000282d:[<0x1000000282a/unshare02.c v8>,<0x10000002414/unshare v2366>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.748+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000282c [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare01.c auth v10 ap=1 s=11718 n(v0 rc2023-10-08T08:45:16.209034+0000 b11718 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e28580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000282c:[<0x1000000282a/unshare01.c v10>,<0x10000002414/unshare v2366>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000282c:[<0x1000000282a/unshare01.c v10>,<0x10000002414/unshare v2366>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.748+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002705 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/mkdirat01.c auth v6 ap=1 s=6175 n(v0 rc2023-10-08T08:45:15.844045+0000 b6175 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e29b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002705:[<0x10000002704/mkdirat01.c v6>,<0x10000002414/mkdirat v2384>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002705:[<0x10000002704/mkdirat01.c v6>,<0x10000002414/mkdirat v2384>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.748+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000282b [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/Makefile auth v12 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.208034+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e28b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000282b:[<0x1000000282a/Makefile v12>,<0x10000002414/unshare v2366>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000282b:[<0x1000000282a/Makefile v12>,<0x10000002414/unshare v2366>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.750+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002706 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/Makefile auth v8 ap=1 s=915 n(v0 rc2023-10-08T08:45:15.846045+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e2a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002706:[<0x10000002704/Makefile v8>,<0x10000002414/mkdirat v2384>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002706:[<0x10000002704/Makefile v8>,<0x10000002414/mkdirat v2384>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.797 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.752+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000294c [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/connect01.c auth v6 ap=1 s=7932 n(v0 rc2023-10-08T08:45:16.471026+0000 b7932 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e37180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000294c:[<0x1000000294a/connect01.c v6>,<0x10000002414/connect v2360>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000294c:[<0x1000000294a/connect01.c v6>,<0x10000002414/connect v2360>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.798 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.753+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000294b [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/Makefile auth v8 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.470026+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e37700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000294b:[<0x1000000294a/Makefile v8>,<0x10000002414/connect v2360>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000294b:[<0x1000000294a/Makefile v8>,<0x10000002414/connect v2360>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.798 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.757+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029b1 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir01.c auth v12 ap=1 s=10661 n(v0 rc2023-10-08T08:45:16.554023+0000 b10661 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e3eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029b1:[<0x100000029ae/readdir01.c v12>,<0x10000002414/readdir v2356>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029b1:[<0x100000029ae/readdir01.c v12>,<0x10000002414/readdir v2356>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.798 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.758+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029af [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/Makefile auth v10 ap=1 s=915 n(v0 rc2009-10-09T17:55:59.000000+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e3f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029af:[<0x100000029ae/Makefile v10>,<0x10000002414/readdir v2356>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029af:[<0x100000029ae/Makefile v10>,<0x10000002414/readdir v2356>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.798 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.758+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a8 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod05.c auth v36 ap=1 s=8189 n(v0 rc2023-10-08T08:45:16.113037+0000 b8189 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027a8:[<0x1000000279e/chmod05.c v36>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027a8:[<0x1000000279e/chmod05.c v36>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.798 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.758+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029b0 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir02.c auth v8 ap=1 s=6423 n(v0 rc2023-10-08T08:45:16.553023+0000 b6423 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e3f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029b0:[<0x100000029ae/readdir02.c v8>,<0x10000002414/readdir v2356>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029b0:[<0x100000029ae/readdir02.c v8>,<0x10000002414/readdir v2356>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.798 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.758+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a5 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.mode.sh auth v26 ap=1 s=426 n(v0 rc2009-03-23T13:35:39.000000+0000 b426 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e40680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027a5:[<0x1000000279e/change_owner.mode.sh v26>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027a5:[<0x1000000279e/change_owner.mode.sh v26>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.798 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.759+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a4 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod02.c auth v40 ap=1 s=7097 n(v0 rc2023-10-08T08:45:16.110037+0000 b7097 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e41180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027a4:[<0x1000000279e/chmod02.c v40>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027a4:[<0x1000000279e/chmod02.c v40>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.798 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.759+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a2 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod03.c auth v38 ap=1 s=6634 n(v0 rc2023-10-08T08:45:16.109037+0000 b6634 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027a2:[<0x1000000279e/chmod03.c v38>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027a2:[<0x1000000279e/chmod03.c v38>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.798 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.761+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a6 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.c auth v34 ap=1 s=2764 n(v0 rc2023-10-08T08:45:16.111037+0000 b2764 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027a6:[<0x1000000279e/change_owner.c v34>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027a6:[<0x1000000279e/change_owner.c v34>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.762+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a7 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod04.c auth v30 ap=1 s=6259 n(v0 rc2023-10-08T08:45:16.112037+0000 b6259 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027a7:[<0x1000000279e/chmod04.c v30>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027a7:[<0x1000000279e/chmod04.c v30>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.764+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a0 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod01.c auth v32 ap=1 s=6023 n(v0 rc2009-08-28T11:49:07.000000+0000 b6023 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e3fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027a0:[<0x1000000279e/chmod01.c v32>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027a0:[<0x1000000279e/chmod01.c v32>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.765+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000279f [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod06.c auth v24 ap=1 s=12162 n(v0 rc2023-10-08T08:45:16.107037+0000 b12162 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000279f:[<0x1000000279e/chmod06.c v24>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000279f:[<0x1000000279e/chmod06.c v24>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.766+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a1 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod07.c auth v28 ap=1 s=7314 n(v0 rc2023-10-08T08:45:16.108037+0000 b7314 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027a1:[<0x1000000279e/chmod07.c v28>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027a1:[<0x1000000279e/chmod07.c v28>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.766+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a23 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm03.c auth v16 ap=1 s=6488 n(v0 rc2023-10-08T08:45:16.644021+0000 b6488 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a23:[<0x10000002a1f/alarm03.c v16>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a23:[<0x10000002a1f/alarm03.c v16>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.766+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027a3 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/Makefile auth v22 ap=1 s=915 n(v0 rc2009-10-09T17:55:53.000000+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e40c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027a3:[<0x1000000279e/Makefile v22>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027a3:[<0x1000000279e/Makefile v22>,<0x10000002414/chmod v2376>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.766+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a20 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm01.c auth v28 ap=1 s=6105 n(v0 rc2023-10-08T08:45:16.642021+0000 b6105 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a20:[<0x10000002a1f/alarm01.c v28>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a20:[<0x10000002a1f/alarm01.c v28>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.767+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a25 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm02.c auth v22 ap=1 s=6635 n(v0 rc2023-10-08T08:45:16.646021+0000 b6635 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a25:[<0x10000002a1f/alarm02.c v22>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a25:[<0x10000002a1f/alarm02.c v22>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.767+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a21 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/Makefile auth v18 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.643021+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a21:[<0x10000002a1f/Makefile v18>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a21:[<0x10000002a1f/Makefile v18>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.799 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.767+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a24 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm06.c auth v20 ap=1 s=5767 n(v0 rc2023-10-08T08:45:16.645021+0000 b5767 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a24:[<0x10000002a1f/alarm06.c v20>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a24:[<0x10000002a1f/alarm06.c v20>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.768+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a22 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm07.c auth v24 ap=1 s=5450 n(v0 rc2009-08-28T10:57:29.000000+0000 b5450 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a22:[<0x10000002a1f/alarm07.c v24>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a22:[<0x10000002a1f/alarm07.c v24>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.768+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a26 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm05.c auth v26 ap=1 s=6348 n(v0 rc2009-03-23T13:35:39.000000+0000 b6348 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579e4bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a26:[<0x10000002a1f/alarm05.c v26>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a26:[<0x10000002a1f/alarm05.c v26>,<0x10000002414/alarm v2344>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.768+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029ed [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/Makefile auth v12 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.601022+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029ed:[<0x100000029ec/Makefile v12>,<0x10000002414/tkill v2352>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029ed:[<0x100000029ec/Makefile v12>,<0x10000002414/tkill v2352>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.769+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029ef [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill02.c auth v8 ap=1 s=8451 n(v0 rc2009-06-25T08:54:42.000000+0000 b8451 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029ef:[<0x100000029ec/tkill02.c v8>,<0x10000002414/tkill v2352>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029ef:[<0x100000029ec/tkill02.c v8>,<0x10000002414/tkill v2352>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.770+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002786 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open08.c auth v26 ap=1 s=5180 n(v0 rc2023-10-08T08:45:16.090037+0000 b5180 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002786:[<0x1000000277d/open08.c v26>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002786:[<0x1000000277d/open08.c v26>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.770+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002787 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open07.c auth v34 ap=1 s=6535 n(v0 rc2009-03-23T13:35:58.000000+0000 b6535 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002787:[<0x1000000277d/open07.c v34>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002787:[<0x1000000277d/open07.c v34>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.770+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002785 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open02.c auth v30 ap=1 s=3418 n(v0 rc2009-03-23T13:35:58.000000+0000 b3418 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002785:[<0x1000000277d/open02.c v30>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002785:[<0x1000000277d/open02.c v30>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.771+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002781 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open05.c auth v44 ap=1 s=4498 n(v0 rc2023-10-08T08:45:16.086037+0000 b4498 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002781:[<0x1000000277d/open05.c v44>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002781:[<0x1000000277d/open05.c v44>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.771+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000277e [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open10.c auth v40 ap=1 s=13822 n(v0 rc2023-10-08T08:45:16.082038+0000 b13822 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000277e:[<0x1000000277d/open10.c v40>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000277e:[<0x1000000277d/open10.c v40>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.800 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.771+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002780 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open04.c auth v42 ap=1 s=4458 n(v0 rc2023-10-08T08:45:16.084037+0000 b4458 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002780:[<0x1000000277d/open04.c v42>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002780:[<0x1000000277d/open04.c v42>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.772+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002782 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/Makefile auth v32 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.087037+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ac4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002782:[<0x1000000277d/Makefile v32>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002782:[<0x1000000277d/Makefile v32>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.773+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002784 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open01.c auth v28 ap=1 s=4667 n(v0 rc2023-10-08T08:45:16.089037+0000 b4667 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ac4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002784:[<0x1000000277d/open01.c v28>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002784:[<0x1000000277d/open01.c v28>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.774+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029ee [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill01.c auth v10 ap=1 s=8344 n(v0 rc2023-10-08T08:45:16.602022+0000 b8344 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029ee:[<0x100000029ec/tkill01.c v10>,<0x10000002414/tkill v2352>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029ee:[<0x100000029ec/tkill01.c v10>,<0x10000002414/tkill v2352>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.774+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002788 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open03.c auth v24 ap=1 s=6569 n(v0 rc2009-08-28T13:35:01.000000+0000 b6569 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002788:[<0x1000000277d/open03.c v24>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002788:[<0x1000000277d/open03.c v24>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.775+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002783 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open09.c auth v38 ap=1 s=3761 n(v0 rc2023-10-08T08:45:16.088037+0000 b3761 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579abf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002783:[<0x1000000277d/open09.c v38>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002783:[<0x1000000277d/open09.c v38>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.776+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000277f [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open06.c auth v36 ap=1 s=3504 n(v0 rc2023-10-08T08:45:16.083037+0000 b3504 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ac4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000277f:[<0x1000000277d/open06.c v36>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000277f:[<0x1000000277d/open06.c v36>,<0x10000002414/open v2378>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.777+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a07 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/test3.c auth v26 ap=1 s=978 n(v0 rc2023-10-08T08:45:16.622021+0000 b978 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ac7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a07:[<0x10000002a02/test3.c v26>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a07:[<0x10000002a02/test3.c v26>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.778+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a04 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve03.c auth v22 ap=1 s=6807 n(v0 rc2023-10-08T08:45:16.620021+0000 b6807 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ad0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a04:[<0x10000002a02/execve03.c v22>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a04:[<0x10000002a02/execve03.c v22>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.778+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a08 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve05.c auth v28 ap=1 s=5199 n(v0 rc2023-10-08T08:45:16.623021+0000 b5199 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ac7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a08:[<0x10000002a02/execve05.c v28>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a08:[<0x10000002a02/execve05.c v28>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.801 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.779+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a03 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve04.c auth v24 ap=1 s=8216 n(v0 rc2023-10-08T08:45:16.619021+0000 b8216 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ad1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a03:[<0x10000002a02/execve04.c v24>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a03:[<0x10000002a02/execve04.c v24>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.802 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.779+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a06 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve01.c auth v20 ap=1 s=7513 n(v0 rc2009-03-23T13:35:40.000000+0000 b7513 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ad1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a06:[<0x10000002a02/execve01.c v20>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a06:[<0x10000002a02/execve01.c v20>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.802 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.780+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a1a [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/tee01.c auth v6 ap=1 s=6983 n(v0 rc2023-10-08T08:45:16.637021+0000 b6983 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ad1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a1a:[<0x10000002a18/tee01.c v6>,<0x10000002414/tee v2346>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a1a:[<0x10000002a18/tee01.c v6>,<0x10000002414/tee v2346>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:32.802 INFO:tasks.workunit.client.0.smithi070.stdout:2/528: dread df/d12/d15/d54/f55 [0,4194304] 0 2023-10-08T08:45:32.802 INFO:tasks.workunit.client.0.smithi070.stdout:2/529: write df/d12/d1b/d1c/f64 [523821,122682] 0 2023-10-08T08:45:32.802 INFO:tasks.workunit.client.0.smithi070.stdout:2/530: dread df/d12/d1b/d82/d85/f70 [0,4194304] 0 2023-10-08T08:45:32.806 INFO:tasks.workunit.client.0.smithi070.stdout:2/531: truncate df/d12/d1b/d82/d85/f70 53669 0 2023-10-08T08:45:32.808 INFO:tasks.workunit.client.0.smithi070.stdout:0/586: rmdir d1/d14 39 2023-10-08T08:45:32.810 INFO:tasks.workunit.client.0.smithi070.stdout:0/587: creat d1/d1d/d24/fb7 x:0 0 0 2023-10-08T08:45:32.813 INFO:tasks.workunit.client.0.smithi070.stdout:0/588: rename d1/d62/d54/d5e/fa2 to d1/d62/fb8 0 2023-10-08T08:45:32.824 INFO:tasks.workunit.client.0.smithi070.stdout:2/532: dread df/d12/d15/f86 [0,4194304] 0 2023-10-08T08:45:32.826 INFO:tasks.workunit.client.0.smithi070.stdout:2/533: truncate df/d12/d15/f42 2366018 0 2023-10-08T08:45:32.958 INFO:tasks.workunit.client.0.smithi070.stdout:2/534: rename df/d12/d15/f42 to df/d12/d25/fa6 0 2023-10-08T08:45:32.961 INFO:tasks.workunit.client.0.smithi070.stdout:2/535: unlink df/d12/d1b/d1c/d2d/fa1 0 2023-10-08T08:45:32.980 INFO:tasks.workunit.client.0.smithi070.stdout:2/536: dwrite fb [0,4194304] 0 2023-10-08T08:45:32.982 INFO:tasks.workunit.client.0.smithi070.stdout:2/537: read df/d12/d1b/d1c/f64 [218049,125263] 0 2023-10-08T08:45:32.984 INFO:tasks.workunit.client.0.smithi070.stdout:2/538: write df/d12/d15/f41 [3966478,108902] 0 2023-10-08T08:45:32.988 INFO:tasks.workunit.client.0.smithi070.stdout:2/539: rename df/d4c/f51 to df/d12/d25/fa7 0 2023-10-08T08:45:32.989 INFO:tasks.workunit.client.0.smithi070.stdout:2/540: unlink df/d3a/f66 0 2023-10-08T08:45:32.989 INFO:tasks.workunit.client.0.smithi070.stdout:2/541: chown df/d12/d1b/d1c/d79 91 1 2023-10-08T08:45:33.024 INFO:tasks.workunit.client.0.smithi070.stdout:2/542: dwrite df/d12/d1b/d1c/d2d/f58 [0,4194304] 0 2023-10-08T08:45:33.028 INFO:tasks.workunit.client.0.smithi070.stdout:2/543: link l7 df/d12/d25/la8 0 2023-10-08T08:45:33.034 INFO:tasks.workunit.client.0.smithi070.stdout:2/544: mkdir df/d4c/da9 0 2023-10-08T08:45:33.035 INFO:tasks.workunit.client.0.smithi070.stdout:2/545: getdents df/d4c/d91 0 2023-10-08T08:45:33.035 INFO:tasks.workunit.client.0.smithi070.stdout:2/546: readlink df/d12/d1b/d1c/l28 0 2023-10-08T08:45:33.036 INFO:tasks.workunit.client.0.smithi070.stdout:2/547: dread - df/d4c/d91/f99 zero size 2023-10-08T08:45:33.061 INFO:tasks.workunit.client.0.smithi070.stdout:2/548: dwrite df/d12/d1b/d1c/d79/da4/f95 [0,4194304] 0 2023-10-08T08:45:33.065 INFO:tasks.workunit.client.0.smithi070.stdout:2/549: write df/d4c/f68 [1968595,32143] 0 2023-10-08T08:45:33.068 INFO:tasks.workunit.client.0.smithi070.stdout:2/550: creat df/d12/d25/d83/d92/faa x:0 0 0 2023-10-08T08:45:33.071 INFO:tasks.workunit.client.0.smithi070.stdout:2/551: write fc [2524833,21104] 0 2023-10-08T08:45:33.071 INFO:tasks.workunit.client.0.smithi070.stdout:2/552: chown df/d12/d15/f94 1066413010 1 2023-10-08T08:45:33.072 INFO:tasks.workunit.client.0.smithi070.stdout:2/553: creat df/d12/d25/d83/d92/fab x:0 0 0 2023-10-08T08:45:33.077 INFO:tasks.workunit.client.0.smithi070.stdout:2/554: rmdir df/d12/d1b/d82 39 2023-10-08T08:45:33.078 INFO:tasks.workunit.client.0.smithi070.stdout:2/555: rmdir df/d12/d1b/d1c/d79/da4 39 2023-10-08T08:45:33.080 INFO:tasks.workunit.client.0.smithi070.stdout:2/556: symlink df/d3a/lac 0 2023-10-08T08:45:33.081 INFO:tasks.workunit.client.0.smithi070.stdout:2/557: readlink df/l29 0 2023-10-08T08:45:33.083 INFO:tasks.workunit.client.0.smithi070.stdout:2/558: link df/d3a/c9d df/cad 0 2023-10-08T08:45:33.084 INFO:tasks.workunit.client.0.smithi070.stdout:2/559: read df/d12/d1b/d82/d85/f70 [13920,80635] 0 2023-10-08T08:45:33.087 INFO:tasks.workunit.client.0.smithi070.stdout:2/560: truncate df/f11 1704810 0 2023-10-08T08:45:33.087 INFO:tasks.workunit.client.0.smithi070.stdout:2/561: fdatasync df/f59 0 2023-10-08T08:45:33.088 INFO:tasks.workunit.client.0.smithi070.stdout:2/562: mkdir df/d12/d98/dae 0 2023-10-08T08:45:33.090 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.782+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002893 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/Makefile auth v8 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.310031+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ad2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002893:[<0x10000002891/Makefile v8>,<0x10000002414/memset v2364>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002893:[<0x10000002891/Makefile v8>,<0x10000002414/memset v2364>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.090 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.782+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a19 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/Makefile auth v8 ap=1 s=915 n(v0 rc2009-10-09T17:56:02.000000+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ad2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a19:[<0x10000002a18/Makefile v8>,<0x10000002414/tee v2346>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a19:[<0x10000002a18/Makefile v8>,<0x10000002414/tee v2346>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.091 INFO:tasks.workunit.client.0.smithi070.stdout:2/563: dread df/d12/d1b/f8c [0,4194304] 0 2023-10-08T08:45:33.092 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.783+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002892 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/memset01.c auth v6 ap=1 s=2907 n(v0 rc2023-10-08T08:45:16.309031+0000 b2907 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ad2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002892:[<0x10000002891/memset01.c v6>,<0x10000002414/memset v2364>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002892:[<0x10000002891/memset01.c v6>,<0x10000002414/memset v2364>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.092 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.783+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a05 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/Makefile auth v16 ap=1 s=952 n(v0 rc2009-10-09T17:55:54.000000+0000 b952 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ad0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a05:[<0x10000002a02/Makefile v16>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a05:[<0x10000002a02/Makefile v16>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.092 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.785+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027b6 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl01.c auth v16 ap=1 s=4580 n(v0 rc2009-03-23T13:36:07.000000+0000 b4580 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579adcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027b6:[<0x100000027b1/sysctl01.c v16>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027b6:[<0x100000027b1/sysctl01.c v16>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.092 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.785+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027b5 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl05.c auth v20 ap=1 s=4660 n(v0 rc2023-10-08T08:45:16.123036+0000 b4660 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579add080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027b5:[<0x100000027b1/sysctl05.c v20>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027b5:[<0x100000027b1/sysctl05.c v20>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.092 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.786+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027b4 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl04.c auth v14 ap=1 s=3997 n(v0 rc2023-10-08T08:45:16.122036+0000 b3997 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579addb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027b4:[<0x100000027b1/sysctl04.c v14>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027b4:[<0x100000027b1/sysctl04.c v14>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.092 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.786+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027b3 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl03.c auth v18 ap=1 s=5106 n(v0 rc2023-10-08T08:45:16.121036+0000 b5106 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ade100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027b3:[<0x100000027b1/sysctl03.c v18>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027b3:[<0x100000027b1/sysctl03.c v18>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.092 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.789+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000275d [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/Makefile auth v6 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.016039+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ae8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000275d:[<0x1000000275b/Makefile v6>,<0x10000002414/sigrelse v2380>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000275d:[<0x1000000275b/Makefile v6>,<0x10000002414/sigrelse v2380>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.092 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.793+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000275c [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/sigrelse01.c auth v8 ap=1 s=23704 n(v0 rc2023-10-08T08:45:16.015040+0000 b23704 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ae9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000275c:[<0x1000000275b/sigrelse01.c v8>,<0x10000002414/sigrelse v2380>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x1000000275c:[<0x1000000275b/sigrelse01.c v8>,<0x10000002414/sigrelse v2380>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.093 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.793+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a09 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve02.c auth v18 ap=1 s=6361 n(v0 rc2023-10-08T08:45:16.624021+0000 b6361 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579ad0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a09:[<0x10000002a02/execve02.c v18>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a09:[<0x10000002a02/execve02.c v18>,<0x10000002414/execve v2348>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.093 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.793+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027b2 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/Makefile auth v12 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.120036+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579add600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027b2:[<0x100000027b1/Makefile v12>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027b2:[<0x100000027b1/Makefile v12>,<0x10000002414/sysctl v2374>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.093 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.794+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029c1 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill05.c auth v42 ap=1 s=6890 n(v0 rc2023-10-08T08:45:16.566023+0000 b6890 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579aeb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029c1:[<0x100000029b7/kill05.c v42>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029c1:[<0x100000029b7/kill05.c v42>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.093 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.795+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029c3 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill04.c auth v34 ap=1 s=4803 n(v0 rc2009-08-28T13:22:51.000000+0000 b4803 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029c3:[<0x100000029b7/kill04.c v34>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029c3:[<0x100000029b7/kill04.c v34>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.093 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.796+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029c2 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill09.c auth v46 ap=1 s=7320 n(v0 rc2023-10-08T08:45:16.567023+0000 b7320 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029c2:[<0x100000029b7/kill09.c v46>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029c2:[<0x100000029b7/kill09.c v46>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.093 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.796+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029b9 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill02.c auth v48 ap=1 s=28473 n(v0 rc2023-10-08T08:45:16.561023+0000 b28473 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029b9:[<0x100000029b7/kill02.c v48>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029b9:[<0x100000029b7/kill02.c v48>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.093 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.796+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029c0 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill07.c auth v44 ap=1 s=5931 n(v0 rc2023-10-08T08:45:16.565023+0000 b5931 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579aeb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029c0:[<0x100000029b7/kill07.c v44>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029c0:[<0x100000029b7/kill07.c v44>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.093 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.796+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029bd [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/Makefile auth v52 ap=1 s=1241 n(v0 rc2009-10-10T23:53:29.000000+0000 b1241 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029bd:[<0x100000029b7/Makefile v52>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029bd:[<0x100000029b7/Makefile v52>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.093 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.797+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029b8 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill08.c auth v28 ap=1 s=4623 n(v0 rc2023-10-08T08:45:16.560023+0000 b4623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029b8:[<0x100000029b7/kill08.c v28>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029b8:[<0x100000029b7/kill08.c v28>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.094 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.797+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029c4 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill10.c auth v32 ap=1 s=23537 n(v0 rc2023-10-08T08:45:16.568023+0000 b23537 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029c4:[<0x100000029b7/kill10.c v32>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029c4:[<0x100000029b7/kill10.c v32>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.094 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.797+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029bb [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill11.c auth v36 ap=1 s=6936 n(v0 rc2023-10-08T08:45:16.562023+0000 b6936 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029bb:[<0x100000029b7/kill11.c v36>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029bb:[<0x100000029b7/kill11.c v36>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.094 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.797+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029bc [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill01.c auth v50 ap=1 s=4154 n(v0 rc2023-10-08T08:45:16.563023+0000 b4154 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029bc:[<0x100000029b7/kill01.c v50>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029bc:[<0x100000029b7/kill01.c v50>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.094 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.798+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029be [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill06.c auth v38 ap=1 s=4906 n(v0 rc2023-10-08T08:45:16.564023+0000 b4906 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029be:[<0x100000029b7/kill06.c v38>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029be:[<0x100000029b7/kill06.c v38>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.094 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.798+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029bf [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill12.c auth v40 ap=1 s=6453 n(v0 rc2009-03-23T13:35:53.000000+0000 b6453 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029bf:[<0x100000029b7/kill12.c v40>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029bf:[<0x100000029b7/kill12.c v40>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.094 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.798+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000029ba [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill03.c auth v30 ap=1 s=4338 n(v0 rc2009-08-28T13:22:51.000000+0000 b4338 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579af4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000029ba:[<0x100000029b7/kill03.c v30>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000029ba:[<0x100000029b7/kill03.c v30>,<0x10000002414/kill v2354>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.094 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.801+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002735 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset01.c auth v10 ap=1 s=5156 n(v0 rc2023-10-08T08:45:15.957041+0000 b5156 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579aff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002735:[<0x10000002732/capset01.c v10>,<0x10000002414/capset v2382>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002735:[<0x10000002732/capset01.c v10>,<0x10000002414/capset v2382>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.095 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.802+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002734 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/Makefile auth v8 ap=1 s=915 n(v0 rc2023-10-08T08:45:15.954041+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a16000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002734:[<0x10000002732/Makefile v8>,<0x10000002414/capset v2382>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002734:[<0x10000002732/Makefile v8>,<0x10000002414/capset v2382>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.095 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.802+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002733 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset02.c auth v12 ap=1 s=7621 n(v0 rc2023-10-08T08:45:15.952041+0000 b7621 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a16580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002733:[<0x10000002732/capset02.c v12>,<0x10000002414/capset v2382>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002733:[<0x10000002732/capset02.c v12>,<0x10000002414/capset v2382>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.095 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.802+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027c6 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir01.c auth v10 ap=1 s=5624 n(v0 rc2023-10-08T08:45:16.136036+0000 b5624 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a16b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027c6:[<0x100000027c3/fchdir01.c v10>,<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027c6:[<0x100000027c3/fchdir01.c v10>,<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.095 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.802+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027c4 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir02.c auth v14 ap=1 s=3754 n(v0 rc2009-03-23T13:35:40.000000+0000 b3754 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a17b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027c4:[<0x100000027c3/fchdir02.c v14>,<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027c4:[<0x100000027c3/fchdir02.c v14>,<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.803+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027c5 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/Makefile auth v12 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.135036+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a17080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027c5:[<0x100000027c3/Makefile v12>,<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027c5:[<0x100000027c3/Makefile v12>,<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.804+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002829 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/sbrk01.c auth v8 ap=1 s=7349 n(v0 rc2023-10-08T08:45:16.207034+0000 b7349 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a20000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002829:[<0x10000002827/sbrk01.c v8>,<0x10000002414/sbrk v2368>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002829:[<0x10000002827/sbrk01.c v8>,<0x10000002414/sbrk v2368>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.804+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027c7 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir03.c auth v16 ap=1 s=5263 n(v0 rc2023-10-08T08:45:16.137036+0000 b5263 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a17600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027c7:[<0x100000027c3/fchdir03.c v16>,<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027c7:[<0x100000027c3/fchdir03.c v16>,<0x10000002414/fchdir v2372>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.805+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002828 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/Makefile auth v6 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.206034+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a20580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002828:[<0x10000002827/Makefile v6>,<0x10000002414/sbrk v2368>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002828:[<0x10000002827/Makefile v6>,<0x10000002414/sbrk v2368>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.805+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a4a [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid02.c auth v12 ap=1 s=6303 n(v0 rc2023-10-08T08:45:16.674020+0000 b6303 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a21b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a4a:[<0x10000002a49/getresuid02.c v12>,<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a4a:[<0x10000002a49/getresuid02.c v12>,<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.805+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a4d [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid01.c auth v16 ap=1 s=5207 n(v0 rc2023-10-08T08:45:16.676020+0000 b5207 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a22100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a4d:[<0x10000002a49/getresuid01.c v16>,<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a4d:[<0x10000002a49/getresuid01.c v16>,<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.806+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a4b [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/Makefile auth v14 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.675020+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a22680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a4b:[<0x10000002a49/Makefile v14>,<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a4b:[<0x10000002a49/Makefile v14>,<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.807+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002808 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/Makefile auth v8 ap=1 s=915 n(v0 rc2009-10-09T17:56:01.000000+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a30580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002808:[<0x10000002805/Makefile v8>,<0x10000002414/sigaltstack v2370>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002808:[<0x10000002805/Makefile v8>,<0x10000002414/sigaltstack v2370>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.807+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002807 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack01.c auth v12 ap=1 s=7398 n(v0 rc2023-10-08T08:45:16.184034+0000 b7398 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a30b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002807:[<0x10000002805/sigaltstack01.c v12>,<0x10000002414/sigaltstack v2370>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002807:[<0x10000002805/sigaltstack01.c v12>,<0x10000002414/sigaltstack v2370>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.807+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a4c [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid03.c auth v10 ap=1 s=6521 n(v0 rc2009-03-23T13:35:45.000000+0000 b6521 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a22c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a4c:[<0x10000002a49/getresuid03.c v10>,<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a4c:[<0x10000002a49/getresuid03.c v10>,<0x10000002414/getresuid v2342>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.097 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.808+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002806 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack02.c auth v10 ap=1 s=6285 n(v0 rc2023-10-08T08:45:16.183034+0000 b6285 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a30000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002806:[<0x10000002805/sigaltstack02.c v10>,<0x10000002414/sigaltstack v2370>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002806:[<0x10000002805/sigaltstack02.c v10>,<0x10000002414/sigaltstack v2370>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.097 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.808+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002944 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/Makefile auth v6 ap=1 s=915 n(v0 rc2023-10-08T08:45:16.464026+0000 b915 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a31b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002944:[<0x10000002943/Makefile v6>,<0x10000002414/string v2362>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002944:[<0x10000002943/Makefile v6>,<0x10000002414/string v2362>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.097 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.808+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a55 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/Makefile auth v8 ap=1 s=914 n(v0 rc2023-10-08T08:45:16.682020+0000 b914 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a31600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a55:[<0x10000002a53/Makefile v8>,<0x10000002414/linkat v2340>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a55:[<0x10000002a53/Makefile v8>,<0x10000002414/linkat v2340>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.097 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.809+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002a54 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/linkat01.c auth v6 ap=1 s=11709 n(v0 rc2009-11-27T07:43:12.000000+0000 b11709 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a31080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002a54:[<0x10000002a53/linkat01.c v6>,<0x10000002414/linkat v2340>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002a54:[<0x10000002a53/linkat01.c v6>,<0x10000002414/linkat v2340>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.097 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.809+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002993 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/Makefile auth v18 ap=1 s=915 n(v0 rc2009-10-09T17:55:57.000000+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a32680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002993:[<0x10000002991/Makefile v18>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002993:[<0x10000002991/Makefile v18>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.097 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.809+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002992 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link07.c auth v24 ap=1 s=8040 n(v0 rc2023-10-08T08:45:16.529024+0000 b8040 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a33700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002992:[<0x10000002991/link07.c v24>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002992:[<0x10000002991/link07.c v24>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.097 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.810+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002995 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link03.c auth v16 ap=1 s=8774 n(v0 rc2023-10-08T08:45:16.531024+0000 b8774 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a33180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002995:[<0x10000002991/link03.c v16>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002995:[<0x10000002991/link03.c v16>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.097 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.810+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002945 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/string01.c auth v8 ap=1 s=9340 n(v0 rc2023-10-08T08:45:16.465026+0000 b9340 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a32100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002945:[<0x10000002943/string01.c v8>,<0x10000002414/string v2362>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002945:[<0x10000002943/string01.c v8>,<0x10000002414/string v2362>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.097 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.810+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002997 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link02.c auth v28 ap=1 s=7408 n(v0 rc2009-10-26T14:55:47.000000+0000 b7408 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a32c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002997:[<0x10000002991/link02.c v28>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002997:[<0x10000002991/link02.c v28>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.098 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.811+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002996 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link04.c auth v26 ap=1 s=11393 n(v0 rc2023-10-08T08:45:16.532024+0000 b11393 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a3c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002996:[<0x10000002991/link04.c v26>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002996:[<0x10000002991/link04.c v26>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.098 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.811+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002994 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link05.c auth v20 ap=1 s=9352 n(v0 rc2023-10-08T08:45:16.530024+0000 b9352 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a3c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002994:[<0x10000002991/link05.c v20>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002994:[<0x10000002991/link05.c v20>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.098 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:32.812+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002998 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link06.c auth v22 ap=1 s=6905 n(v0 rc2023-10-08T08:45:16.533024+0000 b6905 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579a3cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002998:[<0x10000002991/link06.c v22>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x10000002998:[<0x10000002991/link06.c v22>,<0x10000002414/link v2358>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.098 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.088+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e3 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.ps auth v42 ap=1 s=14505 n(v0 rc2023-10-08T08:45:16.158035+0000 b14505 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027e3:[<0x100000027d6/epoll_ctl.ps v42>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027e3:[<0x100000027d6/epoll_ctl.ps v42>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.098 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.089+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027dd [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.txt auth v36 ap=1 s=10032 n(v0 rc2004-11-02T21:19:47.000000+0000 b10032 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027dd:[<0x100000027d6/epoll.txt v36>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027dd:[<0x100000027d6/epoll.txt v36>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.098 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.089+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d9 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.ps auth v52 ap=1 s=30167 n(v0 rc2023-10-08T08:45:16.151035+0000 b30167 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027d9:[<0x100000027d6/epoll.ps v52>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027d9:[<0x100000027d6/epoll.ps v52>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.098 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.090+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027df [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.ps auth v46 ap=1 s=11698 n(v0 rc2023-10-08T08:45:16.155035+0000 b11698 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027df:[<0x100000027d6/epoll_wait.ps v46>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027df:[<0x100000027d6/epoll_wait.ps v46>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.098 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.090+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027de [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.2 auth v44 ap=1 s=2108 n(v0 rc2023-10-08T08:45:16.154035+0000 b2108 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027de:[<0x100000027d6/epoll_create.2 v44>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027de:[<0x100000027d6/epoll_create.2 v44>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.098 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.090+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e1 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.2 auth v32 ap=1 s=4073 n(v0 rc2023-10-08T08:45:16.156035+0000 b4073 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027e1:[<0x100000027d6/epoll_ctl.2 v32>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027e1:[<0x100000027d6/epoll_ctl.2 v32>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.099 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.092+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027da [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.txt auth v28 ap=1 s=1306 n(v0 rc2004-11-02T21:19:47.000000+0000 b1306 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027da:[<0x100000027d6/epoll_create.txt v28>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027da:[<0x100000027d6/epoll_create.txt v28>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.099 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.092+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e2 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.txt auth v34 ap=1 s=3663 n(v0 rc2023-10-08T08:45:16.157035+0000 b3663 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c5c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027e2:[<0x100000027d6/epoll_ctl.txt v34>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027e2:[<0x100000027d6/epoll_ctl.txt v34>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.099 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.092+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e0 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/mkpages.sh auth v50 ap=1 s=484 n(v0 rc2004-11-02T21:19:47.000000+0000 b484 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027e0:[<0x100000027d6/mkpages.sh v50>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027e0:[<0x100000027d6/mkpages.sh v50>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.099 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.092+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027db [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.txt auth v40 ap=1 s=2452 n(v0 rc2023-10-08T08:45:16.152035+0000 b2452 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5625798f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027db:[<0x100000027d6/epoll_wait.txt v40>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027db:[<0x100000027d6/epoll_wait.txt v40>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.099 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.093+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d8 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.4 auth v38 ap=1 s=9909 n(v0 rc2009-03-23T13:35:40.000000+0000 b9909 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c5c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027d8:[<0x100000027d6/epoll.4 v38>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027d8:[<0x100000027d6/epoll.4 v38>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.107 INFO:tasks.workunit.client.0.smithi070.stdout:2/564: dread df/d12/f37 [0,4194304] 0 2023-10-08T08:45:33.111 INFO:tasks.workunit.client.0.smithi070.stdout:2/565: symlink df/d4c/da9/laf 0 2023-10-08T08:45:33.112 INFO:tasks.workunit.client.0.smithi070.stdout:2/566: creat df/d12/d1b/d1c/fb0 x:0 0 0 2023-10-08T08:45:33.113 INFO:tasks.workunit.client.0.smithi070.stdout:2/567: write df/d12/d25/fa7 [692487,99492] 0 2023-10-08T08:45:33.113 INFO:tasks.workunit.client.0.smithi070.stdout:2/568: read - df/d12/f71 zero size 2023-10-08T08:45:33.113 INFO:tasks.workunit.client.0.smithi070.stdout:2/569: chown l1 9 1 2023-10-08T08:45:33.117 INFO:tasks.workunit.client.0.smithi070.stdout:2/570: rename df/d12/d25 to df/d12/d15/d54/db1 0 2023-10-08T08:45:33.130 INFO:tasks.workunit.client.0.smithi070.stdout:2/571: dread df/f59 [0,4194304] 0 2023-10-08T08:45:33.130 INFO:tasks.workunit.client.0.smithi070.stdout:2/572: chown df/d4c 919458 1 2023-10-08T08:45:33.133 INFO:tasks.workunit.client.0.smithi070.stdout:2/573: creat df/d12/d1b/d1c/d69/fb2 x:0 0 0 2023-10-08T08:45:33.134 INFO:tasks.workunit.client.0.smithi070.stdout:2/574: stat df/d12/d15/d54/db1/l90 0 2023-10-08T08:45:33.161 INFO:tasks.workunit.client.0.smithi070.stdout:2/575: dwrite df/d12/d15/d54/f87 [0,4194304] 0 2023-10-08T08:45:33.164 INFO:tasks.workunit.client.0.smithi070.stdout:2/576: unlink df/d12/d1b/d82/d85/f70 0 2023-10-08T08:45:33.165 INFO:tasks.workunit.client.0.smithi070.stdout:2/577: creat df/d12/d1b/d82/d85/d65/fb3 x:0 0 0 2023-10-08T08:45:33.165 INFO:tasks.workunit.client.0.smithi070.stdout:2/578: truncate df/d12/d1b/d82/d85/d65/fb3 642671 0 2023-10-08T08:45:33.167 INFO:tasks.workunit.client.0.smithi070.stdout:2/579: symlink df/d12/d1b/d1c/lb4 0 2023-10-08T08:45:33.168 INFO:tasks.workunit.client.0.smithi070.stdout:2/580: unlink df/d12/d1b/d1c/d79/da4/f95 0 2023-10-08T08:45:33.169 INFO:tasks.workunit.client.0.smithi070.stdout:2/581: mknod df/d12/d1b/d1c/d69/cb5 0 2023-10-08T08:45:33.170 INFO:tasks.workunit.client.0.smithi070.stdout:2/582: mkdir df/d3a/db6 0 2023-10-08T08:45:33.172 INFO:tasks.workunit.client.0.smithi070.stdout:2/583: rename df/d12/d98 to df/d12/d1b/db7 0 2023-10-08T08:45:33.184 INFO:tasks.workunit.client.0.smithi070.stdout:2/584: dread df/d12/f37 [0,4194304] 0 2023-10-08T08:45:33.184 INFO:tasks.workunit.client.0.smithi070.stdout:2/585: write df/d12/d1b/d82/d85/d65/fb3 [938725,114008] 0 2023-10-08T08:45:33.184 INFO:tasks.workunit.client.0.smithi070.stdout:2/586: truncate df/d4c/f9c 132438 0 2023-10-08T08:45:33.192 INFO:tasks.workunit.client.0.smithi070.stdout:2/587: rmdir df/d3a 39 2023-10-08T08:45:33.197 INFO:tasks.workunit.client.0.smithi070.stdout:2/588: fsync df/d12/d1b/d82/d85/d65/fb3 0 2023-10-08T08:45:33.199 INFO:tasks.workunit.client.0.smithi070.stdout:2/589: symlink df/d12/d15/d54/db1/d83/lb8 0 2023-10-08T08:45:33.199 INFO:tasks.workunit.client.0.smithi070.stdout:2/590: fsync df/d12/d1b/d1c/d2d/f58 0 2023-10-08T08:45:33.199 INFO:tasks.workunit.client.0.smithi070.stdout:2/591: stat df/d12/c4a 0 2023-10-08T08:45:33.199 INFO:tasks.workunit.client.0.smithi070.stdout:2/592: chown df/d12/d1b/ca2 168843486 1 2023-10-08T08:45:33.200 INFO:tasks.workunit.client.0.smithi070.stdout:2/593: symlink df/d12/d1b/db7/lb9 0 2023-10-08T08:45:33.200 INFO:tasks.workunit.client.0.smithi070.stdout:2/594: truncate df/d12/d15/d54/f87 5131990 0 2023-10-08T08:45:33.218 INFO:tasks.workunit.client.0.smithi070.stdout:2/595: dwrite fb [0,4194304] 0 2023-10-08T08:45:33.219 INFO:tasks.workunit.client.0.smithi070.stdout:2/596: write df/d12/d15/d54/f55 [3584638,1652] 0 2023-10-08T08:45:33.220 INFO:tasks.workunit.client.0.smithi070.stdout:2/597: creat df/d12/d1b/d82/d85/fba x:0 0 0 2023-10-08T08:45:33.233 INFO:tasks.workunit.client.0.smithi070.stdout:2/598: dread fc [0,4194304] 0 2023-10-08T08:45:33.234 INFO:tasks.workunit.client.0.smithi070.stdout:2/599: rmdir df/d12/d1b/d1c/d79 39 2023-10-08T08:45:33.234 INFO:tasks.workunit.client.0.smithi070.stdout:2/600: stat df/f33 0 2023-10-08T08:45:33.236 INFO:tasks.workunit.client.0.smithi070.stdout:2/601: getdents df/d12/d1b/d82/d85/d65 0 2023-10-08T08:45:33.239 INFO:tasks.workunit.client.0.smithi070.stdout:2/602: dread df/d12/d15/d54/db1/f7d [0,4194304] 0 2023-10-08T08:45:33.240 INFO:tasks.workunit.client.0.smithi070.stdout:2/603: fsync df/d12/d1b/f7b 0 2023-10-08T08:45:33.244 INFO:tasks.workunit.client.0.smithi070.stdout:2/604: dread df/d12/d15/f16 [0,4194304] 0 2023-10-08T08:45:33.264 INFO:tasks.workunit.client.0.smithi070.stdout:2/605: dwrite df/d12/d15/d54/f87 [0,4194304] 0 2023-10-08T08:45:33.265 INFO:tasks.workunit.client.0.smithi070.stdout:2/606: mknod df/d12/d1b/d1c/d79/cbb 0 2023-10-08T08:45:33.267 INFO:tasks.workunit.client.0.smithi070.stdout:2/607: link df/d3a/l5b df/d12/d1b/d1c/d79/da4/lbc 0 2023-10-08T08:45:33.267 INFO:tasks.workunit.client.0.smithi070.stdout:2/608: fsync df/d4c/f6d 0 2023-10-08T08:45:33.267 INFO:tasks.workunit.client.0.smithi070.stdout:2/609: dread - df/d12/d15/d54/db1/f8a zero size 2023-10-08T08:45:33.268 INFO:tasks.workunit.client.0.smithi070.stdout:2/610: rmdir df/d12/d1b/d1c/d69 39 2023-10-08T08:45:33.269 INFO:tasks.workunit.client.0.smithi070.stdout:2/611: truncate df/d12/f71 779293 0 2023-10-08T08:45:33.270 INFO:tasks.workunit.client.0.smithi070.stdout:2/612: symlink df/d12/d15/lbd 0 2023-10-08T08:45:33.271 INFO:tasks.workunit.client.0.smithi070.stdout:2/613: mknod df/d12/d1b/d1c/d2d/cbe 0 2023-10-08T08:45:33.344 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.094+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027d7 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.ps auth v48 ap=1 s=8706 n(v0 rc2023-10-08T08:45:16.150035+0000 b8706 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c5cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027d7:[<0x100000027d6/epoll_create.ps v48>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027d7:[<0x100000027d6/epoll_create.ps v48>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.344 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.094+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e8 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src/epoll.c auth v4 ap=1 s=983 n(v0 rc2023-10-08T08:45:16.161035+0000 b983 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c5d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027e8:[<0x100000027e7/epoll.c v4>,<0x100000027d5/src v84>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027e8:[<0x100000027e7/epoll.c v4>,<0x100000027d5/src v84>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub queued for path: / 2023-10-08T08:45:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:45:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:45:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:45:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:45:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:45:33.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:33.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:33.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:45:33.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:45:33.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a13 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a3e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027cf (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002817 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027f5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002978 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.347 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.095+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e5 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/Makefile auth v6 ap=1 s=1195 n(v0 rc2023-10-08T08:45:16.159035+0000 b1195 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c5db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027e5:[<0x100000027e4/Makefile v6>,<0x100000027d5/examples v86>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027e5:[<0x100000027e4/Makefile v6>,<0x100000027d5/examples v86>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.347 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.095+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027e6 [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/epoll-test.c auth v8 ap=1 s=20623 n(v0 rc2023-10-08T08:45:16.160035+0000 b20623 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c5e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027e6:[<0x100000027e4/epoll-test.c v8>,<0x100000027d5/examples v86>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027e6:[<0x100000027e4/epoll-test.c v8>,<0x100000027d5/examples v86>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.347 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.095+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027dc [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.2 auth v30 ap=1 s=3087 n(v0 rc2023-10-08T08:45:16.153035+0000 b3087 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c5d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027dc:[<0x100000027d6/epoll_wait.2 v30>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027dc:[<0x100000027d6/epoll_wait.2 v30>,<0x100000027d5/man v88>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.347 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.096+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027eb [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/dbllist.h auth v6 ap=1 s=2450 n(v0 rc2023-10-08T08:45:16.164035+0000 b2450 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15648=0-4194304@3} caps={15648=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15648 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c5ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027eb:[<0x100000027e9/dbllist.h v6>,<0x100000027d5/include v82>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027eb:[<0x100000027e9/dbllist.h v6>,<0x100000027d5/include v82>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.347 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:45:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:45:33.096+0000 7fa97ce54700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027ea [4,head] /client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/epoll.h auth v8 ap=1 s=3783 n(v0 rc2023-10-08T08:45:16.163035+0000 b3783 1=1+0) (iversion lock) caps={15648=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562579c5e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000027ea:[<0x100000027e9/epoll.h v8>,<0x100000027d5/include v82>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2067>,<0x10000000006/kernel v1114>,<0x10000000004/testcases v1349>,<0x10000000002/ltp-full-20091231 v223>,<0x10000000001/fsstress v116>,<0x10000000000/tmp v67>,<0x1/client.0 v62>]//[3]","memoryvalue":"(4)0x100000027ea:[<0x100000027e9/epoll.h v8>,<0x100000027d5/include v82>,<0x10000002414/epoll2 v2279>,<0x10000001d27/syscalls v2103>,<0x10000000006/kernel v1207>,<0x10000000004/testcases v1372>,<0x10000000002/ltp-full-20091231 v231>,<0x10000000001/fsstress v104>,<0x10000000000/tmp v72>,<0x1/client.0 v65>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T08:45:33.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub queued for path: / 2023-10-08T08:45:33.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:45:33.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a13 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a3e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027cf (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002817 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027f5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:33 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002978 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub queued for path: / 2023-10-08T08:45:33.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:33.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:45:33.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:45:33.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:45:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:45:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:45:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:45:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:45:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a13 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a3e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027cf (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002817 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027f5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil) see mds.f log and `damage ls` output for details 2023-10-08T08:45:33.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:33 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002978 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002940 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029d2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000275e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002879 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029a2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029cc (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002811 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002988 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002880 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002739 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029f3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000282a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002704 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000294a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029ae (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000279e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a1f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029ec (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000277d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a02 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a18 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002891 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027b1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000275b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029b7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002732 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002827 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a49 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002805 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a53 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002943 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002991 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027c3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a17 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a14 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a15 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a16 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002941 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002942 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/mem03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a42 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a40 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a3f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a45 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a44 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000281b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002819 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000281c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000281a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a43 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a41 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/vmsplice01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002818 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027f7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027f6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/profil01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029d5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029d6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029d3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029d4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029d8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.sh) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029d7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000297c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002979 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000297b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000297a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002762 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002761 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000275f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000287c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002760 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area.h) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000287e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000287d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000287a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000287f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000287b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029a4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029a3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/memcpy01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/fmtmsg01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002813 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002812 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/readlinkat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000298b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029cd (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000298a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002989 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029ce (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/unlinkat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002881 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002882 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002884 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002883 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002742 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.479 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000273c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe09.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002741 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe10.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002745 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000273d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002744 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe08.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000273a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe11.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002743 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002740 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000273e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000273f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029f8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029f7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029f9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.481 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029f4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.481 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029f6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.481 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029f5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.481 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000273b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.481 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000282d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000282c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002705 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/mkdirat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000282b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002706 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000294c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/connect01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000294b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029b1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029af (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027a8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029b0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027a5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.mode.sh) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027a4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027a2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027a6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027a7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027a0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000279f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027a1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a23 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027a3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a20 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a25 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a21 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a24 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a22 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a26 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029ed (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029ef (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002786 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open08.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002787 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002785 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002781 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000277e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open10.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002780 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002782 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002784 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029ee (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002788 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002783 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open09.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000277f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a07 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/test3.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a04 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a08 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a03 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a06 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a1a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/tee01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002893 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a19 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002892 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/memset01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a05 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027b6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027b5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027b4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027b3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000275d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x1000000275c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/sigrelse01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a09 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027b2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029c1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029c3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029c2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill09.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029b9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029c0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029bd (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029b8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill08.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029c4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill10.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029bb (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill11.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029bc (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029be (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029bf (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill12.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000029ba (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002735 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002734 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002733 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027c6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027c4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027c5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002829 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/sbrk01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027c7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002828 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a4a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a4d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a4b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002808 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002807 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a4c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002806 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002944 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a55 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002a54 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/linkat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002993 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002992 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002995 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002945 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/string01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002997 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002996 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002994 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x10000002998 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.490 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027dd (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027df (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027de (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027da (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/mkpages.sh) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027db (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.4) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027d7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src/epoll.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027e6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/epoll-test.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027dc (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027eb (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/dbllist.h) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: Scrub error on inode 0x100000027ea (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/epoll.h) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: pgmap v344: 129 pgs: 129 active+clean; 808 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 MiB/s rd, 124 MiB/s wr, 1.05k op/s 2023-10-08T08:45:34.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:34 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002940 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029d2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000275e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002879 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029a2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029cc (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002811 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002988 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002880 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002739 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029f3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000282a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002704 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000294a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029ae (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000279e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a1f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029ec (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000277d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a02 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a18 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002891 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027b1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.523 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000275b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029b7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002732 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002827 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a49 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002805 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a53 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002943 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002991 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027c3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a17 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a14 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.524 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a15 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a16 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002941 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002942 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/mem03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a42 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a40 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a3f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a45 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a44 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000281b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002819 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000281c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.525 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000281a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a43 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a41 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/vmsplice01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002818 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027f7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027f6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/profil01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029d5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029d6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029d3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029d4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029d8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.sh) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029d7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000297c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002979 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000297b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000297a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002762 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002761 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000275f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000287c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002760 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area.h) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000287e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000287d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000287a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000287f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000287b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029a4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029a3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/memcpy01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/fmtmsg01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002813 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002812 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/readlinkat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000298b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029cd (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000298a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002989 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029ce (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/unlinkat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002881 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002882 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002884 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002883 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.529 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002742 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000273c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe09.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002741 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe10.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002745 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000273d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002744 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe08.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000273a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe11.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002743 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002740 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000273e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000273f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029f8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.530 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029f7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029f9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029f4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029f6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029f5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000273b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000282d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000282c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002705 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/mkdirat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000282b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002706 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000294c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/connect01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000294b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029b1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029af (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027a8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029b0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027a5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.mode.sh) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027a4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027a2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027a6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027a7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027a0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000279f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027a1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.532 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a23 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027a3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a20 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a25 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a21 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a24 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a22 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a26 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029ed (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029ef (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002786 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open08.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002787 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.533 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002785 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002781 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000277e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open10.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002780 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002782 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002784 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029ee (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002788 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002783 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open09.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000277f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a07 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/test3.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a04 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.534 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a08 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a03 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a06 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a1a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/tee01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002893 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a19 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002892 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/memset01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a05 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027b6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027b5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027b4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027b3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000275d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.535 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x1000000275c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/sigrelse01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.536 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a09 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.536 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027b2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.536 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029c1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.536 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029c3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029c2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill09.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029b9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029c0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029bd (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029b8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill08.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029c4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill10.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029bb (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill11.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029bc (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029be (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029bf (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill12.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.537 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000029ba (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002735 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002734 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002733 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027c6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027c4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027c5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002829 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/sbrk01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027c7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002828 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a4a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a4d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a4b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002808 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002807 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a4c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002806 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002944 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a55 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002a54 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/linkat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002993 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002992 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002995 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002945 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/string01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.539 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002997 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002996 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002994 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x10000002998 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027dd (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027df (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027de (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027da (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.540 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/mkpages.sh) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027db (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.4) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027d7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src/epoll.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027e6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/epoll-test.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027dc (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027eb (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/dbllist.h) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: Scrub error on inode 0x100000027ea (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/epoll.h) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: pgmap v344: 129 pgs: 129 active+clean; 808 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 MiB/s rd, 124 MiB/s wr, 1.05k op/s 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.541 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.542 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:34 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002940 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029d2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000275e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002879 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029a2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029cc (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002811 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002988 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002880 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002739 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029f3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000282a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002704 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000294a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029ae (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000279e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a1f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029ec (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000277d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a02 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a18 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002891 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027b1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000275b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029b7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002732 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002827 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a49 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002805 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a53 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002943 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002991 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027c3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a17 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a14 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a15 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a16 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002941 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002942 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/mem03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a42 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a40 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a3f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a45 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a44 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000281b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002819 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000281c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000281a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a43 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a41 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/vmsplice01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002818 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027f7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027f6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/profil01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029d5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029d6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029d3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029d4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029d8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.sh) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029d7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000297c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002979 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000297b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000297a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002762 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002761 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000275f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000287c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002760 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area.h) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000287e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000287d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000287a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000287f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000287b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029a4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029a3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/memcpy01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/fmtmsg01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002813 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002812 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/readlinkat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000298b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029cd (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000298a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002989 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029ce (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/unlinkat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002881 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002882 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002884 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002883 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002742 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000273c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe09.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002741 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe10.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002745 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000273d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002744 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe08.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000273a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe11.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002743 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002740 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000273e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000273f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029f8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029f7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.605 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029f9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029f4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029f6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029f5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000273b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000282d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000282c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002705 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/mkdirat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000282b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002706 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000294c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/connect01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000294b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029b1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.606 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029af (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027a8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029b0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027a5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.mode.sh) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027a4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027a2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027a6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027a7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027a0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.608 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000279f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.608 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027a1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.608 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a23 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027a3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a20 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a25 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a21 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a24 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a22 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a26 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029ed (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029ef (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.609 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002786 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open08.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002787 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002785 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002781 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000277e (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open10.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002780 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002782 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002784 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029ee (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002788 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002783 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open09.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.610 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000277f (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a07 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/test3.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a04 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a08 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a03 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a06 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a1a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/tee01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002893 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a19 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002892 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/memset01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a05 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027b6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027b5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027b4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027b3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000275d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x1000000275c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/sigrelse01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a09 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027b2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029c1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029c3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029c2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill09.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029b9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029c0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029bd (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029b8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill08.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.612 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029c4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill10.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029bb (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill11.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029bc (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029be (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029bf (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill12.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000029ba (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002735 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002734 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002733 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027c6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027c4 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027c5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.613 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002829 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/sbrk01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027c7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002828 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a4a (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a4d (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a4b (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002808 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002807 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a4c (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002806 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002944 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a55 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002a54 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/linkat01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.614 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002993 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002992 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link07.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002995 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link03.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002945 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/string01.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002997 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link02.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002996 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link04.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002994 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link05.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x10000002998 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link06.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e3 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027dd (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d9 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027df (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.615 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027de (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e1 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027da (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e2 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e0 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/mkpages.sh) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027db (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.txt) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.4) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027d7 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.ps) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e8 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src/epoll.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e5 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/Makefile) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027e6 (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/epoll-test.c) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027dc (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.2) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027eb (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/dbllist.h) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.616 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: Scrub error on inode 0x100000027ea (/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/epoll.h) see mds.f log and `damage ls` output for details 2023-10-08T08:45:34.617 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: pgmap v344: 129 pgs: 129 active+clean; 808 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 MiB/s rd, 124 MiB/s wr, 1.05k op/s 2023-10-08T08:45:34.617 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.617 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.617 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:34.617 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:34 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:45:36.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:36 smithi070 ceph-mon[99513]: pgmap v345: 129 pgs: 129 active+clean; 859 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 135 MiB/s wr, 1.34k op/s 2023-10-08T08:45:36.509 INFO:tasks.workunit.client.0.smithi070.stdout:9/249: sync 2023-10-08T08:45:36.509 INFO:tasks.workunit.client.0.smithi070.stdout:7/451: sync 2023-10-08T08:45:36.509 INFO:tasks.workunit.client.0.smithi070.stdout:5/401: sync 2023-10-08T08:45:36.509 INFO:tasks.workunit.client.0.smithi070.stdout:9/250: dread - d1/dd/d26/f47 zero size 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:4/298: sync 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:8/465: sync 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:6/334: sync 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:5/402: fdatasync d5/da/d4d/d37/d2a/f31 0 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:5/403: stat d5/da/d4d/d37/d38/d55/f4f 0 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:3/382: sync 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:0/589: sync 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/526: sync 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:2/614: sync 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:2/615: write df/d12/d1b/d82/d85/f78 [1507043,20529] 0 2023-10-08T08:45:36.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/527: write d6/dc/f2d [4956954,70065] 0 2023-10-08T08:45:36.511 INFO:tasks.workunit.client.0.smithi070.stdout:0/590: truncate d1/f5 1324014 0 2023-10-08T08:45:36.513 INFO:tasks.workunit.client.0.smithi070.stdout:2/616: symlink df/d12/d15/d54/db1/d83/lbf 0 2023-10-08T08:45:36.513 INFO:tasks.workunit.client.0.smithi070.stdout:5/404: rename d5/d5f/d61/d30/d83/l87 to d5/d5f/d61/d30/d54/d62/l88 0 2023-10-08T08:45:36.514 INFO:tasks.workunit.client.0.smithi070.stdout:9/251: mknod d1/dd/d19/c48 0 2023-10-08T08:45:36.514 INFO:tasks.workunit.client.0.smithi070.stdout:9/252: fsync d1/dd/d19/f1b 0 2023-10-08T08:45:36.514 INFO:tasks.workunit.client.0.smithi070.stdout:9/253: write d1/dd/d26/f47 [419734,55409] 0 2023-10-08T08:45:36.514 INFO:tasks.workunit.client.0.smithi070.stdout:9/254: dread - d1/dd/d1a/d40/f46 zero size 2023-10-08T08:45:36.514 INFO:tasks.workunit.client.0.smithi070.stdout:1/528: creat d6/dc/d14/d1f/d26/d38/d4b/fab x:0 0 0 2023-10-08T08:45:36.518 INFO:tasks.workunit.client.0.smithi070.stdout:6/335: write df/d26/d42/d4b/f64 [1971283,4694] 0 2023-10-08T08:45:36.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:36 smithi105 ceph-mon[103798]: pgmap v345: 129 pgs: 129 active+clean; 859 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 135 MiB/s wr, 1.34k op/s 2023-10-08T08:45:36.521 INFO:tasks.workunit.client.0.smithi070.stdout:0/591: symlink d1/d1d/d24/lb9 0 2023-10-08T08:45:36.521 INFO:tasks.workunit.client.0.smithi070.stdout:1/529: read d6/dc/d14/f5c [3880411,21598] 0 2023-10-08T08:45:36.523 INFO:tasks.workunit.client.0.smithi070.stdout:0/592: stat d1/d14/d1f/c3e 0 2023-10-08T08:45:36.524 INFO:tasks.workunit.client.0.smithi070.stdout:4/299: dread dc/d17/d24/f40 [0,4194304] 0 2023-10-08T08:45:36.528 INFO:tasks.workunit.client.0.smithi070.stdout:4/300: mknod dc/d17/d24/d4c/d4e/c63 0 2023-10-08T08:45:36.528 INFO:tasks.workunit.client.0.smithi070.stdout:0/593: mknod d1/dd/cba 0 2023-10-08T08:45:36.528 INFO:tasks.workunit.client.0.smithi070.stdout:1/530: symlink d6/lac 0 2023-10-08T08:45:36.528 INFO:tasks.workunit.client.0.smithi070.stdout:1/531: chown f5 7887436 1 2023-10-08T08:45:36.528 INFO:tasks.workunit.client.0.smithi070.stdout:1/532: write d6/f1b [1501103,66319] 0 2023-10-08T08:45:36.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/533: mknod d6/dc/d14/cad 0 2023-10-08T08:45:36.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/534: truncate d6/dc/d14/d1f/d26/f31 524205 0 2023-10-08T08:45:36.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/535: getdents d6/dc/d14/d1f/d75/d88 0 2023-10-08T08:45:36.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/536: read - d6/dc/d14/d70/fa6 zero size 2023-10-08T08:45:36.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/537: rename d6/dc/d14/d1f to d6/dc/d14/d1f/d75/da1/dae 22 2023-10-08T08:45:36.530 INFO:tasks.workunit.client.0.smithi070.stdout:1/538: mknod d6/dc/d14/d1f/d63/caf 0 2023-10-08T08:45:36.531 INFO:tasks.workunit.client.0.smithi070.stdout:9/255: dread d1/dd/d19/f1b [0,4194304] 0 2023-10-08T08:45:36.531 INFO:tasks.workunit.client.0.smithi070.stdout:9/256: write d1/f2a [577372,10855] 0 2023-10-08T08:45:36.533 INFO:tasks.workunit.client.0.smithi070.stdout:1/539: mknod d6/dc/d14/d1f/d63/daa/cb0 0 2023-10-08T08:45:36.533 INFO:tasks.workunit.client.0.smithi070.stdout:9/257: mkdir d1/dd/d26/d49 0 2023-10-08T08:45:36.534 INFO:tasks.workunit.client.0.smithi070.stdout:1/540: mknod d6/dc/d14/d90/cb1 0 2023-10-08T08:45:36.537 INFO:tasks.workunit.client.0.smithi070.stdout:1/541: symlink d6/dc/d14/d1f/d26/lb2 0 2023-10-08T08:45:36.539 INFO:tasks.workunit.client.0.smithi070.stdout:7/452: dread d3/d19/d1b/d4a/f83 [0,4194304] 0 2023-10-08T08:45:36.544 INFO:tasks.workunit.client.0.smithi070.stdout:5/405: dwrite d5/da/d4d/f85 [0,4194304] 0 2023-10-08T08:45:36.544 INFO:tasks.workunit.client.0.smithi070.stdout:5/406: stat d5/da/d4d/d37/d2a/c5b 0 2023-10-08T08:45:36.544 INFO:tasks.workunit.client.0.smithi070.stdout:7/453: rename d3/d19/d1b/d4a/f25 to d3/d19/d1b/d4a/d9/d97/f9b 0 2023-10-08T08:45:36.547 INFO:tasks.workunit.client.0.smithi070.stdout:6/336: dread df/d26/d42/d4b/f56 [0,4194304] 0 2023-10-08T08:45:36.550 INFO:tasks.workunit.client.0.smithi070.stdout:5/407: link d5/da/d22/f47 d5/da/d22/f89 0 2023-10-08T08:45:36.551 INFO:tasks.workunit.client.0.smithi070.stdout:7/454: symlink d3/d19/d1b/d4a/d9/l9c 0 2023-10-08T08:45:36.551 INFO:tasks.workunit.client.0.smithi070.stdout:7/455: dread - d3/d19/d1a/f2f zero size 2023-10-08T08:45:36.551 INFO:tasks.workunit.client.0.smithi070.stdout:7/456: chown d3/d19/d1b/d4a/d9/l85 374990 1 2023-10-08T08:45:36.552 INFO:tasks.workunit.client.0.smithi070.stdout:2/617: dread fc [0,4194304] 0 2023-10-08T08:45:36.552 INFO:tasks.workunit.client.0.smithi070.stdout:2/618: chown df/d12/d15/d54/c5e 801459274 1 2023-10-08T08:45:36.552 INFO:tasks.workunit.client.0.smithi070.stdout:2/619: readlink df/l29 0 2023-10-08T08:45:36.553 INFO:tasks.workunit.client.0.smithi070.stdout:7/457: dread d3/d19/d1b/d1e/d4c/f80 [0,4194304] 0 2023-10-08T08:45:36.553 INFO:tasks.workunit.client.0.smithi070.stdout:5/408: creat d5/d5f/d61/d30/d54/d62/f8a x:0 0 0 2023-10-08T08:45:36.553 INFO:tasks.workunit.client.0.smithi070.stdout:0/594: dread d1/d14/f43 [0,4194304] 0 2023-10-08T08:45:36.556 INFO:tasks.workunit.client.0.smithi070.stdout:3/383: dwrite d0/db/d10/f59 [0,4194304] 0 2023-10-08T08:45:36.556 INFO:tasks.workunit.client.0.smithi070.stdout:5/409: mkdir d5/d5f/d63/d8b 0 2023-10-08T08:45:36.557 INFO:tasks.workunit.client.0.smithi070.stdout:8/466: dwrite d1/de/d1a/f79 [0,4194304] 0 2023-10-08T08:45:36.558 INFO:tasks.workunit.client.0.smithi070.stdout:2/620: getdents df/d12/d1b/d82 0 2023-10-08T08:45:36.560 INFO:tasks.workunit.client.0.smithi070.stdout:8/467: write d1/d23/f43 [2607928,119121] 0 2023-10-08T08:45:36.560 INFO:tasks.workunit.client.0.smithi070.stdout:3/384: mkdir d0/d12/d14/d5c/d5d/d75/d52/d5a/d6a/d80 0 2023-10-08T08:45:36.561 INFO:tasks.workunit.client.0.smithi070.stdout:7/458: rename d3/f3d to d3/d19/d1b/f9d 0 2023-10-08T08:45:36.563 INFO:tasks.workunit.client.0.smithi070.stdout:8/468: write d1/d2/d6/d22/f4b [2908748,47982] 0 2023-10-08T08:45:36.564 INFO:tasks.workunit.client.0.smithi070.stdout:2/621: creat df/d93/fc0 x:0 0 0 2023-10-08T08:45:36.564 INFO:tasks.workunit.client.0.smithi070.stdout:3/385: creat d0/d12/f81 x:0 0 0 2023-10-08T08:45:36.565 INFO:tasks.workunit.client.0.smithi070.stdout:7/459: symlink d3/d19/l9e 0 2023-10-08T08:45:36.565 INFO:tasks.workunit.client.0.smithi070.stdout:7/460: readlink d3/d19/l61 0 2023-10-08T08:45:36.565 INFO:tasks.workunit.client.0.smithi070.stdout:5/410: unlink d5/da/f23 0 2023-10-08T08:45:36.568 INFO:tasks.workunit.client.0.smithi070.stdout:6/337: link cc df/d11/d1d/c6f 0 2023-10-08T08:45:36.568 INFO:tasks.workunit.client.0.smithi070.stdout:6/338: truncate df/d53/f5e 244641 0 2023-10-08T08:45:36.569 INFO:tasks.workunit.client.0.smithi070.stdout:5/411: creat d5/d5f/d61/d30/d83/f8c x:0 0 0 2023-10-08T08:45:36.570 INFO:tasks.workunit.client.0.smithi070.stdout:6/339: symlink df/d26/d42/d43/l70 0 2023-10-08T08:45:36.570 INFO:tasks.workunit.client.0.smithi070.stdout:6/340: fsync df/d26/f6b 0 2023-10-08T08:45:36.572 INFO:tasks.workunit.client.0.smithi070.stdout:6/341: write df/f1c [2876717,13745] 0 2023-10-08T08:45:36.575 INFO:tasks.workunit.client.0.smithi070.stdout:6/342: mkdir df/d71 0 2023-10-08T08:45:36.577 INFO:tasks.workunit.client.0.smithi070.stdout:6/343: symlink df/l72 0 2023-10-08T08:45:36.579 INFO:tasks.workunit.client.0.smithi070.stdout:6/344: symlink df/d26/l73 0 2023-10-08T08:45:36.580 INFO:tasks.workunit.client.0.smithi070.stdout:6/345: mkdir df/d26/d42/d55/d74 0 2023-10-08T08:45:36.580 INFO:tasks.workunit.client.0.smithi070.stdout:6/346: write df/d26/d42/d43/d4a/f6d [101984,39660] 0 2023-10-08T08:45:36.582 INFO:tasks.workunit.client.0.smithi070.stdout:6/347: mkdir df/d26/d42/d43/d4a/d75 0 2023-10-08T08:45:36.583 INFO:tasks.workunit.client.0.smithi070.stdout:6/348: symlink df/d26/d42/d43/d4a/l76 0 2023-10-08T08:45:36.589 INFO:tasks.workunit.client.0.smithi070.stdout:2/622: write df/d12/d1b/d82/d85/f78 [1150538,98418] 0 2023-10-08T08:45:36.589 INFO:tasks.workunit.client.0.smithi070.stdout:4/301: dwrite dc/f4d [8388608,4194304] 0 2023-10-08T08:45:36.592 INFO:tasks.workunit.client.0.smithi070.stdout:4/302: mknod dc/d17/d1f/c64 0 2023-10-08T08:45:36.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:36 smithi191 ceph-mon[104220]: pgmap v345: 129 pgs: 129 active+clean; 859 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 135 MiB/s wr, 1.34k op/s 2023-10-08T08:45:36.596 INFO:tasks.workunit.client.0.smithi070.stdout:4/303: write dc/ff [19660,85259] 0 2023-10-08T08:45:36.597 INFO:tasks.workunit.client.0.smithi070.stdout:7/461: dread d3/d19/d1b/d4a/f43 [0,4194304] 0 2023-10-08T08:45:36.597 INFO:tasks.workunit.client.0.smithi070.stdout:3/386: dwrite d0/d12/d14/d1d/f5e [0,4194304] 0 2023-10-08T08:45:36.597 INFO:tasks.workunit.client.0.smithi070.stdout:8/469: dwrite d1/de/d15/f20 [4194304,4194304] 0 2023-10-08T08:45:36.597 INFO:tasks.workunit.client.0.smithi070.stdout:8/470: write d1/f73 [1057167,103553] 0 2023-10-08T08:45:36.598 INFO:tasks.workunit.client.0.smithi070.stdout:4/304: symlink dc/d5a/l65 0 2023-10-08T08:45:36.600 INFO:tasks.workunit.client.0.smithi070.stdout:3/387: creat d0/db/d10/d38/d63/f82 x:0 0 0 2023-10-08T08:45:36.603 INFO:tasks.workunit.client.0.smithi070.stdout:3/388: rename d0/d12/d14/f62 to d0/d12/d14/d48/f83 0 2023-10-08T08:45:36.605 INFO:tasks.workunit.client.0.smithi070.stdout:7/462: mkdir d3/d19/d1b/d4a/d50/d9f 0 2023-10-08T08:45:36.611 INFO:tasks.workunit.client.0.smithi070.stdout:5/412: dwrite d5/da/d4d/f67 [0,4194304] 0 2023-10-08T08:45:36.611 INFO:tasks.workunit.client.0.smithi070.stdout:5/413: readlink d5/da/d4d/d37/d38/d55/l4e 0 2023-10-08T08:45:36.614 INFO:tasks.workunit.client.0.smithi070.stdout:2/623: dwrite df/d12/d15/d54/db1/d83/d92/fab [0,4194304] 0 2023-10-08T08:45:36.614 INFO:tasks.workunit.client.0.smithi070.stdout:2/624: truncate df/d93/fc0 900904 0 2023-10-08T08:45:36.614 INFO:tasks.workunit.client.0.smithi070.stdout:2/625: fsync df/d12/d15/d54/f87 0 2023-10-08T08:45:36.616 INFO:tasks.workunit.client.0.smithi070.stdout:5/414: symlink d5/da/d22/d75/d82/l8d 0 2023-10-08T08:45:36.617 INFO:tasks.workunit.client.0.smithi070.stdout:2/626: mkdir df/d12/d15/d54/db1/d83/d92/dc1 0 2023-10-08T08:45:36.617 INFO:tasks.workunit.client.0.smithi070.stdout:2/627: chown df/d4c/c84 621 1 2023-10-08T08:45:36.617 INFO:tasks.workunit.client.0.smithi070.stdout:5/415: creat d5/da/d4d/f8e x:0 0 0 2023-10-08T08:45:36.619 INFO:tasks.workunit.client.0.smithi070.stdout:5/416: mkdir d5/d5f/d63/d8b/d8f 0 2023-10-08T08:45:36.619 INFO:tasks.workunit.client.0.smithi070.stdout:3/389: dread d0/d12/d14/f40 [0,4194304] 0 2023-10-08T08:45:36.620 INFO:tasks.workunit.client.0.smithi070.stdout:5/417: write d5/da/d4d/f8e [416990,27030] 0 2023-10-08T08:45:36.620 INFO:tasks.workunit.client.0.smithi070.stdout:5/418: chown d5/f7c 117 1 2023-10-08T08:45:36.620 INFO:tasks.workunit.client.0.smithi070.stdout:7/463: write d3/d19/d1a/f4e [1788076,2016] 0 2023-10-08T08:45:36.620 INFO:tasks.workunit.client.0.smithi070.stdout:7/464: chown d3/d19/d1b/c65 1 1 2023-10-08T08:45:36.620 INFO:tasks.workunit.client.0.smithi070.stdout:6/349: dwrite df/d26/f2f [0,4194304] 0 2023-10-08T08:45:36.620 INFO:tasks.workunit.client.0.smithi070.stdout:2/628: rename df/d12/d1b/db7 to df/d93/dc2 0 2023-10-08T08:45:36.626 INFO:tasks.workunit.client.0.smithi070.stdout:8/471: dread d1/d2/d6/d22/f58 [0,4194304] 0 2023-10-08T08:45:36.627 INFO:tasks.workunit.client.0.smithi070.stdout:3/390: write d0/d12/d14/d48/f83 [3570627,69818] 0 2023-10-08T08:45:36.628 INFO:tasks.workunit.client.0.smithi070.stdout:3/391: creat d0/d12/d14/d48/f84 x:0 0 0 2023-10-08T08:45:36.629 INFO:tasks.workunit.client.0.smithi070.stdout:3/392: chown d0/d12/d14/d5c/d5d/d75/c57 468714 1 2023-10-08T08:45:36.641 INFO:tasks.workunit.client.0.smithi070.stdout:8/472: dread d1/d2/d6/d22/f4b [0,4194304] 0 2023-10-08T08:45:36.642 INFO:tasks.workunit.client.0.smithi070.stdout:5/419: dread d5/da/d4d/f3f [0,4194304] 0 2023-10-08T08:45:36.642 INFO:tasks.workunit.client.0.smithi070.stdout:8/473: mknod d1/de/d3a/d92/ca1 0 2023-10-08T08:45:36.645 INFO:tasks.workunit.client.0.smithi070.stdout:5/420: link d5/da/d22/f47 d5/da/d4d/d37/d38/d55/f90 0 2023-10-08T08:45:36.645 INFO:tasks.workunit.client.0.smithi070.stdout:5/421: symlink d5/da/d4d/d37/d2a/l91 0 2023-10-08T08:45:36.733 INFO:tasks.workunit.client.0.smithi070.stdout:4/305: dwrite dc/d17/d24/d37/f3a [0,4194304] 0 2023-10-08T08:45:36.736 INFO:tasks.workunit.client.0.smithi070.stdout:4/306: creat dc/d17/d24/d55/f66 x:0 0 0 2023-10-08T08:45:36.737 INFO:tasks.workunit.client.0.smithi070.stdout:4/307: rmdir dc/d17/d24/d37 39 2023-10-08T08:45:36.737 INFO:tasks.workunit.client.0.smithi070.stdout:4/308: chown dc/l22 325398 1 2023-10-08T08:45:36.737 INFO:tasks.workunit.client.0.smithi070.stdout:4/309: fdatasync dc/f50 0 2023-10-08T08:45:36.738 INFO:tasks.workunit.client.0.smithi070.stdout:4/310: creat dc/d17/d1f/d54/f67 x:0 0 0 2023-10-08T08:45:36.744 INFO:tasks.workunit.client.0.smithi070.stdout:4/311: write dc/f4b [1873175,95034] 0 2023-10-08T08:45:36.744 INFO:tasks.workunit.client.0.smithi070.stdout:4/312: write dc/d17/d1f/f43 [246531,56130] 0 2023-10-08T08:45:36.744 INFO:tasks.workunit.client.0.smithi070.stdout:4/313: chown dc/d17/d24/d37/f53 77866058 1 2023-10-08T08:45:36.744 INFO:tasks.workunit.client.0.smithi070.stdout:4/314: write dc/d17/d24/d37/f53 [585788,58688] 0 2023-10-08T08:45:36.744 INFO:tasks.workunit.client.0.smithi070.stdout:3/393: dread d0/db/d10/f2c [0,4194304] 0 2023-10-08T08:45:36.746 INFO:tasks.workunit.client.0.smithi070.stdout:4/315: mkdir dc/d68 0 2023-10-08T08:45:36.746 INFO:tasks.workunit.client.0.smithi070.stdout:5/422: dwrite d5/da/f15 [0,4194304] 0 2023-10-08T08:45:36.746 INFO:tasks.workunit.client.0.smithi070.stdout:8/474: dread d1/de/d15/f40 [0,4194304] 0 2023-10-08T08:45:36.747 INFO:tasks.workunit.client.0.smithi070.stdout:3/394: write d0/db/f18 [2468523,27524] 0 2023-10-08T08:45:36.747 INFO:tasks.workunit.client.0.smithi070.stdout:4/316: rename dc/d17/d1f/l2b to dc/d5a/l69 0 2023-10-08T08:45:36.747 INFO:tasks.workunit.client.0.smithi070.stdout:4/317: dread - dc/f1e zero size 2023-10-08T08:45:36.748 INFO:tasks.workunit.client.0.smithi070.stdout:5/423: symlink d5/da/d4d/d37/l92 0 2023-10-08T08:45:36.749 INFO:tasks.workunit.client.0.smithi070.stdout:8/475: creat d1/d4d/d61/fa2 x:0 0 0 2023-10-08T08:45:36.749 INFO:tasks.workunit.client.0.smithi070.stdout:7/465: write d3/d19/d1a/f70 [2662666,125476] 0 2023-10-08T08:45:36.749 INFO:tasks.workunit.client.0.smithi070.stdout:3/395: creat d0/d12/d14/d48/f85 x:0 0 0 2023-10-08T08:45:36.750 INFO:tasks.workunit.client.0.smithi070.stdout:4/318: dread dc/d17/f2e [0,4194304] 0 2023-10-08T08:45:36.750 INFO:tasks.workunit.client.0.smithi070.stdout:4/319: stat dc/d5a/l65 0 2023-10-08T08:45:36.750 INFO:tasks.workunit.client.0.smithi070.stdout:3/396: readlink d0/d12/d14/d5c/d5d/d75/d52/d5a/l79 0 2023-10-08T08:45:36.751 INFO:tasks.workunit.client.0.smithi070.stdout:4/320: write dc/d17/d24/f49 [71942,62861] 0 2023-10-08T08:45:36.751 INFO:tasks.workunit.client.0.smithi070.stdout:4/321: fdatasync dc/d17/d24/d55/f66 0 2023-10-08T08:45:36.751 INFO:tasks.workunit.client.0.smithi070.stdout:4/322: chown dc/d17/d1f/c2d 8115504 1 2023-10-08T08:45:36.751 INFO:tasks.workunit.client.0.smithi070.stdout:5/424: creat d5/d5f/d61/d30/d83/f93 x:0 0 0 2023-10-08T08:45:36.751 INFO:tasks.workunit.client.0.smithi070.stdout:2/629: dwrite df/d4c/f9c [0,4194304] 0 2023-10-08T08:45:36.751 INFO:tasks.workunit.client.0.smithi070.stdout:2/630: truncate df/d73/f7f 1766273 0 2023-10-08T08:45:36.752 INFO:tasks.workunit.client.0.smithi070.stdout:7/466: link d3/d19/d1b/d1e/d76/f8a d3/d19/d1b/d4a/d9/d97/fa0 0 2023-10-08T08:45:36.752 INFO:tasks.workunit.client.0.smithi070.stdout:8/476: creat d1/d4d/fa3 x:0 0 0 2023-10-08T08:45:36.752 INFO:tasks.workunit.client.0.smithi070.stdout:3/397: mkdir d0/d12/d14/d5c/d5d/d75/d52/d5a/d86 0 2023-10-08T08:45:36.752 INFO:tasks.workunit.client.0.smithi070.stdout:4/323: link dc/d17/d24/d4c/d4e/c63 dc/d17/d1f/d54/c6a 0 2023-10-08T08:45:36.752 INFO:tasks.workunit.client.0.smithi070.stdout:4/324: read dc/d17/d24/f49 [71966,105529] 0 2023-10-08T08:45:36.753 INFO:tasks.workunit.client.0.smithi070.stdout:7/467: truncate d3/d19/d1b/d4a/f43 3192037 0 2023-10-08T08:45:36.753 INFO:tasks.workunit.client.0.smithi070.stdout:7/468: chown d3/d19/d6d 198459 1 2023-10-08T08:45:36.757 INFO:tasks.workunit.client.0.smithi070.stdout:5/425: dread d5/d5f/d61/f60 [0,4194304] 0 2023-10-08T08:45:36.758 INFO:tasks.workunit.client.0.smithi070.stdout:8/477: dread d1/d2/f1e [0,4194304] 0 2023-10-08T08:45:36.761 INFO:tasks.workunit.client.0.smithi070.stdout:4/325: dread f9 [0,4194304] 0 2023-10-08T08:45:36.761 INFO:tasks.workunit.client.0.smithi070.stdout:2/631: truncate df/d73/f7f 1456314 0 2023-10-08T08:45:36.763 INFO:tasks.workunit.client.0.smithi070.stdout:2/632: mknod df/d4c/d91/cc3 0 2023-10-08T08:45:36.763 INFO:tasks.workunit.client.0.smithi070.stdout:2/633: dread - df/d12/d7e/f8e zero size 2023-10-08T08:45:36.763 INFO:tasks.workunit.client.0.smithi070.stdout:2/634: chown df/d12/d1b/d82/d85/d65/fb3 5 1 2023-10-08T08:45:36.764 INFO:tasks.workunit.client.0.smithi070.stdout:2/635: symlink df/d4c/d91/lc4 0 2023-10-08T08:45:36.769 INFO:tasks.workunit.client.0.smithi070.stdout:7/469: dread d3/d19/d1b/d4a/f8 [0,4194304] 0 2023-10-08T08:45:36.770 INFO:tasks.workunit.client.0.smithi070.stdout:4/326: mkdir dc/d17/d24/d6b 0 2023-10-08T08:45:36.772 INFO:tasks.workunit.client.0.smithi070.stdout:3/398: dread d0/d12/d14/d48/f83 [0,4194304] 0 2023-10-08T08:45:36.772 INFO:tasks.workunit.client.0.smithi070.stdout:3/399: stat d0/d12/d14/d1d/l55 0 2023-10-08T08:45:36.773 INFO:tasks.workunit.client.0.smithi070.stdout:7/470: symlink d3/d19/d95/la1 0 2023-10-08T08:45:36.774 INFO:tasks.workunit.client.0.smithi070.stdout:4/327: truncate dc/f51 1736728 0 2023-10-08T08:45:36.781 INFO:tasks.workunit.client.0.smithi070.stdout:7/471: dread d3/d19/d1b/f9d [0,4194304] 0 2023-10-08T08:45:36.783 INFO:tasks.workunit.client.0.smithi070.stdout:7/472: rename d3/c5 to d3/d19/d6d/ca2 0 2023-10-08T08:45:36.786 INFO:tasks.workunit.client.0.smithi070.stdout:7/473: mkdir d3/d19/d95/da3 0 2023-10-08T08:45:36.786 INFO:tasks.workunit.client.0.smithi070.stdout:7/474: write d3/f2b [1221631,77500] 0 2023-10-08T08:45:36.786 INFO:tasks.workunit.client.0.smithi070.stdout:7/475: write d3/f71 [4569649,59598] 0 2023-10-08T08:45:36.786 INFO:tasks.workunit.client.0.smithi070.stdout:8/478: dwrite d1/de/d3a/d56/d65/f93 [0,4194304] 0 2023-10-08T08:45:36.787 INFO:tasks.workunit.client.0.smithi070.stdout:8/479: readlink d1/d2/d6/l67 0 2023-10-08T08:45:36.787 INFO:tasks.workunit.client.0.smithi070.stdout:8/480: chown d1/d2/d6/d22/d5b/c8e 9558800 1 2023-10-08T08:45:36.788 INFO:tasks.workunit.client.0.smithi070.stdout:8/481: write d1/d2/f3b [167275,125171] 0 2023-10-08T08:45:36.789 INFO:tasks.workunit.client.0.smithi070.stdout:8/482: getdents d1/d2/d8c 0 2023-10-08T08:45:36.789 INFO:tasks.workunit.client.0.smithi070.stdout:3/400: write d0/d12/d14/d5c/f61 [124083,90655] 0 2023-10-08T08:45:36.789 INFO:tasks.workunit.client.0.smithi070.stdout:5/426: dwrite d5/da/d4d/d37/f6c [0,4194304] 0 2023-10-08T08:45:36.792 INFO:tasks.workunit.client.0.smithi070.stdout:3/401: link d0/d12/d14/d5c/d5d/d75/c57 d0/d12/d14/d5c/c87 0 2023-10-08T08:45:36.793 INFO:tasks.workunit.client.0.smithi070.stdout:8/483: dread d1/de/d3a/d56/f95 [0,4194304] 0 2023-10-08T08:45:36.796 INFO:tasks.workunit.client.0.smithi070.stdout:3/402: rename d0/db/d10/f59 to d0/d12/d14/d5c/d5d/d75/d52/d5a/f88 0 2023-10-08T08:45:36.797 INFO:tasks.workunit.client.0.smithi070.stdout:8/484: dread - d1/d4d/f68 zero size 2023-10-08T08:45:36.800 INFO:tasks.workunit.client.0.smithi070.stdout:3/403: rename d0/db/f7f to d0/d12/d14/d5c/d5d/d75/d52/d5a/d86/f89 0 2023-10-08T08:45:36.804 INFO:tasks.workunit.client.0.smithi070.stdout:8/485: mknod d1/de/d3a/d92/ca4 0 2023-10-08T08:45:36.804 INFO:tasks.workunit.client.0.smithi070.stdout:8/486: rmdir d1/de/d2e/d45 39 2023-10-08T08:45:36.906 INFO:tasks.workunit.client.0.smithi070.stdout:8/487: write d1/de/d15/f40 [2169280,36422] 0 2023-10-08T08:45:36.906 INFO:tasks.workunit.client.0.smithi070.stdout:7/476: dwrite d3/d19/d1a/f4e [0,4194304] 0 2023-10-08T08:45:36.907 INFO:tasks.workunit.client.0.smithi070.stdout:8/488: symlink d1/de/d2e/d45/d7b/la5 0 2023-10-08T08:45:36.908 INFO:tasks.workunit.client.0.smithi070.stdout:7/477: truncate d3/d19/d1b/d4a/f83 1737660 0 2023-10-08T08:45:36.908 INFO:tasks.workunit.client.0.smithi070.stdout:7/478: chown d3/d19/d1b/d1e/d76/l89 2100251 1 2023-10-08T08:45:36.909 INFO:tasks.workunit.client.0.smithi070.stdout:7/479: mkdir d3/d19/d1b/d4a/d9/da4 0 2023-10-08T08:45:36.910 INFO:tasks.workunit.client.0.smithi070.stdout:7/480: symlink d3/d19/d95/la5 0 2023-10-08T08:45:36.911 INFO:tasks.workunit.client.0.smithi070.stdout:7/481: chown d3/d19/d1b/d4a/d50/f81 101 1 2023-10-08T08:45:36.928 INFO:tasks.workunit.client.0.smithi070.stdout:8/489: dwrite d1/d2/d6/d22/f98 [0,4194304] 0 2023-10-08T08:45:36.930 INFO:tasks.workunit.client.0.smithi070.stdout:7/482: dwrite d3/d19/d1b/d4a/f43 [0,4194304] 0 2023-10-08T08:45:36.932 INFO:tasks.workunit.client.0.smithi070.stdout:8/490: unlink d1/de/d2e/f48 0 2023-10-08T08:45:36.932 INFO:tasks.workunit.client.0.smithi070.stdout:8/491: chown d1/de/d3a/d56/d65/c7a 14 1 2023-10-08T08:45:36.933 INFO:tasks.workunit.client.0.smithi070.stdout:8/492: creat d1/de/d3a/fa6 x:0 0 0 2023-10-08T08:45:36.935 INFO:tasks.workunit.client.0.smithi070.stdout:8/493: mkdir d1/d2/d6/d22/d9e/da7 0 2023-10-08T08:45:36.935 INFO:tasks.workunit.client.0.smithi070.stdout:8/494: fsync d1/d2/d6/d22/f4b 0 2023-10-08T08:45:36.935 INFO:tasks.workunit.client.0.smithi070.stdout:8/495: fdatasync d1/d2/f31 0 2023-10-08T08:45:36.935 INFO:tasks.workunit.client.0.smithi070.stdout:8/496: dread - d1/de/d3a/fa6 zero size 2023-10-08T08:45:36.944 INFO:tasks.workunit.client.0.smithi070.stdout:8/497: dread d1/d2/d6/d22/f4c [0,4194304] 0 2023-10-08T08:45:36.946 INFO:tasks.workunit.client.0.smithi070.stdout:8/498: rename d1/de/d2e/d45/f53 to d1/de/d2e/fa8 0 2023-10-08T08:45:36.948 INFO:tasks.workunit.client.0.smithi070.stdout:8/499: mkdir d1/de/da9 0 2023-10-08T08:45:36.950 INFO:tasks.workunit.client.0.smithi070.stdout:7/483: dwrite d3/d19/d1b/d4a/d9/f48 [4194304,4194304] 0 2023-10-08T08:45:36.967 INFO:tasks.workunit.client.0.smithi070.stdout:7/484: dread d3/d19/d1b/d1e/d4c/f63 [0,4194304] 0 2023-10-08T08:45:36.968 INFO:tasks.workunit.client.0.smithi070.stdout:7/485: truncate d3/d19/d1b/d4a/d9/d97/f9b 423938 0 2023-10-08T08:45:36.968 INFO:tasks.workunit.client.0.smithi070.stdout:7/486: fdatasync d3/d19/d1b/d4a/d9/d97/fa0 0 2023-10-08T08:45:36.969 INFO:tasks.workunit.client.0.smithi070.stdout:7/487: symlink d3/d19/d1b/d4a/d9/la6 0 2023-10-08T08:45:36.972 INFO:tasks.workunit.client.0.smithi070.stdout:8/500: dwrite d1/d2/d6/d22/f58 [0,4194304] 0 2023-10-08T08:45:36.972 INFO:tasks.workunit.client.0.smithi070.stdout:8/501: fsync d1/de/d3a/d56/f95 0 2023-10-08T08:45:36.972 INFO:tasks.workunit.client.0.smithi070.stdout:8/502: readlink d1/de/d1a/l76 0 2023-10-08T08:45:36.974 INFO:tasks.workunit.client.0.smithi070.stdout:8/503: link d1/d2/d6/d22/d5b/c8e d1/de/d3a/caa 0 2023-10-08T08:45:36.975 INFO:tasks.workunit.client.0.smithi070.stdout:7/488: dread d3/d19/d1b/d4a/f83 [0,4194304] 0 2023-10-08T08:45:36.980 INFO:tasks.workunit.client.0.smithi070.stdout:7/489: dread d3/d19/d1b/d4a/f83 [0,4194304] 0 2023-10-08T08:45:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:8/504: dwrite d1/d2/d6/d22/d5c/f8d [0,4194304] 0 2023-10-08T08:45:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:8/505: mknod d1/de/d3a/cab 0 2023-10-08T08:45:36.995 INFO:tasks.workunit.client.0.smithi070.stdout:8/506: write d1/d4d/f5f [1540173,37065] 0 2023-10-08T08:45:36.995 INFO:tasks.workunit.client.0.smithi070.stdout:8/507: truncate d1/de/d2e/fa8 563400 0 2023-10-08T08:45:37.007 INFO:tasks.workunit.client.0.smithi070.stdout:8/508: dread d1/d2/d6/f14 [0,4194304] 0 2023-10-08T08:45:37.008 INFO:tasks.workunit.client.0.smithi070.stdout:8/509: mknod d1/de/d15/cac 0 2023-10-08T08:45:37.008 INFO:tasks.workunit.client.0.smithi070.stdout:8/510: chown d1/d2/d6/d22/d5b/d74/c91 22 1 2023-10-08T08:45:37.008 INFO:tasks.workunit.client.0.smithi070.stdout:8/511: truncate d1/d4d/f68 602445 0 2023-10-08T08:45:37.009 INFO:tasks.workunit.client.0.smithi070.stdout:8/512: creat d1/de/d3a/d92/fad x:0 0 0 2023-10-08T08:45:37.027 INFO:tasks.workunit.client.0.smithi070.stdout:8/513: dwrite d1/d2/d6/d22/f58 [0,4194304] 0 2023-10-08T08:45:37.028 INFO:tasks.workunit.client.0.smithi070.stdout:8/514: link d1/d2/f3b d1/de/da9/fae 0 2023-10-08T08:45:37.047 INFO:tasks.workunit.client.0.smithi070.stdout:8/515: dwrite d1/d4d/f68 [0,4194304] 0 2023-10-08T08:45:37.051 INFO:tasks.workunit.client.0.smithi070.stdout:8/516: dread d1/d2/f1e [0,4194304] 0 2023-10-08T08:45:37.069 INFO:tasks.workunit.client.0.smithi070.stdout:8/517: dwrite d1/de/d2e/d45/f51 [0,4194304] 0 2023-10-08T08:45:37.072 INFO:tasks.workunit.client.0.smithi070.stdout:8/518: link d1/d2/c39 d1/d2/d6/d22/d9e/caf 0 2023-10-08T08:45:37.075 INFO:tasks.workunit.client.0.smithi070.stdout:8/519: dread d1/de/d21/f35 [0,4194304] 0 2023-10-08T08:45:37.076 INFO:tasks.workunit.client.0.smithi070.stdout:8/520: creat d1/d2/d8c/fb0 x:0 0 0 2023-10-08T08:45:37.078 INFO:tasks.workunit.client.0.smithi070.stdout:8/521: write d1/d2/d6/fa [2981953,79195] 0 2023-10-08T08:45:37.095 INFO:tasks.workunit.client.0.smithi070.stdout:8/522: dwrite d1/de/f34 [0,4194304] 0 2023-10-08T08:45:37.096 INFO:tasks.workunit.client.0.smithi070.stdout:8/523: readlink d1/de/d15/l16 0 2023-10-08T08:45:37.096 INFO:tasks.workunit.client.0.smithi070.stdout:8/524: stat d1/d2/d6/d22/f4b 0 2023-10-08T08:45:37.096 INFO:tasks.workunit.client.0.smithi070.stdout:8/525: creat d1/de/d15/fb1 x:0 0 0 2023-10-08T08:45:37.097 INFO:tasks.workunit.client.0.smithi070.stdout:8/526: mknod d1/de/d2e/d45/d80/cb2 0 2023-10-08T08:45:37.097 INFO:tasks.workunit.client.0.smithi070.stdout:8/527: chown d1/de/d3a/d56/d65/f71 30817 1 2023-10-08T08:45:37.097 INFO:tasks.workunit.client.0.smithi070.stdout:8/528: write d1/d2/d6/d22/d5c/d99/f9d [867744,119399] 0 2023-10-08T08:45:37.099 INFO:tasks.workunit.client.0.smithi070.stdout:8/529: dread d1/d2/f3b [0,4194304] 0 2023-10-08T08:45:37.100 INFO:tasks.workunit.client.0.smithi070.stdout:8/530: rename d1/d2/d6/d22/f2b to d1/d4d/d61/fb3 0 2023-10-08T08:45:38.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:38 smithi070 ceph-mon[99513]: pgmap v346: 129 pgs: 129 active+clean; 931 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s rd, 155 MiB/s wr, 1.67k op/s 2023-10-08T08:45:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:38 smithi105 ceph-mon[103798]: pgmap v346: 129 pgs: 129 active+clean; 931 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s rd, 155 MiB/s wr, 1.67k op/s 2023-10-08T08:45:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:38 smithi191 ceph-mon[104220]: pgmap v346: 129 pgs: 129 active+clean; 931 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 70 MiB/s rd, 155 MiB/s wr, 1.67k op/s 2023-10-08T08:45:40.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:40 smithi070 ceph-mon[99513]: pgmap v347: 129 pgs: 129 active+clean; 935 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 142 MiB/s wr, 1.56k op/s 2023-10-08T08:45:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:40 smithi105 ceph-mon[103798]: pgmap v347: 129 pgs: 129 active+clean; 935 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 142 MiB/s wr, 1.56k op/s 2023-10-08T08:45:40.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:40 smithi191 ceph-mon[104220]: pgmap v347: 129 pgs: 129 active+clean; 935 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 142 MiB/s wr, 1.56k op/s 2023-10-08T08:45:40.981 INFO:tasks.workunit.client.0.smithi070.stdout:0/595: sync 2023-10-08T08:45:40.981 INFO:tasks.workunit.client.0.smithi070.stdout:4/328: sync 2023-10-08T08:45:40.981 INFO:tasks.workunit.client.0.smithi070.stdout:0/596: chown d1/f57 92 1 2023-10-08T08:45:40.981 INFO:tasks.workunit.client.0.smithi070.stdout:4/329: chown dc/d17/d24/d37/f3b 302 1 2023-10-08T08:45:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:9/258: sync 2023-10-08T08:45:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:1/542: sync 2023-10-08T08:45:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:5/427: sync 2023-10-08T08:45:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:7/490: sync 2023-10-08T08:45:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:9/259: write d1/dd/d26/d27/f36 [843675,8507] 0 2023-10-08T08:45:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:8/531: sync 2023-10-08T08:45:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:8/532: readlink d1/d23/l2f 0 2023-10-08T08:45:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:6/350: sync 2023-10-08T08:45:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:6/351: chown df/d53/f62 81304 1 2023-10-08T08:45:40.983 INFO:tasks.workunit.client.0.smithi070.stdout:0/597: write d1/d1d/d24/f99 [1027522,116556] 0 2023-10-08T08:45:40.983 INFO:tasks.workunit.client.0.smithi070.stdout:3/404: sync 2023-10-08T08:45:40.983 INFO:tasks.workunit.client.0.smithi070.stdout:3/405: fsync d0/d12/d14/d1d/f34 0 2023-10-08T08:45:40.983 INFO:tasks.workunit.client.0.smithi070.stdout:2/636: sync 2023-10-08T08:45:40.983 INFO:tasks.workunit.client.0.smithi070.stdout:6/352: fdatasync df/d53/f5a 0 2023-10-08T08:45:40.983 INFO:tasks.workunit.client.0.smithi070.stdout:9/260: truncate d1/dd/d1a/f1c 1761879 0 2023-10-08T08:45:40.985 INFO:tasks.workunit.client.0.smithi070.stdout:7/491: truncate d3/d19/d1b/d4a/d9/d97/f9b 396219 0 2023-10-08T08:45:40.987 INFO:tasks.workunit.client.0.smithi070.stdout:9/261: link d1/dd/f11 d1/dd/d19/f4a 0 2023-10-08T08:45:40.987 INFO:tasks.workunit.client.0.smithi070.stdout:5/428: unlink d5/c3e 0 2023-10-08T08:45:40.987 INFO:tasks.workunit.client.0.smithi070.stdout:8/533: creat d1/fb4 x:0 0 0 2023-10-08T08:45:40.988 INFO:tasks.workunit.client.0.smithi070.stdout:5/429: mknod d5/d5f/d63/d8b/c94 0 2023-10-08T08:45:40.989 INFO:tasks.workunit.client.0.smithi070.stdout:6/353: symlink df/d26/d42/d43/d4a/d75/l77 0 2023-10-08T08:45:40.990 INFO:tasks.workunit.client.0.smithi070.stdout:8/534: symlink d1/de/d2e/d45/lb5 0 2023-10-08T08:45:40.990 INFO:tasks.workunit.client.0.smithi070.stdout:8/535: chown d1/d2/d6/d22/d5b 89 1 2023-10-08T08:45:40.991 INFO:tasks.workunit.client.0.smithi070.stdout:3/406: mkdir d0/d8a 0 2023-10-08T08:45:40.993 INFO:tasks.workunit.client.0.smithi070.stdout:5/430: creat d5/da/d4d/d37/d2a/f95 x:0 0 0 2023-10-08T08:45:40.994 INFO:tasks.workunit.client.0.smithi070.stdout:2/637: dread df/d12/d15/d54/db1/f72 [0,4194304] 0 2023-10-08T08:45:40.996 INFO:tasks.workunit.client.0.smithi070.stdout:3/407: creat d0/d12/d14/d5c/d5d/d75/d52/d5a/d6a/d80/f8b x:0 0 0 2023-10-08T08:45:40.998 INFO:tasks.workunit.client.0.smithi070.stdout:5/431: truncate d5/d5f/d61/d30/f14 1207444 0 2023-10-08T08:45:40.998 INFO:tasks.workunit.client.0.smithi070.stdout:5/432: write d5/da/d4d/d37/d38/d55/f53 [1320498,51003] 0 2023-10-08T08:45:40.999 INFO:tasks.workunit.client.0.smithi070.stdout:7/492: symlink d3/d19/d95/da3/la7 0 2023-10-08T08:45:40.999 INFO:tasks.workunit.client.0.smithi070.stdout:6/354: mkdir df/d26/d78 0 2023-10-08T08:45:40.999 INFO:tasks.workunit.client.0.smithi070.stdout:6/355: write df/d26/d42/f6e [190976,58299] 0 2023-10-08T08:45:41.000 INFO:tasks.workunit.client.0.smithi070.stdout:3/408: creat d0/db/d10/d38/d2f/f8c x:0 0 0 2023-10-08T08:45:41.000 INFO:tasks.workunit.client.0.smithi070.stdout:3/409: chown d0/d12/d14/f72 246 1 2023-10-08T08:45:41.001 INFO:tasks.workunit.client.0.smithi070.stdout:3/410: write d0/db/d10/d38/d63/f82 [217657,39813] 0 2023-10-08T08:45:41.001 INFO:tasks.workunit.client.0.smithi070.stdout:3/411: write d0/d12/d14/d5c/d5d/d75/d52/d5a/d86/f89 [136169,22030] 0 2023-10-08T08:45:41.004 INFO:tasks.workunit.client.0.smithi070.stdout:6/356: link df/l3e df/d26/d42/d55/d74/l79 0 2023-10-08T08:45:41.005 INFO:tasks.workunit.client.0.smithi070.stdout:6/357: stat df/d11/c34 0 2023-10-08T08:45:41.005 INFO:tasks.workunit.client.0.smithi070.stdout:6/358: fsync df/d53/f5e 0 2023-10-08T08:45:41.005 INFO:tasks.workunit.client.0.smithi070.stdout:6/359: getdents df/d26/d78 0 2023-10-08T08:45:41.005 INFO:tasks.workunit.client.0.smithi070.stdout:2/638: link df/d12/c14 df/d3a/d77/cc5 0 2023-10-08T08:45:41.007 INFO:tasks.workunit.client.0.smithi070.stdout:5/433: write d5/da/d4d/d37/f2b [1644701,86770] 0 2023-10-08T08:45:41.009 INFO:tasks.workunit.client.0.smithi070.stdout:6/360: unlink df/d26/l3a 0 2023-10-08T08:45:41.010 INFO:tasks.workunit.client.0.smithi070.stdout:0/598: dwrite d1/d76/d7a/faf [0,4194304] 0 2023-10-08T08:45:41.013 INFO:tasks.workunit.client.0.smithi070.stdout:1/543: rename d6/dc/d14/d1f/d26 to d6/dc/d14/d1f/d63/db3 0 2023-10-08T08:45:41.013 INFO:tasks.workunit.client.0.smithi070.stdout:1/544: read - d6/dc/d14/d90/f9b zero size 2023-10-08T08:45:41.016 INFO:tasks.workunit.client.0.smithi070.stdout:9/262: dwrite d1/dd/d1a/d40/f46 [0,4194304] 0 2023-10-08T08:45:41.016 INFO:tasks.workunit.client.0.smithi070.stdout:4/330: dwrite dc/f61 [0,4194304] 0 2023-10-08T08:45:41.018 INFO:tasks.workunit.client.0.smithi070.stdout:0/599: unlink d1/d14/fac 0 2023-10-08T08:45:41.018 INFO:tasks.workunit.client.0.smithi070.stdout:0/600: chown d1/dd/d1b/f33 6 1 2023-10-08T08:45:41.018 INFO:tasks.workunit.client.0.smithi070.stdout:9/263: creat d1/f4b x:0 0 0 2023-10-08T08:45:41.019 INFO:tasks.workunit.client.0.smithi070.stdout:2/639: rmdir df/d12/d1b/d82/d85 39 2023-10-08T08:45:41.020 INFO:tasks.workunit.client.0.smithi070.stdout:4/331: creat dc/d17/d24/d6b/f6c x:0 0 0 2023-10-08T08:45:41.021 INFO:tasks.workunit.client.0.smithi070.stdout:4/332: symlink dc/d17/d24/d6b/l6d 0 2023-10-08T08:45:41.021 INFO:tasks.workunit.client.0.smithi070.stdout:9/264: unlink d1/dd/d1a/d40/f46 0 2023-10-08T08:45:41.024 INFO:tasks.workunit.client.0.smithi070.stdout:5/434: rename d5/da/d4d/d37/d2a/f31 to d5/d5f/d63/d8b/d8f/f96 0 2023-10-08T08:45:41.025 INFO:tasks.workunit.client.0.smithi070.stdout:5/435: creat d5/d5f/d61/d30/d83/f97 x:0 0 0 2023-10-08T08:45:41.025 INFO:tasks.workunit.client.0.smithi070.stdout:8/536: dwrite d1/de/d2e/d45/d7b/f9c [0,4194304] 0 2023-10-08T08:45:41.025 INFO:tasks.workunit.client.0.smithi070.stdout:8/537: readlink d1/de/d1a/l46 0 2023-10-08T08:45:41.031 INFO:tasks.workunit.client.0.smithi070.stdout:2/640: rename df/d12/d1b/d1c/d79/da4/lbc to df/d12/d1b/d1c/d79/lc6 0 2023-10-08T08:45:41.031 INFO:tasks.workunit.client.0.smithi070.stdout:2/641: stat df/d4c/d91/lc4 0 2023-10-08T08:45:41.031 INFO:tasks.workunit.client.0.smithi070.stdout:2/642: write df/d12/d1b/d1c/f6a [34852,90060] 0 2023-10-08T08:45:41.031 INFO:tasks.workunit.client.0.smithi070.stdout:2/643: readlink df/d12/d1b/d1c/lb4 0 2023-10-08T08:45:41.034 INFO:tasks.workunit.client.0.smithi070.stdout:7/493: dwrite d3/d19/d1a/f4b [0,4194304] 0 2023-10-08T08:45:41.034 INFO:tasks.workunit.client.0.smithi070.stdout:8/538: rename d1/de/d1a/c2c to d1/de/d2e/cb6 0 2023-10-08T08:45:41.041 INFO:tasks.workunit.client.0.smithi070.stdout:8/539: truncate d1/de/d2e/d45/f70 609377 0 2023-10-08T08:45:41.042 INFO:tasks.workunit.client.0.smithi070.stdout:1/545: rmdir d6/dc/d14/d1f 39 2023-10-08T08:45:41.043 INFO:tasks.workunit.client.0.smithi070.stdout:1/546: chown d6/dc/f54 5631 1 2023-10-08T08:45:41.043 INFO:tasks.workunit.client.0.smithi070.stdout:1/547: stat d6/dc/d14/d1f/c3a 0 2023-10-08T08:45:41.043 INFO:tasks.workunit.client.0.smithi070.stdout:1/548: dread - d6/dc/f85 zero size 2023-10-08T08:45:41.043 INFO:tasks.workunit.client.0.smithi070.stdout:2/644: mkdir df/d12/d1b/d1c/d79/da4/dc7 0 2023-10-08T08:45:41.043 INFO:tasks.workunit.client.0.smithi070.stdout:5/436: read d5/da/d22/f52 [4482625,34834] 0 2023-10-08T08:45:41.043 INFO:tasks.workunit.client.0.smithi070.stdout:8/540: dread d1/d2/f3b [0,4194304] 0 2023-10-08T08:45:41.045 INFO:tasks.workunit.client.0.smithi070.stdout:1/549: getdents d6/dc/d14 0 2023-10-08T08:45:41.048 INFO:tasks.workunit.client.0.smithi070.stdout:1/550: mknod d6/dc/d14/d1f/d63/db3/d38/d4b/cb4 0 2023-10-08T08:45:41.048 INFO:tasks.workunit.client.0.smithi070.stdout:1/551: chown d6/lac 12 1 2023-10-08T08:45:41.049 INFO:tasks.workunit.client.0.smithi070.stdout:6/361: dwrite df/d11/d1d/f3c [0,4194304] 0 2023-10-08T08:45:41.049 INFO:tasks.workunit.client.0.smithi070.stdout:1/552: creat d6/fb5 x:0 0 0 2023-10-08T08:45:41.049 INFO:tasks.workunit.client.0.smithi070.stdout:1/553: chown d6/dc/d97/ca7 5888 1 2023-10-08T08:45:41.050 INFO:tasks.workunit.client.0.smithi070.stdout:4/333: dwrite dc/d17/d24/d37/f3b [0,4194304] 0 2023-10-08T08:45:41.051 INFO:tasks.workunit.client.0.smithi070.stdout:4/334: mknod dc/d17/d24/d6b/c6e 0 2023-10-08T08:45:41.053 INFO:tasks.workunit.client.0.smithi070.stdout:6/362: chown l8 0 1 2023-10-08T08:45:41.053 INFO:tasks.workunit.client.0.smithi070.stdout:1/554: rmdir d6/dc/d14/d1f/d75/da1 39 2023-10-08T08:45:41.057 INFO:tasks.workunit.client.0.smithi070.stdout:1/555: unlink d6/c7c 0 2023-10-08T08:45:41.058 INFO:tasks.workunit.client.0.smithi070.stdout:1/556: write d6/dc/d14/f71 [822486,74463] 0 2023-10-08T08:45:41.063 INFO:tasks.workunit.client.0.smithi070.stdout:1/557: getdents d6/dc/d14/d70 0 2023-10-08T08:45:41.063 INFO:tasks.workunit.client.0.smithi070.stdout:1/558: dread - d6/dc/d14/d1f/d63/db3/d38/d4b/fab zero size 2023-10-08T08:45:41.064 INFO:tasks.workunit.client.0.smithi070.stdout:9/265: dwrite d1/dd/d26/f47 [0,4194304] 0 2023-10-08T08:45:41.066 INFO:tasks.workunit.client.0.smithi070.stdout:8/541: getdents d1/d2 0 2023-10-08T08:45:41.066 INFO:tasks.workunit.client.0.smithi070.stdout:8/542: fdatasync d1/d2/f31 0 2023-10-08T08:45:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:7/494: dwrite d3/d19/d1b/d1e/d4c/f7e [0,4194304] 0 2023-10-08T08:45:41.082 INFO:tasks.workunit.client.0.smithi070.stdout:2/645: dwrite df/d12/d15/d54/db1/d83/f88 [0,4194304] 0 2023-10-08T08:45:41.082 INFO:tasks.workunit.client.0.smithi070.stdout:6/363: dread df/d11/d1d/f3c [0,4194304] 0 2023-10-08T08:45:41.082 INFO:tasks.workunit.client.0.smithi070.stdout:1/559: dread d6/dc/d14/d1f/d63/db3/d38/f4a [0,4194304] 0 2023-10-08T08:45:41.082 INFO:tasks.workunit.client.0.smithi070.stdout:1/560: write d6/dc/d14/d1f/d63/db3/f60 [4817784,91643] 0 2023-10-08T08:45:41.084 INFO:tasks.workunit.client.0.smithi070.stdout:2/646: creat df/d4c/da9/fc8 x:0 0 0 2023-10-08T08:45:41.086 INFO:tasks.workunit.client.0.smithi070.stdout:2/647: mkdir df/d12/d7e/dc9 0 2023-10-08T08:45:41.087 INFO:tasks.workunit.client.0.smithi070.stdout:2/648: dread df/d93/fc0 [0,4194304] 0 2023-10-08T08:45:41.119 INFO:tasks.workunit.client.0.smithi070.stdout:8/543: dwrite d1/d2/d8c/f85 [0,4194304] 0 2023-10-08T08:45:41.120 INFO:tasks.workunit.client.0.smithi070.stdout:8/544: fsync d1/d4d/f84 0 2023-10-08T08:45:41.120 INFO:tasks.workunit.client.0.smithi070.stdout:6/364: read df/f27 [601883,63039] 0 2023-10-08T08:45:41.120 INFO:tasks.workunit.client.0.smithi070.stdout:6/365: read df/f27 [771232,80082] 0 2023-10-08T08:45:41.120 INFO:tasks.workunit.client.0.smithi070.stdout:9/266: dwrite d1/dd/d19/d38/f3c [0,4194304] 0 2023-10-08T08:45:41.121 INFO:tasks.workunit.client.0.smithi070.stdout:9/267: chown d1/fb 93 1 2023-10-08T08:45:41.121 INFO:tasks.workunit.client.0.smithi070.stdout:2/649: dread df/d12/d15/d54/f5a [0,4194304] 0 2023-10-08T08:45:41.121 INFO:tasks.workunit.client.0.smithi070.stdout:7/495: dwrite d3/f2e [0,4194304] 0 2023-10-08T08:45:41.121 INFO:tasks.workunit.client.0.smithi070.stdout:1/561: dwrite d6/dc/d14/d1f/d63/f6a [0,4194304] 0 2023-10-08T08:45:41.121 INFO:tasks.workunit.client.0.smithi070.stdout:6/366: unlink df/d26/d42/f6e 0 2023-10-08T08:45:41.122 INFO:tasks.workunit.client.0.smithi070.stdout:8/545: rename d1/de/d2e/d45/lb5 to d1/de/d3a/d56/d65/da0/lb7 0 2023-10-08T08:45:41.123 INFO:tasks.workunit.client.0.smithi070.stdout:9/268: write d1/dd/d1a/f1d [5018840,5230] 0 2023-10-08T08:45:41.127 INFO:tasks.workunit.client.0.smithi070.stdout:7/496: mknod d3/d19/d1a/ca8 0 2023-10-08T08:45:41.127 INFO:tasks.workunit.client.0.smithi070.stdout:7/497: fdatasync d3/d19/f67 0 2023-10-08T08:45:41.129 INFO:tasks.workunit.client.0.smithi070.stdout:1/562: mknod d6/dc/d14/d1f/d63/daa/cb6 0 2023-10-08T08:45:41.137 INFO:tasks.workunit.client.0.smithi070.stdout:2/650: dread f8 [4194304,4194304] 0 2023-10-08T08:45:41.140 INFO:tasks.workunit.client.0.smithi070.stdout:2/651: symlink df/d12/d1b/d1c/d79/da4/lca 0 2023-10-08T08:45:41.143 INFO:tasks.workunit.client.0.smithi070.stdout:7/498: rename d3/d19/d1b to d3/da9 0 2023-10-08T08:45:41.144 INFO:tasks.workunit.client.0.smithi070.stdout:2/652: creat df/d12/d1b/d1c/fcb x:0 0 0 2023-10-08T08:45:41.147 INFO:tasks.workunit.client.0.smithi070.stdout:1/563: dread d6/dc/d14/d1f/d63/db3/d38/f4a [0,4194304] 0 2023-10-08T08:45:41.148 INFO:tasks.workunit.client.0.smithi070.stdout:2/653: creat df/d12/d1b/d82/d85/d65/fcc x:0 0 0 2023-10-08T08:45:41.148 INFO:tasks.workunit.client.0.smithi070.stdout:8/546: dwrite d1/d2/d6/d22/f98 [4194304,4194304] 0 2023-10-08T08:45:41.149 INFO:tasks.workunit.client.0.smithi070.stdout:1/564: write d6/dc/d14/f80 [413312,33482] 0 2023-10-08T08:45:41.151 INFO:tasks.workunit.client.0.smithi070.stdout:1/565: mknod d6/dc/d14/d90/cb7 0 2023-10-08T08:45:41.151 INFO:tasks.workunit.client.0.smithi070.stdout:1/566: fsync d6/f11 0 2023-10-08T08:45:41.152 INFO:tasks.workunit.client.0.smithi070.stdout:1/567: chown d6/dc/d14/d62/f77 4024 1 2023-10-08T08:45:41.152 INFO:tasks.workunit.client.0.smithi070.stdout:6/367: dwrite df/d11/d1d/f44 [0,4194304] 0 2023-10-08T08:45:41.152 INFO:tasks.workunit.client.0.smithi070.stdout:9/269: dwrite d1/dd/d26/d27/f36 [0,4194304] 0 2023-10-08T08:45:41.155 INFO:tasks.workunit.client.0.smithi070.stdout:6/368: dread df/d26/d42/d43/d4a/f6d [0,4194304] 0 2023-10-08T08:45:41.155 INFO:tasks.workunit.client.0.smithi070.stdout:1/568: rmdir d6/dc/d14/d1f 39 2023-10-08T08:45:41.156 INFO:tasks.workunit.client.0.smithi070.stdout:6/369: creat df/d11/f7a x:0 0 0 2023-10-08T08:45:41.156 INFO:tasks.workunit.client.0.smithi070.stdout:9/270: creat d1/dd/d26/f4c x:0 0 0 2023-10-08T08:45:41.157 INFO:tasks.workunit.client.0.smithi070.stdout:1/569: mknod d6/dc/cb8 0 2023-10-08T08:45:41.157 INFO:tasks.workunit.client.0.smithi070.stdout:1/570: write d6/dc/d14/d1f/f9c [186761,98705] 0 2023-10-08T08:45:41.157 INFO:tasks.workunit.client.0.smithi070.stdout:6/370: rmdir df/d26/d42/d55 39 2023-10-08T08:45:41.157 INFO:tasks.workunit.client.0.smithi070.stdout:6/371: truncate df/d11/f47 1225949 0 2023-10-08T08:45:41.158 INFO:tasks.workunit.client.0.smithi070.stdout:7/499: dread d3/d19/d1a/f20 [0,4194304] 0 2023-10-08T08:45:41.158 INFO:tasks.workunit.client.0.smithi070.stdout:1/571: link d6/dc/d14/l64 d6/dc/d14/d1f/d75/d7e/lb9 0 2023-10-08T08:45:41.160 INFO:tasks.workunit.client.0.smithi070.stdout:7/500: rename d3/da9/c34 to d3/da9/d4a/d50/d9f/caa 0 2023-10-08T08:45:41.163 INFO:tasks.workunit.client.0.smithi070.stdout:9/271: write d1/dd/f18 [1948821,123277] 0 2023-10-08T08:45:41.163 INFO:tasks.workunit.client.0.smithi070.stdout:1/572: creat d6/dc/d14/d70/fba x:0 0 0 2023-10-08T08:45:41.163 INFO:tasks.workunit.client.0.smithi070.stdout:1/573: stat d6/dc/d14/d1f/f72 0 2023-10-08T08:45:41.164 INFO:tasks.workunit.client.0.smithi070.stdout:9/272: rmdir d1/dd/d1a 39 2023-10-08T08:45:41.164 INFO:tasks.workunit.client.0.smithi070.stdout:9/273: truncate d1/dd/d26/d27/d2d/f2f 1090000 0 2023-10-08T08:45:41.164 INFO:tasks.workunit.client.0.smithi070.stdout:9/274: chown d1/dd/d19/f4a 206571 1 2023-10-08T08:45:41.165 INFO:tasks.workunit.client.0.smithi070.stdout:7/501: creat d3/da9/d1e/fab x:0 0 0 2023-10-08T08:45:41.166 INFO:tasks.workunit.client.0.smithi070.stdout:9/275: dread d1/f2a [0,4194304] 0 2023-10-08T08:45:41.167 INFO:tasks.workunit.client.0.smithi070.stdout:1/574: mknod d6/dc/d14/d1f/d75/da1/cbb 0 2023-10-08T08:45:41.169 INFO:tasks.workunit.client.0.smithi070.stdout:7/502: link d3/l27 d3/da9/d4a/d9/lac 0 2023-10-08T08:45:41.170 INFO:tasks.workunit.client.0.smithi070.stdout:1/575: creat d6/dc/d97/fbc x:0 0 0 2023-10-08T08:45:41.170 INFO:tasks.workunit.client.0.smithi070.stdout:1/576: write d6/dc/d14/d1f/d63/db3/d38/d4b/fab [92798,102814] 0 2023-10-08T08:45:41.170 INFO:tasks.workunit.client.0.smithi070.stdout:2/654: dwrite df/d12/d1b/f76 [0,4194304] 0 2023-10-08T08:45:41.171 INFO:tasks.workunit.client.0.smithi070.stdout:9/276: mkdir d1/dd/d39/d4d 0 2023-10-08T08:45:41.172 INFO:tasks.workunit.client.0.smithi070.stdout:1/577: rename d6/dc/d14/d1f/d75/da1/cbb to d6/dc/d14/d90/cbd 0 2023-10-08T08:45:41.173 INFO:tasks.workunit.client.0.smithi070.stdout:7/503: getdents d3/d79 0 2023-10-08T08:45:41.173 INFO:tasks.workunit.client.0.smithi070.stdout:9/277: chown d1/dd/c23 8158 1 2023-10-08T08:45:41.173 INFO:tasks.workunit.client.0.smithi070.stdout:9/278: chown d1/f4b 66870745 1 2023-10-08T08:45:41.174 INFO:tasks.workunit.client.0.smithi070.stdout:9/279: creat d1/dd/d1a/d40/f4e x:0 0 0 2023-10-08T08:45:41.178 INFO:tasks.workunit.client.0.smithi070.stdout:7/504: write d3/da9/d4a/f43 [92226,14455] 0 2023-10-08T08:45:41.178 INFO:tasks.workunit.client.0.smithi070.stdout:7/505: chown d3/d19/d1a/c28 140354345 1 2023-10-08T08:45:41.180 INFO:tasks.workunit.client.0.smithi070.stdout:0/601: sync 2023-10-08T08:45:41.181 INFO:tasks.workunit.client.0.smithi070.stdout:3/412: sync 2023-10-08T08:45:41.181 INFO:tasks.workunit.client.0.smithi070.stdout:2/655: mkdir df/d12/d1b/d1c/dcd 0 2023-10-08T08:45:41.182 INFO:tasks.workunit.client.0.smithi070.stdout:2/656: stat df/d12/d15/d54/db1/f44 0 2023-10-08T08:45:41.182 INFO:tasks.workunit.client.0.smithi070.stdout:1/578: truncate d6/dc/d14/f71 745817 0 2023-10-08T08:45:41.183 INFO:tasks.workunit.client.0.smithi070.stdout:6/372: dwrite df/d11/f47 [0,4194304] 0 2023-10-08T08:45:41.183 INFO:tasks.workunit.client.0.smithi070.stdout:3/413: mkdir d0/d12/d8d 0 2023-10-08T08:45:41.185 INFO:tasks.workunit.client.0.smithi070.stdout:7/506: mkdir d3/d19/d95/dad 0 2023-10-08T08:45:41.185 INFO:tasks.workunit.client.0.smithi070.stdout:7/507: chown d3/d19/d1a/f2f 46665942 1 2023-10-08T08:45:41.186 INFO:tasks.workunit.client.0.smithi070.stdout:6/373: write df/d11/f31 [1899571,128455] 0 2023-10-08T08:45:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:2/657: mkdir df/d93/dc2/dae/dce 0 2023-10-08T08:45:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:0/602: creat d1/dd/dae/fbb x:0 0 0 2023-10-08T08:45:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:1/579: creat d6/dc/d14/d1f/d63/db3/d38/fbe x:0 0 0 2023-10-08T08:45:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:4/335: sync 2023-10-08T08:45:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:2/658: readlink l1 0 2023-10-08T08:45:41.192 INFO:tasks.workunit.client.0.smithi070.stdout:5/437: sync 2023-10-08T08:45:41.192 INFO:tasks.workunit.client.0.smithi070.stdout:5/438: creat d5/f98 x:0 0 0 2023-10-08T08:45:41.193 INFO:tasks.workunit.client.0.smithi070.stdout:5/439: readlink d5/da/l1d 0 2023-10-08T08:45:41.194 INFO:tasks.workunit.client.0.smithi070.stdout:5/440: link d5/da/d4d/d37/d2a/c44 d5/d5f/d61/c99 0 2023-10-08T08:45:41.197 INFO:tasks.workunit.client.0.smithi070.stdout:3/414: dread d0/d12/d14/f28 [0,4194304] 0 2023-10-08T08:45:41.197 INFO:tasks.workunit.client.0.smithi070.stdout:3/415: write d0/db/f26 [496157,60885] 0 2023-10-08T08:45:41.197 INFO:tasks.workunit.client.0.smithi070.stdout:4/336: unlink dc/d17/d24/d6b/l6d 0 2023-10-08T08:45:41.199 INFO:tasks.workunit.client.0.smithi070.stdout:4/337: creat dc/d17/d1f/d5e/f6f x:0 0 0 2023-10-08T08:45:41.200 INFO:tasks.workunit.client.0.smithi070.stdout:5/441: read d5/da/d22/f32 [1153547,64378] 0 2023-10-08T08:45:41.200 INFO:tasks.workunit.client.0.smithi070.stdout:4/338: creat dc/d17/f70 x:0 0 0 2023-10-08T08:45:41.201 INFO:tasks.workunit.client.0.smithi070.stdout:5/442: mknod d5/d5f/d63/d8b/c9a 0 2023-10-08T08:45:41.201 INFO:tasks.workunit.client.0.smithi070.stdout:6/374: rename df/d26/d42/d43/f4e to df/d71/f7b 0 2023-10-08T08:45:41.201 INFO:tasks.workunit.client.0.smithi070.stdout:1/580: symlink d6/dc/d14/lbf 0 2023-10-08T08:45:41.204 INFO:tasks.workunit.client.0.smithi070.stdout:6/375: rename df/d26/d42/d55/c59 to df/d26/d42/d43/d4a/c7c 0 2023-10-08T08:45:41.204 INFO:tasks.workunit.client.0.smithi070.stdout:6/376: dread - df/d11/f58 zero size 2023-10-08T08:45:41.204 INFO:tasks.workunit.client.0.smithi070.stdout:6/377: readlink df/d11/l57 0 2023-10-08T08:45:41.204 INFO:tasks.workunit.client.0.smithi070.stdout:3/416: symlink d0/db/l8e 0 2023-10-08T08:45:41.205 INFO:tasks.workunit.client.0.smithi070.stdout:6/378: mkdir df/d26/d42/d55/d74/d7d 0 2023-10-08T08:45:41.206 INFO:tasks.workunit.client.0.smithi070.stdout:3/417: truncate d0/d12/f7a 2822631 0 2023-10-08T08:45:41.206 INFO:tasks.workunit.client.0.smithi070.stdout:3/418: write d0/db/d10/d38/d2f/f8c [471003,111401] 0 2023-10-08T08:45:41.206 INFO:tasks.workunit.client.0.smithi070.stdout:3/419: stat d0/db/d10/d38/f3f 0 2023-10-08T08:45:41.207 INFO:tasks.workunit.client.0.smithi070.stdout:6/379: mkdir df/d26/d42/d43/d4a/d75/d7e 0 2023-10-08T08:45:41.211 INFO:tasks.workunit.client.0.smithi070.stdout:4/339: dread f9 [0,4194304] 0 2023-10-08T08:45:41.212 INFO:tasks.workunit.client.0.smithi070.stdout:7/508: dwrite d3/da9/d1e/d76/f87 [0,4194304] 0 2023-10-08T08:45:41.219 INFO:tasks.workunit.client.0.smithi070.stdout:2/659: dread df/d12/d1b/f76 [0,4194304] 0 2023-10-08T08:45:41.220 INFO:tasks.workunit.client.0.smithi070.stdout:2/660: write df/d12/d7e/f8e [521981,76250] 0 2023-10-08T08:45:41.226 INFO:tasks.workunit.client.0.smithi070.stdout:6/380: link f9 df/d11/f7f 0 2023-10-08T08:45:41.226 INFO:tasks.workunit.client.0.smithi070.stdout:2/661: creat df/d12/d1b/fcf x:0 0 0 2023-10-08T08:45:41.227 INFO:tasks.workunit.client.0.smithi070.stdout:2/662: mknod df/d3a/d77/cd0 0 2023-10-08T08:45:41.230 INFO:tasks.workunit.client.0.smithi070.stdout:3/420: dread d0/d12/d14/d5c/d5d/d75/d52/d5a/d86/f89 [0,4194304] 0 2023-10-08T08:45:41.230 INFO:tasks.workunit.client.0.smithi070.stdout:0/603: dwrite d1/d14/d1f/fad [0,4194304] 0 2023-10-08T08:45:41.233 INFO:tasks.workunit.client.0.smithi070.stdout:2/663: write df/d12/d15/d54/db1/d83/d92/fab [976021,107284] 0 2023-10-08T08:45:41.239 INFO:tasks.workunit.client.0.smithi070.stdout:5/443: dwrite d5/da/f15 [4194304,4194304] 0 2023-10-08T08:45:41.240 INFO:tasks.workunit.client.0.smithi070.stdout:5/444: fdatasync d5/da/d22/f89 0 2023-10-08T08:45:41.240 INFO:tasks.workunit.client.0.smithi070.stdout:2/664: getdents df/d12/d1b 0 2023-10-08T08:45:41.241 INFO:tasks.workunit.client.0.smithi070.stdout:4/340: dwrite dc/d17/d24/f40 [0,4194304] 0 2023-10-08T08:45:41.241 INFO:tasks.workunit.client.0.smithi070.stdout:4/341: write dc/d17/d24/d55/f66 [956133,101729] 0 2023-10-08T08:45:41.241 INFO:tasks.workunit.client.0.smithi070.stdout:1/581: dwrite d6/dc/f59 [0,4194304] 0 2023-10-08T08:45:41.247 INFO:tasks.workunit.client.0.smithi070.stdout:1/582: truncate d6/dc/d14/d1f/d75/d7e/f8d 63609 0 2023-10-08T08:45:41.254 INFO:tasks.workunit.client.0.smithi070.stdout:6/381: dwrite df/d26/f6a [0,4194304] 0 2023-10-08T08:45:41.260 INFO:tasks.workunit.client.0.smithi070.stdout:1/583: dread d6/dc/d14/f5c [0,4194304] 0 2023-10-08T08:45:41.261 INFO:tasks.workunit.client.0.smithi070.stdout:1/584: creat d6/dc/d14/d1f/d75/da1/fc0 x:0 0 0 2023-10-08T08:45:41.262 INFO:tasks.workunit.client.0.smithi070.stdout:1/585: rmdir d6/dc/d14/d1f/d75 39 2023-10-08T08:45:41.294 INFO:tasks.workunit.client.0.smithi070.stdout:2/665: write df/d12/d1b/f76 [634314,26315] 0 2023-10-08T08:45:41.297 INFO:tasks.workunit.client.0.smithi070.stdout:2/666: mknod df/d12/d1b/d1c/d2d/cd1 0 2023-10-08T08:45:41.299 INFO:tasks.workunit.client.0.smithi070.stdout:2/667: rename df/d3a/lac to df/d12/d1b/d82/ld2 0 2023-10-08T08:45:41.301 INFO:tasks.workunit.client.0.smithi070.stdout:2/668: mknod df/d4c/d91/cd3 0 2023-10-08T08:45:41.303 INFO:tasks.workunit.client.0.smithi070.stdout:2/669: symlink df/d12/d1b/d1c/d79/da4/ld4 0 2023-10-08T08:45:41.305 INFO:tasks.workunit.client.0.smithi070.stdout:2/670: link df/d12/d1b/d1c/f64 df/d12/d1b/d1c/d69/fd5 0 2023-10-08T08:45:41.307 INFO:tasks.workunit.client.0.smithi070.stdout:2/671: mknod df/d93/dc2/dae/dce/cd6 0 2023-10-08T08:45:41.307 INFO:tasks.workunit.client.0.smithi070.stdout:2/672: chown df/d12/d1b/d1c/d69/c6c 31960 1 2023-10-08T08:45:41.307 INFO:tasks.workunit.client.0.smithi070.stdout:7/509: dwrite d3/f55 [0,4194304] 0 2023-10-08T08:45:41.309 INFO:tasks.workunit.client.0.smithi070.stdout:2/673: creat df/d12/d15/d54/db1/d83/fd7 x:0 0 0 2023-10-08T08:45:41.309 INFO:tasks.workunit.client.0.smithi070.stdout:0/604: dwrite d1/d1d/d4d/d9d/f4f [0,4194304] 0 2023-10-08T08:45:41.310 INFO:tasks.workunit.client.0.smithi070.stdout:2/674: getdents df/d93/dc2/dae 0 2023-10-08T08:45:41.313 INFO:tasks.workunit.client.0.smithi070.stdout:4/342: dwrite dc/d17/d24/d37/f3b [0,4194304] 0 2023-10-08T08:45:41.313 INFO:tasks.workunit.client.0.smithi070.stdout:3/421: dwrite d0/d12/d14/f2a [8388608,4194304] 0 2023-10-08T08:45:41.314 INFO:tasks.workunit.client.0.smithi070.stdout:0/605: rename d1/d62/d54/d5e/d80/d8a/ca8 to d1/d62/cbc 0 2023-10-08T08:45:41.316 INFO:tasks.workunit.client.0.smithi070.stdout:4/343: dread dc/d17/f2e [0,4194304] 0 2023-10-08T08:45:41.317 INFO:tasks.workunit.client.0.smithi070.stdout:2/675: mkdir df/d4c/d91/dd8 0 2023-10-08T08:45:41.317 INFO:tasks.workunit.client.0.smithi070.stdout:2/676: read - df/d12/d15/d54/db1/d83/fd7 zero size 2023-10-08T08:45:41.317 INFO:tasks.workunit.client.0.smithi070.stdout:3/422: rename d0/d12/d14/d5c/d5d/d75/f3b to d0/db/d10/f8f 0 2023-10-08T08:45:41.319 INFO:tasks.workunit.client.0.smithi070.stdout:3/423: creat d0/d12/d14/d1d/f90 x:0 0 0 2023-10-08T08:45:41.319 INFO:tasks.workunit.client.0.smithi070.stdout:3/424: write d0/d12/d14/d1d/f78 [4732859,17246] 0 2023-10-08T08:45:41.321 INFO:tasks.workunit.client.0.smithi070.stdout:3/425: dread d0/db/d10/d38/d2f/f8c [0,4194304] 0 2023-10-08T08:45:41.324 INFO:tasks.workunit.client.0.smithi070.stdout:3/426: rename d0/f1f to d0/d12/d14/d48/f91 0 2023-10-08T08:45:41.326 INFO:tasks.workunit.client.0.smithi070.stdout:0/606: mknod d1/d1d/d4d/cbd 0 2023-10-08T08:45:41.326 INFO:tasks.workunit.client.0.smithi070.stdout:3/427: mkdir d0/db/d10/d92 0 2023-10-08T08:45:41.326 INFO:tasks.workunit.client.0.smithi070.stdout:3/428: readlink d0/d12/d14/d5c/d5d/d75/d52/d5a/l79 0 2023-10-08T08:45:41.329 INFO:tasks.workunit.client.0.smithi070.stdout:7/510: dwrite d3/da9/d1e/d4c/f7e [0,4194304] 0 2023-10-08T08:45:41.329 INFO:tasks.workunit.client.0.smithi070.stdout:3/429: rmdir d0/d12/d14/d5c/d5d/d75/d52/d5a/d6a/d80 39 2023-10-08T08:45:41.331 INFO:tasks.workunit.client.0.smithi070.stdout:3/430: creat d0/db/d10/d92/f93 x:0 0 0 2023-10-08T08:45:41.331 INFO:tasks.workunit.client.0.smithi070.stdout:0/607: getdents d1/d62/d54/d5e 0 2023-10-08T08:45:41.332 INFO:tasks.workunit.client.0.smithi070.stdout:7/511: write d3/da9/d4a/f83 [2844072,103368] 0 2023-10-08T08:45:41.332 INFO:tasks.workunit.client.0.smithi070.stdout:7/512: chown d3/d79/c86 338595 1 2023-10-08T08:45:41.333 INFO:tasks.workunit.client.0.smithi070.stdout:0/608: read d1/d1d/d24/f99 [123532,77670] 0 2023-10-08T08:45:41.334 INFO:tasks.workunit.client.0.smithi070.stdout:2/677: rmdir df/d12/d1b/d82 39 2023-10-08T08:45:41.334 INFO:tasks.workunit.client.0.smithi070.stdout:2/678: chown df/d12/d15/d54/db1/f72 6064 1 2023-10-08T08:45:41.335 INFO:tasks.workunit.client.0.smithi070.stdout:3/431: symlink d0/d12/d14/d1d/l94 0 2023-10-08T08:45:41.335 INFO:tasks.workunit.client.0.smithi070.stdout:3/432: chown d0/d12/d14/d1d/f78 1603306941 1 2023-10-08T08:45:41.335 INFO:tasks.workunit.client.0.smithi070.stdout:2/679: read df/d12/f37 [2019949,121688] 0 2023-10-08T08:45:41.335 INFO:tasks.workunit.client.0.smithi070.stdout:7/513: mkdir d3/da9/d4a/d9/da4/dae 0 2023-10-08T08:45:41.336 INFO:tasks.workunit.client.0.smithi070.stdout:3/433: symlink d0/d12/d14/l95 0 2023-10-08T08:45:41.336 INFO:tasks.workunit.client.0.smithi070.stdout:3/434: fsync d0/d12/d14/d5c/d5d/d75/d52/d5a/d86/f89 0 2023-10-08T08:45:41.337 INFO:tasks.workunit.client.0.smithi070.stdout:3/435: creat d0/d8a/f96 x:0 0 0 2023-10-08T08:45:41.337 INFO:tasks.workunit.client.0.smithi070.stdout:0/609: link d1/d1d/d4d/cbd d1/d62/d54/cbe 0 2023-10-08T08:45:41.338 INFO:tasks.workunit.client.0.smithi070.stdout:3/436: dread - d0/d12/d14/d5c/d5d/d75/f33 zero size 2023-10-08T08:45:41.338 INFO:tasks.workunit.client.0.smithi070.stdout:3/437: creat d0/d12/f97 x:0 0 0 2023-10-08T08:45:41.339 INFO:tasks.workunit.client.0.smithi070.stdout:0/610: read d1/fa [1645538,79750] 0 2023-10-08T08:45:41.339 INFO:tasks.workunit.client.0.smithi070.stdout:2/680: mkdir df/d12/d1b/dd9 0 2023-10-08T08:45:41.340 INFO:tasks.workunit.client.0.smithi070.stdout:7/514: truncate d3/d19/d1a/f4e 1874112 0 2023-10-08T08:45:41.341 INFO:tasks.workunit.client.0.smithi070.stdout:3/438: rename d0/d12/d14/d5c/d5d/d75/d52/d5a/l5b to d0/l98 0 2023-10-08T08:45:41.341 INFO:tasks.workunit.client.0.smithi070.stdout:0/611: symlink d1/d76/lbf 0 2023-10-08T08:45:41.341 INFO:tasks.workunit.client.0.smithi070.stdout:0/612: chown d1/f70 860 1 2023-10-08T08:45:41.342 INFO:tasks.workunit.client.0.smithi070.stdout:3/439: creat d0/d8a/f99 x:0 0 0 2023-10-08T08:45:41.342 INFO:tasks.workunit.client.0.smithi070.stdout:2/681: mknod df/d12/d1b/d1c/d2d/cda 0 2023-10-08T08:45:41.344 INFO:tasks.workunit.client.0.smithi070.stdout:3/440: unlink d0/db/d10/d38/d2f/l32 0 2023-10-08T08:45:41.345 INFO:tasks.workunit.client.0.smithi070.stdout:3/441: creat d0/d12/f9a x:0 0 0 2023-10-08T08:45:41.345 INFO:tasks.workunit.client.0.smithi070.stdout:2/682: rename df/d12/d1b/d1c/c6e to df/d12/d1b/d82/cdb 0 2023-10-08T08:45:41.347 INFO:tasks.workunit.client.0.smithi070.stdout:2/683: symlink df/d12/d1b/d82/d85/d65/da0/ldc 0 2023-10-08T08:45:41.347 INFO:tasks.workunit.client.0.smithi070.stdout:3/442: rename d0/d12/d14/d5c/d5d/d75/d52/d5a/d6a/d80/f8b to d0/db/d10/d6d/f9b 0 2023-10-08T08:45:41.348 INFO:tasks.workunit.client.0.smithi070.stdout:3/443: creat d0/db/d10/f9c x:0 0 0 2023-10-08T08:45:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:3/444: rmdir d0/db/d10/d38/d63 39 2023-10-08T08:45:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:3/445: getdents d0/d12/d14/d5c/d5d/d75/d52/d5a/d86 0 2023-10-08T08:45:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:3/446: write d0/d12/f9a [295869,91308] 0 2023-10-08T08:45:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:0/613: dread d1/d1d/d4d/d9d/f5a [0,4194304] 0 2023-10-08T08:45:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:0/614: chown d1/d62/d54/d5e/d80/d8a 0 1 2023-10-08T08:45:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:7/515: dread d3/d19/d1a/f22 [0,4194304] 0 2023-10-08T08:45:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:7/516: write d3/d19/f56 [275496,89401] 0 2023-10-08T08:45:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:0/615: mknod d1/dd/dae/cc0 0 2023-10-08T08:45:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:3/447: mkdir d0/d12/d14/d5c/d9d 0 2023-10-08T08:45:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:3/448: write d0/d12/d14/f72 [1930901,48465] 0 2023-10-08T08:45:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:7/517: mknod d3/d79/caf 0 2023-10-08T08:45:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:7/518: rmdir d3/d77 39 2023-10-08T08:45:41.363 INFO:tasks.workunit.client.0.smithi070.stdout:7/519: link d3/da9/d1e/c49 d3/da9/d4a/cb0 0 2023-10-08T08:45:41.367 INFO:tasks.workunit.client.0.smithi070.stdout:7/520: unlink d3/da9/d4a/l44 0 2023-10-08T08:45:41.370 INFO:tasks.workunit.client.0.smithi070.stdout:0/616: rmdir d1/d1d 39 2023-10-08T08:45:41.370 INFO:tasks.workunit.client.0.smithi070.stdout:0/617: chown d1/d14/d1f/d6f 1102003863 1 2023-10-08T08:45:41.370 INFO:tasks.workunit.client.0.smithi070.stdout:0/618: write d1/f7 [2343430,119721] 0 2023-10-08T08:45:41.372 INFO:tasks.workunit.client.0.smithi070.stdout:7/521: write d3/da9/d4a/d9/f48 [4353532,95911] 0 2023-10-08T08:45:41.378 INFO:tasks.workunit.client.0.smithi070.stdout:2/684: dwrite df/d12/d15/d54/db1/fa7 [0,4194304] 0 2023-10-08T08:45:41.379 INFO:tasks.workunit.client.0.smithi070.stdout:0/619: dread d1/dd/ff [0,4194304] 0 2023-10-08T08:45:41.381 INFO:tasks.workunit.client.0.smithi070.stdout:2/685: truncate df/d12/d15/f41 1969624 0 2023-10-08T08:45:41.381 INFO:tasks.workunit.client.0.smithi070.stdout:2/686: dread - df/d4c/d91/f99 zero size 2023-10-08T08:45:41.382 INFO:tasks.workunit.client.0.smithi070.stdout:0/620: getdents d1/d14/d1f 0 2023-10-08T08:45:41.383 INFO:tasks.workunit.client.0.smithi070.stdout:3/449: dwrite d0/d8a/f99 [0,4194304] 0 2023-10-08T08:45:41.385 INFO:tasks.workunit.client.0.smithi070.stdout:0/621: write d1/dd/d1b/f34 [217928,44552] 0 2023-10-08T08:45:41.386 INFO:tasks.workunit.client.0.smithi070.stdout:2/687: mknod df/d12/d1b/d1c/dcd/cdd 0 2023-10-08T08:45:41.387 INFO:tasks.workunit.client.0.smithi070.stdout:3/450: creat d0/db/d10/d38/d2f/f9e x:0 0 0 2023-10-08T08:45:41.388 INFO:tasks.workunit.client.0.smithi070.stdout:0/622: symlink d1/d14/lc1 0 2023-10-08T08:45:41.388 INFO:tasks.workunit.client.0.smithi070.stdout:0/623: truncate d1/d1d/f2e 459533 0 2023-10-08T08:45:41.389 INFO:tasks.workunit.client.0.smithi070.stdout:3/451: link d0/d12/d14/d1d/f3a d0/d12/d14/d5c/d5d/d75/d52/d5a/d86/f9f 0 2023-10-08T08:45:41.389 INFO:tasks.workunit.client.0.smithi070.stdout:2/688: rmdir df/d12/d1b/d1c/d79 39 2023-10-08T08:45:41.389 INFO:tasks.workunit.client.0.smithi070.stdout:2/689: write df/d12/d15/d54/db1/d83/fd7 [791398,128555] 0 2023-10-08T08:45:41.390 INFO:tasks.workunit.client.0.smithi070.stdout:3/452: truncate d0/d12/d14/d1d/f3a 414446 0 2023-10-08T08:45:41.390 INFO:tasks.workunit.client.0.smithi070.stdout:0/624: mknod d1/dd/d1b/cc2 0 2023-10-08T08:45:41.391 INFO:tasks.workunit.client.0.smithi070.stdout:0/625: chown d1/d62/d54/d5e/d80/f8f 1716898 1 2023-10-08T08:45:41.392 INFO:tasks.workunit.client.0.smithi070.stdout:0/626: mkdir d1/d62/d54/d5e/d80/d8a/dc3 0 2023-10-08T08:45:41.396 INFO:tasks.workunit.client.0.smithi070.stdout:0/627: creat d1/d62/d54/d5e/d80/d8a/fc4 x:0 0 0 2023-10-08T08:45:41.398 INFO:tasks.workunit.client.0.smithi070.stdout:0/628: truncate d1/d14/d1f/f28 1303732 0 2023-10-08T08:45:41.400 INFO:tasks.workunit.client.0.smithi070.stdout:0/629: truncate d1/d1d/d24/f36 2719119 0 2023-10-08T08:45:41.400 INFO:tasks.workunit.client.0.smithi070.stdout:0/630: fsync d1/d62/d54/f7d 0 2023-10-08T08:45:41.400 INFO:tasks.workunit.client.0.smithi070.stdout:0/631: dread - d1/dd/dae/fbb zero size 2023-10-08T08:45:41.401 INFO:tasks.workunit.client.0.smithi070.stdout:0/632: read d1/d14/d1f/f66 [452472,126584] 0 2023-10-08T08:45:41.403 INFO:tasks.workunit.client.0.smithi070.stdout:0/633: getdents d1/d1d 0 2023-10-08T08:45:41.410 INFO:tasks.workunit.client.0.smithi070.stdout:0/634: link d1/d14/d1f/f28 d1/fc5 0 2023-10-08T08:45:41.412 INFO:tasks.workunit.client.0.smithi070.stdout:0/635: unlink d1/d62/l93 0 2023-10-08T08:45:41.414 INFO:tasks.workunit.client.0.smithi070.stdout:0/636: creat d1/d14/fc6 x:0 0 0 2023-10-08T08:45:41.433 INFO:tasks.workunit.client.0.smithi070.stdout:0/637: dwrite d1/dd/f13 [8388608,4194304] 0 2023-10-08T08:45:41.436 INFO:tasks.workunit.client.0.smithi070.stdout:0/638: link d1/d1d/d4d/d9d/f8c d1/dd/dae/fc7 0 2023-10-08T08:45:41.436 INFO:tasks.workunit.client.0.smithi070.stdout:2/690: dwrite df/f39 [4194304,4194304] 0 2023-10-08T08:45:41.439 INFO:tasks.workunit.client.0.smithi070.stdout:2/691: mkdir df/d3a/db6/dde 0 2023-10-08T08:45:41.439 INFO:tasks.workunit.client.0.smithi070.stdout:2/692: truncate df/d4c/f68 5181597 0 2023-10-08T08:45:41.441 INFO:tasks.workunit.client.0.smithi070.stdout:0/639: dread d1/d14/f43 [0,4194304] 0 2023-10-08T08:45:41.442 INFO:tasks.workunit.client.0.smithi070.stdout:3/453: rename d0/d12/d14/d5c/d5d/d75/d52/d5a to d0/d12/d14/d5c/d5d/da0 0 2023-10-08T08:45:41.444 INFO:tasks.workunit.client.0.smithi070.stdout:3/454: creat d0/d12/d14/d5c/d5d/da0/d6a/fa1 x:0 0 0 2023-10-08T08:45:41.445 INFO:tasks.workunit.client.0.smithi070.stdout:3/455: truncate d0/d12/d14/d1d/f5e 717227 0 2023-10-08T08:45:41.445 INFO:tasks.workunit.client.0.smithi070.stdout:3/456: write d0/d12/d14/d48/f4f [3315988,8025] 0 2023-10-08T08:45:41.446 INFO:tasks.workunit.client.0.smithi070.stdout:0/640: truncate d1/d1d/d4d/d9d/fa1 640191 0 2023-10-08T08:45:41.447 INFO:tasks.workunit.client.0.smithi070.stdout:0/641: dread d1/dd/f3a [0,4194304] 0 2023-10-08T08:45:41.447 INFO:tasks.workunit.client.0.smithi070.stdout:0/642: write d1/d1d/d24/f4c [5128906,9437] 0 2023-10-08T08:45:41.447 INFO:tasks.workunit.client.0.smithi070.stdout:0/643: chown d1/d62/d54/d5e/c64 0 1 2023-10-08T08:45:41.448 INFO:tasks.workunit.client.0.smithi070.stdout:2/693: rename df/d12/d15/d54/db1/f7d to df/d12/d1b/d1c/d2d/fdf 0 2023-10-08T08:45:41.457 INFO:tasks.workunit.client.0.smithi070.stdout:2/694: dread df/f59 [0,4194304] 0 2023-10-08T08:45:41.460 INFO:tasks.workunit.client.0.smithi070.stdout:3/457: dread d0/d12/d14/d5c/d5d/d75/f44 [0,4194304] 0 2023-10-08T08:45:41.461 INFO:tasks.workunit.client.0.smithi070.stdout:2/695: dread df/d12/d1b/d1c/d69/fd5 [0,4194304] 0 2023-10-08T08:45:41.461 INFO:tasks.workunit.client.0.smithi070.stdout:3/458: creat d0/db/fa2 x:0 0 0 2023-10-08T08:45:41.462 INFO:tasks.workunit.client.0.smithi070.stdout:3/459: readlink d0/d12/d14/d1d/l55 0 2023-10-08T08:45:41.462 INFO:tasks.workunit.client.0.smithi070.stdout:3/460: write d0/d12/d14/d5c/d5d/da0/f6f [427450,88268] 0 2023-10-08T08:45:41.469 INFO:tasks.workunit.client.0.smithi070.stdout:0/644: dwrite d1/d62/d54/f58 [0,4194304] 0 2023-10-08T08:45:41.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:41 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a[99489]: 2023-10-08T08:45:41.199+0000 7f936d189700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T08:45:41.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:41 smithi070 ceph-mon[99513]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T08:45:41.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:41 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] up:active 2023-10-08T08:45:41.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:41 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:41.475 INFO:tasks.workunit.client.0.smithi070.stdout:0/645: rename d1/dd/d1b to d1/d62/d54/d5e/d80/d8a/dc8 0 2023-10-08T08:45:41.475 INFO:tasks.workunit.client.0.smithi070.stdout:0/646: readlink d1/d1d/d24/lb9 0 2023-10-08T08:45:41.510 INFO:tasks.workunit.client.0.smithi070.stdout:0/647: dwrite d1/d1d/d4d/d9d/f8c [0,4194304] 0 2023-10-08T08:45:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:0/648: symlink d1/d62/d54/d5e/d80/d8a/dc3/lc9 0 2023-10-08T08:45:41.517 INFO:tasks.workunit.client.0.smithi070.stdout:0/649: symlink d1/lca 0 2023-10-08T08:45:41.517 INFO:tasks.workunit.client.0.smithi070.stdout:0/650: stat d1/d1d/d24/f94 0 2023-10-08T08:45:41.520 INFO:tasks.workunit.client.0.smithi070.stdout:0/651: dread d1/d62/f55 [0,4194304] 0 2023-10-08T08:45:41.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:41 smithi105 ceph-mon[103798]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T08:45:41.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:41 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] up:active 2023-10-08T08:45:41.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:41 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:41.532 INFO:tasks.workunit.client.0.smithi070.stdout:0/652: dread d1/d1d/d4d/d9d/f8c [0,4194304] 0 2023-10-08T08:45:41.535 INFO:tasks.workunit.client.0.smithi070.stdout:0/653: rename c0 to d1/d62/d54/d5e/d80/ccb 0 2023-10-08T08:45:41.535 INFO:tasks.workunit.client.0.smithi070.stdout:0/654: chown d1/d1d/d4d/l6d 5695897 1 2023-10-08T08:45:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:9/280: sync 2023-10-08T08:45:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:8/547: sync 2023-10-08T08:45:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:1/586: sync 2023-10-08T08:45:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:6/382: sync 2023-10-08T08:45:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:5/445: sync 2023-10-08T08:45:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:1/587: fsync d6/f65 0 2023-10-08T08:45:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:5/446: stat d5/da/l40 0 2023-10-08T08:45:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:1/588: dread - d6/dc/d14/d90/f9b zero size 2023-10-08T08:45:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:5/447: write d5/da/d22/f5e [175945,3593] 0 2023-10-08T08:45:41.563 INFO:tasks.workunit.client.0.smithi070.stdout:9/281: mkdir d1/dd/d19/d38/d4f 0 2023-10-08T08:45:41.563 INFO:tasks.workunit.client.0.smithi070.stdout:9/282: write d1/dd/d26/f4c [784997,94130] 0 2023-10-08T08:45:41.568 INFO:tasks.workunit.client.0.smithi070.stdout:6/383: dread df/d11/f40 [0,4194304] 0 2023-10-08T08:45:41.568 INFO:tasks.workunit.client.0.smithi070.stdout:1/589: rmdir d6/dc 39 2023-10-08T08:45:41.569 INFO:tasks.workunit.client.0.smithi070.stdout:9/283: dread d1/dd/d26/d27/d2d/f2f [0,4194304] 0 2023-10-08T08:45:41.569 INFO:tasks.workunit.client.0.smithi070.stdout:9/284: chown d1/dd/d39/d4d 0 1 2023-10-08T08:45:41.569 INFO:tasks.workunit.client.0.smithi070.stdout:9/285: dread - d1/dd/d1a/d40/f4e zero size 2023-10-08T08:45:41.570 INFO:tasks.workunit.client.0.smithi070.stdout:9/286: mknod d1/dd/d39/d4d/c50 0 2023-10-08T08:45:41.570 INFO:tasks.workunit.client.0.smithi070.stdout:6/384: mkdir df/d26/d42/d4b/d80 0 2023-10-08T08:45:41.571 INFO:tasks.workunit.client.0.smithi070.stdout:1/590: mkdir d6/dc/d14/dc1 0 2023-10-08T08:45:41.571 INFO:tasks.workunit.client.0.smithi070.stdout:1/591: dread - d6/dc/d14/d70/f89 zero size 2023-10-08T08:45:41.571 INFO:tasks.workunit.client.0.smithi070.stdout:1/592: fsync d6/dc/d14/f5c 0 2023-10-08T08:45:41.572 INFO:tasks.workunit.client.0.smithi070.stdout:6/385: creat df/d26/d42/d43/d4a/f81 x:0 0 0 2023-10-08T08:45:41.574 INFO:tasks.workunit.client.0.smithi070.stdout:9/287: rename d1/c32 to d1/dd/d26/d27/d2d/c51 0 2023-10-08T08:45:41.574 INFO:tasks.workunit.client.0.smithi070.stdout:9/288: fdatasync d1/dd/d1a/f1d 0 2023-10-08T08:45:41.575 INFO:tasks.workunit.client.0.smithi070.stdout:1/593: unlink d6/f11 0 2023-10-08T08:45:41.575 INFO:tasks.workunit.client.0.smithi070.stdout:9/289: mknod d1/dd/d19/d38/d4f/c52 0 2023-10-08T08:45:41.577 INFO:tasks.workunit.client.0.smithi070.stdout:1/594: mkdir d6/dc/d14/d1f/d75/d7e/dc2 0 2023-10-08T08:45:41.577 INFO:tasks.workunit.client.0.smithi070.stdout:1/595: chown d6/dc/d14/d1f/d63/db3/d38/d4b/l78 60054 1 2023-10-08T08:45:41.578 INFO:tasks.workunit.client.0.smithi070.stdout:1/596: truncate d6/dc/d14/d1f/d75/d7e/f8f 3733349 0 2023-10-08T08:45:41.581 INFO:tasks.workunit.client.0.smithi070.stdout:1/597: creat d6/dc/d14/d1f/d63/db3/fc3 x:0 0 0 2023-10-08T08:45:41.581 INFO:tasks.workunit.client.0.smithi070.stdout:9/290: rename d1/dd/d19/c48 to d1/dd/d26/d27/d2d/c53 0 2023-10-08T08:45:41.582 INFO:tasks.workunit.client.0.smithi070.stdout:1/598: symlink d6/dc/d14/d1f/d75/d88/lc4 0 2023-10-08T08:45:41.582 INFO:tasks.workunit.client.0.smithi070.stdout:9/291: creat d1/dd/d26/f54 x:0 0 0 2023-10-08T08:45:41.583 INFO:tasks.workunit.client.0.smithi070.stdout:9/292: chown d1/dd/d1a 14011 1 2023-10-08T08:45:41.584 INFO:tasks.workunit.client.0.smithi070.stdout:9/293: truncate d1/dd/f10 3705263 0 2023-10-08T08:45:41.584 INFO:tasks.workunit.client.0.smithi070.stdout:9/294: read - d1/dd/d1a/d40/f4e zero size 2023-10-08T08:45:41.586 INFO:tasks.workunit.client.0.smithi070.stdout:1/599: read d6/dc/d14/d1f/d75/d7e/f87 [333097,100503] 0 2023-10-08T08:45:41.586 INFO:tasks.workunit.client.0.smithi070.stdout:9/295: creat d1/f55 x:0 0 0 2023-10-08T08:45:41.587 INFO:tasks.workunit.client.0.smithi070.stdout:1/600: symlink d6/dc/lc5 0 2023-10-08T08:45:41.588 INFO:tasks.workunit.client.0.smithi070.stdout:1/601: chown c2 30295 1 2023-10-08T08:45:41.589 INFO:tasks.workunit.client.0.smithi070.stdout:1/602: creat d6/dc/d14/d1f/d63/db3/d38/d4b/fc6 x:0 0 0 2023-10-08T08:45:41.591 INFO:tasks.workunit.client.0.smithi070.stdout:1/603: write d6/dc/f46 [677256,84893] 0 2023-10-08T08:45:41.591 INFO:tasks.workunit.client.0.smithi070.stdout:1/604: getdents d6/dc/d14/dc1 0 2023-10-08T08:45:41.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:41 smithi191 ceph-mon[104220]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T08:45:41.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:41 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] up:active 2023-10-08T08:45:41.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:41 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:45:41.602 INFO:tasks.workunit.client.0.smithi070.stdout:5/448: dwrite d5/da/f1f [0,4194304] 0 2023-10-08T08:45:41.602 INFO:tasks.workunit.client.0.smithi070.stdout:6/386: dread df/d26/f6a [0,4194304] 0 2023-10-08T08:45:41.602 INFO:tasks.workunit.client.0.smithi070.stdout:8/548: dwrite d1/d4d/fa3 [0,4194304] 0 2023-10-08T08:45:41.602 INFO:tasks.workunit.client.0.smithi070.stdout:8/549: fdatasync d1/d2/f3b 0 2023-10-08T08:45:41.602 INFO:tasks.workunit.client.0.smithi070.stdout:5/449: write d5/da/d4d/f3f [5207056,107941] 0 2023-10-08T08:45:41.603 INFO:tasks.workunit.client.0.smithi070.stdout:5/450: dread - d5/da/f68 zero size 2023-10-08T08:45:41.603 INFO:tasks.workunit.client.0.smithi070.stdout:6/387: mknod df/d26/d42/d43/d4a/d75/c82 0 2023-10-08T08:45:41.604 INFO:tasks.workunit.client.0.smithi070.stdout:5/451: dread d5/da/d4d/d37/d38/d55/f4f [0,4194304] 0 2023-10-08T08:45:41.604 INFO:tasks.workunit.client.0.smithi070.stdout:5/452: fsync d5/da/d4d/d37/d38/d55/f90 0 2023-10-08T08:45:41.605 INFO:tasks.workunit.client.0.smithi070.stdout:8/550: creat d1/de/d3a/d56/fb8 x:0 0 0 2023-10-08T08:45:41.606 INFO:tasks.workunit.client.0.smithi070.stdout:6/388: write df/d26/d42/d4b/f56 [3648474,108314] 0 2023-10-08T08:45:41.607 INFO:tasks.workunit.client.0.smithi070.stdout:5/453: rename d5/da/d4d/d37/l2c to d5/da/d22/d75/d82/l9b 0 2023-10-08T08:45:41.608 INFO:tasks.workunit.client.0.smithi070.stdout:9/296: dwrite d1/f2a [0,4194304] 0 2023-10-08T08:45:41.609 INFO:tasks.workunit.client.0.smithi070.stdout:8/551: mkdir d1/d2/d8c/db9 0 2023-10-08T08:45:41.610 INFO:tasks.workunit.client.0.smithi070.stdout:9/297: mkdir d1/dd/d19/d38/d56 0 2023-10-08T08:45:41.611 INFO:tasks.workunit.client.0.smithi070.stdout:5/454: link d5/da/d4d/f3f d5/d5f/d61/f9c 0 2023-10-08T08:45:41.611 INFO:tasks.workunit.client.0.smithi070.stdout:9/298: rmdir d1/dd/d1a/d40 39 2023-10-08T08:45:41.612 INFO:tasks.workunit.client.0.smithi070.stdout:8/552: truncate d1/d2/d6/d22/f4b 1922856 0 2023-10-08T08:45:41.612 INFO:tasks.workunit.client.0.smithi070.stdout:9/299: rmdir d1/dd/d19/d38/d4f 39 2023-10-08T08:45:41.613 INFO:tasks.workunit.client.0.smithi070.stdout:9/300: mknod d1/dd/d19/d38/d4f/c57 0 2023-10-08T08:45:41.613 INFO:tasks.workunit.client.0.smithi070.stdout:5/455: mknod d5/d5f/d61/d30/d54/d62/c9d 0 2023-10-08T08:45:41.615 INFO:tasks.workunit.client.0.smithi070.stdout:8/553: link d1/d2/d6/c72 d1/de/d3a/d56/d65/cba 0 2023-10-08T08:45:41.615 INFO:tasks.workunit.client.0.smithi070.stdout:8/554: truncate d1/de/d15/fb1 609645 0 2023-10-08T08:45:41.615 INFO:tasks.workunit.client.0.smithi070.stdout:8/555: read - d1/d2/d8c/fb0 zero size 2023-10-08T08:45:41.618 INFO:tasks.workunit.client.0.smithi070.stdout:8/556: mknod d1/de/d2e/cbb 0 2023-10-08T08:45:41.621 INFO:tasks.workunit.client.0.smithi070.stdout:8/557: link d1/c5 d1/de/d3a/d56/d65/cbc 0 2023-10-08T08:45:41.621 INFO:tasks.workunit.client.0.smithi070.stdout:8/558: write d1/de/da9/fae [1210646,130898] 0 2023-10-08T08:45:41.624 INFO:tasks.workunit.client.0.smithi070.stdout:8/559: symlink d1/de/d3a/d56/d86/lbd 0 2023-10-08T08:45:41.655 INFO:tasks.workunit.client.0.smithi070.stdout:5/456: dwrite d5/f26 [0,4194304] 0 2023-10-08T08:45:41.658 INFO:tasks.workunit.client.0.smithi070.stdout:5/457: link d5/d5f/d61/d30/d54/f7b d5/d5f/d63/d8b/f9e 0 2023-10-08T08:45:41.658 INFO:tasks.workunit.client.0.smithi070.stdout:5/458: readlink d5/da/l1d 0 2023-10-08T08:45:41.665 INFO:tasks.workunit.client.0.smithi070.stdout:1/605: dwrite d6/f55 [0,4194304] 0 2023-10-08T08:45:41.665 INFO:tasks.workunit.client.0.smithi070.stdout:6/389: dwrite df/d53/f5e [0,4194304] 0 2023-10-08T08:45:41.665 INFO:tasks.workunit.client.0.smithi070.stdout:6/390: read - df/d53/f67 zero size 2023-10-08T08:45:41.668 INFO:tasks.workunit.client.0.smithi070.stdout:8/560: dwrite d1/de/f34 [4194304,4194304] 0 2023-10-08T08:45:41.681 INFO:tasks.workunit.client.0.smithi070.stdout:4/344: sync 2023-10-08T08:45:41.682 INFO:tasks.workunit.client.0.smithi070.stdout:4/345: chown dc/l42 913709722 1 2023-10-08T08:45:41.682 INFO:tasks.workunit.client.0.smithi070.stdout:7/522: sync 2023-10-08T08:45:41.684 INFO:tasks.workunit.client.0.smithi070.stdout:6/391: dread df/d26/d42/d43/d4a/f4f [0,4194304] 0 2023-10-08T08:45:41.686 INFO:tasks.workunit.client.0.smithi070.stdout:7/523: unlink c1 0 2023-10-08T08:45:41.686 INFO:tasks.workunit.client.0.smithi070.stdout:7/524: chown d3/d19/d1a/f2f 72 1 2023-10-08T08:45:41.686 INFO:tasks.workunit.client.0.smithi070.stdout:6/392: symlink df/d26/d42/d55/d74/l83 0 2023-10-08T08:45:41.689 INFO:tasks.workunit.client.0.smithi070.stdout:5/459: dwrite d5/da/d22/f89 [0,4194304] 0 2023-10-08T08:45:41.689 INFO:tasks.workunit.client.0.smithi070.stdout:5/460: truncate d5/da/d22/f5e 476699 0 2023-10-08T08:45:41.693 INFO:tasks.workunit.client.0.smithi070.stdout:5/461: creat d5/f9f x:0 0 0 2023-10-08T08:45:41.695 INFO:tasks.workunit.client.0.smithi070.stdout:8/561: dwrite d1/d2/f31 [8388608,4194304] 0 2023-10-08T08:45:41.695 INFO:tasks.workunit.client.0.smithi070.stdout:1/606: dwrite d6/dc/d14/d1f/d63/fa9 [0,4194304] 0 2023-10-08T08:45:41.695 INFO:tasks.workunit.client.0.smithi070.stdout:1/607: write d6/dc/d14/d1f/d63/db3/f57 [304002,113213] 0 2023-10-08T08:45:41.695 INFO:tasks.workunit.client.0.smithi070.stdout:1/608: chown d6/dc/d14/d1f/d75/l9a 1469121 1 2023-10-08T08:45:41.695 INFO:tasks.workunit.client.0.smithi070.stdout:5/462: rename d5/d5f/d61/l71 to d5/d5f/d63/la0 0 2023-10-08T08:45:41.696 INFO:tasks.workunit.client.0.smithi070.stdout:8/562: mkdir d1/d2/d6/d22/d9e/da7/dbe 0 2023-10-08T08:45:41.696 INFO:tasks.workunit.client.0.smithi070.stdout:8/563: fsync d1/de/f4f 0 2023-10-08T08:45:41.696 INFO:tasks.workunit.client.0.smithi070.stdout:1/609: write d6/dc/d14/d1f/d63/db3/d38/f5f [669906,65928] 0 2023-10-08T08:45:41.697 INFO:tasks.workunit.client.0.smithi070.stdout:5/463: getdents d5/d5f/d63/d8b 0 2023-10-08T08:45:41.698 INFO:tasks.workunit.client.0.smithi070.stdout:7/525: dread d3/d19/d1a/f22 [0,4194304] 0 2023-10-08T08:45:41.698 INFO:tasks.workunit.client.0.smithi070.stdout:4/346: dread dc/d17/d24/f52 [0,4194304] 0 2023-10-08T08:45:41.698 INFO:tasks.workunit.client.0.smithi070.stdout:4/347: fdatasync dc/d17/d24/d4c/f60 0 2023-10-08T08:45:41.699 INFO:tasks.workunit.client.0.smithi070.stdout:4/348: stat dc/d17/d24/d4c/f60 0 2023-10-08T08:45:41.701 INFO:tasks.workunit.client.0.smithi070.stdout:7/526: dread d3/d19/f56 [0,4194304] 0 2023-10-08T08:45:41.701 INFO:tasks.workunit.client.0.smithi070.stdout:7/527: stat d3/da9/d4a/d9/l68 0 2023-10-08T08:45:41.701 INFO:tasks.workunit.client.0.smithi070.stdout:7/528: write d3/d19/f56 [684383,45240] 0 2023-10-08T08:45:41.701 INFO:tasks.workunit.client.0.smithi070.stdout:8/564: creat d1/d4d/d61/fbf x:0 0 0 2023-10-08T08:45:41.701 INFO:tasks.workunit.client.0.smithi070.stdout:8/565: write d1/de/d1a/f1b [4626476,63921] 0 2023-10-08T08:45:41.702 INFO:tasks.workunit.client.0.smithi070.stdout:8/566: fsync d1/de/d2e/f42 0 2023-10-08T08:45:41.702 INFO:tasks.workunit.client.0.smithi070.stdout:5/464: dread d5/da/d4d/f8e [0,4194304] 0 2023-10-08T08:45:41.703 INFO:tasks.workunit.client.0.smithi070.stdout:7/529: symlink d3/d19/d95/dad/lb1 0 2023-10-08T08:45:41.703 INFO:tasks.workunit.client.0.smithi070.stdout:8/567: read d1/de/d15/f20 [6105159,23507] 0 2023-10-08T08:45:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:6/393: dread df/d11/d1d/f3d [0,4194304] 0 2023-10-08T08:45:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:4/349: read dc/d17/d24/f40 [7488317,94359] 0 2023-10-08T08:45:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:5/465: rmdir d5/da/d22/d75/d82 39 2023-10-08T08:45:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:5/466: chown d5/d5f/d61/d30/l18 7959 1 2023-10-08T08:45:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:5/467: chown d5/da/d22/f5e 1751 1 2023-10-08T08:45:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:4/350: write dc/d17/f70 [256531,50599] 0 2023-10-08T08:45:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:4/351: readlink dc/d17/l58 0 2023-10-08T08:45:41.706 INFO:tasks.workunit.client.0.smithi070.stdout:7/530: creat d3/d19/fb2 x:0 0 0 2023-10-08T08:45:41.706 INFO:tasks.workunit.client.0.smithi070.stdout:5/468: rmdir d5/d5f/d61/d30/d54/d62 39 2023-10-08T08:45:41.707 INFO:tasks.workunit.client.0.smithi070.stdout:6/394: rename df/d11/f66 to df/d26/f84 0 2023-10-08T08:45:41.707 INFO:tasks.workunit.client.0.smithi070.stdout:6/395: fsync df/d26/f6b 0 2023-10-08T08:45:41.707 INFO:tasks.workunit.client.0.smithi070.stdout:8/568: rename d1/cf to d1/cc0 0 2023-10-08T08:45:41.709 INFO:tasks.workunit.client.0.smithi070.stdout:7/531: creat d3/da9/d4a/d9/da4/fb3 x:0 0 0 2023-10-08T08:45:41.709 INFO:tasks.workunit.client.0.smithi070.stdout:7/532: fsync d3/da9/d1e/d76/f87 0 2023-10-08T08:45:41.709 INFO:tasks.workunit.client.0.smithi070.stdout:6/396: creat df/d26/d42/d43/d4a/f85 x:0 0 0 2023-10-08T08:45:41.710 INFO:tasks.workunit.client.0.smithi070.stdout:8/569: rename d1/de/d15/fb1 to d1/de/d1a/fc1 0 2023-10-08T08:45:41.710 INFO:tasks.workunit.client.0.smithi070.stdout:8/570: creat d1/de/d2e/d45/d7b/fc2 x:0 0 0 2023-10-08T08:45:41.711 INFO:tasks.workunit.client.0.smithi070.stdout:6/397: creat df/d26/d42/d43/f86 x:0 0 0 2023-10-08T08:45:41.712 INFO:tasks.workunit.client.0.smithi070.stdout:8/571: mkdir d1/d2/d6/d22/d5b/d74/dc3 0 2023-10-08T08:45:41.712 INFO:tasks.workunit.client.0.smithi070.stdout:8/572: readlink d1/d2/l4 0 2023-10-08T08:45:41.712 INFO:tasks.workunit.client.0.smithi070.stdout:6/398: read df/d11/f41 [17546,18006] 0 2023-10-08T08:45:41.713 INFO:tasks.workunit.client.0.smithi070.stdout:6/399: mknod df/d26/d42/d43/d4a/d75/c87 0 2023-10-08T08:45:41.716 INFO:tasks.workunit.client.0.smithi070.stdout:8/573: unlink d1/de/d21/f35 0 2023-10-08T08:45:41.735 INFO:tasks.workunit.client.0.smithi070.stdout:8/574: write d1/de/d15/f20 [2405670,94480] 0 2023-10-08T08:45:41.737 INFO:tasks.workunit.client.0.smithi070.stdout:5/469: dwrite d5/f9f [0,4194304] 0 2023-10-08T08:45:41.737 INFO:tasks.workunit.client.0.smithi070.stdout:7/533: dwrite d3/da9/d4a/f8e [0,4194304] 0 2023-10-08T08:45:41.738 INFO:tasks.workunit.client.0.smithi070.stdout:8/575: link d1/d4d/f81 d1/d2/d6/d22/d5b/d74/dc3/fc4 0 2023-10-08T08:45:41.739 INFO:tasks.workunit.client.0.smithi070.stdout:6/400: dwrite df/d11/f31 [4194304,4194304] 0 2023-10-08T08:45:41.741 INFO:tasks.workunit.client.0.smithi070.stdout:5/470: link d5/d5f/d63/c74 d5/d5f/d61/d30/ca1 0 2023-10-08T08:45:41.742 INFO:tasks.workunit.client.0.smithi070.stdout:5/471: truncate d5/d5f/d61/d30/d83/f8c 542064 0 2023-10-08T08:45:41.742 INFO:tasks.workunit.client.0.smithi070.stdout:6/401: creat df/d26/f88 x:0 0 0 2023-10-08T08:45:41.743 INFO:tasks.workunit.client.0.smithi070.stdout:8/576: link d1/de/d1a/l76 d1/d2/lc5 0 2023-10-08T08:45:41.743 INFO:tasks.workunit.client.0.smithi070.stdout:8/577: chown d1/d2/d6/d22/f98 2 1 2023-10-08T08:45:41.745 INFO:tasks.workunit.client.0.smithi070.stdout:6/402: mknod df/d53/c89 0 2023-10-08T08:45:41.748 INFO:tasks.workunit.client.0.smithi070.stdout:6/403: getdents df/d26/d42/d43/d4a 0 2023-10-08T08:45:41.751 INFO:tasks.workunit.client.0.smithi070.stdout:6/404: mknod df/d71/c8a 0 2023-10-08T08:45:41.752 INFO:tasks.workunit.client.0.smithi070.stdout:5/472: creat d5/da/d4d/d37/d38/fa2 x:0 0 0 2023-10-08T08:45:41.752 INFO:tasks.workunit.client.0.smithi070.stdout:5/473: truncate d5/da/d4d/d37/d2a/f58 2418333 0 2023-10-08T08:45:41.753 INFO:tasks.workunit.client.0.smithi070.stdout:6/405: link df/d11/f40 df/d26/d42/d55/d74/f8b 0 2023-10-08T08:45:41.757 INFO:tasks.workunit.client.0.smithi070.stdout:7/534: dwrite d3/f96 [0,4194304] 0 2023-10-08T08:45:41.758 INFO:tasks.workunit.client.0.smithi070.stdout:7/535: truncate d3/d19/d1a/f4e 2802544 0 2023-10-08T08:45:41.758 INFO:tasks.workunit.client.0.smithi070.stdout:7/536: write d3/d19/f3c [416607,119353] 0 2023-10-08T08:45:41.759 INFO:tasks.workunit.client.0.smithi070.stdout:2/696: sync 2023-10-08T08:45:41.759 INFO:tasks.workunit.client.0.smithi070.stdout:3/461: sync 2023-10-08T08:45:41.759 INFO:tasks.workunit.client.0.smithi070.stdout:8/578: creat d1/de/d2e/d45/d7b/fc6 x:0 0 0 2023-10-08T08:45:41.759 INFO:tasks.workunit.client.0.smithi070.stdout:8/579: dread - d1/de/d3a/d56/fb8 zero size 2023-10-08T08:45:41.759 INFO:tasks.workunit.client.0.smithi070.stdout:2/697: write df/d12/d15/d54/db1/d83/d92/faa [919786,18505] 0 2023-10-08T08:45:41.765 INFO:tasks.workunit.client.0.smithi070.stdout:3/462: rename d0/d12/d14/d5c/d5d/d75/f44 to d0/db/d10/fa3 0 2023-10-08T08:45:41.766 INFO:tasks.workunit.client.0.smithi070.stdout:2/698: rmdir df/d4c/d91/dd8 0 2023-10-08T08:45:41.766 INFO:tasks.workunit.client.0.smithi070.stdout:3/463: mkdir d0/d12/d14/d48/da4 0 2023-10-08T08:45:41.767 INFO:tasks.workunit.client.0.smithi070.stdout:2/699: creat df/d12/d1b/d1c/fe0 x:0 0 0 2023-10-08T08:45:41.767 INFO:tasks.workunit.client.0.smithi070.stdout:2/700: chown df/d12/d1b/d1c/d79/da4/lca 185223949 1 2023-10-08T08:45:41.769 INFO:tasks.workunit.client.0.smithi070.stdout:2/701: rename l7 to df/d12/d1b/dd9/le1 0 2023-10-08T08:45:41.776 INFO:tasks.workunit.client.0.smithi070.stdout:3/464: dread d0/db/d10/f1e [0,4194304] 0 2023-10-08T08:45:41.776 INFO:tasks.workunit.client.0.smithi070.stdout:3/465: write d0/d12/d14/d48/f53 [705535,106078] 0 2023-10-08T08:45:41.778 INFO:tasks.workunit.client.0.smithi070.stdout:3/466: creat d0/d12/d14/fa5 x:0 0 0 2023-10-08T08:45:41.778 INFO:tasks.workunit.client.0.smithi070.stdout:3/467: truncate d0/d12/d14/d5c/d5d/d75/f33 964055 0 2023-10-08T08:45:41.778 INFO:tasks.workunit.client.0.smithi070.stdout:3/468: write d0/f68 [753311,119523] 0 2023-10-08T08:45:41.779 INFO:tasks.workunit.client.0.smithi070.stdout:3/469: creat d0/db/fa6 x:0 0 0 2023-10-08T08:45:41.780 INFO:tasks.workunit.client.0.smithi070.stdout:3/470: creat d0/d12/d14/d5c/d5d/da0/d86/fa7 x:0 0 0 2023-10-08T08:45:41.781 INFO:tasks.workunit.client.0.smithi070.stdout:3/471: read d0/db/f18 [3197565,49593] 0 2023-10-08T08:45:41.782 INFO:tasks.workunit.client.0.smithi070.stdout:3/472: creat d0/d12/d14/d1d/fa8 x:0 0 0 2023-10-08T08:45:41.783 INFO:tasks.workunit.client.0.smithi070.stdout:3/473: symlink d0/d12/d14/d5c/d5d/d75/d52/la9 0 2023-10-08T08:45:41.784 INFO:tasks.workunit.client.0.smithi070.stdout:8/580: dwrite d1/de/d2e/d45/d7b/fc6 [0,4194304] 0 2023-10-08T08:45:41.784 INFO:tasks.workunit.client.0.smithi070.stdout:6/406: dwrite df/f5c [0,4194304] 0 2023-10-08T08:45:41.785 INFO:tasks.workunit.client.0.smithi070.stdout:3/474: creat d0/d12/d14/d5c/d5d/da0/faa x:0 0 0 2023-10-08T08:45:41.788 INFO:tasks.workunit.client.0.smithi070.stdout:8/581: mkdir d1/de/d3a/d56/dc7 0 2023-10-08T08:45:41.789 INFO:tasks.workunit.client.0.smithi070.stdout:6/407: link df/d11/f29 df/d71/f8c 0 2023-10-08T08:45:41.789 INFO:tasks.workunit.client.0.smithi070.stdout:6/408: chown df/d26/d42/d55 59159 1 2023-10-08T08:45:41.789 INFO:tasks.workunit.client.0.smithi070.stdout:5/474: dwrite d5/d5f/d61/d30/d83/f93 [0,4194304] 0 2023-10-08T08:45:41.792 INFO:tasks.workunit.client.0.smithi070.stdout:6/409: rename df/d26/f6b to df/d26/d42/d43/d4a/d75/d7e/f8d 0 2023-10-08T08:45:41.795 INFO:tasks.workunit.client.0.smithi070.stdout:2/702: dwrite df/d12/d1b/d1c/fcb [0,4194304] 0 2023-10-08T08:45:41.797 INFO:tasks.workunit.client.0.smithi070.stdout:6/410: symlink df/d26/d42/d55/l8e 0 2023-10-08T08:45:41.797 INFO:tasks.workunit.client.0.smithi070.stdout:6/411: write df/d71/f7b [862018,57422] 0 2023-10-08T08:45:41.802 INFO:tasks.workunit.client.0.smithi070.stdout:6/412: symlink df/d26/d78/l8f 0 2023-10-08T08:45:41.802 INFO:tasks.workunit.client.0.smithi070.stdout:6/413: chown df/d11 390 1 2023-10-08T08:45:41.803 INFO:tasks.workunit.client.0.smithi070.stdout:6/414: fdatasync df/d26/d42/d43/d4a/f6d 0 2023-10-08T08:45:41.820 INFO:tasks.workunit.client.0.smithi070.stdout:6/415: dread df/d11/d1d/f44 [0,4194304] 0 2023-10-08T08:45:41.821 INFO:tasks.workunit.client.0.smithi070.stdout:6/416: mkdir df/d26/d78/d90 0 2023-10-08T08:45:41.822 INFO:tasks.workunit.client.0.smithi070.stdout:6/417: chown df/d26/d42/d4b/c6c 3861 1 2023-10-08T08:45:41.822 INFO:tasks.workunit.client.0.smithi070.stdout:6/418: truncate df/d11/f47 5160358 0 2023-10-08T08:45:41.822 INFO:tasks.workunit.client.0.smithi070.stdout:6/419: fdatasync f4 0 2023-10-08T08:45:41.823 INFO:tasks.workunit.client.0.smithi070.stdout:6/420: mknod df/d11/d1d/c91 0 2023-10-08T08:45:41.837 INFO:tasks.workunit.client.0.smithi070.stdout:2/703: dwrite df/d12/d1b/d82/d85/fba [0,4194304] 0 2023-10-08T08:45:41.838 INFO:tasks.workunit.client.0.smithi070.stdout:3/475: dwrite d0/db/d10/d38/d2f/f7e [0,4194304] 0 2023-10-08T08:45:41.839 INFO:tasks.workunit.client.0.smithi070.stdout:5/475: dwrite d5/da/f50 [0,4194304] 0 2023-10-08T08:45:41.840 INFO:tasks.workunit.client.0.smithi070.stdout:3/476: symlink d0/db/d10/d6d/lab 0 2023-10-08T08:45:41.840 INFO:tasks.workunit.client.0.smithi070.stdout:2/704: link df/cad df/d12/d7e/ce2 0 2023-10-08T08:45:41.842 INFO:tasks.workunit.client.0.smithi070.stdout:2/705: write df/f20 [3362799,106726] 0 2023-10-08T08:45:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:3/477: creat d0/db/d10/d6d/fac x:0 0 0 2023-10-08T08:45:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:3/478: fsync d0/d12/d14/d5c/d5d/da0/d86/f9f 0 2023-10-08T08:45:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:3/479: dread - d0/d12/d14/d1d/f90 zero size 2023-10-08T08:45:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:3/480: write d0/d8a/f96 [1001907,5372] 0 2023-10-08T08:45:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:3/481: dread d0/d12/d14/d5c/d5d/d75/f41 [0,4194304] 0 2023-10-08T08:45:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:2/706: truncate df/d12/d15/d54/db1/f44 96211 0 2023-10-08T08:45:41.845 INFO:tasks.workunit.client.0.smithi070.stdout:2/707: rename df/d12/d15/f31 to df/d12/d15/d54/fe3 0 2023-10-08T08:45:41.845 INFO:tasks.workunit.client.0.smithi070.stdout:2/708: chown df/f20 8441859 1 2023-10-08T08:45:41.847 INFO:tasks.workunit.client.0.smithi070.stdout:5/476: write d5/da/d4d/d37/d2a/f58 [1326307,99618] 0 2023-10-08T08:45:41.847 INFO:tasks.workunit.client.0.smithi070.stdout:2/709: rename c6 to df/d12/d1b/dd9/ce4 0 2023-10-08T08:45:41.850 INFO:tasks.workunit.client.0.smithi070.stdout:5/477: mknod d5/ca3 0 2023-10-08T08:45:41.850 INFO:tasks.workunit.client.0.smithi070.stdout:5/478: chown d5/da/d4d/d37/f6c 485875110 1 2023-10-08T08:45:41.851 INFO:tasks.workunit.client.0.smithi070.stdout:5/479: readlink d5/da/d22/d75/d82/l8d 0 2023-10-08T08:45:41.852 INFO:tasks.workunit.client.0.smithi070.stdout:5/480: creat d5/da/d22/fa4 x:0 0 0 2023-10-08T08:45:41.852 INFO:tasks.workunit.client.0.smithi070.stdout:5/481: chown d5/d5f/d61/d30/l21 5 1 2023-10-08T08:45:41.855 INFO:tasks.workunit.client.0.smithi070.stdout:5/482: getdents d5/da/d4d/d37/d38 0 2023-10-08T08:45:41.864 INFO:tasks.workunit.client.0.smithi070.stdout:9/301: sync 2023-10-08T08:45:41.864 INFO:tasks.workunit.client.0.smithi070.stdout:0/655: sync 2023-10-08T08:45:41.864 INFO:tasks.workunit.client.0.smithi070.stdout:0/656: fdatasync d1/d1d/d4d/f5c 0 2023-10-08T08:45:41.865 INFO:tasks.workunit.client.0.smithi070.stdout:9/302: mknod d1/dd/d19/d38/d56/c58 0 2023-10-08T08:45:41.867 INFO:tasks.workunit.client.0.smithi070.stdout:0/657: rename d1/d14/d1f/c40 to d1/d62/ccc 0 2023-10-08T08:45:41.867 INFO:tasks.workunit.client.0.smithi070.stdout:0/658: fdatasync d1/d76/d7a/f88 0 2023-10-08T08:45:41.867 INFO:tasks.workunit.client.0.smithi070.stdout:0/659: fsync d1/dd/fb4 0 2023-10-08T08:45:41.867 INFO:tasks.workunit.client.0.smithi070.stdout:3/482: dwrite d0/d12/d14/f28 [0,4194304] 0 2023-10-08T08:45:41.867 INFO:tasks.workunit.client.0.smithi070.stdout:3/483: write d0/d12/d14/d48/f84 [269786,963] 0 2023-10-08T08:45:41.867 INFO:tasks.workunit.client.0.smithi070.stdout:3/484: write d0/db/d10/d6d/fac [718922,111446] 0 2023-10-08T08:45:41.867 INFO:tasks.workunit.client.0.smithi070.stdout:3/485: truncate d0/d12/d14/d1d/f34 246802 0 2023-10-08T08:45:41.867 INFO:tasks.workunit.client.0.smithi070.stdout:9/303: creat d1/dd/d19/d38/d4f/f59 x:0 0 0 2023-10-08T08:45:41.869 INFO:tasks.workunit.client.0.smithi070.stdout:0/660: symlink d1/d1d/d4d/lcd 0 2023-10-08T08:45:41.869 INFO:tasks.workunit.client.0.smithi070.stdout:0/661: chown d1/d1d/d4d/d9d/l74 3838820 1 2023-10-08T08:45:41.869 INFO:tasks.workunit.client.0.smithi070.stdout:0/662: fsync d1/fa7 0 2023-10-08T08:45:41.869 INFO:tasks.workunit.client.0.smithi070.stdout:0/663: readlink d1/dd/l50 0 2023-10-08T08:45:41.869 INFO:tasks.workunit.client.0.smithi070.stdout:3/486: write d0/db/d10/f1e [1001497,88635] 0 2023-10-08T08:45:41.870 INFO:tasks.workunit.client.0.smithi070.stdout:9/304: chown d1/dd/ce 465276 1 2023-10-08T08:45:41.870 INFO:tasks.workunit.client.0.smithi070.stdout:3/487: creat d0/d8a/fad x:0 0 0 2023-10-08T08:45:41.871 INFO:tasks.workunit.client.0.smithi070.stdout:3/488: link d0/d12/d14/d48/f85 d0/d12/d14/d5c/d5d/fae 0 2023-10-08T08:45:41.872 INFO:tasks.workunit.client.0.smithi070.stdout:9/305: getdents d1/dd/d26/d27 0 2023-10-08T08:45:41.873 INFO:tasks.workunit.client.0.smithi070.stdout:3/489: symlink d0/d12/d14/d5c/d5d/d75/d52/laf 0 2023-10-08T08:45:41.874 INFO:tasks.workunit.client.0.smithi070.stdout:9/306: rename d1/dd/d26/f47 to d1/dd/d19/d38/f5a 0 2023-10-08T08:45:41.883 INFO:tasks.workunit.client.0.smithi070.stdout:5/483: dwrite d5/da/f15 [4194304,4194304] 0 2023-10-08T08:45:41.886 INFO:tasks.workunit.client.0.smithi070.stdout:5/484: rmdir d5/d5f/d61/d30/d54 39 2023-10-08T08:45:41.888 INFO:tasks.workunit.client.0.smithi070.stdout:5/485: unlink d5/d5f/d61/d30/d83/f97 0 2023-10-08T08:45:41.889 INFO:tasks.workunit.client.0.smithi070.stdout:5/486: truncate d5/da/d22/f52 2075487 0 2023-10-08T08:45:41.890 INFO:tasks.workunit.client.0.smithi070.stdout:5/487: mknod d5/ca5 0 2023-10-08T08:45:41.891 INFO:tasks.workunit.client.0.smithi070.stdout:5/488: write d5/da/d4d/d37/d38/d55/f53 [1486724,66868] 0 2023-10-08T08:45:41.891 INFO:tasks.workunit.client.0.smithi070.stdout:5/489: truncate d5/da/d22/f5e 907214 0 2023-10-08T08:45:41.892 INFO:tasks.workunit.client.0.smithi070.stdout:5/490: read d5/da/d4d/f64 [1560190,117561] 0 2023-10-08T08:45:41.897 INFO:tasks.workunit.client.0.smithi070.stdout:3/490: dwrite d0/d12/f81 [0,4194304] 0 2023-10-08T08:45:41.899 INFO:tasks.workunit.client.0.smithi070.stdout:3/491: symlink d0/d12/d14/d1d/lb0 0 2023-10-08T08:45:41.899 INFO:tasks.workunit.client.0.smithi070.stdout:3/492: stat d0/db/f18 0 2023-10-08T08:45:41.924 INFO:tasks.workunit.client.0.smithi070.stdout:9/307: dread d1/dd/d26/f4c [0,4194304] 0 2023-10-08T08:45:41.924 INFO:tasks.workunit.client.0.smithi070.stdout:9/308: read - d1/dd/d26/f54 zero size 2023-10-08T08:45:41.924 INFO:tasks.workunit.client.0.smithi070.stdout:0/664: dwrite d1/d14/f35 [0,4194304] 0 2023-10-08T08:45:41.924 INFO:tasks.workunit.client.0.smithi070.stdout:0/665: write d1/d62/f55 [1632723,98122] 0 2023-10-08T08:45:41.924 INFO:tasks.workunit.client.0.smithi070.stdout:0/666: write d1/d1d/f69 [925177,100776] 0 2023-10-08T08:45:41.927 INFO:tasks.workunit.client.0.smithi070.stdout:5/491: dwrite d5/da/d4d/d37/f6c [0,4194304] 0 2023-10-08T08:45:41.927 INFO:tasks.workunit.client.0.smithi070.stdout:0/667: creat d1/d76/d7a/fce x:0 0 0 2023-10-08T08:45:41.931 INFO:tasks.workunit.client.0.smithi070.stdout:0/668: link d1/d1d/d4d/c87 d1/d62/d54/d5e/ccf 0 2023-10-08T08:45:41.931 INFO:tasks.workunit.client.0.smithi070.stdout:3/493: dwrite d0/d12/d14/d5c/d5d/da0/d6a/fa1 [0,4194304] 0 2023-10-08T08:45:41.937 INFO:tasks.workunit.client.0.smithi070.stdout:3/494: dread d0/db/d10/d6d/fac [0,4194304] 0 2023-10-08T08:45:41.937 INFO:tasks.workunit.client.0.smithi070.stdout:3/495: readlink d0/d12/d14/d1d/l7d 0 2023-10-08T08:45:41.937 INFO:tasks.workunit.client.0.smithi070.stdout:3/496: dread - d0/d12/f7c zero size 2023-10-08T08:45:41.937 INFO:tasks.workunit.client.0.smithi070.stdout:3/497: write d0/db/d10/d38/d2f/f9e [2169,74289] 0 2023-10-08T08:45:41.948 INFO:tasks.workunit.client.0.smithi070.stdout:3/498: dread d0/d12/d14/f40 [0,4194304] 0 2023-10-08T08:45:41.948 INFO:tasks.workunit.client.0.smithi070.stdout:5/492: dwrite d5/f7c [0,4194304] 0 2023-10-08T08:45:41.950 INFO:tasks.workunit.client.0.smithi070.stdout:9/309: dread d1/dd/f11 [0,4194304] 0 2023-10-08T08:45:41.950 INFO:tasks.workunit.client.0.smithi070.stdout:3/499: mkdir d0/d12/d14/d5c/db1 0 2023-10-08T08:45:41.950 INFO:tasks.workunit.client.0.smithi070.stdout:9/310: readlink d1/dd/d19/l24 0 2023-10-08T08:45:41.950 INFO:tasks.workunit.client.0.smithi070.stdout:3/500: fsync d0/d12/d14/d1d/f90 0 2023-10-08T08:45:41.951 INFO:tasks.workunit.client.0.smithi070.stdout:0/669: dread d1/fa [0,4194304] 0 2023-10-08T08:45:41.951 INFO:tasks.workunit.client.0.smithi070.stdout:0/670: chown d1/fa 42188759 1 2023-10-08T08:45:41.952 INFO:tasks.workunit.client.0.smithi070.stdout:0/671: creat d1/d14/d1f/d6f/fd0 x:0 0 0 2023-10-08T08:45:41.952 INFO:tasks.workunit.client.0.smithi070.stdout:3/501: link d0/c19 d0/db/d10/d38/d2f/cb2 0 2023-10-08T08:45:41.952 INFO:tasks.workunit.client.0.smithi070.stdout:3/502: truncate d0/d12/d14/d1d/f5e 1195015 0 2023-10-08T08:45:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:0/672: creat d1/d62/d54/d5e/d80/d8a/fd1 x:0 0 0 2023-10-08T08:45:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:3/503: truncate d0/db/d10/d38/f50 881976 0 2023-10-08T08:45:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:0/673: write d1/d14/d1f/fad [3025353,123375] 0 2023-10-08T08:45:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:3/504: dread d0/d12/f9a [0,4194304] 0 2023-10-08T08:45:41.958 INFO:tasks.workunit.client.0.smithi070.stdout:3/505: rmdir d0/db/d10/d38 39 2023-10-08T08:45:41.958 INFO:tasks.workunit.client.0.smithi070.stdout:3/506: chown d0/db/d10/d38/d2f/c36 2406415 1 2023-10-08T08:45:41.959 INFO:tasks.workunit.client.0.smithi070.stdout:3/507: creat d0/d12/d14/d5c/d5d/da0/d86/fb3 x:0 0 0 2023-10-08T08:45:41.959 INFO:tasks.workunit.client.0.smithi070.stdout:3/508: write d0/db/d10/d92/f93 [907832,90513] 0 2023-10-08T08:45:41.961 INFO:tasks.workunit.client.0.smithi070.stdout:3/509: rename d0/l5 to d0/db/d10/d38/d63/lb4 0 2023-10-08T08:45:41.962 INFO:tasks.workunit.client.0.smithi070.stdout:3/510: mkdir d0/d12/d14/d5c/d5d/d75/d52/db5 0 2023-10-08T08:45:41.963 INFO:tasks.workunit.client.0.smithi070.stdout:3/511: chown d0/d12/d14/d5c/d5d/da0/f6f 5255660 1 2023-10-08T08:45:41.965 INFO:tasks.workunit.client.0.smithi070.stdout:3/512: rename d0/db/d10/d92 to d0/d12/d14/d5c/d5d/d75/d52/db5/db6 0 2023-10-08T08:45:41.967 INFO:tasks.workunit.client.0.smithi070.stdout:3/513: mknod d0/d12/d14/d5c/d5d/d75/d52/db5/cb7 0 2023-10-08T08:45:41.972 INFO:tasks.workunit.client.0.smithi070.stdout:3/514: rename d0/db/ce to d0/d12/d14/d48/da4/cb8 0 2023-10-08T08:45:41.973 INFO:tasks.workunit.client.0.smithi070.stdout:3/515: chown d0 50319 1 2023-10-08T08:45:41.974 INFO:tasks.workunit.client.0.smithi070.stdout:0/674: dread d1/fa [0,4194304] 0 2023-10-08T08:45:41.974 INFO:tasks.workunit.client.0.smithi070.stdout:0/675: truncate d1/d14/d1f/f66 4379530 0 2023-10-08T08:45:41.979 INFO:tasks.workunit.client.0.smithi070.stdout:5/493: dwrite d5/d5f/d63/d8b/f9e [0,4194304] 0 2023-10-08T08:45:41.979 INFO:tasks.workunit.client.0.smithi070.stdout:5/494: chown d5/f98 1463 1 2023-10-08T08:45:41.981 INFO:tasks.workunit.client.0.smithi070.stdout:5/495: dread d5/da/d4d/f8e [0,4194304] 0 2023-10-08T08:45:41.982 INFO:tasks.workunit.client.0.smithi070.stdout:0/676: write d1/d62/d54/d5e/d80/d8a/dc8/f6c [471141,81438] 0 2023-10-08T08:45:41.984 INFO:tasks.workunit.client.0.smithi070.stdout:0/677: symlink d1/d62/d54/d5e/d80/d8a/ld2 0 2023-10-08T08:45:41.984 INFO:tasks.workunit.client.0.smithi070.stdout:0/678: readlink d1/d62/lb2 0 2023-10-08T08:45:41.987 INFO:tasks.workunit.client.0.smithi070.stdout:0/679: getdents d1/d62/d54 0 2023-10-08T08:45:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:0/680: mkdir d1/d1d/d4d/d9d/dd3 0 2023-10-08T08:45:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:5/496: truncate d5/d5f/d61/d30/d54/f7b 2404874 0 2023-10-08T08:45:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:5/497: chown d5/da/d22/f5e 6585666 1 2023-10-08T08:45:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:3/516: dwrite d0/d12/d14/f28 [0,4194304] 0 2023-10-08T08:45:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:5/498: symlink d5/la6 0 2023-10-08T08:45:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:3/517: mknod d0/d12/d14/d5c/d9d/cb9 0 2023-10-08T08:45:42.001 INFO:tasks.workunit.client.0.smithi070.stdout:3/518: mkdir d0/d12/d14/d1d/dba 0 2023-10-08T08:45:42.001 INFO:tasks.workunit.client.0.smithi070.stdout:3/519: write d0/db/d10/d6d/fac [1710761,118926] 0 2023-10-08T08:45:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:5/499: getdents d5/da/d22 0 2023-10-08T08:45:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:5/500: chown d5/da/d4d/d37/d38/d55 16790 1 2023-10-08T08:45:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:3/520: unlink d0/d12/d14/f39 0 2023-10-08T08:45:42.008 INFO:tasks.workunit.client.0.smithi070.stdout:3/521: getdents d0/d12/d14/d5c/d5d/da0/d86 0 2023-10-08T08:45:42.011 INFO:tasks.workunit.client.0.smithi070.stdout:0/681: dwrite d1/d62/d54/f7d [4194304,4194304] 0 2023-10-08T08:45:42.029 INFO:tasks.workunit.client.0.smithi070.stdout:5/501: dread d5/da/d4d/f85 [0,4194304] 0 2023-10-08T08:45:42.031 INFO:tasks.workunit.client.0.smithi070.stdout:3/522: dwrite d0/d12/d14/f72 [0,4194304] 0 2023-10-08T08:45:42.031 INFO:tasks.workunit.client.0.smithi070.stdout:3/523: fsync d0/d12/d14/d5c/d5d/da0/d86/fa7 0 2023-10-08T08:45:42.034 INFO:tasks.workunit.client.0.smithi070.stdout:3/524: getdents d0/db/d10/d6d 0 2023-10-08T08:45:42.034 INFO:tasks.workunit.client.0.smithi070.stdout:3/525: fsync d0/d12/f7a 0 2023-10-08T08:45:42.034 INFO:tasks.workunit.client.0.smithi070.stdout:3/526: stat d0/d12/d14/l4a 0 2023-10-08T08:45:42.036 INFO:tasks.workunit.client.0.smithi070.stdout:3/527: rename d0/db/d10/d38/d2f/f9e to d0/d12/d14/fbb 0 2023-10-08T08:45:42.037 INFO:tasks.workunit.client.0.smithi070.stdout:3/528: creat d0/d12/d14/d5c/fbc x:0 0 0 2023-10-08T08:45:42.038 INFO:tasks.workunit.client.0.smithi070.stdout:3/529: chown d0/d12/d14/d5c/d5d/da0/d86/f89 0 1 2023-10-08T08:45:42.038 INFO:tasks.workunit.client.0.smithi070.stdout:3/530: rmdir d0/db/d10/d38/d63 39 2023-10-08T08:45:42.038 INFO:tasks.workunit.client.0.smithi070.stdout:3/531: chown d0/db/d10/c1b 888 1 2023-10-08T08:45:42.040 INFO:tasks.workunit.client.0.smithi070.stdout:3/532: read d0/d12/d14/d48/f53 [249805,97270] 0 2023-10-08T08:45:42.041 INFO:tasks.workunit.client.0.smithi070.stdout:3/533: mknod d0/db/d10/cbd 0 2023-10-08T08:45:42.043 INFO:tasks.workunit.client.0.smithi070.stdout:3/534: write d0/db/d10/f1e [624084,79010] 0 2023-10-08T08:45:42.044 INFO:tasks.workunit.client.0.smithi070.stdout:3/535: getdents d0/d12/d14/d5c/d5d/d75/d52/db5 0 2023-10-08T08:45:42.044 INFO:tasks.workunit.client.0.smithi070.stdout:3/536: getdents d0/db/d10/d6d 0 2023-10-08T08:45:42.045 INFO:tasks.workunit.client.0.smithi070.stdout:3/537: chown d0/db/d10/c1b 53 1 2023-10-08T08:45:42.045 INFO:tasks.workunit.client.0.smithi070.stdout:3/538: chown d0/db/d10/l46 865104510 1 2023-10-08T08:45:42.046 INFO:tasks.workunit.client.0.smithi070.stdout:3/539: mkdir d0/d12/d14/d5c/db1/dbe 0 2023-10-08T08:45:42.046 INFO:tasks.workunit.client.0.smithi070.stdout:5/502: dwrite d5/d5f/d61/f60 [0,4194304] 0 2023-10-08T08:45:42.048 INFO:tasks.workunit.client.0.smithi070.stdout:3/540: creat d0/d12/d14/d5c/d5d/fbf x:0 0 0 2023-10-08T08:45:42.049 INFO:tasks.workunit.client.0.smithi070.stdout:3/541: creat d0/d12/d14/d1d/fc0 x:0 0 0 2023-10-08T08:45:42.051 INFO:tasks.workunit.client.0.smithi070.stdout:3/542: creat d0/db/d10/d38/d2f/fc1 x:0 0 0 2023-10-08T08:45:42.052 INFO:tasks.workunit.client.0.smithi070.stdout:3/543: creat d0/d12/d14/d5c/d5d/da0/d86/fc2 x:0 0 0 2023-10-08T08:45:42.054 INFO:tasks.workunit.client.0.smithi070.stdout:3/544: rename d0/d12/d14/d5c/d5d/da0/c6e to d0/d12/d14/d1d/cc3 0 2023-10-08T08:45:42.067 INFO:tasks.workunit.client.0.smithi070.stdout:3/545: dread d0/d12/f4e [0,4194304] 0 2023-10-08T08:45:42.079 INFO:tasks.workunit.client.0.smithi070.stdout:3/546: dread d0/db/f18 [0,4194304] 0 2023-10-08T08:45:42.079 INFO:tasks.workunit.client.0.smithi070.stdout:3/547: write d0/d12/d14/d48/f4f [4286093,98942] 0 2023-10-08T08:45:42.080 INFO:tasks.workunit.client.0.smithi070.stdout:3/548: mkdir d0/d12/d14/d5c/dc4 0 2023-10-08T08:45:42.081 INFO:tasks.workunit.client.0.smithi070.stdout:3/549: symlink d0/d12/d8d/lc5 0 2023-10-08T08:45:42.083 INFO:tasks.workunit.client.0.smithi070.stdout:3/550: mknod d0/d12/cc6 0 2023-10-08T08:45:42.083 INFO:tasks.workunit.client.0.smithi070.stdout:3/551: dread - d0/d8a/fad zero size 2023-10-08T08:45:42.084 INFO:tasks.workunit.client.0.smithi070.stdout:3/552: creat d0/db/d10/d38/d63/fc7 x:0 0 0 2023-10-08T08:45:42.084 INFO:tasks.workunit.client.0.smithi070.stdout:3/553: mkdir d0/db/d10/d38/dc8 0 2023-10-08T08:45:42.104 INFO:tasks.workunit.client.0.smithi070.stdout:3/554: dwrite d0/d8a/f96 [0,4194304] 0 2023-10-08T08:45:42.104 INFO:tasks.workunit.client.0.smithi070.stdout:3/555: write d0/d8a/fad [429113,14146] 0 2023-10-08T08:45:42.108 INFO:tasks.workunit.client.0.smithi070.stdout:3/556: unlink d0/d12/d14/d5c/f61 0 2023-10-08T08:45:42.109 INFO:tasks.workunit.client.0.smithi070.stdout:3/557: creat d0/d12/d14/d1d/fc9 x:0 0 0 2023-10-08T08:45:42.131 INFO:tasks.workunit.client.0.smithi070.stdout:3/558: dwrite d0/db/f18 [4194304,4194304] 0 2023-10-08T08:45:42.135 INFO:tasks.workunit.client.0.smithi070.stdout:3/559: dread d0/db/d10/d6d/fac [0,4194304] 0 2023-10-08T08:45:42.135 INFO:tasks.workunit.client.0.smithi070.stdout:3/560: chown d0/db/d10/f1e 4 1 2023-10-08T08:45:42.136 INFO:tasks.workunit.client.0.smithi070.stdout:3/561: mknod d0/d12/d8d/cca 0 2023-10-08T08:45:42.138 INFO:tasks.workunit.client.0.smithi070.stdout:3/562: dread d0/d12/d14/d5c/d5d/d75/f33 [0,4194304] 0 2023-10-08T08:45:42.138 INFO:tasks.workunit.client.0.smithi070.stdout:3/563: write d0/db/d10/d38/d63/f82 [1236875,6957] 0 2023-10-08T08:45:42.139 INFO:tasks.workunit.client.0.smithi070.stdout:3/564: write d0/d12/d14/fa5 [657262,16310] 0 2023-10-08T08:45:42.140 INFO:tasks.workunit.client.0.smithi070.stdout:3/565: mkdir d0/d12/d14/d5c/d5d/d75/d52/db5/dcb 0 2023-10-08T08:45:42.140 INFO:tasks.workunit.client.0.smithi070.stdout:3/566: dread - d0/d12/d14/d5c/d5d/da0/d86/fa7 zero size 2023-10-08T08:45:42.142 INFO:tasks.workunit.client.0.smithi070.stdout:3/567: write d0/d12/d14/f2a [363568,106353] 0 2023-10-08T08:45:42.143 INFO:tasks.workunit.client.0.smithi070.stdout:3/568: mkdir d0/d12/d8d/dcc 0 2023-10-08T08:45:42.143 INFO:tasks.workunit.client.0.smithi070.stdout:3/569: dread - d0/d12/d14/d5c/fbc zero size 2023-10-08T08:45:42.143 INFO:tasks.workunit.client.0.smithi070.stdout:3/570: chown d0/ca 1481487 1 2023-10-08T08:45:42.144 INFO:tasks.workunit.client.0.smithi070.stdout:3/571: fsync d0/d12/f71 0 2023-10-08T08:45:42.144 INFO:tasks.workunit.client.0.smithi070.stdout:3/572: fdatasync d0/db/d10/f9c 0 2023-10-08T08:45:42.144 INFO:tasks.workunit.client.0.smithi070.stdout:3/573: write d0/d12/d14/d5c/d5d/da0/d86/fc2 [509092,85147] 0 2023-10-08T08:45:42.144 INFO:tasks.workunit.client.0.smithi070.stdout:3/574: read d0/d12/f7a [816881,21229] 0 2023-10-08T08:45:42.145 INFO:tasks.workunit.client.0.smithi070.stdout:3/575: creat d0/d8a/fcd x:0 0 0 2023-10-08T08:45:42.146 INFO:tasks.workunit.client.0.smithi070.stdout:3/576: symlink d0/d12/d14/d5c/d5d/lce 0 2023-10-08T08:45:42.147 INFO:tasks.workunit.client.0.smithi070.stdout:3/577: creat d0/d12/d8d/fcf x:0 0 0 2023-10-08T08:45:42.148 INFO:tasks.workunit.client.0.smithi070.stdout:3/578: creat d0/d12/d14/d5c/db1/fd0 x:0 0 0 2023-10-08T08:45:42.151 INFO:tasks.workunit.client.0.smithi070.stdout:3/579: creat d0/fd1 x:0 0 0 2023-10-08T08:45:42.152 INFO:tasks.workunit.client.0.smithi070.stdout:3/580: mkdir d0/db/d10/d38/dc8/dd2 0 2023-10-08T08:45:42.156 INFO:tasks.workunit.client.0.smithi070.stdout:3/581: rename d0/db/d10/d38/d2f/f8c to d0/fd3 0 2023-10-08T08:45:42.156 INFO:tasks.workunit.client.0.smithi070.stdout:3/582: readlink d0/d12/l65 0 2023-10-08T08:45:42.156 INFO:tasks.workunit.client.0.smithi070.stdout:3/583: truncate d0/fd1 391620 0 2023-10-08T08:45:42.157 INFO:tasks.workunit.client.0.smithi070.stdout:3/584: mkdir d0/d12/d14/d5c/d9d/dd4 0 2023-10-08T08:45:42.158 INFO:tasks.workunit.client.0.smithi070.stdout:3/585: mknod d0/d12/d14/d5c/db1/cd5 0 2023-10-08T08:45:42.159 INFO:tasks.workunit.client.0.smithi070.stdout:3/586: mknod d0/d8a/cd6 0 2023-10-08T08:45:42.161 INFO:tasks.workunit.client.0.smithi070.stdout:3/587: write d0/db/fd [1002619,99047] 0 2023-10-08T08:45:42.162 INFO:tasks.workunit.client.0.smithi070.stdout:3/588: truncate d0/d12/d14/d1d/fc0 678626 0 2023-10-08T08:45:42.162 INFO:tasks.workunit.client.0.smithi070.stdout:3/589: fdatasync d0/db/f26 0 2023-10-08T08:45:42.172 INFO:tasks.workunit.client.0.smithi070.stdout:3/590: dread d0/d12/d14/f1c [0,4194304] 0 2023-10-08T08:45:42.175 INFO:tasks.workunit.client.0.smithi070.stdout:3/591: unlink d0/d12/d14/l4a 0 2023-10-08T08:45:42.177 INFO:tasks.workunit.client.0.smithi070.stdout:3/592: rename d0/db/d10/d38/c42 to d0/db/d10/d38/dc8/cd7 0 2023-10-08T08:45:42.179 INFO:tasks.workunit.client.0.smithi070.stdout:3/593: dread d0/d12/d14/d5c/d5d/da0/f6f [0,4194304] 0 2023-10-08T08:45:42.180 INFO:tasks.workunit.client.0.smithi070.stdout:3/594: read - d0/db/fa2 zero size 2023-10-08T08:45:42.184 INFO:tasks.workunit.client.0.smithi070.stdout:3/595: getdents d0/d8a 0 2023-10-08T08:45:42.187 INFO:tasks.workunit.client.0.smithi070.stdout:3/596: mkdir d0/d12/d14/d5c/d5d/da0/dd8 0 2023-10-08T08:45:42.189 INFO:tasks.workunit.client.0.smithi070.stdout:3/597: symlink d0/d12/d14/d5c/d5d/da0/d6a/ld9 0 2023-10-08T08:45:42.189 INFO:tasks.workunit.client.0.smithi070.stdout:3/598: chown d0/d12/d14/d1d/f78 7 1 2023-10-08T08:45:42.189 INFO:tasks.workunit.client.0.smithi070.stdout:3/599: fsync d0/d12/d14/d1d/fc9 0 2023-10-08T08:45:42.190 INFO:tasks.workunit.client.0.smithi070.stdout:3/600: rmdir d0/d12/d14/d5c/d9d/dd4 0 2023-10-08T08:45:42.191 INFO:tasks.workunit.client.0.smithi070.stdout:3/601: mknod d0/d12/d14/d5c/d5d/da0/dd8/cda 0 2023-10-08T08:45:42.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:42 smithi105 ceph-mon[103798]: pgmap v348: 129 pgs: 129 active+clean; 955 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 137 MiB/s wr, 1.52k op/s 2023-10-08T08:45:42.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:42 smithi191 ceph-mon[104220]: pgmap v348: 129 pgs: 129 active+clean; 955 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 137 MiB/s wr, 1.52k op/s 2023-10-08T08:45:42.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:42 smithi070 ceph-mon[99513]: pgmap v348: 129 pgs: 129 active+clean; 955 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 137 MiB/s wr, 1.52k op/s 2023-10-08T08:45:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.156+0000 7fd8cd24d700 1 -- 172.21.15.70:0/535293403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8c8100000 msgr2=0x7fd8c81003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.156+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/535293403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8c8100000 0x7fd8c81003e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80099c0 tx=0x7fd8b8009cd0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.156+0000 7fd8cd24d700 1 -- 172.21.15.70:0/535293403 shutdown_connections 2023-10-08T08:45:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.156+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/535293403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8c81049b0 0x7fd8c810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.156+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/535293403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8c8100000 0x7fd8c81003e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.156+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/535293403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8c81009b0 0x7fd8c8104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.156+0000 7fd8cd24d700 1 -- 172.21.15.70:0/535293403 >> 172.21.15.70:0/535293403 conn(0x7fd8c8075c40 msgr2=0x7fd8c80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.156+0000 7fd8cd24d700 1 -- 172.21.15.70:0/535293403 shutdown_connections 2023-10-08T08:45:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.156+0000 7fd8cd24d700 1 -- 172.21.15.70:0/535293403 wait complete. 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.157+0000 7fd8cd24d700 1 Processor -- start 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.157+0000 7fd8cd24d700 1 -- start start 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8cd24d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8c8100000 0x7fd8c8197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8cd24d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8c81049b0 0x7fd8c8197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8cd24d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8c81984b0 0x7fd8c81a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8cd24d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c81a3150 con 0x7fd8c81049b0 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8cd24d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c81a32c0 con 0x7fd8c8100000 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8cd24d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c81a3480 con 0x7fd8c81984b0 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8c8100000 0x7fd8c8197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c759e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8c81984b0 0x7fd8c81a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8c8100000 0x7fd8c8197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40166/0 (socket says 172.21.15.70:40166) 2023-10-08T08:45:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8c81049b0 0x7fd8c8197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c759e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8c81984b0 0x7fd8c81a2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40290/0 (socket says 172.21.15.70:40290) 2023-10-08T08:45:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/2844697619 learned_addr learned my addr 172.21.15.70:0/2844697619 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c759e700 1 -- 172.21.15.70:0/2844697619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8c8100000 msgr2=0x7fd8c8197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c759e700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8c8100000 0x7fd8c8197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c759e700 1 -- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8c81049b0 msgr2=0x7fd8c8197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c759e700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8c81049b0 0x7fd8c8197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c759e700 1 -- 172.21.15.70:0/2844697619 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80095f0 con 0x7fd8c81984b0 2023-10-08T08:45:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c659c700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8c81049b0 0x7fd8c8197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.158+0000 7fd8c759e700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8c81984b0 0x7fd8c81a2ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000efc0 tx=0x7fd8c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.159+0000 7fd8affff700 1 -- 172.21.15.70:0/2844697619 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0018070 con 0x7fd8c81984b0 2023-10-08T08:45:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.159+0000 7fd8cd24d700 1 -- 172.21.15.70:0/2844697619 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c81a3700 con 0x7fd8c81984b0 2023-10-08T08:45:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.159+0000 7fd8affff700 1 -- 172.21.15.70:0/2844697619 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8c000f040 con 0x7fd8c81984b0 2023-10-08T08:45:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.159+0000 7fd8affff700 1 -- 172.21.15.70:0/2844697619 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000cd40 con 0x7fd8c81984b0 2023-10-08T08:45:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.159+0000 7fd8cd24d700 1 -- 172.21.15.70:0/2844697619 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c81a3c10 con 0x7fd8c81984b0 2023-10-08T08:45:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.161+0000 7fd8affff700 1 -- 172.21.15.70:0/2844697619 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd8c0003a00 con 0x7fd8c81984b0 2023-10-08T08:45:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.162+0000 7fd8affff700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8b00a15f0 0x7fd8b00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.162+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8b00a15f0 0x7fd8b00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.162+0000 7fd8affff700 1 -- 172.21.15.70:0/2844697619 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd8c00ccfc0 con 0x7fd8c81984b0 2023-10-08T08:45:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8b00a15f0 0x7fd8b00a3ab0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80036c0 tx=0x7fd8b8005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8d9436b80 1 Processor -- start 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8d9436b80 1 -- start start 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b61a0 0x55e4e56afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e5618400 con 0x55e4e56b5880 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e5609bc0 con 0x55e4e56b61a0 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e56074e0 con 0x55e4e56b00b0 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b61a0 0x55e4e56afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b61a0 0x55e4e56afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40176/0 (socket says 172.21.15.70:40176) 2023-10-08T08:45:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c659c700 1 -- 172.21.15.70:0/3972080726 learned_addr learned my addr 172.21.15.70:0/3972080726 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c759e700 1 --2- 172.21.15.70:0/3972080726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c659c700 1 -- 172.21.15.70:0/3972080726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 msgr2=0x55e4e56b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c659c700 1 --2- 172.21.15.70:0/3972080726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c659c700 1 -- 172.21.15.70:0/3972080726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 msgr2=0x55e4e56b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c659c700 1 --2- 172.21.15.70:0/3972080726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c659c700 1 -- 172.21.15.70:0/3972080726 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4e542dd80 con 0x55e4e56b61a0 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.163+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/3972080726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.164+0000 7fd8c659c700 1 --2- 172.21.15.70:0/3972080726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b61a0 0x55e4e56afb70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc011540 tx=0x7fd8bc011850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e566084785c1492 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.164+0000 7fd8ad7fa700 1 -- 172.21.15.70:0/3972080726 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc004a30 con 0x55e4e56b61a0 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.164+0000 7fd8ad7fa700 1 -- 172.21.15.70:0/3972080726 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8bc0054e0 con 0x55e4e56b61a0 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.164+0000 7fd8ad7fa700 1 -- 172.21.15.70:0/3972080726 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc00e810 con 0x55e4e56b61a0 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.164+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3972080726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b61a0 msgr2=0x55e4e56afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.164+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3972080726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b61a0 0x55e4e56afb70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc011540 tx=0x7fd8bc011850 comp rx=0 tx=0).stop 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3972080726 shutdown_connections 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3972080726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3972080726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3972080726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b61a0 0x55e4e56afb70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3972080726 >> 172.21.15.70:0/3972080726 conn(0x55e4e5624200 msgr2=0x55e4e56aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3972080726 shutdown_connections 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3972080726 wait complete. 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 -- start start 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 Processor -- start 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b00b0 0x55e4e56bc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b61a0 0x55e4e56b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e5602dd0 con 0x55e4e56b5880 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e559f6b0 con 0x55e4e56b00b0 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e559f350 con 0x55e4e56b61a0 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8d9436b80 10 client.0 _ll_register_callbacks cb 0x55e4e53fc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b00b0 0x55e4e56bc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b00b0 0x55e4e56bc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40180/0 (socket says 172.21.15.70:40180) 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52724/0 (socket says 172.21.15.70:52724) 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/3622048206 learned_addr learned my addr 172.21.15.70:0/3622048206 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.165+0000 7fd8c759e700 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b61a0 0x55e4e56b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/3622048206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b61a0 msgr2=0x55e4e56b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b61a0 0x55e4e56b9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/3622048206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 msgr2=0x55e4e56b9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/3622048206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c810cdd0 con 0x55e4e56b00b0 2023-10-08T08:45:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b00b0 0x55e4e56bc140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8003e50 tx=0x7fd8b8009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13ede112fcf01e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8aaff5700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:45:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3622048206 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b802c040 con 0x55e4e56b00b0 2023-10-08T08:45:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3622048206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4e55cae50 con 0x55e4e56b00b0 2023-10-08T08:45:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3622048206 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd8b800bdc0 con 0x55e4e56b00b0 2023-10-08T08:45:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3622048206 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8b800f460 con 0x55e4e56b00b0 2023-10-08T08:45:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8d9436b80 10 client.25823 fetch_fsmap learned FSMap version 32 2023-10-08T08:45:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3622048206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fd8bc009d10 con 0x55e4e56b00b0 2023-10-08T08:45:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.166+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3622048206 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e4e55cae50 con 0x55e4e56b00b0 2023-10-08T08:45:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3622048206 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 32) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd8b8026550 con 0x55e4e56b00b0 2023-10-08T08:45:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8d9436b80 10 client.25823 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T08:45:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8d9436b80 10 client.25823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8d9436b80 20 client.25823 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e4e56ce150 0x55e4e56d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8d9436b80 4 client.25823 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3622048206 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4e55fbdb0 con 0x55e4e56ce150 2023-10-08T08:45:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8c659c700 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e4e56ce150 0x55e4e56d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8aaff5700 10 client.25823 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.167+0000 7fd8c659c700 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e4e56ce150 0x55e4e56d0570 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=176f2eeb2b266c44 server_cookie=48129d2bdbd00199 in_seq=0 out_seq=0 2023-10-08T08:45:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3622048206 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e4e55fbdb0 con 0x55e4e56ce150 2023-10-08T08:45:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8aaff5700 10 client.25823 handle_command_reply: tid=0 2023-10-08T08:45:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 client.25823 shutdown 2023-10-08T08:45:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3622048206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b00b0 msgr2=0x55e4e56bc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b00b0 0x55e4e56bc140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8003e50 tx=0x7fd8b8009cd0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3622048206 shutdown_connections 2023-10-08T08:45:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b61a0 0x55e4e56b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e4e56ce150 0x55e4e56d0570 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b00b0 0x55e4e56bc140 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8aaff5700 0 client.25823 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3622048206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b5880 0x55e4e56b9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3622048206 >> 172.21.15.70:0/3622048206 conn(0x55e4e5624200 msgr2=0x55e4e56aa010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3622048206 shutdown_connections 2023-10-08T08:45:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3622048206 wait complete. 2023-10-08T08:45:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.168+0000 7fd8d9436b80 20 client.25823 trim_cache size 0 max 16384 2023-10-08T08:45:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8d9436b80 1 Processor -- start 2023-10-08T08:45:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8d9436b80 1 -- start start 2023-10-08T08:45:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 0x55e4e56c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56aa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e54838c0 con 0x55e4e56b61a0 2023-10-08T08:45:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e56a52b0 con 0x55e4e56b5880 2023-10-08T08:45:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e56c1120 con 0x55e4e56b00b0 2023-10-08T08:45:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8c759e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40308/0 (socket says 172.21.15.70:40308) 2023-10-08T08:45:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/2505984899 learned_addr learned my addr 172.21.15.70:0/2505984899 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.183+0000 7fd8c659c700 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 0x55e4e56c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/2505984899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 msgr2=0x55e4e56c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 0x55e4e56c0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/2505984899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 msgr2=0x55e4e56aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/2505984899 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4e5416c00 con 0x55e4e56b00b0 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8c759e700 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8c659c700 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 0x55e4e56c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800b600 tx=0x7fd8b8009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93e7fd3077a164c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8adffb700 1 -- 172.21.15.70:0/2505984899 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b802c070 con 0x55e4e56b00b0 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8adffb700 1 -- 172.21.15.70:0/2505984899 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8b801e040 con 0x55e4e56b00b0 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.184+0000 7fd8adffb700 1 -- 172.21.15.70:0/2505984899 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800f6c0 con 0x55e4e56b00b0 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 -- 172.21.15.70:0/2505984899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 msgr2=0x55e4e56b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800b600 tx=0x7fd8b8009360 comp rx=0 tx=0).stop 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 -- 172.21.15.70:0/2505984899 shutdown_connections 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b0490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/2505984899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 0x55e4e56c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 -- 172.21.15.70:0/2505984899 >> 172.21.15.70:0/2505984899 conn(0x55e4e5624200 msgr2=0x55e4e56d4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 -- 172.21.15.70:0/2505984899 shutdown_connections 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 -- 172.21.15.70:0/2505984899 wait complete. 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 -- start start 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 Processor -- start 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 0x55e4e56b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56b1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e56b1990 con 0x55e4e56b61a0 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e56b1b00 con 0x55e4e56b5880 2023-10-08T08:45:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e56b1cc0 con 0x55e4e56b00b0 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8d9436b80 10 client.0 _ll_register_callbacks cb 0x7fd8b8003a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8c759e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40314/0 (socket says 172.21.15.70:40314) 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8c759e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52740/0 (socket says 172.21.15.70:52740) 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8c6d9d700 1 -- 172.21.15.70:0/3678906328 learned_addr learned my addr 172.21.15.70:0/3678906328 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.185+0000 7fd8c659c700 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 0x55e4e56b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8c759e700 1 -- 172.21.15.70:0/3678906328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 msgr2=0x55e4e56b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8c759e700 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8c759e700 1 -- 172.21.15.70:0/3678906328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 msgr2=0x55e4e56b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8c759e700 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 0x55e4e56b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8c759e700 1 -- 172.21.15.70:0/3678906328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4e542dd80 con 0x55e4e56b61a0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8c759e700 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56b1390 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00ca440 tx=0x7fd8c00998a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f18a9957be9dd72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8aaff5700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3678906328 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0004ad0 con 0x55e4e56b61a0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3678906328 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd8c001b530 con 0x55e4e56b61a0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3678906328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8bc0054e0 con 0x55e4e56b61a0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3678906328 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8c009a460 con 0x55e4e56b61a0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8d9436b80 10 client.16413 fetch_fsmap learned FSMap version 32 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3678906328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fd8c81a3c10 con 0x55e4e56b61a0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.186+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3678906328 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8bc0054e0 con 0x55e4e56b61a0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3678906328 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd8c0099250 con 0x55e4e56b61a0 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8d9436b80 10 client.16413 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T08:45:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8d9436b80 10 client.16413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:43.200 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8d9436b80 20 client.16413 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:43.200 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e4e57231c0 0x55e4e57255e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:43.200 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8d9436b80 4 client.16413 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:45:43.200 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3678906328 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e4e55fbad0 con 0x55e4e57231c0 2023-10-08T08:45:43.200 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e4e57231c0 0x55e4e57255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:43.200 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8aaff5700 10 client.16413 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:43.200 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.187+0000 7fd8c6d9d700 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e4e57231c0 0x55e4e57255e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a76c3b0ec7880f6 server_cookie=7b5daf6019d4da2f in_seq=0 out_seq=0 2023-10-08T08:45:43.216 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.214+0000 7fd8aaff5700 1 -- 172.21.15.70:0/3678906328 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e4e55fbad0 con 0x55e4e57231c0 2023-10-08T08:45:43.216 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.214+0000 7fd8aaff5700 10 client.16413 handle_command_reply: tid=0 2023-10-08T08:45:43.217 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 client.16413 shutdown 2023-10-08T08:45:43.217 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3678906328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 msgr2=0x55e4e56b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:43.217 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56b1390 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00ca440 tx=0x7fd8c00998a0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.217 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3678906328 shutdown_connections 2023-10-08T08:45:43.217 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4e56b61a0 0x55e4e56b1390 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e4e56b00b0 0x55e4e56b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e4e57231c0 0x55e4e57255e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 --2- 172.21.15.70:0/3678906328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4e56b5880 0x55e4e56b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8aaff5700 0 client.16413 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3678906328 >> 172.21.15.70:0/3678906328 conn(0x55e4e5624200 msgr2=0x55e4e56b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3678906328 shutdown_connections 2023-10-08T08:45:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 1 -- 172.21.15.70:0/3678906328 wait complete. 2023-10-08T08:45:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.215+0000 7fd8d9436b80 20 client.16413 trim_cache size 0 max 16384 2023-10-08T08:45:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:45:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:45:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:45:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:45:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 -- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8b00a15f0 msgr2=0x7fd8b00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8b00a15f0 0x7fd8b00a3ab0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80036c0 tx=0x7fd8b8005fb0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 -- 172.21.15.70:0/2844697619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8c81984b0 msgr2=0x7fd8c81a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8c81984b0 0x7fd8c81a2ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000efc0 tx=0x7fd8c000c3a0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 -- 172.21.15.70:0/2844697619 shutdown_connections 2023-10-08T08:45:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd8b00a15f0 0x7fd8b00a3ab0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8c81984b0 0x7fd8c81a2ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8c8100000 0x7fd8c8197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 --2- 172.21.15.70:0/2844697619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8c81049b0 0x7fd8c8197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 -- 172.21.15.70:0/2844697619 >> 172.21.15.70:0/2844697619 conn(0x7fd8c8075c40 msgr2=0x7fd8c8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 -- 172.21.15.70:0/2844697619 shutdown_connections 2023-10-08T08:45:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:43.216+0000 7fd8cd24d700 1 -- 172.21.15.70:0/2844697619 wait complete. 2023-10-08T08:45:44.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:44 smithi105 ceph-mon[103798]: pgmap v349: 129 pgs: 129 active+clean; 983 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 66 MiB/s wr, 1.16k op/s 2023-10-08T08:45:44.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:44 smithi191 ceph-mon[104220]: pgmap v349: 129 pgs: 129 active+clean; 983 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 66 MiB/s wr, 1.16k op/s 2023-10-08T08:45:44.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:44 smithi070 ceph-mon[99513]: pgmap v349: 129 pgs: 129 active+clean; 983 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 66 MiB/s wr, 1.16k op/s 2023-10-08T08:45:46.509 INFO:tasks.workunit.client.0.smithi070.stdout:1/610: sync 2023-10-08T08:45:46.510 INFO:tasks.workunit.client.0.smithi070.stdout:7/537: sync 2023-10-08T08:45:46.510 INFO:tasks.workunit.client.0.smithi070.stdout:4/352: sync 2023-10-08T08:45:46.510 INFO:tasks.workunit.client.0.smithi070.stdout:9/311: sync 2023-10-08T08:45:46.510 INFO:tasks.workunit.client.0.smithi070.stdout:6/421: sync 2023-10-08T08:45:46.510 INFO:tasks.workunit.client.0.smithi070.stdout:5/503: sync 2023-10-08T08:45:46.510 INFO:tasks.workunit.client.0.smithi070.stdout:3/602: sync 2023-10-08T08:45:46.510 INFO:tasks.workunit.client.0.smithi070.stdout:0/682: sync 2023-10-08T08:45:46.510 INFO:tasks.workunit.client.0.smithi070.stdout:0/683: truncate d1/d14/d1f/f96 4244186 0 2023-10-08T08:45:46.510 INFO:tasks.workunit.client.0.smithi070.stdout:0/684: dread - d1/faa zero size 2023-10-08T08:45:46.511 INFO:tasks.workunit.client.0.smithi070.stdout:4/353: creat dc/d17/d24/d6b/f71 x:0 0 0 2023-10-08T08:45:46.511 INFO:tasks.workunit.client.0.smithi070.stdout:8/582: sync 2023-10-08T08:45:46.511 INFO:tasks.workunit.client.0.smithi070.stdout:2/710: sync 2023-10-08T08:45:46.511 INFO:tasks.workunit.client.0.smithi070.stdout:2/711: write df/d4c/d91/f99 [639933,98262] 0 2023-10-08T08:45:46.511 INFO:tasks.workunit.client.0.smithi070.stdout:5/504: mknod d5/da/d4d/d37/d2a/ca7 0 2023-10-08T08:45:46.512 INFO:tasks.workunit.client.0.smithi070.stdout:9/312: write f0 [791718,116] 0 2023-10-08T08:45:46.512 INFO:tasks.workunit.client.0.smithi070.stdout:9/313: chown d1/dd/d26/d27/f36 1068977 1 2023-10-08T08:45:46.512 INFO:tasks.workunit.client.0.smithi070.stdout:9/314: chown d1/dd 445940318 1 2023-10-08T08:45:46.513 INFO:tasks.workunit.client.0.smithi070.stdout:3/603: link d0/d12/d14/d5c/d5d/fae d0/d12/d14/d5c/d5d/fdb 0 2023-10-08T08:45:46.514 INFO:tasks.workunit.client.0.smithi070.stdout:9/315: rename d1/dd/d26/d27/c3a to d1/dd/d19/d38/c5b 0 2023-10-08T08:45:46.516 INFO:tasks.workunit.client.0.smithi070.stdout:9/316: mknod d1/dd/d26/c5c 0 2023-10-08T08:45:46.517 INFO:tasks.workunit.client.0.smithi070.stdout:3/604: rmdir d0/d12/d14/d48 39 2023-10-08T08:45:46.518 INFO:tasks.workunit.client.0.smithi070.stdout:7/538: symlink d3/lb4 0 2023-10-08T08:45:46.518 INFO:tasks.workunit.client.0.smithi070.stdout:9/317: mkdir d1/dd/d26/d5d 0 2023-10-08T08:45:46.518 INFO:tasks.workunit.client.0.smithi070.stdout:0/685: creat d1/d62/d54/d5e/d80/d8a/dc3/fd4 x:0 0 0 2023-10-08T08:45:46.518 INFO:tasks.workunit.client.0.smithi070.stdout:5/505: dread d5/da/d4d/d37/d2a/f58 [0,4194304] 0 2023-10-08T08:45:46.518 INFO:tasks.workunit.client.0.smithi070.stdout:5/506: truncate d5/d5f/d61/d30/d54/d62/f8a 505323 0 2023-10-08T08:45:46.519 INFO:tasks.workunit.client.0.smithi070.stdout:3/605: rename d0/d12/f7a to d0/d12/d8d/dcc/fdc 0 2023-10-08T08:45:46.520 INFO:tasks.workunit.client.0.smithi070.stdout:9/318: rmdir d1/dd/d26/d49 0 2023-10-08T08:45:46.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:46 smithi105 ceph-mon[103798]: pgmap v350: 129 pgs: 129 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 55 MiB/s wr, 1k op/s 2023-10-08T08:45:46.521 INFO:tasks.workunit.client.0.smithi070.stdout:2/712: write df/f11 [262756,17924] 0 2023-10-08T08:45:46.521 INFO:tasks.workunit.client.0.smithi070.stdout:0/686: write d1/dd/dae/fc7 [4060178,124843] 0 2023-10-08T08:45:46.522 INFO:tasks.workunit.client.0.smithi070.stdout:5/507: mkdir d5/d5f/d63/d8b/da8 0 2023-10-08T08:45:46.522 INFO:tasks.workunit.client.0.smithi070.stdout:9/319: rename d1/dd/ce to d1/dd/d39/d4d/c5e 0 2023-10-08T08:45:46.522 INFO:tasks.workunit.client.0.smithi070.stdout:9/320: dread - d1/f55 zero size 2023-10-08T08:45:46.523 INFO:tasks.workunit.client.0.smithi070.stdout:3/606: creat d0/d12/fdd x:0 0 0 2023-10-08T08:45:46.523 INFO:tasks.workunit.client.0.smithi070.stdout:7/539: mknod d3/da9/d4a/d50/cb5 0 2023-10-08T08:45:46.523 INFO:tasks.workunit.client.0.smithi070.stdout:7/540: truncate d3/f37 1519243 0 2023-10-08T08:45:46.524 INFO:tasks.workunit.client.0.smithi070.stdout:9/321: symlink d1/dd/d26/d5d/l5f 0 2023-10-08T08:45:46.526 INFO:tasks.workunit.client.0.smithi070.stdout:7/541: creat d3/d77/fb6 x:0 0 0 2023-10-08T08:45:46.529 INFO:tasks.workunit.client.0.smithi070.stdout:9/322: creat d1/dd/d26/d27/f60 x:0 0 0 2023-10-08T08:45:46.532 INFO:tasks.workunit.client.0.smithi070.stdout:7/542: creat d3/da9/d1e/d76/fb7 x:0 0 0 2023-10-08T08:45:46.536 INFO:tasks.workunit.client.0.smithi070.stdout:8/583: dread d1/d4d/f5f [0,4194304] 0 2023-10-08T08:45:46.541 INFO:tasks.workunit.client.0.smithi070.stdout:6/422: dwrite df/d26/d42/d4b/f56 [0,4194304] 0 2023-10-08T08:45:46.542 INFO:tasks.workunit.client.0.smithi070.stdout:8/584: write d1/de/d2e/f42 [1577754,70851] 0 2023-10-08T08:45:46.544 INFO:tasks.workunit.client.0.smithi070.stdout:8/585: rmdir d1/d2/d6/d22/d5b/d74/dc3 39 2023-10-08T08:45:46.546 INFO:tasks.workunit.client.0.smithi070.stdout:6/423: link df/d26/c2b df/d26/d42/d43/d4a/c92 0 2023-10-08T08:45:46.548 INFO:tasks.workunit.client.0.smithi070.stdout:6/424: truncate df/d11/d1d/f3c 950487 0 2023-10-08T08:45:46.548 INFO:tasks.workunit.client.0.smithi070.stdout:1/611: dwrite d6/f52 [0,4194304] 0 2023-10-08T08:45:46.549 INFO:tasks.workunit.client.0.smithi070.stdout:6/425: creat df/d26/d42/d55/f93 x:0 0 0 2023-10-08T08:45:46.552 INFO:tasks.workunit.client.0.smithi070.stdout:1/612: symlink d6/dc/d14/dc1/lc7 0 2023-10-08T08:45:46.552 INFO:tasks.workunit.client.0.smithi070.stdout:6/426: write df/d26/d42/d43/d4a/f4f [252987,34963] 0 2023-10-08T08:45:46.555 INFO:tasks.workunit.client.0.smithi070.stdout:6/427: unlink f4 0 2023-10-08T08:45:46.561 INFO:tasks.workunit.client.0.smithi070.stdout:0/687: write d1/d62/d54/d5e/d80/d8a/dc8/f59 [1445561,25653] 0 2023-10-08T08:45:46.563 INFO:tasks.workunit.client.0.smithi070.stdout:0/688: mkdir d1/d76/dd5 0 2023-10-08T08:45:46.564 INFO:tasks.workunit.client.0.smithi070.stdout:9/323: dwrite d1/dd/d19/d38/f5a [0,4194304] 0 2023-10-08T08:45:46.568 INFO:tasks.workunit.client.0.smithi070.stdout:2/713: dwrite df/f5c [0,4194304] 0 2023-10-08T08:45:46.569 INFO:tasks.workunit.client.0.smithi070.stdout:3/607: dwrite d0/d12/fdd [0,4194304] 0 2023-10-08T08:45:46.569 INFO:tasks.workunit.client.0.smithi070.stdout:3/608: readlink d0/d12/d14/d1d/l55 0 2023-10-08T08:45:46.574 INFO:tasks.workunit.client.0.smithi070.stdout:3/609: link d0/d12/d14/d5c/d5d/da0/d86/f89 d0/d12/d14/d1d/dba/fde 0 2023-10-08T08:45:46.574 INFO:tasks.workunit.client.0.smithi070.stdout:3/610: write d0/d12/d14/d1d/dba/fde [854446,92167] 0 2023-10-08T08:45:46.574 INFO:tasks.workunit.client.0.smithi070.stdout:3/611: truncate d0/d12/f97 617176 0 2023-10-08T08:45:46.574 INFO:tasks.workunit.client.0.smithi070.stdout:3/612: readlink d0/db/d10/d38/d63/lb4 0 2023-10-08T08:45:46.575 INFO:tasks.workunit.client.0.smithi070.stdout:7/543: dwrite d3/da9/d4a/d9/f48 [8388608,4194304] 0 2023-10-08T08:45:46.579 INFO:tasks.workunit.client.0.smithi070.stdout:2/714: truncate df/d12/d15/d54/db1/f44 462514 0 2023-10-08T08:45:46.580 INFO:tasks.workunit.client.0.smithi070.stdout:2/715: write df/d12/d1b/d82/d85/f78 [1258515,79062] 0 2023-10-08T08:45:46.584 INFO:tasks.workunit.client.0.smithi070.stdout:7/544: rename d3/d19/d1a/f2f to d3/da9/d1e/d76/fb8 0 2023-10-08T08:45:46.587 INFO:tasks.workunit.client.0.smithi070.stdout:2/716: rename df/d12/d15/f94 to df/d3a/db6/dde/fe5 0 2023-10-08T08:45:46.588 INFO:tasks.workunit.client.0.smithi070.stdout:3/613: write d0/d12/d14/d5c/d5d/da0/d86/f89 [167220,76508] 0 2023-10-08T08:45:46.592 INFO:tasks.workunit.client.0.smithi070.stdout:8/586: dwrite d1/d4d/f5f [0,4194304] 0 2023-10-08T08:45:46.592 INFO:tasks.workunit.client.0.smithi070.stdout:8/587: write d1/de/f4f [117528,24438] 0 2023-10-08T08:45:46.593 INFO:tasks.workunit.client.0.smithi070.stdout:8/588: chown d1/d4d/fa3 210868 1 2023-10-08T08:45:46.593 INFO:tasks.workunit.client.0.smithi070.stdout:2/717: rename df/d12/d15/f41 to df/d12/d1b/d82/d85/d65/fe6 0 2023-10-08T08:45:46.593 INFO:tasks.workunit.client.0.smithi070.stdout:2/718: fsync df/d12/d15/d54/f5a 0 2023-10-08T08:45:46.593 INFO:tasks.workunit.client.0.smithi070.stdout:2/719: chown df/d12/d15/d54/db1/d83/lb8 28735123 1 2023-10-08T08:45:46.594 INFO:tasks.workunit.client.0.smithi070.stdout:8/589: creat d1/de/d2e/d45/d7b/fc8 x:0 0 0 2023-10-08T08:45:46.594 INFO:tasks.workunit.client.0.smithi070.stdout:2/720: creat df/fe7 x:0 0 0 2023-10-08T08:45:46.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:46 smithi191 ceph-mon[104220]: pgmap v350: 129 pgs: 129 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 55 MiB/s wr, 1k op/s 2023-10-08T08:45:46.600 INFO:tasks.workunit.client.0.smithi070.stdout:1/613: dwrite d6/dc/d14/fa0 [0,4194304] 0 2023-10-08T08:45:46.601 INFO:tasks.workunit.client.0.smithi070.stdout:1/614: fsync d6/dc/d14/d1f/d63/db3/f60 0 2023-10-08T08:45:46.601 INFO:tasks.workunit.client.0.smithi070.stdout:1/615: fsync d6/dc/d14/d1f/d63/db3/d38/f4a 0 2023-10-08T08:45:46.602 INFO:tasks.workunit.client.0.smithi070.stdout:9/324: dwrite d1/f2a [0,4194304] 0 2023-10-08T08:45:46.604 INFO:tasks.workunit.client.0.smithi070.stdout:7/545: dread d3/da9/d4a/f8e [0,4194304] 0 2023-10-08T08:45:46.605 INFO:tasks.workunit.client.0.smithi070.stdout:1/616: symlink d6/dc/d14/lc8 0 2023-10-08T08:45:46.605 INFO:tasks.workunit.client.0.smithi070.stdout:9/325: truncate d1/dd/f18 2001894 0 2023-10-08T08:45:46.605 INFO:tasks.workunit.client.0.smithi070.stdout:9/326: truncate d1/dd/d26/f54 498885 0 2023-10-08T08:45:46.606 INFO:tasks.workunit.client.0.smithi070.stdout:0/689: dwrite d1/d76/d7a/f88 [4194304,4194304] 0 2023-10-08T08:45:46.607 INFO:tasks.workunit.client.0.smithi070.stdout:6/428: dwrite df/f5c [0,4194304] 0 2023-10-08T08:45:46.607 INFO:tasks.workunit.client.0.smithi070.stdout:7/546: mknod d3/d19/d1a/cb9 0 2023-10-08T08:45:46.608 INFO:tasks.workunit.client.0.smithi070.stdout:1/617: symlink d6/dc/d14/dc1/lc9 0 2023-10-08T08:45:46.610 INFO:tasks.workunit.client.0.smithi070.stdout:9/327: rename d1/dd/d26/f4c to d1/dd/f61 0 2023-10-08T08:45:46.611 INFO:tasks.workunit.client.0.smithi070.stdout:9/328: chown d1/dd/f18 0 1 2023-10-08T08:45:46.612 INFO:tasks.workunit.client.0.smithi070.stdout:9/329: read d1/dd/f11 [2559354,23823] 0 2023-10-08T08:45:46.612 INFO:tasks.workunit.client.0.smithi070.stdout:9/330: truncate d1/dd/d19/f1b 4497962 0 2023-10-08T08:45:46.612 INFO:tasks.workunit.client.0.smithi070.stdout:0/690: mkdir d1/d62/d54/d5e/d80/d8a/dd6 0 2023-10-08T08:45:46.613 INFO:tasks.workunit.client.0.smithi070.stdout:0/691: chown d1/d1d/d4d/d9d/f6a 30 1 2023-10-08T08:45:46.613 INFO:tasks.workunit.client.0.smithi070.stdout:0/692: chown d1/c17 35 1 2023-10-08T08:45:46.613 INFO:tasks.workunit.client.0.smithi070.stdout:9/331: stat d1/dd/d26/d27/d2d/c53 0 2023-10-08T08:45:46.613 INFO:tasks.workunit.client.0.smithi070.stdout:9/332: dread - d1/dd/d19/d38/f42 zero size 2023-10-08T08:45:46.613 INFO:tasks.workunit.client.0.smithi070.stdout:2/721: dread df/f33 [0,4194304] 0 2023-10-08T08:45:46.615 INFO:tasks.workunit.client.0.smithi070.stdout:3/614: dwrite d0/d12/f7c [0,4194304] 0 2023-10-08T08:45:46.615 INFO:tasks.workunit.client.0.smithi070.stdout:6/429: mkdir df/d26/d42/d4b/d80/d94 0 2023-10-08T08:45:46.615 INFO:tasks.workunit.client.0.smithi070.stdout:9/333: link d1/dd/d19/f1b d1/dd/d1a/f62 0 2023-10-08T08:45:46.615 INFO:tasks.workunit.client.0.smithi070.stdout:9/334: chown d1/dd/lf 1 1 2023-10-08T08:45:46.617 INFO:tasks.workunit.client.0.smithi070.stdout:3/615: mknod d0/d12/d14/d5c/cdf 0 2023-10-08T08:45:46.618 INFO:tasks.workunit.client.0.smithi070.stdout:1/618: mkdir d6/dc/d14/dc1/dca 0 2023-10-08T08:45:46.619 INFO:tasks.workunit.client.0.smithi070.stdout:0/693: unlink d1/d1d/f77 0 2023-10-08T08:45:46.620 INFO:tasks.workunit.client.0.smithi070.stdout:7/547: dread d3/da9/d4a/d9/d97/f9b [0,4194304] 0 2023-10-08T08:45:46.620 INFO:tasks.workunit.client.0.smithi070.stdout:7/548: fdatasync d3/da9/d4a/d50/f66 0 2023-10-08T08:45:46.620 INFO:tasks.workunit.client.0.smithi070.stdout:7/549: chown d3/da9/d4a/d50/f81 70091927 1 2023-10-08T08:45:46.621 INFO:tasks.workunit.client.0.smithi070.stdout:7/550: write d3/da9/d1e/d76/f8a [677484,44] 0 2023-10-08T08:45:46.622 INFO:tasks.workunit.client.0.smithi070.stdout:2/722: symlink df/d12/d1b/d1c/le8 0 2023-10-08T08:45:46.624 INFO:tasks.workunit.client.0.smithi070.stdout:3/616: mkdir d0/db/de0 0 2023-10-08T08:45:46.624 INFO:tasks.workunit.client.0.smithi070.stdout:3/617: chown d0/d12/d14/d48/f83 98130647 1 2023-10-08T08:45:46.629 INFO:tasks.workunit.client.0.smithi070.stdout:1/619: link d6/dc/d14/d1f/d63/db3/d38/d4b/l78 d6/dc/d14/d1f/d75/da1/lcb 0 2023-10-08T08:45:46.629 INFO:tasks.workunit.client.0.smithi070.stdout:0/694: creat d1/d62/d54/d5e/d80/d8a/dc8/fd7 x:0 0 0 2023-10-08T08:45:46.630 INFO:tasks.workunit.client.0.smithi070.stdout:7/551: truncate d3/d19/d1a/f4b 1995372 0 2023-10-08T08:45:46.633 INFO:tasks.workunit.client.0.smithi070.stdout:1/620: rename d6/dc/d14/d1f/c73 to d6/dc/d14/d1f/d63/ccc 0 2023-10-08T08:45:46.635 INFO:tasks.workunit.client.0.smithi070.stdout:7/552: dread d3/da9/d4a/f8 [8388608,4194304] 0 2023-10-08T08:45:46.635 INFO:tasks.workunit.client.0.smithi070.stdout:0/695: rename d1/d1d/d24/c44 to d1/d1d/d4d/cd8 0 2023-10-08T08:45:46.636 INFO:tasks.workunit.client.0.smithi070.stdout:1/621: stat d6/dc/d14/d90/c94 0 2023-10-08T08:45:46.636 INFO:tasks.workunit.client.0.smithi070.stdout:7/553: symlink d3/d19/d1a/lba 0 2023-10-08T08:45:46.638 INFO:tasks.workunit.client.0.smithi070.stdout:0/696: rename d1/d62/d54/d5e/d80/d8a/dc8/fd7 to d1/d14/fd9 0 2023-10-08T08:45:46.638 INFO:tasks.workunit.client.0.smithi070.stdout:0/697: readlink d1/lca 0 2023-10-08T08:45:46.639 INFO:tasks.workunit.client.0.smithi070.stdout:7/554: symlink d3/da9/d1e/d76/lbb 0 2023-10-08T08:45:46.640 INFO:tasks.workunit.client.0.smithi070.stdout:7/555: chown d3/d19/d95/dad/lb1 14130566 1 2023-10-08T08:45:46.640 INFO:tasks.workunit.client.0.smithi070.stdout:7/556: readlink d3/d19/l61 0 2023-10-08T08:45:46.640 INFO:tasks.workunit.client.0.smithi070.stdout:0/698: creat d1/dd/fda x:0 0 0 2023-10-08T08:45:46.641 INFO:tasks.workunit.client.0.smithi070.stdout:7/557: creat d3/da9/d1e/fbc x:0 0 0 2023-10-08T08:45:46.643 INFO:tasks.workunit.client.0.smithi070.stdout:0/699: link d1/d1d/d4d/d9d/fa1 d1/d1d/d4d/fdb 0 2023-10-08T08:45:46.673 INFO:tasks.workunit.client.0.smithi070.stdout:6/430: read df/f10 [1939602,120778] 0 2023-10-08T08:45:46.673 INFO:tasks.workunit.client.0.smithi070.stdout:7/558: write d3/f2e [3838765,114755] 0 2023-10-08T08:45:46.673 INFO:tasks.workunit.client.0.smithi070.stdout:2/723: read df/d12/d15/d54/db1/fa6 [644242,27339] 0 2023-10-08T08:45:46.673 INFO:tasks.workunit.client.0.smithi070.stdout:6/431: dread - df/d26/d42/d43/f86 zero size 2023-10-08T08:45:46.673 INFO:tasks.workunit.client.0.smithi070.stdout:1/622: write d6/dc/f59 [2766974,81966] 0 2023-10-08T08:45:46.674 INFO:tasks.workunit.client.0.smithi070.stdout:2/724: creat df/d12/d15/fe9 x:0 0 0 2023-10-08T08:45:46.674 INFO:tasks.workunit.client.0.smithi070.stdout:2/725: stat df/d12/d1b/d1c 0 2023-10-08T08:45:46.676 INFO:tasks.workunit.client.0.smithi070.stdout:0/700: dwrite d1/d1d/d24/f99 [0,4194304] 0 2023-10-08T08:45:46.676 INFO:tasks.workunit.client.0.smithi070.stdout:0/701: chown d1/d1d/d24/f99 227 1 2023-10-08T08:45:46.677 INFO:tasks.workunit.client.0.smithi070.stdout:3/618: dwrite d0/d12/d14/d5c/d5d/da0/d86/f9f [0,4194304] 0 2023-10-08T08:45:46.683 INFO:tasks.workunit.client.0.smithi070.stdout:1/623: rename d6/dc/d14/f7f to d6/dc/d14/d1f/d75/da1/fcd 0 2023-10-08T08:45:46.683 INFO:tasks.workunit.client.0.smithi070.stdout:2/726: unlink f8 0 2023-10-08T08:45:46.684 INFO:tasks.workunit.client.0.smithi070.stdout:1/624: dread - d6/dc/d14/d90/f9b zero size 2023-10-08T08:45:46.684 INFO:tasks.workunit.client.0.smithi070.stdout:1/625: write d6/dc/d14/d1f/d75/d7e/f87 [1855722,68290] 0 2023-10-08T08:45:46.684 INFO:tasks.workunit.client.0.smithi070.stdout:1/626: chown d6/f65 2377898 1 2023-10-08T08:45:46.684 INFO:tasks.workunit.client.0.smithi070.stdout:1/627: chown d6/dc/f2d 65078 1 2023-10-08T08:45:46.687 INFO:tasks.workunit.client.0.smithi070.stdout:3/619: rename d0/db/d10/d38/dc8 to d0/d12/d14/d5c/d5d/d75/d52/db5/dcb/de1 0 2023-10-08T08:45:46.688 INFO:tasks.workunit.client.0.smithi070.stdout:0/702: mknod d1/d62/cdc 0 2023-10-08T08:45:46.688 INFO:tasks.workunit.client.0.smithi070.stdout:1/628: mknod d6/dc/d14/d1f/d75/d7e/dc2/cce 0 2023-10-08T08:45:46.694 INFO:tasks.workunit.client.0.smithi070.stdout:3/620: mkdir d0/d12/d14/d5c/d5d/da0/d6a/d80/de2 0 2023-10-08T08:45:46.695 INFO:tasks.workunit.client.0.smithi070.stdout:0/703: mknod d1/d76/cdd 0 2023-10-08T08:45:46.695 INFO:tasks.workunit.client.0.smithi070.stdout:1/629: creat d6/dc/d97/fcf x:0 0 0 2023-10-08T08:45:46.695 INFO:tasks.workunit.client.0.smithi070.stdout:1/630: readlink d6/dc/d14/d1f/d63/l8b 0 2023-10-08T08:45:46.695 INFO:tasks.workunit.client.0.smithi070.stdout:3/621: mknod d0/d12/d14/d5c/d5d/d75/d52/db5/dcb/de1/ce3 0 2023-10-08T08:45:46.696 INFO:tasks.workunit.client.0.smithi070.stdout:0/704: mknod d1/d1d/cde 0 2023-10-08T08:45:46.697 INFO:tasks.workunit.client.0.smithi070.stdout:6/432: dwrite df/d26/f3b [0,4194304] 0 2023-10-08T08:45:46.697 INFO:tasks.workunit.client.0.smithi070.stdout:1/631: rename d6/dc/d14/d1f/d75/c41 to d6/dc/d14/dc1/dca/cd0 0 2023-10-08T08:45:46.698 INFO:tasks.workunit.client.0.smithi070.stdout:3/622: rename d0/d12/d14/d5c/d5d/d75/d52 to d0/d12/d14/d5c/d5d/d75/d52/db5/de4 22 2023-10-08T08:45:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:0/705: rmdir d1/d1d/d4d 39 2023-10-08T08:45:46.710 INFO:tasks.workunit.client.0.smithi070.stdout:1/632: mknod d6/dc/cd1 0 2023-10-08T08:45:46.715 INFO:tasks.workunit.client.0.smithi070.stdout:6/433: dread f5 [0,4194304] 0 2023-10-08T08:45:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:46 smithi070 ceph-mon[99513]: pgmap v350: 129 pgs: 129 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 MiB/s rd, 55 MiB/s wr, 1k op/s 2023-10-08T08:45:46.724 INFO:tasks.workunit.client.0.smithi070.stdout:9/335: dwrite d1/dd/d26/d27/d2d/f2f [0,4194304] 0 2023-10-08T08:45:46.725 INFO:tasks.workunit.client.0.smithi070.stdout:3/623: dwrite d0/d12/d14/d5c/d5d/d75/d52/db5/db6/f93 [0,4194304] 0 2023-10-08T08:45:46.726 INFO:tasks.workunit.client.0.smithi070.stdout:7/559: dwrite d3/f2e [0,4194304] 0 2023-10-08T08:45:46.728 INFO:tasks.workunit.client.0.smithi070.stdout:1/633: dread d6/f52 [0,4194304] 0 2023-10-08T08:45:46.728 INFO:tasks.workunit.client.0.smithi070.stdout:1/634: fsync d6/dc/d14/d1f/d75/da1/fcd 0 2023-10-08T08:45:46.728 INFO:tasks.workunit.client.0.smithi070.stdout:3/624: creat d0/d12/d14/d5c/d5d/da0/dd8/fe5 x:0 0 0 2023-10-08T08:45:46.730 INFO:tasks.workunit.client.0.smithi070.stdout:3/625: getdents d0/d12/d14/d5c/d5d/da0/d86 0 2023-10-08T08:45:46.731 INFO:tasks.workunit.client.0.smithi070.stdout:7/560: mknod d3/da9/d4a/cbd 0 2023-10-08T08:45:46.733 INFO:tasks.workunit.client.0.smithi070.stdout:1/635: unlink d6/dc/lc5 0 2023-10-08T08:45:46.736 INFO:tasks.workunit.client.0.smithi070.stdout:6/434: dread df/d11/d1d/f1f [4194304,4194304] 0 2023-10-08T08:45:46.736 INFO:tasks.workunit.client.0.smithi070.stdout:9/336: read d1/dd/d26/d27/f36 [4129718,50725] 0 2023-10-08T08:45:46.740 INFO:tasks.workunit.client.0.smithi070.stdout:0/706: dread d1/d14/d1f/f96 [0,4194304] 0 2023-10-08T08:45:46.743 INFO:tasks.workunit.client.0.smithi070.stdout:6/435: rmdir df/d26/d42/d43/d4a 39 2023-10-08T08:45:46.743 INFO:tasks.workunit.client.0.smithi070.stdout:6/436: dread - df/d26/d42/d55/f93 zero size 2023-10-08T08:45:46.745 INFO:tasks.workunit.client.0.smithi070.stdout:0/707: creat d1/d14/d1f/fdf x:0 0 0 2023-10-08T08:45:46.745 INFO:tasks.workunit.client.0.smithi070.stdout:0/708: chown d1/d1d/cde 351119977 1 2023-10-08T08:45:46.752 INFO:tasks.workunit.client.0.smithi070.stdout:0/709: mknod d1/d1d/d24/ce0 0 2023-10-08T08:45:46.753 INFO:tasks.workunit.client.0.smithi070.stdout:6/437: write f2 [2197341,28322] 0 2023-10-08T08:45:46.753 INFO:tasks.workunit.client.0.smithi070.stdout:6/438: readlink df/d26/l33 0 2023-10-08T08:45:46.754 INFO:tasks.workunit.client.0.smithi070.stdout:0/710: mknod d1/d76/d7a/ce1 0 2023-10-08T08:45:46.755 INFO:tasks.workunit.client.0.smithi070.stdout:0/711: mkdir d1/d14/de2 0 2023-10-08T08:45:46.758 INFO:tasks.workunit.client.0.smithi070.stdout:6/439: rename df/d11/d1d/c2c to df/d11/c95 0 2023-10-08T08:45:46.758 INFO:tasks.workunit.client.0.smithi070.stdout:3/626: dwrite d0/d12/d14/fbb [0,4194304] 0 2023-10-08T08:45:46.759 INFO:tasks.workunit.client.0.smithi070.stdout:1/636: dwrite d6/dc/d14/d1f/d63/db3/f51 [0,4194304] 0 2023-10-08T08:45:46.759 INFO:tasks.workunit.client.0.smithi070.stdout:7/561: dwrite d3/d79/f93 [0,4194304] 0 2023-10-08T08:45:46.760 INFO:tasks.workunit.client.0.smithi070.stdout:6/440: read f5 [252930,77668] 0 2023-10-08T08:45:46.761 INFO:tasks.workunit.client.0.smithi070.stdout:3/627: mkdir d0/d12/d14/d1d/de6 0 2023-10-08T08:45:46.761 INFO:tasks.workunit.client.0.smithi070.stdout:3/628: truncate d0/d12/f71 802089 0 2023-10-08T08:45:46.766 INFO:tasks.workunit.client.0.smithi070.stdout:3/629: creat d0/d12/d14/d5c/d5d/da0/d86/fe7 x:0 0 0 2023-10-08T08:45:46.766 INFO:tasks.workunit.client.0.smithi070.stdout:3/630: fdatasync d0/d12/d14/d5c/d5d/fdb 0 2023-10-08T08:45:46.766 INFO:tasks.workunit.client.0.smithi070.stdout:9/337: dwrite d1/dd/d19/f1b [0,4194304] 0 2023-10-08T08:45:46.766 INFO:tasks.workunit.client.0.smithi070.stdout:9/338: chown d1/dd/d26/f54 176 1 2023-10-08T08:45:46.767 INFO:tasks.workunit.client.0.smithi070.stdout:1/637: dread d6/dc/f2d [4194304,4194304] 0 2023-10-08T08:45:46.768 INFO:tasks.workunit.client.0.smithi070.stdout:3/631: mkdir d0/d12/d14/d5c/d5d/da0/d86/de8 0 2023-10-08T08:45:46.769 INFO:tasks.workunit.client.0.smithi070.stdout:3/632: mknod d0/d12/d14/d5c/dc4/ce9 0 2023-10-08T08:45:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:3/633: read d0/d12/d14/fbb [88637,116493] 0 2023-10-08T08:45:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:3/634: getdents d0/d12/d14/d5c/d5d/da0/d86/de8 0 2023-10-08T08:45:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:3/635: write d0/db/d10/d38/d63/fc7 [1014153,8188] 0 2023-10-08T08:45:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:3/636: read d0/db/d10/f2c [152041,23309] 0 2023-10-08T08:45:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:7/562: dwrite d3/da9/d1e/d76/f87 [0,4194304] 0 2023-10-08T08:45:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:3/637: symlink d0/d12/d14/d5c/d5d/da0/d6a/d80/lea 0 2023-10-08T08:45:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:3/638: fdatasync d0/d12/d14/f40 0 2023-10-08T08:45:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:3/639: write d0/d12/d14/d1d/f6c [686734,28287] 0 2023-10-08T08:45:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:7/563: symlink d3/da9/lbe 0 2023-10-08T08:45:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:7/564: fsync d3/da9/d4a/d50/f94 0 2023-10-08T08:45:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:3/640: stat d0/db/d10/d38/d63/lb4 0 2023-10-08T08:45:46.792 INFO:tasks.workunit.client.0.smithi070.stdout:7/565: mknod d3/da9/d4a/d9/cbf 0 2023-10-08T08:45:46.793 INFO:tasks.workunit.client.0.smithi070.stdout:7/566: creat d3/d19/d6d/fc0 x:0 0 0 2023-10-08T08:45:46.795 INFO:tasks.workunit.client.0.smithi070.stdout:7/567: creat d3/d19/d1a/fc1 x:0 0 0 2023-10-08T08:45:46.796 INFO:tasks.workunit.client.0.smithi070.stdout:7/568: link d3/da9/d1e/c54 d3/da9/d4a/cc2 0 2023-10-08T08:45:46.838 INFO:tasks.workunit.client.0.smithi070.stdout:1/638: dwrite d6/f18 [0,4194304] 0 2023-10-08T08:45:46.838 INFO:tasks.workunit.client.0.smithi070.stdout:1/639: dread - d6/dc/d14/d70/f89 zero size 2023-10-08T08:45:46.839 INFO:tasks.workunit.client.0.smithi070.stdout:6/441: dwrite df/d11/f1a [0,4194304] 0 2023-10-08T08:45:46.839 INFO:tasks.workunit.client.0.smithi070.stdout:6/442: write df/d26/d42/d55/f93 [772331,68354] 0 2023-10-08T08:45:46.839 INFO:tasks.workunit.client.0.smithi070.stdout:6/443: write f2 [4325568,87661] 0 2023-10-08T08:45:46.840 INFO:tasks.workunit.client.0.smithi070.stdout:1/640: creat d6/fd2 x:0 0 0 2023-10-08T08:45:46.840 INFO:tasks.workunit.client.0.smithi070.stdout:1/641: read - d6/dc/d14/d1f/fa5 zero size 2023-10-08T08:45:46.841 INFO:tasks.workunit.client.0.smithi070.stdout:9/339: dwrite d1/dd/d19/d38/f42 [0,4194304] 0 2023-10-08T08:45:46.841 INFO:tasks.workunit.client.0.smithi070.stdout:9/340: chown d1/dd/d26/d27/c33 1 1 2023-10-08T08:45:46.843 INFO:tasks.workunit.client.0.smithi070.stdout:9/341: mknod d1/dd/d26/d5d/c63 0 2023-10-08T08:45:46.843 INFO:tasks.workunit.client.0.smithi070.stdout:9/342: fsync d1/dd/f18 0 2023-10-08T08:45:46.844 INFO:tasks.workunit.client.0.smithi070.stdout:1/642: mknod d6/dc/d14/dc1/cd3 0 2023-10-08T08:45:46.845 INFO:tasks.workunit.client.0.smithi070.stdout:1/643: creat d6/dc/d14/fd4 x:0 0 0 2023-10-08T08:45:46.848 INFO:tasks.workunit.client.0.smithi070.stdout:1/644: creat d6/dc/d14/d1f/d75/da1/fd5 x:0 0 0 2023-10-08T08:45:46.848 INFO:tasks.workunit.client.0.smithi070.stdout:9/343: truncate d1/dd/d1a/f1c 557722 0 2023-10-08T08:45:46.848 INFO:tasks.workunit.client.0.smithi070.stdout:9/344: write d1/dd/f61 [1290089,74122] 0 2023-10-08T08:45:46.849 INFO:tasks.workunit.client.0.smithi070.stdout:1/645: creat d6/dc/fd6 x:0 0 0 2023-10-08T08:45:46.855 INFO:tasks.workunit.client.0.smithi070.stdout:6/444: dread df/d11/f47 [0,4194304] 0 2023-10-08T08:45:46.856 INFO:tasks.workunit.client.0.smithi070.stdout:1/646: dread d6/dc/d14/d1f/d63/db3/d38/d4b/fab [0,4194304] 0 2023-10-08T08:45:46.857 INFO:tasks.workunit.client.0.smithi070.stdout:6/445: rename df/d26/f6a to df/d26/d42/f96 0 2023-10-08T08:45:46.858 INFO:tasks.workunit.client.0.smithi070.stdout:6/446: chown df/d11/f40 337008 1 2023-10-08T08:45:46.858 INFO:tasks.workunit.client.0.smithi070.stdout:6/447: stat df/d26/d42/d43/d4a/c7c 0 2023-10-08T08:45:46.859 INFO:tasks.workunit.client.0.smithi070.stdout:1/647: rename d6/dc/d14/d1f/d63/db3/d38/d4b/l76 to d6/dc/d14/dc1/ld7 0 2023-10-08T08:45:46.859 INFO:tasks.workunit.client.0.smithi070.stdout:1/648: chown d6/dc/d14/d1f/d63/db3/l2e 167674 1 2023-10-08T08:45:46.859 INFO:tasks.workunit.client.0.smithi070.stdout:1/649: stat d6/dc/d14/d1f/d63/db3/f57 0 2023-10-08T08:45:46.860 INFO:tasks.workunit.client.0.smithi070.stdout:1/650: mknod d6/dc/cd8 0 2023-10-08T08:45:46.861 INFO:tasks.workunit.client.0.smithi070.stdout:1/651: creat d6/dc/d14/dc1/dca/fd9 x:0 0 0 2023-10-08T08:45:46.862 INFO:tasks.workunit.client.0.smithi070.stdout:1/652: write d6/dc/d14/f5c [5169951,35314] 0 2023-10-08T08:45:46.863 INFO:tasks.workunit.client.0.smithi070.stdout:1/653: read d6/dc/d14/d1f/f3d [2085029,87893] 0 2023-10-08T08:45:46.877 INFO:tasks.workunit.client.0.smithi070.stdout:9/345: dwrite d1/f4b [0,4194304] 0 2023-10-08T08:45:46.878 INFO:tasks.workunit.client.0.smithi070.stdout:9/346: symlink d1/dd/d26/d27/d2d/l64 0 2023-10-08T08:45:46.880 INFO:tasks.workunit.client.0.smithi070.stdout:9/347: creat d1/dd/d26/d27/f65 x:0 0 0 2023-10-08T08:45:46.880 INFO:tasks.workunit.client.0.smithi070.stdout:9/348: stat d1/f55 0 2023-10-08T08:45:46.894 INFO:tasks.workunit.client.0.smithi070.stdout:6/448: dwrite df/d26/d42/d43/d4a/f68 [0,4194304] 0 2023-10-08T08:45:46.901 INFO:tasks.workunit.client.0.smithi070.stdout:9/349: dwrite d1/dd/d26/d27/d2d/f41 [0,4194304] 0 2023-10-08T08:45:46.902 INFO:tasks.workunit.client.0.smithi070.stdout:9/350: truncate d1/dd/fa 586930 0 2023-10-08T08:45:46.903 INFO:tasks.workunit.client.0.smithi070.stdout:9/351: mkdir d1/dd/d39/d66 0 2023-10-08T08:45:46.903 INFO:tasks.workunit.client.0.smithi070.stdout:9/352: readlink d1/dd/d26/d5d/l5f 0 2023-10-08T08:45:46.903 INFO:tasks.workunit.client.0.smithi070.stdout:9/353: write d1/dd/f11 [5193542,34433] 0 2023-10-08T08:45:46.904 INFO:tasks.workunit.client.0.smithi070.stdout:9/354: creat d1/dd/d19/f67 x:0 0 0 2023-10-08T08:45:46.905 INFO:tasks.workunit.client.0.smithi070.stdout:9/355: mknod d1/dd/d19/c68 0 2023-10-08T08:45:46.906 INFO:tasks.workunit.client.0.smithi070.stdout:9/356: dread - d1/dd/d19/d38/d4f/f59 zero size 2023-10-08T08:45:46.906 INFO:tasks.workunit.client.0.smithi070.stdout:9/357: fdatasync d1/dd/d26/f54 0 2023-10-08T08:45:46.908 INFO:tasks.workunit.client.0.smithi070.stdout:6/449: dread df/d11/f4d [0,4194304] 0 2023-10-08T08:45:46.910 INFO:tasks.workunit.client.0.smithi070.stdout:9/358: getdents d1/dd/d39 0 2023-10-08T08:45:46.920 INFO:tasks.workunit.client.0.smithi070.stdout:9/359: write d1/dd/d19/d38/f42 [3255239,88660] 0 2023-10-08T08:45:46.920 INFO:tasks.workunit.client.0.smithi070.stdout:9/360: write d1/dd/d19/d38/d4f/f59 [618540,99587] 0 2023-10-08T08:45:46.920 INFO:tasks.workunit.client.0.smithi070.stdout:9/361: read - d1/f55 zero size 2023-10-08T08:45:46.920 INFO:tasks.workunit.client.0.smithi070.stdout:9/362: chown d1/dd/d1a/f62 13 1 2023-10-08T08:45:46.923 INFO:tasks.workunit.client.0.smithi070.stdout:9/363: rename d1/dd/d19/d38/c5b to d1/dd/c69 0 2023-10-08T08:45:46.924 INFO:tasks.workunit.client.0.smithi070.stdout:9/364: read d1/dd/f61 [762480,6730] 0 2023-10-08T08:45:46.925 INFO:tasks.workunit.client.0.smithi070.stdout:9/365: mknod d1/dd/d1a/c6a 0 2023-10-08T08:45:46.927 INFO:tasks.workunit.client.0.smithi070.stdout:9/366: symlink d1/dd/d1a/l6b 0 2023-10-08T08:45:46.930 INFO:tasks.workunit.client.0.smithi070.stdout:6/450: dwrite df/d26/f63 [0,4194304] 0 2023-10-08T08:45:46.933 INFO:tasks.workunit.client.0.smithi070.stdout:6/451: mkdir df/d26/d42/d43/d4a/d97 0 2023-10-08T08:45:46.933 INFO:tasks.workunit.client.0.smithi070.stdout:6/452: chown df/d26/d42/d43/c69 295402746 1 2023-10-08T08:45:46.934 INFO:tasks.workunit.client.0.smithi070.stdout:6/453: write df/d26/d42/f96 [4164107,40498] 0 2023-10-08T08:45:46.935 INFO:tasks.workunit.client.0.smithi070.stdout:6/454: creat df/d26/d42/d43/d4a/d75/d7e/f98 x:0 0 0 2023-10-08T08:45:46.936 INFO:tasks.workunit.client.0.smithi070.stdout:9/367: dread d1/f2a [0,4194304] 0 2023-10-08T08:45:46.937 INFO:tasks.workunit.client.0.smithi070.stdout:6/455: creat df/d26/d42/d4b/d80/d94/f99 x:0 0 0 2023-10-08T08:45:46.954 INFO:tasks.workunit.client.0.smithi070.stdout:9/368: dread d1/dd/d19/f4a [0,4194304] 0 2023-10-08T08:45:46.955 INFO:tasks.workunit.client.0.smithi070.stdout:9/369: truncate d1/dd/d1a/f1d 1495758 0 2023-10-08T08:45:46.956 INFO:tasks.workunit.client.0.smithi070.stdout:6/456: dwrite f7 [0,4194304] 0 2023-10-08T08:45:46.957 INFO:tasks.workunit.client.0.smithi070.stdout:9/370: write d1/f2a [3494766,122532] 0 2023-10-08T08:45:46.958 INFO:tasks.workunit.client.0.smithi070.stdout:6/457: dread df/f1b [0,4194304] 0 2023-10-08T08:45:46.958 INFO:tasks.workunit.client.0.smithi070.stdout:6/458: truncate df/d26/d42/d4b/f5b 718986 0 2023-10-08T08:45:46.959 INFO:tasks.workunit.client.0.smithi070.stdout:6/459: fsync df/d26/d42/d43/d4a/f4f 0 2023-10-08T08:45:46.960 INFO:tasks.workunit.client.0.smithi070.stdout:6/460: creat df/d26/d42/d43/d4a/f9a x:0 0 0 2023-10-08T08:45:46.960 INFO:tasks.workunit.client.0.smithi070.stdout:9/371: mknod d1/c6c 0 2023-10-08T08:45:46.960 INFO:tasks.workunit.client.0.smithi070.stdout:9/372: truncate d1/f55 1020 0 2023-10-08T08:45:46.962 INFO:tasks.workunit.client.0.smithi070.stdout:9/373: creat d1/dd/d39/d66/f6d x:0 0 0 2023-10-08T08:45:46.962 INFO:tasks.workunit.client.0.smithi070.stdout:9/374: dread - d1/dd/d26/d27/f60 zero size 2023-10-08T08:45:46.962 INFO:tasks.workunit.client.0.smithi070.stdout:9/375: fdatasync d1/dd/d19/d38/f3c 0 2023-10-08T08:45:46.962 INFO:tasks.workunit.client.0.smithi070.stdout:9/376: truncate d1/dd/d26/d27/f60 627712 0 2023-10-08T08:45:46.964 INFO:tasks.workunit.client.0.smithi070.stdout:9/377: symlink d1/dd/d39/d66/l6e 0 2023-10-08T08:45:46.971 INFO:tasks.workunit.client.0.smithi070.stdout:9/378: dread d1/dd/f18 [0,4194304] 0 2023-10-08T08:45:46.973 INFO:tasks.workunit.client.0.smithi070.stdout:9/379: unlink d1/dd/d1a/l45 0 2023-10-08T08:45:46.973 INFO:tasks.workunit.client.0.smithi070.stdout:9/380: write d1/dd/d1a/d40/f4e [394441,101159] 0 2023-10-08T08:45:46.973 INFO:tasks.workunit.client.0.smithi070.stdout:9/381: write d1/dd/d1a/d40/f4e [1429780,55954] 0 2023-10-08T08:45:46.980 INFO:tasks.workunit.client.0.smithi070.stdout:6/461: dwrite f2 [0,4194304] 0 2023-10-08T08:45:46.998 INFO:tasks.workunit.client.0.smithi070.stdout:9/382: dwrite d1/dd/f61 [0,4194304] 0 2023-10-08T08:45:46.998 INFO:tasks.workunit.client.0.smithi070.stdout:9/383: fsync d1/fb 0 2023-10-08T08:45:47.004 INFO:tasks.workunit.client.0.smithi070.stdout:6/462: dwrite df/f1b [0,4194304] 0 2023-10-08T08:45:47.004 INFO:tasks.workunit.client.0.smithi070.stdout:6/463: truncate df/d11/f40 572295 0 2023-10-08T08:45:47.006 INFO:tasks.workunit.client.0.smithi070.stdout:6/464: creat df/d26/d42/d43/d4a/d75/f9b x:0 0 0 2023-10-08T08:45:47.019 INFO:tasks.workunit.client.0.smithi070.stdout:9/384: dwrite d1/dd/d26/d27/d2d/f2f [4194304,4194304] 0 2023-10-08T08:45:47.021 INFO:tasks.workunit.client.0.smithi070.stdout:9/385: mkdir d1/dd/d39/d6f 0 2023-10-08T08:45:47.039 INFO:tasks.workunit.client.0.smithi070.stdout:9/386: dwrite d1/dd/d26/d27/f44 [0,4194304] 0 2023-10-08T08:45:47.043 INFO:tasks.workunit.client.0.smithi070.stdout:9/387: rmdir d1/dd/d19 39 2023-10-08T08:45:47.043 INFO:tasks.workunit.client.0.smithi070.stdout:9/388: fsync d1/dd/d26/f54 0 2023-10-08T08:45:47.045 INFO:tasks.workunit.client.0.smithi070.stdout:9/389: mkdir d1/dd/d26/d27/d2d/d70 0 2023-10-08T08:45:47.048 INFO:tasks.workunit.client.0.smithi070.stdout:9/390: dread d1/dd/d1a/f1c [0,4194304] 0 2023-10-08T08:45:47.049 INFO:tasks.workunit.client.0.smithi070.stdout:9/391: write d1/dd/d26/d27/f36 [1802540,30630] 0 2023-10-08T08:45:47.050 INFO:tasks.workunit.client.0.smithi070.stdout:9/392: read - d1/dd/d39/d66/f6d zero size 2023-10-08T08:45:48.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:48 smithi105 ceph-mon[103798]: pgmap v351: 129 pgs: 129 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 MiB/s rd, 56 MiB/s wr, 613 op/s 2023-10-08T08:45:48.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:48 smithi191 ceph-mon[104220]: pgmap v351: 129 pgs: 129 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 MiB/s rd, 56 MiB/s wr, 613 op/s 2023-10-08T08:45:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:48 smithi070 ceph-mon[99513]: pgmap v351: 129 pgs: 129 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 MiB/s rd, 56 MiB/s wr, 613 op/s 2023-10-08T08:45:50.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:50 smithi105 ceph-mon[103798]: pgmap v352: 129 pgs: 129 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 36 MiB/s wr, 147 op/s 2023-10-08T08:45:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:50 smithi191 ceph-mon[104220]: pgmap v352: 129 pgs: 129 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 36 MiB/s wr, 147 op/s 2023-10-08T08:45:50.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:50 smithi070 ceph-mon[99513]: pgmap v352: 129 pgs: 129 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 36 MiB/s wr, 147 op/s 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:5/508: sync 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:8/590: sync 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:2/727: sync 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:3/641: sync 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:6/465: sync 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:7/569: sync 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:1/654: sync 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:6/466: readlink df/d26/d42/d43/d4a/l76 0 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:3/642: truncate d0/d12/d14/d1d/dba/fde 1509636 0 2023-10-08T08:45:50.980 INFO:tasks.workunit.client.0.smithi070.stdout:3/643: dread - d0/d12/d14/d5c/db1/fd0 zero size 2023-10-08T08:45:50.981 INFO:tasks.workunit.client.0.smithi070.stdout:7/570: write d3/d77/fb6 [346578,15923] 0 2023-10-08T08:45:50.981 INFO:tasks.workunit.client.0.smithi070.stdout:9/393: sync 2023-10-08T08:45:50.981 INFO:tasks.workunit.client.0.smithi070.stdout:4/354: sync 2023-10-08T08:45:50.981 INFO:tasks.workunit.client.0.smithi070.stdout:0/712: sync 2023-10-08T08:45:50.981 INFO:tasks.workunit.client.0.smithi070.stdout:4/355: link f9 dc/d17/d1f/d54/f72 0 2023-10-08T08:45:50.981 INFO:tasks.workunit.client.0.smithi070.stdout:4/356: readlink dc/d17/d24/d55/l5b 0 2023-10-08T08:45:50.982 INFO:tasks.workunit.client.0.smithi070.stdout:9/394: link d1/dd/d26/d27/f65 d1/dd/d19/d38/f71 0 2023-10-08T08:45:50.983 INFO:tasks.workunit.client.0.smithi070.stdout:8/591: getdents d1/d23 0 2023-10-08T08:45:50.983 INFO:tasks.workunit.client.0.smithi070.stdout:8/592: chown d1/de/d15/c9f 0 1 2023-10-08T08:45:50.983 INFO:tasks.workunit.client.0.smithi070.stdout:2/728: creat df/d12/d15/d54/db1/fea x:0 0 0 2023-10-08T08:45:50.984 INFO:tasks.workunit.client.0.smithi070.stdout:1/655: creat d6/dc/fda x:0 0 0 2023-10-08T08:45:50.985 INFO:tasks.workunit.client.0.smithi070.stdout:8/593: symlink d1/d2/d6/d22/d5c/lc9 0 2023-10-08T08:45:50.986 INFO:tasks.workunit.client.0.smithi070.stdout:7/571: rename d3/da9/d1e/d4c/f63 to d3/d19/d6d/fc3 0 2023-10-08T08:45:50.986 INFO:tasks.workunit.client.0.smithi070.stdout:3/644: write d0/d12/d8d/dcc/fdc [1548282,96935] 0 2023-10-08T08:45:50.988 INFO:tasks.workunit.client.0.smithi070.stdout:8/594: read d1/de/d15/f40 [1190809,97035] 0 2023-10-08T08:45:50.990 INFO:tasks.workunit.client.0.smithi070.stdout:3/645: stat d0/d12/d14/d5c/d5d/d75/d52/db5/dcb/de1/cd7 0 2023-10-08T08:45:50.990 INFO:tasks.workunit.client.0.smithi070.stdout:3/646: fdatasync d0/d12/d14/d48/f53 0 2023-10-08T08:45:50.992 INFO:tasks.workunit.client.0.smithi070.stdout:3/647: rmdir d0/d12/d8d 39 2023-10-08T08:45:50.993 INFO:tasks.workunit.client.0.smithi070.stdout:3/648: stat d0/l98 0 2023-10-08T08:45:50.993 INFO:tasks.workunit.client.0.smithi070.stdout:3/649: readlink d0/d12/l65 0 2023-10-08T08:45:50.995 INFO:tasks.workunit.client.0.smithi070.stdout:4/357: dread f9 [0,4194304] 0 2023-10-08T08:45:50.997 INFO:tasks.workunit.client.0.smithi070.stdout:3/650: symlink d0/d12/d14/d5c/d5d/da0/d86/leb 0 2023-10-08T08:45:50.998 INFO:tasks.workunit.client.0.smithi070.stdout:3/651: rename d0/d12/d14/d5c/d5d/d75/d52/db5/db6/f93 to d0/d12/d14/d5c/d5d/da0/d86/de8/fec 0 2023-10-08T08:45:51.001 INFO:tasks.workunit.client.0.smithi070.stdout:3/652: creat d0/d12/d14/d5c/d5d/d75/d52/db5/dcb/fed x:0 0 0 2023-10-08T08:45:51.002 INFO:tasks.workunit.client.0.smithi070.stdout:2/729: write df/d12/d15/d54/db1/d83/f88 [3246874,67617] 0 2023-10-08T08:45:51.002 INFO:tasks.workunit.client.0.smithi070.stdout:3/653: fsync d0/d12/d14/f1c 0 2023-10-08T08:45:51.002 INFO:tasks.workunit.client.0.smithi070.stdout:2/730: stat df/d12/d15/d54/db1/f8a 0 2023-10-08T08:45:51.004 INFO:tasks.workunit.client.0.smithi070.stdout:2/731: creat df/d12/d1b/d1c/d79/da4/feb x:0 0 0 2023-10-08T08:45:51.008 INFO:tasks.workunit.client.0.smithi070.stdout:3/654: creat d0/d12/d14/d1d/dba/fee x:0 0 0 2023-10-08T08:45:51.008 INFO:tasks.workunit.client.0.smithi070.stdout:6/467: dread df/d11/f4d [0,4194304] 0 2023-10-08T08:45:51.008 INFO:tasks.workunit.client.0.smithi070.stdout:2/732: getdents df/d3a/d77 0 2023-10-08T08:45:51.009 INFO:tasks.workunit.client.0.smithi070.stdout:6/468: creat df/d11/d1d/f9c x:0 0 0 2023-10-08T08:45:51.010 INFO:tasks.workunit.client.0.smithi070.stdout:2/733: mknod df/d3a/db6/cec 0 2023-10-08T08:45:51.010 INFO:tasks.workunit.client.0.smithi070.stdout:0/713: dwrite d1/d14/f35 [0,4194304] 0 2023-10-08T08:45:51.013 INFO:tasks.workunit.client.0.smithi070.stdout:6/469: truncate df/d26/d42/d43/d4a/f4f 4016234 0 2023-10-08T08:45:51.013 INFO:tasks.workunit.client.0.smithi070.stdout:0/714: mknod d1/d14/d1f/ce3 0 2023-10-08T08:45:51.013 INFO:tasks.workunit.client.0.smithi070.stdout:0/715: chown d1/dd/c37 57937 1 2023-10-08T08:45:51.014 INFO:tasks.workunit.client.0.smithi070.stdout:6/470: link df/d11/l2a df/d26/d42/d43/d4a/d97/l9d 0 2023-10-08T08:45:51.015 INFO:tasks.workunit.client.0.smithi070.stdout:6/471: mknod df/d26/d42/d55/c9e 0 2023-10-08T08:45:51.017 INFO:tasks.workunit.client.0.smithi070.stdout:6/472: getdents df/d26/d42/d43/d4a/d75/d7e 0 2023-10-08T08:45:51.017 INFO:tasks.workunit.client.0.smithi070.stdout:6/473: chown df/d26/d42/d4b/c6c 30063470 1 2023-10-08T08:45:51.018 INFO:tasks.workunit.client.0.smithi070.stdout:4/358: write dc/f4b [1208486,73008] 0 2023-10-08T08:45:51.018 INFO:tasks.workunit.client.0.smithi070.stdout:7/572: write d3/d77/fb6 [261726,64737] 0 2023-10-08T08:45:51.018 INFO:tasks.workunit.client.0.smithi070.stdout:9/395: dwrite d1/dd/f61 [0,4194304] 0 2023-10-08T08:45:51.020 INFO:tasks.workunit.client.0.smithi070.stdout:4/359: rename dc/f61 to dc/d17/d24/f73 0 2023-10-08T08:45:51.020 INFO:tasks.workunit.client.0.smithi070.stdout:9/396: truncate d1/dd/d19/d38/f5a 4044646 0 2023-10-08T08:45:51.021 INFO:tasks.workunit.client.0.smithi070.stdout:1/656: dwrite d6/dc/d14/d1f/d75/d7e/f87 [0,4194304] 0 2023-10-08T08:45:51.021 INFO:tasks.workunit.client.0.smithi070.stdout:1/657: fsync d6/dc/d14/d1f/d75/f5a 0 2023-10-08T08:45:51.022 INFO:tasks.workunit.client.0.smithi070.stdout:5/509: dwrite d5/d5f/d61/d30/f14 [0,4194304] 0 2023-10-08T08:45:51.022 INFO:tasks.workunit.client.0.smithi070.stdout:4/360: mknod dc/d5a/c74 0 2023-10-08T08:45:51.022 INFO:tasks.workunit.client.0.smithi070.stdout:9/397: write d1/dd/d26/d27/d2d/f41 [2554984,8043] 0 2023-10-08T08:45:51.023 INFO:tasks.workunit.client.0.smithi070.stdout:7/573: rename d3/da9/d4a/d9/la6 to d3/da9/d4a/d9/da4/lc4 0 2023-10-08T08:45:51.025 INFO:tasks.workunit.client.0.smithi070.stdout:4/361: creat dc/d17/d24/d37/f75 x:0 0 0 2023-10-08T08:45:51.028 INFO:tasks.workunit.client.0.smithi070.stdout:4/362: creat dc/d17/d24/d4c/d4e/f76 x:0 0 0 2023-10-08T08:45:51.030 INFO:tasks.workunit.client.0.smithi070.stdout:9/398: fdatasync d1/dd/d26/d27/d2d/f41 0 2023-10-08T08:45:51.030 INFO:tasks.workunit.client.0.smithi070.stdout:4/363: symlink dc/d17/d1f/d54/l77 0 2023-10-08T08:45:51.032 INFO:tasks.workunit.client.0.smithi070.stdout:9/399: truncate d1/dd/d1a/f1c 985385 0 2023-10-08T08:45:51.033 INFO:tasks.workunit.client.0.smithi070.stdout:5/510: write d5/da/d22/f32 [689641,11292] 0 2023-10-08T08:45:51.033 INFO:tasks.workunit.client.0.smithi070.stdout:4/364: mknod dc/d17/d24/d37/c78 0 2023-10-08T08:45:51.035 INFO:tasks.workunit.client.0.smithi070.stdout:4/365: mkdir dc/d17/d79 0 2023-10-08T08:45:51.036 INFO:tasks.workunit.client.0.smithi070.stdout:4/366: mknod dc/d17/d24/d4c/c7a 0 2023-10-08T08:45:51.038 INFO:tasks.workunit.client.0.smithi070.stdout:2/734: dwrite df/d12/d1b/d1c/fe0 [0,4194304] 0 2023-10-08T08:45:51.038 INFO:tasks.workunit.client.0.smithi070.stdout:7/574: dread d3/da9/d4a/f8e [0,4194304] 0 2023-10-08T08:45:51.041 INFO:tasks.workunit.client.0.smithi070.stdout:0/716: dread d1/d62/d54/d5e/d80/d8a/dc8/f34 [0,4194304] 0 2023-10-08T08:45:51.042 INFO:tasks.workunit.client.0.smithi070.stdout:6/474: dread df/d11/f1a [0,4194304] 0 2023-10-08T08:45:51.042 INFO:tasks.workunit.client.0.smithi070.stdout:6/475: dread - df/f61 zero size 2023-10-08T08:45:51.043 INFO:tasks.workunit.client.0.smithi070.stdout:4/367: unlink dc/f11 0 2023-10-08T08:45:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:4/368: write dc/d17/d24/d55/f66 [1215282,128329] 0 2023-10-08T08:45:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:4/369: write dc/f48 [1904087,130081] 0 2023-10-08T08:45:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:4/370: chown dc/d17/l2c 10530820 1 2023-10-08T08:45:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:4/371: chown dc/d17/f27 11 1 2023-10-08T08:45:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:6/476: read df/f1c [1358523,15755] 0 2023-10-08T08:45:51.045 INFO:tasks.workunit.client.0.smithi070.stdout:0/717: link d1/d62/cdc d1/d1d/d4d/d9d/ce4 0 2023-10-08T08:45:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:0/718: mkdir d1/d14/de5 0 2023-10-08T08:45:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:1/658: dread d6/dc/d14/d1f/d63/db3/d38/f4a [0,4194304] 0 2023-10-08T08:45:51.055 INFO:tasks.workunit.client.0.smithi070.stdout:6/477: dread df/d11/d1d/f3c [0,4194304] 0 2023-10-08T08:45:51.056 INFO:tasks.workunit.client.0.smithi070.stdout:6/478: fdatasync df/d71/f8c 0 2023-10-08T08:45:51.056 INFO:tasks.workunit.client.0.smithi070.stdout:6/479: write df/d53/f5a [436006,34996] 0 2023-10-08T08:45:51.056 INFO:tasks.workunit.client.0.smithi070.stdout:6/480: write df/d26/d42/d43/d4a/f85 [378514,659] 0 2023-10-08T08:45:51.063 INFO:tasks.workunit.client.0.smithi070.stdout:5/511: dwrite d5/f7c [4194304,4194304] 0 2023-10-08T08:45:51.066 INFO:tasks.workunit.client.0.smithi070.stdout:5/512: symlink d5/da/d22/d75/la9 0 2023-10-08T08:45:51.066 INFO:tasks.workunit.client.0.smithi070.stdout:5/513: write d5/d5f/d63/d8b/d8f/f96 [5092485,322] 0 2023-10-08T08:45:51.066 INFO:tasks.workunit.client.0.smithi070.stdout:5/514: chown d5/da/f16 131648341 1 2023-10-08T08:45:51.067 INFO:tasks.workunit.client.0.smithi070.stdout:4/372: write dc/f51 [518824,26331] 0 2023-10-08T08:45:51.067 INFO:tasks.workunit.client.0.smithi070.stdout:5/515: symlink d5/d5f/d61/laa 0 2023-10-08T08:45:51.068 INFO:tasks.workunit.client.0.smithi070.stdout:5/516: mkdir d5/d5f/d61/d30/d54/dab 0 2023-10-08T08:45:51.068 INFO:tasks.workunit.client.0.smithi070.stdout:4/373: mknod dc/c7b 0 2023-10-08T08:45:51.068 INFO:tasks.workunit.client.0.smithi070.stdout:9/400: dread d1/dd/d19/d38/f5a [0,4194304] 0 2023-10-08T08:45:51.069 INFO:tasks.workunit.client.0.smithi070.stdout:4/374: fdatasync dc/d17/d1f/d5e/f6f 0 2023-10-08T08:45:51.070 INFO:tasks.workunit.client.0.smithi070.stdout:9/401: unlink d1/dd/d39/l3b 0 2023-10-08T08:45:51.070 INFO:tasks.workunit.client.0.smithi070.stdout:7/575: dwrite d3/d77/f91 [0,4194304] 0 2023-10-08T08:45:51.070 INFO:tasks.workunit.client.0.smithi070.stdout:4/375: unlink dc/d17/d24/d55/l59 0 2023-10-08T08:45:51.071 INFO:tasks.workunit.client.0.smithi070.stdout:4/376: symlink dc/d17/d24/d4c/l7c 0 2023-10-08T08:45:51.072 INFO:tasks.workunit.client.0.smithi070.stdout:9/402: rename d1/dd/d19/d38/d4f/c57 to d1/dd/d26/d27/d2d/d70/c72 0 2023-10-08T08:45:51.072 INFO:tasks.workunit.client.0.smithi070.stdout:4/377: mknod dc/d5f/c7d 0 2023-10-08T08:45:51.075 INFO:tasks.workunit.client.0.smithi070.stdout:7/576: mkdir d3/da9/d4a/d50/d9f/dc5 0 2023-10-08T08:45:51.118 INFO:tasks.workunit.client.0.smithi070.stdout:0/719: dwrite d1/d14/fd9 [0,4194304] 0 2023-10-08T08:45:51.124 INFO:tasks.workunit.client.0.smithi070.stdout:0/720: unlink d1/d62/lb2 0 2023-10-08T08:45:51.135 INFO:tasks.workunit.client.0.smithi070.stdout:5/517: dread d5/da/d22/f52 [0,4194304] 0 2023-10-08T08:45:51.135 INFO:tasks.workunit.client.0.smithi070.stdout:5/518: getdents d5/d5f/d61/d30/d54/dab 0 2023-10-08T08:45:51.136 INFO:tasks.workunit.client.0.smithi070.stdout:4/378: dwrite dc/d17/f21 [0,4194304] 0 2023-10-08T08:45:51.136 INFO:tasks.workunit.client.0.smithi070.stdout:9/403: dread d1/dd/d26/d27/f36 [0,4194304] 0 2023-10-08T08:45:51.137 INFO:tasks.workunit.client.0.smithi070.stdout:4/379: chown dc/d17/d1f/d54/c6a 23 1 2023-10-08T08:45:51.139 INFO:tasks.workunit.client.0.smithi070.stdout:9/404: symlink d1/dd/d19/d38/d56/l73 0 2023-10-08T08:45:51.139 INFO:tasks.workunit.client.0.smithi070.stdout:7/577: dwrite d3/da9/d1e/fab [0,4194304] 0 2023-10-08T08:45:51.140 INFO:tasks.workunit.client.0.smithi070.stdout:5/519: mkdir d5/d5f/d63/d8b/da8/dac 0 2023-10-08T08:45:51.141 INFO:tasks.workunit.client.0.smithi070.stdout:6/481: dwrite f7 [0,4194304] 0 2023-10-08T08:45:51.142 INFO:tasks.workunit.client.0.smithi070.stdout:6/482: read - df/d26/d42/d4b/d80/d94/f99 zero size 2023-10-08T08:45:51.142 INFO:tasks.workunit.client.0.smithi070.stdout:5/520: creat d5/da/d4d/fad x:0 0 0 2023-10-08T08:45:51.145 INFO:tasks.workunit.client.0.smithi070.stdout:1/659: dwrite d6/dc/d14/d1f/f2b [0,4194304] 0 2023-10-08T08:45:51.145 INFO:tasks.workunit.client.0.smithi070.stdout:7/578: mknod d3/d19/d1a/cc6 0 2023-10-08T08:45:51.145 INFO:tasks.workunit.client.0.smithi070.stdout:4/380: read dc/d17/d24/d37/f3b [1388576,81869] 0 2023-10-08T08:45:51.147 INFO:tasks.workunit.client.0.smithi070.stdout:4/381: write dc/d17/d1f/f29 [4776105,128746] 0 2023-10-08T08:45:51.147 INFO:tasks.workunit.client.0.smithi070.stdout:7/579: truncate d3/f2e 3077967 0 2023-10-08T08:45:51.148 INFO:tasks.workunit.client.0.smithi070.stdout:4/382: truncate dc/f46 301348 0 2023-10-08T08:45:51.179 INFO:tasks.workunit.client.0.smithi070.stdout:4/383: truncate dc/f48 1599932 0 2023-10-08T08:45:51.180 INFO:tasks.workunit.client.0.smithi070.stdout:5/521: dread d5/da/f16 [4194304,4194304] 0 2023-10-08T08:45:51.180 INFO:tasks.workunit.client.0.smithi070.stdout:7/580: read d3/d19/d1a/f4b [614779,83961] 0 2023-10-08T08:45:51.181 INFO:tasks.workunit.client.0.smithi070.stdout:0/721: dwrite d1/dd/f53 [0,4194304] 0 2023-10-08T08:45:51.182 INFO:tasks.workunit.client.0.smithi070.stdout:5/522: mkdir d5/d5f/d61/d30/d54/d62/dae 0 2023-10-08T08:45:51.183 INFO:tasks.workunit.client.0.smithi070.stdout:7/581: symlink d3/da9/d4a/lc7 0 2023-10-08T08:45:51.184 INFO:tasks.workunit.client.0.smithi070.stdout:7/582: chown d3/d19/d6d 62461 1 2023-10-08T08:45:51.184 INFO:tasks.workunit.client.0.smithi070.stdout:7/583: chown d3/da9/d1e/d4c/l5e 36 1 2023-10-08T08:45:51.187 INFO:tasks.workunit.client.0.smithi070.stdout:0/722: rmdir d1/d62/d54/d5e/d80/d8a/dd6 0 2023-10-08T08:45:51.187 INFO:tasks.workunit.client.0.smithi070.stdout:9/405: dwrite d1/f25 [4194304,4194304] 0 2023-10-08T08:45:51.187 INFO:tasks.workunit.client.0.smithi070.stdout:6/483: dwrite df/d26/d42/d43/f86 [0,4194304] 0 2023-10-08T08:45:51.187 INFO:tasks.workunit.client.0.smithi070.stdout:7/584: mkdir d3/d19/d95/da3/dc8 0 2023-10-08T08:45:51.190 INFO:tasks.workunit.client.0.smithi070.stdout:9/406: link d1/dd/d1a/d40/f4e d1/f74 0 2023-10-08T08:45:51.193 INFO:tasks.workunit.client.0.smithi070.stdout:6/484: creat df/d26/f9f x:0 0 0 2023-10-08T08:45:51.193 INFO:tasks.workunit.client.0.smithi070.stdout:7/585: mknod d3/da9/d4a/d9/da4/cc9 0 2023-10-08T08:45:51.193 INFO:tasks.workunit.client.0.smithi070.stdout:6/485: fsync df/f61 0 2023-10-08T08:45:51.197 INFO:tasks.workunit.client.0.smithi070.stdout:0/723: write d1/d1d/d24/f71 [859128,63450] 0 2023-10-08T08:45:51.198 INFO:tasks.workunit.client.0.smithi070.stdout:0/724: truncate d1/d62/d54/d5e/fb0 61536 0 2023-10-08T08:45:51.198 INFO:tasks.workunit.client.0.smithi070.stdout:0/725: getdents d1/d76/dd5 0 2023-10-08T08:45:51.198 INFO:tasks.workunit.client.0.smithi070.stdout:0/726: read d1/dd/f53 [5215160,28914] 0 2023-10-08T08:45:51.198 INFO:tasks.workunit.client.0.smithi070.stdout:0/727: stat d1/d62/d54/d5e/c91 0 2023-10-08T08:45:51.202 INFO:tasks.workunit.client.0.smithi070.stdout:0/728: rename d1/lca to d1/d1d/d4d/d9d/le6 0 2023-10-08T08:45:51.202 INFO:tasks.workunit.client.0.smithi070.stdout:0/729: fsync d1/d14/d1f/fad 0 2023-10-08T08:45:51.207 INFO:tasks.workunit.client.0.smithi070.stdout:4/384: dwrite dc/d17/d24/f73 [0,4194304] 0 2023-10-08T08:45:51.210 INFO:tasks.workunit.client.0.smithi070.stdout:4/385: write dc/f50 [3601798,112458] 0 2023-10-08T08:45:51.211 INFO:tasks.workunit.client.0.smithi070.stdout:5/523: dwrite d5/da/d4d/d37/d38/fa2 [0,4194304] 0 2023-10-08T08:45:51.214 INFO:tasks.workunit.client.0.smithi070.stdout:5/524: creat d5/faf x:0 0 0 2023-10-08T08:45:51.214 INFO:tasks.workunit.client.0.smithi070.stdout:6/486: dwrite df/d26/d42/d4b/d80/d94/f99 [0,4194304] 0 2023-10-08T08:45:51.214 INFO:tasks.workunit.client.0.smithi070.stdout:6/487: write df/d26/f88 [757347,51588] 0 2023-10-08T08:45:51.214 INFO:tasks.workunit.client.0.smithi070.stdout:6/488: stat df/f1c 0 2023-10-08T08:45:51.215 INFO:tasks.workunit.client.0.smithi070.stdout:5/525: creat d5/d5f/d61/d30/d54/d62/dae/fb0 x:0 0 0 2023-10-08T08:45:51.218 INFO:tasks.workunit.client.0.smithi070.stdout:5/526: write d5/da/d4d/d37/d38/fa2 [339099,45291] 0 2023-10-08T08:45:51.220 INFO:tasks.workunit.client.0.smithi070.stdout:5/527: creat d5/da/d4d/d37/d38/d55/fb1 x:0 0 0 2023-10-08T08:45:51.221 INFO:tasks.workunit.client.0.smithi070.stdout:5/528: truncate d5/d5f/d61/d30/d83/f8c 654105 0 2023-10-08T08:45:51.222 INFO:tasks.workunit.client.0.smithi070.stdout:5/529: chown d5/da/d4d/d37/d38/f6a 198481 1 2023-10-08T08:45:51.222 INFO:tasks.workunit.client.0.smithi070.stdout:0/730: dread d1/d1d/d4d/d9d/f6a [0,4194304] 0 2023-10-08T08:45:51.222 INFO:tasks.workunit.client.0.smithi070.stdout:0/731: readlink d1/d1d/l9a 0 2023-10-08T08:45:51.223 INFO:tasks.workunit.client.0.smithi070.stdout:0/732: rmdir d1/d62/d54/d5e/d80/d8a/dc3 39 2023-10-08T08:45:51.224 INFO:tasks.workunit.client.0.smithi070.stdout:5/530: unlink d5/d5f/l7e 0 2023-10-08T08:45:51.226 INFO:tasks.workunit.client.0.smithi070.stdout:5/531: symlink d5/d5f/d63/d8b/d8f/lb2 0 2023-10-08T08:45:51.226 INFO:tasks.workunit.client.0.smithi070.stdout:5/532: dread - d5/da/d4d/d37/d2a/f95 zero size 2023-10-08T08:45:51.227 INFO:tasks.workunit.client.0.smithi070.stdout:5/533: symlink d5/d5f/d61/d30/d54/d62/dae/lb3 0 2023-10-08T08:45:51.232 INFO:tasks.workunit.client.0.smithi070.stdout:4/386: dwrite dc/d17/d1f/f26 [0,4194304] 0 2023-10-08T08:45:51.233 INFO:tasks.workunit.client.0.smithi070.stdout:4/387: fdatasync dc/d17/d24/d4c/f60 0 2023-10-08T08:45:51.233 INFO:tasks.workunit.client.0.smithi070.stdout:4/388: stat dc/d17 0 2023-10-08T08:45:51.233 INFO:tasks.workunit.client.0.smithi070.stdout:7/586: dread d3/da9/d4a/d9/f48 [0,4194304] 0 2023-10-08T08:45:51.235 INFO:tasks.workunit.client.0.smithi070.stdout:4/389: mknod dc/d17/d24/d4c/d4e/c7e 0 2023-10-08T08:45:51.237 INFO:tasks.workunit.client.0.smithi070.stdout:4/390: symlink dc/d17/d79/l7f 0 2023-10-08T08:45:51.237 INFO:tasks.workunit.client.0.smithi070.stdout:4/391: stat dc/d17/d24/d4c/d4e/f57 0 2023-10-08T08:45:51.237 INFO:tasks.workunit.client.0.smithi070.stdout:4/392: write dc/d17/d1f/f43 [766066,63824] 0 2023-10-08T08:45:51.245 INFO:tasks.workunit.client.0.smithi070.stdout:7/587: rmdir d3 39 2023-10-08T08:45:51.246 INFO:tasks.workunit.client.0.smithi070.stdout:0/733: dwrite d1/d1d/d4d/d9d/f6a [0,4194304] 0 2023-10-08T08:45:51.248 INFO:tasks.workunit.client.0.smithi070.stdout:0/734: rename d1/dd/l5d to d1/d62/d54/d5e/d80/d8a/dc3/le7 0 2023-10-08T08:45:51.249 INFO:tasks.workunit.client.0.smithi070.stdout:4/393: write dc/f46 [89069,88794] 0 2023-10-08T08:45:51.249 INFO:tasks.workunit.client.0.smithi070.stdout:4/394: readlink dc/d5a/l65 0 2023-10-08T08:45:51.249 INFO:tasks.workunit.client.0.smithi070.stdout:4/395: chown dc/f1e 110 1 2023-10-08T08:45:51.250 INFO:tasks.workunit.client.0.smithi070.stdout:5/534: dwrite d5/d5f/d63/d8b/d8f/f96 [4194304,4194304] 0 2023-10-08T08:45:51.250 INFO:tasks.workunit.client.0.smithi070.stdout:4/396: truncate dc/f51 1513078 0 2023-10-08T08:45:51.251 INFO:tasks.workunit.client.0.smithi070.stdout:4/397: truncate dc/d17/d1f/f26 733918 0 2023-10-08T08:45:51.252 INFO:tasks.workunit.client.0.smithi070.stdout:4/398: readlink dc/d17/l2c 0 2023-10-08T08:45:51.252 INFO:tasks.workunit.client.0.smithi070.stdout:5/535: mkdir d5/d5f/db4 0 2023-10-08T08:45:51.253 INFO:tasks.workunit.client.0.smithi070.stdout:5/536: creat d5/d5f/d61/d30/d54/dab/fb5 x:0 0 0 2023-10-08T08:45:51.254 INFO:tasks.workunit.client.0.smithi070.stdout:4/399: fsync dc/f46 0 2023-10-08T08:45:51.255 INFO:tasks.workunit.client.0.smithi070.stdout:4/400: read - dc/f13 zero size 2023-10-08T08:45:51.256 INFO:tasks.workunit.client.0.smithi070.stdout:4/401: mknod dc/d17/d1f/d54/c80 0 2023-10-08T08:45:51.258 INFO:tasks.workunit.client.0.smithi070.stdout:4/402: getdents dc/d17/d24/d37 0 2023-10-08T08:45:51.260 INFO:tasks.workunit.client.0.smithi070.stdout:4/403: mknod dc/d17/d79/c81 0 2023-10-08T08:45:51.266 INFO:tasks.workunit.client.0.smithi070.stdout:4/404: unlink dc/d17/d24/d37/f75 0 2023-10-08T08:45:51.266 INFO:tasks.workunit.client.0.smithi070.stdout:4/405: chown dc/d17/d1f/d54/c6a 259599 1 2023-10-08T08:45:51.266 INFO:tasks.workunit.client.0.smithi070.stdout:4/406: stat dc/d17/d24/d4c/l7c 0 2023-10-08T08:45:51.267 INFO:tasks.workunit.client.0.smithi070.stdout:4/407: creat dc/d17/d24/d4c/d4e/f82 x:0 0 0 2023-10-08T08:45:51.268 INFO:tasks.workunit.client.0.smithi070.stdout:4/408: creat dc/d68/f83 x:0 0 0 2023-10-08T08:45:51.268 INFO:tasks.workunit.client.0.smithi070.stdout:4/409: dread - dc/d17/d24/d4c/f60 zero size 2023-10-08T08:45:51.269 INFO:tasks.workunit.client.0.smithi070.stdout:4/410: write dc/d17/d1f/d54/f72 [1978502,25989] 0 2023-10-08T08:45:51.269 INFO:tasks.workunit.client.0.smithi070.stdout:4/411: creat dc/d17/d1f/d5e/f84 x:0 0 0 2023-10-08T08:45:51.270 INFO:tasks.workunit.client.0.smithi070.stdout:5/537: dwrite d5/da/d4d/d37/d2a/f95 [0,4194304] 0 2023-10-08T08:45:51.270 INFO:tasks.workunit.client.0.smithi070.stdout:5/538: chown d5/d5f/d63/la0 14 1 2023-10-08T08:45:51.270 INFO:tasks.workunit.client.0.smithi070.stdout:5/539: fsync d5/d5f/d61/f60 0 2023-10-08T08:45:51.270 INFO:tasks.workunit.client.0.smithi070.stdout:4/412: mknod dc/d5a/c85 0 2023-10-08T08:45:51.272 INFO:tasks.workunit.client.0.smithi070.stdout:5/540: symlink d5/da/d4d/d37/d38/lb6 0 2023-10-08T08:45:51.272 INFO:tasks.workunit.client.0.smithi070.stdout:4/413: rename dc/d17/d24/d4c/l7c to dc/d17/d1f/d5e/l86 0 2023-10-08T08:45:51.273 INFO:tasks.workunit.client.0.smithi070.stdout:4/414: readlink dc/d17/d1f/l3d 0 2023-10-08T08:45:51.273 INFO:tasks.workunit.client.0.smithi070.stdout:4/415: truncate dc/d17/d24/d4c/f60 265368 0 2023-10-08T08:45:51.273 INFO:tasks.workunit.client.0.smithi070.stdout:4/416: fdatasync dc/d17/d24/d4c/d4e/f57 0 2023-10-08T08:45:51.273 INFO:tasks.workunit.client.0.smithi070.stdout:4/417: chown dc/d17/c44 786792 1 2023-10-08T08:45:51.276 INFO:tasks.workunit.client.0.smithi070.stdout:4/418: dread dc/d17/d24/d37/f53 [0,4194304] 0 2023-10-08T08:45:51.285 INFO:tasks.workunit.client.0.smithi070.stdout:5/541: dread d5/d5f/f78 [0,4194304] 0 2023-10-08T08:45:51.287 INFO:tasks.workunit.client.0.smithi070.stdout:5/542: symlink d5/lb7 0 2023-10-08T08:45:51.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/543: creat d5/d5f/d63/d8b/da8/dac/fb8 x:0 0 0 2023-10-08T08:45:51.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/544: fsync d5/f7c 0 2023-10-08T08:45:51.294 INFO:tasks.workunit.client.0.smithi070.stdout:4/419: dwrite dc/d17/d1f/f26 [0,4194304] 0 2023-10-08T08:45:51.309 INFO:tasks.workunit.client.0.smithi070.stdout:4/420: dwrite dc/d17/d24/f49 [0,4194304] 0 2023-10-08T08:45:51.312 INFO:tasks.workunit.client.0.smithi070.stdout:4/421: rename dc/d17/d24/d4c/d4e/f76 to dc/d17/d1f/d5e/f87 0 2023-10-08T08:45:51.360 INFO:tasks.workunit.client.0.smithi070.stdout:4/422: dwrite f9 [0,4194304] 0 2023-10-08T08:45:51.369 INFO:tasks.workunit.client.0.smithi070.stdout:8/595: sync 2023-10-08T08:45:51.369 INFO:tasks.workunit.client.0.smithi070.stdout:3/655: sync 2023-10-08T08:45:51.379 INFO:tasks.workunit.client.0.smithi070.stdout:8/596: dread d1/de/d15/f40 [0,4194304] 0 2023-10-08T08:45:51.380 INFO:tasks.workunit.client.0.smithi070.stdout:4/423: dwrite dc/d17/d24/f49 [0,4194304] 0 2023-10-08T08:45:51.381 INFO:tasks.workunit.client.0.smithi070.stdout:8/597: mkdir d1/de/dca 0 2023-10-08T08:45:51.385 INFO:tasks.workunit.client.0.smithi070.stdout:4/424: getdents dc/d17/d24/d37 0 2023-10-08T08:45:51.386 INFO:tasks.workunit.client.0.smithi070.stdout:4/425: truncate dc/d17/d24/f52 293486 0 2023-10-08T08:45:51.386 INFO:tasks.workunit.client.0.smithi070.stdout:4/426: fsync dc/d17/d24/d55/f66 0 2023-10-08T08:45:51.387 INFO:tasks.workunit.client.0.smithi070.stdout:4/427: write dc/d17/d1f/f29 [2950518,27191] 0 2023-10-08T08:45:51.388 INFO:tasks.workunit.client.0.smithi070.stdout:3/656: dwrite d0/fd1 [0,4194304] 0 2023-10-08T08:45:51.465 INFO:tasks.workunit.client.0.smithi070.stdout:3/657: dwrite d0/d12/f71 [0,4194304] 0 2023-10-08T08:45:51.465 INFO:tasks.workunit.client.0.smithi070.stdout:3/658: readlink d0/d12/d14/d5c/d5d/da0/d6a/ld9 0 2023-10-08T08:45:51.465 INFO:tasks.workunit.client.0.smithi070.stdout:3/659: write d0/d12/d14/d5c/d5d/fbf [1001516,43296] 0 2023-10-08T08:45:51.465 INFO:tasks.workunit.client.0.smithi070.stdout:4/428: dwrite dc/d17/d1f/f43 [0,4194304] 0 2023-10-08T08:45:51.467 INFO:tasks.workunit.client.0.smithi070.stdout:3/660: creat d0/d12/d14/d5c/fef x:0 0 0 2023-10-08T08:45:51.468 INFO:tasks.workunit.client.0.smithi070.stdout:4/429: rename dc/d17/l2c to dc/d17/d24/d37/l88 0 2023-10-08T08:45:51.468 INFO:tasks.workunit.client.0.smithi070.stdout:4/430: chown dc/d17/d24/d6b/f6c 49941655 1 2023-10-08T08:45:51.472 INFO:tasks.workunit.client.0.smithi070.stdout:4/431: stat dc/d17/d1f/d5e/l86 0 2023-10-08T08:45:51.482 INFO:tasks.workunit.client.0.smithi070.stdout:3/661: dread d0/d12/fdd [0,4194304] 0 2023-10-08T08:45:51.482 INFO:tasks.workunit.client.0.smithi070.stdout:4/432: dread dc/f46 [0,4194304] 0 2023-10-08T08:45:51.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/662: symlink d0/db/d10/lf0 0 2023-10-08T08:45:51.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/663: write d0/db/fa2 [932888,36599] 0 2023-10-08T08:45:51.484 INFO:tasks.workunit.client.0.smithi070.stdout:3/664: write d0/db/d10/f8f [1137199,8845] 0 2023-10-08T08:45:51.484 INFO:tasks.workunit.client.0.smithi070.stdout:4/433: link dc/c47 dc/d17/d24/d37/c89 0 2023-10-08T08:45:51.484 INFO:tasks.workunit.client.0.smithi070.stdout:4/434: truncate dc/f51 413560 0 2023-10-08T08:45:51.485 INFO:tasks.workunit.client.0.smithi070.stdout:3/665: creat d0/d12/d14/ff1 x:0 0 0 2023-10-08T08:45:51.485 INFO:tasks.workunit.client.0.smithi070.stdout:4/435: write dc/d17/d24/f2f [681315,98402] 0 2023-10-08T08:45:51.486 INFO:tasks.workunit.client.0.smithi070.stdout:3/666: symlink d0/d12/d14/d5c/d5d/da0/d6a/d80/de2/lf2 0 2023-10-08T08:45:51.488 INFO:tasks.workunit.client.0.smithi070.stdout:3/667: link d0/d12/d14/d5c/db1/cd5 d0/d12/d14/d5c/d5d/da0/d6a/cf3 0 2023-10-08T08:45:51.505 INFO:tasks.workunit.client.0.smithi070.stdout:4/436: dwrite dc/f46 [0,4194304] 0 2023-10-08T08:45:51.508 INFO:tasks.workunit.client.0.smithi070.stdout:4/437: getdents dc/d5f 0 2023-10-08T08:45:51.510 INFO:tasks.workunit.client.0.smithi070.stdout:4/438: creat dc/d17/d24/d4c/f8a x:0 0 0 2023-10-08T08:45:51.511 INFO:tasks.workunit.client.0.smithi070.stdout:4/439: readlink dc/d17/d24/d55/l5b 0 2023-10-08T08:45:51.511 INFO:tasks.workunit.client.0.smithi070.stdout:4/440: chown dc/f15 68612797 1 2023-10-08T08:45:51.511 INFO:tasks.workunit.client.0.smithi070.stdout:4/441: fsync dc/d17/d24/d37/f3b 0 2023-10-08T08:45:51.511 INFO:tasks.workunit.client.0.smithi070.stdout:4/442: mknod dc/d5a/c8b 0 2023-10-08T08:45:51.512 INFO:tasks.workunit.client.0.smithi070.stdout:4/443: creat dc/d17/d79/f8c x:0 0 0 2023-10-08T08:45:51.550 INFO:tasks.workunit.client.0.smithi070.stdout:2/735: sync 2023-10-08T08:45:51.550 INFO:tasks.workunit.client.0.smithi070.stdout:1/660: sync 2023-10-08T08:45:51.551 INFO:tasks.workunit.client.0.smithi070.stdout:2/736: creat df/d93/fed x:0 0 0 2023-10-08T08:45:51.552 INFO:tasks.workunit.client.0.smithi070.stdout:1/661: unlink d6/dc/fda 0 2023-10-08T08:45:51.552 INFO:tasks.workunit.client.0.smithi070.stdout:1/662: chown d6/dc/d14/d62/d95/l9e 30 1 2023-10-08T08:45:51.552 INFO:tasks.workunit.client.0.smithi070.stdout:2/737: read df/f20 [1989990,88674] 0 2023-10-08T08:45:51.553 INFO:tasks.workunit.client.0.smithi070.stdout:1/663: mkdir d6/dc/d14/d1f/d75/da1/ddb 0 2023-10-08T08:45:51.572 INFO:tasks.workunit.client.0.smithi070.stdout:1/664: dwrite d6/dc/fd6 [0,4194304] 0 2023-10-08T08:45:51.580 INFO:tasks.workunit.client.0.smithi070.stdout:1/665: rmdir d6/dc 39 2023-10-08T08:45:52.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:52 smithi105 ceph-mon[103798]: pgmap v353: 129 pgs: 129 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 43 MiB/s wr, 108 op/s 2023-10-08T08:45:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:52 smithi191 ceph-mon[104220]: pgmap v353: 129 pgs: 129 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 43 MiB/s wr, 108 op/s 2023-10-08T08:45:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:52 smithi070 ceph-mon[99513]: pgmap v353: 129 pgs: 129 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 43 MiB/s wr, 108 op/s 2023-10-08T08:45:54.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:54 smithi105 ceph-mon[103798]: pgmap v354: 129 pgs: 129 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 39 MiB/s wr, 90 op/s 2023-10-08T08:45:54.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:54 smithi191 ceph-mon[104220]: pgmap v354: 129 pgs: 129 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 39 MiB/s wr, 90 op/s 2023-10-08T08:45:54.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:54 smithi070 ceph-mon[99513]: pgmap v354: 129 pgs: 129 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 39 MiB/s wr, 90 op/s 2023-10-08T08:45:56.013 INFO:tasks.workunit.client.0.smithi070.stdout:5/545: sync 2023-10-08T08:45:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:0/735: sync 2023-10-08T08:45:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:8/598: sync 2023-10-08T08:45:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:4/444: sync 2023-10-08T08:45:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:0/736: truncate d1/d62/fb8 570879 0 2023-10-08T08:45:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:3/668: sync 2023-10-08T08:45:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:6/489: sync 2023-10-08T08:45:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:9/407: sync 2023-10-08T08:45:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:2/738: sync 2023-10-08T08:45:56.014 INFO:tasks.workunit.client.0.smithi070.stdout:8/599: write d1/fb4 [417623,53337] 0 2023-10-08T08:45:56.015 INFO:tasks.workunit.client.0.smithi070.stdout:1/666: sync 2023-10-08T08:45:56.015 INFO:tasks.workunit.client.0.smithi070.stdout:8/600: dread - d1/d4d/d61/fbf zero size 2023-10-08T08:45:56.015 INFO:tasks.workunit.client.0.smithi070.stdout:7/588: sync 2023-10-08T08:45:56.016 INFO:tasks.workunit.client.0.smithi070.stdout:9/408: readlink d1/dd/l22 0 2023-10-08T08:45:56.016 INFO:tasks.workunit.client.0.smithi070.stdout:9/409: read - d1/dd/d19/d38/f71 zero size 2023-10-08T08:45:56.016 INFO:tasks.workunit.client.0.smithi070.stdout:4/445: rename dc/d17/d79/c81 to dc/d17/d24/d6b/c8d 0 2023-10-08T08:45:56.016 INFO:tasks.workunit.client.0.smithi070.stdout:4/446: read - dc/d17/d24/d6b/f71 zero size 2023-10-08T08:45:56.016 INFO:tasks.workunit.client.0.smithi070.stdout:5/546: mknod d5/da/d22/d75/cb9 0 2023-10-08T08:45:56.016 INFO:tasks.workunit.client.0.smithi070.stdout:5/547: readlink d5/da/d4d/l49 0 2023-10-08T08:45:56.016 INFO:tasks.workunit.client.0.smithi070.stdout:5/548: fdatasync d5/da/d22/f5e 0 2023-10-08T08:45:56.016 INFO:tasks.workunit.client.0.smithi070.stdout:5/549: stat d5/da/d22/d75/d82 0 2023-10-08T08:45:56.017 INFO:tasks.workunit.client.0.smithi070.stdout:3/669: mknod d0/d12/d14/d48/da4/cf4 0 2023-10-08T08:45:56.018 INFO:tasks.workunit.client.0.smithi070.stdout:6/490: rename df/d26/d42/d43/d4a/f4f to df/fa0 0 2023-10-08T08:45:56.019 INFO:tasks.workunit.client.0.smithi070.stdout:5/550: unlink d5/la6 0 2023-10-08T08:45:56.019 INFO:tasks.workunit.client.0.smithi070.stdout:3/670: write d0/d12/d14/d1d/f3a [3050468,11373] 0 2023-10-08T08:45:56.020 INFO:tasks.workunit.client.0.smithi070.stdout:7/589: rename d3/da9/d4a/c57 to d3/d19/cca 0 2023-10-08T08:45:56.022 INFO:tasks.workunit.client.0.smithi070.stdout:9/410: link d1/dd/d26/c5c d1/dd/d26/d27/d2d/c75 0 2023-10-08T08:45:56.022 INFO:tasks.workunit.client.0.smithi070.stdout:9/411: dread - d1/dd/d19/f67 zero size 2023-10-08T08:45:56.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/491: creat df/d26/d42/d4b/fa1 x:0 0 0 2023-10-08T08:45:56.022 INFO:tasks.workunit.client.0.smithi070.stdout:7/590: write d3/da9/f58 [9539,83471] 0 2023-10-08T08:45:56.022 INFO:tasks.workunit.client.0.smithi070.stdout:7/591: chown d3/da9/d4a/f8 3286400 1 2023-10-08T08:45:56.022 INFO:tasks.workunit.client.0.smithi070.stdout:4/447: rename dc/d17/d24/d37/c78 to dc/d17/d24/d4c/d4e/c8e 0 2023-10-08T08:45:56.025 INFO:tasks.workunit.client.0.smithi070.stdout:9/412: mkdir d1/dd/d1a/d40/d76 0 2023-10-08T08:45:56.025 INFO:tasks.workunit.client.0.smithi070.stdout:7/592: unlink d3/f47 0 2023-10-08T08:45:56.028 INFO:tasks.workunit.client.0.smithi070.stdout:4/448: rmdir dc/d17/d24/d4c/d4e 39 2023-10-08T08:45:56.031 INFO:tasks.workunit.client.0.smithi070.stdout:6/492: mknod df/d53/ca2 0 2023-10-08T08:45:56.033 INFO:tasks.workunit.client.0.smithi070.stdout:5/551: write d5/da/d4d/d37/d38/f6a [1087096,85279] 0 2023-10-08T08:45:56.035 INFO:tasks.workunit.client.0.smithi070.stdout:6/493: creat df/d26/d42/d43/d4a/d75/d7e/fa3 x:0 0 0 2023-10-08T08:45:56.035 INFO:tasks.workunit.client.0.smithi070.stdout:6/494: fdatasync df/d11/f31 0 2023-10-08T08:45:56.036 INFO:tasks.workunit.client.0.smithi070.stdout:5/552: mknod d5/da/d22/d75/cba 0 2023-10-08T08:45:56.036 INFO:tasks.workunit.client.0.smithi070.stdout:5/553: readlink d5/d5f/d61/d30/d54/d62/l88 0 2023-10-08T08:45:56.038 INFO:tasks.workunit.client.0.smithi070.stdout:5/554: mknod d5/d5f/d61/d30/d54/d62/cbb 0 2023-10-08T08:45:56.045 INFO:tasks.workunit.client.0.smithi070.stdout:5/555: creat d5/d5f/d61/d30/d54/d62/fbc x:0 0 0 2023-10-08T08:45:56.045 INFO:tasks.workunit.client.0.smithi070.stdout:5/556: fdatasync d5/da/d4d/d37/d38/d55/f90 0 2023-10-08T08:45:56.050 INFO:tasks.workunit.client.0.smithi070.stdout:5/557: creat d5/da/fbd x:0 0 0 2023-10-08T08:45:56.055 INFO:tasks.workunit.client.0.smithi070.stdout:6/495: dread df/d11/d1d/f3c [0,4194304] 0 2023-10-08T08:45:56.055 INFO:tasks.workunit.client.0.smithi070.stdout:6/496: readlink df/d26/l51 0 2023-10-08T08:45:56.057 INFO:tasks.workunit.client.0.smithi070.stdout:2/739: dwrite df/d12/d15/d54/db1/fa7 [0,4194304] 0 2023-10-08T08:45:56.058 INFO:tasks.workunit.client.0.smithi070.stdout:8/601: dwrite d1/de/d2e/d45/d7b/f87 [0,4194304] 0 2023-10-08T08:45:56.058 INFO:tasks.workunit.client.0.smithi070.stdout:8/602: chown d1/de/d3a/caa 568746970 1 2023-10-08T08:45:56.058 INFO:tasks.workunit.client.0.smithi070.stdout:8/603: chown d1/de/d1a/l3e 15664651 1 2023-10-08T08:45:56.058 INFO:tasks.workunit.client.0.smithi070.stdout:6/497: rmdir df/d26/d42/d4b/d80 39 2023-10-08T08:45:56.058 INFO:tasks.workunit.client.0.smithi070.stdout:6/498: mknod df/d26/d42/d4b/d80/ca4 0 2023-10-08T08:45:56.060 INFO:tasks.workunit.client.0.smithi070.stdout:6/499: mkdir df/d26/d42/d43/d4a/d97/da5 0 2023-10-08T08:45:56.063 INFO:tasks.workunit.client.0.smithi070.stdout:7/593: dwrite d3/f2e [0,4194304] 0 2023-10-08T08:45:56.063 INFO:tasks.workunit.client.0.smithi070.stdout:9/413: dwrite f0 [0,4194304] 0 2023-10-08T08:45:56.063 INFO:tasks.workunit.client.0.smithi070.stdout:4/449: dwrite dc/ff [0,4194304] 0 2023-10-08T08:45:56.063 INFO:tasks.workunit.client.0.smithi070.stdout:4/450: dread - dc/d17/d24/d4c/f8a zero size 2023-10-08T08:45:56.063 INFO:tasks.workunit.client.0.smithi070.stdout:4/451: readlink dc/d17/d24/l2a 0 2023-10-08T08:45:56.064 INFO:tasks.workunit.client.0.smithi070.stdout:8/604: link d1/d2/d6/d22/f60 d1/d2/d6/d22/fcb 0 2023-10-08T08:45:56.064 INFO:tasks.workunit.client.0.smithi070.stdout:9/414: mkdir d1/dd/d19/d38/d77 0 2023-10-08T08:45:56.064 INFO:tasks.workunit.client.0.smithi070.stdout:9/415: write d1/dd/d26/d27/f65 [528414,12591] 0 2023-10-08T08:45:56.065 INFO:tasks.workunit.client.0.smithi070.stdout:9/416: write d1/dd/d19/d38/d4f/f59 [743890,29425] 0 2023-10-08T08:45:56.065 INFO:tasks.workunit.client.0.smithi070.stdout:0/737: dwrite d1/dd/dae/fc7 [4194304,4194304] 0 2023-10-08T08:45:56.065 INFO:tasks.workunit.client.0.smithi070.stdout:6/500: rename df/d11/d1d/f1f to df/d26/d42/d43/d4a/d75/d7e/fa6 0 2023-10-08T08:45:56.065 INFO:tasks.workunit.client.0.smithi070.stdout:3/671: dwrite d0/d12/d14/d1d/dba/fde [0,4194304] 0 2023-10-08T08:45:56.066 INFO:tasks.workunit.client.0.smithi070.stdout:9/417: creat d1/dd/d19/d38/f78 x:0 0 0 2023-10-08T08:45:56.070 INFO:tasks.workunit.client.0.smithi070.stdout:9/418: creat d1/dd/d19/f79 x:0 0 0 2023-10-08T08:45:56.071 INFO:tasks.workunit.client.0.smithi070.stdout:4/452: write dc/d17/f70 [23120,21630] 0 2023-10-08T08:45:56.072 INFO:tasks.workunit.client.0.smithi070.stdout:9/419: symlink d1/l7a 0 2023-10-08T08:45:56.073 INFO:tasks.workunit.client.0.smithi070.stdout:3/672: dread d0/d12/d14/d1d/f6c [0,4194304] 0 2023-10-08T08:45:56.073 INFO:tasks.workunit.client.0.smithi070.stdout:3/673: fdatasync d0/d12/d14/d5c/d5d/da0/d86/fb3 0 2023-10-08T08:45:56.075 INFO:tasks.workunit.client.0.smithi070.stdout:3/674: creat d0/d12/d14/ff5 x:0 0 0 2023-10-08T08:45:56.075 INFO:tasks.workunit.client.0.smithi070.stdout:3/675: dread - d0/db/fa6 zero size 2023-10-08T08:45:56.081 INFO:tasks.workunit.client.0.smithi070.stdout:5/558: dwrite d5/da/d4d/f8e [0,4194304] 0 2023-10-08T08:45:56.091 INFO:tasks.workunit.client.0.smithi070.stdout:9/420: dread d1/dd/d19/d38/d4f/f59 [0,4194304] 0 2023-10-08T08:45:56.091 INFO:tasks.workunit.client.0.smithi070.stdout:9/421: chown d1/dd/d1a/f62 483441392 1 2023-10-08T08:45:56.091 INFO:tasks.workunit.client.0.smithi070.stdout:7/594: dwrite d3/da9/d4a/d50/f94 [0,4194304] 0 2023-10-08T08:45:56.093 INFO:tasks.workunit.client.0.smithi070.stdout:8/605: dwrite d1/de/d2e/d45/d7b/fc6 [0,4194304] 0 2023-10-08T08:45:56.093 INFO:tasks.workunit.client.0.smithi070.stdout:0/738: write d1/d1d/d4d/fdb [457738,57701] 0 2023-10-08T08:45:56.095 INFO:tasks.workunit.client.0.smithi070.stdout:7/595: rename d3/da9/d4a/d9/c7d to d3/d77/ccb 0 2023-10-08T08:45:56.095 INFO:tasks.workunit.client.0.smithi070.stdout:7/596: chown d3/d19/d6d 345 1 2023-10-08T08:45:56.095 INFO:tasks.workunit.client.0.smithi070.stdout:2/740: dwrite df/d12/d1b/f8c [0,4194304] 0 2023-10-08T08:45:56.096 INFO:tasks.workunit.client.0.smithi070.stdout:9/422: write d1/fb [1918379,52908] 0 2023-10-08T08:45:56.096 INFO:tasks.workunit.client.0.smithi070.stdout:8/606: creat d1/d2/d6/fcc x:0 0 0 2023-10-08T08:45:56.099 INFO:tasks.workunit.client.0.smithi070.stdout:0/739: rename d1/d1d/f51 to d1/d14/d1f/fe8 0 2023-10-08T08:45:56.100 INFO:tasks.workunit.client.0.smithi070.stdout:7/597: symlink d3/d19/d95/da3/dc8/lcc 0 2023-10-08T08:45:56.103 INFO:tasks.workunit.client.0.smithi070.stdout:7/598: rename d3/da9/d4a/d9/cbf to d3/da9/d1e/ccd 0 2023-10-08T08:45:56.106 INFO:tasks.workunit.client.0.smithi070.stdout:7/599: symlink d3/da9/d4a/d9/lce 0 2023-10-08T08:45:56.106 INFO:tasks.workunit.client.0.smithi070.stdout:4/453: dwrite dc/d17/d24/f49 [0,4194304] 0 2023-10-08T08:45:56.109 INFO:tasks.workunit.client.0.smithi070.stdout:9/423: dread d1/dd/d1a/f1d [0,4194304] 0 2023-10-08T08:45:56.110 INFO:tasks.workunit.client.0.smithi070.stdout:3/676: dwrite d0/d12/d14/d48/f91 [0,4194304] 0 2023-10-08T08:45:56.114 INFO:tasks.workunit.client.0.smithi070.stdout:5/559: dread d5/f7c [4194304,4194304] 0 2023-10-08T08:45:56.125 INFO:tasks.workunit.client.0.smithi070.stdout:6/501: dwrite df/d26/d42/d4b/f5b [0,4194304] 0 2023-10-08T08:45:56.125 INFO:tasks.workunit.client.0.smithi070.stdout:6/502: fsync df/d26/f3b 0 2023-10-08T08:45:56.128 INFO:tasks.workunit.client.0.smithi070.stdout:2/741: dwrite df/d12/d1b/f8c [0,4194304] 0 2023-10-08T08:45:56.128 INFO:tasks.workunit.client.0.smithi070.stdout:8/607: dwrite d1/de/d3a/f3f [0,4194304] 0 2023-10-08T08:45:56.128 INFO:tasks.workunit.client.0.smithi070.stdout:6/503: mknod df/d71/ca7 0 2023-10-08T08:45:56.130 INFO:tasks.workunit.client.0.smithi070.stdout:2/742: creat df/d3a/db6/dde/fee x:0 0 0 2023-10-08T08:45:56.135 INFO:tasks.workunit.client.0.smithi070.stdout:2/743: link df/d12/d1b/d82/d85/d65/fe6 df/d12/d15/d54/db1/d83/d92/fef 0 2023-10-08T08:45:56.135 INFO:tasks.workunit.client.0.smithi070.stdout:2/744: chown df/d12/d1b/l50 175600619 1 2023-10-08T08:45:56.140 INFO:tasks.workunit.client.0.smithi070.stdout:5/560: dread d5/d5f/d61/d30/d83/f93 [0,4194304] 0 2023-10-08T08:45:56.140 INFO:tasks.workunit.client.0.smithi070.stdout:0/740: dwrite d1/fa3 [0,4194304] 0 2023-10-08T08:45:56.140 INFO:tasks.workunit.client.0.smithi070.stdout:5/561: stat d5/da/d4d/d37/f39 0 2023-10-08T08:45:56.143 INFO:tasks.workunit.client.0.smithi070.stdout:5/562: truncate d5/da/d4d/d37/f2b 3163711 0 2023-10-08T08:45:56.143 INFO:tasks.workunit.client.0.smithi070.stdout:0/741: link d1/d14/d1f/f42 d1/d1d/d4d/d9d/fe9 0 2023-10-08T08:45:56.143 INFO:tasks.workunit.client.0.smithi070.stdout:2/745: dread df/d12/d15/f16 [0,4194304] 0 2023-10-08T08:45:56.143 INFO:tasks.workunit.client.0.smithi070.stdout:2/746: fdatasync df/d12/d7e/f8e 0 2023-10-08T08:45:56.145 INFO:tasks.workunit.client.0.smithi070.stdout:0/742: mknod d1/d14/d1f/cea 0 2023-10-08T08:45:56.145 INFO:tasks.workunit.client.0.smithi070.stdout:0/743: chown d1/d1d/d4d/d9d/l74 4378494 1 2023-10-08T08:45:56.145 INFO:tasks.workunit.client.0.smithi070.stdout:5/563: dread d5/da/d22/f5e [0,4194304] 0 2023-10-08T08:45:56.146 INFO:tasks.workunit.client.0.smithi070.stdout:4/454: dread dc/d17/f27 [0,4194304] 0 2023-10-08T08:45:56.146 INFO:tasks.workunit.client.0.smithi070.stdout:3/677: dwrite d0/d12/d14/d1d/fc9 [0,4194304] 0 2023-10-08T08:45:56.147 INFO:tasks.workunit.client.0.smithi070.stdout:4/455: creat dc/d17/d24/d6b/f8f x:0 0 0 2023-10-08T08:45:56.148 INFO:tasks.workunit.client.0.smithi070.stdout:2/747: mkdir df/d93/dc2/dae/dce/df0 0 2023-10-08T08:45:56.148 INFO:tasks.workunit.client.0.smithi070.stdout:2/748: chown df/d12/d1b/l27 31602431 1 2023-10-08T08:45:56.148 INFO:tasks.workunit.client.0.smithi070.stdout:4/456: symlink dc/d17/d1f/d5e/l90 0 2023-10-08T08:45:56.148 INFO:tasks.workunit.client.0.smithi070.stdout:5/564: getdents d5/d5f/d61/d30/d54/dab 0 2023-10-08T08:45:56.149 INFO:tasks.workunit.client.0.smithi070.stdout:7/600: dwrite d3/da9/d1e/d4c/f80 [0,4194304] 0 2023-10-08T08:45:56.151 INFO:tasks.workunit.client.0.smithi070.stdout:0/744: rename d1/d62/d54/f7d to d1/d62/d54/d5e/d80/d8a/dc3/feb 0 2023-10-08T08:45:56.151 INFO:tasks.workunit.client.0.smithi070.stdout:2/749: chown ce 569238 1 2023-10-08T08:45:56.151 INFO:tasks.workunit.client.0.smithi070.stdout:3/678: mkdir d0/d12/d14/d5c/df6 0 2023-10-08T08:45:56.151 INFO:tasks.workunit.client.0.smithi070.stdout:2/750: write df/d4c/f6d [909428,44204] 0 2023-10-08T08:45:56.151 INFO:tasks.workunit.client.0.smithi070.stdout:3/679: truncate d0/d12/d14/d48/f53 1478391 0 2023-10-08T08:45:56.152 INFO:tasks.workunit.client.0.smithi070.stdout:0/745: read d1/d14/d1f/f66 [3880525,86174] 0 2023-10-08T08:45:56.154 INFO:tasks.workunit.client.0.smithi070.stdout:5/565: link d5/d5f/d61/d30/d83/f8c d5/d5f/d63/fbe 0 2023-10-08T08:45:56.155 INFO:tasks.workunit.client.0.smithi070.stdout:3/680: symlink d0/d12/d14/d48/da4/lf7 0 2023-10-08T08:45:56.155 INFO:tasks.workunit.client.0.smithi070.stdout:3/681: stat d0/d12/d14/d5c/fef 0 2023-10-08T08:45:56.157 INFO:tasks.workunit.client.0.smithi070.stdout:5/566: mkdir d5/da/d4d/d37/d38/d55/dbf 0 2023-10-08T08:45:56.158 INFO:tasks.workunit.client.0.smithi070.stdout:5/567: truncate d5/d5f/d61/d30/d54/dab/fb5 558292 0 2023-10-08T08:45:56.158 INFO:tasks.workunit.client.0.smithi070.stdout:5/568: truncate d5/d5f/d61/d30/d54/f7b 3082045 0 2023-10-08T08:45:56.159 INFO:tasks.workunit.client.0.smithi070.stdout:3/682: mknod d0/d12/d14/d5c/dc4/cf8 0 2023-10-08T08:45:56.159 INFO:tasks.workunit.client.0.smithi070.stdout:7/601: creat d3/da9/d1e/d4c/fcf x:0 0 0 2023-10-08T08:45:56.159 INFO:tasks.workunit.client.0.smithi070.stdout:2/751: symlink df/d12/d1b/d82/d85/d65/da0/lf1 0 2023-10-08T08:45:56.161 INFO:tasks.workunit.client.0.smithi070.stdout:9/424: dwrite d1/dd/d19/d38/f71 [0,4194304] 0 2023-10-08T08:45:56.161 INFO:tasks.workunit.client.0.smithi070.stdout:0/746: mkdir d1/d62/d54/d5e/d80/d8a/dec 0 2023-10-08T08:45:56.163 INFO:tasks.workunit.client.0.smithi070.stdout:5/569: write d5/da/f1f [2893467,52267] 0 2023-10-08T08:45:56.163 INFO:tasks.workunit.client.0.smithi070.stdout:9/425: mkdir d1/dd/d26/d7b 0 2023-10-08T08:45:56.164 INFO:tasks.workunit.client.0.smithi070.stdout:9/426: chown d1/dd/d19/d38/d56/c58 29800 1 2023-10-08T08:45:56.167 INFO:tasks.workunit.client.0.smithi070.stdout:9/427: symlink d1/dd/d19/d38/d4f/l7c 0 2023-10-08T08:45:56.169 INFO:tasks.workunit.client.0.smithi070.stdout:6/504: dwrite df/d53/f62 [0,4194304] 0 2023-10-08T08:45:56.169 INFO:tasks.workunit.client.0.smithi070.stdout:6/505: fsync df/d53/f5a 0 2023-10-08T08:45:56.171 INFO:tasks.workunit.client.0.smithi070.stdout:8/608: dwrite d1/d23/f28 [4194304,4194304] 0 2023-10-08T08:45:56.171 INFO:tasks.workunit.client.0.smithi070.stdout:0/747: mknod d1/d1d/ced 0 2023-10-08T08:45:56.173 INFO:tasks.workunit.client.0.smithi070.stdout:7/602: creat d3/da9/d4a/d9/fd0 x:0 0 0 2023-10-08T08:45:56.173 INFO:tasks.workunit.client.0.smithi070.stdout:4/457: dread dc/d17/d1f/f34 [0,4194304] 0 2023-10-08T08:45:56.176 INFO:tasks.workunit.client.0.smithi070.stdout:7/603: write d3/da9/d4a/d9/d97/fa0 [432047,83329] 0 2023-10-08T08:45:56.178 INFO:tasks.workunit.client.0.smithi070.stdout:4/458: dread dc/d17/f2e [0,4194304] 0 2023-10-08T08:45:56.178 INFO:tasks.workunit.client.0.smithi070.stdout:0/748: link d1/fa3 d1/d62/d54/d5e/fee 0 2023-10-08T08:45:56.178 INFO:tasks.workunit.client.0.smithi070.stdout:2/752: dread df/d12/f37 [4194304,4194304] 0 2023-10-08T08:45:56.178 INFO:tasks.workunit.client.0.smithi070.stdout:2/753: getdents df/d12/d15/d54/db1/d83/d92/dc1 0 2023-10-08T08:45:56.179 INFO:tasks.workunit.client.0.smithi070.stdout:0/749: symlink d1/d14/de5/lef 0 2023-10-08T08:45:56.179 INFO:tasks.workunit.client.0.smithi070.stdout:0/750: getdents d1/d1d/d4d/d9d/dd3 0 2023-10-08T08:45:56.179 INFO:tasks.workunit.client.0.smithi070.stdout:4/459: symlink dc/d17/d1f/d5e/l91 0 2023-10-08T08:45:56.179 INFO:tasks.workunit.client.0.smithi070.stdout:4/460: chown dc/d5a 1359 1 2023-10-08T08:45:56.180 INFO:tasks.workunit.client.0.smithi070.stdout:2/754: rmdir df/d12/d1b/d1c/dcd 39 2023-10-08T08:45:56.180 INFO:tasks.workunit.client.0.smithi070.stdout:7/604: write d3/da9/d4a/d9/f74 [3870650,71131] 0 2023-10-08T08:45:56.181 INFO:tasks.workunit.client.0.smithi070.stdout:4/461: rmdir dc/d17/d24/d4c 39 2023-10-08T08:45:56.182 INFO:tasks.workunit.client.0.smithi070.stdout:4/462: symlink dc/d17/d24/d4c/l92 0 2023-10-08T08:45:56.183 INFO:tasks.workunit.client.0.smithi070.stdout:0/751: rename d1/d62/d54/d5e/d80/d8a/dc3/fd4 to d1/d14/d1f/d6f/ff0 0 2023-10-08T08:45:56.183 INFO:tasks.workunit.client.0.smithi070.stdout:0/752: write d1/fa7 [379276,32915] 0 2023-10-08T08:45:56.185 INFO:tasks.workunit.client.0.smithi070.stdout:2/755: creat df/d4c/ff2 x:0 0 0 2023-10-08T08:45:56.185 INFO:tasks.workunit.client.0.smithi070.stdout:2/756: fsync df/f59 0 2023-10-08T08:45:56.185 INFO:tasks.workunit.client.0.smithi070.stdout:2/757: chown df/d12/d1b/d82/d85/d65/fe6 1 1 2023-10-08T08:45:56.185 INFO:tasks.workunit.client.0.smithi070.stdout:2/758: write df/d4c/f68 [5144586,72920] 0 2023-10-08T08:45:56.186 INFO:tasks.workunit.client.0.smithi070.stdout:7/605: getdents d3/d19/d6d 0 2023-10-08T08:45:56.189 INFO:tasks.workunit.client.0.smithi070.stdout:0/753: truncate d1/dd/f13 6513935 0 2023-10-08T08:45:56.190 INFO:tasks.workunit.client.0.smithi070.stdout:2/759: rename df/d12/d1b/d1c/d69/cb5 to df/d12/d1b/d1c/d2d/cf3 0 2023-10-08T08:45:56.191 INFO:tasks.workunit.client.0.smithi070.stdout:7/606: symlink d3/d19/d1a/ld1 0 2023-10-08T08:45:56.192 INFO:tasks.workunit.client.0.smithi070.stdout:2/760: mknod df/d12/d1b/d82/d85/d65/da0/cf4 0 2023-10-08T08:45:56.192 INFO:tasks.workunit.client.0.smithi070.stdout:2/761: chown df/d12/d15/d54/db1/d83/d92/fef 50 1 2023-10-08T08:45:56.192 INFO:tasks.workunit.client.0.smithi070.stdout:2/762: dread - df/d3a/db6/dde/fee zero size 2023-10-08T08:45:56.193 INFO:tasks.workunit.client.0.smithi070.stdout:7/607: mknod d3/d19/d95/cd2 0 2023-10-08T08:45:56.194 INFO:tasks.workunit.client.0.smithi070.stdout:2/763: creat df/d12/d7e/ff5 x:0 0 0 2023-10-08T08:45:56.196 INFO:tasks.workunit.client.0.smithi070.stdout:5/570: dread d5/d5f/d63/d8b/d8f/f96 [0,4194304] 0 2023-10-08T08:45:56.196 INFO:tasks.workunit.client.0.smithi070.stdout:5/571: readlink d5/da/d22/l72 0 2023-10-08T08:45:56.196 INFO:tasks.workunit.client.0.smithi070.stdout:5/572: chown d5/d5f/d61/d30/d54/f7b 7730792 1 2023-10-08T08:45:56.196 INFO:tasks.workunit.client.0.smithi070.stdout:3/683: dwrite d0/d12/d14/d1d/fc9 [4194304,4194304] 0 2023-10-08T08:45:56.196 INFO:tasks.workunit.client.0.smithi070.stdout:2/764: symlink df/d3a/db6/lf6 0 2023-10-08T08:45:56.199 INFO:tasks.workunit.client.0.smithi070.stdout:5/573: write d5/d5f/d61/f9c [1638445,114011] 0 2023-10-08T08:45:56.199 INFO:tasks.workunit.client.0.smithi070.stdout:4/463: write dc/d17/d24/d37/f3b [903122,122292] 0 2023-10-08T08:45:56.199 INFO:tasks.workunit.client.0.smithi070.stdout:2/765: link df/d4c/d91/cc3 df/d12/cf7 0 2023-10-08T08:45:56.199 INFO:tasks.workunit.client.0.smithi070.stdout:2/766: chown df/d12/d1b/d82/d85 20533 1 2023-10-08T08:45:56.199 INFO:tasks.workunit.client.0.smithi070.stdout:3/684: rename d0/d8a/f99 to d0/db/d10/d38/ff9 0 2023-10-08T08:45:56.199 INFO:tasks.workunit.client.0.smithi070.stdout:6/506: write df/d26/d42/d4b/f56 [2838943,107382] 0 2023-10-08T08:45:56.200 INFO:tasks.workunit.client.0.smithi070.stdout:6/507: fsync df/d26/d42/d43/d4a/d75/f9b 0 2023-10-08T08:45:56.200 INFO:tasks.workunit.client.0.smithi070.stdout:6/508: readlink df/d26/l52 0 2023-10-08T08:45:56.200 INFO:tasks.workunit.client.0.smithi070.stdout:6/509: write f5 [1189442,72680] 0 2023-10-08T08:45:56.201 INFO:tasks.workunit.client.0.smithi070.stdout:9/428: dwrite d1/dd/d19/d38/f42 [0,4194304] 0 2023-10-08T08:45:56.201 INFO:tasks.workunit.client.0.smithi070.stdout:3/685: rename d0/d12/d14/f40 to d0/d12/d14/d5c/d5d/da0/dd8/ffa 0 2023-10-08T08:45:56.203 INFO:tasks.workunit.client.0.smithi070.stdout:3/686: creat d0/d12/d14/d1d/dba/ffb x:0 0 0 2023-10-08T08:45:56.203 INFO:tasks.workunit.client.0.smithi070.stdout:3/687: truncate d0/d12/d8d/fcf 506061 0 2023-10-08T08:45:56.205 INFO:tasks.workunit.client.0.smithi070.stdout:5/574: dread d5/d5f/d61/d30/d54/dab/fb5 [0,4194304] 0 2023-10-08T08:45:56.205 INFO:tasks.workunit.client.0.smithi070.stdout:8/609: dwrite d1/fb [4194304,4194304] 0 2023-10-08T08:45:56.208 INFO:tasks.workunit.client.0.smithi070.stdout:5/575: mkdir d5/da/d4d/d37/d2a/dc0 0 2023-10-08T08:45:56.208 INFO:tasks.workunit.client.0.smithi070.stdout:5/576: chown d5/da/d4d/d37/d2a/l91 133226028 1 2023-10-08T08:45:56.208 INFO:tasks.workunit.client.0.smithi070.stdout:8/610: symlink d1/d2/d6/d22/d5c/d99/lcd 0 2023-10-08T08:45:56.208 INFO:tasks.workunit.client.0.smithi070.stdout:4/464: write dc/d17/f27 [3857582,34914] 0 2023-10-08T08:45:56.210 INFO:tasks.workunit.client.0.smithi070.stdout:5/577: creat d5/d5f/d63/d8b/d8f/fc1 x:0 0 0 2023-10-08T08:45:56.210 INFO:tasks.workunit.client.0.smithi070.stdout:4/465: creat dc/d17/d1f/d5e/f93 x:0 0 0 2023-10-08T08:45:56.210 INFO:tasks.workunit.client.0.smithi070.stdout:8/611: creat d1/de/d21/fce x:0 0 0 2023-10-08T08:45:56.211 INFO:tasks.workunit.client.0.smithi070.stdout:0/754: dread d1/fa [0,4194304] 0 2023-10-08T08:45:56.212 INFO:tasks.workunit.client.0.smithi070.stdout:0/755: fdatasync d1/d1d/d4d/d9d/fe9 0 2023-10-08T08:45:56.214 INFO:tasks.workunit.client.0.smithi070.stdout:4/466: rmdir dc/d17/d1f/d54 39 2023-10-08T08:45:56.214 INFO:tasks.workunit.client.0.smithi070.stdout:9/429: dread d1/f74 [0,4194304] 0 2023-10-08T08:45:56.216 INFO:tasks.workunit.client.0.smithi070.stdout:4/467: write dc/f15 [396610,11250] 0 2023-10-08T08:45:56.216 INFO:tasks.workunit.client.0.smithi070.stdout:4/468: read - dc/d17/d1f/d54/f67 zero size 2023-10-08T08:45:56.217 INFO:tasks.workunit.client.0.smithi070.stdout:4/469: truncate dc/d17/f2e 1243784 0 2023-10-08T08:45:56.217 INFO:tasks.workunit.client.0.smithi070.stdout:5/578: unlink d5/da/d22/d75/d82/l8d 0 2023-10-08T08:45:56.217 INFO:tasks.workunit.client.0.smithi070.stdout:5/579: chown d5/d5f/d61/d30/d54/d62/c9d 6 1 2023-10-08T08:45:56.217 INFO:tasks.workunit.client.0.smithi070.stdout:4/470: getdents dc/d5a 0 2023-10-08T08:45:56.217 INFO:tasks.workunit.client.0.smithi070.stdout:4/471: write dc/d17/d24/d6b/f71 [738973,9907] 0 2023-10-08T08:45:56.219 INFO:tasks.workunit.client.0.smithi070.stdout:4/472: unlink dc/d17/d79/f8c 0 2023-10-08T08:45:56.221 INFO:tasks.workunit.client.0.smithi070.stdout:4/473: truncate dc/d17/d24/f49 228529 0 2023-10-08T08:45:56.222 INFO:tasks.workunit.client.0.smithi070.stdout:4/474: truncate dc/f50 3987816 0 2023-10-08T08:45:56.223 INFO:tasks.workunit.client.0.smithi070.stdout:4/475: creat dc/d17/d24/d4c/f94 x:0 0 0 2023-10-08T08:45:56.232 INFO:tasks.workunit.client.0.smithi070.stdout:5/580: dread d5/d5f/d61/f9c [0,4194304] 0 2023-10-08T08:45:56.235 INFO:tasks.workunit.client.0.smithi070.stdout:8/612: dwrite d1/d2/d6/fcc [0,4194304] 0 2023-10-08T08:45:56.238 INFO:tasks.workunit.client.0.smithi070.stdout:5/581: dread d5/da/d22/f52 [0,4194304] 0 2023-10-08T08:45:56.239 INFO:tasks.workunit.client.0.smithi070.stdout:6/510: dwrite df/d26/d42/d4b/fa1 [0,4194304] 0 2023-10-08T08:45:56.240 INFO:tasks.workunit.client.0.smithi070.stdout:4/476: write dc/d17/d24/f73 [397973,92497] 0 2023-10-08T08:45:56.245 INFO:tasks.workunit.client.0.smithi070.stdout:5/582: mkdir d5/da/d4d/dc2 0 2023-10-08T08:45:56.246 INFO:tasks.workunit.client.0.smithi070.stdout:5/583: mkdir d5/da/d4d/d37/d38/dc3 0 2023-10-08T08:45:56.249 INFO:tasks.workunit.client.0.smithi070.stdout:1/667: sync 2023-10-08T08:45:56.250 INFO:tasks.workunit.client.0.smithi070.stdout:1/668: stat d6/dc/d14 0 2023-10-08T08:45:56.250 INFO:tasks.workunit.client.0.smithi070.stdout:1/669: chown d6/dc/d14/d1f/c35 3214932 1 2023-10-08T08:45:56.253 INFO:tasks.workunit.client.0.smithi070.stdout:1/670: mknod d6/dc/d14/d1f/d63/cdc 0 2023-10-08T08:45:56.253 INFO:tasks.workunit.client.0.smithi070.stdout:1/671: truncate d6/dc/d14/d1f/d63/db3/d38/f5f 1555658 0 2023-10-08T08:45:56.256 INFO:tasks.workunit.client.0.smithi070.stdout:5/584: mknod d5/cc4 0 2023-10-08T08:45:56.256 INFO:tasks.workunit.client.0.smithi070.stdout:5/585: stat d5/d5f/d61 0 2023-10-08T08:45:56.256 INFO:tasks.workunit.client.0.smithi070.stdout:5/586: chown d5/da/d4d/f79 2 1 2023-10-08T08:45:56.258 INFO:tasks.workunit.client.0.smithi070.stdout:5/587: rename d5/d5f/d63/d8b/d8f/f96 to d5/d5f/d61/d30/d54/d62/dae/fc5 0 2023-10-08T08:45:56.259 INFO:tasks.workunit.client.0.smithi070.stdout:8/613: write d1/de/d2e/fa8 [593697,102069] 0 2023-10-08T08:45:56.259 INFO:tasks.workunit.client.0.smithi070.stdout:8/614: fsync d1/f24 0 2023-10-08T08:45:56.261 INFO:tasks.workunit.client.0.smithi070.stdout:6/511: dread df/d53/f62 [0,4194304] 0 2023-10-08T08:45:56.261 INFO:tasks.workunit.client.0.smithi070.stdout:6/512: chown df/f1c 0 1 2023-10-08T08:45:56.263 INFO:tasks.workunit.client.0.smithi070.stdout:6/513: rename df/d26/d42/d43/d4a/d75/c87 to df/d26/ca8 0 2023-10-08T08:45:56.273 INFO:tasks.workunit.client.0.smithi070.stdout:8/615: dread d1/de/d2e/d45/d7b/f82 [0,4194304] 0 2023-10-08T08:45:56.284 INFO:tasks.workunit.client.0.smithi070.stdout:8/616: dread d1/d2/d6/d22/d5b/d74/f8b [0,4194304] 0 2023-10-08T08:45:56.284 INFO:tasks.workunit.client.0.smithi070.stdout:3/688: read d0/d12/d14/d5c/d5d/da0/dd8/ffa [3760372,129639] 0 2023-10-08T08:45:56.284 INFO:tasks.workunit.client.0.smithi070.stdout:5/588: dread d5/da/d22/f59 [0,4194304] 0 2023-10-08T08:45:56.284 INFO:tasks.workunit.client.0.smithi070.stdout:5/589: readlink d5/da/l56 0 2023-10-08T08:45:56.286 INFO:tasks.workunit.client.0.smithi070.stdout:1/672: dwrite d6/dc/f85 [0,4194304] 0 2023-10-08T08:45:56.288 INFO:tasks.workunit.client.0.smithi070.stdout:0/756: write d1/fa3 [1274568,130939] 0 2023-10-08T08:45:56.288 INFO:tasks.workunit.client.0.smithi070.stdout:5/590: rmdir d5/da/d4d/d37/d2a 39 2023-10-08T08:45:56.288 INFO:tasks.workunit.client.0.smithi070.stdout:5/591: chown d5/l7a 124083187 1 2023-10-08T08:45:56.291 INFO:tasks.workunit.client.0.smithi070.stdout:1/673: mknod d6/dc/d14/d1f/d63/db3/d38/d4b/cdd 0 2023-10-08T08:45:56.291 INFO:tasks.workunit.client.0.smithi070.stdout:1/674: write d6/f5e [190261,53205] 0 2023-10-08T08:45:56.291 INFO:tasks.workunit.client.0.smithi070.stdout:1/675: write d6/dc/d14/d1f/d75/da1/fcd [995929,112043] 0 2023-10-08T08:45:56.298 INFO:tasks.workunit.client.0.smithi070.stdout:3/689: write d0/d12/d14/f28 [3323142,48424] 0 2023-10-08T08:45:56.298 INFO:tasks.workunit.client.0.smithi070.stdout:4/477: dread dc/f50 [0,4194304] 0 2023-10-08T08:45:56.298 INFO:tasks.workunit.client.0.smithi070.stdout:3/690: dread - d0/d12/d14/d5c/db1/fd0 zero size 2023-10-08T08:45:56.298 INFO:tasks.workunit.client.0.smithi070.stdout:6/514: dwrite f2 [0,4194304] 0 2023-10-08T08:45:56.298 INFO:tasks.workunit.client.0.smithi070.stdout:7/608: dwrite d3/da9/d4a/d9/d97/fa0 [0,4194304] 0 2023-10-08T08:45:56.299 INFO:tasks.workunit.client.0.smithi070.stdout:4/478: mknod dc/d17/d24/c95 0 2023-10-08T08:45:56.304 INFO:tasks.workunit.client.0.smithi070.stdout:6/515: creat df/d26/d42/d55/d74/fa9 x:0 0 0 2023-10-08T08:45:56.306 INFO:tasks.workunit.client.0.smithi070.stdout:6/516: mkdir df/d26/d78/d90/daa 0 2023-10-08T08:45:56.306 INFO:tasks.workunit.client.0.smithi070.stdout:6/517: write df/d26/d42/d55/f93 [1843968,50139] 0 2023-10-08T08:45:56.306 INFO:tasks.workunit.client.0.smithi070.stdout:3/691: rename d0/d8a/cd6 to d0/d12/d14/d5c/d5d/d75/cfc 0 2023-10-08T08:45:56.306 INFO:tasks.workunit.client.0.smithi070.stdout:4/479: write dc/d17/d1f/f43 [3404743,107358] 0 2023-10-08T08:45:56.308 INFO:tasks.workunit.client.0.smithi070.stdout:3/692: symlink d0/d12/d8d/dcc/lfd 0 2023-10-08T08:45:56.308 INFO:tasks.workunit.client.0.smithi070.stdout:3/693: write d0/d12/f4e [4845183,32445] 0 2023-10-08T08:45:56.311 INFO:tasks.workunit.client.0.smithi070.stdout:3/694: getdents d0/d12/d14/d1d/dba 0 2023-10-08T08:45:56.314 INFO:tasks.workunit.client.0.smithi070.stdout:3/695: chown d0/d12/d14/f72 105 1 2023-10-08T08:45:56.316 INFO:tasks.workunit.client.0.smithi070.stdout:6/518: symlink df/d11/lab 0 2023-10-08T08:45:56.317 INFO:tasks.workunit.client.0.smithi070.stdout:0/757: dwrite d1/f6 [4194304,4194304] 0 2023-10-08T08:45:56.317 INFO:tasks.workunit.client.0.smithi070.stdout:0/758: chown d1/d62/d54/d5e/d80/d8a/dc8/f33 518 1 2023-10-08T08:45:56.318 INFO:tasks.workunit.client.0.smithi070.stdout:6/519: creat df/d26/d42/d55/fac x:0 0 0 2023-10-08T08:45:56.322 INFO:tasks.workunit.client.0.smithi070.stdout:8/617: write d1/d2/d6/d22/d5b/d74/dc3/fc4 [2582617,61558] 0 2023-10-08T08:45:56.322 INFO:tasks.workunit.client.0.smithi070.stdout:0/759: symlink d1/d14/d1f/d6f/lf1 0 2023-10-08T08:45:56.322 INFO:tasks.workunit.client.0.smithi070.stdout:6/520: creat df/d26/d42/d4b/d80/d94/fad x:0 0 0 2023-10-08T08:45:56.322 INFO:tasks.workunit.client.0.smithi070.stdout:5/592: dwrite d5/d5f/d61/f60 [4194304,4194304] 0 2023-10-08T08:45:56.322 INFO:tasks.workunit.client.0.smithi070.stdout:5/593: stat d5/da/d22/fa4 0 2023-10-08T08:45:56.323 INFO:tasks.workunit.client.0.smithi070.stdout:4/480: dread dc/f46 [0,4194304] 0 2023-10-08T08:45:56.323 INFO:tasks.workunit.client.0.smithi070.stdout:0/760: symlink d1/dd/lf2 0 2023-10-08T08:45:56.324 INFO:tasks.workunit.client.0.smithi070.stdout:4/481: mknod dc/c96 0 2023-10-08T08:45:56.324 INFO:tasks.workunit.client.0.smithi070.stdout:4/482: chown dc/f4d 0 1 2023-10-08T08:45:56.324 INFO:tasks.workunit.client.0.smithi070.stdout:4/483: chown dc/d17/d24/d37/c39 26 1 2023-10-08T08:45:56.324 INFO:tasks.workunit.client.0.smithi070.stdout:4/484: dread - dc/f1e zero size 2023-10-08T08:45:56.325 INFO:tasks.workunit.client.0.smithi070.stdout:8/618: rename d1/d2/f3b to d1/d2/d6/d22/d5b/fcf 0 2023-10-08T08:45:56.329 INFO:tasks.workunit.client.0.smithi070.stdout:6/521: unlink df/d11/d1d/f44 0 2023-10-08T08:45:56.329 INFO:tasks.workunit.client.0.smithi070.stdout:6/522: readlink df/d26/l73 0 2023-10-08T08:45:56.331 INFO:tasks.workunit.client.0.smithi070.stdout:8/619: truncate d1/d2/d8c/f85 440810 0 2023-10-08T08:45:56.331 INFO:tasks.workunit.client.0.smithi070.stdout:8/620: write d1/f73 [1370689,111043] 0 2023-10-08T08:45:56.331 INFO:tasks.workunit.client.0.smithi070.stdout:8/621: write d1/f73 [2489403,120443] 0 2023-10-08T08:45:56.331 INFO:tasks.workunit.client.0.smithi070.stdout:5/594: read d5/d5f/d61/d30/d54/d62/f8a [65164,95652] 0 2023-10-08T08:45:56.332 INFO:tasks.workunit.client.0.smithi070.stdout:6/523: unlink df/f1b 0 2023-10-08T08:45:56.332 INFO:tasks.workunit.client.0.smithi070.stdout:7/609: dwrite d3/da9/d1e/d76/fb7 [0,4194304] 0 2023-10-08T08:45:56.333 INFO:tasks.workunit.client.0.smithi070.stdout:4/485: dread dc/f48 [0,4194304] 0 2023-10-08T08:45:56.335 INFO:tasks.workunit.client.0.smithi070.stdout:5/595: rename d5/da/d4d/d37/d2a/c84 to d5/da/d22/d75/cc6 0 2023-10-08T08:45:56.335 INFO:tasks.workunit.client.0.smithi070.stdout:5/596: chown d5/da/d4d/f3f 1619318268 1 2023-10-08T08:45:56.335 INFO:tasks.workunit.client.0.smithi070.stdout:5/597: chown d5/d5f/d61/f9c 38133447 1 2023-10-08T08:45:56.339 INFO:tasks.workunit.client.0.smithi070.stdout:8/622: getdents d1/d2/d6/d22 0 2023-10-08T08:45:56.339 INFO:tasks.workunit.client.0.smithi070.stdout:8/623: write d1/d2/d8c/fb0 [264871,103524] 0 2023-10-08T08:45:56.342 INFO:tasks.workunit.client.0.smithi070.stdout:7/610: dread d3/d19/d1a/f22 [0,4194304] 0 2023-10-08T08:45:56.342 INFO:tasks.workunit.client.0.smithi070.stdout:6/524: getdents df/d11 0 2023-10-08T08:45:56.343 INFO:tasks.workunit.client.0.smithi070.stdout:5/598: creat d5/da/d22/fc7 x:0 0 0 2023-10-08T08:45:56.346 INFO:tasks.workunit.client.0.smithi070.stdout:8/624: mkdir d1/d2/d6/d22/d5c/dd0 0 2023-10-08T08:45:56.346 INFO:tasks.workunit.client.0.smithi070.stdout:6/525: mkdir df/d26/d78/d90/dae 0 2023-10-08T08:45:56.350 INFO:tasks.workunit.client.0.smithi070.stdout:3/696: dwrite d0/db/d10/d38/ff9 [0,4194304] 0 2023-10-08T08:45:56.350 INFO:tasks.workunit.client.0.smithi070.stdout:3/697: readlink d0/d12/l65 0 2023-10-08T08:45:56.352 INFO:tasks.workunit.client.0.smithi070.stdout:0/761: dwrite d1/d14/f43 [0,4194304] 0 2023-10-08T08:45:56.352 INFO:tasks.workunit.client.0.smithi070.stdout:0/762: chown d1/d14/d1f/d6f/c92 238701 1 2023-10-08T08:45:56.352 INFO:tasks.workunit.client.0.smithi070.stdout:0/763: dread - d1/faa zero size 2023-10-08T08:45:56.352 INFO:tasks.workunit.client.0.smithi070.stdout:0/764: fdatasync d1/d14/d1f/d6f/ff0 0 2023-10-08T08:45:56.353 INFO:tasks.workunit.client.0.smithi070.stdout:8/625: unlink d1/de/d15/cac 0 2023-10-08T08:45:56.353 INFO:tasks.workunit.client.0.smithi070.stdout:8/626: chown d1/d2/d6/f14 1351 1 2023-10-08T08:45:56.355 INFO:tasks.workunit.client.0.smithi070.stdout:0/765: creat d1/d62/d54/d5e/d80/ff3 x:0 0 0 2023-10-08T08:45:56.355 INFO:tasks.workunit.client.0.smithi070.stdout:5/599: write d5/d5f/d61/f9c [41115,89766] 0 2023-10-08T08:45:56.356 INFO:tasks.workunit.client.0.smithi070.stdout:3/698: mkdir d0/db/d10/d38/d63/dfe 0 2023-10-08T08:45:56.357 INFO:tasks.workunit.client.0.smithi070.stdout:5/600: read d5/f26 [843875,80853] 0 2023-10-08T08:45:56.357 INFO:tasks.workunit.client.0.smithi070.stdout:7/611: dread d3/da9/d1e/d76/f8a [0,4194304] 0 2023-10-08T08:45:56.364 INFO:tasks.workunit.client.0.smithi070.stdout:4/486: rmdir dc/d17 39 2023-10-08T08:45:56.370 INFO:tasks.workunit.client.0.smithi070.stdout:8/627: rmdir d1 39 2023-10-08T08:45:56.370 INFO:tasks.workunit.client.0.smithi070.stdout:5/601: write d5/d5f/d61/d30/d54/d62/f8a [1316578,76158] 0 2023-10-08T08:45:56.374 INFO:tasks.workunit.client.0.smithi070.stdout:6/526: dwrite df/d26/d42/d4b/d80/d94/fad [0,4194304] 0 2023-10-08T08:45:56.374 INFO:tasks.workunit.client.0.smithi070.stdout:6/527: stat df/d26/d42/d55/d74/d7d 0 2023-10-08T08:45:56.376 INFO:tasks.workunit.client.0.smithi070.stdout:5/602: rmdir d5/d5f/db4 0 2023-10-08T08:45:56.377 INFO:tasks.workunit.client.0.smithi070.stdout:6/528: truncate df/d26/d42/d4b/f5b 3618678 0 2023-10-08T08:45:56.379 INFO:tasks.workunit.client.0.smithi070.stdout:6/529: unlink df/f1c 0 2023-10-08T08:45:56.381 INFO:tasks.workunit.client.0.smithi070.stdout:8/628: dread d1/de/d2e/d45/f70 [0,4194304] 0 2023-10-08T08:45:56.383 INFO:tasks.workunit.client.0.smithi070.stdout:8/629: symlink d1/d2/d6/d22/d5c/dd0/ld1 0 2023-10-08T08:45:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.382+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3494124556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 msgr2=0x7f9c380ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.382+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3494124556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 0x7f9c380ffa50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0099c0 tx=0x7f9c2c009cd0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.383+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3494124556 shutdown_connections 2023-10-08T08:45:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.383+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3494124556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c380fff90 0x7f9c3810c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.383+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3494124556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c38105690 0x7f9c38105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.383+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3494124556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 0x7f9c380ffa50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.383+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3494124556 >> 172.21.15.70:0/3494124556 conn(0x7f9c380fb0a0 msgr2=0x7f9c380fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.383+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3494124556 shutdown_connections 2023-10-08T08:45:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.383+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3494124556 wait complete. 2023-10-08T08:45:56.385 INFO:tasks.workunit.client.0.smithi070.stdout:0/766: rename d1/d62/d54/d5e/d80/d8a/dc8 to d1/d1d/d24/df4 0 2023-10-08T08:45:56.385 INFO:tasks.workunit.client.0.smithi070.stdout:5/603: rename d5/da/d4d/d37 to d5/da/d4d/d37/d38/d55/dbf/dc8 22 2023-10-08T08:45:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.384+0000 7f9c3d01d700 1 Processor -- start 2023-10-08T08:45:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.384+0000 7f9c3d01d700 1 -- start start 2023-10-08T08:45:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3d01d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 0x7f9c3819e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3d01d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c380fff90 0x7f9c3819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3d01d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c38105690 0x7f9c38198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3d01d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c381991b0 con 0x7f9c380ff5d0 2023-10-08T08:45:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3d01d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c38199320 con 0x7f9c380fff90 2023-10-08T08:45:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3d01d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c381994e0 con 0x7f9c38105690 2023-10-08T08:45:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c36d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 0x7f9c3819e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c36d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 0x7f9c3819e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52752/0 (socket says 172.21.15.70:52752) 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c36d9d700 1 -- 172.21.15.70:0/3038145569 learned_addr learned my addr 172.21.15.70:0/3038145569 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3659c700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c380fff90 0x7f9c3819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3759e700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c38105690 0x7f9c38198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c36d9d700 1 -- 172.21.15.70:0/3038145569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c38105690 msgr2=0x7f9c38198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c38105690 0x7f9c38198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c36d9d700 1 -- 172.21.15.70:0/3038145569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c380fff90 msgr2=0x7f9c3819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c380fff90 0x7f9c3819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c36d9d700 1 -- 172.21.15.70:0/3038145569 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c0095f0 con 0x7f9c380ff5d0 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3759e700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c38105690 0x7f9c38198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:45:56.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.385+0000 7f9c3659c700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c380fff90 0x7f9c3819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:45:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.386+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 0x7f9c3819e9c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800e9a0 tx=0x7f9c2800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.386+0000 7f9c1ffff700 1 -- 172.21.15.70:0/3038145569 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28009790 con 0x7f9c380ff5d0 2023-10-08T08:45:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.386+0000 7f9c1ffff700 1 -- 172.21.15.70:0/3038145569 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c2800cbd0 con 0x7f9c380ff5d0 2023-10-08T08:45:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.386+0000 7f9c1ffff700 1 -- 172.21.15.70:0/3038145569 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28018680 con 0x7f9c380ff5d0 2023-10-08T08:45:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.386+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3038145569 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c381997c0 con 0x7f9c380ff5d0 2023-10-08T08:45:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.386+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3038145569 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c381a5a60 con 0x7f9c380ff5d0 2023-10-08T08:45:56.391 INFO:tasks.workunit.client.0.smithi070.stdout:3/699: dwrite d0/d12/d14/d5c/d5d/da0/d86/fb3 [0,4194304] 0 2023-10-08T08:45:56.391 INFO:tasks.workunit.client.0.smithi070.stdout:8/630: rename d1/d2/d6/d22/d5b/l88 to d1/de/da9/ld2 0 2023-10-08T08:45:56.391 INFO:tasks.workunit.client.0.smithi070.stdout:5/604: creat d5/d5f/fc9 x:0 0 0 2023-10-08T08:45:56.391 INFO:tasks.workunit.client.0.smithi070.stdout:7/612: dwrite d3/da9/d4a/d9/d97/f9b [0,4194304] 0 2023-10-08T08:45:56.391 INFO:tasks.workunit.client.0.smithi070.stdout:4/487: dwrite dc/ff [0,4194304] 0 2023-10-08T08:45:56.391 INFO:tasks.workunit.client.0.smithi070.stdout:4/488: write dc/f1e [279324,78838] 0 2023-10-08T08:45:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.388+0000 7f9c1ffff700 1 -- 172.21.15.70:0/3038145569 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9c2800cd40 con 0x7f9c380ff5d0 2023-10-08T08:45:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.389+0000 7f9c1ffff700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9c200a1670 0x7f9c200a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.389+0000 7f9c1ffff700 1 -- 172.21.15.70:0/3038145569 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9c28014070 con 0x7f9c380ff5d0 2023-10-08T08:45:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.389+0000 7f9c3659c700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9c200a1670 0x7f9c200a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.393 INFO:tasks.workunit.client.0.smithi070.stdout:4/489: symlink dc/d17/d79/l97 0 2023-10-08T08:45:56.393 INFO:tasks.workunit.client.0.smithi070.stdout:3/700: unlink d0/d12/d14/d5c/d5d/fae 0 2023-10-08T08:45:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c3659c700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9c200a1670 0x7f9c200a3b30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009990 tx=0x7f9c2c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c49206b80 1 Processor -- start 2023-10-08T08:45:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c49206b80 1 -- start start 2023-10-08T08:45:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fca880 0x55dd47fcac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fc50b0 0x55dd47fc5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c49206b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47f2d400 con 0x55dd47fcb1a0 2023-10-08T08:45:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c49206b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47f1ebc0 con 0x55dd47fca880 2023-10-08T08:45:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c49206b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47f1c4e0 con 0x55dd47fc50b0 2023-10-08T08:45:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c3659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c3659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52760/0 (socket says 172.21.15.70:52760) 2023-10-08T08:45:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c3659c700 1 -- 172.21.15.70:0/2370541159 learned_addr learned my addr 172.21.15.70:0/2370541159 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:56.395 INFO:tasks.workunit.client.0.smithi070.stdout:4/490: creat dc/d17/d79/f98 x:0 0 0 2023-10-08T08:45:56.395 INFO:tasks.workunit.client.0.smithi070.stdout:4/491: read - dc/d17/d1f/d5e/f84 zero size 2023-10-08T08:45:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.391+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/2370541159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fca880 0x55dd47fcac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c3659c700 1 -- 172.21.15.70:0/2370541159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fc50b0 msgr2=0x55dd47fc5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c3659c700 1 --2- 172.21.15.70:0/2370541159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fc50b0 0x55dd47fc5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c3659c700 1 -- 172.21.15.70:0/2370541159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fca880 msgr2=0x55dd47fcac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c3659c700 1 --2- 172.21.15.70:0/2370541159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fca880 0x55dd47fcac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c3659c700 1 -- 172.21.15.70:0/2370541159 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd47d42d80 con 0x55dd47fcb1a0 2023-10-08T08:45:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/2370541159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fca880 0x55dd47fcac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:45:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c3659c700 1 --2- 172.21.15.70:0/2370541159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc4b70 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0095c0 tx=0x7f9c2c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4a8c12a93db855 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c1d7fa700 1 -- 172.21.15.70:0/2370541159 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c02a070 con 0x55dd47fcb1a0 2023-10-08T08:45:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c1d7fa700 1 -- 172.21.15.70:0/2370541159 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c2c01d040 con 0x55dd47fcb1a0 2023-10-08T08:45:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.392+0000 7f9c1d7fa700 1 -- 172.21.15.70:0/2370541159 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c00fb80 con 0x55dd47fcb1a0 2023-10-08T08:45:56.397 INFO:tasks.workunit.client.0.smithi070.stdout:7/613: rename d3/da9/d4a/d9/da4/lc4 to d3/da9/d4a/d50/d9f/ld3 0 2023-10-08T08:45:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.393+0000 7f9c49206b80 1 -- 172.21.15.70:0/2370541159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 msgr2=0x55dd47fc4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.393+0000 7f9c49206b80 1 --2- 172.21.15.70:0/2370541159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc4b70 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0095c0 tx=0x7f9c2c01f000 comp rx=0 tx=0).stop 2023-10-08T08:45:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.394+0000 7f9c49206b80 1 -- 172.21.15.70:0/2370541159 shutdown_connections 2023-10-08T08:45:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.394+0000 7f9c49206b80 1 --2- 172.21.15.70:0/2370541159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fc50b0 0x55dd47fc5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.394+0000 7f9c49206b80 1 --2- 172.21.15.70:0/2370541159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fca880 0x55dd47fcac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.394+0000 7f9c49206b80 1 --2- 172.21.15.70:0/2370541159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc4b70 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.394+0000 7f9c49206b80 1 -- 172.21.15.70:0/2370541159 >> 172.21.15.70:0/2370541159 conn(0x55dd47f39200 msgr2=0x55dd47fbfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.394+0000 7f9c49206b80 1 -- 172.21.15.70:0/2370541159 shutdown_connections 2023-10-08T08:45:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.394+0000 7f9c49206b80 1 -- 172.21.15.70:0/2370541159 wait complete. 2023-10-08T08:45:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.394+0000 7f9c49206b80 1 -- start start 2023-10-08T08:45:56.399 INFO:tasks.workunit.client.0.smithi070.stdout:5/605: mkdir d5/d5f/d63/dca 0 2023-10-08T08:45:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.394+0000 7f9c49206b80 1 Processor -- start 2023-10-08T08:45:56.400 INFO:tasks.workunit.client.0.smithi070.stdout:4/492: write f9 [2835175,129389] 0 2023-10-08T08:45:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fc50b0 0x55dd47fd1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 0x55dd47fce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fcb1a0 0x55dd47fcec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c49206b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47f17dd0 con 0x55dd47fc50b0 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c49206b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47eb46b0 con 0x55dd47fcb1a0 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c49206b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47eb4350 con 0x55dd47fca880 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c49206b80 10 client.0 _ll_register_callbacks cb 0x55dd47d117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c36d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fc50b0 0x55dd47fd1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c36d9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fc50b0 0x55dd47fd1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52764/0 (socket says 172.21.15.70:52764) 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c36d9d700 1 -- 172.21.15.70:0/1431790203 learned_addr learned my addr 172.21.15.70:0/1431790203 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c3759e700 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fcb1a0 0x55dd47fcec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c3659c700 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 0x55dd47fce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.402 INFO:tasks.workunit.client.0.smithi070.stdout:3/701: symlink d0/d12/d14/d5c/d5d/da0/d6a/d80/de2/lff 0 2023-10-08T08:45:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c36d9d700 1 -- 172.21.15.70:0/1431790203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 msgr2=0x55dd47fce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 0x55dd47fce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c36d9d700 1 -- 172.21.15.70:0/1431790203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fcb1a0 msgr2=0x55dd47fcec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fcb1a0 0x55dd47fcec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.395+0000 7f9c36d9d700 1 -- 172.21.15.70:0/1431790203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3810cd50 con 0x55dd47fc50b0 2023-10-08T08:45:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c3659c700 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 0x55dd47fce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:45:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fc50b0 0x55dd47fd1270 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9c280cb060 tx=0x7f9c2809a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daf8bb5693da9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c1aff5700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c1aff5700 1 -- 172.21.15.70:0/1431790203 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2809a750 con 0x55dd47fc50b0 2023-10-08T08:45:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c1aff5700 1 -- 172.21.15.70:0/1431790203 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9c280997e0 con 0x55dd47fc50b0 2023-10-08T08:45:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c49206b80 1 -- 172.21.15.70:0/1431790203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd47edfe50 con 0x55dd47fc50b0 2023-10-08T08:45:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c1aff5700 1 -- 172.21.15.70:0/1431790203 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c280999a0 con 0x55dd47fc50b0 2023-10-08T08:45:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c49206b80 10 client.16425 fetch_fsmap learned FSMap version 32 2023-10-08T08:45:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c49206b80 1 -- 172.21.15.70:0/1431790203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55dd47d2bc00 con 0x55dd47fc50b0 2023-10-08T08:45:56.405 INFO:tasks.workunit.client.0.smithi070.stdout:7/614: creat d3/d79/fd4 x:0 0 0 2023-10-08T08:45:56.405 INFO:tasks.workunit.client.0.smithi070.stdout:4/493: creat dc/d17/d1f/f99 x:0 0 0 2023-10-08T08:45:56.405 INFO:tasks.workunit.client.0.smithi070.stdout:4/494: chown dc/d17/d79/f98 66820665 1 2023-10-08T08:45:56.405 INFO:tasks.workunit.client.0.smithi070.stdout:4/495: dread - dc/d68/f83 zero size 2023-10-08T08:45:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.396+0000 7f9c1aff5700 1 -- 172.21.15.70:0/1431790203 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dd47edfe50 con 0x55dd47fc50b0 2023-10-08T08:45:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c1aff5700 1 -- 172.21.15.70:0/1431790203 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9c280993c0 con 0x55dd47fc50b0 2023-10-08T08:45:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c49206b80 10 client.16425 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T08:45:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c49206b80 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c49206b80 20 client.16425 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:56.406 INFO:tasks.workunit.client.0.smithi070.stdout:0/767: dread d1/d14/d1f/f96 [0,4194304] 0 2023-10-08T08:45:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c49206b80 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dd47ff8430 0x55dd47ffa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c49206b80 4 client.16425 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:45:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c49206b80 1 -- 172.21.15.70:0/1431790203 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd47f10db0 con 0x55dd47ff8430 2023-10-08T08:45:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c3659c700 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dd47ff8430 0x55dd47ffa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c1aff5700 10 client.16425 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.397+0000 7f9c3659c700 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dd47ff8430 0x55dd47ffa850 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f426bb58653b384 server_cookie=3d9f852bf142c53a in_seq=0 out_seq=0 2023-10-08T08:45:56.408 INFO:tasks.workunit.client.0.smithi070.stdout:0/768: creat d1/d14/d1f/ff5 x:0 0 0 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.398+0000 7f9c1aff5700 1 -- 172.21.15.70:0/1431790203 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dd47f10db0 con 0x55dd47ff8430 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.398+0000 7f9c1aff5700 10 client.16425 handle_command_reply: tid=0 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.398+0000 7f9c49206b80 1 client.16425 shutdown 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.398+0000 7f9c49206b80 1 -- 172.21.15.70:0/1431790203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fc50b0 msgr2=0x55dd47fd1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.398+0000 7f9c49206b80 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fc50b0 0x55dd47fd1270 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9c280cb060 tx=0x7f9c2809a2f0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.400+0000 7f9c49206b80 1 -- 172.21.15.70:0/1431790203 shutdown_connections 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.400+0000 7f9c49206b80 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dd47ff8430 0x55dd47ffa850 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.400+0000 7f9c49206b80 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fcb1a0 0x55dd47fcec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.400+0000 7f9c49206b80 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fc50b0 0x55dd47fd1270 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.400+0000 7f9c49206b80 1 --2- 172.21.15.70:0/1431790203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 0x55dd47fce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.400+0000 7f9c49206b80 1 -- 172.21.15.70:0/1431790203 >> 172.21.15.70:0/1431790203 conn(0x55dd47f39200 msgr2=0x55dd47fbf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.400+0000 7f9c1aff5700 0 client.16425 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.400+0000 7f9c49206b80 1 -- 172.21.15.70:0/1431790203 shutdown_connections 2023-10-08T08:45:56.410 INFO:tasks.workunit.client.0.smithi070.stdout:5/606: creat d5/da/d4d/d37/d38/dc3/fcb x:0 0 0 2023-10-08T08:45:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.400+0000 7f9c49206b80 1 -- 172.21.15.70:0/1431790203 wait complete. 2023-10-08T08:45:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.401+0000 7f9c49206b80 20 client.16425 trim_cache size 0 max 16384 2023-10-08T08:45:56.411 INFO:tasks.workunit.client.0.smithi070.stdout:5/607: truncate d5/da/f1f 4159357 0 2023-10-08T08:45:56.411 INFO:tasks.workunit.client.0.smithi070.stdout:5/608: creat d5/d5f/d63/d8b/da8/dac/fcc x:0 0 0 2023-10-08T08:45:56.411 INFO:tasks.workunit.client.0.smithi070.stdout:6/530: dwrite df/f5c [0,4194304] 0 2023-10-08T08:45:56.412 INFO:tasks.workunit.client.0.smithi070.stdout:0/769: creat d1/d1d/ff6 x:0 0 0 2023-10-08T08:45:56.412 INFO:tasks.workunit.client.0.smithi070.stdout:0/770: getdents d1/d62/d54/d5e/d80/d8a/dec 0 2023-10-08T08:45:56.412 INFO:tasks.workunit.client.0.smithi070.stdout:7/615: dread d3/da9/d4a/d50/f81 [0,4194304] 0 2023-10-08T08:45:56.413 INFO:tasks.workunit.client.0.smithi070.stdout:6/531: creat df/d26/d42/d55/d74/d7d/faf x:0 0 0 2023-10-08T08:45:56.413 INFO:tasks.workunit.client.0.smithi070.stdout:6/532: stat df/d53/ca2 0 2023-10-08T08:45:56.413 INFO:tasks.workunit.client.0.smithi070.stdout:6/533: fsync df/d26/d42/d43/d4a/d75/d7e/f8d 0 2023-10-08T08:45:56.415 INFO:tasks.workunit.client.0.smithi070.stdout:8/631: write d1/d2/d6/d22/f58 [3163033,35225] 0 2023-10-08T08:45:56.415 INFO:tasks.workunit.client.0.smithi070.stdout:5/609: read d5/da/f15 [4774100,73330] 0 2023-10-08T08:45:56.415 INFO:tasks.workunit.client.0.smithi070.stdout:6/534: rename df/d11/f31 to df/d26/d78/d90/daa/fb0 0 2023-10-08T08:45:56.416 INFO:tasks.workunit.client.0.smithi070.stdout:6/535: truncate df/d26/d42/d4b/f54 747604 0 2023-10-08T08:45:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c49206b80 1 Processor -- start 2023-10-08T08:45:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c49206b80 1 -- start start 2023-10-08T08:45:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 0x55dd47fce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 0x55dd47fbf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fbfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c49206b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47d988c0 con 0x55dd47fcb1a0 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c49206b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47fcfb60 con 0x55dd47fc50b0 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c49206b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47ff5a40 con 0x55dd47fca880 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c3759e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fbfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c3759e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fbfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52776/0 (socket says 172.21.15.70:52776) 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c3759e700 1 -- 172.21.15.70:0/2453062818 learned_addr learned my addr 172.21.15.70:0/2453062818 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.418+0000 7f9c3659c700 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 0x55dd47fbf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 0x55dd47fce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c3759e700 1 -- 172.21.15.70:0/2453062818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 msgr2=0x55dd47fbf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c3759e700 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 0x55dd47fbf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c3759e700 1 -- 172.21.15.70:0/2453062818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 msgr2=0x55dd47fce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c3759e700 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 0x55dd47fce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c3759e700 1 -- 172.21.15.70:0/2453062818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd47d691f0 con 0x55dd47fcb1a0 2023-10-08T08:45:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 0x55dd47fce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:45:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c3759e700 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fbfcd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009e00 tx=0x7f9c300076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84b3f1e27105915 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c1dffb700 1 -- 172.21.15.70:0/2453062818 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30007dd0 con 0x55dd47fcb1a0 2023-10-08T08:45:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c1dffb700 1 -- 172.21.15.70:0/2453062818 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c300158b0 con 0x55dd47fcb1a0 2023-10-08T08:45:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.419+0000 7f9c1dffb700 1 -- 172.21.15.70:0/2453062818 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c300147e0 con 0x55dd47fcb1a0 2023-10-08T08:45:56.422 INFO:tasks.workunit.client.0.smithi070.stdout:8/632: link d1/de/d2e/d45/f51 d1/de/d2e/d45/d7b/fd3 0 2023-10-08T08:45:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 -- 172.21.15.70:0/2453062818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 msgr2=0x55dd47fbfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fbfcd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009e00 tx=0x7f9c300076c0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 -- 172.21.15.70:0/2453062818 shutdown_connections 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fcb1a0 0x55dd47fbfcd0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 0x55dd47fce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 --2- 172.21.15.70:0/2453062818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fca880 0x55dd47fbf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 -- 172.21.15.70:0/2453062818 >> 172.21.15.70:0/2453062818 conn(0x55dd47f39200 msgr2=0x55dd47fcdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 -- 172.21.15.70:0/2453062818 shutdown_connections 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 -- 172.21.15.70:0/2453062818 wait complete. 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 -- start start 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.420+0000 7f9c49206b80 1 Processor -- start 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 0x55dd47fc76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fca880 0x55dd47fc7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c49206b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c49206b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47fc68d0 con 0x55dd47fca880 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c49206b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47fc6a40 con 0x55dd47fc50b0 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c49206b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd47fc6c00 con 0x55dd47fcb1a0 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c49206b80 10 client.0 _ll_register_callbacks cb 0x7f9c28099c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c3659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fca880 0x55dd47fc7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c3659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fca880 0x55dd47fc7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52780/0 (socket says 172.21.15.70:52780) 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c3659c700 1 -- 172.21.15.70:0/866494479 learned_addr learned my addr 172.21.15.70:0/866494479 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c3759e700 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 0x55dd47fc76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c3659c700 1 -- 172.21.15.70:0/866494479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fcb1a0 msgr2=0x55dd47fc6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c3659c700 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c3659c700 1 -- 172.21.15.70:0/866494479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 msgr2=0x55dd47fc76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:45:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c3659c700 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 0x55dd47fc76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.421+0000 7f9c3659c700 1 -- 172.21.15.70:0/866494479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c30009ae0 con 0x55dd47fca880 2023-10-08T08:45:56.427 INFO:tasks.workunit.client.0.smithi070.stdout:5/610: rename d5/d5f/d61/d30/d54/d62/f8a to d5/da/d4d/d37/d38/fcd 0 2023-10-08T08:45:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c3659c700 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fca880 0x55dd47fc7c00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00bf60 tx=0x7f9c2c03a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a042fcaa9b928b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:45:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c1aff5700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:45:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c1aff5700 1 -- 172.21.15.70:0/866494479 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c02a040 con 0x55dd47fca880 2023-10-08T08:45:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c1aff5700 1 -- 172.21.15.70:0/866494479 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9c2c028040 con 0x55dd47fca880 2023-10-08T08:45:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c49206b80 1 -- 172.21.15.70:0/866494479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c2c01d040 con 0x55dd47fca880 2023-10-08T08:45:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c1aff5700 1 -- 172.21.15.70:0/866494479 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c2c03a560 con 0x55dd47fca880 2023-10-08T08:45:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c49206b80 10 client.16431 fetch_fsmap learned FSMap version 32 2023-10-08T08:45:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c49206b80 1 -- 172.21.15.70:0/866494479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55dd47d41250 con 0x55dd47fca880 2023-10-08T08:45:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c1aff5700 1 -- 172.21.15.70:0/866494479 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c2c01d040 con 0x55dd47fca880 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c1aff5700 1 -- 172.21.15.70:0/866494479 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9c2c003740 con 0x55dd47fca880 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c49206b80 10 client.16431 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c49206b80 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c49206b80 20 client.16431 populate_metadata read hostname 'smithi070' 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c49206b80 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dd4804ce10 0x55dd4804f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c49206b80 4 client.16431 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.422+0000 7f9c49206b80 1 -- 172.21.15.70:0/866494479 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dd47f10ad0 con 0x55dd4804ce10 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.423+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dd4804ce10 0x55dd4804f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.423+0000 7f9c1aff5700 10 client.16431 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.423+0000 7f9c36d9d700 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dd4804ce10 0x55dd4804f230 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=119b2426fa58bbfc server_cookie=6b6d304aed480d1e in_seq=0 out_seq=0 2023-10-08T08:45:56.431 INFO:tasks.workunit.client.0.smithi070.stdout:8/633: mkdir d1/d2/dd4 0 2023-10-08T08:45:56.431 INFO:tasks.workunit.client.0.smithi070.stdout:7/616: dread d3/da9/d4a/f8e [0,4194304] 0 2023-10-08T08:45:56.431 INFO:tasks.workunit.client.0.smithi070.stdout:8/634: rmdir d1/de/d2e/d45/d80 39 2023-10-08T08:45:56.474 INFO:tasks.workunit.client.0.smithi070.stdout:0/771: read d1/d62/f55 [1132929,19642] 0 2023-10-08T08:45:56.482 INFO:tasks.workunit.client.0.smithi070.stdout:7/617: dwrite d3/da9/d4a/d9/fd0 [0,4194304] 0 2023-10-08T08:45:56.482 INFO:tasks.workunit.client.0.smithi070.stdout:7/618: chown d3/d19/d1a/ca8 944964775 1 2023-10-08T08:45:56.483 INFO:tasks.workunit.client.0.smithi070.stdout:5/611: write d5/da/f1f [4932552,86094] 0 2023-10-08T08:45:56.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/702: rmdir d0/d12/d14 39 2023-10-08T08:45:56.484 INFO:tasks.workunit.client.0.smithi070.stdout:0/772: dread d1/fa7 [0,4194304] 0 2023-10-08T08:45:56.486 INFO:tasks.workunit.client.0.smithi070.stdout:8/635: dwrite d1/d2/d6/d22/f4c [0,4194304] 0 2023-10-08T08:45:56.486 INFO:tasks.workunit.client.0.smithi070.stdout:7/619: unlink d3/da9/d4a/d9/fd0 0 2023-10-08T08:45:56.487 INFO:tasks.workunit.client.0.smithi070.stdout:6/536: dread df/d26/f3b [0,4194304] 0 2023-10-08T08:45:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.488+0000 7f9c1aff5700 1 -- 172.21.15.70:0/866494479 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dd47f10ad0 con 0x55dd4804ce10 2023-10-08T08:45:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.488+0000 7f9c1aff5700 10 client.16431 handle_command_reply: tid=0 2023-10-08T08:45:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.488+0000 7f9c49206b80 1 client.16431 shutdown 2023-10-08T08:45:56.489 INFO:tasks.workunit.client.0.smithi070.stdout:7/620: creat d3/d19/d1a/fd5 x:0 0 0 2023-10-08T08:45:56.492 INFO:tasks.workunit.client.0.smithi070.stdout:5/612: mknod d5/d5f/d61/d30/d54/cce 0 2023-10-08T08:45:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.491+0000 7f9c49206b80 1 -- 172.21.15.70:0/866494479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fca880 msgr2=0x55dd47fc7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.491+0000 7f9c49206b80 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fca880 0x55dd47fc7c00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00bf60 tx=0x7f9c2c03a1f0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c49206b80 1 -- 172.21.15.70:0/866494479 shutdown_connections 2023-10-08T08:45:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c49206b80 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dd47fcb1a0 0x55dd47fc6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c49206b80 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dd4804ce10 0x55dd4804f230 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c49206b80 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dd47fc50b0 0x55dd47fc76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c49206b80 1 --2- 172.21.15.70:0/866494479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd47fca880 0x55dd47fc7c00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c1aff5700 0 client.16431 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:45:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c49206b80 1 -- 172.21.15.70:0/866494479 >> 172.21.15.70:0/866494479 conn(0x55dd47f39200 msgr2=0x55dd47fc9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c49206b80 1 -- 172.21.15.70:0/866494479 shutdown_connections 2023-10-08T08:45:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c49206b80 1 -- 172.21.15.70:0/866494479 wait complete. 2023-10-08T08:45:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.492+0000 7f9c49206b80 20 client.16431 trim_cache size 0 max 16384 2023-10-08T08:45:56.494 INFO:tasks.workunit.client.0.smithi070.stdout:6/537: getdents df/d26/d42/d4b 0 2023-10-08T08:45:56.494 INFO:tasks.workunit.client.0.smithi070.stdout:6/538: dread - df/d26/d42/d55/d74/fa9 zero size 2023-10-08T08:45:56.495 INFO:tasks.workunit.client.0.smithi070.stdout:6/539: readlink df/d11/l2e 0 2023-10-08T08:45:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:45:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:45:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:45:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:45:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9c200a1670 msgr2=0x7f9c200a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9c200a1670 0x7f9c200a3b30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009990 tx=0x7f9c2c005fb0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 msgr2=0x7f9c3819e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:45:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 0x7f9c3819e9c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800e9a0 tx=0x7f9c2800ecb0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3038145569 shutdown_connections 2023-10-08T08:45:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f9c200a1670 0x7f9c200a3b30 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009990 tx=0x7f9c2c005fb0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c38105690 0x7f9c38198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c380ff5d0 0x7f9c3819e9c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 --2- 172.21.15.70:0/3038145569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c380fff90 0x7f9c3819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:45:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3038145569 >> 172.21.15.70:0/3038145569 conn(0x7f9c380fb0a0 msgr2=0x7f9c38068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:45:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3038145569 shutdown_connections 2023-10-08T08:45:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:45:56.493+0000 7f9c3d01d700 1 -- 172.21.15.70:0/3038145569 wait complete. 2023-10-08T08:45:56.497 INFO:tasks.workunit.client.0.smithi070.stdout:6/540: truncate df/d11/d1d/f3c 1123225 0 2023-10-08T08:45:56.497 INFO:tasks.workunit.client.0.smithi070.stdout:6/541: chown df/d26/d42/d43/d4a/f6d 36 1 2023-10-08T08:45:56.498 INFO:tasks.workunit.client.0.smithi070.stdout:6/542: dread - df/d11/d1d/f9c zero size 2023-10-08T08:45:56.502 INFO:tasks.workunit.client.0.smithi070.stdout:0/773: dread d1/d14/f43 [0,4194304] 0 2023-10-08T08:45:56.502 INFO:tasks.workunit.client.0.smithi070.stdout:5/613: dread d5/d5f/d63/fbe [0,4194304] 0 2023-10-08T08:45:56.513 INFO:tasks.workunit.client.0.smithi070.stdout:6/543: rename df/d11/d1d to df/d26/d42/db1 0 2023-10-08T08:45:56.513 INFO:tasks.workunit.client.0.smithi070.stdout:6/544: chown df/d11/f29 969409 1 2023-10-08T08:45:56.514 INFO:tasks.workunit.client.0.smithi070.stdout:3/703: dwrite d0/d12/d14/d5c/d5d/da0/faa [0,4194304] 0 2023-10-08T08:45:56.514 INFO:tasks.workunit.client.0.smithi070.stdout:0/774: write d1/d1d/d24/df4/f59 [2022499,26316] 0 2023-10-08T08:45:56.514 INFO:tasks.workunit.client.0.smithi070.stdout:0/775: chown d1/d1d/l9a 38578107 1 2023-10-08T08:45:56.514 INFO:tasks.workunit.client.0.smithi070.stdout:0/776: write d1/fa3 [4447884,26422] 0 2023-10-08T08:45:56.516 INFO:tasks.workunit.client.0.smithi070.stdout:0/777: creat d1/d14/d1f/ff7 x:0 0 0 2023-10-08T08:45:56.516 INFO:tasks.workunit.client.0.smithi070.stdout:2/767: sync 2023-10-08T08:45:56.517 INFO:tasks.workunit.client.0.smithi070.stdout:0/778: creat d1/d1d/d24/df4/ff8 x:0 0 0 2023-10-08T08:45:56.519 INFO:tasks.workunit.client.0.smithi070.stdout:3/704: getdents d0/d12/d8d/dcc 0 2023-10-08T08:45:56.520 INFO:tasks.workunit.client.0.smithi070.stdout:2/768: rename df/l62 to df/d12/d1b/d1c/d69/lf8 0 2023-10-08T08:45:56.521 INFO:tasks.workunit.client.0.smithi070.stdout:3/705: mkdir d0/d12/d14/d5c/db1/dbe/d100 0 2023-10-08T08:45:56.525 INFO:tasks.workunit.client.0.smithi070.stdout:7/621: dwrite d3/da9/d4a/f83 [0,4194304] 0 2023-10-08T08:45:56.525 INFO:tasks.workunit.client.0.smithi070.stdout:7/622: truncate d3/da9/f58 755759 0 2023-10-08T08:45:56.526 INFO:tasks.workunit.client.0.smithi070.stdout:7/623: readlink d3/lb4 0 2023-10-08T08:45:56.526 INFO:tasks.workunit.client.0.smithi070.stdout:7/624: write d3/d19/d1a/fc1 [205149,23746] 0 2023-10-08T08:45:56.526 INFO:tasks.workunit.client.0.smithi070.stdout:8/636: dwrite d1/de/d2e/d45/f51 [0,4194304] 0 2023-10-08T08:45:56.527 INFO:tasks.workunit.client.0.smithi070.stdout:5/614: dwrite d5/d5f/fc9 [0,4194304] 0 2023-10-08T08:45:56.530 INFO:tasks.workunit.client.0.smithi070.stdout:5/615: read d5/da/d22/f32 [3250963,11282] 0 2023-10-08T08:45:56.530 INFO:tasks.workunit.client.0.smithi070.stdout:7/625: write d3/d19/d1a/f4e [3382864,31967] 0 2023-10-08T08:45:56.535 INFO:tasks.workunit.client.0.smithi070.stdout:7/626: mkdir d3/da9/d4a/d9/da4/dd6 0 2023-10-08T08:45:56.535 INFO:tasks.workunit.client.0.smithi070.stdout:7/627: truncate d3/d19/d1a/fd5 899815 0 2023-10-08T08:45:56.539 INFO:tasks.workunit.client.0.smithi070.stdout:7/628: mkdir d3/d19/d6d/dd7 0 2023-10-08T08:45:56.539 INFO:tasks.workunit.client.0.smithi070.stdout:7/629: dread - d3/d19/d6d/fc0 zero size 2023-10-08T08:45:56.543 INFO:tasks.workunit.client.0.smithi070.stdout:7/630: symlink d3/ld8 0 2023-10-08T08:45:56.552 INFO:tasks.workunit.client.0.smithi070.stdout:6/545: dwrite df/d26/d42/d4b/d80/d94/fad [0,4194304] 0 2023-10-08T08:45:56.558 INFO:tasks.workunit.client.0.smithi070.stdout:6/546: creat df/d26/d42/d55/d74/d7d/fb2 x:0 0 0 2023-10-08T08:45:56.558 INFO:tasks.workunit.client.0.smithi070.stdout:3/706: dwrite d0/d12/fdd [0,4194304] 0 2023-10-08T08:45:56.559 INFO:tasks.workunit.client.0.smithi070.stdout:3/707: readlink d0/db/d10/lf0 0 2023-10-08T08:45:56.559 INFO:tasks.workunit.client.0.smithi070.stdout:3/708: chown d0/db/d10/d38/d2f/f7e 581909543 1 2023-10-08T08:45:56.559 INFO:tasks.workunit.client.0.smithi070.stdout:0/779: dwrite d1/d14/fd9 [0,4194304] 0 2023-10-08T08:45:56.561 INFO:tasks.workunit.client.0.smithi070.stdout:2/769: dwrite df/d12/d1b/d1c/fb0 [0,4194304] 0 2023-10-08T08:45:56.561 INFO:tasks.workunit.client.0.smithi070.stdout:3/709: read d0/d12/d14/d1d/f3a [917889,57834] 0 2023-10-08T08:45:56.562 INFO:tasks.workunit.client.0.smithi070.stdout:6/547: mkdir df/d26/d78/d90/dae/db3 0 2023-10-08T08:45:56.563 INFO:tasks.workunit.client.0.smithi070.stdout:8/637: dwrite d1/de/d2e/d45/d7b/fc8 [0,4194304] 0 2023-10-08T08:45:56.566 INFO:tasks.workunit.client.0.smithi070.stdout:2/770: mknod df/d12/d1b/d1c/d2d/cf9 0 2023-10-08T08:45:56.566 INFO:tasks.workunit.client.0.smithi070.stdout:2/771: stat df/d12/d1b/d1c/c61 0 2023-10-08T08:45:56.566 INFO:tasks.workunit.client.0.smithi070.stdout:2/772: dread - df/d12/d15/fe9 zero size 2023-10-08T08:45:56.566 INFO:tasks.workunit.client.0.smithi070.stdout:2/773: write df/d12/d1b/d82/d85/d65/fcc [607279,73192] 0 2023-10-08T08:45:56.568 INFO:tasks.workunit.client.0.smithi070.stdout:2/774: write df/d12/d15/f86 [3230609,85185] 0 2023-10-08T08:45:56.568 INFO:tasks.workunit.client.0.smithi070.stdout:6/548: write df/d26/d42/d43/d4a/f68 [465315,73611] 0 2023-10-08T08:45:56.568 INFO:tasks.workunit.client.0.smithi070.stdout:6/549: chown df/d11/f40 204346 1 2023-10-08T08:45:56.568 INFO:tasks.workunit.client.0.smithi070.stdout:0/780: rename d1/d1d/d24/f4c to d1/d76/dd5/ff9 0 2023-10-08T08:45:56.569 INFO:tasks.workunit.client.0.smithi070.stdout:0/781: write d1/fa9 [702176,110537] 0 2023-10-08T08:45:56.569 INFO:tasks.workunit.client.0.smithi070.stdout:3/710: write d0/d12/d14/d48/f85 [351995,78590] 0 2023-10-08T08:45:56.571 INFO:tasks.workunit.client.0.smithi070.stdout:2/775: unlink df/d12/cf7 0 2023-10-08T08:45:56.576 INFO:tasks.workunit.client.0.smithi070.stdout:0/782: creat d1/d62/d54/d5e/d80/d8a/ffa x:0 0 0 2023-10-08T08:45:56.577 INFO:tasks.workunit.client.0.smithi070.stdout:0/783: symlink d1/d62/d54/d5e/d80/d8a/dc3/lfb 0 2023-10-08T08:45:56.579 INFO:tasks.workunit.client.0.smithi070.stdout:0/784: mkdir d1/d62/d54/dfc 0 2023-10-08T08:45:56.582 INFO:tasks.workunit.client.0.smithi070.stdout:3/711: dread d0/fd1 [0,4194304] 0 2023-10-08T08:45:56.583 INFO:tasks.workunit.client.0.smithi070.stdout:2/776: write df/d12/d1b/f8c [3338584,111518] 0 2023-10-08T08:45:56.584 INFO:tasks.workunit.client.0.smithi070.stdout:8/638: dwrite d1/d2/d6/d22/f98 [4194304,4194304] 0 2023-10-08T08:45:56.586 INFO:tasks.workunit.client.0.smithi070.stdout:8/639: creat d1/d2/d6/d22/d5b/fd5 x:0 0 0 2023-10-08T08:45:56.586 INFO:tasks.workunit.client.0.smithi070.stdout:8/640: chown d1/de/d2e/d45/c96 32292 1 2023-10-08T08:45:56.591 INFO:tasks.workunit.client.0.smithi070.stdout:3/712: rename d0/d12/d14/d5c/d5d/d75 to d0/d12/d14/d5c/d5d/da0/d101 0 2023-10-08T08:45:56.593 INFO:tasks.workunit.client.0.smithi070.stdout:8/641: write d1/de/d2e/d45/d7b/f9c [2864829,111696] 0 2023-10-08T08:45:56.593 INFO:tasks.workunit.client.0.smithi070.stdout:8/642: chown d1/d2/d6/d22/d5b/d74/dc3 945535 1 2023-10-08T08:45:56.594 INFO:tasks.workunit.client.0.smithi070.stdout:6/550: dwrite df/d11/f7f [4194304,4194304] 0 2023-10-08T08:45:56.594 INFO:tasks.workunit.client.0.smithi070.stdout:6/551: fsync df/d11/f7a 0 2023-10-08T08:45:56.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:56 smithi191 ceph-mon[104220]: pgmap v355: 129 pgs: 129 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 37 MiB/s wr, 100 op/s 2023-10-08T08:45:56.595 INFO:tasks.workunit.client.0.smithi070.stdout:3/713: unlink d0/db/d10/d38/f3f 0 2023-10-08T08:45:56.596 INFO:tasks.workunit.client.0.smithi070.stdout:8/643: mkdir d1/d2/d6/d22/d5b/d74/dc3/dd6 0 2023-10-08T08:45:56.598 INFO:tasks.workunit.client.0.smithi070.stdout:8/644: rename d1/d2/d6/d22/d5c/dd0 to d1/de/d2e/d45/d7b/dd7 0 2023-10-08T08:45:56.599 INFO:tasks.workunit.client.0.smithi070.stdout:3/714: getdents d0/d12 0 2023-10-08T08:45:56.600 INFO:tasks.workunit.client.0.smithi070.stdout:8/645: truncate d1/de/d2e/d45/f70 892850 0 2023-10-08T08:45:56.601 INFO:tasks.workunit.client.0.smithi070.stdout:8/646: chown d1/d2/d6/d22/l29 4 1 2023-10-08T08:45:56.601 INFO:tasks.workunit.client.0.smithi070.stdout:8/647: write d1/de/d3a/d56/d65/f71 [60803,52933] 0 2023-10-08T08:45:56.606 INFO:tasks.workunit.client.0.smithi070.stdout:0/785: dwrite d1/d1d/d24/df4/f90 [0,4194304] 0 2023-10-08T08:45:56.607 INFO:tasks.workunit.client.0.smithi070.stdout:8/648: dread d1/d2/d8c/fb0 [0,4194304] 0 2023-10-08T08:45:56.609 INFO:tasks.workunit.client.0.smithi070.stdout:8/649: symlink d1/de/d3a/ld8 0 2023-10-08T08:45:56.610 INFO:tasks.workunit.client.0.smithi070.stdout:0/786: dread - d1/d1d/d24/f94 zero size 2023-10-08T08:45:56.610 INFO:tasks.workunit.client.0.smithi070.stdout:0/787: fdatasync d1/dd/f53 0 2023-10-08T08:45:56.611 INFO:tasks.workunit.client.0.smithi070.stdout:2/777: dwrite df/d12/d15/d54/db1/f8a [0,4194304] 0 2023-10-08T08:45:56.613 INFO:tasks.workunit.client.0.smithi070.stdout:1/676: sync 2023-10-08T08:45:56.613 INFO:tasks.workunit.client.0.smithi070.stdout:1/677: chown d6/lf 2183 1 2023-10-08T08:45:56.613 INFO:tasks.workunit.client.0.smithi070.stdout:9/430: sync 2023-10-08T08:45:56.613 INFO:tasks.workunit.client.0.smithi070.stdout:9/431: chown d1/dd/d26/d27/d2d/l64 169791282 1 2023-10-08T08:45:56.616 INFO:tasks.workunit.client.0.smithi070.stdout:9/432: rename d1/dd/d19/f4a to d1/dd/d26/d7b/f7d 0 2023-10-08T08:45:56.617 INFO:tasks.workunit.client.0.smithi070.stdout:8/650: truncate d1/de/d2e/d45/d7b/fd3 4110245 0 2023-10-08T08:45:56.617 INFO:tasks.workunit.client.0.smithi070.stdout:8/651: write d1/de/d3a/d92/fad [540167,44530] 0 2023-10-08T08:45:56.619 INFO:tasks.workunit.client.0.smithi070.stdout:6/552: dread df/d53/f5e [0,4194304] 0 2023-10-08T08:45:56.619 INFO:tasks.workunit.client.0.smithi070.stdout:2/778: creat df/d12/d1b/d82/d85/d65/ffa x:0 0 0 2023-10-08T08:45:56.619 INFO:tasks.workunit.client.0.smithi070.stdout:6/553: write df/d26/d42/d43/d4a/d75/d7e/f98 [35153,67729] 0 2023-10-08T08:45:56.621 INFO:tasks.workunit.client.0.smithi070.stdout:8/652: rmdir d1/de/d3a/d56/dc7 0 2023-10-08T08:45:56.621 INFO:tasks.workunit.client.0.smithi070.stdout:8/653: write d1/d4d/d61/fa2 [557326,96899] 0 2023-10-08T08:45:56.621 INFO:tasks.workunit.client.0.smithi070.stdout:8/654: chown d1/d2/d6/l9 59570 1 2023-10-08T08:45:56.621 INFO:tasks.workunit.client.0.smithi070.stdout:9/433: write d1/dd/d19/d38/f42 [45220,86474] 0 2023-10-08T08:45:56.622 INFO:tasks.workunit.client.0.smithi070.stdout:9/434: fdatasync d1/dd/d1a/f1d 0 2023-10-08T08:45:56.623 INFO:tasks.workunit.client.0.smithi070.stdout:8/655: unlink d1/d2/f31 0 2023-10-08T08:45:56.639 INFO:tasks.workunit.client.0.smithi070.stdout:2/779: dread df/d4c/f9c [0,4194304] 0 2023-10-08T08:45:56.641 INFO:tasks.workunit.client.0.smithi070.stdout:0/788: dread d1/d14/d1f/fad [0,4194304] 0 2023-10-08T08:45:56.643 INFO:tasks.workunit.client.0.smithi070.stdout:0/789: mknod d1/d76/d7a/cfd 0 2023-10-08T08:45:56.643 INFO:tasks.workunit.client.0.smithi070.stdout:0/790: chown d1/dd/f3d 218303281 1 2023-10-08T08:45:56.643 INFO:tasks.workunit.client.0.smithi070.stdout:0/791: chown d1/d62/d54/l81 1501 1 2023-10-08T08:45:56.646 INFO:tasks.workunit.client.0.smithi070.stdout:9/435: dwrite d1/dd/d26/d27/f44 [0,4194304] 0 2023-10-08T08:45:56.648 INFO:tasks.workunit.client.0.smithi070.stdout:3/715: dwrite d0/db/d10/d38/d63/fc7 [0,4194304] 0 2023-10-08T08:45:56.648 INFO:tasks.workunit.client.0.smithi070.stdout:8/656: dwrite d1/d2/d6/d22/d5b/fcf [0,4194304] 0 2023-10-08T08:45:56.648 INFO:tasks.workunit.client.0.smithi070.stdout:8/657: truncate d1/d2/d6/d22/d5b/fd5 983953 0 2023-10-08T08:45:56.650 INFO:tasks.workunit.client.0.smithi070.stdout:9/436: write d1/dd/f18 [1330755,70190] 0 2023-10-08T08:45:56.653 INFO:tasks.workunit.client.0.smithi070.stdout:8/658: creat d1/de/d2e/d45/fd9 x:0 0 0 2023-10-08T08:45:56.654 INFO:tasks.workunit.client.0.smithi070.stdout:9/437: creat d1/dd/d26/d27/d2d/f7e x:0 0 0 2023-10-08T08:45:56.655 INFO:tasks.workunit.client.0.smithi070.stdout:8/659: link d1/d2/d6/d22/d9e/caf d1/d2/d6/d22/d5b/d74/cda 0 2023-10-08T08:45:56.656 INFO:tasks.workunit.client.0.smithi070.stdout:8/660: chown d1/de/d1a/l36 102046 1 2023-10-08T08:45:56.666 INFO:tasks.workunit.client.0.smithi070.stdout:8/661: read d1/de/d1a/fc1 [173219,56490] 0 2023-10-08T08:45:56.666 INFO:tasks.workunit.client.0.smithi070.stdout:0/792: dread d1/d1d/d4d/d9d/f4f [0,4194304] 0 2023-10-08T08:45:56.666 INFO:tasks.workunit.client.0.smithi070.stdout:0/793: chown d1/d1d/d24/df4/c9f 1273743 1 2023-10-08T08:45:56.666 INFO:tasks.workunit.client.0.smithi070.stdout:2/780: dwrite df/d12/d15/d54/db1/f2a [0,4194304] 0 2023-10-08T08:45:56.668 INFO:tasks.workunit.client.0.smithi070.stdout:0/794: truncate d1/d1d/d24/df4/f34 5801050 0 2023-10-08T08:45:56.668 INFO:tasks.workunit.client.0.smithi070.stdout:0/795: chown d1/fc5 143586 1 2023-10-08T08:45:56.668 INFO:tasks.workunit.client.0.smithi070.stdout:2/781: truncate df/d12/d1b/d82/d85/d65/fb3 193903 0 2023-10-08T08:45:56.670 INFO:tasks.workunit.client.0.smithi070.stdout:3/716: dwrite d0/d12/d14/d5c/d5d/da0/d86/f9f [0,4194304] 0 2023-10-08T08:45:56.670 INFO:tasks.workunit.client.0.smithi070.stdout:0/796: creat d1/d1d/ffe x:0 0 0 2023-10-08T08:45:56.671 INFO:tasks.workunit.client.0.smithi070.stdout:2/782: getdents df/d12/d1b/d1c/d79 0 2023-10-08T08:45:56.673 INFO:tasks.workunit.client.0.smithi070.stdout:0/797: unlink d1/d1d/l41 0 2023-10-08T08:45:56.674 INFO:tasks.workunit.client.0.smithi070.stdout:8/662: write d1/fb [8118816,88849] 0 2023-10-08T08:45:56.675 INFO:tasks.workunit.client.0.smithi070.stdout:3/717: rename d0/d12/f9a to d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/de1/f102 0 2023-10-08T08:45:56.676 INFO:tasks.workunit.client.0.smithi070.stdout:2/783: creat df/d12/d1b/d1c/d79/da4/ffb x:0 0 0 2023-10-08T08:45:56.677 INFO:tasks.workunit.client.0.smithi070.stdout:8/663: creat d1/de/d2e/d45/d80/fdb x:0 0 0 2023-10-08T08:45:56.677 INFO:tasks.workunit.client.0.smithi070.stdout:0/798: unlink d1/d14/f35 0 2023-10-08T08:45:56.677 INFO:tasks.workunit.client.0.smithi070.stdout:0/799: readlink d1/d14/d1f/d6f/lf1 0 2023-10-08T08:45:56.678 INFO:tasks.workunit.client.0.smithi070.stdout:0/800: write d1/dd/f53 [6327236,28707] 0 2023-10-08T08:45:56.678 INFO:tasks.workunit.client.0.smithi070.stdout:8/664: mkdir d1/d23/ddc 0 2023-10-08T08:45:56.678 INFO:tasks.workunit.client.0.smithi070.stdout:8/665: chown d1/d2 1 1 2023-10-08T08:45:56.680 INFO:tasks.workunit.client.0.smithi070.stdout:8/666: symlink d1/d2/d6/d22/d5c/ldd 0 2023-10-08T08:45:56.680 INFO:tasks.workunit.client.0.smithi070.stdout:0/801: mkdir d1/d14/dff 0 2023-10-08T08:45:56.682 INFO:tasks.workunit.client.0.smithi070.stdout:8/667: unlink d1/d2/d6/d22/d5c/l90 0 2023-10-08T08:45:56.682 INFO:tasks.workunit.client.0.smithi070.stdout:8/668: fdatasync d1/d2/d8c/f85 0 2023-10-08T08:45:56.683 INFO:tasks.workunit.client.0.smithi070.stdout:8/669: chown d1/de/d2e/d45/d7b/dd7/ld1 156 1 2023-10-08T08:45:56.683 INFO:tasks.workunit.client.0.smithi070.stdout:9/438: dwrite d1/f4b [0,4194304] 0 2023-10-08T08:45:56.683 INFO:tasks.workunit.client.0.smithi070.stdout:9/439: chown d1/f25 466285 1 2023-10-08T08:45:56.685 INFO:tasks.workunit.client.0.smithi070.stdout:8/670: unlink d1/de/d2e/d45/d7b/f82 0 2023-10-08T08:45:56.688 INFO:tasks.workunit.client.0.smithi070.stdout:9/440: dread d1/f74 [0,4194304] 0 2023-10-08T08:45:56.689 INFO:tasks.workunit.client.0.smithi070.stdout:8/671: mkdir d1/d2/d6/d22/d5b/dde 0 2023-10-08T08:45:56.690 INFO:tasks.workunit.client.0.smithi070.stdout:9/441: truncate d1/dd/f11 1130820 0 2023-10-08T08:45:56.695 INFO:tasks.workunit.client.0.smithi070.stdout:8/672: link d1/d2/d6/d22/d5b/l97 d1/d2/d6/d22/d5b/ldf 0 2023-10-08T08:45:56.695 INFO:tasks.workunit.client.0.smithi070.stdout:8/673: fdatasync d1/d4d/f84 0 2023-10-08T08:45:56.697 INFO:tasks.workunit.client.0.smithi070.stdout:4/496: sync 2023-10-08T08:45:56.697 INFO:tasks.workunit.client.0.smithi070.stdout:4/497: write dc/d17/d24/f49 [1088133,99754] 0 2023-10-08T08:45:56.697 INFO:tasks.workunit.client.0.smithi070.stdout:4/498: write dc/d17/d1f/f36 [717349,29629] 0 2023-10-08T08:45:56.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:56 smithi070 ceph-mon[99513]: pgmap v355: 129 pgs: 129 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 37 MiB/s wr, 100 op/s 2023-10-08T08:45:56.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:56 smithi105 ceph-mon[103798]: pgmap v355: 129 pgs: 129 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 37 MiB/s wr, 100 op/s 2023-10-08T08:45:56.773 INFO:tasks.workunit.client.0.smithi070.stdout:2/784: dwrite df/d12/d15/d54/db1/f72 [0,4194304] 0 2023-10-08T08:45:56.776 INFO:tasks.workunit.client.0.smithi070.stdout:2/785: read df/d73/f7f [1454864,72159] 0 2023-10-08T08:45:56.776 INFO:tasks.workunit.client.0.smithi070.stdout:3/718: dwrite d0/db/fd [4194304,4194304] 0 2023-10-08T08:45:56.777 INFO:tasks.workunit.client.0.smithi070.stdout:0/802: dwrite d1/fc5 [0,4194304] 0 2023-10-08T08:45:56.780 INFO:tasks.workunit.client.0.smithi070.stdout:2/786: rmdir df/d12 39 2023-10-08T08:45:56.780 INFO:tasks.workunit.client.0.smithi070.stdout:2/787: dread - df/d12/d1b/d1c/d79/da4/ffb zero size 2023-10-08T08:45:56.783 INFO:tasks.workunit.client.0.smithi070.stdout:3/719: truncate d0/d12/d14/d5c/d5d/da0/d86/f9f 3455703 0 2023-10-08T08:45:56.783 INFO:tasks.workunit.client.0.smithi070.stdout:3/720: getdents d0/d12/d14/d5c/db1/dbe/d100 0 2023-10-08T08:45:56.783 INFO:tasks.workunit.client.0.smithi070.stdout:9/442: dwrite d1/dd/d26/d27/d2d/f7e [0,4194304] 0 2023-10-08T08:45:56.784 INFO:tasks.workunit.client.0.smithi070.stdout:8/674: dwrite d1/d2/d6/d22/fcb [0,4194304] 0 2023-10-08T08:45:56.785 INFO:tasks.workunit.client.0.smithi070.stdout:3/721: mknod d0/db/d10/d6d/c103 0 2023-10-08T08:45:56.788 INFO:tasks.workunit.client.0.smithi070.stdout:3/722: creat d0/d12/d14/d5c/dc4/f104 x:0 0 0 2023-10-08T08:45:56.792 INFO:tasks.workunit.client.0.smithi070.stdout:3/723: unlink d0/db/d10/f2c 0 2023-10-08T08:45:56.794 INFO:tasks.workunit.client.0.smithi070.stdout:8/675: write d1/d23/f43 [1645833,3093] 0 2023-10-08T08:45:56.795 INFO:tasks.workunit.client.0.smithi070.stdout:3/724: mknod d0/db/c105 0 2023-10-08T08:45:56.795 INFO:tasks.workunit.client.0.smithi070.stdout:8/676: creat d1/de/d3a/d56/d86/fe0 x:0 0 0 2023-10-08T08:45:56.799 INFO:tasks.workunit.client.0.smithi070.stdout:3/725: mknod d0/d12/d14/d5c/d5d/da0/d101/d52/c106 0 2023-10-08T08:45:56.799 INFO:tasks.workunit.client.0.smithi070.stdout:8/677: truncate d1/d2/f1e 649237 0 2023-10-08T08:45:56.800 INFO:tasks.workunit.client.0.smithi070.stdout:8/678: fsync d1/d2/d6/d22/d5c/f6f 0 2023-10-08T08:45:56.801 INFO:tasks.workunit.client.0.smithi070.stdout:3/726: rename d0/d12/d14/d1d/l7d to d0/d12/d14/d5c/d5d/da0/d101/d52/l107 0 2023-10-08T08:45:56.801 INFO:tasks.workunit.client.0.smithi070.stdout:0/803: dwrite d1/d1d/d4d/fdb [0,4194304] 0 2023-10-08T08:45:56.802 INFO:tasks.workunit.client.0.smithi070.stdout:2/788: dwrite df/d12/d1b/f8c [0,4194304] 0 2023-10-08T08:45:56.802 INFO:tasks.workunit.client.0.smithi070.stdout:2/789: stat df/d12/d1b/d82/d85/d65/da0/lf1 0 2023-10-08T08:45:56.804 INFO:tasks.workunit.client.0.smithi070.stdout:2/790: symlink df/d12/d1b/d1c/lfc 0 2023-10-08T08:45:56.808 INFO:tasks.workunit.client.0.smithi070.stdout:2/791: dread df/d4c/d91/f99 [0,4194304] 0 2023-10-08T08:45:56.808 INFO:tasks.workunit.client.0.smithi070.stdout:2/792: fdatasync df/d12/d15/d54/db1/d83/d92/fef 0 2023-10-08T08:45:56.809 INFO:tasks.workunit.client.0.smithi070.stdout:2/793: chown df/d12/d1b/l4d 24444125 1 2023-10-08T08:45:56.809 INFO:tasks.workunit.client.0.smithi070.stdout:2/794: write df/fe7 [989939,105392] 0 2023-10-08T08:45:56.810 INFO:tasks.workunit.client.0.smithi070.stdout:9/443: dwrite d1/dd/d1a/d40/f4e [0,4194304] 0 2023-10-08T08:45:56.811 INFO:tasks.workunit.client.0.smithi070.stdout:2/795: rmdir df/d12/d1b/d1c/d79/da4/dc7 0 2023-10-08T08:45:56.815 INFO:tasks.workunit.client.0.smithi070.stdout:5/616: sync 2023-10-08T08:45:56.815 INFO:tasks.workunit.client.0.smithi070.stdout:7/631: sync 2023-10-08T08:45:56.816 INFO:tasks.workunit.client.0.smithi070.stdout:0/804: dread d1/d14/d1f/f42 [0,4194304] 0 2023-10-08T08:45:56.817 INFO:tasks.workunit.client.0.smithi070.stdout:2/796: dread df/d12/d15/f16 [0,4194304] 0 2023-10-08T08:45:56.818 INFO:tasks.workunit.client.0.smithi070.stdout:9/444: write d1/dd/d26/d7b/f7d [2088457,80993] 0 2023-10-08T08:45:56.818 INFO:tasks.workunit.client.0.smithi070.stdout:9/445: chown d1/dd/d26/d27/f65 101019 1 2023-10-08T08:45:56.818 INFO:tasks.workunit.client.0.smithi070.stdout:8/679: rename d1/de to d1/d2/d6/d22/d5b/d74/de1 0 2023-10-08T08:45:56.819 INFO:tasks.workunit.client.0.smithi070.stdout:7/632: rename d3/d79/c86 to d3/d19/d6d/dd7/cd9 0 2023-10-08T08:45:56.819 INFO:tasks.workunit.client.0.smithi070.stdout:3/727: dread d0/d12/d14/f2a [8388608,4194304] 0 2023-10-08T08:45:56.819 INFO:tasks.workunit.client.0.smithi070.stdout:3/728: fdatasync d0/db/d10/f9c 0 2023-10-08T08:45:56.822 INFO:tasks.workunit.client.0.smithi070.stdout:5/617: write d5/d5f/f78 [1944010,67439] 0 2023-10-08T08:45:56.822 INFO:tasks.workunit.client.0.smithi070.stdout:2/797: rename df/d3a/c9d to df/d12/d15/cfd 0 2023-10-08T08:45:56.822 INFO:tasks.workunit.client.0.smithi070.stdout:5/618: write d5/da/d4d/d37/d38/dc3/fcb [213375,49251] 0 2023-10-08T08:45:56.823 INFO:tasks.workunit.client.0.smithi070.stdout:7/633: rmdir d3/da9/d1e 39 2023-10-08T08:45:56.824 INFO:tasks.workunit.client.0.smithi070.stdout:7/634: write d3/da9/d4a/d9/da4/fb3 [343207,100086] 0 2023-10-08T08:45:56.826 INFO:tasks.workunit.client.0.smithi070.stdout:7/635: creat d3/da9/d4a/d9/d97/fda x:0 0 0 2023-10-08T08:45:56.850 INFO:tasks.workunit.client.0.smithi070.stdout:7/636: write d3/f55 [2361573,93827] 0 2023-10-08T08:45:56.852 INFO:tasks.workunit.client.0.smithi070.stdout:3/729: dwrite d0/db/d10/f1e [0,4194304] 0 2023-10-08T08:45:56.852 INFO:tasks.workunit.client.0.smithi070.stdout:3/730: fsync d0/d12/f7c 0 2023-10-08T08:45:56.853 INFO:tasks.workunit.client.0.smithi070.stdout:7/637: mkdir d3/da9/d4a/d9/da4/dd6/ddb 0 2023-10-08T08:45:56.853 INFO:tasks.workunit.client.0.smithi070.stdout:7/638: readlink d3/d77/l92 0 2023-10-08T08:45:56.853 INFO:tasks.workunit.client.0.smithi070.stdout:7/639: readlink d3/d19/l9e 0 2023-10-08T08:45:56.853 INFO:tasks.workunit.client.0.smithi070.stdout:3/731: dread d0/d12/d14/d5c/d5d/da0/d101/f33 [0,4194304] 0 2023-10-08T08:45:56.854 INFO:tasks.workunit.client.0.smithi070.stdout:7/640: link d3/l75 d3/da9/d4a/ldc 0 2023-10-08T08:45:56.856 INFO:tasks.workunit.client.0.smithi070.stdout:8/680: dwrite d1/d2/d6/fcc [4194304,4194304] 0 2023-10-08T08:45:56.856 INFO:tasks.workunit.client.0.smithi070.stdout:8/681: chown d1/d2/d6/d22/d5b/d74/de1/d15/l16 761 1 2023-10-08T08:45:56.857 INFO:tasks.workunit.client.0.smithi070.stdout:2/798: dwrite df/d12/d1b/d1c/d2d/f58 [0,4194304] 0 2023-10-08T08:45:56.859 INFO:tasks.workunit.client.0.smithi070.stdout:9/446: dwrite d1/dd/d1a/f1c [0,4194304] 0 2023-10-08T08:45:56.861 INFO:tasks.workunit.client.0.smithi070.stdout:5/619: dwrite d5/d5f/d63/d8b/d8f/fc1 [0,4194304] 0 2023-10-08T08:45:56.865 INFO:tasks.workunit.client.0.smithi070.stdout:5/620: creat d5/da/d22/fcf x:0 0 0 2023-10-08T08:45:56.865 INFO:tasks.workunit.client.0.smithi070.stdout:5/621: dread - d5/d5f/d61/d30/d54/d62/dae/fb0 zero size 2023-10-08T08:45:56.865 INFO:tasks.workunit.client.0.smithi070.stdout:5/622: fdatasync d5/da/f16 0 2023-10-08T08:45:56.867 INFO:tasks.workunit.client.0.smithi070.stdout:3/732: dread d0/d12/d14/d1d/f5e [0,4194304] 0 2023-10-08T08:45:56.868 INFO:tasks.workunit.client.0.smithi070.stdout:3/733: truncate d0/d12/d14/f1c 1998213 0 2023-10-08T08:45:56.870 INFO:tasks.workunit.client.0.smithi070.stdout:3/734: creat d0/d12/d14/d5c/d5d/da0/d6a/d80/f108 x:0 0 0 2023-10-08T08:45:56.872 INFO:tasks.workunit.client.0.smithi070.stdout:3/735: rmdir d0/d12/d14/d5c/d5d/da0 39 2023-10-08T08:45:56.878 INFO:tasks.workunit.client.0.smithi070.stdout:5/623: dread d5/da/d4d/d37/f2b [0,4194304] 0 2023-10-08T08:45:56.878 INFO:tasks.workunit.client.0.smithi070.stdout:5/624: chown d5/f26 45311 1 2023-10-08T08:45:56.890 INFO:tasks.workunit.client.0.smithi070.stdout:7/641: write d3/d19/d1a/f70 [3077996,2825] 0 2023-10-08T08:45:56.890 INFO:tasks.workunit.client.0.smithi070.stdout:7/642: truncate d3/f71 5269648 0 2023-10-08T08:45:56.890 INFO:tasks.workunit.client.0.smithi070.stdout:2/799: dwrite df/d12/d1b/d1c/f64 [0,4194304] 0 2023-10-08T08:45:56.893 INFO:tasks.workunit.client.0.smithi070.stdout:7/643: mkdir d3/d19/d95/da3/dc8/ddd 0 2023-10-08T08:45:56.894 INFO:tasks.workunit.client.0.smithi070.stdout:6/554: sync 2023-10-08T08:45:56.894 INFO:tasks.workunit.client.0.smithi070.stdout:1/678: sync 2023-10-08T08:45:56.895 INFO:tasks.workunit.client.0.smithi070.stdout:7/644: rename d3/da9/d4a/d9/c84 to d3/da9/d4a/d9/da4/cde 0 2023-10-08T08:45:56.896 INFO:tasks.workunit.client.0.smithi070.stdout:9/447: dwrite d1/dd/f61 [4194304,4194304] 0 2023-10-08T08:45:56.896 INFO:tasks.workunit.client.0.smithi070.stdout:1/679: truncate d6/dc/d14/d1f/d63/fa9 395893 0 2023-10-08T08:45:56.898 INFO:tasks.workunit.client.0.smithi070.stdout:5/625: dwrite d5/da/d22/f47 [4194304,4194304] 0 2023-10-08T08:45:56.901 INFO:tasks.workunit.client.0.smithi070.stdout:5/626: rename d5/da/d22/fc7 to d5/da/d4d/d37/d38/fd0 0 2023-10-08T08:45:56.903 INFO:tasks.workunit.client.0.smithi070.stdout:1/680: mknod d6/dc/d14/d62/d95/cde 0 2023-10-08T08:45:56.903 INFO:tasks.workunit.client.0.smithi070.stdout:6/555: creat df/d26/d42/d43/d4a/d75/fb4 x:0 0 0 2023-10-08T08:45:56.903 INFO:tasks.workunit.client.0.smithi070.stdout:6/556: stat df/d26/d42/db1/f3d 0 2023-10-08T08:45:56.906 INFO:tasks.workunit.client.0.smithi070.stdout:6/557: symlink df/d71/lb5 0 2023-10-08T08:45:56.906 INFO:tasks.workunit.client.0.smithi070.stdout:6/558: fdatasync df/d26/d42/d4b/d80/d94/fad 0 2023-10-08T08:45:56.909 INFO:tasks.workunit.client.0.smithi070.stdout:1/681: dread d6/dc/f2d [4194304,4194304] 0 2023-10-08T08:45:56.910 INFO:tasks.workunit.client.0.smithi070.stdout:6/559: write df/d11/f1a [1681706,99427] 0 2023-10-08T08:45:56.914 INFO:tasks.workunit.client.0.smithi070.stdout:6/560: read df/d26/d78/d90/daa/fb0 [104950,113149] 0 2023-10-08T08:45:56.915 INFO:tasks.workunit.client.0.smithi070.stdout:2/800: dwrite df/f20 [0,4194304] 0 2023-10-08T08:45:56.915 INFO:tasks.workunit.client.0.smithi070.stdout:2/801: chown df/d12/d15/fe9 29783313 1 2023-10-08T08:45:56.915 INFO:tasks.workunit.client.0.smithi070.stdout:2/802: write fa [4611362,101450] 0 2023-10-08T08:45:56.915 INFO:tasks.workunit.client.0.smithi070.stdout:2/803: readlink df/l13 0 2023-10-08T08:45:56.918 INFO:tasks.workunit.client.0.smithi070.stdout:2/804: rename df/d12/d15/f16 to df/d12/d15/d54/db1/d83/d92/ffe 0 2023-10-08T08:45:56.919 INFO:tasks.workunit.client.0.smithi070.stdout:6/561: getdents df/d26/d42/d55/d74/d7d 0 2023-10-08T08:45:56.921 INFO:tasks.workunit.client.0.smithi070.stdout:2/805: creat df/d12/d7e/fff x:0 0 0 2023-10-08T08:45:56.923 INFO:tasks.workunit.client.0.smithi070.stdout:9/448: dwrite d1/dd/d1a/d40/f4e [0,4194304] 0 2023-10-08T08:45:56.925 INFO:tasks.workunit.client.0.smithi070.stdout:9/449: truncate d1/dd/f11 482119 0 2023-10-08T08:45:56.925 INFO:tasks.workunit.client.0.smithi070.stdout:9/450: fdatasync d1/f25 0 2023-10-08T08:45:56.930 INFO:tasks.workunit.client.0.smithi070.stdout:7/645: dwrite d3/d19/d1a/f40 [0,4194304] 0 2023-10-08T08:45:56.930 INFO:tasks.workunit.client.0.smithi070.stdout:7/646: write d3/f96 [4838249,91504] 0 2023-10-08T08:45:56.932 INFO:tasks.workunit.client.0.smithi070.stdout:6/562: rename df/d26/d42/d55/d74 to df/d26/d42/d4b/db6 0 2023-10-08T08:45:56.932 INFO:tasks.workunit.client.0.smithi070.stdout:6/563: fdatasync df/d26/d42/d4b/f56 0 2023-10-08T08:45:56.934 INFO:tasks.workunit.client.0.smithi070.stdout:7/647: creat d3/da9/d4a/d50/d9f/dc5/fdf x:0 0 0 2023-10-08T08:45:56.934 INFO:tasks.workunit.client.0.smithi070.stdout:7/648: chown d3/d19/d6d/dd7 362 1 2023-10-08T08:45:56.934 INFO:tasks.workunit.client.0.smithi070.stdout:5/627: dwrite d5/d5f/d61/d30/d54/dab/fb5 [0,4194304] 0 2023-10-08T08:45:56.934 INFO:tasks.workunit.client.0.smithi070.stdout:7/649: write d3/da9/d1e/fbc [1420,73324] 0 2023-10-08T08:45:56.935 INFO:tasks.workunit.client.0.smithi070.stdout:1/682: dwrite d6/dc/d14/f80 [0,4194304] 0 2023-10-08T08:45:56.935 INFO:tasks.workunit.client.0.smithi070.stdout:1/683: fsync d6/dc/d14/d1f/d63/db3/d38/d4b/fab 0 2023-10-08T08:45:56.937 INFO:tasks.workunit.client.0.smithi070.stdout:1/684: chown d6/dc/d14/d1f/f2b 49310 1 2023-10-08T08:45:56.938 INFO:tasks.workunit.client.0.smithi070.stdout:6/564: creat df/d26/d78/d90/fb7 x:0 0 0 2023-10-08T08:45:56.938 INFO:tasks.workunit.client.0.smithi070.stdout:5/628: creat d5/d5f/d61/d30/d54/dab/fd1 x:0 0 0 2023-10-08T08:45:56.940 INFO:tasks.workunit.client.0.smithi070.stdout:6/565: getdents df/d53 0 2023-10-08T08:45:56.940 INFO:tasks.workunit.client.0.smithi070.stdout:6/566: write f5 [1341141,71167] 0 2023-10-08T08:45:56.940 INFO:tasks.workunit.client.0.smithi070.stdout:6/567: stat df/d11/f65 0 2023-10-08T08:45:56.950 INFO:tasks.workunit.client.0.smithi070.stdout:9/451: dwrite d1/dd/d1a/f1c [0,4194304] 0 2023-10-08T08:45:56.950 INFO:tasks.workunit.client.0.smithi070.stdout:9/452: dread - d1/dd/d19/f67 zero size 2023-10-08T08:45:56.954 INFO:tasks.workunit.client.0.smithi070.stdout:2/806: rename df/d12/d15/d54/db1 to df/d12/d1b/d1c/d69/d100 0 2023-10-08T08:45:56.955 INFO:tasks.workunit.client.0.smithi070.stdout:9/453: symlink d1/dd/d26/d27/d2d/l7f 0 2023-10-08T08:45:56.957 INFO:tasks.workunit.client.0.smithi070.stdout:2/807: creat df/d12/d1b/d82/f101 x:0 0 0 2023-10-08T08:45:56.957 INFO:tasks.workunit.client.0.smithi070.stdout:9/454: truncate d1/dd/d1a/f1d 168066 0 2023-10-08T08:45:56.962 INFO:tasks.workunit.client.0.smithi070.stdout:5/629: dwrite d5/da/d22/fcf [0,4194304] 0 2023-10-08T08:45:56.967 INFO:tasks.workunit.client.0.smithi070.stdout:5/630: truncate d5/da/f16 436664 0 2023-10-08T08:45:56.975 INFO:tasks.workunit.client.0.smithi070.stdout:6/568: dwrite f2 [0,4194304] 0 2023-10-08T08:45:56.975 INFO:tasks.workunit.client.0.smithi070.stdout:6/569: fsync df/d26/f9f 0 2023-10-08T08:45:56.975 INFO:tasks.workunit.client.0.smithi070.stdout:6/570: readlink df/d71/lb5 0 2023-10-08T08:45:56.975 INFO:tasks.workunit.client.0.smithi070.stdout:6/571: write df/d26/d78/d90/fb7 [544873,94795] 0 2023-10-08T08:45:56.976 INFO:tasks.workunit.client.0.smithi070.stdout:7/650: dwrite d3/da9/d1e/d76/fb7 [0,4194304] 0 2023-10-08T08:45:56.978 INFO:tasks.workunit.client.0.smithi070.stdout:2/808: dread df/d12/d15/d54/fe3 [0,4194304] 0 2023-10-08T08:45:56.982 INFO:tasks.workunit.client.0.smithi070.stdout:7/651: creat d3/da9/d1e/fe0 x:0 0 0 2023-10-08T08:45:56.983 INFO:tasks.workunit.client.0.smithi070.stdout:2/809: dread df/d4c/f6d [0,4194304] 0 2023-10-08T08:45:56.984 INFO:tasks.workunit.client.0.smithi070.stdout:7/652: rmdir d3/da9/d1e/d76 39 2023-10-08T08:45:56.985 INFO:tasks.workunit.client.0.smithi070.stdout:2/810: mkdir df/d12/d1b/d1c/d69/d100/d83/d92/d102 0 2023-10-08T08:45:56.986 INFO:tasks.workunit.client.0.smithi070.stdout:9/455: dwrite d1/dd/d19/d38/f42 [0,4194304] 0 2023-10-08T08:45:56.987 INFO:tasks.workunit.client.0.smithi070.stdout:9/456: readlink d1/dd/d1a/l2e 0 2023-10-08T08:45:56.987 INFO:tasks.workunit.client.0.smithi070.stdout:9/457: readlink d1/dd/lf 0 2023-10-08T08:45:56.987 INFO:tasks.workunit.client.0.smithi070.stdout:9/458: write d1/dd/d19/f79 [37125,41460] 0 2023-10-08T08:45:56.989 INFO:tasks.workunit.client.0.smithi070.stdout:2/811: rmdir df/d12/d1b/d1c/d69/d100/d83/d92/dc1 0 2023-10-08T08:45:56.993 INFO:tasks.workunit.client.0.smithi070.stdout:2/812: creat df/d12/d15/f103 x:0 0 0 2023-10-08T08:45:56.995 INFO:tasks.workunit.client.0.smithi070.stdout:5/631: dwrite d5/d5f/d61/f9c [0,4194304] 0 2023-10-08T08:45:56.995 INFO:tasks.workunit.client.0.smithi070.stdout:2/813: mkdir df/d12/d7e/dc9/d104 0 2023-10-08T08:45:56.996 INFO:tasks.workunit.client.0.smithi070.stdout:4/499: sync 2023-10-08T08:45:56.998 INFO:tasks.workunit.client.0.smithi070.stdout:5/632: symlink d5/d5f/d61/d30/ld2 0 2023-10-08T08:45:56.998 INFO:tasks.workunit.client.0.smithi070.stdout:4/500: rename dc/d17/d24/d4c/l92 to dc/l9a 0 2023-10-08T08:45:56.999 INFO:tasks.workunit.client.0.smithi070.stdout:7/653: dread d3/f55 [0,4194304] 0 2023-10-08T08:45:56.999 INFO:tasks.workunit.client.0.smithi070.stdout:2/814: creat df/d12/d7e/f105 x:0 0 0 2023-10-08T08:45:57.000 INFO:tasks.workunit.client.0.smithi070.stdout:4/501: creat dc/d17/d24/d4c/f9b x:0 0 0 2023-10-08T08:45:57.000 INFO:tasks.workunit.client.0.smithi070.stdout:4/502: write dc/f1e [1249057,35678] 0 2023-10-08T08:45:57.001 INFO:tasks.workunit.client.0.smithi070.stdout:4/503: mknod dc/d5f/c9c 0 2023-10-08T08:45:57.001 INFO:tasks.workunit.client.0.smithi070.stdout:7/654: write d3/d19/d1a/f22 [1386021,59332] 0 2023-10-08T08:45:57.002 INFO:tasks.workunit.client.0.smithi070.stdout:2/815: mkdir df/d12/d7e/d106 0 2023-10-08T08:45:57.002 INFO:tasks.workunit.client.0.smithi070.stdout:2/816: fdatasync df/d12/d1b/d1c/d69/d100/fa7 0 2023-10-08T08:45:57.002 INFO:tasks.workunit.client.0.smithi070.stdout:2/817: readlink df/d12/d1b/d1c/le8 0 2023-10-08T08:45:57.005 INFO:tasks.workunit.client.0.smithi070.stdout:7/655: write d3/f2e [826168,127147] 0 2023-10-08T08:45:57.009 INFO:tasks.workunit.client.0.smithi070.stdout:2/818: mkdir df/d93/dc2/dae/d107 0 2023-10-08T08:45:57.009 INFO:tasks.workunit.client.0.smithi070.stdout:6/572: dwrite df/d26/d42/d4b/f5b [0,4194304] 0 2023-10-08T08:45:57.009 INFO:tasks.workunit.client.0.smithi070.stdout:6/573: readlink df/d11/l57 0 2023-10-08T08:45:57.011 INFO:tasks.workunit.client.0.smithi070.stdout:9/459: dwrite d1/dd/d19/d38/d4f/f59 [0,4194304] 0 2023-10-08T08:45:57.011 INFO:tasks.workunit.client.0.smithi070.stdout:9/460: fsync d1/dd/d19/f1b 0 2023-10-08T08:45:57.011 INFO:tasks.workunit.client.0.smithi070.stdout:7/656: truncate d3/da9/d4a/d9/d97/fa0 723363 0 2023-10-08T08:45:57.011 INFO:tasks.workunit.client.0.smithi070.stdout:7/657: dread - d3/da9/d4a/d9/d97/fda zero size 2023-10-08T08:45:57.011 INFO:tasks.workunit.client.0.smithi070.stdout:7/658: chown d3/d77/ccb 26002104 1 2023-10-08T08:45:57.013 INFO:tasks.workunit.client.0.smithi070.stdout:2/819: symlink df/l108 0 2023-10-08T08:45:57.013 INFO:tasks.workunit.client.0.smithi070.stdout:2/820: stat df/d3a 0 2023-10-08T08:45:57.015 INFO:tasks.workunit.client.0.smithi070.stdout:2/821: creat df/d3a/db6/f109 x:0 0 0 2023-10-08T08:45:57.017 INFO:tasks.workunit.client.0.smithi070.stdout:6/574: getdents df 0 2023-10-08T08:45:57.019 INFO:tasks.workunit.client.0.smithi070.stdout:2/822: creat df/d93/dc2/dae/f10a x:0 0 0 2023-10-08T08:45:57.021 INFO:tasks.workunit.client.0.smithi070.stdout:6/575: creat df/d26/d78/fb8 x:0 0 0 2023-10-08T08:45:57.021 INFO:tasks.workunit.client.0.smithi070.stdout:6/576: chown df/f23 3806824 1 2023-10-08T08:45:57.025 INFO:tasks.workunit.client.0.smithi070.stdout:2/823: symlink df/d12/d1b/d82/d85/d65/l10b 0 2023-10-08T08:45:57.027 INFO:tasks.workunit.client.0.smithi070.stdout:5/633: dwrite d5/d5f/d63/d8b/f9e [0,4194304] 0 2023-10-08T08:45:57.030 INFO:tasks.workunit.client.0.smithi070.stdout:5/634: symlink d5/da/d4d/ld3 0 2023-10-08T08:45:57.031 INFO:tasks.workunit.client.0.smithi070.stdout:7/659: dread d3/da9/d1e/fab [0,4194304] 0 2023-10-08T08:45:57.032 INFO:tasks.workunit.client.0.smithi070.stdout:2/824: getdents df/d12/d1b/d82/d85/d65 0 2023-10-08T08:45:57.035 INFO:tasks.workunit.client.0.smithi070.stdout:2/825: mkdir df/d12/d7e/d10c 0 2023-10-08T08:45:57.040 INFO:tasks.workunit.client.0.smithi070.stdout:9/461: dread d1/dd/d1a/d40/f4e [0,4194304] 0 2023-10-08T08:45:57.040 INFO:tasks.workunit.client.0.smithi070.stdout:4/504: dwrite dc/d17/d24/d4c/d4e/f82 [0,4194304] 0 2023-10-08T08:45:57.041 INFO:tasks.workunit.client.0.smithi070.stdout:4/505: write dc/d17/d1f/f26 [4091604,106553] 0 2023-10-08T08:45:57.042 INFO:tasks.workunit.client.0.smithi070.stdout:4/506: fsync dc/d17/d24/d37/f3b 0 2023-10-08T08:45:57.042 INFO:tasks.workunit.client.0.smithi070.stdout:4/507: write dc/d17/d79/f98 [544909,34266] 0 2023-10-08T08:45:57.043 INFO:tasks.workunit.client.0.smithi070.stdout:4/508: symlink dc/d17/d24/d4c/d4e/l9d 0 2023-10-08T08:45:57.043 INFO:tasks.workunit.client.0.smithi070.stdout:4/509: fsync dc/d68/f83 0 2023-10-08T08:45:57.044 INFO:tasks.workunit.client.0.smithi070.stdout:4/510: symlink dc/d17/d24/d4c/d4e/l9e 0 2023-10-08T08:45:57.045 INFO:tasks.workunit.client.0.smithi070.stdout:9/462: write d1/dd/f61 [2420834,109919] 0 2023-10-08T08:45:57.046 INFO:tasks.workunit.client.0.smithi070.stdout:4/511: mkdir dc/d17/d1f/d5e/d9f 0 2023-10-08T08:45:57.046 INFO:tasks.workunit.client.0.smithi070.stdout:9/463: mknod d1/dd/d1a/d40/c80 0 2023-10-08T08:45:57.056 INFO:tasks.workunit.client.0.smithi070.stdout:4/512: read dc/f4b [2759584,29735] 0 2023-10-08T08:45:57.056 INFO:tasks.workunit.client.0.smithi070.stdout:4/513: write dc/f4b [4607838,71439] 0 2023-10-08T08:45:57.056 INFO:tasks.workunit.client.0.smithi070.stdout:4/514: chown dc/d5a 97093090 1 2023-10-08T08:45:57.056 INFO:tasks.workunit.client.0.smithi070.stdout:4/515: stat dc/d17/d24/d37/f53 0 2023-10-08T08:45:57.057 INFO:tasks.workunit.client.0.smithi070.stdout:4/516: chown dc/d17/d1f/d5e 14243 1 2023-10-08T08:45:57.057 INFO:tasks.workunit.client.0.smithi070.stdout:7/660: dwrite d3/da9/d4a/f83 [0,4194304] 0 2023-10-08T08:45:57.058 INFO:tasks.workunit.client.0.smithi070.stdout:4/517: creat dc/d17/d24/d55/fa0 x:0 0 0 2023-10-08T08:45:57.058 INFO:tasks.workunit.client.0.smithi070.stdout:9/464: write d1/dd/f61 [2818913,43669] 0 2023-10-08T08:45:57.059 INFO:tasks.workunit.client.0.smithi070.stdout:9/465: mkdir d1/dd/d1a/d81 0 2023-10-08T08:45:57.059 INFO:tasks.workunit.client.0.smithi070.stdout:4/518: mknod dc/ca1 0 2023-10-08T08:45:57.060 INFO:tasks.workunit.client.0.smithi070.stdout:7/661: write d3/da9/d4a/f8e [452213,64034] 0 2023-10-08T08:45:57.061 INFO:tasks.workunit.client.0.smithi070.stdout:4/519: rename dc/d17/d24/d37/f3a to dc/d5a/fa2 0 2023-10-08T08:45:57.062 INFO:tasks.workunit.client.0.smithi070.stdout:4/520: rename dc/d17/d24/d4c/d4e/c7e to dc/d68/ca3 0 2023-10-08T08:45:57.063 INFO:tasks.workunit.client.0.smithi070.stdout:4/521: mkdir dc/d17/d24/d55/da4 0 2023-10-08T08:45:57.086 INFO:tasks.workunit.client.0.smithi070.stdout:8/682: sync 2023-10-08T08:45:57.086 INFO:tasks.workunit.client.0.smithi070.stdout:3/736: sync 2023-10-08T08:45:57.086 INFO:tasks.workunit.client.0.smithi070.stdout:9/466: write d1/f25 [2437689,14534] 0 2023-10-08T08:45:57.086 INFO:tasks.workunit.client.0.smithi070.stdout:9/467: write d1/dd/d19/d38/f78 [617865,29057] 0 2023-10-08T08:45:57.087 INFO:tasks.workunit.client.0.smithi070.stdout:3/737: creat d0/d12/d14/d5c/f109 x:0 0 0 2023-10-08T08:45:57.087 INFO:tasks.workunit.client.0.smithi070.stdout:9/468: mkdir d1/dd/d39/d66/d82 0 2023-10-08T08:45:57.088 INFO:tasks.workunit.client.0.smithi070.stdout:9/469: chown d1/dd/d19/c3d 257611150 1 2023-10-08T08:45:57.088 INFO:tasks.workunit.client.0.smithi070.stdout:8/683: write d1/d2/d6/d22/d5c/d99/f9d [751725,18475] 0 2023-10-08T08:45:57.088 INFO:tasks.workunit.client.0.smithi070.stdout:3/738: creat d0/d12/d14/d5c/db1/f10a x:0 0 0 2023-10-08T08:45:57.091 INFO:tasks.workunit.client.0.smithi070.stdout:3/739: unlink d0/db/d10/d38/f50 0 2023-10-08T08:45:57.093 INFO:tasks.workunit.client.0.smithi070.stdout:3/740: mkdir d0/d12/d10b 0 2023-10-08T08:45:57.095 INFO:tasks.workunit.client.0.smithi070.stdout:3/741: rmdir d0/db/d10/d38/d63 39 2023-10-08T08:45:57.097 INFO:tasks.workunit.client.0.smithi070.stdout:3/742: rename d0/d12/d14/d5c/d5d/da0/d101/c57 to d0/d12/d14/d5c/df6/c10c 0 2023-10-08T08:45:57.099 INFO:tasks.workunit.client.0.smithi070.stdout:2/826: dwrite fb [0,4194304] 0 2023-10-08T08:45:57.101 INFO:tasks.workunit.client.0.smithi070.stdout:2/827: getdents df/d12/d1b/d82/d85 0 2023-10-08T08:45:57.109 INFO:tasks.workunit.client.0.smithi070.stdout:5/635: dwrite d5/d5f/d63/fbe [0,4194304] 0 2023-10-08T08:45:57.113 INFO:tasks.workunit.client.0.smithi070.stdout:4/522: write dc/d5a/fa2 [3904868,85059] 0 2023-10-08T08:45:57.114 INFO:tasks.workunit.client.0.smithi070.stdout:5/636: creat d5/d5f/d61/d30/d54/d62/fd4 x:0 0 0 2023-10-08T08:45:57.115 INFO:tasks.workunit.client.0.smithi070.stdout:4/523: rmdir dc/d17/d24/d4c/d4e 39 2023-10-08T08:45:57.115 INFO:tasks.workunit.client.0.smithi070.stdout:8/684: dwrite d1/f73 [0,4194304] 0 2023-10-08T08:45:57.116 INFO:tasks.workunit.client.0.smithi070.stdout:5/637: creat d5/d5f/d61/d30/d83/fd5 x:0 0 0 2023-10-08T08:45:57.118 INFO:tasks.workunit.client.0.smithi070.stdout:8/685: mkdir d1/d2/d6/d22/d9e/de2 0 2023-10-08T08:45:57.120 INFO:tasks.workunit.client.0.smithi070.stdout:5/638: rename d5/da/d4d/d37/d38/d55/f4c to d5/da/d22/d75/d82/fd6 0 2023-10-08T08:45:57.120 INFO:tasks.workunit.client.0.smithi070.stdout:5/639: stat d5/d5f/d61/f60 0 2023-10-08T08:45:57.122 INFO:tasks.workunit.client.0.smithi070.stdout:4/524: write dc/d17/d24/d4c/d4e/f5d [597550,6202] 0 2023-10-08T08:45:57.122 INFO:tasks.workunit.client.0.smithi070.stdout:8/686: read d1/d4d/f84 [1175878,52331] 0 2023-10-08T08:45:57.126 INFO:tasks.workunit.client.0.smithi070.stdout:4/525: link dc/f46 dc/d17/d24/d55/da4/fa5 0 2023-10-08T08:45:57.126 INFO:tasks.workunit.client.0.smithi070.stdout:3/743: dwrite d0/d12/d14/d1d/f3a [0,4194304] 0 2023-10-08T08:45:57.126 INFO:tasks.workunit.client.0.smithi070.stdout:3/744: stat d0/db/d10/l16 0 2023-10-08T08:45:57.128 INFO:tasks.workunit.client.0.smithi070.stdout:5/640: rmdir d5/da/d4d/d37/d38 39 2023-10-08T08:45:57.128 INFO:tasks.workunit.client.0.smithi070.stdout:7/662: write d3/da9/d4a/f43 [45154,126179] 0 2023-10-08T08:45:57.128 INFO:tasks.workunit.client.0.smithi070.stdout:9/470: dread d1/fb [0,4194304] 0 2023-10-08T08:45:57.128 INFO:tasks.workunit.client.0.smithi070.stdout:0/805: sync 2023-10-08T08:45:57.128 INFO:tasks.workunit.client.0.smithi070.stdout:2/828: dwrite df/d12/d7e/fff [0,4194304] 0 2023-10-08T08:45:57.132 INFO:tasks.workunit.client.0.smithi070.stdout:4/526: link dc/d17/f27 dc/d17/d24/fa6 0 2023-10-08T08:45:57.132 INFO:tasks.workunit.client.0.smithi070.stdout:5/641: getdents d5/d5f/d61/d30 0 2023-10-08T08:45:57.132 INFO:tasks.workunit.client.0.smithi070.stdout:5/642: write d5/d5f/d63/d8b/da8/dac/fb8 [596074,7757] 0 2023-10-08T08:45:57.133 INFO:tasks.workunit.client.0.smithi070.stdout:9/471: rename d1/dd/c23 to d1/dd/c83 0 2023-10-08T08:45:57.135 INFO:tasks.workunit.client.0.smithi070.stdout:4/527: write dc/d17/d24/fa6 [208022,22633] 0 2023-10-08T08:45:57.137 INFO:tasks.workunit.client.0.smithi070.stdout:4/528: creat dc/d17/d24/d55/da4/fa7 x:0 0 0 2023-10-08T08:45:57.138 INFO:tasks.workunit.client.0.smithi070.stdout:1/685: sync 2023-10-08T08:45:57.139 INFO:tasks.workunit.client.0.smithi070.stdout:0/806: write d1/d14/d1f/f1a [56022,94704] 0 2023-10-08T08:45:57.141 INFO:tasks.workunit.client.0.smithi070.stdout:4/529: link dc/d17/d24/d55/l5b dc/d17/d1f/d5e/d9f/la8 0 2023-10-08T08:45:57.141 INFO:tasks.workunit.client.0.smithi070.stdout:4/530: chown dc/d17/d79 1569 1 2023-10-08T08:45:57.142 INFO:tasks.workunit.client.0.smithi070.stdout:4/531: creat dc/d17/d24/d4c/d4e/fa9 x:0 0 0 2023-10-08T08:45:57.143 INFO:tasks.workunit.client.0.smithi070.stdout:0/807: mknod d1/d62/d54/d5e/c100 0 2023-10-08T08:45:57.143 INFO:tasks.workunit.client.0.smithi070.stdout:0/808: fdatasync d1/fab 0 2023-10-08T08:45:57.143 INFO:tasks.workunit.client.0.smithi070.stdout:0/809: chown d1/d1d/d24/df4/f59 6653569 1 2023-10-08T08:45:57.143 INFO:tasks.workunit.client.0.smithi070.stdout:0/810: dread - d1/d14/fc6 zero size 2023-10-08T08:45:57.143 INFO:tasks.workunit.client.0.smithi070.stdout:4/532: getdents dc/d17/d79 0 2023-10-08T08:45:57.144 INFO:tasks.workunit.client.0.smithi070.stdout:2/829: dread df/d12/d1b/d1c/d2d/f58 [0,4194304] 0 2023-10-08T08:45:57.146 INFO:tasks.workunit.client.0.smithi070.stdout:4/533: unlink dc/d17/d1f/d5e/l91 0 2023-10-08T08:45:57.146 INFO:tasks.workunit.client.0.smithi070.stdout:4/534: truncate dc/d17/d24/f73 5218284 0 2023-10-08T08:45:57.146 INFO:tasks.workunit.client.0.smithi070.stdout:4/535: chown f9 72957559 1 2023-10-08T08:45:57.147 INFO:tasks.workunit.client.0.smithi070.stdout:4/536: creat dc/d17/d24/d4c/d4e/faa x:0 0 0 2023-10-08T08:45:57.153 INFO:tasks.workunit.client.0.smithi070.stdout:8/687: dwrite d1/d2/d8c/fb0 [0,4194304] 0 2023-10-08T08:45:57.156 INFO:tasks.workunit.client.0.smithi070.stdout:4/537: dread dc/f51 [0,4194304] 0 2023-10-08T08:45:57.156 INFO:tasks.workunit.client.0.smithi070.stdout:8/688: creat d1/d2/d6/d22/d5b/d74/de1/d21/fe3 x:0 0 0 2023-10-08T08:45:57.157 INFO:tasks.workunit.client.0.smithi070.stdout:5/643: dwrite d5/da/f15 [0,4194304] 0 2023-10-08T08:45:57.158 INFO:tasks.workunit.client.0.smithi070.stdout:5/644: stat d5/d5f/d63/d8b/da8 0 2023-10-08T08:45:57.160 INFO:tasks.workunit.client.0.smithi070.stdout:3/745: dwrite d0/d12/d14/d5c/dc4/f104 [0,4194304] 0 2023-10-08T08:45:57.160 INFO:tasks.workunit.client.0.smithi070.stdout:3/746: truncate d0/d12/d14/d5c/d5d/fdb 1130956 0 2023-10-08T08:45:57.160 INFO:tasks.workunit.client.0.smithi070.stdout:3/747: chown d0/db/d10/c67 5451732 1 2023-10-08T08:45:57.160 INFO:tasks.workunit.client.0.smithi070.stdout:3/748: write d0/d12/d14/d5c/d5d/da0/dd8/fe5 [859376,39598] 0 2023-10-08T08:45:57.160 INFO:tasks.workunit.client.0.smithi070.stdout:3/749: fsync d0/d12/d14/d5c/d5d/da0/d86/f9f 0 2023-10-08T08:45:57.160 INFO:tasks.workunit.client.0.smithi070.stdout:3/750: chown d0/d12/d14/d1d/l94 0 1 2023-10-08T08:45:57.164 INFO:tasks.workunit.client.0.smithi070.stdout:4/538: dread dc/f51 [0,4194304] 0 2023-10-08T08:45:57.164 INFO:tasks.workunit.client.0.smithi070.stdout:3/751: creat d0/db/d10/d38/d63/dfe/f10d x:0 0 0 2023-10-08T08:45:57.164 INFO:tasks.workunit.client.0.smithi070.stdout:3/752: fdatasync d0/d12/d14/d5c/d5d/da0/d86/fb3 0 2023-10-08T08:45:57.164 INFO:tasks.workunit.client.0.smithi070.stdout:3/753: readlink d0/d12/d14/d1d/l94 0 2023-10-08T08:45:57.165 INFO:tasks.workunit.client.0.smithi070.stdout:4/539: mkdir dc/d17/d24/d4c/d4e/dab 0 2023-10-08T08:45:57.168 INFO:tasks.workunit.client.0.smithi070.stdout:7/663: dwrite d3/da9/d4a/fd [0,4194304] 0 2023-10-08T08:45:57.168 INFO:tasks.workunit.client.0.smithi070.stdout:7/664: truncate d3/d19/f3c 855083 0 2023-10-08T08:45:57.168 INFO:tasks.workunit.client.0.smithi070.stdout:7/665: dread - d3/d19/d1a/f99 zero size 2023-10-08T08:45:57.168 INFO:tasks.workunit.client.0.smithi070.stdout:7/666: chown d3/da9/d4a/d9 52381 1 2023-10-08T08:45:57.169 INFO:tasks.workunit.client.0.smithi070.stdout:8/689: write d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/fd3 [2148784,20119] 0 2023-10-08T08:45:57.169 INFO:tasks.workunit.client.0.smithi070.stdout:8/690: fdatasync d1/d2/d6/d22/d5b/d74/de1/d1a/f66 0 2023-10-08T08:45:57.170 INFO:tasks.workunit.client.0.smithi070.stdout:7/667: creat d3/da9/d4a/d9/da4/dae/fe1 x:0 0 0 2023-10-08T08:45:57.174 INFO:tasks.workunit.client.0.smithi070.stdout:7/668: dread d3/da9/d1e/d76/f8a [0,4194304] 0 2023-10-08T08:45:57.174 INFO:tasks.workunit.client.0.smithi070.stdout:7/669: truncate d3/da9/f58 928365 0 2023-10-08T08:45:57.178 INFO:tasks.workunit.client.0.smithi070.stdout:8/691: write d1/d4d/f81 [1417372,91479] 0 2023-10-08T08:45:57.178 INFO:tasks.workunit.client.0.smithi070.stdout:7/670: mkdir d3/d77/de2 0 2023-10-08T08:45:57.178 INFO:tasks.workunit.client.0.smithi070.stdout:9/472: dwrite d1/dd/d19/f67 [0,4194304] 0 2023-10-08T08:45:57.181 INFO:tasks.workunit.client.0.smithi070.stdout:9/473: write d1/dd/d1a/f62 [819325,80901] 0 2023-10-08T08:45:57.184 INFO:tasks.workunit.client.0.smithi070.stdout:5/645: dwrite d5/d5f/d61/d30/d83/f8c [0,4194304] 0 2023-10-08T08:45:57.186 INFO:tasks.workunit.client.0.smithi070.stdout:9/474: symlink d1/l84 0 2023-10-08T08:45:57.189 INFO:tasks.workunit.client.0.smithi070.stdout:5/646: symlink d5/d5f/d61/d30/d54/d62/ld7 0 2023-10-08T08:45:57.189 INFO:tasks.workunit.client.0.smithi070.stdout:7/671: write d3/da9/d4a/d50/f66 [123411,68402] 0 2023-10-08T08:45:57.190 INFO:tasks.workunit.client.0.smithi070.stdout:8/692: fdatasync d1/d2/d6/d22/d5b/d74/dc3/fc4 0 2023-10-08T08:45:57.193 INFO:tasks.workunit.client.0.smithi070.stdout:2/830: dread df/d12/d7e/fff [0,4194304] 0 2023-10-08T08:45:57.193 INFO:tasks.workunit.client.0.smithi070.stdout:1/686: dwrite d6/dc/fd6 [0,4194304] 0 2023-10-08T08:45:57.193 INFO:tasks.workunit.client.0.smithi070.stdout:0/811: dwrite d1/f6 [0,4194304] 0 2023-10-08T08:45:57.193 INFO:tasks.workunit.client.0.smithi070.stdout:2/831: dread - df/d12/d1b/d1c/d79/da4/feb zero size 2023-10-08T08:45:57.193 INFO:tasks.workunit.client.0.smithi070.stdout:5/647: mknod d5/d5f/d61/d30/d54/d62/cd8 0 2023-10-08T08:45:57.194 INFO:tasks.workunit.client.0.smithi070.stdout:3/754: dwrite d0/d12/d14/d5c/db1/fd0 [0,4194304] 0 2023-10-08T08:45:57.194 INFO:tasks.workunit.client.0.smithi070.stdout:3/755: chown d0/db/d10/f9c 6 1 2023-10-08T08:45:57.194 INFO:tasks.workunit.client.0.smithi070.stdout:3/756: dread - d0/d8a/fcd zero size 2023-10-08T08:45:57.194 INFO:tasks.workunit.client.0.smithi070.stdout:7/672: unlink d3/f71 0 2023-10-08T08:45:57.194 INFO:tasks.workunit.client.0.smithi070.stdout:7/673: chown d3/d19/d95 31356 1 2023-10-08T08:45:57.197 INFO:tasks.workunit.client.0.smithi070.stdout:0/812: mknod d1/d1d/d4d/d9d/c101 0 2023-10-08T08:45:57.198 INFO:tasks.workunit.client.0.smithi070.stdout:2/832: rename df/d12/d15/d54/f87 to df/d12/d1b/f10d 0 2023-10-08T08:45:57.202 INFO:tasks.workunit.client.0.smithi070.stdout:3/757: mknod d0/d12/d14/d5c/d5d/da0/c10e 0 2023-10-08T08:45:57.208 INFO:tasks.workunit.client.0.smithi070.stdout:3/758: dread d0/db/d10/d38/d63/f82 [0,4194304] 0 2023-10-08T08:45:57.210 INFO:tasks.workunit.client.0.smithi070.stdout:7/674: mkdir d3/d79/de3 0 2023-10-08T08:45:57.215 INFO:tasks.workunit.client.0.smithi070.stdout:7/675: symlink d3/da9/d4a/d9/d97/le4 0 2023-10-08T08:45:57.216 INFO:tasks.workunit.client.0.smithi070.stdout:3/759: creat d0/d12/d14/f10f x:0 0 0 2023-10-08T08:45:57.218 INFO:tasks.workunit.client.0.smithi070.stdout:5/648: dread d5/da/d22/f89 [4194304,4194304] 0 2023-10-08T08:45:57.220 INFO:tasks.workunit.client.0.smithi070.stdout:9/475: dwrite d1/dd/d26/d27/d2d/f2f [0,4194304] 0 2023-10-08T08:45:57.220 INFO:tasks.workunit.client.0.smithi070.stdout:9/476: readlink d1/dd/d26/l30 0 2023-10-08T08:45:57.233 INFO:tasks.workunit.client.0.smithi070.stdout:3/760: read d0/db/f26 [57410,119130] 0 2023-10-08T08:45:57.234 INFO:tasks.workunit.client.0.smithi070.stdout:4/540: dwrite dc/d17/d24/d55/da4/fa5 [0,4194304] 0 2023-10-08T08:45:57.236 INFO:tasks.workunit.client.0.smithi070.stdout:4/541: mknod dc/d17/d79/cac 0 2023-10-08T08:45:57.238 INFO:tasks.workunit.client.0.smithi070.stdout:4/542: write dc/d17/d24/f49 [559730,124277] 0 2023-10-08T08:45:57.240 INFO:tasks.workunit.client.0.smithi070.stdout:4/543: mkdir dc/d17/d79/dad 0 2023-10-08T08:45:57.240 INFO:tasks.workunit.client.0.smithi070.stdout:4/544: chown dc/d17/d24/d37/f3b 1 1 2023-10-08T08:45:57.241 INFO:tasks.workunit.client.0.smithi070.stdout:5/649: dwrite d5/da/d4d/f85 [0,4194304] 0 2023-10-08T08:45:57.243 INFO:tasks.workunit.client.0.smithi070.stdout:9/477: dwrite d1/dd/d19/d38/f42 [0,4194304] 0 2023-10-08T08:45:57.245 INFO:tasks.workunit.client.0.smithi070.stdout:5/650: rename d5/da/l34 to d5/d5f/d63/d8b/d8f/ld9 0 2023-10-08T08:45:57.246 INFO:tasks.workunit.client.0.smithi070.stdout:9/478: dread d1/dd/d26/d27/f60 [0,4194304] 0 2023-10-08T08:45:57.246 INFO:tasks.workunit.client.0.smithi070.stdout:5/651: truncate d5/da/d4d/d37/d38/d55/f90 7560037 0 2023-10-08T08:45:57.250 INFO:tasks.workunit.client.0.smithi070.stdout:3/761: dread d0/d12/f7c [0,4194304] 0 2023-10-08T08:45:57.252 INFO:tasks.workunit.client.0.smithi070.stdout:3/762: symlink d0/d12/d14/d1d/dba/l110 0 2023-10-08T08:45:57.252 INFO:tasks.workunit.client.0.smithi070.stdout:3/763: truncate d0/db/d10/d38/d2f/f66 953057 0 2023-10-08T08:45:57.252 INFO:tasks.workunit.client.0.smithi070.stdout:4/545: rmdir dc 39 2023-10-08T08:45:57.252 INFO:tasks.workunit.client.0.smithi070.stdout:4/546: chown dc/d17/d79 259578 1 2023-10-08T08:45:57.254 INFO:tasks.workunit.client.0.smithi070.stdout:4/547: rename dc/d17/d24/l2a to dc/d17/d1f/d5e/lae 0 2023-10-08T08:45:57.255 INFO:tasks.workunit.client.0.smithi070.stdout:4/548: creat dc/d17/d1f/d54/faf x:0 0 0 2023-10-08T08:45:57.257 INFO:tasks.workunit.client.0.smithi070.stdout:4/549: link dc/d17/d24/l25 dc/d17/d79/dad/lb0 0 2023-10-08T08:45:57.265 INFO:tasks.workunit.client.0.smithi070.stdout:5/652: dread d5/da/f50 [0,4194304] 0 2023-10-08T08:45:57.267 INFO:tasks.workunit.client.0.smithi070.stdout:5/653: mknod d5/da/d22/d75/d82/cda 0 2023-10-08T08:45:57.267 INFO:tasks.workunit.client.0.smithi070.stdout:1/687: dwrite d6/dc/d14/d1f/d75/d7e/f87 [0,4194304] 0 2023-10-08T08:45:57.268 INFO:tasks.workunit.client.0.smithi070.stdout:5/654: symlink d5/d5f/d61/d30/ldb 0 2023-10-08T08:45:57.270 INFO:tasks.workunit.client.0.smithi070.stdout:6/577: sync 2023-10-08T08:45:57.270 INFO:tasks.workunit.client.0.smithi070.stdout:6/578: chown df/d26/d42/d4b/d80/d94 51268182 1 2023-10-08T08:45:57.270 INFO:tasks.workunit.client.0.smithi070.stdout:1/688: rename d6/dc/d14/d1f/d63/db3/d38/d4b/cdd to d6/dc/d14/d1f/d75/cdf 0 2023-10-08T08:45:57.270 INFO:tasks.workunit.client.0.smithi070.stdout:1/689: readlink d6/dc/d14/d1f/l7b 0 2023-10-08T08:45:57.271 INFO:tasks.workunit.client.0.smithi070.stdout:7/676: write d3/d19/d1a/f22 [2623490,121151] 0 2023-10-08T08:45:57.271 INFO:tasks.workunit.client.0.smithi070.stdout:9/479: dread d1/dd/d26/d27/f44 [0,4194304] 0 2023-10-08T08:45:57.272 INFO:tasks.workunit.client.0.smithi070.stdout:6/579: rename df/d26/d42/d4b/f64 to df/d26/d78/d90/fb9 0 2023-10-08T08:45:57.272 INFO:tasks.workunit.client.0.smithi070.stdout:6/580: chown df/d26/d42/db1/l39 89878 1 2023-10-08T08:45:57.274 INFO:tasks.workunit.client.0.smithi070.stdout:1/690: getdents d6/dc/d14 0 2023-10-08T08:45:57.275 INFO:tasks.workunit.client.0.smithi070.stdout:6/581: mkdir df/d26/d42/d4b/dba 0 2023-10-08T08:45:57.275 INFO:tasks.workunit.client.0.smithi070.stdout:8/693: dwrite d1/d2/d6/d22/d5b/d74/dc3/fc4 [0,4194304] 0 2023-10-08T08:45:57.275 INFO:tasks.workunit.client.0.smithi070.stdout:0/813: dwrite d1/d62/fb8 [0,4194304] 0 2023-10-08T08:45:57.275 INFO:tasks.workunit.client.0.smithi070.stdout:9/480: mkdir d1/dd/d1a/d40/d76/d85 0 2023-10-08T08:45:57.276 INFO:tasks.workunit.client.0.smithi070.stdout:9/481: chown d1/dd/d26/d27/f36 978068 1 2023-10-08T08:45:57.276 INFO:tasks.workunit.client.0.smithi070.stdout:9/482: chown d1/dd/d26/d27/d2d/c53 233 1 2023-10-08T08:45:57.277 INFO:tasks.workunit.client.0.smithi070.stdout:8/694: mknod d1/d4d/ce4 0 2023-10-08T08:45:57.279 INFO:tasks.workunit.client.0.smithi070.stdout:9/483: rename d1/dd/d1a/f1d to d1/dd/d26/d27/d2d/d70/f86 0 2023-10-08T08:45:57.281 INFO:tasks.workunit.client.0.smithi070.stdout:1/691: mknod d6/dc/d97/ce0 0 2023-10-08T08:45:57.281 INFO:tasks.workunit.client.0.smithi070.stdout:6/582: truncate df/d26/d42/d43/d4a/f85 195033 0 2023-10-08T08:45:57.281 INFO:tasks.workunit.client.0.smithi070.stdout:6/583: chown df/d26/d78/l8f 8791 1 2023-10-08T08:45:57.281 INFO:tasks.workunit.client.0.smithi070.stdout:1/692: write d6/dc/d14/d1f/d75/da1/fc0 [562805,89425] 0 2023-10-08T08:45:57.281 INFO:tasks.workunit.client.0.smithi070.stdout:0/814: truncate d1/d76/dd5/ff9 4619684 0 2023-10-08T08:45:57.281 INFO:tasks.workunit.client.0.smithi070.stdout:9/484: creat d1/dd/f87 x:0 0 0 2023-10-08T08:45:57.282 INFO:tasks.workunit.client.0.smithi070.stdout:4/550: dwrite dc/f50 [4194304,4194304] 0 2023-10-08T08:45:57.284 INFO:tasks.workunit.client.0.smithi070.stdout:9/485: mkdir d1/dd/d39/d6f/d88 0 2023-10-08T08:45:57.286 INFO:tasks.workunit.client.0.smithi070.stdout:9/486: link d1/dd/d26/d27/d2d/c75 d1/dd/d39/d6f/c89 0 2023-10-08T08:45:57.287 INFO:tasks.workunit.client.0.smithi070.stdout:8/695: write d1/d2/d6/d22/f60 [3556933,127554] 0 2023-10-08T08:45:57.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/655: dwrite d5/d5f/d61/d30/d83/f93 [0,4194304] 0 2023-10-08T08:45:57.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/656: read - d5/d5f/d61/d30/d54/d62/fbc zero size 2023-10-08T08:45:57.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/657: fsync d5/da/f68 0 2023-10-08T08:45:57.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/658: write d5/da/fbd [597814,124409] 0 2023-10-08T08:45:57.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/659: fdatasync d5/da/d22/d75/d82/fd6 0 2023-10-08T08:45:57.290 INFO:tasks.workunit.client.0.smithi070.stdout:6/584: creat df/d26/d42/fbb x:0 0 0 2023-10-08T08:45:57.290 INFO:tasks.workunit.client.0.smithi070.stdout:6/585: getdents df/d26/d42/d43/d4a/d97/da5 0 2023-10-08T08:45:57.290 INFO:tasks.workunit.client.0.smithi070.stdout:9/487: creat d1/dd/d26/f8a x:0 0 0 2023-10-08T08:45:57.290 INFO:tasks.workunit.client.0.smithi070.stdout:8/696: symlink d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/le5 0 2023-10-08T08:45:57.291 INFO:tasks.workunit.client.0.smithi070.stdout:6/586: link df/d11/l2e df/d26/lbc 0 2023-10-08T08:45:57.293 INFO:tasks.workunit.client.0.smithi070.stdout:6/587: creat df/fbd x:0 0 0 2023-10-08T08:45:57.293 INFO:tasks.workunit.client.0.smithi070.stdout:9/488: creat d1/f8b x:0 0 0 2023-10-08T08:45:57.294 INFO:tasks.workunit.client.0.smithi070.stdout:6/588: creat df/d26/d78/fbe x:0 0 0 2023-10-08T08:45:57.294 INFO:tasks.workunit.client.0.smithi070.stdout:6/589: write df/d26/d42/db1/f9c [509611,19762] 0 2023-10-08T08:45:57.295 INFO:tasks.workunit.client.0.smithi070.stdout:6/590: symlink df/d26/d78/d90/daa/lbf 0 2023-10-08T08:45:57.295 INFO:tasks.workunit.client.0.smithi070.stdout:6/591: readlink df/d11/l2e 0 2023-10-08T08:45:57.300 INFO:tasks.workunit.client.0.smithi070.stdout:8/697: unlink d1/d2/d6/d22/d5c/ldd 0 2023-10-08T08:45:57.300 INFO:tasks.workunit.client.0.smithi070.stdout:8/698: truncate d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/f71 225116 0 2023-10-08T08:45:57.302 INFO:tasks.workunit.client.0.smithi070.stdout:9/489: read d1/dd/d26/d27/f44 [3081645,7217] 0 2023-10-08T08:45:57.302 INFO:tasks.workunit.client.0.smithi070.stdout:0/815: write d1/fc5 [1961993,118518] 0 2023-10-08T08:45:57.304 INFO:tasks.workunit.client.0.smithi070.stdout:0/816: mkdir d1/d76/d102 0 2023-10-08T08:45:57.304 INFO:tasks.workunit.client.0.smithi070.stdout:0/817: fdatasync d1/d14/d1f/f42 0 2023-10-08T08:45:57.304 INFO:tasks.workunit.client.0.smithi070.stdout:0/818: chown d1/f57 233754372 1 2023-10-08T08:45:57.305 INFO:tasks.workunit.client.0.smithi070.stdout:7/677: dwrite d3/d77/f91 [0,4194304] 0 2023-10-08T08:45:57.307 INFO:tasks.workunit.client.0.smithi070.stdout:9/490: creat d1/dd/d1a/d40/d76/f8c x:0 0 0 2023-10-08T08:45:57.307 INFO:tasks.workunit.client.0.smithi070.stdout:7/678: creat d3/da9/d4a/d9/da4/dae/fe5 x:0 0 0 2023-10-08T08:45:57.311 INFO:tasks.workunit.client.0.smithi070.stdout:7/679: mknod d3/d19/d95/da3/dc8/ddd/ce6 0 2023-10-08T08:45:57.312 INFO:tasks.workunit.client.0.smithi070.stdout:4/551: dwrite dc/d17/d1f/d54/f67 [0,4194304] 0 2023-10-08T08:45:57.312 INFO:tasks.workunit.client.0.smithi070.stdout:4/552: readlink dc/d17/l30 0 2023-10-08T08:45:57.312 INFO:tasks.workunit.client.0.smithi070.stdout:4/553: dread - dc/d68/f83 zero size 2023-10-08T08:45:57.315 INFO:tasks.workunit.client.0.smithi070.stdout:1/693: dwrite d6/dc/d97/fcf [0,4194304] 0 2023-10-08T08:45:57.315 INFO:tasks.workunit.client.0.smithi070.stdout:1/694: dread - d6/dc/d14/d1f/d75/d7e/fa4 zero size 2023-10-08T08:45:57.316 INFO:tasks.workunit.client.0.smithi070.stdout:9/491: rename d1/dd/d19/d38/d56 to d1/dd/d8d 0 2023-10-08T08:45:57.317 INFO:tasks.workunit.client.0.smithi070.stdout:4/554: unlink dc/f50 0 2023-10-08T08:45:57.319 INFO:tasks.workunit.client.0.smithi070.stdout:1/695: mkdir d6/dc/d14/d1f/d63/daa/de1 0 2023-10-08T08:45:57.319 INFO:tasks.workunit.client.0.smithi070.stdout:1/696: chown d6/dc/d14/d1f/d75/d7e 42 1 2023-10-08T08:45:57.319 INFO:tasks.workunit.client.0.smithi070.stdout:1/697: stat d6/dc/d14/d1f/d63/db3/d38/d4b/fab 0 2023-10-08T08:45:57.326 INFO:tasks.workunit.client.0.smithi070.stdout:8/699: dwrite d1/d2/d6/d22/d5b/fcf [0,4194304] 0 2023-10-08T08:45:57.326 INFO:tasks.workunit.client.0.smithi070.stdout:8/700: fsync d1/d2/d6/d22/d5b/d74/de1/d2e/d45/f51 0 2023-10-08T08:45:57.326 INFO:tasks.workunit.client.0.smithi070.stdout:8/701: chown d1/d2/d6/d22/d5b/d74/de1/d3a/d92/ca4 4 1 2023-10-08T08:45:57.328 INFO:tasks.workunit.client.0.smithi070.stdout:8/702: getdents d1/d23 0 2023-10-08T08:45:57.328 INFO:tasks.workunit.client.0.smithi070.stdout:6/592: dwrite df/fbd [0,4194304] 0 2023-10-08T08:45:57.332 INFO:tasks.workunit.client.0.smithi070.stdout:0/819: dwrite d1/d1d/fa4 [0,4194304] 0 2023-10-08T08:45:57.332 INFO:tasks.workunit.client.0.smithi070.stdout:0/820: chown d1/d62/d54/cbe 11146637 1 2023-10-08T08:45:57.333 INFO:tasks.workunit.client.0.smithi070.stdout:7/680: dread d3/da9/d4a/f43 [0,4194304] 0 2023-10-08T08:45:57.334 INFO:tasks.workunit.client.0.smithi070.stdout:6/593: mkdir df/d26/d42/d43/d4a/d97/dc0 0 2023-10-08T08:45:57.334 INFO:tasks.workunit.client.0.smithi070.stdout:5/660: dwrite d5/da/d22/f32 [0,4194304] 0 2023-10-08T08:45:57.335 INFO:tasks.workunit.client.0.smithi070.stdout:5/661: fdatasync d5/d5f/d63/d8b/da8/dac/fcc 0 2023-10-08T08:45:57.343 INFO:tasks.workunit.client.0.smithi070.stdout:7/681: unlink d3/d77/fb6 0 2023-10-08T08:45:57.343 INFO:tasks.workunit.client.0.smithi070.stdout:7/682: read - d3/da9/d1e/fe0 zero size 2023-10-08T08:45:57.343 INFO:tasks.workunit.client.0.smithi070.stdout:6/594: creat df/d26/d42/d43/fc1 x:0 0 0 2023-10-08T08:45:57.344 INFO:tasks.workunit.client.0.smithi070.stdout:5/662: dread d5/ff [0,4194304] 0 2023-10-08T08:45:57.345 INFO:tasks.workunit.client.0.smithi070.stdout:7/683: truncate d3/da9/d4a/fd 1593946 0 2023-10-08T08:45:57.345 INFO:tasks.workunit.client.0.smithi070.stdout:1/698: dwrite d6/dc/d14/fa0 [0,4194304] 0 2023-10-08T08:45:57.347 INFO:tasks.workunit.client.0.smithi070.stdout:5/663: creat d5/da/d22/d75/fdc x:0 0 0 2023-10-08T08:45:57.347 INFO:tasks.workunit.client.0.smithi070.stdout:7/684: mkdir d3/d19/d6d/de7 0 2023-10-08T08:45:57.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/555: dwrite dc/f15 [0,4194304] 0 2023-10-08T08:45:57.347 INFO:tasks.workunit.client.0.smithi070.stdout:7/685: write d3/d19/d6d/f8f [453600,89541] 0 2023-10-08T08:45:57.347 INFO:tasks.workunit.client.0.smithi070.stdout:9/492: dread d1/dd/f10 [0,4194304] 0 2023-10-08T08:45:57.348 INFO:tasks.workunit.client.0.smithi070.stdout:8/703: write d1/d2/d6/d22/f60 [1565993,86734] 0 2023-10-08T08:45:57.348 INFO:tasks.workunit.client.0.smithi070.stdout:9/493: symlink d1/dd/d26/d27/l8e 0 2023-10-08T08:45:57.350 INFO:tasks.workunit.client.0.smithi070.stdout:1/699: write d6/dc/d14/d70/f9d [544402,103704] 0 2023-10-08T08:45:57.350 INFO:tasks.workunit.client.0.smithi070.stdout:6/595: rmdir df/d26/d42/d4b/db6 39 2023-10-08T08:45:57.350 INFO:tasks.workunit.client.0.smithi070.stdout:8/704: symlink d1/d2/d6/d22/d5b/d74/de1/d3a/le6 0 2023-10-08T08:45:57.350 INFO:tasks.workunit.client.0.smithi070.stdout:9/494: mknod d1/dd/d26/d27/d2d/c8f 0 2023-10-08T08:45:57.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/705: creat d1/d2/fe7 x:0 0 0 2023-10-08T08:45:57.353 INFO:tasks.workunit.client.0.smithi070.stdout:1/700: creat d6/dc/d14/d62/fe2 x:0 0 0 2023-10-08T08:45:57.354 INFO:tasks.workunit.client.0.smithi070.stdout:4/556: rmdir dc/d5a 39 2023-10-08T08:45:57.354 INFO:tasks.workunit.client.0.smithi070.stdout:4/557: fsync dc/d17/d1f/d54/faf 0 2023-10-08T08:45:57.354 INFO:tasks.workunit.client.0.smithi070.stdout:4/558: chown dc/d17/d79/dad/lb0 17290 1 2023-10-08T08:45:57.355 INFO:tasks.workunit.client.0.smithi070.stdout:4/559: symlink dc/d17/d24/d4c/d4e/dab/lb1 0 2023-10-08T08:45:57.355 INFO:tasks.workunit.client.0.smithi070.stdout:4/560: fdatasync dc/d17/d24/d4c/d4e/f82 0 2023-10-08T08:45:57.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/495: write d1/f4b [1365673,4775] 0 2023-10-08T08:45:57.355 INFO:tasks.workunit.client.0.smithi070.stdout:6/596: mknod df/d26/d42/d4b/d80/d94/cc2 0 2023-10-08T08:45:57.357 INFO:tasks.workunit.client.0.smithi070.stdout:7/686: getdents d3/da9/d4a/d9/da4/dae 0 2023-10-08T08:45:57.357 INFO:tasks.workunit.client.0.smithi070.stdout:6/597: write f7 [3163833,86495] 0 2023-10-08T08:45:57.357 INFO:tasks.workunit.client.0.smithi070.stdout:6/598: fsync df/d11/f4d 0 2023-10-08T08:45:57.359 INFO:tasks.workunit.client.0.smithi070.stdout:1/701: creat d6/dc/d14/d1f/d75/d7e/dc2/fe3 x:0 0 0 2023-10-08T08:45:57.359 INFO:tasks.workunit.client.0.smithi070.stdout:8/706: write d1/d2/d6/d22/d5b/d74/de1/d2e/d45/f70 [531368,72525] 0 2023-10-08T08:45:57.359 INFO:tasks.workunit.client.0.smithi070.stdout:8/707: write d1/d2/d6/d22/d5b/d74/de1/d21/f47 [266689,90401] 0 2023-10-08T08:45:57.360 INFO:tasks.workunit.client.0.smithi070.stdout:6/599: link df/d26/d42/d43/d4a/c92 df/d26/d42/d43/d4a/d97/cc3 0 2023-10-08T08:45:57.361 INFO:tasks.workunit.client.0.smithi070.stdout:5/664: dread d5/da/d4d/d37/d38/fa2 [0,4194304] 0 2023-10-08T08:45:57.362 INFO:tasks.workunit.client.0.smithi070.stdout:9/496: rmdir d1/dd/d39 39 2023-10-08T08:45:57.362 INFO:tasks.workunit.client.0.smithi070.stdout:9/497: stat d1/f4b 0 2023-10-08T08:45:57.362 INFO:tasks.workunit.client.0.smithi070.stdout:0/821: dwrite d1/d76/d7a/faf [0,4194304] 0 2023-10-08T08:45:57.362 INFO:tasks.workunit.client.0.smithi070.stdout:1/702: mkdir d6/dc/d14/d90/de4 0 2023-10-08T08:45:57.363 INFO:tasks.workunit.client.0.smithi070.stdout:9/498: read d1/dd/d1a/f62 [1105715,122558] 0 2023-10-08T08:45:57.367 INFO:tasks.workunit.client.0.smithi070.stdout:9/499: mkdir d1/dd/d26/d27/d2d/d70/d90 0 2023-10-08T08:45:57.367 INFO:tasks.workunit.client.0.smithi070.stdout:9/500: chown d1/dd/d26/d5d/c63 12171627 1 2023-10-08T08:45:57.367 INFO:tasks.workunit.client.0.smithi070.stdout:9/501: chown d1/dd/d26/d27/d2d/l7f 952363891 1 2023-10-08T08:45:57.367 INFO:tasks.workunit.client.0.smithi070.stdout:9/502: chown d1/dd/d26/d5d 6 1 2023-10-08T08:45:57.368 INFO:tasks.workunit.client.0.smithi070.stdout:9/503: chown d1/dd/d26/d27/d2d/c75 877111676 1 2023-10-08T08:45:57.369 INFO:tasks.workunit.client.0.smithi070.stdout:9/504: creat d1/dd/d19/d38/d4f/f91 x:0 0 0 2023-10-08T08:45:57.382 INFO:tasks.workunit.client.0.smithi070.stdout:4/561: dread dc/d17/d24/d4c/d4e/f57 [0,4194304] 0 2023-10-08T08:45:57.386 INFO:tasks.workunit.client.0.smithi070.stdout:5/665: dread d5/da/d22/fcf [0,4194304] 0 2023-10-08T08:45:57.388 INFO:tasks.workunit.client.0.smithi070.stdout:1/703: read d6/f52 [3049334,73234] 0 2023-10-08T08:45:57.389 INFO:tasks.workunit.client.0.smithi070.stdout:7/687: dwrite d3/da9/d4a/f8 [4194304,4194304] 0 2023-10-08T08:45:57.389 INFO:tasks.workunit.client.0.smithi070.stdout:7/688: fdatasync d3/da9/d1e/d76/fb7 0 2023-10-08T08:45:57.393 INFO:tasks.workunit.client.0.smithi070.stdout:7/689: rmdir d3/da9/d4a/d9 39 2023-10-08T08:45:57.394 INFO:tasks.workunit.client.0.smithi070.stdout:0/822: dwrite d1/d76/d7a/faf [0,4194304] 0 2023-10-08T08:45:57.394 INFO:tasks.workunit.client.0.smithi070.stdout:0/823: write d1/d14/d1f/ff5 [998003,43479] 0 2023-10-08T08:45:57.395 INFO:tasks.workunit.client.0.smithi070.stdout:7/690: link d3/da9/d1e/d76/l8d d3/da9/d4a/d9/da4/dd6/ddb/le8 0 2023-10-08T08:45:57.396 INFO:tasks.workunit.client.0.smithi070.stdout:0/824: getdents d1/d14/de5 0 2023-10-08T08:45:57.396 INFO:tasks.workunit.client.0.smithi070.stdout:5/666: write d5/da/d4d/d37/d38/f6a [3767631,113237] 0 2023-10-08T08:45:57.398 INFO:tasks.workunit.client.0.smithi070.stdout:0/825: mkdir d1/d62/d103 0 2023-10-08T08:45:57.399 INFO:tasks.workunit.client.0.smithi070.stdout:0/826: creat d1/d76/d7a/f104 x:0 0 0 2023-10-08T08:45:57.402 INFO:tasks.workunit.client.0.smithi070.stdout:4/562: dread dc/d17/d1f/d54/f67 [0,4194304] 0 2023-10-08T08:45:57.402 INFO:tasks.workunit.client.0.smithi070.stdout:4/563: truncate dc/d17/d24/d6b/f6c 23168 0 2023-10-08T08:45:57.402 INFO:tasks.workunit.client.0.smithi070.stdout:4/564: read - dc/d17/d24/d4c/f8a zero size 2023-10-08T08:45:57.403 INFO:tasks.workunit.client.0.smithi070.stdout:4/565: creat dc/d17/d1f/d5e/fb2 x:0 0 0 2023-10-08T08:45:57.404 INFO:tasks.workunit.client.0.smithi070.stdout:4/566: rmdir dc/d17/d24/d4c/d4e 39 2023-10-08T08:45:57.404 INFO:tasks.workunit.client.0.smithi070.stdout:4/567: stat dc/d17 0 2023-10-08T08:45:57.404 INFO:tasks.workunit.client.0.smithi070.stdout:4/568: write dc/d17/d24/d4c/d4e/fa9 [809521,62262] 0 2023-10-08T08:45:57.404 INFO:tasks.workunit.client.0.smithi070.stdout:4/569: chown dc/d17/d1f/d5e 13194 1 2023-10-08T08:45:57.405 INFO:tasks.workunit.client.0.smithi070.stdout:5/667: rename d5/da/d4d/d37 to d5/da/d22/ddd 0 2023-10-08T08:45:57.405 INFO:tasks.workunit.client.0.smithi070.stdout:5/668: readlink d5/da/l1d 0 2023-10-08T08:45:57.405 INFO:tasks.workunit.client.0.smithi070.stdout:5/669: write d5/faf [308229,116448] 0 2023-10-08T08:45:57.405 INFO:tasks.workunit.client.0.smithi070.stdout:5/670: creat d5/d5f/d61/fde x:0 0 0 2023-10-08T08:45:57.405 INFO:tasks.workunit.client.0.smithi070.stdout:5/671: write d5/da/f15 [9272072,35763] 0 2023-10-08T08:45:57.407 INFO:tasks.workunit.client.0.smithi070.stdout:5/672: mkdir d5/da/d22/ddd/d38/d55/ddf 0 2023-10-08T08:45:57.407 INFO:tasks.workunit.client.0.smithi070.stdout:5/673: fsync d5/da/d22/ddd/f2b 0 2023-10-08T08:45:57.408 INFO:tasks.workunit.client.0.smithi070.stdout:5/674: creat d5/da/d22/ddd/d38/d55/fe0 x:0 0 0 2023-10-08T08:45:57.422 INFO:tasks.workunit.client.0.smithi070.stdout:0/827: dwrite d1/dd/f13 [4194304,4194304] 0 2023-10-08T08:45:57.424 INFO:tasks.workunit.client.0.smithi070.stdout:0/828: mkdir d1/d14/de2/d105 0 2023-10-08T08:45:57.428 INFO:tasks.workunit.client.0.smithi070.stdout:5/675: dwrite d5/d5f/d61/fde [0,4194304] 0 2023-10-08T08:45:57.428 INFO:tasks.workunit.client.0.smithi070.stdout:5/676: chown d5/d5f/d61/d30/d54/dab/fd1 763 1 2023-10-08T08:45:57.468 INFO:tasks.workunit.client.0.smithi070.stdout:8/708: write d1/d2/d6/d22/d5b/d74/dc3/fc4 [291164,130118] 0 2023-10-08T08:45:57.472 INFO:tasks.workunit.client.0.smithi070.stdout:8/709: write d1/d2/d6/d22/f33 [2643624,68234] 0 2023-10-08T08:45:57.473 INFO:tasks.workunit.client.0.smithi070.stdout:6/600: dwrite df/d53/f5e [0,4194304] 0 2023-10-08T08:45:57.473 INFO:tasks.workunit.client.0.smithi070.stdout:6/601: rename df/d26/d42/d55 to df/d26/d42/d55/dc4 22 2023-10-08T08:45:57.474 INFO:tasks.workunit.client.0.smithi070.stdout:6/602: symlink df/d26/d42/d43/d4a/d97/lc5 0 2023-10-08T08:45:57.474 INFO:tasks.workunit.client.0.smithi070.stdout:6/603: fsync df/d26/d42/d43/d4a/f81 0 2023-10-08T08:45:57.475 INFO:tasks.workunit.client.0.smithi070.stdout:1/704: write d6/dc/d14/d1f/f2b [1766968,117501] 0 2023-10-08T08:45:57.476 INFO:tasks.workunit.client.0.smithi070.stdout:6/604: mknod df/d26/d42/cc6 0 2023-10-08T08:45:57.476 INFO:tasks.workunit.client.0.smithi070.stdout:6/605: fdatasync df/d26/d42/d4b/f56 0 2023-10-08T08:45:57.476 INFO:tasks.workunit.client.0.smithi070.stdout:8/710: write d1/d2/d6/d22/d5b/d74/de1/d2e/d45/f70 [527453,54239] 0 2023-10-08T08:45:57.480 INFO:tasks.workunit.client.0.smithi070.stdout:0/829: dwrite d1/d1d/d4d/d9d/f6a [0,4194304] 0 2023-10-08T08:45:57.483 INFO:tasks.workunit.client.0.smithi070.stdout:0/830: fdatasync d1/d1d/d24/f7f 0 2023-10-08T08:45:57.485 INFO:tasks.workunit.client.0.smithi070.stdout:8/711: truncate d1/d2/d6/d22/d5b/d74/de1/f64 6509962 0 2023-10-08T08:45:57.493 INFO:tasks.workunit.client.0.smithi070.stdout:4/570: dread dc/d5a/fa2 [0,4194304] 0 2023-10-08T08:45:57.493 INFO:tasks.workunit.client.0.smithi070.stdout:7/691: write d3/d19/d1a/f22 [2960374,66093] 0 2023-10-08T08:45:57.493 INFO:tasks.workunit.client.0.smithi070.stdout:4/571: readlink dc/d17/d79/dad/lb0 0 2023-10-08T08:45:57.493 INFO:tasks.workunit.client.0.smithi070.stdout:4/572: write dc/d17/f70 [290159,120334] 0 2023-10-08T08:45:57.494 INFO:tasks.workunit.client.0.smithi070.stdout:4/573: rmdir dc/d17/d24/d55/da4 39 2023-10-08T08:45:57.494 INFO:tasks.workunit.client.0.smithi070.stdout:7/692: creat d3/da9/d4a/d9/da4/dd6/fe9 x:0 0 0 2023-10-08T08:45:57.495 INFO:tasks.workunit.client.0.smithi070.stdout:5/677: dwrite d5/ff [0,4194304] 0 2023-10-08T08:45:57.495 INFO:tasks.workunit.client.0.smithi070.stdout:7/693: creat d3/da9/d4a/d9/da4/dd6/fea x:0 0 0 2023-10-08T08:45:57.497 INFO:tasks.workunit.client.0.smithi070.stdout:4/574: rename dc/d17/d79/f98 to dc/d5f/fb3 0 2023-10-08T08:45:57.497 INFO:tasks.workunit.client.0.smithi070.stdout:4/575: chown dc/d5a/fa2 4456 1 2023-10-08T08:45:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:5/678: truncate d5/da/d22/f59 107013 0 2023-10-08T08:45:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:4/576: link dc/d17/d1f/d54/faf dc/d17/d24/d55/fb4 0 2023-10-08T08:45:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:5/679: fdatasync d5/d5f/d61/d30/d83/fd5 0 2023-10-08T08:45:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:4/577: truncate dc/d17/f70 940917 0 2023-10-08T08:45:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:0/831: dread d1/d14/d1f/f1a [0,4194304] 0 2023-10-08T08:45:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:7/694: rename d3/d19/d6d/fc0 to d3/d79/de3/feb 0 2023-10-08T08:45:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:4/578: symlink dc/d5a/lb5 0 2023-10-08T08:45:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:4/579: chown dc/d17/d24/f40 299 1 2023-10-08T08:45:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:0/832: creat d1/d62/f106 x:0 0 0 2023-10-08T08:45:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:0/833: write d1/d1d/d4d/d9d/fe9 [5124764,72800] 0 2023-10-08T08:45:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:4/580: mkdir dc/d17/d79/dad/db6 0 2023-10-08T08:45:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:4/581: write dc/d17/d24/d55/fb4 [351097,50579] 0 2023-10-08T08:45:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:0/834: truncate d1/d1d/d24/f94 842081 0 2023-10-08T08:45:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:7/695: read d3/da9/d4a/d9/f48 [2734050,49568] 0 2023-10-08T08:45:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:4/582: creat dc/d17/d24/d55/fb7 x:0 0 0 2023-10-08T08:45:57.508 INFO:tasks.workunit.client.0.smithi070.stdout:1/705: dwrite d6/f52 [4194304,4194304] 0 2023-10-08T08:45:57.508 INFO:tasks.workunit.client.0.smithi070.stdout:7/696: rename d3/da9/d4a/cc2 to d3/d19/d6d/cec 0 2023-10-08T08:45:57.509 INFO:tasks.workunit.client.0.smithi070.stdout:7/697: chown d3/da9/d1e/d4c/f7e 386223836 1 2023-10-08T08:45:57.509 INFO:tasks.workunit.client.0.smithi070.stdout:4/583: write dc/d17/f27 [2366604,6594] 0 2023-10-08T08:45:57.509 INFO:tasks.workunit.client.0.smithi070.stdout:0/835: write d1/d1d/d4d/d9d/f8c [3798188,12804] 0 2023-10-08T08:45:57.512 INFO:tasks.workunit.client.0.smithi070.stdout:1/706: link d6/dc/d14/d1f/f9c d6/dc/d14/d1f/d63/db3/fe5 0 2023-10-08T08:45:57.514 INFO:tasks.workunit.client.0.smithi070.stdout:1/707: creat d6/dc/d14/d90/de4/fe6 x:0 0 0 2023-10-08T08:45:57.516 INFO:tasks.workunit.client.0.smithi070.stdout:4/584: dread dc/d17/d24/d55/f66 [0,4194304] 0 2023-10-08T08:45:57.517 INFO:tasks.workunit.client.0.smithi070.stdout:4/585: creat dc/d17/d24/d55/da4/fb8 x:0 0 0 2023-10-08T08:45:57.518 INFO:tasks.workunit.client.0.smithi070.stdout:4/586: getdents dc 0 2023-10-08T08:45:57.520 INFO:tasks.workunit.client.0.smithi070.stdout:4/587: symlink dc/d17/d24/d55/lb9 0 2023-10-08T08:45:57.520 INFO:tasks.workunit.client.0.smithi070.stdout:4/588: write dc/f46 [4389441,90493] 0 2023-10-08T08:45:57.521 INFO:tasks.workunit.client.0.smithi070.stdout:2/833: sync 2023-10-08T08:45:57.521 INFO:tasks.workunit.client.0.smithi070.stdout:1/708: truncate d6/dc/d14/d1f/d75/d7e/f8f 3880940 0 2023-10-08T08:45:57.522 INFO:tasks.workunit.client.0.smithi070.stdout:3/764: sync 2023-10-08T08:45:57.522 INFO:tasks.workunit.client.0.smithi070.stdout:4/589: symlink dc/d17/d79/dad/lba 0 2023-10-08T08:45:57.525 INFO:tasks.workunit.client.0.smithi070.stdout:1/709: rename d6/dc/d14/lc8 to d6/dc/d14/d1f/d75/d88/le7 0 2023-10-08T08:45:57.526 INFO:tasks.workunit.client.0.smithi070.stdout:1/710: link d6/dc/d14/dc1/dca/cd0 d6/dc/d14/d1f/d63/db3/d38/ce8 0 2023-10-08T08:45:57.526 INFO:tasks.workunit.client.0.smithi070.stdout:1/711: chown d6/f5e 14 1 2023-10-08T08:45:57.527 INFO:tasks.workunit.client.0.smithi070.stdout:1/712: mknod d6/dc/d97/ce9 0 2023-10-08T08:45:57.528 INFO:tasks.workunit.client.0.smithi070.stdout:7/698: dwrite d3/da9/d4a/f83 [0,4194304] 0 2023-10-08T08:45:57.528 INFO:tasks.workunit.client.0.smithi070.stdout:7/699: truncate d3/da9/d4a/d9/f48 13218654 0 2023-10-08T08:45:57.528 INFO:tasks.workunit.client.0.smithi070.stdout:7/700: stat d3/da9/d1e/l36 0 2023-10-08T08:45:57.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/713: rmdir d6/dc/d14/d1f/d63/daa/de1 0 2023-10-08T08:45:57.531 INFO:tasks.workunit.client.0.smithi070.stdout:7/701: mknod d3/d19/d95/ced 0 2023-10-08T08:45:57.531 INFO:tasks.workunit.client.0.smithi070.stdout:7/702: fdatasync d3/da9/f58 0 2023-10-08T08:45:57.533 INFO:tasks.workunit.client.0.smithi070.stdout:7/703: creat d3/da9/d1e/d4c/fee x:0 0 0 2023-10-08T08:45:57.533 INFO:tasks.workunit.client.0.smithi070.stdout:7/704: chown d3/da9/d1e/d4c/f7e 55964 1 2023-10-08T08:45:57.534 INFO:tasks.workunit.client.0.smithi070.stdout:7/705: mknod d3/da9/d4a/cef 0 2023-10-08T08:45:57.574 INFO:tasks.workunit.client.0.smithi070.stdout:8/712: dwrite d1/d2/d6/d22/d5b/d74/de1/d3a/f6c [0,4194304] 0 2023-10-08T08:45:57.575 INFO:tasks.workunit.client.0.smithi070.stdout:4/590: write dc/d17/d1f/f34 [3018267,49293] 0 2023-10-08T08:45:57.576 INFO:tasks.workunit.client.0.smithi070.stdout:8/713: mknod d1/d2/d6/d22/d5b/d74/dc3/dd6/ce8 0 2023-10-08T08:45:57.576 INFO:tasks.workunit.client.0.smithi070.stdout:8/714: readlink d1/d2/d6/l9 0 2023-10-08T08:45:57.577 INFO:tasks.workunit.client.0.smithi070.stdout:0/836: dwrite d1/d1d/d4d/d9d/f4f [0,4194304] 0 2023-10-08T08:45:57.577 INFO:tasks.workunit.client.0.smithi070.stdout:4/591: creat dc/d17/d24/d55/fbb x:0 0 0 2023-10-08T08:45:57.579 INFO:tasks.workunit.client.0.smithi070.stdout:0/837: mknod d1/d62/d103/c107 0 2023-10-08T08:45:57.579 INFO:tasks.workunit.client.0.smithi070.stdout:0/838: fsync d1/f6b 0 2023-10-08T08:45:57.581 INFO:tasks.workunit.client.0.smithi070.stdout:4/592: unlink dc/d17/d1f/d5e/lae 0 2023-10-08T08:45:57.581 INFO:tasks.workunit.client.0.smithi070.stdout:2/834: dwrite df/d12/f37 [0,4194304] 0 2023-10-08T08:45:57.581 INFO:tasks.workunit.client.0.smithi070.stdout:2/835: chown df/f5c 50911306 1 2023-10-08T08:45:57.583 INFO:tasks.workunit.client.0.smithi070.stdout:0/839: write d1/dd/f13 [2079856,83835] 0 2023-10-08T08:45:57.583 INFO:tasks.workunit.client.0.smithi070.stdout:2/836: mknod df/d12/d1b/d1c/dcd/c10e 0 2023-10-08T08:45:57.584 INFO:tasks.workunit.client.0.smithi070.stdout:2/837: chown df/d3a/db6/f109 193735115 1 2023-10-08T08:45:57.584 INFO:tasks.workunit.client.0.smithi070.stdout:0/840: read - d1/d1d/d24/f72 zero size 2023-10-08T08:45:57.584 INFO:tasks.workunit.client.0.smithi070.stdout:4/593: read dc/f15 [3512026,108568] 0 2023-10-08T08:45:57.584 INFO:tasks.workunit.client.0.smithi070.stdout:7/706: dread d3/da9/d1e/fab [0,4194304] 0 2023-10-08T08:45:57.585 INFO:tasks.workunit.client.0.smithi070.stdout:0/841: creat d1/d1d/f108 x:0 0 0 2023-10-08T08:45:57.585 INFO:tasks.workunit.client.0.smithi070.stdout:7/707: mknod d3/da9/d1e/d76/cf0 0 2023-10-08T08:45:57.585 INFO:tasks.workunit.client.0.smithi070.stdout:7/708: dread - d3/da9/d4a/d9/da4/dae/fe1 zero size 2023-10-08T08:45:57.586 INFO:tasks.workunit.client.0.smithi070.stdout:8/715: rmdir d1/d2/d6/d22/d5c 39 2023-10-08T08:45:57.586 INFO:tasks.workunit.client.0.smithi070.stdout:8/716: chown d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/f93 12283 1 2023-10-08T08:45:57.587 INFO:tasks.workunit.client.0.smithi070.stdout:0/842: symlink d1/dd/dae/l109 0 2023-10-08T08:45:57.587 INFO:tasks.workunit.client.0.smithi070.stdout:4/594: rmdir dc/d68 39 2023-10-08T08:45:57.588 INFO:tasks.workunit.client.0.smithi070.stdout:8/717: rename d1/d2/d6/d22/d5b/d74/de1/d2e/cb6 to d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/ce9 0 2023-10-08T08:45:57.589 INFO:tasks.workunit.client.0.smithi070.stdout:7/709: link d3/da9/d4a/d9/da4/dae/fe1 d3/d19/d6d/dd7/ff1 0 2023-10-08T08:45:57.589 INFO:tasks.workunit.client.0.smithi070.stdout:8/718: mkdir d1/d2/d6/d22/d5b/d74/de1/d3a/dea 0 2023-10-08T08:45:57.590 INFO:tasks.workunit.client.0.smithi070.stdout:4/595: unlink dc/d5a/c74 0 2023-10-08T08:45:57.590 INFO:tasks.workunit.client.0.smithi070.stdout:4/596: write dc/d17/d24/d4c/f8a [757098,55092] 0 2023-10-08T08:45:57.590 INFO:tasks.workunit.client.0.smithi070.stdout:4/597: chown dc/f4b 156 1 2023-10-08T08:45:57.590 INFO:tasks.workunit.client.0.smithi070.stdout:0/843: link d1/d1d/d24/ce0 d1/d76/d102/c10a 0 2023-10-08T08:45:57.591 INFO:tasks.workunit.client.0.smithi070.stdout:0/844: fdatasync d1/d1d/f69 0 2023-10-08T08:45:57.591 INFO:tasks.workunit.client.0.smithi070.stdout:8/719: mknod d1/d2/d6/d22/d5b/d74/dc3/dd6/ceb 0 2023-10-08T08:45:57.592 INFO:tasks.workunit.client.0.smithi070.stdout:8/720: write d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/f9c [3419042,4364] 0 2023-10-08T08:45:57.593 INFO:tasks.workunit.client.0.smithi070.stdout:7/710: link d3/da9/d4a/l15 d3/d79/lf2 0 2023-10-08T08:45:57.593 INFO:tasks.workunit.client.0.smithi070.stdout:8/721: truncate d1/d4d/f5f 3779269 0 2023-10-08T08:45:57.594 INFO:tasks.workunit.client.0.smithi070.stdout:4/598: read dc/d5f/fb3 [197506,130120] 0 2023-10-08T08:45:57.594 INFO:tasks.workunit.client.0.smithi070.stdout:4/599: stat dc/d17 0 2023-10-08T08:45:57.595 INFO:tasks.workunit.client.0.smithi070.stdout:8/722: mknod d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/cec 0 2023-10-08T08:45:57.596 INFO:tasks.workunit.client.0.smithi070.stdout:4/600: symlink dc/lbc 0 2023-10-08T08:45:57.597 INFO:tasks.workunit.client.0.smithi070.stdout:0/845: link d1/d14/fd9 d1/dd/f10b 0 2023-10-08T08:45:57.597 INFO:tasks.workunit.client.0.smithi070.stdout:8/723: mkdir d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/ded 0 2023-10-08T08:45:57.598 INFO:tasks.workunit.client.0.smithi070.stdout:4/601: write dc/d17/d24/d55/da4/fa5 [4153042,57452] 0 2023-10-08T08:45:57.598 INFO:tasks.workunit.client.0.smithi070.stdout:8/724: creat d1/d2/d6/fee x:0 0 0 2023-10-08T08:45:57.599 INFO:tasks.workunit.client.0.smithi070.stdout:7/711: getdents d3/da9/d4a/d9/d97 0 2023-10-08T08:45:57.599 INFO:tasks.workunit.client.0.smithi070.stdout:7/712: readlink d3/d19/l7c 0 2023-10-08T08:45:57.599 INFO:tasks.workunit.client.0.smithi070.stdout:7/713: stat d3/da9/d1e/d76/cf0 0 2023-10-08T08:45:57.599 INFO:tasks.workunit.client.0.smithi070.stdout:8/725: getdents d1/d2/d6/d22/d5b/d74/de1/d15 0 2023-10-08T08:45:57.600 INFO:tasks.workunit.client.0.smithi070.stdout:4/602: creat dc/d17/d24/d4c/d4e/fbd x:0 0 0 2023-10-08T08:45:57.600 INFO:tasks.workunit.client.0.smithi070.stdout:4/603: dread - dc/d17/d24/d55/fbb zero size 2023-10-08T08:45:57.600 INFO:tasks.workunit.client.0.smithi070.stdout:8/726: dread d1/d2/d6/d22/d5b/d74/de1/d1a/fc1 [0,4194304] 0 2023-10-08T08:45:57.602 INFO:tasks.workunit.client.0.smithi070.stdout:8/727: symlink d1/d2/d6/d22/d5b/d74/de1/d2e/lef 0 2023-10-08T08:45:57.602 INFO:tasks.workunit.client.0.smithi070.stdout:8/728: chown d1/d2/lc5 6 1 2023-10-08T08:45:57.602 INFO:tasks.workunit.client.0.smithi070.stdout:4/604: rename dc/f4d to dc/d5f/fbe 0 2023-10-08T08:45:57.602 INFO:tasks.workunit.client.0.smithi070.stdout:4/605: readlink dc/d5a/lb5 0 2023-10-08T08:45:57.605 INFO:tasks.workunit.client.0.smithi070.stdout:8/729: rename d1/d4d/d61/fb3 to d1/d2/d6/d22/d9e/de2/ff0 0 2023-10-08T08:45:57.605 INFO:tasks.workunit.client.0.smithi070.stdout:3/765: dwrite d0/db/d10/d38/d2f/f66 [0,4194304] 0 2023-10-08T08:45:57.608 INFO:tasks.workunit.client.0.smithi070.stdout:2/838: dwrite df/d12/d1b/d82/d85/fba [0,4194304] 0 2023-10-08T08:45:57.608 INFO:tasks.workunit.client.0.smithi070.stdout:4/606: dread dc/d17/d24/d55/fb4 [0,4194304] 0 2023-10-08T08:45:57.609 INFO:tasks.workunit.client.0.smithi070.stdout:4/607: rmdir dc/d17/d79/dad 39 2023-10-08T08:45:57.611 INFO:tasks.workunit.client.0.smithi070.stdout:4/608: unlink dc/d17/d24/d37/c38 0 2023-10-08T08:45:57.611 INFO:tasks.workunit.client.0.smithi070.stdout:4/609: chown dc/d17/d24/d37/c5c 522206914 1 2023-10-08T08:45:57.612 INFO:tasks.workunit.client.0.smithi070.stdout:4/610: mkdir dc/d17/dbf 0 2023-10-08T08:45:57.612 INFO:tasks.workunit.client.0.smithi070.stdout:8/730: rename d1/d2/d6/d22/d5b/d74/de1/d3a/c50 to d1/d2/cf1 0 2023-10-08T08:45:57.612 INFO:tasks.workunit.client.0.smithi070.stdout:8/731: fsync d1/d2/d6/d22/d5b/d74/de1/d3a/d56/f95 0 2023-10-08T08:45:57.612 INFO:tasks.workunit.client.0.smithi070.stdout:4/611: mknod dc/d17/d1f/d5e/cc0 0 2023-10-08T08:45:57.613 INFO:tasks.workunit.client.0.smithi070.stdout:0/846: rmdir d1/d62/d54/d5e/d80 39 2023-10-08T08:45:57.613 INFO:tasks.workunit.client.0.smithi070.stdout:4/612: mkdir dc/d17/d79/dad/db6/dc1 0 2023-10-08T08:45:57.614 INFO:tasks.workunit.client.0.smithi070.stdout:4/613: fdatasync dc/d17/d24/f49 0 2023-10-08T08:45:57.614 INFO:tasks.workunit.client.0.smithi070.stdout:4/614: getdents dc/d17/d24/d6b 0 2023-10-08T08:45:57.614 INFO:tasks.workunit.client.0.smithi070.stdout:4/615: readlink dc/d17/l30 0 2023-10-08T08:45:57.616 INFO:tasks.workunit.client.0.smithi070.stdout:4/616: rename dc/f1e to dc/d17/d1f/d5e/d9f/fc2 0 2023-10-08T08:45:57.618 INFO:tasks.workunit.client.0.smithi070.stdout:4/617: mkdir dc/d17/d79/dad/db6/dc1/dc3 0 2023-10-08T08:45:57.620 INFO:tasks.workunit.client.0.smithi070.stdout:2/839: creat df/d12/d1b/d1c/d69/d100/d83/d92/d102/f10f x:0 0 0 2023-10-08T08:45:57.620 INFO:tasks.workunit.client.0.smithi070.stdout:0/847: mkdir d1/d14/d1f/d6f/d10c 0 2023-10-08T08:45:57.620 INFO:tasks.workunit.client.0.smithi070.stdout:2/840: stat df/d12/d1b/d1c/f56 0 2023-10-08T08:45:57.621 INFO:tasks.workunit.client.0.smithi070.stdout:0/848: chown d1/dd 1628821 1 2023-10-08T08:45:57.621 INFO:tasks.workunit.client.0.smithi070.stdout:4/618: rename dc/d17/d79/cac to dc/d17/d24/cc4 0 2023-10-08T08:45:57.622 INFO:tasks.workunit.client.0.smithi070.stdout:0/849: mkdir d1/d62/d54/dfc/d10d 0 2023-10-08T08:45:57.622 INFO:tasks.workunit.client.0.smithi070.stdout:0/850: chown d1/d14/cb5 0 1 2023-10-08T08:45:57.622 INFO:tasks.workunit.client.0.smithi070.stdout:0/851: chown d1/d1d/f108 7810 1 2023-10-08T08:45:57.622 INFO:tasks.workunit.client.0.smithi070.stdout:7/714: dwrite d3/f2b [0,4194304] 0 2023-10-08T08:45:57.627 INFO:tasks.workunit.client.0.smithi070.stdout:8/732: dread d1/d2/d6/d22/f98 [4194304,4194304] 0 2023-10-08T08:45:57.628 INFO:tasks.workunit.client.0.smithi070.stdout:4/619: link dc/d5a/fa2 dc/d17/d24/d4c/d4e/dab/fc5 0 2023-10-08T08:45:57.628 INFO:tasks.workunit.client.0.smithi070.stdout:3/766: dwrite d0/d12/d14/d5c/d5d/da0/faa [0,4194304] 0 2023-10-08T08:45:57.628 INFO:tasks.workunit.client.0.smithi070.stdout:8/733: creat d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/ff2 x:0 0 0 2023-10-08T08:45:57.630 INFO:tasks.workunit.client.0.smithi070.stdout:2/841: rename df/d12/d1b/d1c/d2d/l6f to df/d4c/da9/l110 0 2023-10-08T08:45:57.633 INFO:tasks.workunit.client.0.smithi070.stdout:3/767: mkdir d0/db/d111 0 2023-10-08T08:45:57.633 INFO:tasks.workunit.client.0.smithi070.stdout:3/768: truncate d0/d12/d14/d5c/d5d/da0/d6a/d80/f108 777902 0 2023-10-08T08:45:57.633 INFO:tasks.workunit.client.0.smithi070.stdout:4/620: write dc/f51 [353710,61399] 0 2023-10-08T08:45:57.638 INFO:tasks.workunit.client.0.smithi070.stdout:3/769: read d0/d12/d14/d5c/d5d/da0/f88 [803599,37454] 0 2023-10-08T08:45:57.639 INFO:tasks.workunit.client.0.smithi070.stdout:3/770: chown d0/db/c3c 49 1 2023-10-08T08:45:57.640 INFO:tasks.workunit.client.0.smithi070.stdout:4/621: rename dc/d17/f70 to dc/d17/d24/d4c/fc6 0 2023-10-08T08:45:57.641 INFO:tasks.workunit.client.0.smithi070.stdout:3/771: mknod d0/d8a/c112 0 2023-10-08T08:45:57.642 INFO:tasks.workunit.client.0.smithi070.stdout:3/772: write d0/d12/d14/d5c/d5d/da0/d86/fa7 [546673,57141] 0 2023-10-08T08:45:57.647 INFO:tasks.workunit.client.0.smithi070.stdout:2/842: write df/d12/d1b/d1c/d69/d100/fa6 [1311126,27483] 0 2023-10-08T08:45:57.647 INFO:tasks.workunit.client.0.smithi070.stdout:8/734: dread d1/d2/d6/d22/d5b/d74/de1/d2e/d45/f51 [0,4194304] 0 2023-10-08T08:45:57.653 INFO:tasks.workunit.client.0.smithi070.stdout:6/606: sync 2023-10-08T08:45:57.653 INFO:tasks.workunit.client.0.smithi070.stdout:0/852: dwrite d1/dd/f53 [0,4194304] 0 2023-10-08T08:45:57.655 INFO:tasks.workunit.client.0.smithi070.stdout:7/715: dwrite d3/d19/d1a/f22 [0,4194304] 0 2023-10-08T08:45:57.658 INFO:tasks.workunit.client.0.smithi070.stdout:3/773: rename d0/d12/d14/d1d to d0/d12/d14/d48/d113 0 2023-10-08T08:45:57.658 INFO:tasks.workunit.client.0.smithi070.stdout:3/774: fdatasync d0/d12/d14/d48/d113/fa8 0 2023-10-08T08:45:57.658 INFO:tasks.workunit.client.0.smithi070.stdout:7/716: truncate d3/da9/d4a/d9/d97/f9b 1968903 0 2023-10-08T08:45:57.659 INFO:tasks.workunit.client.0.smithi070.stdout:0/853: write d1/dd/f3d [330608,51568] 0 2023-10-08T08:45:57.659 INFO:tasks.workunit.client.0.smithi070.stdout:7/717: truncate d3/da9/d1e/d4c/f80 291036 0 2023-10-08T08:45:57.660 INFO:tasks.workunit.client.0.smithi070.stdout:8/735: rename d1/d2/dd4 to d1/d2/d6/d22/d5b/d74/de1/d3a/df3 0 2023-10-08T08:45:57.661 INFO:tasks.workunit.client.0.smithi070.stdout:0/854: truncate d1/d1d/d4d/d9d/fa1 3734008 0 2023-10-08T08:45:57.661 INFO:tasks.workunit.client.0.smithi070.stdout:0/855: dread - d1/d1d/d24/df4/ff8 zero size 2023-10-08T08:45:57.661 INFO:tasks.workunit.client.0.smithi070.stdout:0/856: readlink d1/d14/lc1 0 2023-10-08T08:45:57.662 INFO:tasks.workunit.client.0.smithi070.stdout:0/857: fdatasync d1/d14/d1f/d6f/fd0 0 2023-10-08T08:45:57.662 INFO:tasks.workunit.client.0.smithi070.stdout:3/775: symlink d0/d12/d14/d5c/d5d/da0/d101/d52/l114 0 2023-10-08T08:45:57.662 INFO:tasks.workunit.client.0.smithi070.stdout:3/776: chown d0/d8a 4842785 1 2023-10-08T08:45:57.662 INFO:tasks.workunit.client.0.smithi070.stdout:3/777: readlink d0/d12/d14/d5c/d5d/da0/d6a/d80/de2/lff 0 2023-10-08T08:45:57.663 INFO:tasks.workunit.client.0.smithi070.stdout:8/736: truncate d1/d2/d6/d22/d5b/d74/de1/f34 451013 0 2023-10-08T08:45:57.664 INFO:tasks.workunit.client.0.smithi070.stdout:3/778: creat d0/d8a/f115 x:0 0 0 2023-10-08T08:45:57.664 INFO:tasks.workunit.client.0.smithi070.stdout:3/779: write d0/d12/d14/d5c/fbc [98091,14837] 0 2023-10-08T08:45:57.665 INFO:tasks.workunit.client.0.smithi070.stdout:8/737: truncate d1/d2/d6/d22/d5b/d74/de1/d15/f20 642127 0 2023-10-08T08:45:57.665 INFO:tasks.workunit.client.0.smithi070.stdout:8/738: stat d1/d4d/d61/fa2 0 2023-10-08T08:45:57.667 INFO:tasks.workunit.client.0.smithi070.stdout:3/780: read d0/d12/d14/d48/f84 [238513,38533] 0 2023-10-08T08:45:57.667 INFO:tasks.workunit.client.0.smithi070.stdout:8/739: mkdir d1/d23/df4 0 2023-10-08T08:45:57.669 INFO:tasks.workunit.client.0.smithi070.stdout:8/740: creat d1/d2/d6/d22/d5b/d74/de1/da9/ff5 x:0 0 0 2023-10-08T08:45:57.670 INFO:tasks.workunit.client.0.smithi070.stdout:6/607: write df/d11/f47 [383350,68385] 0 2023-10-08T08:45:57.670 INFO:tasks.workunit.client.0.smithi070.stdout:4/622: dread dc/d17/d24/fa6 [0,4194304] 0 2023-10-08T08:45:57.670 INFO:tasks.workunit.client.0.smithi070.stdout:6/608: chown df/d26/c46 55 1 2023-10-08T08:45:57.670 INFO:tasks.workunit.client.0.smithi070.stdout:7/718: rmdir d3/da9/d4a/d50 39 2023-10-08T08:45:57.671 INFO:tasks.workunit.client.0.smithi070.stdout:6/609: symlink df/lc7 0 2023-10-08T08:45:57.673 INFO:tasks.workunit.client.0.smithi070.stdout:4/623: rmdir dc/d17 39 2023-10-08T08:45:57.679 INFO:tasks.workunit.client.0.smithi070.stdout:8/741: dread d1/d2/d6/d22/d5b/d74/de1/d2e/fa8 [0,4194304] 0 2023-10-08T08:45:57.689 INFO:tasks.workunit.client.0.smithi070.stdout:7/719: dread d3/da9/d1e/d76/fb7 [0,4194304] 0 2023-10-08T08:45:57.691 INFO:tasks.workunit.client.0.smithi070.stdout:7/720: mknod d3/d19/d95/da3/cf3 0 2023-10-08T08:45:57.691 INFO:tasks.workunit.client.0.smithi070.stdout:7/721: write d3/da9/d4a/d9/da4/dd6/fe9 [935395,63988] 0 2023-10-08T08:45:57.691 INFO:tasks.workunit.client.0.smithi070.stdout:0/858: dwrite d1/d14/d1f/fad [4194304,4194304] 0 2023-10-08T08:45:57.691 INFO:tasks.workunit.client.0.smithi070.stdout:3/781: dwrite d0/d12/f81 [0,4194304] 0 2023-10-08T08:45:57.693 INFO:tasks.workunit.client.0.smithi070.stdout:3/782: mknod d0/db/d10/d38/d2f/c116 0 2023-10-08T08:45:57.693 INFO:tasks.workunit.client.0.smithi070.stdout:0/859: creat d1/d14/de2/d105/f10e x:0 0 0 2023-10-08T08:45:57.695 INFO:tasks.workunit.client.0.smithi070.stdout:3/783: mkdir d0/d12/d14/d5c/dc4/d117 0 2023-10-08T08:45:57.695 INFO:tasks.workunit.client.0.smithi070.stdout:3/784: fdatasync d0/d12/f7c 0 2023-10-08T08:45:57.695 INFO:tasks.workunit.client.0.smithi070.stdout:3/785: chown d0/d12/d14/d5c/d5d/da0/d6a/d80/de2/lf2 1058 1 2023-10-08T08:45:57.695 INFO:tasks.workunit.client.0.smithi070.stdout:3/786: stat d0/d12/d14/d48/l60 0 2023-10-08T08:45:57.696 INFO:tasks.workunit.client.0.smithi070.stdout:3/787: write d0/d12/d14/f10f [546116,121671] 0 2023-10-08T08:45:57.696 INFO:tasks.workunit.client.0.smithi070.stdout:3/788: fdatasync d0/d12/d14/d48/d113/dba/fde 0 2023-10-08T08:45:57.697 INFO:tasks.workunit.client.0.smithi070.stdout:3/789: rename d0/d12/d14/d48/d113/lb0 to d0/d12/d14/d48/d113/de6/l118 0 2023-10-08T08:45:57.697 INFO:tasks.workunit.client.0.smithi070.stdout:3/790: fdatasync d0/db/f26 0 2023-10-08T08:45:57.697 INFO:tasks.workunit.client.0.smithi070.stdout:3/791: rename d0/d12 to d0/d12/d14/d5c/d5d/d119 22 2023-10-08T08:45:57.698 INFO:tasks.workunit.client.0.smithi070.stdout:7/722: link d3/d19/d1a/f20 d3/ff4 0 2023-10-08T08:45:57.702 INFO:tasks.workunit.client.0.smithi070.stdout:0/860: unlink d1/d62/d54/d5e/d80/d8a/dc3/feb 0 2023-10-08T08:45:57.702 INFO:tasks.workunit.client.0.smithi070.stdout:3/792: rename d0/d12/d14/d5c/d5d/da0/d101/c56 to d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/c11a 0 2023-10-08T08:45:57.705 INFO:tasks.workunit.client.0.smithi070.stdout:4/624: dwrite dc/d17/d24/d4c/d4e/dab/fc5 [0,4194304] 0 2023-10-08T08:45:57.706 INFO:tasks.workunit.client.0.smithi070.stdout:4/625: mkdir dc/d17/d24/d6b/dc7 0 2023-10-08T08:45:57.707 INFO:tasks.workunit.client.0.smithi070.stdout:7/723: rmdir d3/da9/d4a/d50/d9f/dc5 39 2023-10-08T08:45:57.708 INFO:tasks.workunit.client.0.smithi070.stdout:8/742: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/f9c [0,4194304] 0 2023-10-08T08:45:57.709 INFO:tasks.workunit.client.0.smithi070.stdout:4/626: unlink dc/d17/d1f/l3d 0 2023-10-08T08:45:57.712 INFO:tasks.workunit.client.0.smithi070.stdout:7/724: mknod d3/da9/d1e/d76/cf5 0 2023-10-08T08:45:57.712 INFO:tasks.workunit.client.0.smithi070.stdout:7/725: chown d3/d19/c6a 1 1 2023-10-08T08:45:57.712 INFO:tasks.workunit.client.0.smithi070.stdout:7/726: chown d3/da9/d4a/d9/l9c 51 1 2023-10-08T08:45:57.712 INFO:tasks.workunit.client.0.smithi070.stdout:4/627: mknod dc/d17/d79/dad/db6/cc8 0 2023-10-08T08:45:57.712 INFO:tasks.workunit.client.0.smithi070.stdout:3/793: write d0/d12/d14/d48/d113/f6c [56607,37724] 0 2023-10-08T08:45:57.714 INFO:tasks.workunit.client.0.smithi070.stdout:4/628: creat dc/d17/d79/dad/db6/dc1/fc9 x:0 0 0 2023-10-08T08:45:57.716 INFO:tasks.workunit.client.0.smithi070.stdout:7/727: dread d3/d19/f3c [0,4194304] 0 2023-10-08T08:45:57.716 INFO:tasks.workunit.client.0.smithi070.stdout:4/629: symlink dc/d17/d1f/d5e/lca 0 2023-10-08T08:45:57.719 INFO:tasks.workunit.client.0.smithi070.stdout:7/728: write d3/da9/d1e/fab [1811995,28134] 0 2023-10-08T08:45:57.719 INFO:tasks.workunit.client.0.smithi070.stdout:7/729: stat d3/d19/d1a/f40 0 2023-10-08T08:45:57.719 INFO:tasks.workunit.client.0.smithi070.stdout:4/630: rename dc/d17/d1f/f34 to dc/d68/fcb 0 2023-10-08T08:45:57.724 INFO:tasks.workunit.client.0.smithi070.stdout:1/714: sync 2023-10-08T08:45:57.724 INFO:tasks.workunit.client.0.smithi070.stdout:5/680: sync 2023-10-08T08:45:57.724 INFO:tasks.workunit.client.0.smithi070.stdout:9/505: sync 2023-10-08T08:45:57.725 INFO:tasks.workunit.client.0.smithi070.stdout:9/506: truncate f0 1947759 0 2023-10-08T08:45:57.725 INFO:tasks.workunit.client.0.smithi070.stdout:9/507: write d1/dd/d19/f79 [467112,79442] 0 2023-10-08T08:45:57.726 INFO:tasks.workunit.client.0.smithi070.stdout:8/743: dread d1/d2/d6/d22/f33 [0,4194304] 0 2023-10-08T08:45:57.727 INFO:tasks.workunit.client.0.smithi070.stdout:9/508: link d1/dd/d26/d27/d2d/c75 d1/dd/d39/d66/d82/c92 0 2023-10-08T08:45:57.734 INFO:tasks.workunit.client.0.smithi070.stdout:0/861: dwrite d1/d14/d1f/d6f/fd0 [0,4194304] 0 2023-10-08T08:45:57.734 INFO:tasks.workunit.client.0.smithi070.stdout:0/862: chown d1/d1d/d24/df4/f59 393394 1 2023-10-08T08:45:57.734 INFO:tasks.workunit.client.0.smithi070.stdout:1/715: write d6/dc/d14/d1f/f2b [541759,37859] 0 2023-10-08T08:45:57.740 INFO:tasks.workunit.client.0.smithi070.stdout:0/863: mkdir d1/d14/d1f/d10f 0 2023-10-08T08:45:57.741 INFO:tasks.workunit.client.0.smithi070.stdout:7/730: dread d3/d19/d1a/f40 [0,4194304] 0 2023-10-08T08:45:57.742 INFO:tasks.workunit.client.0.smithi070.stdout:3/794: dwrite d0/db/d10/f8f [0,4194304] 0 2023-10-08T08:45:57.742 INFO:tasks.workunit.client.0.smithi070.stdout:3/795: fdatasync d0/d12/d14/d5c/fef 0 2023-10-08T08:45:57.743 INFO:tasks.workunit.client.0.smithi070.stdout:1/716: rename d6/dc/d14/d1f/d63/db3/d38/f5f to d6/dc/d14/d1f/d63/fea 0 2023-10-08T08:45:57.745 INFO:tasks.workunit.client.0.smithi070.stdout:7/731: mkdir d3/d77/de2/df6 0 2023-10-08T08:45:57.745 INFO:tasks.workunit.client.0.smithi070.stdout:1/717: mkdir d6/dc/d14/d62/d95/deb 0 2023-10-08T08:45:57.745 INFO:tasks.workunit.client.0.smithi070.stdout:7/732: write d3/da9/d4a/d9/da4/dae/fe5 [436457,120411] 0 2023-10-08T08:45:57.746 INFO:tasks.workunit.client.0.smithi070.stdout:3/796: rmdir d0/db/d111 0 2023-10-08T08:45:57.749 INFO:tasks.workunit.client.0.smithi070.stdout:8/744: write d1/d2/d6/d22/d5c/f8d [1942419,4739] 0 2023-10-08T08:45:57.750 INFO:tasks.workunit.client.0.smithi070.stdout:9/509: dread d1/dd/d1a/f62 [0,4194304] 0 2023-10-08T08:45:57.751 INFO:tasks.workunit.client.0.smithi070.stdout:0/864: rename d1/d62/d54/d5e/d80/d8a/fc4 to d1/d14/d1f/d6f/f110 0 2023-10-08T08:45:57.751 INFO:tasks.workunit.client.0.smithi070.stdout:9/510: write d1/fb [1962588,18577] 0 2023-10-08T08:45:57.753 INFO:tasks.workunit.client.0.smithi070.stdout:8/745: symlink d1/d2/d6/d22/d9e/lf6 0 2023-10-08T08:45:57.753 INFO:tasks.workunit.client.0.smithi070.stdout:8/746: getdents d1/d2/d6/d22/d9e/da7/dbe 0 2023-10-08T08:45:57.753 INFO:tasks.workunit.client.0.smithi070.stdout:8/747: fsync d1/d4d/f81 0 2023-10-08T08:45:57.753 INFO:tasks.workunit.client.0.smithi070.stdout:9/511: mkdir d1/dd/d1a/d40/d76/d93 0 2023-10-08T08:45:57.753 INFO:tasks.workunit.client.0.smithi070.stdout:9/512: chown d1/dd/d1a/c6a 8 1 2023-10-08T08:45:57.753 INFO:tasks.workunit.client.0.smithi070.stdout:1/718: rename d6/dc/d14/d1f/f72 to d6/dc/d97/fec 0 2023-10-08T08:45:57.754 INFO:tasks.workunit.client.0.smithi070.stdout:4/631: dwrite dc/d17/d24/d6b/f6c [0,4194304] 0 2023-10-08T08:45:57.758 INFO:tasks.workunit.client.0.smithi070.stdout:7/733: rename d3/da9/d1e/d4c/f7e to d3/d19/d6d/de7/ff7 0 2023-10-08T08:45:57.758 INFO:tasks.workunit.client.0.smithi070.stdout:7/734: stat d3/da9/d4a/f43 0 2023-10-08T08:45:57.759 INFO:tasks.workunit.client.0.smithi070.stdout:7/735: dread - d3/da9/d4a/d9/da4/dae/fe1 zero size 2023-10-08T08:45:57.759 INFO:tasks.workunit.client.0.smithi070.stdout:1/719: mkdir d6/dc/d14/d90/ded 0 2023-10-08T08:45:57.759 INFO:tasks.workunit.client.0.smithi070.stdout:4/632: rmdir dc/d17/d24/d55/da4 39 2023-10-08T08:45:57.759 INFO:tasks.workunit.client.0.smithi070.stdout:4/633: getdents dc/d17/dbf 0 2023-10-08T08:45:57.759 INFO:tasks.workunit.client.0.smithi070.stdout:4/634: dread - dc/d17/d24/d4c/d4e/faa zero size 2023-10-08T08:45:57.759 INFO:tasks.workunit.client.0.smithi070.stdout:4/635: readlink dc/d17/l58 0 2023-10-08T08:45:57.759 INFO:tasks.workunit.client.0.smithi070.stdout:7/736: truncate d3/da9/f9d 610999 0 2023-10-08T08:45:57.759 INFO:tasks.workunit.client.0.smithi070.stdout:4/636: symlink dc/d17/d24/d4c/d4e/lcc 0 2023-10-08T08:45:57.760 INFO:tasks.workunit.client.0.smithi070.stdout:7/737: truncate d3/d19/d6d/de7/ff7 2871954 0 2023-10-08T08:45:57.760 INFO:tasks.workunit.client.0.smithi070.stdout:7/738: readlink d3/da9/d1e/d76/l89 0 2023-10-08T08:45:57.760 INFO:tasks.workunit.client.0.smithi070.stdout:7/739: fsync d3/d19/d6d/f8f 0 2023-10-08T08:45:57.766 INFO:tasks.workunit.client.0.smithi070.stdout:8/748: rename d1/d2/d6/d22/d5b/c8e to d1/cf7 0 2023-10-08T08:45:57.769 INFO:tasks.workunit.client.0.smithi070.stdout:8/749: write d1/d2/d6/d22/d5c/f8d [257341,100531] 0 2023-10-08T08:45:57.771 INFO:tasks.workunit.client.0.smithi070.stdout:8/750: creat d1/d2/d6/d22/d5b/d74/de1/dca/ff8 x:0 0 0 2023-10-08T08:45:57.788 INFO:tasks.workunit.client.0.smithi070.stdout:5/681: dwrite d5/da/d4d/fad [0,4194304] 0 2023-10-08T08:45:57.791 INFO:tasks.workunit.client.0.smithi070.stdout:5/682: dread d5/d5f/d63/d8b/da8/dac/fb8 [0,4194304] 0 2023-10-08T08:45:57.793 INFO:tasks.workunit.client.0.smithi070.stdout:5/683: symlink d5/da/d22/d75/le1 0 2023-10-08T08:45:57.794 INFO:tasks.workunit.client.0.smithi070.stdout:5/684: mkdir d5/d5f/d63/d8b/da8/dac/de2 0 2023-10-08T08:45:57.798 INFO:tasks.workunit.client.0.smithi070.stdout:8/751: dread d1/d2/d6/d22/f60 [0,4194304] 0 2023-10-08T08:45:57.801 INFO:tasks.workunit.client.0.smithi070.stdout:7/740: dwrite d3/da9/d1e/d76/f8a [0,4194304] 0 2023-10-08T08:45:57.803 INFO:tasks.workunit.client.0.smithi070.stdout:7/741: link d3/d19/d1a/c23 d3/da9/d4a/d9/cf8 0 2023-10-08T08:45:57.806 INFO:tasks.workunit.client.0.smithi070.stdout:0/865: write d1/d14/d1f/f66 [2366191,30303] 0 2023-10-08T08:45:57.817 INFO:tasks.workunit.client.0.smithi070.stdout:8/752: dwrite d1/d2/d6/d22/d5b/d74/de1/d21/fe3 [0,4194304] 0 2023-10-08T08:45:57.820 INFO:tasks.workunit.client.0.smithi070.stdout:8/753: write d1/d2/d6/d22/d5b/d74/de1/d21/fe3 [2004771,108118] 0 2023-10-08T08:45:57.821 INFO:tasks.workunit.client.0.smithi070.stdout:8/754: mkdir d1/d2/d6/d22/d9e/da7/df9 0 2023-10-08T08:45:57.822 INFO:tasks.workunit.client.0.smithi070.stdout:8/755: chown d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/cb2 627946 1 2023-10-08T08:45:57.822 INFO:tasks.workunit.client.0.smithi070.stdout:8/756: fdatasync d1/d2/d6/d22/d5b/d74/de1/d3a/fa6 0 2023-10-08T08:45:57.822 INFO:tasks.workunit.client.0.smithi070.stdout:8/757: mkdir d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/dfa 0 2023-10-08T08:45:57.823 INFO:tasks.workunit.client.0.smithi070.stdout:8/758: rmdir d1/d2/d6/d22/d5b/d74/dc3/dd6 39 2023-10-08T08:45:57.823 INFO:tasks.workunit.client.0.smithi070.stdout:8/759: fdatasync d1/d2/d6/d22/d5b/d74/de1/d2e/d45/f51 0 2023-10-08T08:45:57.824 INFO:tasks.workunit.client.0.smithi070.stdout:8/760: chown d1/d2/d6/d22/d5b/d74/de1/d2e/d45/c96 2743 1 2023-10-08T08:45:57.833 INFO:tasks.workunit.client.0.smithi070.stdout:8/761: dread d1/d2/d6/d22/d9e/de2/ff0 [0,4194304] 0 2023-10-08T08:45:57.834 INFO:tasks.workunit.client.0.smithi070.stdout:8/762: rename d1/d2/d6/d22/f4c to d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/ffb 0 2023-10-08T08:45:57.835 INFO:tasks.workunit.client.0.smithi070.stdout:8/763: mknod d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/cfc 0 2023-10-08T08:45:57.836 INFO:tasks.workunit.client.0.smithi070.stdout:8/764: creat d1/d2/d6/d22/d5c/d99/ffd x:0 0 0 2023-10-08T08:45:57.838 INFO:tasks.workunit.client.0.smithi070.stdout:8/765: write d1/d4d/f84 [790381,85890] 0 2023-10-08T08:45:57.838 INFO:tasks.workunit.client.0.smithi070.stdout:8/766: write d1/d2/d6/d22/d5c/d99/f9d [1704703,25214] 0 2023-10-08T08:45:57.838 INFO:tasks.workunit.client.0.smithi070.stdout:8/767: fsync d1/d2/d6/d22/d5b/d74/de1/d3a/f3f 0 2023-10-08T08:45:57.880 INFO:tasks.workunit.client.0.smithi070.stdout:9/513: dwrite f0 [0,4194304] 0 2023-10-08T08:45:57.882 INFO:tasks.workunit.client.0.smithi070.stdout:4/637: dwrite dc/d17/d1f/d54/f72 [4194304,4194304] 0 2023-10-08T08:45:57.882 INFO:tasks.workunit.client.0.smithi070.stdout:4/638: fsync dc/d17/d24/d4c/f94 0 2023-10-08T08:45:57.883 INFO:tasks.workunit.client.0.smithi070.stdout:4/639: mknod dc/d17/ccd 0 2023-10-08T08:45:57.883 INFO:tasks.workunit.client.0.smithi070.stdout:4/640: write dc/d17/d24/d4c/f8a [969876,65473] 0 2023-10-08T08:45:57.883 INFO:tasks.workunit.client.0.smithi070.stdout:1/720: dwrite d6/dc/d14/d1f/d63/db3/d38/d4b/fc6 [0,4194304] 0 2023-10-08T08:45:57.884 INFO:tasks.workunit.client.0.smithi070.stdout:4/641: mknod dc/d17/d24/d6b/dc7/cce 0 2023-10-08T08:45:57.889 INFO:tasks.workunit.client.0.smithi070.stdout:1/721: link d6/dc/d14/d1f/d75/d88/lc4 d6/dc/d14/d90/lee 0 2023-10-08T08:45:57.890 INFO:tasks.workunit.client.0.smithi070.stdout:4/642: rmdir dc 39 2023-10-08T08:45:57.892 INFO:tasks.workunit.client.0.smithi070.stdout:1/722: link d6/dc/d14/d1f/d63/db3/f51 d6/dc/d14/d90/ded/fef 0 2023-10-08T08:45:57.892 INFO:tasks.workunit.client.0.smithi070.stdout:1/723: readlink d6/dc/d14/d1f/l30 0 2023-10-08T08:45:57.892 INFO:tasks.workunit.client.0.smithi070.stdout:4/643: creat dc/d17/d24/d6b/fcf x:0 0 0 2023-10-08T08:45:57.892 INFO:tasks.workunit.client.0.smithi070.stdout:4/644: mkdir dc/d17/d1f/d5e/dd0 0 2023-10-08T08:45:57.895 INFO:tasks.workunit.client.0.smithi070.stdout:1/724: truncate f5 4130375 0 2023-10-08T08:45:57.895 INFO:tasks.workunit.client.0.smithi070.stdout:1/725: dread - d6/dc/d14/d1f/d75/d7e/fa4 zero size 2023-10-08T08:45:57.896 INFO:tasks.workunit.client.0.smithi070.stdout:1/726: mknod d6/dc/d14/d1f/d75/d7e/cf0 0 2023-10-08T08:45:57.914 INFO:tasks.workunit.client.0.smithi070.stdout:1/727: dread d6/dc/f59 [0,4194304] 0 2023-10-08T08:45:57.915 INFO:tasks.workunit.client.0.smithi070.stdout:1/728: unlink d6/ca 0 2023-10-08T08:45:57.937 INFO:tasks.workunit.client.0.smithi070.stdout:1/729: dwrite d6/f65 [0,4194304] 0 2023-10-08T08:45:57.938 INFO:tasks.workunit.client.0.smithi070.stdout:4/645: dwrite dc/d17/d1f/d54/f72 [4194304,4194304] 0 2023-10-08T08:45:57.938 INFO:tasks.workunit.client.0.smithi070.stdout:4/646: chown dc/d17/d24/f73 1751045255 1 2023-10-08T08:45:57.939 INFO:tasks.workunit.client.0.smithi070.stdout:1/730: write d6/dc/d14/d1f/f25 [50205,88518] 0 2023-10-08T08:45:57.941 INFO:tasks.workunit.client.0.smithi070.stdout:4/647: write dc/d17/d24/d4c/d4e/f82 [3231024,29982] 0 2023-10-08T08:45:57.941 INFO:tasks.workunit.client.0.smithi070.stdout:1/731: unlink d6/dc/d14/d62/d95/l9e 0 2023-10-08T08:45:57.943 INFO:tasks.workunit.client.0.smithi070.stdout:4/648: mknod dc/d17/d1f/d5e/cd1 0 2023-10-08T08:45:57.945 INFO:tasks.workunit.client.0.smithi070.stdout:4/649: rename dc/d17/d24/d4c/f94 to dc/d17/d24/d4c/d4e/fd2 0 2023-10-08T08:45:57.947 INFO:tasks.workunit.client.0.smithi070.stdout:4/650: creat dc/d17/d24/d55/fd3 x:0 0 0 2023-10-08T08:45:57.947 INFO:tasks.workunit.client.0.smithi070.stdout:4/651: fsync dc/d17/d24/f73 0 2023-10-08T08:45:57.947 INFO:tasks.workunit.client.0.smithi070.stdout:4/652: symlink dc/d17/d24/d55/ld4 0 2023-10-08T08:45:57.948 INFO:tasks.workunit.client.0.smithi070.stdout:4/653: mknod dc/d17/d24/d4c/d4e/dab/cd5 0 2023-10-08T08:45:57.949 INFO:tasks.workunit.client.0.smithi070.stdout:4/654: read dc/f48 [1534582,45944] 0 2023-10-08T08:45:57.951 INFO:tasks.workunit.client.0.smithi070.stdout:4/655: unlink dc/d17/d1f/d54/faf 0 2023-10-08T08:45:57.952 INFO:tasks.workunit.client.0.smithi070.stdout:4/656: creat dc/d17/d24/d4c/d4e/fd6 x:0 0 0 2023-10-08T08:45:57.954 INFO:tasks.workunit.client.0.smithi070.stdout:1/732: dread d6/f1b [0,4194304] 0 2023-10-08T08:45:57.954 INFO:tasks.workunit.client.0.smithi070.stdout:1/733: chown d6/dc/d14/d1f/d63/db3/d38/f4e 1664980 1 2023-10-08T08:45:57.956 INFO:tasks.workunit.client.0.smithi070.stdout:1/734: creat d6/dc/d14/d90/ff1 x:0 0 0 2023-10-08T08:45:57.956 INFO:tasks.workunit.client.0.smithi070.stdout:1/735: creat d6/ff2 x:0 0 0 2023-10-08T08:45:57.958 INFO:tasks.workunit.client.0.smithi070.stdout:1/736: symlink d6/dc/d14/d62/lf3 0 2023-10-08T08:45:57.958 INFO:tasks.workunit.client.0.smithi070.stdout:1/737: fdatasync d6/dc/d14/d62/f6e 0 2023-10-08T08:45:57.974 INFO:tasks.workunit.client.0.smithi070.stdout:4/657: dwrite dc/d17/d24/d4c/d4e/fd6 [0,4194304] 0 2023-10-08T08:45:57.978 INFO:tasks.workunit.client.0.smithi070.stdout:1/738: dwrite d6/dc/d97/fbc [0,4194304] 0 2023-10-08T08:45:57.978 INFO:tasks.workunit.client.0.smithi070.stdout:1/739: fdatasync d6/f55 0 2023-10-08T08:45:57.985 INFO:tasks.workunit.client.0.smithi070.stdout:2/843: sync 2023-10-08T08:45:57.985 INFO:tasks.workunit.client.0.smithi070.stdout:6/610: sync 2023-10-08T08:45:57.986 INFO:tasks.workunit.client.0.smithi070.stdout:6/611: write df/d26/d42/d43/d4a/f6d [1022343,68028] 0 2023-10-08T08:45:57.987 INFO:tasks.workunit.client.0.smithi070.stdout:2/844: write df/d12/d1b/d1c/d69/fd5 [4052281,15917] 0 2023-10-08T08:45:57.989 INFO:tasks.workunit.client.0.smithi070.stdout:2/845: truncate df/d12/d1b/d1c/fb0 4136239 0 2023-10-08T08:45:57.993 INFO:tasks.workunit.client.0.smithi070.stdout:2/846: mkdir df/d12/d1b/d82/d85/d65/da0/d111 0 2023-10-08T08:45:57.994 INFO:tasks.workunit.client.0.smithi070.stdout:2/847: read - df/d12/d1b/d82/d85/d65/ffa zero size 2023-10-08T08:45:57.995 INFO:tasks.workunit.client.0.smithi070.stdout:2/848: mknod df/d12/d1b/d82/d85/d65/da0/c112 0 2023-10-08T08:45:57.996 INFO:tasks.workunit.client.0.smithi070.stdout:2/849: chown df/d12/d15/lbd 202723 1 2023-10-08T08:45:57.997 INFO:tasks.workunit.client.0.smithi070.stdout:2/850: truncate df/d12/d1b/f8c 1368439 0 2023-10-08T08:45:57.997 INFO:tasks.workunit.client.0.smithi070.stdout:1/740: dwrite d6/dc/d14/d1f/d63/db3/d38/f4a [4194304,4194304] 0 2023-10-08T08:45:57.999 INFO:tasks.workunit.client.0.smithi070.stdout:2/851: mkdir df/d113 0 2023-10-08T08:45:57.999 INFO:tasks.workunit.client.0.smithi070.stdout:2/852: chown df/d12/d1b/d82/d85/d65/da0/ldc 3402 1 2023-10-08T08:45:57.999 INFO:tasks.workunit.client.0.smithi070.stdout:1/741: truncate d6/f52 6064216 0 2023-10-08T08:45:58.000 INFO:tasks.workunit.client.0.smithi070.stdout:1/742: fdatasync d6/dc/d14/d1f/d63/db3/f4d 0 2023-10-08T08:45:58.001 INFO:tasks.workunit.client.0.smithi070.stdout:2/853: creat df/d4c/f114 x:0 0 0 2023-10-08T08:45:58.001 INFO:tasks.workunit.client.0.smithi070.stdout:1/743: symlink d6/dc/d14/d1f/d75/d7e/dc2/lf4 0 2023-10-08T08:45:58.001 INFO:tasks.workunit.client.0.smithi070.stdout:2/854: write df/d4c/ff2 [1019401,72187] 0 2023-10-08T08:45:58.001 INFO:tasks.workunit.client.0.smithi070.stdout:2/855: fdatasync df/d3a/db6/dde/fe5 0 2023-10-08T08:45:58.002 INFO:tasks.workunit.client.0.smithi070.stdout:1/744: symlink d6/dc/d14/d1f/lf5 0 2023-10-08T08:45:58.002 INFO:tasks.workunit.client.0.smithi070.stdout:1/745: truncate d6/f55 5207605 0 2023-10-08T08:45:58.002 INFO:tasks.workunit.client.0.smithi070.stdout:1/746: chown d6/dc/d14/d1f/d75/d7e/dc2 33966789 1 2023-10-08T08:45:58.003 INFO:tasks.workunit.client.0.smithi070.stdout:2/856: creat df/d12/d1b/d1c/d69/d100/d83/f115 x:0 0 0 2023-10-08T08:45:58.004 INFO:tasks.workunit.client.0.smithi070.stdout:1/747: getdents d6/dc 0 2023-10-08T08:45:58.005 INFO:tasks.workunit.client.0.smithi070.stdout:6/612: dwrite f7 [0,4194304] 0 2023-10-08T08:45:58.014 INFO:tasks.workunit.client.0.smithi070.stdout:1/748: mkdir d6/dc/d14/d70/df6 0 2023-10-08T08:45:58.015 INFO:tasks.workunit.client.0.smithi070.stdout:1/749: creat d6/dc/d97/ff7 x:0 0 0 2023-10-08T08:45:58.018 INFO:tasks.workunit.client.0.smithi070.stdout:2/857: dread df/d12/d1b/d1c/d69/d100/d83/f88 [0,4194304] 0 2023-10-08T08:45:58.020 INFO:tasks.workunit.client.0.smithi070.stdout:2/858: read df/d4c/d91/f99 [387200,112291] 0 2023-10-08T08:45:58.028 INFO:tasks.workunit.client.0.smithi070.stdout:6/613: dwrite df/f5c [0,4194304] 0 2023-10-08T08:45:58.031 INFO:tasks.workunit.client.0.smithi070.stdout:6/614: write df/d11/f7f [661866,81085] 0 2023-10-08T08:45:58.033 INFO:tasks.workunit.client.0.smithi070.stdout:6/615: mkdir df/d26/d42/d4b/db6/d7d/dc8 0 2023-10-08T08:45:58.035 INFO:tasks.workunit.client.0.smithi070.stdout:6/616: rename df/d26/d42/d43/d4a/d75/c82 to df/d26/d78/d90/dae/cc9 0 2023-10-08T08:45:58.041 INFO:tasks.workunit.client.0.smithi070.stdout:1/750: dwrite d6/dc/d14/d70/fa6 [0,4194304] 0 2023-10-08T08:45:58.042 INFO:tasks.workunit.client.0.smithi070.stdout:2/859: dwrite df/d12/d15/f17 [4194304,4194304] 0 2023-10-08T08:45:58.044 INFO:tasks.workunit.client.0.smithi070.stdout:1/751: link d6/c86 d6/dc/d14/d62/d95/deb/cf8 0 2023-10-08T08:45:58.044 INFO:tasks.workunit.client.0.smithi070.stdout:1/752: write d6/dc/d14/d1f/d63/db3/d38/d4b/fc6 [4631865,33681] 0 2023-10-08T08:45:58.044 INFO:tasks.workunit.client.0.smithi070.stdout:1/753: write d6/dc/d14/d1f/d63/db3/d38/d4b/fab [224482,34153] 0 2023-10-08T08:45:58.044 INFO:tasks.workunit.client.0.smithi070.stdout:2/860: mkdir df/d3a/d77/d116 0 2023-10-08T08:45:58.048 INFO:tasks.workunit.client.0.smithi070.stdout:1/754: creat d6/dc/d14/d62/d95/ff9 x:0 0 0 2023-10-08T08:45:58.050 INFO:tasks.workunit.client.0.smithi070.stdout:1/755: mknod d6/dc/d14/d1f/d63/db3/cfa 0 2023-10-08T08:45:58.051 INFO:tasks.workunit.client.0.smithi070.stdout:1/756: getdents d6/dc/d14/d1f/d75/d88 0 2023-10-08T08:45:58.052 INFO:tasks.workunit.client.0.smithi070.stdout:1/757: creat d6/dc/d14/d1f/d75/da1/ddb/ffb x:0 0 0 2023-10-08T08:45:58.053 INFO:tasks.workunit.client.0.smithi070.stdout:1/758: stat d6/dc/d14/d1f/d63/ccc 0 2023-10-08T08:45:58.053 INFO:tasks.workunit.client.0.smithi070.stdout:2/861: dread df/d12/d15/d54/fe3 [0,4194304] 0 2023-10-08T08:45:58.054 INFO:tasks.workunit.client.0.smithi070.stdout:6/617: dwrite df/d11/f65 [0,4194304] 0 2023-10-08T08:45:58.054 INFO:tasks.workunit.client.0.smithi070.stdout:1/759: mkdir d6/dc/d14/d1f/d75/d7e/dc2/dfc 0 2023-10-08T08:45:58.055 INFO:tasks.workunit.client.0.smithi070.stdout:2/862: mkdir df/d12/d1b/d1c/dcd/d117 0 2023-10-08T08:45:58.057 INFO:tasks.workunit.client.0.smithi070.stdout:6/618: truncate df/d11/f1a 2234814 0 2023-10-08T08:45:58.058 INFO:tasks.workunit.client.0.smithi070.stdout:6/619: read df/d26/f30 [91839,28120] 0 2023-10-08T08:45:58.058 INFO:tasks.workunit.client.0.smithi070.stdout:1/760: symlink d6/dc/lfd 0 2023-10-08T08:45:58.058 INFO:tasks.workunit.client.0.smithi070.stdout:1/761: fsync d6/dc/d14/d1f/d63/db3/d38/f74 0 2023-10-08T08:45:58.059 INFO:tasks.workunit.client.0.smithi070.stdout:2/863: creat df/d4c/d91/f118 x:0 0 0 2023-10-08T08:45:58.059 INFO:tasks.workunit.client.0.smithi070.stdout:6/620: read df/d26/d42/d43/f86 [2826590,77986] 0 2023-10-08T08:45:58.068 INFO:tasks.workunit.client.0.smithi070.stdout:1/762: dread d6/dc/d14/d1f/d63/db3/d38/f4a [4194304,4194304] 0 2023-10-08T08:45:58.068 INFO:tasks.workunit.client.0.smithi070.stdout:1/763: readlink d6/dc/d14/d90/lee 0 2023-10-08T08:45:58.068 INFO:tasks.workunit.client.0.smithi070.stdout:1/764: readlink d6/dc/d14/d1f/l7b 0 2023-10-08T08:45:58.068 INFO:tasks.workunit.client.0.smithi070.stdout:2/864: getdents df/d12/d1b 0 2023-10-08T08:45:58.068 INFO:tasks.workunit.client.0.smithi070.stdout:2/865: chown df/d12/d1b/d1c/d2d/cd1 469927 1 2023-10-08T08:45:58.069 INFO:tasks.workunit.client.0.smithi070.stdout:6/621: creat df/d26/d42/fca x:0 0 0 2023-10-08T08:45:58.070 INFO:tasks.workunit.client.0.smithi070.stdout:1/765: mkdir d6/dc/d14/d1f/d63/db3/d38/dfe 0 2023-10-08T08:45:58.072 INFO:tasks.workunit.client.0.smithi070.stdout:1/766: write d6/dc/d14/d1f/f25 [3804771,26444] 0 2023-10-08T08:45:58.074 INFO:tasks.workunit.client.0.smithi070.stdout:2/866: rename df/d3a/f52 to df/d12/d1b/d1c/dcd/d117/f119 0 2023-10-08T08:45:58.076 INFO:tasks.workunit.client.0.smithi070.stdout:6/622: getdents df/d26/d78/d90/dae 0 2023-10-08T08:45:58.077 INFO:tasks.workunit.client.0.smithi070.stdout:1/767: creat d6/dc/d14/d90/de4/fff x:0 0 0 2023-10-08T08:45:58.080 INFO:tasks.workunit.client.0.smithi070.stdout:3/797: sync 2023-10-08T08:45:58.080 INFO:tasks.workunit.client.0.smithi070.stdout:9/514: sync 2023-10-08T08:45:58.080 INFO:tasks.workunit.client.0.smithi070.stdout:8/768: sync 2023-10-08T08:45:58.080 INFO:tasks.workunit.client.0.smithi070.stdout:5/685: sync 2023-10-08T08:45:58.080 INFO:tasks.workunit.client.0.smithi070.stdout:9/515: chown d1/dd/d26/d27/d2d/f7e 2596 1 2023-10-08T08:45:58.080 INFO:tasks.workunit.client.0.smithi070.stdout:0/866: sync 2023-10-08T08:45:58.080 INFO:tasks.workunit.client.0.smithi070.stdout:7/742: sync 2023-10-08T08:45:58.081 INFO:tasks.workunit.client.0.smithi070.stdout:5/686: write d5/faf [1125011,85055] 0 2023-10-08T08:45:58.081 INFO:tasks.workunit.client.0.smithi070.stdout:8/769: read d1/d2/d6/d22/f33 [1203570,93705] 0 2023-10-08T08:45:58.082 INFO:tasks.workunit.client.0.smithi070.stdout:9/516: mknod d1/dd/d26/d5d/c94 0 2023-10-08T08:45:58.083 INFO:tasks.workunit.client.0.smithi070.stdout:4/658: sync 2023-10-08T08:45:58.084 INFO:tasks.workunit.client.0.smithi070.stdout:9/517: creat d1/dd/d39/d6f/d88/f95 x:0 0 0 2023-10-08T08:45:58.085 INFO:tasks.workunit.client.0.smithi070.stdout:2/867: mkdir df/d3a/db6/dde/d11a 0 2023-10-08T08:45:58.085 INFO:tasks.workunit.client.0.smithi070.stdout:2/868: dread - df/d12/d1b/d1c/d79/da4/ffb zero size 2023-10-08T08:45:58.085 INFO:tasks.workunit.client.0.smithi070.stdout:2/869: readlink df/d4c/d91/lc4 0 2023-10-08T08:45:58.086 INFO:tasks.workunit.client.0.smithi070.stdout:9/518: mkdir d1/dd/d19/d38/d77/d96 0 2023-10-08T08:45:58.086 INFO:tasks.workunit.client.0.smithi070.stdout:9/519: chown d1/dd/f61 361841 1 2023-10-08T08:45:58.088 INFO:tasks.workunit.client.0.smithi070.stdout:1/768: creat d6/dc/d14/dc1/dca/f100 x:0 0 0 2023-10-08T08:45:58.088 INFO:tasks.workunit.client.0.smithi070.stdout:6/623: rmdir df/d26/d42/d4b/db6 39 2023-10-08T08:45:58.088 INFO:tasks.workunit.client.0.smithi070.stdout:6/624: dread - df/d11/f7a zero size 2023-10-08T08:45:58.088 INFO:tasks.workunit.client.0.smithi070.stdout:7/743: mknod d3/da9/d4a/d9/cf9 0 2023-10-08T08:45:58.089 INFO:tasks.workunit.client.0.smithi070.stdout:4/659: unlink dc/d17/d24/d55/fb7 0 2023-10-08T08:45:58.090 INFO:tasks.workunit.client.0.smithi070.stdout:5/687: dread d5/da/d22/ddd/d2a/f58 [0,4194304] 0 2023-10-08T08:45:58.090 INFO:tasks.workunit.client.0.smithi070.stdout:5/688: chown d5/faf 1492099 1 2023-10-08T08:45:58.095 INFO:tasks.workunit.client.0.smithi070.stdout:6/625: link df/d26/d78/fb8 df/d26/d42/d4b/d80/fcb 0 2023-10-08T08:45:58.095 INFO:tasks.workunit.client.0.smithi070.stdout:7/744: unlink d3/d19/d1a/f4e 0 2023-10-08T08:45:58.095 INFO:tasks.workunit.client.0.smithi070.stdout:7/745: chown d3/l4 79 1 2023-10-08T08:45:58.095 INFO:tasks.workunit.client.0.smithi070.stdout:4/660: link dc/d17/d24/d55/ld4 dc/ld7 0 2023-10-08T08:45:58.096 INFO:tasks.workunit.client.0.smithi070.stdout:4/661: dread - dc/d17/d24/d4c/d4e/fbd zero size 2023-10-08T08:45:58.096 INFO:tasks.workunit.client.0.smithi070.stdout:6/626: creat df/d71/fcc x:0 0 0 2023-10-08T08:45:58.096 INFO:tasks.workunit.client.0.smithi070.stdout:3/798: rename d0/d12/d8d/fcf to d0/db/f11b 0 2023-10-08T08:45:58.096 INFO:tasks.workunit.client.0.smithi070.stdout:2/870: dread df/d12/d1b/d1c/f6a [0,4194304] 0 2023-10-08T08:45:58.096 INFO:tasks.workunit.client.0.smithi070.stdout:3/799: truncate d0/d12/d14/d5c/d5d/da0/dd8/fe5 1002910 0 2023-10-08T08:45:58.096 INFO:tasks.workunit.client.0.smithi070.stdout:6/627: creat df/d26/d42/d43/d4a/d97/fcd x:0 0 0 2023-10-08T08:45:58.096 INFO:tasks.workunit.client.0.smithi070.stdout:4/662: creat dc/d17/d1f/d5e/dd0/fd8 x:0 0 0 2023-10-08T08:45:58.096 INFO:tasks.workunit.client.0.smithi070.stdout:2/871: creat df/d12/d1b/d1c/dcd/f11b x:0 0 0 2023-10-08T08:45:58.097 INFO:tasks.workunit.client.0.smithi070.stdout:3/800: mkdir d0/db/d10/d38/d63/d11c 0 2023-10-08T08:45:58.097 INFO:tasks.workunit.client.0.smithi070.stdout:1/769: rename d6/dc/d14/d1f/d63/db3/d38/f74 to d6/dc/d14/d1f/d63/db3/d38/dfe/f101 0 2023-10-08T08:45:58.097 INFO:tasks.workunit.client.0.smithi070.stdout:2/872: readlink l4 0 2023-10-08T08:45:58.099 INFO:tasks.workunit.client.0.smithi070.stdout:2/873: rename df/d12/d1b/d1c/d2d/f58 to df/d12/d7e/d106/f11c 0 2023-10-08T08:45:58.105 INFO:tasks.workunit.client.0.smithi070.stdout:7/746: dread d3/da9/f9d [0,4194304] 0 2023-10-08T08:45:58.105 INFO:tasks.workunit.client.0.smithi070.stdout:2/874: creat df/d113/f11d x:0 0 0 2023-10-08T08:45:58.105 INFO:tasks.workunit.client.0.smithi070.stdout:2/875: readlink df/d12/d1b/d1c/d69/d100/la8 0 2023-10-08T08:45:58.106 INFO:tasks.workunit.client.0.smithi070.stdout:2/876: truncate df/d12/d1b/d1c/d69/d100/d83/d92/d102/f10f 647406 0 2023-10-08T08:45:58.106 INFO:tasks.workunit.client.0.smithi070.stdout:7/747: write d3/d79/fd4 [704516,80589] 0 2023-10-08T08:45:58.106 INFO:tasks.workunit.client.0.smithi070.stdout:3/801: dread d0/f68 [0,4194304] 0 2023-10-08T08:45:58.106 INFO:tasks.workunit.client.0.smithi070.stdout:3/802: write d0/d12/d14/d5c/d5d/da0/d86/fa7 [1423461,15875] 0 2023-10-08T08:45:58.106 INFO:tasks.workunit.client.0.smithi070.stdout:4/663: creat dc/d17/d24/d4c/fd9 x:0 0 0 2023-10-08T08:45:58.106 INFO:tasks.workunit.client.0.smithi070.stdout:7/748: creat d3/da9/d1e/d4c/ffa x:0 0 0 2023-10-08T08:45:58.106 INFO:tasks.workunit.client.0.smithi070.stdout:7/749: write d3/da9/d1e/d4c/ffa [686197,100284] 0 2023-10-08T08:45:58.107 INFO:tasks.workunit.client.0.smithi070.stdout:4/664: mkdir dc/d17/d24/d4c/d4e/dda 0 2023-10-08T08:45:58.107 INFO:tasks.workunit.client.0.smithi070.stdout:8/770: dwrite d1/d2/d6/d22/fcb [0,4194304] 0 2023-10-08T08:45:58.109 INFO:tasks.workunit.client.0.smithi070.stdout:3/803: symlink d0/d12/d14/d5c/d5d/da0/d101/l11d 0 2023-10-08T08:45:58.110 INFO:tasks.workunit.client.0.smithi070.stdout:3/804: truncate d0/d12/d14/d5c/d5d/da0/dd8/fe5 2001430 0 2023-10-08T08:45:58.111 INFO:tasks.workunit.client.0.smithi070.stdout:8/771: mkdir d1/d2/d6/d22/d5b/d74/de1/d1a/dfe 0 2023-10-08T08:45:58.112 INFO:tasks.workunit.client.0.smithi070.stdout:9/520: dwrite d1/dd/d26/d27/d2d/d70/f86 [0,4194304] 0 2023-10-08T08:45:58.113 INFO:tasks.workunit.client.0.smithi070.stdout:8/772: symlink d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d86/lff 0 2023-10-08T08:45:58.115 INFO:tasks.workunit.client.0.smithi070.stdout:6/628: dread df/d26/d42/d4b/f5b [0,4194304] 0 2023-10-08T08:45:58.115 INFO:tasks.workunit.client.0.smithi070.stdout:8/773: mknod d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/c100 0 2023-10-08T08:45:58.115 INFO:tasks.workunit.client.0.smithi070.stdout:8/774: chown d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d86/lbd 0 1 2023-10-08T08:45:58.118 INFO:tasks.workunit.client.0.smithi070.stdout:9/521: mkdir d1/dd/d19/d97 0 2023-10-08T08:45:58.118 INFO:tasks.workunit.client.0.smithi070.stdout:2/877: getdents df/d113 0 2023-10-08T08:45:58.122 INFO:tasks.workunit.client.0.smithi070.stdout:2/878: symlink df/d12/l11e 0 2023-10-08T08:45:58.122 INFO:tasks.workunit.client.0.smithi070.stdout:2/879: chown df/d12/d15/l81 4 1 2023-10-08T08:45:58.123 INFO:tasks.workunit.client.0.smithi070.stdout:5/689: dwrite d5/d5f/d61/d30/d54/d62/dae/fc5 [4194304,4194304] 0 2023-10-08T08:45:58.123 INFO:tasks.workunit.client.0.smithi070.stdout:5/690: readlink d5/d5f/d61/d30/l18 0 2023-10-08T08:45:58.124 INFO:tasks.workunit.client.0.smithi070.stdout:5/691: symlink d5/d5f/d61/d30/le3 0 2023-10-08T08:45:58.126 INFO:tasks.workunit.client.0.smithi070.stdout:5/692: mknod d5/d5f/d63/d8b/da8/ce4 0 2023-10-08T08:45:58.127 INFO:tasks.workunit.client.0.smithi070.stdout:5/693: readlink d5/d5f/d61/d30/l21 0 2023-10-08T08:45:58.128 INFO:tasks.workunit.client.0.smithi070.stdout:7/750: rename d3/da9/d4a/d50 to d3/d19/d95/da3/dc8/dfb 0 2023-10-08T08:45:58.130 INFO:tasks.workunit.client.0.smithi070.stdout:4/665: dread dc/f51 [0,4194304] 0 2023-10-08T08:45:58.130 INFO:tasks.workunit.client.0.smithi070.stdout:5/694: unlink d5/d5f/d63/d8b/d8f/fc1 0 2023-10-08T08:45:58.130 INFO:tasks.workunit.client.0.smithi070.stdout:5/695: write d5/da/d22/ddd/d38/fa2 [5176520,61723] 0 2023-10-08T08:45:58.130 INFO:tasks.workunit.client.0.smithi070.stdout:6/629: rename df/l3e to df/d26/d42/d4b/lce 0 2023-10-08T08:45:58.132 INFO:tasks.workunit.client.0.smithi070.stdout:7/751: symlink d3/d19/d6d/de7/lfc 0 2023-10-08T08:45:58.132 INFO:tasks.workunit.client.0.smithi070.stdout:7/752: chown d3/d19/d1a/lba 9 1 2023-10-08T08:45:58.132 INFO:tasks.workunit.client.0.smithi070.stdout:7/753: chown d3/d19/d1a/f70 1789 1 2023-10-08T08:45:58.132 INFO:tasks.workunit.client.0.smithi070.stdout:7/754: readlink d3/da9/d1e/l36 0 2023-10-08T08:45:58.132 INFO:tasks.workunit.client.0.smithi070.stdout:7/755: fdatasync d3/da9/d4a/d9/d97/fda 0 2023-10-08T08:45:58.133 INFO:tasks.workunit.client.0.smithi070.stdout:7/756: truncate d3/da9/f58 904129 0 2023-10-08T08:45:58.135 INFO:tasks.workunit.client.0.smithi070.stdout:8/775: dread d1/d4d/fa3 [0,4194304] 0 2023-10-08T08:45:58.135 INFO:tasks.workunit.client.0.smithi070.stdout:7/757: rename d3/da9/d1e/d4c/c7a to d3/d19/d1a/cfd 0 2023-10-08T08:45:58.136 INFO:tasks.workunit.client.0.smithi070.stdout:7/758: fsync d3/d19/d95/da3/dc8/dfb/d9f/dc5/fdf 0 2023-10-08T08:45:58.137 INFO:tasks.workunit.client.0.smithi070.stdout:8/776: link d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/f93 d1/d2/d6/d22/d5b/d74/de1/d21/f101 0 2023-10-08T08:45:58.137 INFO:tasks.workunit.client.0.smithi070.stdout:7/759: mkdir d3/d19/d95/dfe 0 2023-10-08T08:45:58.140 INFO:tasks.workunit.client.0.smithi070.stdout:7/760: creat d3/d19/d95/da3/dc8/dfb/d9f/dc5/fff x:0 0 0 2023-10-08T08:45:58.140 INFO:tasks.workunit.client.0.smithi070.stdout:7/761: chown d3/da9/d4a/d9/cf8 448293 1 2023-10-08T08:45:58.140 INFO:tasks.workunit.client.0.smithi070.stdout:7/762: symlink d3/d19/d95/da3/l100 0 2023-10-08T08:45:58.142 INFO:tasks.workunit.client.0.smithi070.stdout:7/763: creat d3/d19/d95/da3/dc8/dfb/d9f/dc5/f101 x:0 0 0 2023-10-08T08:45:58.142 INFO:tasks.workunit.client.0.smithi070.stdout:4/666: dread dc/d17/f27 [0,4194304] 0 2023-10-08T08:45:58.172 INFO:tasks.workunit.client.0.smithi070.stdout:1/770: dwrite d6/f5e [0,4194304] 0 2023-10-08T08:45:58.177 INFO:tasks.workunit.client.0.smithi070.stdout:3/805: dwrite d0/d12/f71 [0,4194304] 0 2023-10-08T08:45:58.185 INFO:tasks.workunit.client.0.smithi070.stdout:6/630: dwrite df/d26/d42/d4b/fa1 [0,4194304] 0 2023-10-08T08:45:58.185 INFO:tasks.workunit.client.0.smithi070.stdout:6/631: rename df/d26/d42 to df/d26/d42/d43/dcf 22 2023-10-08T08:45:58.187 INFO:tasks.workunit.client.0.smithi070.stdout:5/696: dwrite d5/d5f/d63/d8b/f9e [0,4194304] 0 2023-10-08T08:45:58.187 INFO:tasks.workunit.client.0.smithi070.stdout:5/697: chown d5/da/d22/ddd/f39 3300 1 2023-10-08T08:45:58.188 INFO:tasks.workunit.client.0.smithi070.stdout:6/632: mkdir df/d26/d42/d4b/d80/d94/dd0 0 2023-10-08T08:45:58.189 INFO:tasks.workunit.client.0.smithi070.stdout:6/633: chown df/d26/d42/d4b/db6/fa9 417292318 1 2023-10-08T08:45:58.201 INFO:tasks.workunit.client.0.smithi070.stdout:8/777: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/f87 [0,4194304] 0 2023-10-08T08:45:58.208 INFO:tasks.workunit.client.0.smithi070.stdout:7/764: dread d3/f2b [0,4194304] 0 2023-10-08T08:45:58.208 INFO:tasks.workunit.client.0.smithi070.stdout:1/771: dwrite d6/dc/fd6 [0,4194304] 0 2023-10-08T08:45:58.209 INFO:tasks.workunit.client.0.smithi070.stdout:1/772: truncate d6/f52 151939 0 2023-10-08T08:45:58.211 INFO:tasks.workunit.client.0.smithi070.stdout:1/773: symlink d6/dc/d14/d1f/d63/db3/d38/d4b/l102 0 2023-10-08T08:45:58.214 INFO:tasks.workunit.client.0.smithi070.stdout:8/778: write d1/d2/d6/d22/d5b/d74/de1/d2e/f6e [1181001,111529] 0 2023-10-08T08:45:58.222 INFO:tasks.workunit.client.0.smithi070.stdout:6/634: dread f5 [0,4194304] 0 2023-10-08T08:45:58.222 INFO:tasks.workunit.client.0.smithi070.stdout:8/779: mknod d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/dfa/c102 0 2023-10-08T08:45:58.225 INFO:tasks.workunit.client.0.smithi070.stdout:5/698: dwrite d5/f7c [4194304,4194304] 0 2023-10-08T08:45:58.225 INFO:tasks.workunit.client.0.smithi070.stdout:5/699: readlink d5/l7a 0 2023-10-08T08:45:58.225 INFO:tasks.workunit.client.0.smithi070.stdout:3/806: dwrite d0/d12/d14/d48/d113/f34 [0,4194304] 0 2023-10-08T08:45:58.231 INFO:tasks.workunit.client.0.smithi070.stdout:1/774: dread d6/f5e [0,4194304] 0 2023-10-08T08:45:58.231 INFO:tasks.workunit.client.0.smithi070.stdout:5/700: mkdir d5/d5f/d63/d8b/d8f/de5 0 2023-10-08T08:45:58.234 INFO:tasks.workunit.client.0.smithi070.stdout:7/765: dread d3/da9/d4a/d9/f48 [8388608,4194304] 0 2023-10-08T08:45:58.235 INFO:tasks.workunit.client.0.smithi070.stdout:3/807: rename d0/d12/c27 to d0/d12/d14/d48/d113/dba/c11e 0 2023-10-08T08:45:58.235 INFO:tasks.workunit.client.0.smithi070.stdout:3/808: write d0/d8a/f115 [18694,106605] 0 2023-10-08T08:45:58.237 INFO:tasks.workunit.client.0.smithi070.stdout:3/809: rename d0/d12/d14/d5c/d5d/da0/c10e to d0/d12/d14/d5c/db1/c11f 0 2023-10-08T08:45:58.237 INFO:tasks.workunit.client.0.smithi070.stdout:3/810: chown d0/d12/d14/d48/da4/lf7 1 1 2023-10-08T08:45:58.238 INFO:tasks.workunit.client.0.smithi070.stdout:5/701: unlink d5/d5f/d61/d30/ld2 0 2023-10-08T08:45:58.238 INFO:tasks.workunit.client.0.smithi070.stdout:5/702: rename d5 to d5/da/d22/d75/de6 22 2023-10-08T08:45:58.238 INFO:tasks.workunit.client.0.smithi070.stdout:5/703: fdatasync d5/da/f1f 0 2023-10-08T08:45:58.239 INFO:tasks.workunit.client.0.smithi070.stdout:5/704: rename d5/da/d22/d75/d82/fd6 to d5/da/d22/ddd/d38/dc3/fe7 0 2023-10-08T08:45:58.240 INFO:tasks.workunit.client.0.smithi070.stdout:5/705: mknod d5/d5f/d61/d30/d54/dab/ce8 0 2023-10-08T08:45:58.250 INFO:tasks.workunit.client.0.smithi070.stdout:8/780: dread d1/d2/d6/d22/d5b/fcf [0,4194304] 0 2023-10-08T08:45:58.252 INFO:tasks.workunit.client.0.smithi070.stdout:3/811: dread d0/d12/d14/f2a [8388608,4194304] 0 2023-10-08T08:45:58.259 INFO:tasks.workunit.client.0.smithi070.stdout:5/706: dwrite d5/f7c [4194304,4194304] 0 2023-10-08T08:45:58.275 INFO:tasks.workunit.client.0.smithi070.stdout:3/812: dwrite d0/d12/d14/f28 [0,4194304] 0 2023-10-08T08:45:58.278 INFO:tasks.workunit.client.0.smithi070.stdout:3/813: rmdir d0/d12/d8d/dcc 39 2023-10-08T08:45:58.278 INFO:tasks.workunit.client.0.smithi070.stdout:3/814: fsync d0/db/d10/d6d/fac 0 2023-10-08T08:45:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:5/707: dwrite d5/da/d4d/f79 [0,4194304] 0 2023-10-08T08:45:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:5/708: rename d5/d5f/d61/d30/d54/d62/cbb to d5/d5f/d63/d8b/da8/dac/ce9 0 2023-10-08T08:45:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:5/709: symlink d5/d5f/d61/d30/d54/dab/lea 0 2023-10-08T08:45:58.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/710: mkdir d5/da/d22/ddd/d38/d55/ddf/deb 0 2023-10-08T08:45:58.290 INFO:tasks.workunit.client.0.smithi070.stdout:5/711: symlink d5/d5f/lec 0 2023-10-08T08:45:58.292 INFO:tasks.workunit.client.0.smithi070.stdout:5/712: creat d5/da/d22/ddd/d38/d55/dbf/fed x:0 0 0 2023-10-08T08:45:58.298 INFO:tasks.workunit.client.0.smithi070.stdout:3/815: dwrite d0/d12/d14/ff1 [0,4194304] 0 2023-10-08T08:45:58.298 INFO:tasks.workunit.client.0.smithi070.stdout:3/816: chown d0/d12/d14/d5c/d5d/da0/d86/fe7 0 1 2023-10-08T08:45:58.298 INFO:tasks.workunit.client.0.smithi070.stdout:3/817: read - d0/d12/d14/d48/d113/fa8 zero size 2023-10-08T08:45:58.299 INFO:tasks.workunit.client.0.smithi070.stdout:3/818: truncate d0/d12/d14/d5c/db1/f10a 661119 0 2023-10-08T08:45:58.299 INFO:tasks.workunit.client.0.smithi070.stdout:3/819: dread - d0/d12/d14/d48/d113/dba/ffb zero size 2023-10-08T08:45:58.301 INFO:tasks.workunit.client.0.smithi070.stdout:3/820: unlink d0/d12/d14/d5c/d5d/da0/d86/fb3 0 2023-10-08T08:45:58.302 INFO:tasks.workunit.client.0.smithi070.stdout:3/821: unlink d0/db/d10/d38/d2f/c116 0 2023-10-08T08:45:58.321 INFO:tasks.workunit.client.0.smithi070.stdout:5/713: read d5/da/d22/ddd/d38/dc3/fe7 [4070743,81024] 0 2023-10-08T08:45:58.321 INFO:tasks.workunit.client.0.smithi070.stdout:5/714: write d5/da/d4d/f64 [5209591,12092] 0 2023-10-08T08:45:58.322 INFO:tasks.workunit.client.0.smithi070.stdout:5/715: unlink d5/d5f/d61/d30/d54/d62/ld7 0 2023-10-08T08:45:58.324 INFO:tasks.workunit.client.0.smithi070.stdout:5/716: symlink d5/da/d22/ddd/d38/d55/ddf/lee 0 2023-10-08T08:45:58.325 INFO:tasks.workunit.client.0.smithi070.stdout:5/717: creat d5/d5f/d63/d8b/d8f/de5/fef x:0 0 0 2023-10-08T08:45:58.327 INFO:tasks.workunit.client.0.smithi070.stdout:5/718: creat d5/d5f/d61/d30/d54/dab/ff0 x:0 0 0 2023-10-08T08:45:58.328 INFO:tasks.workunit.client.0.smithi070.stdout:5/719: creat d5/d5f/ff1 x:0 0 0 2023-10-08T08:45:58.332 INFO:tasks.workunit.client.0.smithi070.stdout:5/720: dread d5/da/f16 [0,4194304] 0 2023-10-08T08:45:58.332 INFO:tasks.workunit.client.0.smithi070.stdout:5/721: readlink d5/d5f/d63/d8b/d8f/ld9 0 2023-10-08T08:45:58.334 INFO:tasks.workunit.client.0.smithi070.stdout:5/722: creat d5/da/d22/ff2 x:0 0 0 2023-10-08T08:45:58.334 INFO:tasks.workunit.client.0.smithi070.stdout:7/766: dwrite d3/da9/d1e/d76/f87 [0,4194304] 0 2023-10-08T08:45:58.334 INFO:tasks.workunit.client.0.smithi070.stdout:7/767: readlink d3/d19/d95/da3/dc8/lcc 0 2023-10-08T08:45:58.334 INFO:tasks.workunit.client.0.smithi070.stdout:7/768: readlink d3/da9/d4a/l33 0 2023-10-08T08:45:58.336 INFO:tasks.workunit.client.0.smithi070.stdout:5/723: mkdir d5/d5f/d63/dca/df3 0 2023-10-08T08:45:58.341 INFO:tasks.workunit.client.0.smithi070.stdout:1/775: write d6/dc/d14/d1f/d75/d7e/f87 [2966011,68975] 0 2023-10-08T08:45:58.341 INFO:tasks.workunit.client.0.smithi070.stdout:1/776: truncate d6/dc/d14/d70/fba 165628 0 2023-10-08T08:45:58.342 INFO:tasks.workunit.client.0.smithi070.stdout:1/777: creat d6/dc/f103 x:0 0 0 2023-10-08T08:45:58.343 INFO:tasks.workunit.client.0.smithi070.stdout:1/778: mknod d6/dc/c104 0 2023-10-08T08:45:58.346 INFO:tasks.workunit.client.0.smithi070.stdout:1/779: rmdir d6/dc/d14/d62 39 2023-10-08T08:45:58.347 INFO:tasks.workunit.client.0.smithi070.stdout:1/780: creat d6/dc/d14/d1f/d75/d7e/dc2/dfc/f105 x:0 0 0 2023-10-08T08:45:58.349 INFO:tasks.workunit.client.0.smithi070.stdout:1/781: creat d6/dc/d14/d1f/d75/d7e/dc2/dfc/f106 x:0 0 0 2023-10-08T08:45:58.349 INFO:tasks.workunit.client.0.smithi070.stdout:5/724: dread d5/f9 [0,4194304] 0 2023-10-08T08:45:58.350 INFO:tasks.workunit.client.0.smithi070.stdout:1/782: creat d6/dc/d97/f107 x:0 0 0 2023-10-08T08:45:58.351 INFO:tasks.workunit.client.0.smithi070.stdout:1/783: creat d6/dc/d14/d1f/d75/da1/ddb/f108 x:0 0 0 2023-10-08T08:45:58.351 INFO:tasks.workunit.client.0.smithi070.stdout:1/784: truncate d6/f18 4060004 0 2023-10-08T08:45:58.352 INFO:tasks.workunit.client.0.smithi070.stdout:1/785: getdents d6/dc/d14/d1f/d75 0 2023-10-08T08:45:58.353 INFO:tasks.workunit.client.0.smithi070.stdout:1/786: creat d6/dc/d14/d1f/d75/d7e/dc2/dfc/f109 x:0 0 0 2023-10-08T08:45:58.355 INFO:tasks.workunit.client.0.smithi070.stdout:1/787: read d6/dc/d14/d1f/d63/db3/fe5 [56241,93565] 0 2023-10-08T08:45:58.357 INFO:tasks.workunit.client.0.smithi070.stdout:1/788: dread d6/dc/d14/d1f/d63/db3/fe5 [0,4194304] 0 2023-10-08T08:45:58.359 INFO:tasks.workunit.client.0.smithi070.stdout:1/789: rename d6/dc/d14/d1f/c3f to d6/dc/d14/d1f/d75/c10a 0 2023-10-08T08:45:58.369 INFO:tasks.workunit.client.0.smithi070.stdout:3/822: dwrite d0/d12/d14/d48/d113/f90 [0,4194304] 0 2023-10-08T08:45:58.369 INFO:tasks.workunit.client.0.smithi070.stdout:3/823: dread - d0/db/d10/d6d/f9b zero size 2023-10-08T08:45:58.371 INFO:tasks.workunit.client.0.smithi070.stdout:5/725: read d5/da/fbd [356471,32679] 0 2023-10-08T08:45:58.385 INFO:tasks.workunit.client.0.smithi070.stdout:3/824: dread d0/d12/d14/d5c/dc4/f104 [0,4194304] 0 2023-10-08T08:45:58.385 INFO:tasks.workunit.client.0.smithi070.stdout:3/825: write d0/d12/d14/d48/d113/dba/ffb [980297,2019] 0 2023-10-08T08:45:58.443 INFO:tasks.workunit.client.0.smithi070.stdout:1/790: dwrite d6/dc/d14/d1f/f25 [12582912,4194304] 0 2023-10-08T08:45:58.445 INFO:tasks.workunit.client.0.smithi070.stdout:1/791: dread d6/dc/d14/d1f/f9c [0,4194304] 0 2023-10-08T08:45:58.447 INFO:tasks.workunit.client.0.smithi070.stdout:1/792: mkdir d6/dc/d14/d62/d95/deb/d10b 0 2023-10-08T08:45:58.456 INFO:tasks.workunit.client.0.smithi070.stdout:3/826: dread d0/db/fd [4194304,4194304] 0 2023-10-08T08:45:58.456 INFO:tasks.workunit.client.0.smithi070.stdout:3/827: chown d0/d12/d14/ff5 117 1 2023-10-08T08:45:58.456 INFO:tasks.workunit.client.0.smithi070.stdout:3/828: chown d0/d12/d14/d48/d113/dba/fde 1606895453 1 2023-10-08T08:45:58.457 INFO:tasks.workunit.client.0.smithi070.stdout:3/829: creat d0/d12/d14/d5c/d5d/da0/d101/f120 x:0 0 0 2023-10-08T08:45:58.457 INFO:tasks.workunit.client.0.smithi070.stdout:3/830: truncate d0/d12/d14/ff5 500809 0 2023-10-08T08:45:58.459 INFO:tasks.workunit.client.0.smithi070.stdout:3/831: rename d0/d12/d14/ff1 to d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/de1/dd2/f121 0 2023-10-08T08:45:58.459 INFO:tasks.workunit.client.0.smithi070.stdout:3/832: write d0/d12/d14/d48/d113/fc0 [1647028,85093] 0 2023-10-08T08:45:58.459 INFO:tasks.workunit.client.0.smithi070.stdout:1/793: dread d6/dc/d14/d1f/d63/f6a [0,4194304] 0 2023-10-08T08:45:58.461 INFO:tasks.workunit.client.0.smithi070.stdout:1/794: dread d6/dc/d14/d1f/f9c [0,4194304] 0 2023-10-08T08:45:58.463 INFO:tasks.workunit.client.0.smithi070.stdout:1/795: creat d6/dc/d14/d1f/d63/f10c x:0 0 0 2023-10-08T08:45:58.464 INFO:tasks.workunit.client.0.smithi070.stdout:1/796: symlink d6/dc/d14/d1f/l10d 0 2023-10-08T08:45:58.465 INFO:tasks.workunit.client.0.smithi070.stdout:1/797: truncate d6/dc/d14/d1f/d75/f2f 2202890 0 2023-10-08T08:45:58.468 INFO:tasks.workunit.client.0.smithi070.stdout:1/798: rename d6/dc/d14/d1f/d75/l34 to d6/dc/d14/d1f/d63/db3/l10e 0 2023-10-08T08:45:58.468 INFO:tasks.workunit.client.0.smithi070.stdout:1/799: chown d6/dc/d14/cad 1030045921 1 2023-10-08T08:45:58.470 INFO:tasks.workunit.client.0.smithi070.stdout:1/800: getdents d6/dc 0 2023-10-08T08:45:58.471 INFO:tasks.workunit.client.0.smithi070.stdout:1/801: creat d6/dc/d14/d62/d95/f10f x:0 0 0 2023-10-08T08:45:58.471 INFO:tasks.workunit.client.0.smithi070.stdout:1/802: fdatasync d6/dc/d14/d1f/d75/da1/fc0 0 2023-10-08T08:45:58.472 INFO:tasks.workunit.client.0.smithi070.stdout:1/803: stat d6/dc/d97/fec 0 2023-10-08T08:45:58.481 INFO:tasks.workunit.client.0.smithi070.stdout:3/833: dwrite d0/d12/d14/d48/d113/dba/fde [0,4194304] 0 2023-10-08T08:45:58.482 INFO:tasks.workunit.client.0.smithi070.stdout:3/834: rmdir d0/d12/d14/d5c/d5d/da0/d6a/d80/de2 39 2023-10-08T08:45:58.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/835: chown d0/d8a 288 1 2023-10-08T08:45:58.485 INFO:tasks.workunit.client.0.smithi070.stdout:3/836: rename d0/d12/d14/d5c/d5d/da0/d6a to d0/d12/d14/d5c/d5d/da0/d101/d52/db5/db6/d122 0 2023-10-08T08:45:58.487 INFO:tasks.workunit.client.0.smithi070.stdout:1/804: dread d6/f12 [0,4194304] 0 2023-10-08T08:45:58.498 INFO:tasks.workunit.client.0.smithi070.stdout:3/837: dread d0/d12/f7c [0,4194304] 0 2023-10-08T08:45:58.498 INFO:tasks.workunit.client.0.smithi070.stdout:3/838: write d0/d12/d14/d5c/d5d/da0/d101/f120 [412312,64990] 0 2023-10-08T08:45:58.500 INFO:tasks.workunit.client.0.smithi070.stdout:3/839: rename d0/db/fa2 to d0/d12/d14/d5c/db1/dbe/d100/f123 0 2023-10-08T08:45:58.502 INFO:tasks.workunit.client.0.smithi070.stdout:3/840: link d0/db/d10/d6d/c103 d0/d12/d14/d5c/dc4/c124 0 2023-10-08T08:45:58.503 INFO:tasks.workunit.client.0.smithi070.stdout:3/841: write d0/db/d10/d6d/f9b [184778,61373] 0 2023-10-08T08:45:58.503 INFO:tasks.workunit.client.0.smithi070.stdout:3/842: fsync d0/db/d10/d38/ff9 0 2023-10-08T08:45:58.504 INFO:tasks.workunit.client.0.smithi070.stdout:3/843: truncate d0/d12/d14/fbb 3331035 0 2023-10-08T08:45:58.508 INFO:tasks.workunit.client.0.smithi070.stdout:1/805: dwrite d6/ff2 [0,4194304] 0 2023-10-08T08:45:58.510 INFO:tasks.workunit.client.0.smithi070.stdout:3/844: write d0/d12/d14/d48/d113/fc9 [957235,101194] 0 2023-10-08T08:45:58.511 INFO:tasks.workunit.client.0.smithi070.stdout:1/806: dread d6/dc/d14/d1f/d75/da1/fc0 [0,4194304] 0 2023-10-08T08:45:58.512 INFO:tasks.workunit.client.0.smithi070.stdout:3/845: symlink d0/d12/d14/d5c/d5d/da0/d101/d52/db5/db6/d122/l125 0 2023-10-08T08:45:58.513 INFO:tasks.workunit.client.0.smithi070.stdout:1/807: creat d6/dc/d14/d1f/d63/daa/f110 x:0 0 0 2023-10-08T08:45:58.516 INFO:tasks.workunit.client.0.smithi070.stdout:1/808: rename d6/dc/d14/dc1/lc9 to d6/dc/d14/l111 0 2023-10-08T08:45:58.517 INFO:tasks.workunit.client.0.smithi070.stdout:1/809: creat d6/dc/d14/d1f/d75/da1/ddb/f112 x:0 0 0 2023-10-08T08:45:58.519 INFO:tasks.workunit.client.0.smithi070.stdout:1/810: unlink d6/dc/d14/d1f/d75/d7e/dc2/cce 0 2023-10-08T08:45:58.522 INFO:tasks.workunit.client.0.smithi070.stdout:3/846: write d0/d12/f97 [714909,114067] 0 2023-10-08T08:45:58.522 INFO:tasks.workunit.client.0.smithi070.stdout:3/847: chown d0/d12/d14/d48/da4 570136498 1 2023-10-08T08:45:58.523 INFO:tasks.workunit.client.0.smithi070.stdout:3/848: truncate d0/d12/d14/d5c/d5d/da0/d101/d52/db5/db6/d122/fa1 1733132 0 2023-10-08T08:45:58.526 INFO:tasks.workunit.client.0.smithi070.stdout:3/849: dread d0/d12/d14/fa5 [0,4194304] 0 2023-10-08T08:45:58.532 INFO:tasks.workunit.client.0.smithi070.stdout:3/850: write d0/d12/d14/d48/d113/f5e [887059,100739] 0 2023-10-08T08:45:58.532 INFO:tasks.workunit.client.0.smithi070.stdout:3/851: chown d0/d12/d14/d48/f83 54469029 1 2023-10-08T08:45:58.533 INFO:tasks.workunit.client.0.smithi070.stdout:3/852: truncate d0/db/d10/d6d/f9b 889936 0 2023-10-08T08:45:58.536 INFO:tasks.workunit.client.0.smithi070.stdout:1/811: dwrite d6/dc/d14/d90/ff1 [0,4194304] 0 2023-10-08T08:45:58.539 INFO:tasks.workunit.client.0.smithi070.stdout:1/812: getdents d6/dc/d14/d1f/d75 0 2023-10-08T08:45:58.545 INFO:tasks.workunit.client.0.smithi070.stdout:3/853: dread d0/d12/d14/d48/d113/f90 [0,4194304] 0 2023-10-08T08:45:58.546 INFO:tasks.workunit.client.0.smithi070.stdout:3/854: symlink d0/d12/d14/d5c/d5d/da0/dd8/l126 0 2023-10-08T08:45:58.546 INFO:tasks.workunit.client.0.smithi070.stdout:3/855: stat d0/d12/d14/d5c/d5d/da0/dd8/cda 0 2023-10-08T08:45:58.547 INFO:tasks.workunit.client.0.smithi070.stdout:3/856: getdents d0/db 0 2023-10-08T08:45:58.548 INFO:tasks.workunit.client.0.smithi070.stdout:3/857: write d0/d12/d14/d5c/d5d/da0/d101/f41 [756386,117504] 0 2023-10-08T08:45:58.548 INFO:tasks.workunit.client.0.smithi070.stdout:3/858: readlink d0/d12/d14/d5c/d5d/lce 0 2023-10-08T08:45:58.548 INFO:tasks.workunit.client.0.smithi070.stdout:3/859: fsync d0/d12/d8d/dcc/fdc 0 2023-10-08T08:45:58.560 INFO:tasks.workunit.client.0.smithi070.stdout:1/813: dwrite d6/dc/d14/d1f/d75/f8c [0,4194304] 0 2023-10-08T08:45:58.561 INFO:tasks.workunit.client.0.smithi070.stdout:3/860: dread d0/db/d10/d38/d63/fc7 [0,4194304] 0 2023-10-08T08:45:58.563 INFO:tasks.workunit.client.0.smithi070.stdout:1/814: mkdir d6/dc/d97/d113 0 2023-10-08T08:45:58.563 INFO:tasks.workunit.client.0.smithi070.stdout:3/861: symlink d0/d12/d14/d5c/d5d/da0/d101/d52/db5/l127 0 2023-10-08T08:45:58.564 INFO:tasks.workunit.client.0.smithi070.stdout:1/815: link d6/dc/d14/d1f/d63/cdc d6/dc/d97/d113/c114 0 2023-10-08T08:45:58.566 INFO:tasks.workunit.client.0.smithi070.stdout:1/816: getdents d6/dc/d14 0 2023-10-08T08:45:58.566 INFO:tasks.workunit.client.0.smithi070.stdout:1/817: chown d6/dc/d14/d1f/d75/d7e/lb9 987045 1 2023-10-08T08:45:58.567 INFO:tasks.workunit.client.0.smithi070.stdout:1/818: creat d6/dc/d14/d1f/d75/f115 x:0 0 0 2023-10-08T08:45:58.567 INFO:tasks.workunit.client.0.smithi070.stdout:1/819: fsync d6/dc/d14/d1f/d63/db3/fc3 0 2023-10-08T08:45:58.569 INFO:tasks.workunit.client.0.smithi070.stdout:1/820: write d6/dc/d97/fbc [1947351,32440] 0 2023-10-08T08:45:58.587 INFO:tasks.workunit.client.0.smithi070.stdout:1/821: dread d6/dc/d97/fcf [0,4194304] 0 2023-10-08T08:45:58.587 INFO:tasks.workunit.client.0.smithi070.stdout:1/822: stat d6/dc/d14/d1f/d63/db3/d38/dfe/f101 0 2023-10-08T08:45:58.587 INFO:tasks.workunit.client.0.smithi070.stdout:1/823: fsync d6/dc/d14/d1f/d75/d7e/dc2/dfc/f109 0 2023-10-08T08:45:58.587 INFO:tasks.workunit.client.0.smithi070.stdout:1/824: write d6/dc/d97/ff7 [88302,110890] 0 2023-10-08T08:45:58.588 INFO:tasks.workunit.client.0.smithi070.stdout:1/825: stat d6/dc/d14/d1f/f32 0 2023-10-08T08:45:58.588 INFO:tasks.workunit.client.0.smithi070.stdout:3/862: dwrite d0/d12/d14/d5c/d5d/da0/d86/f89 [0,4194304] 0 2023-10-08T08:45:58.588 INFO:tasks.workunit.client.0.smithi070.stdout:3/863: dread - d0/db/fa6 zero size 2023-10-08T08:45:58.588 INFO:tasks.workunit.client.0.smithi070.stdout:1/826: read d6/ff2 [1783430,116252] 0 2023-10-08T08:45:58.588 INFO:tasks.workunit.client.0.smithi070.stdout:1/827: truncate d6/f1b 4520510 0 2023-10-08T08:45:58.588 INFO:tasks.workunit.client.0.smithi070.stdout:1/828: fdatasync d6/dc/d14/d1f/f3d 0 2023-10-08T08:45:58.589 INFO:tasks.workunit.client.0.smithi070.stdout:1/829: mknod d6/dc/d14/d1f/d75/d7e/c116 0 2023-10-08T08:45:58.589 INFO:tasks.workunit.client.0.smithi070.stdout:1/830: chown d6/dc/d14/d90/cbd 176518 1 2023-10-08T08:45:58.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:45:58 smithi191 ceph-mon[104220]: pgmap v356: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 38 MiB/s wr, 90 op/s 2023-10-08T08:45:58.597 INFO:tasks.workunit.client.0.smithi070.stdout:1/831: rename d6/dc/d14/d1f/d75 to d6/dc/d14/dc1/dca/d117 0 2023-10-08T08:45:58.597 INFO:tasks.workunit.client.0.smithi070.stdout:1/832: fdatasync d6/dc/d14/dc1/dca/d117/d7e/f87 0 2023-10-08T08:45:58.598 INFO:tasks.workunit.client.0.smithi070.stdout:1/833: dread - d6/fd2 zero size 2023-10-08T08:45:58.598 INFO:tasks.workunit.client.0.smithi070.stdout:1/834: chown d6/dc/d14/d1f/d63/db3/d38/dfe 8612 1 2023-10-08T08:45:58.602 INFO:tasks.workunit.client.0.smithi070.stdout:1/835: rename d6/dc/d14/d62/d95 to d6/dc/d14/d1f/d118 0 2023-10-08T08:45:58.604 INFO:tasks.workunit.client.0.smithi070.stdout:1/836: write d6/dc/d14/fa0 [3011380,89352] 0 2023-10-08T08:45:58.606 INFO:tasks.workunit.client.0.smithi070.stdout:3/864: dwrite d0/db/d10/d38/d2f/f66 [4194304,4194304] 0 2023-10-08T08:45:58.631 INFO:tasks.workunit.client.0.smithi070.stdout:1/837: dwrite d6/dc/d14/d1f/d118/f10f [0,4194304] 0 2023-10-08T08:45:58.633 INFO:tasks.workunit.client.0.smithi070.stdout:1/838: write d6/dc/d14/d62/f6e [4061288,69699] 0 2023-10-08T08:45:58.648 INFO:tasks.workunit.client.0.smithi070.stdout:1/839: dread d6/dc/d14/d1f/f3d [0,4194304] 0 2023-10-08T08:45:58.648 INFO:tasks.workunit.client.0.smithi070.stdout:1/840: chown d6/dc/cd1 22613 1 2023-10-08T08:45:58.649 INFO:tasks.workunit.client.0.smithi070.stdout:1/841: creat d6/dc/d14/dc1/dca/d117/da1/ddb/f119 x:0 0 0 2023-10-08T08:45:58.649 INFO:tasks.workunit.client.0.smithi070.stdout:1/842: chown d6/dc/d14/d1f/d63/db3/f60 1157 1 2023-10-08T08:45:58.667 INFO:tasks.workunit.client.0.smithi070.stdout:1/843: dwrite d6/dc/d14/d1f/d118/ff9 [0,4194304] 0 2023-10-08T08:45:58.670 INFO:tasks.workunit.client.0.smithi070.stdout:1/844: rmdir d6/dc/d14/d1f 39 2023-10-08T08:45:58.670 INFO:tasks.workunit.client.0.smithi070.stdout:1/845: chown d6/dc/d14/d1f/f3d 49590 1 2023-10-08T08:45:58.682 INFO:tasks.workunit.client.0.smithi070.stdout:1/846: dread d6/dc/d14/d70/fa6 [0,4194304] 0 2023-10-08T08:45:58.683 INFO:tasks.workunit.client.0.smithi070.stdout:1/847: link d6/dc/d14/l64 d6/dc/d14/d1f/d118/l11a 0 2023-10-08T08:45:58.683 INFO:tasks.workunit.client.0.smithi070.stdout:1/848: fsync d6/f52 0 2023-10-08T08:45:58.684 INFO:tasks.workunit.client.0.smithi070.stdout:1/849: mkdir d6/dc/d97/d11b 0 2023-10-08T08:45:58.686 INFO:tasks.workunit.client.0.smithi070.stdout:1/850: rename d6/dc/f103 to d6/dc/d14/dc1/f11c 0 2023-10-08T08:45:58.686 INFO:tasks.workunit.client.0.smithi070.stdout:1/851: truncate d6/dc/d14/d1f/fa5 382610 0 2023-10-08T08:45:58.687 INFO:tasks.workunit.client.0.smithi070.stdout:1/852: dread - d6/dc/d14/d1f/d63/f10c zero size 2023-10-08T08:45:58.687 INFO:tasks.workunit.client.0.smithi070.stdout:1/853: dread - d6/dc/d14/dc1/dca/d117/da1/ddb/ffb zero size 2023-10-08T08:45:58.710 INFO:tasks.workunit.client.0.smithi070.stdout:1/854: dwrite d6/fd2 [0,4194304] 0 2023-10-08T08:45:58.720 INFO:tasks.workunit.client.0.smithi070.stdout:1/855: rmdir d6/dc/d14/d90/ded 39 2023-10-08T08:45:58.720 INFO:tasks.workunit.client.0.smithi070.stdout:1/856: dread - d6/dc/d14/dc1/dca/d117/d7e/fa4 zero size 2023-10-08T08:45:58.720 INFO:tasks.workunit.client.0.smithi070.stdout:1/857: chown d6/dc/d14/dc1/dca 811546 1 2023-10-08T08:45:58.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:45:58 smithi070 ceph-mon[99513]: pgmap v356: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 38 MiB/s wr, 90 op/s 2023-10-08T08:45:58.724 INFO:tasks.workunit.client.0.smithi070.stdout:1/858: rename d6/dc/d14/d1f/d63/db3/d38/dfe to d6/dc/d14/d70/df6/d11d 0 2023-10-08T08:45:58.724 INFO:tasks.workunit.client.0.smithi070.stdout:1/859: chown d6/dc/cb8 2 1 2023-10-08T08:45:58.735 INFO:tasks.workunit.client.0.smithi070.stdout:1/860: dread d6/dc/d14/d1f/d63/f6a [0,4194304] 0 2023-10-08T08:45:58.755 INFO:tasks.workunit.client.0.smithi070.stdout:1/861: dwrite d6/dc/d14/d1f/d118/f10f [4194304,4194304] 0 2023-10-08T08:45:58.755 INFO:tasks.workunit.client.0.smithi070.stdout:1/862: fdatasync d6/dc/d14/d90/f9b 0 2023-10-08T08:45:58.757 INFO:tasks.workunit.client.0.smithi070.stdout:1/863: creat d6/dc/d14/dc1/dca/d117/d7e/f11e x:0 0 0 2023-10-08T08:45:58.760 INFO:tasks.workunit.client.0.smithi070.stdout:1/864: mkdir d6/dc/d14/d1f/d11f 0 2023-10-08T08:45:58.760 INFO:tasks.workunit.client.0.smithi070.stdout:1/865: mkdir d6/dc/d97/d113/d120 0 2023-10-08T08:45:58.760 INFO:tasks.workunit.client.0.smithi070.stdout:1/866: dread - d6/dc/d14/d1f/d63/f10c zero size 2023-10-08T08:45:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:45:58 smithi105 ceph-mon[103798]: pgmap v356: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 38 MiB/s wr, 90 op/s 2023-10-08T08:45:58.777 INFO:tasks.workunit.client.0.smithi070.stdout:1/867: dwrite d6/dc/d14/d1f/d118/ff9 [0,4194304] 0 2023-10-08T08:45:58.777 INFO:tasks.workunit.client.0.smithi070.stdout:1/868: write d6/dc/d14/d1f/d63/db3/f4d [441936,65236] 0 2023-10-08T08:45:58.777 INFO:tasks.workunit.client.0.smithi070.stdout:1/869: readlink d6/dc/d14/d1f/l10d 0 2023-10-08T08:45:58.793 INFO:tasks.workunit.client.0.smithi070.stdout:1/870: dwrite d6/dc/d14/dc1/dca/d117/d7e/dc2/dfc/f106 [0,4194304] 0 2023-10-08T08:45:58.795 INFO:tasks.workunit.client.0.smithi070.stdout:1/871: mkdir d6/dc/d14/d1f/d63/daa/d121 0 2023-10-08T08:45:58.800 INFO:tasks.workunit.client.0.smithi070.stdout:1/872: rmdir d6/dc/d14/dc1/dca 39 2023-10-08T08:45:58.801 INFO:tasks.workunit.client.0.smithi070.stdout:1/873: mknod d6/dc/d14/d62/c122 0 2023-10-08T08:45:58.801 INFO:tasks.workunit.client.0.smithi070.stdout:1/874: stat d6/dc/d14/d1f/d63/db3/d38/d4b/fab 0 2023-10-08T08:45:58.804 INFO:tasks.workunit.client.0.smithi070.stdout:1/875: getdents d6/dc/d14/d62 0 2023-10-08T08:45:58.804 INFO:tasks.workunit.client.0.smithi070.stdout:1/876: readlink d6/dc/d14/d70/l79 0 2023-10-08T08:45:58.806 INFO:tasks.workunit.client.0.smithi070.stdout:1/877: write d6/dc/f59 [2705320,54578] 0 2023-10-08T08:45:58.807 INFO:tasks.workunit.client.0.smithi070.stdout:1/878: mkdir d6/dc/d14/d1f/d63/db3/d123 0 2023-10-08T08:45:58.808 INFO:tasks.workunit.client.0.smithi070.stdout:1/879: mknod d6/dc/d14/d62/c124 0 2023-10-08T08:45:58.819 INFO:tasks.workunit.client.0.smithi070.stdout:1/880: dread d6/dc/d14/d1f/d63/db3/f57 [0,4194304] 0 2023-10-08T08:45:58.823 INFO:tasks.workunit.client.0.smithi070.stdout:1/881: dread d6/f3b [0,4194304] 0 2023-10-08T08:45:58.823 INFO:tasks.workunit.client.0.smithi070.stdout:1/882: getdents d6/dc/d14/d70 0 2023-10-08T08:45:58.824 INFO:tasks.workunit.client.0.smithi070.stdout:1/883: symlink d6/dc/d14/dc1/dca/d117/da1/ddb/l125 0 2023-10-08T08:45:58.825 INFO:tasks.workunit.client.0.smithi070.stdout:1/884: fdatasync d6/dc/d14/d1f/d63/db3/f51 0 2023-10-08T08:45:58.826 INFO:tasks.workunit.client.0.smithi070.stdout:1/885: rename d6/dc/d14/d1f/d118/deb to d6/dc/d14/d1f/d11f/d126 0 2023-10-08T08:45:58.827 INFO:tasks.workunit.client.0.smithi070.stdout:1/886: write d6/dc/d14/d62/f77 [90476,10809] 0 2023-10-08T08:45:58.827 INFO:tasks.workunit.client.0.smithi070.stdout:1/887: readlink d6/dc/lfd 0 2023-10-08T08:46:00.332 INFO:tasks.workunit.client.0.smithi070.stdout:7/769: sync 2023-10-08T08:46:00.332 INFO:tasks.workunit.client.0.smithi070.stdout:9/522: sync 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:0/867: sync 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:6/635: sync 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:1/888: sync 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:4/667: sync 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:8/781: sync 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:1/889: fdatasync d6/dc/d14/dc1/dca/d117/da1/fc0 0 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:1/890: chown d6/dc/d97/d11b 222242124 1 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:2/880: sync 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:5/726: sync 2023-10-08T08:46:00.333 INFO:tasks.workunit.client.0.smithi070.stdout:3/865: sync 2023-10-08T08:46:00.335 INFO:tasks.workunit.client.0.smithi070.stdout:2/881: write df/d4c/f68 [5014910,101382] 0 2023-10-08T08:46:00.354 INFO:tasks.workunit.client.0.smithi070.stdout:3/866: dwrite d0/d12/d8d/dcc/fdc [0,4194304] 0 2023-10-08T08:46:00.360 INFO:tasks.workunit.client.0.smithi070.stdout:6/636: dread df/d26/d42/d4b/db6/f8b [0,4194304] 0 2023-10-08T08:46:00.403 INFO:tasks.workunit.client.0.smithi070.stdout:8/782: creat d1/d2/d6/d22/d5b/d74/de1/dca/f103 x:0 0 0 2023-10-08T08:46:00.403 INFO:tasks.workunit.client.0.smithi070.stdout:7/770: mknod d3/d19/d95/dfe/c102 0 2023-10-08T08:46:00.403 INFO:tasks.workunit.client.0.smithi070.stdout:0/868: creat d1/d62/d54/d5e/d80/d8a/dec/f111 x:0 0 0 2023-10-08T08:46:00.404 INFO:tasks.workunit.client.0.smithi070.stdout:4/668: creat dc/d17/d24/d4c/fdb x:0 0 0 2023-10-08T08:46:00.404 INFO:tasks.workunit.client.0.smithi070.stdout:0/869: write d1/d76/d7a/fce [224267,65972] 0 2023-10-08T08:46:00.404 INFO:tasks.workunit.client.0.smithi070.stdout:9/523: creat d1/dd/d26/f98 x:0 0 0 2023-10-08T08:46:00.404 INFO:tasks.workunit.client.0.smithi070.stdout:5/727: creat d5/da/d22/ddd/d2a/dc0/ff4 x:0 0 0 2023-10-08T08:46:00.405 INFO:tasks.workunit.client.0.smithi070.stdout:4/669: creat dc/d17/d79/dad/db6/dc1/dc3/fdc x:0 0 0 2023-10-08T08:46:00.406 INFO:tasks.workunit.client.0.smithi070.stdout:6/637: unlink df/d26/d42/d4b/f54 0 2023-10-08T08:46:00.406 INFO:tasks.workunit.client.0.smithi070.stdout:6/638: dread - df/d26/d42/d43/d4a/f9a zero size 2023-10-08T08:46:00.407 INFO:tasks.workunit.client.0.smithi070.stdout:7/771: symlink d3/d79/l103 0 2023-10-08T08:46:00.407 INFO:tasks.workunit.client.0.smithi070.stdout:2/882: truncate df/f5c 945549 0 2023-10-08T08:46:00.409 INFO:tasks.workunit.client.0.smithi070.stdout:9/524: write d1/dd/d19/d38/f5a [2118520,66068] 0 2023-10-08T08:46:00.409 INFO:tasks.workunit.client.0.smithi070.stdout:9/525: write d1/dd/d19/d38/f42 [4956299,10071] 0 2023-10-08T08:46:00.409 INFO:tasks.workunit.client.0.smithi070.stdout:3/867: symlink d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/l128 0 2023-10-08T08:46:00.409 INFO:tasks.workunit.client.0.smithi070.stdout:9/526: write d1/f4b [4710855,47837] 0 2023-10-08T08:46:00.410 INFO:tasks.workunit.client.0.smithi070.stdout:9/527: rmdir d1/dd/d19/d38 39 2023-10-08T08:46:00.410 INFO:tasks.workunit.client.0.smithi070.stdout:3/868: mkdir d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/d129 0 2023-10-08T08:46:00.411 INFO:tasks.workunit.client.0.smithi070.stdout:0/870: creat d1/d76/d102/f112 x:0 0 0 2023-10-08T08:46:00.413 INFO:tasks.workunit.client.0.smithi070.stdout:7/772: mknod d3/d79/de3/c104 0 2023-10-08T08:46:00.415 INFO:tasks.workunit.client.0.smithi070.stdout:3/869: getdents d0/d12/d14/d48/d113/de6 0 2023-10-08T08:46:00.415 INFO:tasks.workunit.client.0.smithi070.stdout:3/870: chown d0/db/fd 4 1 2023-10-08T08:46:00.415 INFO:tasks.workunit.client.0.smithi070.stdout:8/783: unlink d1/d2/d6/d22/f58 0 2023-10-08T08:46:00.415 INFO:tasks.workunit.client.0.smithi070.stdout:8/784: write d1/d2/d6/d22/d5b/d74/de1/d21/fce [33413,23304] 0 2023-10-08T08:46:00.416 INFO:tasks.workunit.client.0.smithi070.stdout:2/883: link df/d4c/d91/cd3 df/d12/d1b/dd9/c11f 0 2023-10-08T08:46:00.416 INFO:tasks.workunit.client.0.smithi070.stdout:8/785: mknod d1/d4d/c104 0 2023-10-08T08:46:00.417 INFO:tasks.workunit.client.0.smithi070.stdout:0/871: rmdir d1/d62/d54/d5e/d80/d8a/dc3 39 2023-10-08T08:46:00.418 INFO:tasks.workunit.client.0.smithi070.stdout:9/528: write d1/dd/fa [1533736,70839] 0 2023-10-08T08:46:00.419 INFO:tasks.workunit.client.0.smithi070.stdout:9/529: chown d1/dd/d39/d6f/d88/f95 595 1 2023-10-08T08:46:00.419 INFO:tasks.workunit.client.0.smithi070.stdout:9/530: truncate d1/dd/d26/d27/d2d/f41 4249994 0 2023-10-08T08:46:00.419 INFO:tasks.workunit.client.0.smithi070.stdout:2/884: read df/d4c/f9c [3100925,125328] 0 2023-10-08T08:46:00.421 INFO:tasks.workunit.client.0.smithi070.stdout:9/531: rename d1/dd/d39/d4d to d1/dd/d19/d99 0 2023-10-08T08:46:00.421 INFO:tasks.workunit.client.0.smithi070.stdout:9/532: stat d1/dd/d1a/l37 0 2023-10-08T08:46:00.423 INFO:tasks.workunit.client.0.smithi070.stdout:2/885: unlink df/d3a/d77/cd0 0 2023-10-08T08:46:00.423 INFO:tasks.workunit.client.0.smithi070.stdout:4/670: dread dc/d17/d24/f40 [0,4194304] 0 2023-10-08T08:46:00.424 INFO:tasks.workunit.client.0.smithi070.stdout:9/533: symlink d1/dd/d19/d38/d77/l9a 0 2023-10-08T08:46:00.425 INFO:tasks.workunit.client.0.smithi070.stdout:4/671: getdents dc/d17/d24/d6b/dc7 0 2023-10-08T08:46:00.427 INFO:tasks.workunit.client.0.smithi070.stdout:2/886: read df/d73/f7f [444580,86972] 0 2023-10-08T08:46:00.427 INFO:tasks.workunit.client.0.smithi070.stdout:2/887: dread - df/d12/d1b/d82/d85/d65/ffa zero size 2023-10-08T08:46:00.433 INFO:tasks.workunit.client.0.smithi070.stdout:8/786: dread d1/d2/d6/d22/f98 [4194304,4194304] 0 2023-10-08T08:46:00.433 INFO:tasks.workunit.client.0.smithi070.stdout:8/787: truncate d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/ff2 319701 0 2023-10-08T08:46:00.435 INFO:tasks.workunit.client.0.smithi070.stdout:8/788: mkdir d1/d2/d6/d22/d5b/d74/de1/d2e/d105 0 2023-10-08T08:46:00.439 INFO:tasks.workunit.client.0.smithi070.stdout:6/639: dwrite f9 [0,4194304] 0 2023-10-08T08:46:00.444 INFO:tasks.workunit.client.0.smithi070.stdout:5/728: dwrite d5/da/d22/ddd/d38/fcd [0,4194304] 0 2023-10-08T08:46:00.444 INFO:tasks.workunit.client.0.smithi070.stdout:9/534: dread d1/dd/d26/d27/f44 [0,4194304] 0 2023-10-08T08:46:00.444 INFO:tasks.workunit.client.0.smithi070.stdout:9/535: dread - d1/dd/d26/f8a zero size 2023-10-08T08:46:00.444 INFO:tasks.workunit.client.0.smithi070.stdout:7/773: dwrite d3/da9/d4a/fd [0,4194304] 0 2023-10-08T08:46:00.456 INFO:tasks.workunit.client.0.smithi070.stdout:5/729: rmdir d5/da/d22 39 2023-10-08T08:46:00.457 INFO:tasks.workunit.client.0.smithi070.stdout:9/536: stat d1/dd/c69 0 2023-10-08T08:46:00.458 INFO:tasks.workunit.client.0.smithi070.stdout:2/888: write df/f5c [46624,125634] 0 2023-10-08T08:46:00.458 INFO:tasks.workunit.client.0.smithi070.stdout:5/730: mkdir d5/d5f/d61/d30/d83/df5 0 2023-10-08T08:46:00.460 INFO:tasks.workunit.client.0.smithi070.stdout:2/889: truncate df/d12/d1b/d1c/d69/d100/f72 1035533 0 2023-10-08T08:46:00.460 INFO:tasks.workunit.client.0.smithi070.stdout:3/871: dwrite d0/d12/d14/d5c/d5d/fdb [0,4194304] 0 2023-10-08T08:46:00.460 INFO:tasks.workunit.client.0.smithi070.stdout:0/872: dread d1/d1d/d4d/d9d/fa1 [0,4194304] 0 2023-10-08T08:46:00.466 INFO:tasks.workunit.client.0.smithi070.stdout:0/873: read d1/d1d/d4d/f5c [346398,98191] 0 2023-10-08T08:46:00.466 INFO:tasks.workunit.client.0.smithi070.stdout:9/537: dread d1/dd/f18 [0,4194304] 0 2023-10-08T08:46:00.468 INFO:tasks.workunit.client.0.smithi070.stdout:3/872: creat d0/d12/d14/d5c/d5d/da0/d101/d52/db5/db6/f12a x:0 0 0 2023-10-08T08:46:00.471 INFO:tasks.workunit.client.0.smithi070.stdout:9/538: rmdir d1/dd/d1a/d40/d76/d85 0 2023-10-08T08:46:00.471 INFO:tasks.workunit.client.0.smithi070.stdout:3/873: link d0/db/d10/c4c d0/d12/c12b 0 2023-10-08T08:46:00.473 INFO:tasks.workunit.client.0.smithi070.stdout:3/874: mknod d0/db/d10/d38/d63/c12c 0 2023-10-08T08:46:00.475 INFO:tasks.workunit.client.0.smithi070.stdout:4/672: write dc/d17/d24/fa6 [3482146,104164] 0 2023-10-08T08:46:00.475 INFO:tasks.workunit.client.0.smithi070.stdout:4/673: chown dc 57195887 1 2023-10-08T08:46:00.475 INFO:tasks.workunit.client.0.smithi070.stdout:0/874: rename d1/d1d/d4d/d9d/f8c to d1/d62/d103/f113 0 2023-10-08T08:46:00.475 INFO:tasks.workunit.client.0.smithi070.stdout:8/789: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/fdb [0,4194304] 0 2023-10-08T08:46:00.478 INFO:tasks.workunit.client.0.smithi070.stdout:6/640: dwrite df/d26/d42/db1/f3d [0,4194304] 0 2023-10-08T08:46:00.478 INFO:tasks.workunit.client.0.smithi070.stdout:6/641: chown df/d26/d42/d4b/db6/d7d/faf 1 1 2023-10-08T08:46:00.478 INFO:tasks.workunit.client.0.smithi070.stdout:7/774: dwrite d3/f2e [0,4194304] 0 2023-10-08T08:46:00.478 INFO:tasks.workunit.client.0.smithi070.stdout:3/875: mkdir d0/d12/d14/d5c/d5d/da0/d101/d52/db5/d12d 0 2023-10-08T08:46:00.478 INFO:tasks.workunit.client.0.smithi070.stdout:3/876: chown d0/d12/d14/d48/f91 81 1 2023-10-08T08:46:00.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/877: mkdir d0/db/d10/d38/d12e 0 2023-10-08T08:46:00.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/878: write d0/db/fa6 [231760,119212] 0 2023-10-08T08:46:00.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/879: chown d0/d12/d14/d5c/db1/c11f 0 1 2023-10-08T08:46:00.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/880: chown d0/db/d10/d38/c4d 1 1 2023-10-08T08:46:00.484 INFO:tasks.workunit.client.0.smithi070.stdout:8/790: mkdir d1/d2/d6/d22/d5b/d74/de1/d3a/dea/d106 0 2023-10-08T08:46:00.485 INFO:tasks.workunit.client.0.smithi070.stdout:0/875: link d1/d1d/d4d/d9d/fa1 d1/d14/dff/f114 0 2023-10-08T08:46:00.487 INFO:tasks.workunit.client.0.smithi070.stdout:3/881: mknod d0/d12/d14/d5c/d5d/da0/d101/d52/db5/c12f 0 2023-10-08T08:46:00.487 INFO:tasks.workunit.client.0.smithi070.stdout:8/791: mkdir d1/d2/d6/d22/d5c/d99/d107 0 2023-10-08T08:46:00.487 INFO:tasks.workunit.client.0.smithi070.stdout:3/882: chown d0/d12/d14/d5c/dc4/cf8 894 1 2023-10-08T08:46:00.488 INFO:tasks.workunit.client.0.smithi070.stdout:8/792: getdents d1/d2/d6/d22/d5b/d74/de1/d3a 0 2023-10-08T08:46:00.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/793: read d1/d2/d6/d22/d5c/d99/f9d [1590657,73715] 0 2023-10-08T08:46:00.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/794: fdatasync d1/d2/d6/d22/f98 0 2023-10-08T08:46:00.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/795: fdatasync d1/d2/d6/d22/d5b/d74/de1/dca/ff8 0 2023-10-08T08:46:00.491 INFO:tasks.workunit.client.0.smithi070.stdout:8/796: truncate d1/d2/d6/d22/d5b/d74/de1/d1a/fc1 1278210 0 2023-10-08T08:46:00.491 INFO:tasks.workunit.client.0.smithi070.stdout:8/797: fdatasync d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/ffb 0 2023-10-08T08:46:00.491 INFO:tasks.workunit.client.0.smithi070.stdout:5/731: dwrite d5/da/d22/f59 [0,4194304] 0 2023-10-08T08:46:00.492 INFO:tasks.workunit.client.0.smithi070.stdout:3/883: read d0/d12/d14/d5c/d5d/fdb [1754756,90431] 0 2023-10-08T08:46:00.493 INFO:tasks.workunit.client.0.smithi070.stdout:0/876: write d1/d1d/d4d/fdb [3137672,32121] 0 2023-10-08T08:46:00.494 INFO:tasks.workunit.client.0.smithi070.stdout:8/798: rename d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/fd3 to d1/d23/f108 0 2023-10-08T08:46:00.495 INFO:tasks.workunit.client.0.smithi070.stdout:8/799: write d1/d2/d6/d22/d5c/d99/f9d [2277449,53135] 0 2023-10-08T08:46:00.495 INFO:tasks.workunit.client.0.smithi070.stdout:8/800: fdatasync d1/d2/d6/d22/d5b/d74/de1/d3a/f63 0 2023-10-08T08:46:00.495 INFO:tasks.workunit.client.0.smithi070.stdout:9/539: dread d1/dd/d26/d27/d2d/d70/f86 [0,4194304] 0 2023-10-08T08:46:00.498 INFO:tasks.workunit.client.0.smithi070.stdout:0/877: symlink d1/d14/d1f/l115 0 2023-10-08T08:46:00.499 INFO:tasks.workunit.client.0.smithi070.stdout:2/890: dwrite df/d93/fed [0,4194304] 0 2023-10-08T08:46:00.499 INFO:tasks.workunit.client.0.smithi070.stdout:3/884: mkdir d0/d12/d130 0 2023-10-08T08:46:00.500 INFO:tasks.workunit.client.0.smithi070.stdout:8/801: creat d1/d2/d6/d22/d5b/d74/dc3/f109 x:0 0 0 2023-10-08T08:46:00.501 INFO:tasks.workunit.client.0.smithi070.stdout:0/878: unlink d1/d14/d1f/d6f/fd0 0 2023-10-08T08:46:00.502 INFO:tasks.workunit.client.0.smithi070.stdout:6/642: dread df/d26/d78/d90/daa/fb0 [0,4194304] 0 2023-10-08T08:46:00.502 INFO:tasks.workunit.client.0.smithi070.stdout:2/891: truncate df/f33 1158561 0 2023-10-08T08:46:00.503 INFO:tasks.workunit.client.0.smithi070.stdout:8/802: symlink d1/d2/d6/d22/d9e/da7/df9/l10a 0 2023-10-08T08:46:00.503 INFO:tasks.workunit.client.0.smithi070.stdout:8/803: write d1/d2/d6/d22/d5b/d74/de1/d21/fce [752846,20893] 0 2023-10-08T08:46:00.504 INFO:tasks.workunit.client.0.smithi070.stdout:8/804: readlink d1/d2/d6/d22/d5b/d74/de1/d1a/l36 0 2023-10-08T08:46:00.504 INFO:tasks.workunit.client.0.smithi070.stdout:0/879: truncate d1/d1d/d24/df4/f6c 583136 0 2023-10-08T08:46:00.504 INFO:tasks.workunit.client.0.smithi070.stdout:6/643: mkdir df/d26/d42/d4b/dd1 0 2023-10-08T08:46:00.506 INFO:tasks.workunit.client.0.smithi070.stdout:8/805: creat d1/d2/d6/d22/d5b/d74/de1/d3a/d92/f10b x:0 0 0 2023-10-08T08:46:00.506 INFO:tasks.workunit.client.0.smithi070.stdout:4/674: dwrite dc/d17/d24/d55/fa0 [0,4194304] 0 2023-10-08T08:46:00.507 INFO:tasks.workunit.client.0.smithi070.stdout:6/644: truncate df/d26/d42/d43/d4a/d75/d7e/fa6 4415673 0 2023-10-08T08:46:00.510 INFO:tasks.workunit.client.0.smithi070.stdout:4/675: creat dc/d17/d24/d6b/dc7/fdd x:0 0 0 2023-10-08T08:46:00.510 INFO:tasks.workunit.client.0.smithi070.stdout:4/676: fdatasync dc/d17/d24/f52 0 2023-10-08T08:46:00.512 INFO:tasks.workunit.client.0.smithi070.stdout:4/677: creat dc/d17/dbf/fde x:0 0 0 2023-10-08T08:46:00.516 INFO:tasks.workunit.client.0.smithi070.stdout:5/732: dread d5/d5f/d61/d30/d54/f7b [0,4194304] 0 2023-10-08T08:46:00.517 INFO:tasks.workunit.client.0.smithi070.stdout:7/775: dwrite d3/d19/d6d/fc3 [0,4194304] 0 2023-10-08T08:46:00.519 INFO:tasks.workunit.client.0.smithi070.stdout:7/776: truncate d3/da9/d4a/fd 369787 0 2023-10-08T08:46:00.520 INFO:tasks.workunit.client.0.smithi070.stdout:5/733: truncate d5/da/d22/ddd/d38/fa2 3246788 0 2023-10-08T08:46:00.521 INFO:tasks.workunit.client.0.smithi070.stdout:7/777: mknod d3/d19/d95/c105 0 2023-10-08T08:46:00.523 INFO:tasks.workunit.client.0.smithi070.stdout:8/806: write d1/fb4 [63719,36088] 0 2023-10-08T08:46:00.525 INFO:tasks.workunit.client.0.smithi070.stdout:4/678: write dc/d17/d24/d6b/f6c [2726959,51327] 0 2023-10-08T08:46:00.525 INFO:tasks.workunit.client.0.smithi070.stdout:4/679: readlink dc/d17/d24/d4c/d4e/lcc 0 2023-10-08T08:46:00.526 INFO:tasks.workunit.client.0.smithi070.stdout:8/807: creat d1/d2/d6/d22/d5b/d74/de1/d3a/f10c x:0 0 0 2023-10-08T08:46:00.526 INFO:tasks.workunit.client.0.smithi070.stdout:9/540: dread d1/dd/d19/d38/f3c [0,4194304] 0 2023-10-08T08:46:00.528 INFO:tasks.workunit.client.0.smithi070.stdout:4/680: unlink dc/d17/ccd 0 2023-10-08T08:46:00.529 INFO:tasks.workunit.client.0.smithi070.stdout:2/892: write df/d12/d1b/d1c/fe0 [3038330,67902] 0 2023-10-08T08:46:00.531 INFO:tasks.workunit.client.0.smithi070.stdout:4/681: mknod dc/d17/d24/d4c/d4e/cdf 0 2023-10-08T08:46:00.531 INFO:tasks.workunit.client.0.smithi070.stdout:4/682: dread - dc/d17/d24/d4c/f9b zero size 2023-10-08T08:46:00.532 INFO:tasks.workunit.client.0.smithi070.stdout:6/645: dwrite df/d11/f58 [0,4194304] 0 2023-10-08T08:46:00.532 INFO:tasks.workunit.client.0.smithi070.stdout:6/646: dread - df/f61 zero size 2023-10-08T08:46:00.534 INFO:tasks.workunit.client.0.smithi070.stdout:7/778: dread d3/da9/d4a/d9/d97/f9b [0,4194304] 0 2023-10-08T08:46:00.534 INFO:tasks.workunit.client.0.smithi070.stdout:7/779: fdatasync d3/d19/d6d/de7/ff7 0 2023-10-08T08:46:00.534 INFO:tasks.workunit.client.0.smithi070.stdout:0/880: dwrite d1/faa [0,4194304] 0 2023-10-08T08:46:00.534 INFO:tasks.workunit.client.0.smithi070.stdout:0/881: dread - d1/d1d/d24/f72 zero size 2023-10-08T08:46:00.535 INFO:tasks.workunit.client.0.smithi070.stdout:8/808: mkdir d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/d10d 0 2023-10-08T08:46:00.535 INFO:tasks.workunit.client.0.smithi070.stdout:3/885: dwrite d0/d12/d14/d5c/d5d/da0/d86/f89 [0,4194304] 0 2023-10-08T08:46:00.535 INFO:tasks.workunit.client.0.smithi070.stdout:5/734: rename d5/d5f/d63/dca/df3 to d5/da/df6 0 2023-10-08T08:46:00.538 INFO:tasks.workunit.client.0.smithi070.stdout:6/647: creat df/d26/d42/d4b/db6/fd2 x:0 0 0 2023-10-08T08:46:00.543 INFO:tasks.workunit.client.0.smithi070.stdout:0/882: rename d1/d62/c3b to d1/d14/de2/c116 0 2023-10-08T08:46:00.544 INFO:tasks.workunit.client.0.smithi070.stdout:6/648: creat df/d26/d42/d4b/dba/fd3 x:0 0 0 2023-10-08T08:46:00.545 INFO:tasks.workunit.client.0.smithi070.stdout:8/809: mknod d1/d2/d6/c10e 0 2023-10-08T08:46:00.545 INFO:tasks.workunit.client.0.smithi070.stdout:8/810: fdatasync d1/d23/f28 0 2023-10-08T08:46:00.545 INFO:tasks.workunit.client.0.smithi070.stdout:3/886: mkdir d0/db/d10/d38/d63/d11c/d131 0 2023-10-08T08:46:00.547 INFO:tasks.workunit.client.0.smithi070.stdout:8/811: symlink d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/l10f 0 2023-10-08T08:46:00.552 INFO:tasks.workunit.client.0.smithi070.stdout:3/887: truncate d0/d8a/f96 3739513 0 2023-10-08T08:46:00.553 INFO:tasks.workunit.client.0.smithi070.stdout:1/891: sync 2023-10-08T08:46:00.554 INFO:tasks.workunit.client.0.smithi070.stdout:1/892: fsync d6/f18 0 2023-10-08T08:46:00.554 INFO:tasks.workunit.client.0.smithi070.stdout:1/893: write d6/dc/d14/dc1/dca/d117/f8c [5240550,52799] 0 2023-10-08T08:46:00.554 INFO:tasks.workunit.client.0.smithi070.stdout:3/888: mknod d0/d12/d14/d5c/c132 0 2023-10-08T08:46:00.556 INFO:tasks.workunit.client.0.smithi070.stdout:3/889: symlink d0/db/d10/d38/d63/d11c/l133 0 2023-10-08T08:46:00.557 INFO:tasks.workunit.client.0.smithi070.stdout:3/890: stat d0/db/d10/d38/d63/d11c 0 2023-10-08T08:46:00.557 INFO:tasks.workunit.client.0.smithi070.stdout:1/894: mkdir d6/dc/d14/d1f/d127 0 2023-10-08T08:46:00.559 INFO:tasks.workunit.client.0.smithi070.stdout:3/891: link d0/d12/d14/d5c/d5d/da0/d101/f120 d0/d12/d10b/f134 0 2023-10-08T08:46:00.567 INFO:tasks.workunit.client.0.smithi070.stdout:4/683: dread dc/d17/d1f/d54/f67 [0,4194304] 0 2023-10-08T08:46:00.570 INFO:tasks.workunit.client.0.smithi070.stdout:4/684: creat dc/d17/d79/dad/db6/dc1/dc3/fe0 x:0 0 0 2023-10-08T08:46:00.572 INFO:tasks.workunit.client.0.smithi070.stdout:4/685: link dc/d17/d1f/c2d dc/d17/d24/d4c/d4e/dab/ce1 0 2023-10-08T08:46:00.575 INFO:tasks.workunit.client.0.smithi070.stdout:6/649: dread df/d71/f7b [0,4194304] 0 2023-10-08T08:46:00.579 INFO:tasks.workunit.client.0.smithi070.stdout:5/735: dread d5/da/d4d/f3f [0,4194304] 0 2023-10-08T08:46:00.579 INFO:tasks.workunit.client.0.smithi070.stdout:7/780: dwrite d3/d77/f91 [0,4194304] 0 2023-10-08T08:46:00.580 INFO:tasks.workunit.client.0.smithi070.stdout:3/892: read d0/d12/d14/d5c/db1/dbe/d100/f123 [309469,438] 0 2023-10-08T08:46:00.580 INFO:tasks.workunit.client.0.smithi070.stdout:3/893: write d0/d12/d14/d5c/d5d/da0/d86/fc2 [1294816,45343] 0 2023-10-08T08:46:00.580 INFO:tasks.workunit.client.0.smithi070.stdout:3/894: fsync d0/db/d10/f8f 0 2023-10-08T08:46:00.582 INFO:tasks.workunit.client.0.smithi070.stdout:5/736: creat d5/da/d22/ff7 x:0 0 0 2023-10-08T08:46:00.583 INFO:tasks.workunit.client.0.smithi070.stdout:7/781: mknod d3/d79/c106 0 2023-10-08T08:46:00.586 INFO:tasks.workunit.client.0.smithi070.stdout:3/895: rename d0/d12/d14/d48/f91 to d0/d12/d14/d48/d113/dba/f135 0 2023-10-08T08:46:00.586 INFO:tasks.workunit.client.0.smithi070.stdout:3/896: write d0/db/fa6 [759612,13771] 0 2023-10-08T08:46:00.586 INFO:tasks.workunit.client.0.smithi070.stdout:5/737: creat d5/da/d22/ddd/ff8 x:0 0 0 2023-10-08T08:46:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:00 smithi191 ceph-mon[104220]: pgmap v357: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 35 MiB/s wr, 88 op/s 2023-10-08T08:46:00.606 INFO:tasks.workunit.client.0.smithi070.stdout:9/541: dwrite d1/dd/d19/d38/f71 [0,4194304] 0 2023-10-08T08:46:00.607 INFO:tasks.workunit.client.0.smithi070.stdout:9/542: fdatasync d1/dd/d1a/f62 0 2023-10-08T08:46:00.607 INFO:tasks.workunit.client.0.smithi070.stdout:6/650: dwrite df/fa0 [0,4194304] 0 2023-10-08T08:46:00.610 INFO:tasks.workunit.client.0.smithi070.stdout:6/651: creat df/d26/d78/d90/fd4 x:0 0 0 2023-10-08T08:46:00.613 INFO:tasks.workunit.client.0.smithi070.stdout:3/897: dwrite d0/d12/d14/d5c/d5d/da0/dd8/fe5 [0,4194304] 0 2023-10-08T08:46:00.617 INFO:tasks.workunit.client.0.smithi070.stdout:3/898: truncate d0/d12/d14/d48/d113/dba/ffb 561152 0 2023-10-08T08:46:00.617 INFO:tasks.workunit.client.0.smithi070.stdout:3/899: write d0/d8a/fcd [588902,55108] 0 2023-10-08T08:46:00.619 INFO:tasks.workunit.client.0.smithi070.stdout:3/900: symlink d0/d12/d10b/l136 0 2023-10-08T08:46:00.626 INFO:tasks.workunit.client.0.smithi070.stdout:8/812: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/fc6 [4194304,4194304] 0 2023-10-08T08:46:00.627 INFO:tasks.workunit.client.0.smithi070.stdout:8/813: fdatasync d1/d2/d6/d22/d5b/d74/de1/d21/f47 0 2023-10-08T08:46:00.627 INFO:tasks.workunit.client.0.smithi070.stdout:4/686: dwrite dc/d17/d24/f49 [0,4194304] 0 2023-10-08T08:46:00.629 INFO:tasks.workunit.client.0.smithi070.stdout:8/814: mkdir d1/d2/d8c/db9/d110 0 2023-10-08T08:46:00.632 INFO:tasks.workunit.client.0.smithi070.stdout:7/782: dwrite d3/d19/fb2 [0,4194304] 0 2023-10-08T08:46:00.632 INFO:tasks.workunit.client.0.smithi070.stdout:7/783: chown d3/d77/de2/df6 1 1 2023-10-08T08:46:00.633 INFO:tasks.workunit.client.0.smithi070.stdout:1/895: dwrite d6/dc/d14/dc1/dca/d117/d7e/dc2/fe3 [0,4194304] 0 2023-10-08T08:46:00.633 INFO:tasks.workunit.client.0.smithi070.stdout:5/738: dwrite d5/da/d22/d75/fdc [0,4194304] 0 2023-10-08T08:46:00.633 INFO:tasks.workunit.client.0.smithi070.stdout:8/815: read d1/d2/d6/d22/d5b/d74/de1/d3a/f3f [1659135,43955] 0 2023-10-08T08:46:00.633 INFO:tasks.workunit.client.0.smithi070.stdout:4/687: write dc/d5f/fbe [1901410,36832] 0 2023-10-08T08:46:00.633 INFO:tasks.workunit.client.0.smithi070.stdout:8/816: chown d1 3300895 1 2023-10-08T08:46:00.633 INFO:tasks.workunit.client.0.smithi070.stdout:0/883: dwrite d1/d1d/d24/df4/ff8 [0,4194304] 0 2023-10-08T08:46:00.637 INFO:tasks.workunit.client.0.smithi070.stdout:4/688: rename dc/ff to dc/d17/d24/d4c/fe2 0 2023-10-08T08:46:00.638 INFO:tasks.workunit.client.0.smithi070.stdout:3/901: dread d0/d12/d14/f1c [0,4194304] 0 2023-10-08T08:46:00.639 INFO:tasks.workunit.client.0.smithi070.stdout:4/689: dread dc/d5f/fb3 [0,4194304] 0 2023-10-08T08:46:00.639 INFO:tasks.workunit.client.0.smithi070.stdout:4/690: write dc/d17/d24/d55/da4/fa7 [887316,38124] 0 2023-10-08T08:46:00.642 INFO:tasks.workunit.client.0.smithi070.stdout:4/691: write dc/d17/f21 [1555276,760] 0 2023-10-08T08:46:00.644 INFO:tasks.workunit.client.0.smithi070.stdout:5/739: rmdir d5/d5f/d61/d30/d54/d62 39 2023-10-08T08:46:00.644 INFO:tasks.workunit.client.0.smithi070.stdout:5/740: write d5/da/d22/fa4 [113543,106458] 0 2023-10-08T08:46:00.644 INFO:tasks.workunit.client.0.smithi070.stdout:5/741: readlink d5/da/d22/d75/d82/l9b 0 2023-10-08T08:46:00.644 INFO:tasks.workunit.client.0.smithi070.stdout:1/896: mkdir d6/dc/d128 0 2023-10-08T08:46:00.644 INFO:tasks.workunit.client.0.smithi070.stdout:4/692: symlink dc/d17/le3 0 2023-10-08T08:46:00.646 INFO:tasks.workunit.client.0.smithi070.stdout:7/784: dread d3/da9/d1e/fab [0,4194304] 0 2023-10-08T08:46:00.646 INFO:tasks.workunit.client.0.smithi070.stdout:8/817: mknod d1/d2/d6/d22/d5b/d74/de1/d21/c111 0 2023-10-08T08:46:00.646 INFO:tasks.workunit.client.0.smithi070.stdout:0/884: creat d1/d14/d1f/d10f/f117 x:0 0 0 2023-10-08T08:46:00.647 INFO:tasks.workunit.client.0.smithi070.stdout:0/885: dread - d1/fab zero size 2023-10-08T08:46:00.647 INFO:tasks.workunit.client.0.smithi070.stdout:0/886: write d1/d1d/d24/f7f [4238126,15841] 0 2023-10-08T08:46:00.647 INFO:tasks.workunit.client.0.smithi070.stdout:3/902: mkdir d0/d12/d14/d5c/d5d/da0/d101/d52/d137 0 2023-10-08T08:46:00.648 INFO:tasks.workunit.client.0.smithi070.stdout:1/897: creat d6/dc/d14/f129 x:0 0 0 2023-10-08T08:46:00.650 INFO:tasks.workunit.client.0.smithi070.stdout:7/785: mknod d3/d19/d6d/dd7/c107 0 2023-10-08T08:46:00.653 INFO:tasks.workunit.client.0.smithi070.stdout:5/742: rename d5/d5f/d61/d30/le3 to d5/da/d4d/dc2/lf9 0 2023-10-08T08:46:00.655 INFO:tasks.workunit.client.0.smithi070.stdout:0/887: symlink d1/d62/d54/dfc/d10d/l118 0 2023-10-08T08:46:00.655 INFO:tasks.workunit.client.0.smithi070.stdout:5/743: dread d5/da/d22/ddd/d38/d55/f4f [0,4194304] 0 2023-10-08T08:46:00.655 INFO:tasks.workunit.client.0.smithi070.stdout:5/744: chown d5/d5f/d63/d8b/d8f/ld9 1432 1 2023-10-08T08:46:00.656 INFO:tasks.workunit.client.0.smithi070.stdout:8/818: mknod d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/d10d/c112 0 2023-10-08T08:46:00.656 INFO:tasks.workunit.client.0.smithi070.stdout:8/819: chown d1/d2/d6/d22/f33 49 1 2023-10-08T08:46:00.657 INFO:tasks.workunit.client.0.smithi070.stdout:7/786: creat d3/da9/d4a/f108 x:0 0 0 2023-10-08T08:46:00.660 INFO:tasks.workunit.client.0.smithi070.stdout:5/745: mkdir d5/da/d22/d75/dfa 0 2023-10-08T08:46:00.660 INFO:tasks.workunit.client.0.smithi070.stdout:5/746: stat d5/d5f/d63/d8b/d8f/de5/fef 0 2023-10-08T08:46:00.660 INFO:tasks.workunit.client.0.smithi070.stdout:0/888: readlink d1/d1d/d24/l2a 0 2023-10-08T08:46:00.664 INFO:tasks.workunit.client.0.smithi070.stdout:7/787: rename d3/da9/d1e/d76/cf5 to d3/d19/d95/da3/dc8/c109 0 2023-10-08T08:46:00.665 INFO:tasks.workunit.client.0.smithi070.stdout:0/889: creat d1/d62/d54/f119 x:0 0 0 2023-10-08T08:46:00.665 INFO:tasks.workunit.client.0.smithi070.stdout:0/890: fsync d1/d1d/d24/f71 0 2023-10-08T08:46:00.666 INFO:tasks.workunit.client.0.smithi070.stdout:5/747: read d5/da/d22/f89 [3659958,61638] 0 2023-10-08T08:46:00.666 INFO:tasks.workunit.client.0.smithi070.stdout:5/748: readlink d5/d5f/d63/la0 0 2023-10-08T08:46:00.670 INFO:tasks.workunit.client.0.smithi070.stdout:5/749: mkdir d5/da/d4d/dfb 0 2023-10-08T08:46:00.670 INFO:tasks.workunit.client.0.smithi070.stdout:5/750: stat d5/da/l40 0 2023-10-08T08:46:00.672 INFO:tasks.workunit.client.0.smithi070.stdout:5/751: creat d5/d5f/d61/d30/d54/d62/dae/ffc x:0 0 0 2023-10-08T08:46:00.672 INFO:tasks.workunit.client.0.smithi070.stdout:5/752: stat d5/da/d22/f32 0 2023-10-08T08:46:00.675 INFO:tasks.workunit.client.0.smithi070.stdout:5/753: symlink d5/da/d4d/lfd 0 2023-10-08T08:46:00.675 INFO:tasks.workunit.client.0.smithi070.stdout:5/754: chown d5/d5f/d63/d8b/da8/dac/de2 4 1 2023-10-08T08:46:00.676 INFO:tasks.workunit.client.0.smithi070.stdout:5/755: mkdir d5/da/d22/d75/dfe 0 2023-10-08T08:46:00.713 INFO:tasks.workunit.client.0.smithi070.stdout:7/788: write d3/d19/fb2 [3668170,10644] 0 2023-10-08T08:46:00.714 INFO:tasks.workunit.client.0.smithi070.stdout:3/903: dwrite d0/d12/d14/d5c/db1/f10a [0,4194304] 0 2023-10-08T08:46:00.714 INFO:tasks.workunit.client.0.smithi070.stdout:0/891: write d1/d62/d54/d5e/fee [3354048,21612] 0 2023-10-08T08:46:00.715 INFO:tasks.workunit.client.0.smithi070.stdout:5/756: write d5/d5f/d63/fbe [2495769,87444] 0 2023-10-08T08:46:00.717 INFO:tasks.workunit.client.0.smithi070.stdout:6/652: dwrite df/d11/f40 [0,4194304] 0 2023-10-08T08:46:00.720 INFO:tasks.workunit.client.0.smithi070.stdout:3/904: write d0/d12/f71 [2755236,90292] 0 2023-10-08T08:46:00.720 INFO:tasks.workunit.client.0.smithi070.stdout:3/905: chown d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/fed 49895258 1 2023-10-08T08:46:00.721 INFO:tasks.workunit.client.0.smithi070.stdout:5/757: creat d5/d5f/fff x:0 0 0 2023-10-08T08:46:00.721 INFO:tasks.workunit.client.0.smithi070.stdout:8/820: dwrite d1/d2/d8c/fb0 [0,4194304] 0 2023-10-08T08:46:00.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:00 smithi070 ceph-mon[99513]: pgmap v357: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 35 MiB/s wr, 88 op/s 2023-10-08T08:46:00.721 INFO:tasks.workunit.client.0.smithi070.stdout:8/821: write d1/d2/d6/d22/d5b/d74/de1/d3a/d92/fad [1587778,80653] 0 2023-10-08T08:46:00.722 INFO:tasks.workunit.client.0.smithi070.stdout:3/906: creat d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/de1/f138 x:0 0 0 2023-10-08T08:46:00.724 INFO:tasks.workunit.client.0.smithi070.stdout:3/907: write d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/de1/dd2/f121 [4142218,124697] 0 2023-10-08T08:46:00.726 INFO:tasks.workunit.client.0.smithi070.stdout:6/653: rmdir df/d26/d78 39 2023-10-08T08:46:00.728 INFO:tasks.workunit.client.0.smithi070.stdout:6/654: write df/d26/d42/d4b/d80/d94/f99 [511139,34077] 0 2023-10-08T08:46:00.732 INFO:tasks.workunit.client.0.smithi070.stdout:6/655: unlink df/d26/d42/d43/d4a/d75/fb4 0 2023-10-08T08:46:00.735 INFO:tasks.workunit.client.0.smithi070.stdout:6/656: rmdir df/d26/d42/d4b/dd1 0 2023-10-08T08:46:00.735 INFO:tasks.workunit.client.0.smithi070.stdout:6/657: truncate df/d26/d42/d43/d4a/f68 4294288 0 2023-10-08T08:46:00.736 INFO:tasks.workunit.client.0.smithi070.stdout:6/658: rmdir df/d26/d42/db1 39 2023-10-08T08:46:00.736 INFO:tasks.workunit.client.0.smithi070.stdout:6/659: chown df/d26/l33 58886991 1 2023-10-08T08:46:00.737 INFO:tasks.workunit.client.0.smithi070.stdout:7/789: dwrite d3/d19/d95/da3/dc8/dfb/f66 [0,4194304] 0 2023-10-08T08:46:00.740 INFO:tasks.workunit.client.0.smithi070.stdout:3/908: write d0/d12/d14/d5c/d5d/da0/dd8/fe5 [4000051,37815] 0 2023-10-08T08:46:00.740 INFO:tasks.workunit.client.0.smithi070.stdout:3/909: read - d0/d12/d14/d48/d113/fa8 zero size 2023-10-08T08:46:00.740 INFO:tasks.workunit.client.0.smithi070.stdout:7/790: mkdir d3/da9/d4a/d10a 0 2023-10-08T08:46:00.743 INFO:tasks.workunit.client.0.smithi070.stdout:3/910: creat d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/f139 x:0 0 0 2023-10-08T08:46:00.744 INFO:tasks.workunit.client.0.smithi070.stdout:3/911: getdents d0/d12/d14/d5c/d5d/da0/d101/d52 0 2023-10-08T08:46:00.752 INFO:tasks.workunit.client.0.smithi070.stdout:8/822: dwrite d1/fb [4194304,4194304] 0 2023-10-08T08:46:00.754 INFO:tasks.workunit.client.0.smithi070.stdout:8/823: mkdir d1/d2/d6/d22/d5b/d74/de1/da9/d113 0 2023-10-08T08:46:00.755 INFO:tasks.workunit.client.0.smithi070.stdout:0/892: dwrite d1/d1d/d4d/d9d/f4f [4194304,4194304] 0 2023-10-08T08:46:00.755 INFO:tasks.workunit.client.0.smithi070.stdout:5/758: dread d5/da/d22/ddd/f6c [0,4194304] 0 2023-10-08T08:46:00.755 INFO:tasks.workunit.client.0.smithi070.stdout:5/759: chown d5/da/d4d/dc2/lf9 159631164 1 2023-10-08T08:46:00.756 INFO:tasks.workunit.client.0.smithi070.stdout:6/660: dwrite df/d11/f58 [0,4194304] 0 2023-10-08T08:46:00.756 INFO:tasks.workunit.client.0.smithi070.stdout:8/824: creat d1/d2/d6/d22/d5b/d74/de1/d3a/dea/d106/f114 x:0 0 0 2023-10-08T08:46:00.757 INFO:tasks.workunit.client.0.smithi070.stdout:0/893: truncate d1/d1d/d24/f94 670937 0 2023-10-08T08:46:00.757 INFO:tasks.workunit.client.0.smithi070.stdout:0/894: chown d1/d1d/d24/df4 528 1 2023-10-08T08:46:00.758 INFO:tasks.workunit.client.0.smithi070.stdout:5/760: creat d5/d5f/d63/d8b/da8/dac/f100 x:0 0 0 2023-10-08T08:46:00.758 INFO:tasks.workunit.client.0.smithi070.stdout:5/761: fdatasync d5/d5f/d61/d30/d54/d62/fd4 0 2023-10-08T08:46:00.759 INFO:tasks.workunit.client.0.smithi070.stdout:0/895: mknod d1/d14/d1f/c11a 0 2023-10-08T08:46:00.759 INFO:tasks.workunit.client.0.smithi070.stdout:8/825: mkdir d1/d2/d6/d22/d9e/d115 0 2023-10-08T08:46:00.760 INFO:tasks.workunit.client.0.smithi070.stdout:0/896: mkdir d1/d76/d11b 0 2023-10-08T08:46:00.762 INFO:tasks.workunit.client.0.smithi070.stdout:3/912: write d0/d12/f7c [775950,49011] 0 2023-10-08T08:46:00.762 INFO:tasks.workunit.client.0.smithi070.stdout:3/913: write d0/d12/d14/d48/d113/fa8 [955083,58870] 0 2023-10-08T08:46:00.766 INFO:tasks.workunit.client.0.smithi070.stdout:5/762: rename d5/d5f/d61/d30/d54/dab/fb5 to d5/f101 0 2023-10-08T08:46:00.766 INFO:tasks.workunit.client.0.smithi070.stdout:5/763: dread - d5/d5f/d63/d8b/d8f/de5/fef zero size 2023-10-08T08:46:00.766 INFO:tasks.workunit.client.0.smithi070.stdout:5/764: chown d5/da/d22/ddd/d2a/f58 78 1 2023-10-08T08:46:00.769 INFO:tasks.workunit.client.0.smithi070.stdout:3/914: creat d0/d12/d14/d5c/d5d/da0/d101/d52/db5/d12d/f13a x:0 0 0 2023-10-08T08:46:00.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:00 smithi105 ceph-mon[103798]: pgmap v357: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 35 MiB/s wr, 88 op/s 2023-10-08T08:46:00.773 INFO:tasks.workunit.client.0.smithi070.stdout:7/791: dwrite d3/d77/f91 [0,4194304] 0 2023-10-08T08:46:00.777 INFO:tasks.workunit.client.0.smithi070.stdout:0/897: dread d1/dd/f3d [0,4194304] 0 2023-10-08T08:46:00.777 INFO:tasks.workunit.client.0.smithi070.stdout:0/898: chown d1/d62/d54/dfc/d10d 302788614 1 2023-10-08T08:46:00.777 INFO:tasks.workunit.client.0.smithi070.stdout:7/792: symlink d3/da9/d1e/d4c/l10b 0 2023-10-08T08:46:00.777 INFO:tasks.workunit.client.0.smithi070.stdout:7/793: read - d3/da9/d1e/fe0 zero size 2023-10-08T08:46:00.777 INFO:tasks.workunit.client.0.smithi070.stdout:0/899: creat d1/d62/d54/dfc/f11c x:0 0 0 2023-10-08T08:46:00.779 INFO:tasks.workunit.client.0.smithi070.stdout:7/794: creat d3/d19/d6d/f10c x:0 0 0 2023-10-08T08:46:00.780 INFO:tasks.workunit.client.0.smithi070.stdout:0/900: mkdir d1/d14/de5/d11d 0 2023-10-08T08:46:00.781 INFO:tasks.workunit.client.0.smithi070.stdout:3/915: write d0/d12/d14/ff5 [109877,55964] 0 2023-10-08T08:46:00.781 INFO:tasks.workunit.client.0.smithi070.stdout:6/661: dwrite df/d26/d42/d43/d4a/d75/f9b [0,4194304] 0 2023-10-08T08:46:00.782 INFO:tasks.workunit.client.0.smithi070.stdout:6/662: dread - df/d26/d42/d43/d4a/d97/fcd zero size 2023-10-08T08:46:00.782 INFO:tasks.workunit.client.0.smithi070.stdout:3/916: symlink d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/de1/l13b 0 2023-10-08T08:46:00.784 INFO:tasks.workunit.client.0.smithi070.stdout:8/826: dwrite d1/d2/d8c/fb0 [4194304,4194304] 0 2023-10-08T08:46:00.784 INFO:tasks.workunit.client.0.smithi070.stdout:8/827: stat d1/d2/d6/d22/d5c/d99/lcd 0 2023-10-08T08:46:00.784 INFO:tasks.workunit.client.0.smithi070.stdout:3/917: rename d0/db/d10/f8f to d0/d12/d130/f13c 0 2023-10-08T08:46:00.785 INFO:tasks.workunit.client.0.smithi070.stdout:6/663: mkdir df/d26/d78/dd5 0 2023-10-08T08:46:00.785 INFO:tasks.workunit.client.0.smithi070.stdout:6/664: truncate f2 5192003 0 2023-10-08T08:46:00.786 INFO:tasks.workunit.client.0.smithi070.stdout:8/828: symlink d1/d2/d6/d22/d9e/da7/dbe/l116 0 2023-10-08T08:46:00.787 INFO:tasks.workunit.client.0.smithi070.stdout:6/665: rename df/d11/f7a to df/d26/d78/fd6 0 2023-10-08T08:46:00.788 INFO:tasks.workunit.client.0.smithi070.stdout:8/829: creat d1/d2/f117 x:0 0 0 2023-10-08T08:46:00.789 INFO:tasks.workunit.client.0.smithi070.stdout:6/666: link df/d71/f8c df/d26/d78/dd5/fd7 0 2023-10-08T08:46:00.790 INFO:tasks.workunit.client.0.smithi070.stdout:6/667: dread df/d11/f47 [4194304,4194304] 0 2023-10-08T08:46:00.790 INFO:tasks.workunit.client.0.smithi070.stdout:6/668: dread - df/d26/d42/d43/d4a/d75/d7e/fa3 zero size 2023-10-08T08:46:00.793 INFO:tasks.workunit.client.0.smithi070.stdout:6/669: creat df/d26/d42/d43/d4a/d97/da5/fd8 x:0 0 0 2023-10-08T08:46:00.793 INFO:tasks.workunit.client.0.smithi070.stdout:6/670: fdatasync df/d11/f47 0 2023-10-08T08:46:00.793 INFO:tasks.workunit.client.0.smithi070.stdout:3/918: read d0/db/d10/d38/d2f/f7e [360602,119951] 0 2023-10-08T08:46:00.795 INFO:tasks.workunit.client.0.smithi070.stdout:7/795: read d3/d77/f91 [3883274,91480] 0 2023-10-08T08:46:00.795 INFO:tasks.workunit.client.0.smithi070.stdout:3/919: truncate d0/d12/d14/d48/f84 13798 0 2023-10-08T08:46:00.796 INFO:tasks.workunit.client.0.smithi070.stdout:7/796: symlink d3/da9/d4a/d10a/l10d 0 2023-10-08T08:46:00.799 INFO:tasks.workunit.client.0.smithi070.stdout:3/920: mkdir d0/db/de0/d13d 0 2023-10-08T08:46:00.801 INFO:tasks.workunit.client.0.smithi070.stdout:3/921: write d0/d12/d14/f2a [608370,68951] 0 2023-10-08T08:46:00.803 INFO:tasks.workunit.client.0.smithi070.stdout:3/922: rename d0/d12/d14/d48/l60 to d0/d12/d14/d5c/l13e 0 2023-10-08T08:46:00.804 INFO:tasks.workunit.client.0.smithi070.stdout:8/830: dread d1/d2/d6/d22/d5b/d74/de1/d21/fe3 [0,4194304] 0 2023-10-08T08:46:00.804 INFO:tasks.workunit.client.0.smithi070.stdout:7/797: dread d3/d19/d95/da3/dc8/dfb/f81 [0,4194304] 0 2023-10-08T08:46:00.805 INFO:tasks.workunit.client.0.smithi070.stdout:5/765: dwrite d5/da/d22/ddd/ff8 [0,4194304] 0 2023-10-08T08:46:00.809 INFO:tasks.workunit.client.0.smithi070.stdout:3/923: creat d0/d12/d14/d5c/d5d/da0/f13f x:0 0 0 2023-10-08T08:46:00.809 INFO:tasks.workunit.client.0.smithi070.stdout:5/766: creat d5/da/df6/f102 x:0 0 0 2023-10-08T08:46:00.813 INFO:tasks.workunit.client.0.smithi070.stdout:0/901: write d1/d14/d1f/fad [5666406,122379] 0 2023-10-08T08:46:00.813 INFO:tasks.workunit.client.0.smithi070.stdout:0/902: write d1/d14/d1f/ff5 [1292842,89926] 0 2023-10-08T08:46:00.815 INFO:tasks.workunit.client.0.smithi070.stdout:5/767: rmdir d5/da/d22 39 2023-10-08T08:46:00.818 INFO:tasks.workunit.client.0.smithi070.stdout:5/768: mkdir d5/da/d22/ddd/d38/d55/dbf/d103 0 2023-10-08T08:46:00.833 INFO:tasks.workunit.client.0.smithi070.stdout:5/769: dread d5/d5f/f78 [0,4194304] 0 2023-10-08T08:46:00.834 INFO:tasks.workunit.client.0.smithi070.stdout:5/770: getdents d5/d5f/d63/dca 0 2023-10-08T08:46:00.836 INFO:tasks.workunit.client.0.smithi070.stdout:5/771: rename d5/d5f/d61/d30/l42 to d5/d5f/l104 0 2023-10-08T08:46:00.837 INFO:tasks.workunit.client.0.smithi070.stdout:3/924: write d0/d12/d14/d5c/d5d/da0/dd8/fe5 [1335287,70738] 0 2023-10-08T08:46:00.838 INFO:tasks.workunit.client.0.smithi070.stdout:7/798: dwrite d3/d19/d1a/f40 [4194304,4194304] 0 2023-10-08T08:46:00.838 INFO:tasks.workunit.client.0.smithi070.stdout:5/772: unlink d5/d5f/d63/fbe 0 2023-10-08T08:46:00.841 INFO:tasks.workunit.client.0.smithi070.stdout:7/799: creat d3/d79/de3/f10e x:0 0 0 2023-10-08T08:46:00.841 INFO:tasks.workunit.client.0.smithi070.stdout:7/800: dread - d3/d19/d95/da3/dc8/dfb/d9f/dc5/fff zero size 2023-10-08T08:46:00.842 INFO:tasks.workunit.client.0.smithi070.stdout:5/773: rename d5/da/d22/ddd/d38/fa2 to d5/da/d22/ddd/d38/d55/dbf/f105 0 2023-10-08T08:46:00.842 INFO:tasks.workunit.client.0.smithi070.stdout:5/774: rename d5/da/d22/ddd/d38/f6a to d5/da/d22/ddd/d38/f106 0 2023-10-08T08:46:00.847 INFO:tasks.workunit.client.0.smithi070.stdout:0/903: read d1/f7 [1784607,126483] 0 2023-10-08T08:46:00.848 INFO:tasks.workunit.client.0.smithi070.stdout:7/801: rename d3/d19/d95/da3/dc8/dfb/f81 to d3/da9/d1e/f10f 0 2023-10-08T08:46:00.848 INFO:tasks.workunit.client.0.smithi070.stdout:7/802: dread - d3/da9/d1e/d4c/fcf zero size 2023-10-08T08:46:00.850 INFO:tasks.workunit.client.0.smithi070.stdout:0/904: mkdir d1/d62/d54/d5e/d80/d11e 0 2023-10-08T08:46:00.850 INFO:tasks.workunit.client.0.smithi070.stdout:7/803: unlink d3/d79/de3/feb 0 2023-10-08T08:46:00.851 INFO:tasks.workunit.client.0.smithi070.stdout:5/775: write d5/da/d4d/f3f [1389059,31619] 0 2023-10-08T08:46:00.852 INFO:tasks.workunit.client.0.smithi070.stdout:7/804: mkdir d3/d79/d110 0 2023-10-08T08:46:00.852 INFO:tasks.workunit.client.0.smithi070.stdout:5/776: mknod d5/d5f/d63/d8b/da8/dac/de2/c107 0 2023-10-08T08:46:00.854 INFO:tasks.workunit.client.0.smithi070.stdout:7/805: unlink d3/da9/c65 0 2023-10-08T08:46:00.857 INFO:tasks.workunit.client.0.smithi070.stdout:7/806: creat d3/d77/de2/f111 x:0 0 0 2023-10-08T08:46:00.860 INFO:tasks.workunit.client.0.smithi070.stdout:3/925: dwrite d0/d12/d14/ff5 [0,4194304] 0 2023-10-08T08:46:00.862 INFO:tasks.workunit.client.0.smithi070.stdout:6/671: dwrite df/d26/d42/d4b/dba/fd3 [0,4194304] 0 2023-10-08T08:46:00.865 INFO:tasks.workunit.client.0.smithi070.stdout:3/926: write d0/d12/d14/d5c/d5d/da0/dd8/fe5 [314794,50103] 0 2023-10-08T08:46:00.865 INFO:tasks.workunit.client.0.smithi070.stdout:6/672: truncate df/d26/f63 1147905 0 2023-10-08T08:46:00.866 INFO:tasks.workunit.client.0.smithi070.stdout:6/673: readlink df/d26/d42/d43/d4a/d97/lc5 0 2023-10-08T08:46:00.867 INFO:tasks.workunit.client.0.smithi070.stdout:6/674: creat df/d26/d42/d43/d4a/d97/dc0/fd9 x:0 0 0 2023-10-08T08:46:00.868 INFO:tasks.workunit.client.0.smithi070.stdout:3/927: rmdir d0/db/de0/d13d 0 2023-10-08T08:46:00.868 INFO:tasks.workunit.client.0.smithi070.stdout:6/675: symlink df/d26/d78/d90/dae/lda 0 2023-10-08T08:46:00.870 INFO:tasks.workunit.client.0.smithi070.stdout:3/928: creat d0/d12/d14/d5c/d5d/da0/dd8/f140 x:0 0 0 2023-10-08T08:46:00.874 INFO:tasks.workunit.client.0.smithi070.stdout:3/929: getdents d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb 0 2023-10-08T08:46:00.876 INFO:tasks.workunit.client.0.smithi070.stdout:5/777: dread d5/da/d22/d75/fdc [0,4194304] 0 2023-10-08T08:46:00.876 INFO:tasks.workunit.client.0.smithi070.stdout:0/905: dwrite d1/dd/f13 [4194304,4194304] 0 2023-10-08T08:46:00.877 INFO:tasks.workunit.client.0.smithi070.stdout:5/778: readlink d5/d5f/l104 0 2023-10-08T08:46:00.878 INFO:tasks.workunit.client.0.smithi070.stdout:3/930: creat d0/d12/d14/d5c/dc4/f141 x:0 0 0 2023-10-08T08:46:00.878 INFO:tasks.workunit.client.0.smithi070.stdout:3/931: write d0/d12/d14/d48/d113/fa8 [1633296,85707] 0 2023-10-08T08:46:00.878 INFO:tasks.workunit.client.0.smithi070.stdout:3/932: chown d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/de1/l13b 9601 1 2023-10-08T08:46:00.879 INFO:tasks.workunit.client.0.smithi070.stdout:5/779: mknod d5/da/d4d/dfb/c108 0 2023-10-08T08:46:00.884 INFO:tasks.workunit.client.0.smithi070.stdout:3/933: dread d0/d12/d14/d5c/d5d/da0/d86/fc2 [0,4194304] 0 2023-10-08T08:46:00.887 INFO:tasks.workunit.client.0.smithi070.stdout:3/934: mknod d0/d12/d10b/c142 0 2023-10-08T08:46:00.888 INFO:tasks.workunit.client.0.smithi070.stdout:3/935: mknod d0/d12/d14/d5c/db1/c143 0 2023-10-08T08:46:00.889 INFO:tasks.workunit.client.0.smithi070.stdout:3/936: truncate d0/d12/d14/d5c/db1/dbe/d100/f123 798888 0 2023-10-08T08:46:00.893 INFO:tasks.workunit.client.0.smithi070.stdout:3/937: dread d0/d12/d14/d5c/d5d/da0/d101/f120 [0,4194304] 0 2023-10-08T08:46:00.893 INFO:tasks.workunit.client.0.smithi070.stdout:3/938: fsync d0/db/d10/f1e 0 2023-10-08T08:46:00.893 INFO:tasks.workunit.client.0.smithi070.stdout:6/676: dread df/d26/d42/d43/d4a/d75/f9b [0,4194304] 0 2023-10-08T08:46:00.893 INFO:tasks.workunit.client.0.smithi070.stdout:7/807: dwrite d3/da9/d4a/d9/da4/dd6/fea [0,4194304] 0 2023-10-08T08:46:00.893 INFO:tasks.workunit.client.0.smithi070.stdout:6/677: getdents df/d26/d42/d4b/db6/d7d/dc8 0 2023-10-08T08:46:00.893 INFO:tasks.workunit.client.0.smithi070.stdout:6/678: write df/d26/d42/d43/d4a/f9a [979479,27995] 0 2023-10-08T08:46:00.894 INFO:tasks.workunit.client.0.smithi070.stdout:6/679: dread - df/d26/d42/d4b/db6/fd2 zero size 2023-10-08T08:46:00.894 INFO:tasks.workunit.client.0.smithi070.stdout:3/939: symlink d0/db/d10/d38/d63/d11c/l144 0 2023-10-08T08:46:00.900 INFO:tasks.workunit.client.0.smithi070.stdout:7/808: mkdir d3/d77/d112 0 2023-10-08T08:46:00.900 INFO:tasks.workunit.client.0.smithi070.stdout:6/680: link df/d11/f58 df/d26/d42/d55/fdb 0 2023-10-08T08:46:00.900 INFO:tasks.workunit.client.0.smithi070.stdout:6/681: fsync df/d26/d42/fca 0 2023-10-08T08:46:00.910 INFO:tasks.workunit.client.0.smithi070.stdout:6/682: dread df/f27 [0,4194304] 0 2023-10-08T08:46:00.922 INFO:tasks.workunit.client.0.smithi070.stdout:7/809: dwrite d3/da9/d4a/f108 [0,4194304] 0 2023-10-08T08:46:00.922 INFO:tasks.workunit.client.0.smithi070.stdout:7/810: chown d3/d19/d95/da3/dc8/dfb/d9f/caa 456374 1 2023-10-08T08:46:00.922 INFO:tasks.workunit.client.0.smithi070.stdout:7/811: chown d3/d79/f93 32979342 1 2023-10-08T08:46:00.924 INFO:tasks.workunit.client.0.smithi070.stdout:7/812: unlink d3/d19/d1a/c1f 0 2023-10-08T08:46:00.934 INFO:tasks.workunit.client.0.smithi070.stdout:3/940: dwrite d0/d12/d14/d5c/db1/f10a [0,4194304] 0 2023-10-08T08:46:00.935 INFO:tasks.workunit.client.0.smithi070.stdout:7/813: dread d3/da9/f64 [0,4194304] 0 2023-10-08T08:46:00.936 INFO:tasks.workunit.client.0.smithi070.stdout:6/683: dwrite df/d53/f5e [0,4194304] 0 2023-10-08T08:46:00.936 INFO:tasks.workunit.client.0.smithi070.stdout:3/941: mkdir d0/db/d10/d38/d2f/d145 0 2023-10-08T08:46:00.937 INFO:tasks.workunit.client.0.smithi070.stdout:7/814: mknod d3/d19/c113 0 2023-10-08T08:46:00.938 INFO:tasks.workunit.client.0.smithi070.stdout:6/684: rename df/d26/d42/d43/d4a/d75/d7e/f98 to df/d53/fdc 0 2023-10-08T08:46:00.939 INFO:tasks.workunit.client.0.smithi070.stdout:7/815: mkdir d3/da9/d4a/d9/da4/dd6/ddb/d114 0 2023-10-08T08:46:00.942 INFO:tasks.workunit.client.0.smithi070.stdout:7/816: rmdir d3/d19/d95/da3/dc8/dfb 39 2023-10-08T08:46:00.943 INFO:tasks.workunit.client.0.smithi070.stdout:3/942: rmdir d0/d12 39 2023-10-08T08:46:00.944 INFO:tasks.workunit.client.0.smithi070.stdout:3/943: mkdir d0/d12/d14/d5c/dc4/d146 0 2023-10-08T08:46:00.944 INFO:tasks.workunit.client.0.smithi070.stdout:7/817: creat d3/da9/d1e/f115 x:0 0 0 2023-10-08T08:46:00.945 INFO:tasks.workunit.client.0.smithi070.stdout:7/818: link d3/da9/d4a/f8e d3/da9/d1e/d76/f116 0 2023-10-08T08:46:00.946 INFO:tasks.workunit.client.0.smithi070.stdout:7/819: mkdir d3/d77/d112/d117 0 2023-10-08T08:46:00.947 INFO:tasks.workunit.client.0.smithi070.stdout:7/820: symlink d3/d19/d95/da3/dc8/dfb/d9f/l118 0 2023-10-08T08:46:00.978 INFO:tasks.workunit.client.0.smithi070.stdout:4/693: sync 2023-10-08T08:46:00.978 INFO:tasks.workunit.client.0.smithi070.stdout:9/543: sync 2023-10-08T08:46:00.978 INFO:tasks.workunit.client.0.smithi070.stdout:1/898: sync 2023-10-08T08:46:00.978 INFO:tasks.workunit.client.0.smithi070.stdout:2/893: sync 2023-10-08T08:46:00.979 INFO:tasks.workunit.client.0.smithi070.stdout:1/899: truncate d6/dc/d14/d1f/d63/db3/fe5 591828 0 2023-10-08T08:46:00.979 INFO:tasks.workunit.client.0.smithi070.stdout:9/544: rmdir d1/dd/d19/d99 39 2023-10-08T08:46:00.979 INFO:tasks.workunit.client.0.smithi070.stdout:9/545: stat d1/dd/d26/f8a 0 2023-10-08T08:46:00.980 INFO:tasks.workunit.client.0.smithi070.stdout:2/894: truncate df/d12/d7e/d106/f11c 3433465 0 2023-10-08T08:46:00.981 INFO:tasks.workunit.client.0.smithi070.stdout:4/694: getdents dc/d17 0 2023-10-08T08:46:00.981 INFO:tasks.workunit.client.0.smithi070.stdout:9/546: creat d1/dd/d19/d38/d4f/f9b x:0 0 0 2023-10-08T08:46:00.981 INFO:tasks.workunit.client.0.smithi070.stdout:1/900: mkdir d6/dc/d14/d90/de4/d12a 0 2023-10-08T08:46:00.983 INFO:tasks.workunit.client.0.smithi070.stdout:2/895: symlink df/d12/d7e/l120 0 2023-10-08T08:46:00.983 INFO:tasks.workunit.client.0.smithi070.stdout:9/547: mknod d1/dd/d26/d27/d2d/c9c 0 2023-10-08T08:46:00.983 INFO:tasks.workunit.client.0.smithi070.stdout:9/548: write d1/f55 [534265,29033] 0 2023-10-08T08:46:00.983 INFO:tasks.workunit.client.0.smithi070.stdout:4/695: read dc/d17/f21 [2551464,42130] 0 2023-10-08T08:46:00.984 INFO:tasks.workunit.client.0.smithi070.stdout:1/901: mknod d6/dc/d14/d90/de4/c12b 0 2023-10-08T08:46:00.987 INFO:tasks.workunit.client.0.smithi070.stdout:3/944: dwrite d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/de1/f138 [0,4194304] 0 2023-10-08T08:46:00.988 INFO:tasks.workunit.client.0.smithi070.stdout:6/685: dwrite df/d71/f8c [0,4194304] 0 2023-10-08T08:46:00.988 INFO:tasks.workunit.client.0.smithi070.stdout:6/686: chown df/d11/f65 1009331 1 2023-10-08T08:46:00.990 INFO:tasks.workunit.client.0.smithi070.stdout:3/945: mknod d0/db/d10/d38/d63/d11c/c147 0 2023-10-08T08:46:00.992 INFO:tasks.workunit.client.0.smithi070.stdout:1/902: mknod d6/dc/d14/dc1/dca/d117/c12c 0 2023-10-08T08:46:00.992 INFO:tasks.workunit.client.0.smithi070.stdout:1/903: stat d6/dc/d14/dc1/dca/d117 0 2023-10-08T08:46:00.992 INFO:tasks.workunit.client.0.smithi070.stdout:9/549: dread d1/dd/d19/f1b [0,4194304] 0 2023-10-08T08:46:00.992 INFO:tasks.workunit.client.0.smithi070.stdout:2/896: creat df/d93/dc2/dae/dce/f121 x:0 0 0 2023-10-08T08:46:00.997 INFO:tasks.workunit.client.0.smithi070.stdout:6/687: creat df/d26/d78/dd5/fdd x:0 0 0 2023-10-08T08:46:00.997 INFO:tasks.workunit.client.0.smithi070.stdout:1/904: truncate d6/dc/d14/dc1/dca/d117/f2f 1208257 0 2023-10-08T08:46:00.998 INFO:tasks.workunit.client.0.smithi070.stdout:6/688: mkdir df/d26/d42/d43/d4a/dde 0 2023-10-08T08:46:01.002 INFO:tasks.workunit.client.0.smithi070.stdout:1/905: creat d6/dc/d14/d1f/d63/db3/d123/f12d x:0 0 0 2023-10-08T08:46:01.002 INFO:tasks.workunit.client.0.smithi070.stdout:1/906: dread - d6/dc/d14/dc1/dca/d117/f5a zero size 2023-10-08T08:46:01.005 INFO:tasks.workunit.client.0.smithi070.stdout:6/689: link df/d26/d78/d90/daa/lbf df/d26/d42/d4b/d80/d94/dd0/ldf 0 2023-10-08T08:46:01.005 INFO:tasks.workunit.client.0.smithi070.stdout:9/550: dread d1/dd/d19/d38/f71 [0,4194304] 0 2023-10-08T08:46:01.005 INFO:tasks.workunit.client.0.smithi070.stdout:9/551: chown d1/f2a 1307 1 2023-10-08T08:46:01.007 INFO:tasks.workunit.client.0.smithi070.stdout:1/907: creat d6/dc/d14/dc1/dca/d117/d7e/f12e x:0 0 0 2023-10-08T08:46:01.007 INFO:tasks.workunit.client.0.smithi070.stdout:9/552: mknod d1/dd/d1a/d81/c9d 0 2023-10-08T08:46:01.007 INFO:tasks.workunit.client.0.smithi070.stdout:4/696: dwrite dc/d17/d24/d4c/fc6 [0,4194304] 0 2023-10-08T08:46:01.010 INFO:tasks.workunit.client.0.smithi070.stdout:4/697: symlink dc/d17/d79/dad/db6/dc1/le4 0 2023-10-08T08:46:01.010 INFO:tasks.workunit.client.0.smithi070.stdout:4/698: dread - dc/d17/d24/d4c/d4e/faa zero size 2023-10-08T08:46:01.010 INFO:tasks.workunit.client.0.smithi070.stdout:6/690: unlink df/d26/f30 0 2023-10-08T08:46:01.011 INFO:tasks.workunit.client.0.smithi070.stdout:9/553: link d1/dd/d19/d38/f3c d1/dd/d26/d27/d2d/d70/d90/f9e 0 2023-10-08T08:46:01.011 INFO:tasks.workunit.client.0.smithi070.stdout:9/554: dread - d1/dd/d39/d6f/d88/f95 zero size 2023-10-08T08:46:01.012 INFO:tasks.workunit.client.0.smithi070.stdout:1/908: mkdir d6/dc/d14/dc1/dca/d117/da1/ddb/d12f 0 2023-10-08T08:46:01.012 INFO:tasks.workunit.client.0.smithi070.stdout:1/909: truncate d6/dc/d14/d70/fa6 4810001 0 2023-10-08T08:46:01.014 INFO:tasks.workunit.client.0.smithi070.stdout:1/910: symlink d6/dc/d14/d1f/d118/l130 0 2023-10-08T08:46:01.016 INFO:tasks.workunit.client.0.smithi070.stdout:6/691: mkdir df/d26/d78/dd5/de0 0 2023-10-08T08:46:01.016 INFO:tasks.workunit.client.0.smithi070.stdout:6/692: write df/d26/d42/d4b/db6/d7d/fb2 [37120,120944] 0 2023-10-08T08:46:01.016 INFO:tasks.workunit.client.0.smithi070.stdout:6/693: write df/d11/f41 [165201,22242] 0 2023-10-08T08:46:01.016 INFO:tasks.workunit.client.0.smithi070.stdout:6/694: chown df/fbd 194868173 1 2023-10-08T08:46:01.016 INFO:tasks.workunit.client.0.smithi070.stdout:6/695: stat df 0 2023-10-08T08:46:01.016 INFO:tasks.workunit.client.0.smithi070.stdout:4/699: creat dc/d17/d1f/d5e/d9f/fe5 x:0 0 0 2023-10-08T08:46:01.016 INFO:tasks.workunit.client.0.smithi070.stdout:9/555: rename d1/dd/d19/d38/d4f/f59 to d1/dd/d39/f9f 0 2023-10-08T08:46:01.025 INFO:tasks.workunit.client.0.smithi070.stdout:2/897: dwrite fb [0,4194304] 0 2023-10-08T08:46:01.028 INFO:tasks.workunit.client.0.smithi070.stdout:2/898: rename df/d12/d1b/d1c/d69/d100/f3e to df/d12/d1b/d82/f122 0 2023-10-08T08:46:01.028 INFO:tasks.workunit.client.0.smithi070.stdout:2/899: chown df/d4c/da9/laf 482771 1 2023-10-08T08:46:01.029 INFO:tasks.workunit.client.0.smithi070.stdout:3/946: dwrite d0/d12/d14/d5c/d5d/da0/f88 [0,4194304] 0 2023-10-08T08:46:01.029 INFO:tasks.workunit.client.0.smithi070.stdout:9/556: dread d1/dd/d26/d27/d2d/d70/f86 [0,4194304] 0 2023-10-08T08:46:01.029 INFO:tasks.workunit.client.0.smithi070.stdout:3/947: chown d0/db/d10/c1b 102129 1 2023-10-08T08:46:01.029 INFO:tasks.workunit.client.0.smithi070.stdout:3/948: stat d0/d12/d14/d5c/d5d/da0/l79 0 2023-10-08T08:46:01.029 INFO:tasks.workunit.client.0.smithi070.stdout:2/900: mkdir df/d93/d123 0 2023-10-08T08:46:01.032 INFO:tasks.workunit.client.0.smithi070.stdout:3/949: creat d0/d12/d14/d5c/d5d/da0/dd8/f148 x:0 0 0 2023-10-08T08:46:01.037 INFO:tasks.workunit.client.0.smithi070.stdout:9/557: write d1/dd/d19/f67 [444252,131061] 0 2023-10-08T08:46:01.038 INFO:tasks.workunit.client.0.smithi070.stdout:9/558: chown d1/dd/f18 52285996 1 2023-10-08T08:46:01.038 INFO:tasks.workunit.client.0.smithi070.stdout:9/559: fdatasync d1/dd/f11 0 2023-10-08T08:46:01.038 INFO:tasks.workunit.client.0.smithi070.stdout:9/560: chown d1/dd/lf 977088 1 2023-10-08T08:46:01.038 INFO:tasks.workunit.client.0.smithi070.stdout:2/901: symlink df/d12/d1b/dd9/l124 0 2023-10-08T08:46:01.040 INFO:tasks.workunit.client.0.smithi070.stdout:9/561: creat d1/dd/d39/d6f/d88/fa0 x:0 0 0 2023-10-08T08:46:01.042 INFO:tasks.workunit.client.0.smithi070.stdout:1/911: dwrite d6/dc/d14/d1f/f9c [0,4194304] 0 2023-10-08T08:46:01.042 INFO:tasks.workunit.client.0.smithi070.stdout:9/562: link d1/dd/d26/d27/f60 d1/dd/d1a/d40/d76/d93/fa1 0 2023-10-08T08:46:01.042 INFO:tasks.workunit.client.0.smithi070.stdout:9/563: chown d1/f25 9792 1 2023-10-08T08:46:01.043 INFO:tasks.workunit.client.0.smithi070.stdout:4/700: dwrite dc/d17/d1f/d54/f67 [0,4194304] 0 2023-10-08T08:46:01.043 INFO:tasks.workunit.client.0.smithi070.stdout:9/564: dread d1/dd/d1a/d40/d76/d93/fa1 [0,4194304] 0 2023-10-08T08:46:01.044 INFO:tasks.workunit.client.0.smithi070.stdout:1/912: write d6/f1b [1987093,92054] 0 2023-10-08T08:46:01.045 INFO:tasks.workunit.client.0.smithi070.stdout:6/696: dwrite df/d26/d42/d4b/fa1 [4194304,4194304] 0 2023-10-08T08:46:01.046 INFO:tasks.workunit.client.0.smithi070.stdout:9/565: mknod d1/dd/d26/ca2 0 2023-10-08T08:46:01.049 INFO:tasks.workunit.client.0.smithi070.stdout:9/566: unlink d1/dd/d19/d99/c50 0 2023-10-08T08:46:01.050 INFO:tasks.workunit.client.0.smithi070.stdout:1/913: mkdir d6/dc/d14/d62/d131 0 2023-10-08T08:46:01.050 INFO:tasks.workunit.client.0.smithi070.stdout:9/567: symlink d1/dd/d39/la3 0 2023-10-08T08:46:01.054 INFO:tasks.workunit.client.0.smithi070.stdout:6/697: symlink df/d26/d42/d4b/dba/le1 0 2023-10-08T08:46:01.054 INFO:tasks.workunit.client.0.smithi070.stdout:6/698: dread - df/d26/d42/d43/d4a/d75/d7e/fa3 zero size 2023-10-08T08:46:01.054 INFO:tasks.workunit.client.0.smithi070.stdout:9/568: mkdir d1/dd/d39/da4 0 2023-10-08T08:46:01.055 INFO:tasks.workunit.client.0.smithi070.stdout:9/569: mknod d1/dd/d19/d38/ca5 0 2023-10-08T08:46:01.055 INFO:tasks.workunit.client.0.smithi070.stdout:1/914: link d6/dc/d14/d1f/d63/db3/l10e d6/dc/d14/dc1/dca/d117/d88/l132 0 2023-10-08T08:46:01.058 INFO:tasks.workunit.client.0.smithi070.stdout:9/570: write d1/f25 [4788938,127947] 0 2023-10-08T08:46:01.058 INFO:tasks.workunit.client.0.smithi070.stdout:9/571: fsync d1/dd/d26/d7b/f7d 0 2023-10-08T08:46:01.058 INFO:tasks.workunit.client.0.smithi070.stdout:6/699: truncate df/d26/d78/d90/fb7 225152 0 2023-10-08T08:46:01.059 INFO:tasks.workunit.client.0.smithi070.stdout:2/902: dwrite df/d4c/f6d [0,4194304] 0 2023-10-08T08:46:01.060 INFO:tasks.workunit.client.0.smithi070.stdout:2/903: dread df/d12/d1b/d1c/d69/d100/d83/d92/d102/f10f [0,4194304] 0 2023-10-08T08:46:01.064 INFO:tasks.workunit.client.0.smithi070.stdout:1/915: link d6/dc/d14/dc1/dca/d117/d7e/dc2/fe3 d6/dc/d14/d1f/d63/db3/d38/d4b/f133 0 2023-10-08T08:46:01.064 INFO:tasks.workunit.client.0.smithi070.stdout:1/916: fsync d6/dc/d14/d1f/f25 0 2023-10-08T08:46:01.064 INFO:tasks.workunit.client.0.smithi070.stdout:3/950: dwrite d0/db/d10/d38/d2f/f66 [4194304,4194304] 0 2023-10-08T08:46:01.067 INFO:tasks.workunit.client.0.smithi070.stdout:3/951: mknod d0/d12/d14/d5c/d5d/da0/d101/d52/db5/dcb/c149 0 2023-10-08T08:46:01.067 INFO:tasks.workunit.client.0.smithi070.stdout:3/952: chown d0/d12/d14/d5c/db1 76844 1 2023-10-08T08:46:01.067 INFO:tasks.workunit.client.0.smithi070.stdout:3/953: chown d0/d12/d14/d5c/dc4/ce9 3 1 2023-10-08T08:46:01.067 INFO:tasks.workunit.client.0.smithi070.stdout:6/700: rmdir df/d26/d78 39 2023-10-08T08:46:01.067 INFO:tasks.workunit.client.0.smithi070.stdout:6/701: read - df/f61 zero size 2023-10-08T08:46:01.077 INFO:tasks.workunit.client.0.smithi070.stdout:6/702: rmdir df/d26/d78/dd5 39 2023-10-08T08:46:01.077 INFO:tasks.workunit.client.0.smithi070.stdout:6/703: chown df/d26/d42/d4b/dba/fd3 0 1 2023-10-08T08:46:01.080 INFO:tasks.workunit.client.0.smithi070.stdout:9/572: dwrite d1/dd/d39/d6f/d88/f95 [0,4194304] 0 2023-10-08T08:46:01.083 INFO:tasks.workunit.client.0.smithi070.stdout:6/704: mknod df/d26/d42/d4b/ce2 0 2023-10-08T08:46:01.085 INFO:tasks.workunit.client.0.smithi070.stdout:8/831: sync 2023-10-08T08:46:01.085 INFO:tasks.workunit.client.0.smithi070.stdout:5/780: sync 2023-10-08T08:46:01.085 INFO:tasks.workunit.client.0.smithi070.stdout:7/821: sync 2023-10-08T08:46:01.085 INFO:tasks.workunit.client.0.smithi070.stdout:0/906: sync 2023-10-08T08:46:01.085 INFO:tasks.workunit.client.0.smithi070.stdout:8/832: chown d1/d2/d6/d22/d5b/d74/de1/d3a 1236323 1 2023-10-08T08:46:01.085 INFO:tasks.workunit.client.0.smithi070.stdout:5/781: fsync d5/da/d22/ddd/d38/fcd 0 2023-10-08T08:46:01.085 INFO:tasks.workunit.client.0.smithi070.stdout:7/822: dread - d3/da9/d1e/fe0 zero size 2023-10-08T08:46:01.085 INFO:tasks.workunit.client.0.smithi070.stdout:8/833: chown d1/d2/d6/d22/d5b/d74/de1/d21/f101 134780204 1 2023-10-08T08:46:01.086 INFO:tasks.workunit.client.0.smithi070.stdout:0/907: write d1/d62/d54/d5e/d80/d8a/fd1 [819963,117541] 0 2023-10-08T08:46:01.086 INFO:tasks.workunit.client.0.smithi070.stdout:6/705: mkdir df/d26/d42/d43/d4a/d97/de3 0 2023-10-08T08:46:01.086 INFO:tasks.workunit.client.0.smithi070.stdout:6/706: truncate df/f27 1840721 0 2023-10-08T08:46:01.088 INFO:tasks.workunit.client.0.smithi070.stdout:5/782: mkdir d5/d5f/d63/d8b/d109 0 2023-10-08T08:46:01.090 INFO:tasks.workunit.client.0.smithi070.stdout:6/707: mkdir df/d26/d42/d43/d4a/d75/d7e/de4 0 2023-10-08T08:46:01.090 INFO:tasks.workunit.client.0.smithi070.stdout:9/573: link d1/dd/d39/la3 d1/dd/d1a/d40/la6 0 2023-10-08T08:46:01.091 INFO:tasks.workunit.client.0.smithi070.stdout:9/574: fsync d1/dd/d1a/f1c 0 2023-10-08T08:46:01.092 INFO:tasks.workunit.client.0.smithi070.stdout:5/783: getdents d5/da/d22/d75 0 2023-10-08T08:46:01.093 INFO:tasks.workunit.client.0.smithi070.stdout:9/575: symlink d1/dd/d26/la7 0 2023-10-08T08:46:01.093 INFO:tasks.workunit.client.0.smithi070.stdout:2/904: dwrite df/d12/d1b/d1c/f5d [0,4194304] 0 2023-10-08T08:46:01.094 INFO:tasks.workunit.client.0.smithi070.stdout:2/905: readlink df/d12/d1b/d1c/d69/d100/d83/lbf 0 2023-10-08T08:46:01.094 INFO:tasks.workunit.client.0.smithi070.stdout:3/954: rename d0/d12/d14/d5c/d5d/da0/d101 to d0/d12/d14/d5c/db1/dbe/d14a 0 2023-10-08T08:46:01.094 INFO:tasks.workunit.client.0.smithi070.stdout:6/708: mknod df/d26/d42/d55/ce5 0 2023-10-08T08:46:01.095 INFO:tasks.workunit.client.0.smithi070.stdout:6/709: chown df/d26/d42/d55/ce5 902349942 1 2023-10-08T08:46:01.095 INFO:tasks.workunit.client.0.smithi070.stdout:6/710: chown df/d26/d42/db1/f3c 3 1 2023-10-08T08:46:01.095 INFO:tasks.workunit.client.0.smithi070.stdout:3/955: symlink d0/d12/d14/d5c/db1/dbe/d14a/d52/db5/dcb/d129/l14b 0 2023-10-08T08:46:01.099 INFO:tasks.workunit.client.0.smithi070.stdout:8/834: dread d1/d23/f28 [0,4194304] 0 2023-10-08T08:46:01.104 INFO:tasks.workunit.client.0.smithi070.stdout:8/835: rmdir d1/d2/d6/d22/d5b/d74/de1/d2e/d105 0 2023-10-08T08:46:01.104 INFO:tasks.workunit.client.0.smithi070.stdout:8/836: chown d1/d2/d6/d22/d5b/d74/de1/d3a/df3 81106 1 2023-10-08T08:46:01.106 INFO:tasks.workunit.client.0.smithi070.stdout:8/837: rename d1/d4d/c104 to d1/d4d/c118 0 2023-10-08T08:46:01.108 INFO:tasks.workunit.client.0.smithi070.stdout:8/838: link d1/d2/d6/d22/d5b/d74/de1/d3a/c94 d1/d2/d8c/c119 0 2023-10-08T08:46:01.116 INFO:tasks.workunit.client.0.smithi070.stdout:7/823: dwrite d3/da9/d1e/d76/fb7 [0,4194304] 0 2023-10-08T08:46:01.117 INFO:tasks.workunit.client.0.smithi070.stdout:8/839: rename d1/d23 to d1/d2/d6/d22/d5b/d74/de1/d2e/d11a 0 2023-10-08T08:46:01.119 INFO:tasks.workunit.client.0.smithi070.stdout:5/784: dread d5/da/d22/ddd/d38/f106 [0,4194304] 0 2023-10-08T08:46:01.120 INFO:tasks.workunit.client.0.smithi070.stdout:2/906: write df/d12/d1b/d1c/f64 [2984211,74098] 0 2023-10-08T08:46:01.120 INFO:tasks.workunit.client.0.smithi070.stdout:2/907: chown df/d12/c9a 1293975364 1 2023-10-08T08:46:01.122 INFO:tasks.workunit.client.0.smithi070.stdout:9/576: dwrite d1/dd/d1a/d40/d76/d93/fa1 [0,4194304] 0 2023-10-08T08:46:01.123 INFO:tasks.workunit.client.0.smithi070.stdout:2/908: truncate df/d12/d1b/d1c/d69/d100/d83/d92/ffe 959782 0 2023-10-08T08:46:01.123 INFO:tasks.workunit.client.0.smithi070.stdout:2/909: stat df/d4c/f68 0 2023-10-08T08:46:01.124 INFO:tasks.workunit.client.0.smithi070.stdout:0/908: dwrite d1/d1d/d4d/d9d/fa1 [0,4194304] 0 2023-10-08T08:46:01.124 INFO:tasks.workunit.client.0.smithi070.stdout:3/956: dread d0/d12/d14/ff5 [0,4194304] 0 2023-10-08T08:46:01.124 INFO:tasks.workunit.client.0.smithi070.stdout:3/957: fdatasync d0/d12/d14/d48/d113/f3a 0 2023-10-08T08:46:01.124 INFO:tasks.workunit.client.0.smithi070.stdout:3/958: fdatasync d0/d12/d14/d48/f84 0 2023-10-08T08:46:01.125 INFO:tasks.workunit.client.0.smithi070.stdout:6/711: dread f2 [0,4194304] 0 2023-10-08T08:46:01.126 INFO:tasks.workunit.client.0.smithi070.stdout:2/910: unlink df/d3a/db6/lf6 0 2023-10-08T08:46:01.137 INFO:tasks.workunit.client.0.smithi070.stdout:7/824: dread d3/d19/d95/da3/dc8/dfb/f66 [0,4194304] 0 2023-10-08T08:46:01.140 INFO:tasks.workunit.client.0.smithi070.stdout:7/825: mknod d3/d19/d95/dfe/c119 0 2023-10-08T08:46:01.142 INFO:tasks.workunit.client.0.smithi070.stdout:7/826: getdents d3 0 2023-10-08T08:46:01.142 INFO:tasks.workunit.client.0.smithi070.stdout:7/827: chown d3/d19/d1a/l4d 463022 1 2023-10-08T08:46:01.143 INFO:tasks.workunit.client.0.smithi070.stdout:7/828: rmdir d3/d19/d95/dad 39 2023-10-08T08:46:01.149 INFO:tasks.workunit.client.0.smithi070.stdout:9/577: write d1/dd/d1a/f1c [2108361,64933] 0 2023-10-08T08:46:01.152 INFO:tasks.workunit.client.0.smithi070.stdout:0/909: dwrite d1/d1d/d4d/f5c [0,4194304] 0 2023-10-08T08:46:01.155 INFO:tasks.workunit.client.0.smithi070.stdout:9/578: symlink d1/dd/d26/d27/d2d/la8 0 2023-10-08T08:46:01.155 INFO:tasks.workunit.client.0.smithi070.stdout:9/579: truncate d1/dd/d26/f54 759585 0 2023-10-08T08:46:01.156 INFO:tasks.workunit.client.0.smithi070.stdout:0/910: mkdir d1/d76/d7a/d11f 0 2023-10-08T08:46:01.156 INFO:tasks.workunit.client.0.smithi070.stdout:7/829: dread d3/da9/d4a/d9/d97/f9b [0,4194304] 0 2023-10-08T08:46:01.156 INFO:tasks.workunit.client.0.smithi070.stdout:6/712: dwrite df/f10 [0,4194304] 0 2023-10-08T08:46:01.157 INFO:tasks.workunit.client.0.smithi070.stdout:0/911: creat d1/d1d/f120 x:0 0 0 2023-10-08T08:46:01.157 INFO:tasks.workunit.client.0.smithi070.stdout:0/912: fsync d1/f5 0 2023-10-08T08:46:01.158 INFO:tasks.workunit.client.0.smithi070.stdout:9/580: rename d1/dd/f11 to d1/dd/d19/d38/d4f/fa9 0 2023-10-08T08:46:01.160 INFO:tasks.workunit.client.0.smithi070.stdout:8/840: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/fc8 [0,4194304] 0 2023-10-08T08:46:01.161 INFO:tasks.workunit.client.0.smithi070.stdout:2/911: dwrite df/d3a/db6/dde/fee [0,4194304] 0 2023-10-08T08:46:01.162 INFO:tasks.workunit.client.0.smithi070.stdout:8/841: mkdir d1/d2/d6/d22/d5c/d99/d11b 0 2023-10-08T08:46:01.162 INFO:tasks.workunit.client.0.smithi070.stdout:8/842: chown d1/d2/d6/d22/d5b/d74/de1/d21/fce 18956 1 2023-10-08T08:46:01.162 INFO:tasks.workunit.client.0.smithi070.stdout:9/581: read d1/dd/d19/d38/f42 [3887733,65185] 0 2023-10-08T08:46:01.163 INFO:tasks.workunit.client.0.smithi070.stdout:6/713: read df/f17 [404423,45949] 0 2023-10-08T08:46:01.164 INFO:tasks.workunit.client.0.smithi070.stdout:9/582: symlink d1/dd/d19/d38/laa 0 2023-10-08T08:46:01.164 INFO:tasks.workunit.client.0.smithi070.stdout:8/843: symlink d1/d2/d6/d22/d9e/da7/dbe/l11c 0 2023-10-08T08:46:01.164 INFO:tasks.workunit.client.0.smithi070.stdout:8/844: chown d1/d2/d6/d22/d5b/fcf 148 1 2023-10-08T08:46:01.164 INFO:tasks.workunit.client.0.smithi070.stdout:8/845: dread - d1/d2/f117 zero size 2023-10-08T08:46:01.165 INFO:tasks.workunit.client.0.smithi070.stdout:6/714: creat df/d11/fe6 x:0 0 0 2023-10-08T08:46:01.165 INFO:tasks.workunit.client.0.smithi070.stdout:6/715: chown df/d53/f5e 725 1 2023-10-08T08:46:01.165 INFO:tasks.workunit.client.0.smithi070.stdout:6/716: readlink df/d11/l14 0 2023-10-08T08:46:01.166 INFO:tasks.workunit.client.0.smithi070.stdout:9/583: mkdir d1/dd/d26/d27/d2d/d70/d90/dab 0 2023-10-08T08:46:01.166 INFO:tasks.workunit.client.0.smithi070.stdout:8/846: mkdir d1/d2/d6/d22/d9e/d11d 0 2023-10-08T08:46:01.166 INFO:tasks.workunit.client.0.smithi070.stdout:6/717: creat df/d71/fe7 x:0 0 0 2023-10-08T08:46:01.167 INFO:tasks.workunit.client.0.smithi070.stdout:8/847: rmdir d1/d2/d6/d22/d5b/d74/de1/d3a/d92 39 2023-10-08T08:46:01.175 INFO:tasks.workunit.client.0.smithi070.stdout:6/718: mkdir df/d26/d42/d43/d4a/d97/de8 0 2023-10-08T08:46:01.178 INFO:tasks.workunit.client.0.smithi070.stdout:6/719: symlink df/d26/d42/d4b/d80/le9 0 2023-10-08T08:46:01.178 INFO:tasks.workunit.client.0.smithi070.stdout:9/584: dread d1/dd/d1a/f1c [0,4194304] 0 2023-10-08T08:46:01.178 INFO:tasks.workunit.client.0.smithi070.stdout:6/720: write df/d26/f84 [265990,130345] 0 2023-10-08T08:46:01.221 INFO:tasks.workunit.client.0.smithi070.stdout:0/913: dwrite d1/d62/f55 [0,4194304] 0 2023-10-08T08:46:01.224 INFO:tasks.workunit.client.0.smithi070.stdout:8/848: write d1/d2/d6/d22/d5b/d74/de1/f64 [183600,39960] 0 2023-10-08T08:46:01.224 INFO:tasks.workunit.client.0.smithi070.stdout:8/849: chown d1/d2/d6/d22/d5b/d74/cda 1 1 2023-10-08T08:46:01.226 INFO:tasks.workunit.client.0.smithi070.stdout:0/914: write d1/d1d/d24/fb7 [208659,6805] 0 2023-10-08T08:46:01.226 INFO:tasks.workunit.client.0.smithi070.stdout:8/850: rename d1/d2/d6/d22/d5b/d74/de1/d2e/c9a to d1/d2/d6/d22/d5b/d74/de1/d2e/d11a/df4/c11e 0 2023-10-08T08:46:01.228 INFO:tasks.workunit.client.0.smithi070.stdout:0/915: mknod d1/d62/d54/d5e/d80/d8a/dec/c121 0 2023-10-08T08:46:01.230 INFO:tasks.workunit.client.0.smithi070.stdout:5/785: dread d5/da/f15 [0,4194304] 0 2023-10-08T08:46:01.231 INFO:tasks.workunit.client.0.smithi070.stdout:8/851: dread d1/d2/d6/d22/d5b/d74/de1/d15/f20 [0,4194304] 0 2023-10-08T08:46:01.233 INFO:tasks.workunit.client.0.smithi070.stdout:8/852: unlink d1/d2/lc5 0 2023-10-08T08:46:01.234 INFO:tasks.workunit.client.0.smithi070.stdout:8/853: chown d1/d2/f117 15602728 1 2023-10-08T08:46:01.234 INFO:tasks.workunit.client.0.smithi070.stdout:5/786: rmdir d5/da/d22/d75 39 2023-10-08T08:46:01.234 INFO:tasks.workunit.client.0.smithi070.stdout:8/854: symlink d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/l11f 0 2023-10-08T08:46:01.235 INFO:tasks.workunit.client.0.smithi070.stdout:5/787: creat d5/d5f/d61/d30/d54/d62/dae/f10a x:0 0 0 2023-10-08T08:46:01.253 INFO:tasks.workunit.client.0.smithi070.stdout:5/788: dwrite d5/d5f/d63/d8b/da8/dac/f100 [0,4194304] 0 2023-10-08T08:46:01.264 INFO:tasks.workunit.client.0.smithi070.stdout:9/585: dwrite d1/dd/d19/d38/f3c [4194304,4194304] 0 2023-10-08T08:46:01.267 INFO:tasks.workunit.client.0.smithi070.stdout:5/789: dread d5/f101 [0,4194304] 0 2023-10-08T08:46:01.267 INFO:tasks.workunit.client.0.smithi070.stdout:9/586: rename d1/dd/d26/d27/c33 to d1/dd/d19/d38/cac 0 2023-10-08T08:46:01.269 INFO:tasks.workunit.client.0.smithi070.stdout:5/790: getdents d5/d5f/d61/d30/d54/d62/dae 0 2023-10-08T08:46:01.269 INFO:tasks.workunit.client.0.smithi070.stdout:5/791: chown d5/d5f/d61/c99 28297 1 2023-10-08T08:46:01.270 INFO:tasks.workunit.client.0.smithi070.stdout:5/792: chown d5/d5f/d63/la0 2 1 2023-10-08T08:46:01.270 INFO:tasks.workunit.client.0.smithi070.stdout:4/701: sync 2023-10-08T08:46:01.272 INFO:tasks.workunit.client.0.smithi070.stdout:5/793: rename d5/da/d22/ddd/d38/f106 to d5/d5f/d61/d30/d54/f10b 0 2023-10-08T08:46:01.272 INFO:tasks.workunit.client.0.smithi070.stdout:5/794: chown d5/da 341911 1 2023-10-08T08:46:01.275 INFO:tasks.workunit.client.0.smithi070.stdout:5/795: rename d5/d5f/fc9 to d5/d5f/d61/d30/d83/f10c 0 2023-10-08T08:46:01.277 INFO:tasks.workunit.client.0.smithi070.stdout:5/796: write d5/da/d4d/f8e [1128695,35671] 0 2023-10-08T08:46:01.277 INFO:tasks.workunit.client.0.smithi070.stdout:5/797: truncate d5/da/f68 826948 0 2023-10-08T08:46:01.277 INFO:tasks.workunit.client.0.smithi070.stdout:5/798: truncate d5/d5f/d61/d30/d54/d62/dae/fb0 820152 0 2023-10-08T08:46:01.277 INFO:tasks.workunit.client.0.smithi070.stdout:5/799: stat d5/da/d4d/l49 0 2023-10-08T08:46:01.278 INFO:tasks.workunit.client.0.smithi070.stdout:5/800: write d5/d5f/d61/f60 [5798995,56239] 0 2023-10-08T08:46:01.287 INFO:tasks.workunit.client.0.smithi070.stdout:9/587: dwrite d1/dd/d1a/d40/d76/f8c [0,4194304] 0 2023-10-08T08:46:01.290 INFO:tasks.workunit.client.0.smithi070.stdout:9/588: creat d1/dd/d8d/fad x:0 0 0 2023-10-08T08:46:01.292 INFO:tasks.workunit.client.0.smithi070.stdout:9/589: creat d1/dd/d1a/fae x:0 0 0 2023-10-08T08:46:01.292 INFO:tasks.workunit.client.0.smithi070.stdout:5/801: dread d5/f101 [0,4194304] 0 2023-10-08T08:46:01.297 INFO:tasks.workunit.client.0.smithi070.stdout:5/802: rename d5/da/d4d/fad to d5/da/d4d/dc2/f10d 0 2023-10-08T08:46:01.298 INFO:tasks.workunit.client.0.smithi070.stdout:5/803: chown d5/da/d22/ddd/d2a/f95 1321557 1 2023-10-08T08:46:01.298 INFO:tasks.workunit.client.0.smithi070.stdout:5/804: creat d5/da/d4d/dfb/f10e x:0 0 0 2023-10-08T08:46:01.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/590: dwrite d1/fb [0,4194304] 0 2023-10-08T08:46:01.370 INFO:tasks.workunit.client.0.smithi070.stdout:9/591: dread d1/f2a [0,4194304] 0 2023-10-08T08:46:01.371 INFO:tasks.workunit.client.0.smithi070.stdout:9/592: stat d1/dd/d1a/d81/c9d 0 2023-10-08T08:46:01.371 INFO:tasks.workunit.client.0.smithi070.stdout:9/593: dread - d1/dd/d39/d66/f6d zero size 2023-10-08T08:46:01.391 INFO:tasks.workunit.client.0.smithi070.stdout:5/805: dread d5/d5f/d61/f60 [4194304,4194304] 0 2023-10-08T08:46:01.405 INFO:tasks.workunit.client.0.smithi070.stdout:9/594: dwrite d1/dd/f10 [0,4194304] 0 2023-10-08T08:46:01.406 INFO:tasks.workunit.client.0.smithi070.stdout:9/595: mknod d1/dd/d39/d66/d82/caf 0 2023-10-08T08:46:01.406 INFO:tasks.workunit.client.0.smithi070.stdout:9/596: fdatasync d1/f8b 0 2023-10-08T08:46:01.407 INFO:tasks.workunit.client.0.smithi070.stdout:9/597: chown d1/dd/d1a/c21 406 1 2023-10-08T08:46:01.407 INFO:tasks.workunit.client.0.smithi070.stdout:9/598: creat d1/dd/d26/d27/d2d/fb0 x:0 0 0 2023-10-08T08:46:01.408 INFO:tasks.workunit.client.0.smithi070.stdout:9/599: rmdir d1/dd/d26/d27/d2d/d70/d90 39 2023-10-08T08:46:01.408 INFO:tasks.workunit.client.0.smithi070.stdout:9/600: fsync d1/f4b 0 2023-10-08T08:46:01.409 INFO:tasks.workunit.client.0.smithi070.stdout:9/601: mknod d1/dd/d1a/cb1 0 2023-10-08T08:46:01.410 INFO:tasks.workunit.client.0.smithi070.stdout:9/602: symlink d1/dd/d26/d27/d2d/lb2 0 2023-10-08T08:46:01.410 INFO:tasks.workunit.client.0.smithi070.stdout:9/603: read - d1/dd/d19/d38/d4f/f9b zero size 2023-10-08T08:46:01.411 INFO:tasks.workunit.client.0.smithi070.stdout:9/604: stat d1/dd/lf 0 2023-10-08T08:46:01.411 INFO:tasks.workunit.client.0.smithi070.stdout:9/605: stat d1/dd/d19/d38/d77 0 2023-10-08T08:46:01.411 INFO:tasks.workunit.client.0.smithi070.stdout:9/606: fdatasync d1/dd/d26/d7b/f7d 0 2023-10-08T08:46:01.414 INFO:tasks.workunit.client.0.smithi070.stdout:9/607: dread d1/f55 [0,4194304] 0 2023-10-08T08:46:01.415 INFO:tasks.workunit.client.0.smithi070.stdout:9/608: mkdir d1/dd/d8d/db3 0 2023-10-08T08:46:01.422 INFO:tasks.workunit.client.0.smithi070.stdout:5/806: mknod d5/d5f/d63/dca/c10f 0 2023-10-08T08:46:01.422 INFO:tasks.workunit.client.0.smithi070.stdout:5/807: chown d5/d5f/d61/d30/d54/f7b 1382 1 2023-10-08T08:46:01.433 INFO:tasks.workunit.client.0.smithi070.stdout:9/609: dread d1/dd/d1a/f1c [0,4194304] 0 2023-10-08T08:46:01.437 INFO:tasks.workunit.client.0.smithi070.stdout:9/610: rename d1/dd/l22 to d1/dd/d39/da4/lb4 0 2023-10-08T08:46:01.441 INFO:tasks.workunit.client.0.smithi070.stdout:9/611: write d1/dd/d19/d38/f78 [215812,111479] 0 2023-10-08T08:46:01.443 INFO:tasks.workunit.client.0.smithi070.stdout:9/612: truncate d1/f2a 976943 0 2023-10-08T08:46:01.444 INFO:tasks.workunit.client.0.smithi070.stdout:5/808: dwrite d5/da/d4d/f8e [0,4194304] 0 2023-10-08T08:46:01.448 INFO:tasks.workunit.client.0.smithi070.stdout:9/613: rename d1/dd/lf to d1/dd/d26/d27/lb5 0 2023-10-08T08:46:01.449 INFO:tasks.workunit.client.0.smithi070.stdout:9/614: creat d1/dd/d26/d27/d2d/d70/d90/dab/fb6 x:0 0 0 2023-10-08T08:46:01.449 INFO:tasks.workunit.client.0.smithi070.stdout:9/615: readlink d1/l1f 0 2023-10-08T08:46:01.453 INFO:tasks.workunit.client.0.smithi070.stdout:9/616: creat d1/dd/d1a/d40/d76/fb7 x:0 0 0 2023-10-08T08:46:01.457 INFO:tasks.workunit.client.0.smithi070.stdout:9/617: symlink d1/dd/d26/d27/lb8 0 2023-10-08T08:46:01.466 INFO:tasks.workunit.client.0.smithi070.stdout:3/959: sync 2023-10-08T08:46:01.466 INFO:tasks.workunit.client.0.smithi070.stdout:1/917: sync 2023-10-08T08:46:01.466 INFO:tasks.workunit.client.0.smithi070.stdout:1/918: stat d6/dc/d14/fa0 0 2023-10-08T08:46:01.467 INFO:tasks.workunit.client.0.smithi070.stdout:1/919: mknod d6/dc/d14/d90/de4/d12a/c134 0 2023-10-08T08:46:01.468 INFO:tasks.workunit.client.0.smithi070.stdout:5/809: dwrite d5/da/d22/f52 [0,4194304] 0 2023-10-08T08:46:01.468 INFO:tasks.workunit.client.0.smithi070.stdout:5/810: readlink d5/da/d22/ddd/d38/d55/ddf/lee 0 2023-10-08T08:46:01.469 INFO:tasks.workunit.client.0.smithi070.stdout:3/960: rename d0/d12/d14/d5c/db1/dbe/d14a/d52/l114 to d0/d12/d14/d5c/db1/dbe/d14a/d52/db5/dcb/de1/l14c 0 2023-10-08T08:46:01.469 INFO:tasks.workunit.client.0.smithi070.stdout:3/961: chown d0/d12/d14/d48/f83 42560 1 2023-10-08T08:46:01.469 INFO:tasks.workunit.client.0.smithi070.stdout:1/920: mkdir d6/dc/d14/dc1/dca/d135 0 2023-10-08T08:46:01.469 INFO:tasks.workunit.client.0.smithi070.stdout:1/921: dread - d6/dc/d14/dc1/dca/d117/d7e/dc2/dfc/f109 zero size 2023-10-08T08:46:01.470 INFO:tasks.workunit.client.0.smithi070.stdout:5/811: getdents d5 0 2023-10-08T08:46:01.470 INFO:tasks.workunit.client.0.smithi070.stdout:5/812: dread - d5/d5f/d63/d8b/d8f/de5/fef zero size 2023-10-08T08:46:01.471 INFO:tasks.workunit.client.0.smithi070.stdout:3/962: rename d0/d12/d14/d5c/db1/dbe/d14a/d52/db5/dcb/fed to d0/d12/d14/d5c/d5d/f14d 0 2023-10-08T08:46:01.471 INFO:tasks.workunit.client.0.smithi070.stdout:3/963: fsync d0/db/d10/d38/d63/fc7 0 2023-10-08T08:46:01.471 INFO:tasks.workunit.client.0.smithi070.stdout:3/964: fdatasync d0/d12/d14/d5c/d5d/da0/f13f 0 2023-10-08T08:46:01.472 INFO:tasks.workunit.client.0.smithi070.stdout:5/813: mknod d5/da/d4d/dfb/c110 0 2023-10-08T08:46:01.474 INFO:tasks.workunit.client.0.smithi070.stdout:3/965: getdents d0/d12/d14/d5c/d5d/da0/d86/de8 0 2023-10-08T08:46:01.476 INFO:tasks.workunit.client.0.smithi070.stdout:5/814: truncate d5/d5f/d61/d30/d54/f7b 5190922 0 2023-10-08T08:46:01.476 INFO:tasks.workunit.client.0.smithi070.stdout:9/618: dwrite d1/dd/d1a/d40/d76/d93/fa1 [0,4194304] 0 2023-10-08T08:46:01.480 INFO:tasks.workunit.client.0.smithi070.stdout:9/619: rename d1/dd/d39/d6f/d88 to d1/dd/d19/d38/d4f/db9 0 2023-10-08T08:46:01.480 INFO:tasks.workunit.client.0.smithi070.stdout:9/620: fdatasync d1/dd/d19/d38/f5a 0 2023-10-08T08:46:01.481 INFO:tasks.workunit.client.0.smithi070.stdout:9/621: symlink d1/dd/d1a/d40/lba 0 2023-10-08T08:46:01.482 INFO:tasks.workunit.client.0.smithi070.stdout:3/966: symlink d0/db/d10/d38/d12e/l14e 0 2023-10-08T08:46:01.484 INFO:tasks.workunit.client.0.smithi070.stdout:5/815: read d5/ff [3392236,25925] 0 2023-10-08T08:46:01.486 INFO:tasks.workunit.client.0.smithi070.stdout:1/922: dwrite d6/dc/d14/d90/de4/fe6 [0,4194304] 0 2023-10-08T08:46:01.487 INFO:tasks.workunit.client.0.smithi070.stdout:1/923: readlink d6/dc/d14/d1f/d63/db3/l10e 0 2023-10-08T08:46:01.487 INFO:tasks.workunit.client.0.smithi070.stdout:1/924: read d6/dc/d14/d70/df6/d11d/f101 [17872,47436] 0 2023-10-08T08:46:01.489 INFO:tasks.workunit.client.0.smithi070.stdout:4/702: sync 2023-10-08T08:46:01.489 INFO:tasks.workunit.client.0.smithi070.stdout:6/721: sync 2023-10-08T08:46:01.489 INFO:tasks.workunit.client.0.smithi070.stdout:8/855: sync 2023-10-08T08:46:01.489 INFO:tasks.workunit.client.0.smithi070.stdout:2/912: sync 2023-10-08T08:46:01.489 INFO:tasks.workunit.client.0.smithi070.stdout:4/703: dread - dc/d17/d24/d4c/fd9 zero size 2023-10-08T08:46:01.489 INFO:tasks.workunit.client.0.smithi070.stdout:5/816: dread d5/da/d22/fa4 [0,4194304] 0 2023-10-08T08:46:01.490 INFO:tasks.workunit.client.0.smithi070.stdout:0/916: sync 2023-10-08T08:46:01.490 INFO:tasks.workunit.client.0.smithi070.stdout:7/830: sync 2023-10-08T08:46:01.490 INFO:tasks.workunit.client.0.smithi070.stdout:1/925: rename d6/dc/d14/dc1/dca/d117/d7e/dc2 to d6/dc/d136 0 2023-10-08T08:46:01.492 INFO:tasks.workunit.client.0.smithi070.stdout:2/913: creat df/d93/dc2/dae/d107/f125 x:0 0 0 2023-10-08T08:46:01.492 INFO:tasks.workunit.client.0.smithi070.stdout:0/917: write d1/dd/dae/fc7 [4383979,15455] 0 2023-10-08T08:46:01.494 INFO:tasks.workunit.client.0.smithi070.stdout:7/831: mkdir d3/d19/d11a 0 2023-10-08T08:46:01.494 INFO:tasks.workunit.client.0.smithi070.stdout:7/832: chown d3/da9/d1e/c49 78 1 2023-10-08T08:46:01.494 INFO:tasks.workunit.client.0.smithi070.stdout:7/833: fdatasync d3/da9/f64 0 2023-10-08T08:46:01.495 INFO:tasks.workunit.client.0.smithi070.stdout:1/926: symlink d6/dc/d14/d1f/d63/db3/d38/d4b/l137 0 2023-10-08T08:46:01.495 INFO:tasks.workunit.client.0.smithi070.stdout:1/927: stat d6/dc/d14/d1f/d63 0 2023-10-08T08:46:01.496 INFO:tasks.workunit.client.0.smithi070.stdout:9/622: dread d1/dd/d19/d38/f42 [0,4194304] 0 2023-10-08T08:46:01.496 INFO:tasks.workunit.client.0.smithi070.stdout:4/704: dread dc/d17/d24/d4c/f60 [0,4194304] 0 2023-10-08T08:46:01.496 INFO:tasks.workunit.client.0.smithi070.stdout:4/705: fdatasync dc/d5f/fbe 0 2023-10-08T08:46:01.496 INFO:tasks.workunit.client.0.smithi070.stdout:8/856: dread d1/fb4 [0,4194304] 0 2023-10-08T08:46:01.497 INFO:tasks.workunit.client.0.smithi070.stdout:4/706: chown dc/d68/fcb 5108755 1 2023-10-08T08:46:01.497 INFO:tasks.workunit.client.0.smithi070.stdout:4/707: write dc/d17/d24/f52 [719768,57049] 0 2023-10-08T08:46:01.497 INFO:tasks.workunit.client.0.smithi070.stdout:4/708: write dc/d17/d1f/d5e/f93 [64585,100761] 0 2023-10-08T08:46:01.497 INFO:tasks.workunit.client.0.smithi070.stdout:2/914: mknod df/c126 0 2023-10-08T08:46:01.497 INFO:tasks.workunit.client.0.smithi070.stdout:2/915: readlink df/d12/d1b/d1c/le8 0 2023-10-08T08:46:01.497 INFO:tasks.workunit.client.0.smithi070.stdout:4/709: creat dc/d17/d1f/fe6 x:0 0 0 2023-10-08T08:46:01.497 INFO:tasks.workunit.client.0.smithi070.stdout:4/710: truncate dc/d17/d24/d4c/f9b 156596 0 2023-10-08T08:46:01.498 INFO:tasks.workunit.client.0.smithi070.stdout:4/711: dread - dc/d17/d1f/f99 zero size 2023-10-08T08:46:01.498 INFO:tasks.workunit.client.0.smithi070.stdout:9/623: unlink d1/dd/d19/c3d 0 2023-10-08T08:46:01.499 INFO:tasks.workunit.client.0.smithi070.stdout:0/918: rename d1/d14/de2/d105 to d1/d76/dd5/d122 0 2023-10-08T08:46:01.500 INFO:tasks.workunit.client.0.smithi070.stdout:9/624: creat d1/dd/d26/fbb x:0 0 0 2023-10-08T08:46:01.500 INFO:tasks.workunit.client.0.smithi070.stdout:9/625: chown d1/dd/d19/d38/d4f/db9/f95 474 1 2023-10-08T08:46:01.502 INFO:tasks.workunit.client.0.smithi070.stdout:2/916: creat df/d93/dc2/dae/dce/f127 x:0 0 0 2023-10-08T08:46:01.503 INFO:tasks.workunit.client.0.smithi070.stdout:2/917: chown df/d12/d1b/d1c/d69/lf8 9720 1 2023-10-08T08:46:01.503 INFO:tasks.workunit.client.0.smithi070.stdout:3/967: write d0/db/f11b [296344,1163] 0 2023-10-08T08:46:01.503 INFO:tasks.workunit.client.0.smithi070.stdout:0/919: rename d1/d62/d54/d5e/f9b to d1/d62/d54/d5e/d80/d11e/f123 0 2023-10-08T08:46:01.506 INFO:tasks.workunit.client.0.smithi070.stdout:3/968: write d0/d12/d14/d5c/db1/dbe/d14a/f33 [497404,102994] 0 2023-10-08T08:46:01.506 INFO:tasks.workunit.client.0.smithi070.stdout:6/722: dread df/d11/f58 [0,4194304] 0 2023-10-08T08:46:01.506 INFO:tasks.workunit.client.0.smithi070.stdout:6/723: chown df/l72 766 1 2023-10-08T08:46:01.509 INFO:tasks.workunit.client.0.smithi070.stdout:8/857: dread d1/d2/d6/d22/d5b/d74/de1/f4f [0,4194304] 0 2023-10-08T08:46:01.509 INFO:tasks.workunit.client.0.smithi070.stdout:5/817: dread d5/da/d4d/f85 [0,4194304] 0 2023-10-08T08:46:01.509 INFO:tasks.workunit.client.0.smithi070.stdout:5/818: readlink d5/da/d22/l72 0 2023-10-08T08:46:01.512 INFO:tasks.workunit.client.0.smithi070.stdout:2/918: unlink df/d12/d1b/d1c/d69/d100/d83/d92/fef 0 2023-10-08T08:46:01.512 INFO:tasks.workunit.client.0.smithi070.stdout:0/920: truncate d1/f7 678014 0 2023-10-08T08:46:01.513 INFO:tasks.workunit.client.0.smithi070.stdout:0/921: truncate d1/dd/f3a 1164094 0 2023-10-08T08:46:01.513 INFO:tasks.workunit.client.0.smithi070.stdout:8/858: mknod d1/d2/d6/d22/d5c/c120 0 2023-10-08T08:46:01.515 INFO:tasks.workunit.client.0.smithi070.stdout:6/724: write df/d11/f65 [3352348,98605] 0 2023-10-08T08:46:01.515 INFO:tasks.workunit.client.0.smithi070.stdout:5/819: rename d5/d5f/d63/la0 to d5/d5f/l111 0 2023-10-08T08:46:01.517 INFO:tasks.workunit.client.0.smithi070.stdout:2/919: mkdir df/d93/d128 0 2023-10-08T08:46:01.517 INFO:tasks.workunit.client.0.smithi070.stdout:2/920: fsync df/d12/d1b/d1c/d69/fd5 0 2023-10-08T08:46:01.517 INFO:tasks.workunit.client.0.smithi070.stdout:2/921: fsync df/d3a/db6/dde/fe5 0 2023-10-08T08:46:01.517 INFO:tasks.workunit.client.0.smithi070.stdout:0/922: rmdir d1/d76/dd5 39 2023-10-08T08:46:01.518 INFO:tasks.workunit.client.0.smithi070.stdout:5/820: unlink d5/da/d22/ddd/l92 0 2023-10-08T08:46:01.519 INFO:tasks.workunit.client.0.smithi070.stdout:8/859: creat d1/d2/d6/d22/d5b/d74/de1/d15/f121 x:0 0 0 2023-10-08T08:46:01.519 INFO:tasks.workunit.client.0.smithi070.stdout:5/821: chown d5/da/d22/d75/cba 270337103 1 2023-10-08T08:46:01.519 INFO:tasks.workunit.client.0.smithi070.stdout:5/822: stat d5/d5f/d61/d30/d54/d62/dae/ffc 0 2023-10-08T08:46:01.519 INFO:tasks.workunit.client.0.smithi070.stdout:3/969: rmdir d0/d12/d14/d5c/d5d/da0/d86 39 2023-10-08T08:46:01.519 INFO:tasks.workunit.client.0.smithi070.stdout:2/922: getdents df/d3a/d77 0 2023-10-08T08:46:01.521 INFO:tasks.workunit.client.0.smithi070.stdout:8/860: rmdir d1/d2/d6/d22/d5b/d74/de1/d3a/df3 0 2023-10-08T08:46:01.522 INFO:tasks.workunit.client.0.smithi070.stdout:5/823: mkdir d5/da/d22/ddd/d38/d55/d112 0 2023-10-08T08:46:01.522 INFO:tasks.workunit.client.0.smithi070.stdout:0/923: dread d1/d76/d7a/fce [0,4194304] 0 2023-10-08T08:46:01.522 INFO:tasks.workunit.client.0.smithi070.stdout:5/824: chown d5/d5f/d63/d8b/f9e 81947936 1 2023-10-08T08:46:01.522 INFO:tasks.workunit.client.0.smithi070.stdout:5/825: write d5/da/df6/f102 [708081,105744] 0 2023-10-08T08:46:01.523 INFO:tasks.workunit.client.0.smithi070.stdout:0/924: write d1/d1d/d24/f94 [1589213,117249] 0 2023-10-08T08:46:01.523 INFO:tasks.workunit.client.0.smithi070.stdout:5/826: write d5/da/d22/ddd/d2a/dc0/ff4 [859658,121492] 0 2023-10-08T08:46:01.523 INFO:tasks.workunit.client.0.smithi070.stdout:3/970: mkdir d0/db/d10/d38/d2f/d14f 0 2023-10-08T08:46:01.523 INFO:tasks.workunit.client.0.smithi070.stdout:3/971: chown d0/db/d10/d38/d63/c12c 123 1 2023-10-08T08:46:01.524 INFO:tasks.workunit.client.0.smithi070.stdout:3/972: chown d0/d12/d14/d5c/db1/dbe/d14a/d52/db5/dcb/de1/ce3 37717 1 2023-10-08T08:46:01.526 INFO:tasks.workunit.client.0.smithi070.stdout:0/925: unlink d1/d62/d54/cbe 0 2023-10-08T08:46:01.526 INFO:tasks.workunit.client.0.smithi070.stdout:0/926: write d1/dd/fb4 [484013,20658] 0 2023-10-08T08:46:01.526 INFO:tasks.workunit.client.0.smithi070.stdout:0/927: fdatasync d1/d14/d1f/ff5 0 2023-10-08T08:46:01.526 INFO:tasks.workunit.client.0.smithi070.stdout:0/928: fdatasync d1/d14/dff/f114 0 2023-10-08T08:46:01.526 INFO:tasks.workunit.client.0.smithi070.stdout:3/973: write d0/d12/d14/d5c/d5d/da0/d86/de8/fec [1288041,59437] 0 2023-10-08T08:46:01.527 INFO:tasks.workunit.client.0.smithi070.stdout:3/974: getdents d0/d12/d14/d5c/db1/dbe/d14a/d52/db5/dcb/d129 0 2023-10-08T08:46:01.527 INFO:tasks.workunit.client.0.smithi070.stdout:3/975: chown d0/c7 61 1 2023-10-08T08:46:01.528 INFO:tasks.workunit.client.0.smithi070.stdout:0/929: mknod d1/d14/de5/c124 0 2023-10-08T08:46:01.528 INFO:tasks.workunit.client.0.smithi070.stdout:5/827: rmdir d5/d5f/d63/d8b 39 2023-10-08T08:46:01.529 INFO:tasks.workunit.client.0.smithi070.stdout:3/976: mkdir d0/db/d10/d38/d63/d11c/d131/d150 0 2023-10-08T08:46:01.532 INFO:tasks.workunit.client.0.smithi070.stdout:0/930: mknod d1/d62/d54/dfc/d10d/c125 0 2023-10-08T08:46:01.541 INFO:tasks.workunit.client.0.smithi070.stdout:5/828: dread d5/da/d22/f47 [4194304,4194304] 0 2023-10-08T08:46:01.541 INFO:tasks.workunit.client.0.smithi070.stdout:5/829: write d5/d5f/fff [206750,65979] 0 2023-10-08T08:46:01.542 INFO:tasks.workunit.client.0.smithi070.stdout:5/830: mknod d5/d5f/d61/d30/d54/dab/c113 0 2023-10-08T08:46:01.544 INFO:tasks.workunit.client.0.smithi070.stdout:5/831: rename d5/da/d22/ddd/d2a/l91 to d5/d5f/d63/dca/l114 0 2023-10-08T08:46:01.545 INFO:tasks.workunit.client.0.smithi070.stdout:5/832: rmdir d5/d5f/d63/d8b/da8 39 2023-10-08T08:46:01.557 INFO:tasks.workunit.client.0.smithi070.stdout:9/626: dread d1/dd/d19/f79 [0,4194304] 0 2023-10-08T08:46:01.558 INFO:tasks.workunit.client.0.smithi070.stdout:9/627: symlink d1/dd/d26/d27/d2d/d70/d90/dab/lbc 0 2023-10-08T08:46:01.558 INFO:tasks.workunit.client.0.smithi070.stdout:9/628: chown d1/dd/d26/d27/d2d/f7e 393414 1 2023-10-08T08:46:01.559 INFO:tasks.workunit.client.0.smithi070.stdout:9/629: chown d1/dd/d26/d27/d2d/c3f 12580509 1 2023-10-08T08:46:01.559 INFO:tasks.workunit.client.0.smithi070.stdout:9/630: chown d1/dd/d1a/d81 3 1 2023-10-08T08:46:01.559 INFO:tasks.workunit.client.0.smithi070.stdout:9/631: symlink d1/dd/d26/d7b/lbd 0 2023-10-08T08:46:01.562 INFO:tasks.workunit.client.0.smithi070.stdout:3/977: read d0/d12/d14/d5c/d5d/da0/d86/fa7 [1277881,60964] 0 2023-10-08T08:46:01.565 INFO:tasks.workunit.client.0.smithi070.stdout:2/923: dwrite df/d12/d1b/fcf [0,4194304] 0 2023-10-08T08:46:01.566 INFO:tasks.workunit.client.0.smithi070.stdout:2/924: stat df/d12/d1b/d1c/d69/fd5 0 2023-10-08T08:46:01.568 INFO:tasks.workunit.client.0.smithi070.stdout:2/925: rmdir df/d12/d1b/d1c/d79/da4 39 2023-10-08T08:46:01.568 INFO:tasks.workunit.client.0.smithi070.stdout:2/926: write df/d93/fc0 [1390315,72161] 0 2023-10-08T08:46:01.569 INFO:tasks.workunit.client.0.smithi070.stdout:2/927: getdents df/d12/d1b/d82/d85/d65/da0 0 2023-10-08T08:46:01.587 INFO:tasks.workunit.client.0.smithi070.stdout:9/632: dwrite d1/dd/f61 [4194304,4194304] 0 2023-10-08T08:46:01.587 INFO:tasks.workunit.client.0.smithi070.stdout:9/633: write d1/f55 [643294,120072] 0 2023-10-08T08:46:01.587 INFO:tasks.workunit.client.0.smithi070.stdout:2/928: dread df/d12/d1b/d1c/d69/fd5 [0,4194304] 0 2023-10-08T08:46:01.589 INFO:tasks.workunit.client.0.smithi070.stdout:3/978: dwrite d0/d12/f4e [0,4194304] 0 2023-10-08T08:46:01.589 INFO:tasks.workunit.client.0.smithi070.stdout:2/929: creat df/d12/d7e/f129 x:0 0 0 2023-10-08T08:46:01.589 INFO:tasks.workunit.client.0.smithi070.stdout:9/634: mkdir d1/dd/d19/dbe 0 2023-10-08T08:46:01.591 INFO:tasks.workunit.client.0.smithi070.stdout:2/930: rename df/d4c/f4f to df/d93/d128/f12a 0 2023-10-08T08:46:01.591 INFO:tasks.workunit.client.0.smithi070.stdout:2/931: fdatasync df/f59 0 2023-10-08T08:46:01.592 INFO:tasks.workunit.client.0.smithi070.stdout:2/932: readlink df/l13 0 2023-10-08T08:46:01.592 INFO:tasks.workunit.client.0.smithi070.stdout:7/834: dwrite d3/da9/d1e/d76/f8a [0,4194304] 0 2023-10-08T08:46:01.594 INFO:tasks.workunit.client.0.smithi070.stdout:2/933: mkdir df/d12/d15/d54/d12b 0 2023-10-08T08:46:01.595 INFO:tasks.workunit.client.0.smithi070.stdout:9/635: write d1/dd/d26/d27/f36 [245928,118815] 0 2023-10-08T08:46:01.595 INFO:tasks.workunit.client.0.smithi070.stdout:7/835: dread d3/da9/d4a/fd [0,4194304] 0 2023-10-08T08:46:01.595 INFO:tasks.workunit.client.0.smithi070.stdout:7/836: dread - d3/d79/de3/f10e zero size 2023-10-08T08:46:01.595 INFO:tasks.workunit.client.0.smithi070.stdout:9/636: write d1/dd/f87 [726446,79385] 0 2023-10-08T08:46:01.596 INFO:tasks.workunit.client.0.smithi070.stdout:0/931: dwrite d1/d1d/f2e [0,4194304] 0 2023-10-08T08:46:01.596 INFO:tasks.workunit.client.0.smithi070.stdout:0/932: dread - d1/d62/d54/dfc/f11c zero size 2023-10-08T08:46:01.598 INFO:tasks.workunit.client.0.smithi070.stdout:2/934: symlink df/d12/d1b/d1c/dcd/l12c 0 2023-10-08T08:46:01.599 INFO:tasks.workunit.client.0.smithi070.stdout:9/637: getdents d1/dd/d26/d27/d2d 0 2023-10-08T08:46:01.602 INFO:tasks.workunit.client.0.smithi070.stdout:8/861: dread d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/ffb [0,4194304] 0 2023-10-08T08:46:01.602 INFO:tasks.workunit.client.0.smithi070.stdout:2/935: rename df/d12/d1b/d82/d85/f78 to df/d93/d123/f12d 0 2023-10-08T08:46:01.602 INFO:tasks.workunit.client.0.smithi070.stdout:3/979: write d0/d12/f97 [674183,93506] 0 2023-10-08T08:46:01.602 INFO:tasks.workunit.client.0.smithi070.stdout:3/980: truncate d0/d12/d14/d5c/f109 350934 0 2023-10-08T08:46:01.602 INFO:tasks.workunit.client.0.smithi070.stdout:1/928: dwrite d6/dc/d14/d1f/d63/db3/d38/d4b/fc6 [0,4194304] 0 2023-10-08T08:46:01.604 INFO:tasks.workunit.client.0.smithi070.stdout:9/638: dread d1/dd/d19/f79 [0,4194304] 0 2023-10-08T08:46:01.604 INFO:tasks.workunit.client.0.smithi070.stdout:9/639: write d1/dd/d19/d38/d4f/fa9 [1095953,31095] 0 2023-10-08T08:46:01.608 INFO:tasks.workunit.client.0.smithi070.stdout:1/929: chown c4 102 1 2023-10-08T08:46:01.608 INFO:tasks.workunit.client.0.smithi070.stdout:8/862: creat d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/d10d/f122 x:0 0 0 2023-10-08T08:46:01.610 INFO:tasks.workunit.client.0.smithi070.stdout:1/930: mkdir d6/dc/d97/d113/d120/d138 0 2023-10-08T08:46:01.610 INFO:tasks.workunit.client.0.smithi070.stdout:9/640: creat d1/dd/d26/d27/d2d/d70/d90/fbf x:0 0 0 2023-10-08T08:46:01.610 INFO:tasks.workunit.client.0.smithi070.stdout:0/933: dread d1/d14/d1f/f42 [0,4194304] 0 2023-10-08T08:46:01.611 INFO:tasks.workunit.client.0.smithi070.stdout:8/863: dread d1/d2/d6/d22/d5b/d74/de1/f4f [0,4194304] 0 2023-10-08T08:46:01.611 INFO:tasks.workunit.client.0.smithi070.stdout:7/837: dread d3/d19/d1a/f22 [0,4194304] 0 2023-10-08T08:46:01.612 INFO:tasks.workunit.client.0.smithi070.stdout:9/641: truncate d1/dd/d1a/d40/d76/d93/fa1 237688 0 2023-10-08T08:46:01.612 INFO:tasks.workunit.client.0.smithi070.stdout:0/934: getdents d1/d62/d54 0 2023-10-08T08:46:01.617 INFO:tasks.workunit.client.0.smithi070.stdout:7/838: unlink d3/d19/c5f 0 2023-10-08T08:46:01.617 INFO:tasks.workunit.client.0.smithi070.stdout:0/935: mknod d1/dd/c126 0 2023-10-08T08:46:01.624 INFO:tasks.workunit.client.0.smithi070.stdout:2/936: dwrite df/d12/d1b/d1c/f6a [0,4194304] 0 2023-10-08T08:46:01.627 INFO:tasks.workunit.client.0.smithi070.stdout:2/937: symlink df/d12/d1b/d82/d85/d65/l12e 0 2023-10-08T08:46:01.627 INFO:tasks.workunit.client.0.smithi070.stdout:2/938: write df/d4c/d91/f118 [711126,21038] 0 2023-10-08T08:46:01.627 INFO:tasks.workunit.client.0.smithi070.stdout:2/939: readlink df/d12/d1b/l4d 0 2023-10-08T08:46:01.629 INFO:tasks.workunit.client.0.smithi070.stdout:7/839: dread d3/d19/f3c [0,4194304] 0 2023-10-08T08:46:01.630 INFO:tasks.workunit.client.0.smithi070.stdout:2/940: creat df/d12/d1b/d1c/d69/d100/d83/d92/f12f x:0 0 0 2023-10-08T08:46:01.632 INFO:tasks.workunit.client.0.smithi070.stdout:7/840: dread d3/da9/f9d [0,4194304] 0 2023-10-08T08:46:01.639 INFO:tasks.workunit.client.0.smithi070.stdout:8/864: mkdir d1/d2/d6/d22/d5b/d74/dc3/dd6/d123 0 2023-10-08T08:46:01.643 INFO:tasks.workunit.client.0.smithi070.stdout:8/865: creat d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/f124 x:0 0 0 2023-10-08T08:46:01.645 INFO:tasks.workunit.client.0.smithi070.stdout:0/936: write d1/d1d/fa4 [4060909,91471] 0 2023-10-08T08:46:01.645 INFO:tasks.workunit.client.0.smithi070.stdout:1/931: dwrite d6/dc/d14/dc1/dca/d117/d7e/f87 [0,4194304] 0 2023-10-08T08:46:01.645 INFO:tasks.workunit.client.0.smithi070.stdout:0/937: chown d1/d1d/d4d/d9d/fa1 6874189 1 2023-10-08T08:46:01.645 INFO:tasks.workunit.client.0.smithi070.stdout:2/941: dread df/d4c/f9c [0,4194304] 0 2023-10-08T08:46:01.648 INFO:tasks.workunit.client.0.smithi070.stdout:0/938: symlink d1/d62/d54/dfc/d10d/l127 0 2023-10-08T08:46:01.649 INFO:tasks.workunit.client.0.smithi070.stdout:8/866: mkdir d1/d2/d6/d22/d5c/d125 0 2023-10-08T08:46:01.649 INFO:tasks.workunit.client.0.smithi070.stdout:8/867: readlink d1/d2/d6/d22/d5b/d74/de1/d1a/l3e 0 2023-10-08T08:46:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:8/868: rmdir d1/d2/d8c/db9/d110 0 2023-10-08T08:46:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:3/981: rename d0/d12/d14/d5c/db1/dbe/d14a to d0/d12/d8d/dcc/d151 0 2023-10-08T08:46:01.655 INFO:tasks.workunit.client.0.smithi070.stdout:8/869: mkdir d1/d126 0 2023-10-08T08:46:01.655 INFO:tasks.workunit.client.0.smithi070.stdout:7/841: dwrite d3/da9/d1e/fab [0,4194304] 0 2023-10-08T08:46:01.656 INFO:tasks.workunit.client.0.smithi070.stdout:3/982: mkdir d0/d12/d14/d5c/db1/dbe/d152 0 2023-10-08T08:46:01.656 INFO:tasks.workunit.client.0.smithi070.stdout:3/983: chown d0/d12/d10b/c142 0 1 2023-10-08T08:46:01.657 INFO:tasks.workunit.client.0.smithi070.stdout:7/842: mknod d3/d77/de2/df6/c11b 0 2023-10-08T08:46:01.657 INFO:tasks.workunit.client.0.smithi070.stdout:9/642: rename d1/dd/d8d/c58 to d1/dd/d19/cc0 0 2023-10-08T08:46:01.657 INFO:tasks.workunit.client.0.smithi070.stdout:7/843: write d3/d19/f67 [4507770,36755] 0 2023-10-08T08:46:01.658 INFO:tasks.workunit.client.0.smithi070.stdout:8/870: creat d1/d2/d6/d22/d5b/d74/de1/d3a/d92/f127 x:0 0 0 2023-10-08T08:46:01.661 INFO:tasks.workunit.client.0.smithi070.stdout:3/984: link d0/d12/d8d/dcc/d151/d52/db5/dcb/de1/cd7 d0/d8a/c153 0 2023-10-08T08:46:01.661 INFO:tasks.workunit.client.0.smithi070.stdout:3/985: chown d0/db/d10/d38/d2f/f66 3815659 1 2023-10-08T08:46:01.662 INFO:tasks.workunit.client.0.smithi070.stdout:8/871: mkdir d1/d2/d6/d22/d9e/da7/dbe/d128 0 2023-10-08T08:46:01.662 INFO:tasks.workunit.client.0.smithi070.stdout:3/986: mknod d0/d12/d14/d5c/db1/dbe/c154 0 2023-10-08T08:46:01.663 INFO:tasks.workunit.client.0.smithi070.stdout:8/872: creat d1/d2/d6/d22/d5b/d74/de1/d3a/d92/f129 x:0 0 0 2023-10-08T08:46:01.664 INFO:tasks.workunit.client.0.smithi070.stdout:8/873: chown d1/d2/d6/fcc 87 1 2023-10-08T08:46:01.666 INFO:tasks.workunit.client.0.smithi070.stdout:8/874: mknod d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/c12a 0 2023-10-08T08:46:01.667 INFO:tasks.workunit.client.0.smithi070.stdout:3/987: write d0/d12/d14/d5c/d5d/da0/dd8/ffa [983011,73511] 0 2023-10-08T08:46:01.667 INFO:tasks.workunit.client.0.smithi070.stdout:3/988: dread - d0/d12/d8d/dcc/d151/d52/db5/dcb/f139 zero size 2023-10-08T08:46:01.667 INFO:tasks.workunit.client.0.smithi070.stdout:3/989: write d0/d12/d14/d48/d113/f3a [4759881,23520] 0 2023-10-08T08:46:01.667 INFO:tasks.workunit.client.0.smithi070.stdout:8/875: creat d1/d2/d6/d22/d9e/da7/dbe/d128/f12b x:0 0 0 2023-10-08T08:46:01.669 INFO:tasks.workunit.client.0.smithi070.stdout:3/990: symlink d0/d12/d8d/dcc/d151/d52/db5/dcb/l155 0 2023-10-08T08:46:01.669 INFO:tasks.workunit.client.0.smithi070.stdout:0/939: dwrite d1/dd/ff [0,4194304] 0 2023-10-08T08:46:01.669 INFO:tasks.workunit.client.0.smithi070.stdout:1/932: dwrite d6/dc/d14/d1f/f3d [0,4194304] 0 2023-10-08T08:46:01.670 INFO:tasks.workunit.client.0.smithi070.stdout:8/876: truncate d1/d2/d6/d22/d5b/d74/de1/d3a/d92/fad 361830 0 2023-10-08T08:46:01.671 INFO:tasks.workunit.client.0.smithi070.stdout:8/877: creat d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/d10d/f12c x:0 0 0 2023-10-08T08:46:01.671 INFO:tasks.workunit.client.0.smithi070.stdout:2/942: rename df/d93/dc2/dae/dce/df0 to df/d4c/d91/d130 0 2023-10-08T08:46:01.673 INFO:tasks.workunit.client.0.smithi070.stdout:1/933: creat d6/dc/d97/d11b/f139 x:0 0 0 2023-10-08T08:46:01.674 INFO:tasks.workunit.client.0.smithi070.stdout:2/943: creat df/d12/d1b/d1c/d2d/f131 x:0 0 0 2023-10-08T08:46:01.674 INFO:tasks.workunit.client.0.smithi070.stdout:8/878: mknod d1/d2/d6/d22/d5b/d74/dc3/c12d 0 2023-10-08T08:46:01.674 INFO:tasks.workunit.client.0.smithi070.stdout:8/879: truncate d1/fb 12786099 0 2023-10-08T08:46:01.676 INFO:tasks.workunit.client.0.smithi070.stdout:1/934: creat d6/dc/d14/d90/de4/f13a x:0 0 0 2023-10-08T08:46:01.677 INFO:tasks.workunit.client.0.smithi070.stdout:2/944: write fa [728080,25277] 0 2023-10-08T08:46:01.677 INFO:tasks.workunit.client.0.smithi070.stdout:3/991: rename d0/d12/d8d/dcc/d151/d52/db5/dcb/de1/dd2 to d0/d12/d14/d5c/db1/dbe/d156 0 2023-10-08T08:46:01.677 INFO:tasks.workunit.client.0.smithi070.stdout:3/992: fdatasync d0/d12/d14/d48/d113/f6c 0 2023-10-08T08:46:01.683 INFO:tasks.workunit.client.0.smithi070.stdout:1/935: mkdir d6/dc/d14/d1f/d63/db3/d13b 0 2023-10-08T08:46:01.683 INFO:tasks.workunit.client.0.smithi070.stdout:9/643: dwrite d1/dd/d1a/d40/d76/fb7 [0,4194304] 0 2023-10-08T08:46:01.684 INFO:tasks.workunit.client.0.smithi070.stdout:9/644: fdatasync d1/dd/d26/f8a 0 2023-10-08T08:46:01.684 INFO:tasks.workunit.client.0.smithi070.stdout:3/993: mkdir d0/db/d10/d38/d2f/d157 0 2023-10-08T08:46:01.687 INFO:tasks.workunit.client.0.smithi070.stdout:9/645: rmdir d1/dd/d19/d38 39 2023-10-08T08:46:01.687 INFO:tasks.workunit.client.0.smithi070.stdout:9/646: truncate d1/f8b 228480 0 2023-10-08T08:46:01.690 INFO:tasks.workunit.client.0.smithi070.stdout:1/936: mknod d6/dc/d14/d1f/d63/db3/c13c 0 2023-10-08T08:46:01.694 INFO:tasks.workunit.client.0.smithi070.stdout:1/937: creat d6/dc/d14/d70/df6/d11d/f13d x:0 0 0 2023-10-08T08:46:01.697 INFO:tasks.workunit.client.0.smithi070.stdout:7/844: dwrite d3/f37 [0,4194304] 0 2023-10-08T08:46:01.699 INFO:tasks.workunit.client.0.smithi070.stdout:2/945: dwrite df/d113/f11d [0,4194304] 0 2023-10-08T08:46:01.700 INFO:tasks.workunit.client.0.smithi070.stdout:3/994: unlink d0/db/d10/d38/d63/fc7 0 2023-10-08T08:46:01.700 INFO:tasks.workunit.client.0.smithi070.stdout:0/940: dwrite d1/d1d/f2b [0,4194304] 0 2023-10-08T08:46:01.701 INFO:tasks.workunit.client.0.smithi070.stdout:7/845: stat d3/d79/lf2 0 2023-10-08T08:46:01.705 INFO:tasks.workunit.client.0.smithi070.stdout:7/846: dread d3/d19/d1a/fc1 [0,4194304] 0 2023-10-08T08:46:01.705 INFO:tasks.workunit.client.0.smithi070.stdout:7/847: chown d3/d77/de2 39 1 2023-10-08T08:46:01.705 INFO:tasks.workunit.client.0.smithi070.stdout:7/848: read - d3/d19/d95/da3/dc8/dfb/d9f/dc5/fff zero size 2023-10-08T08:46:01.706 INFO:tasks.workunit.client.0.smithi070.stdout:2/946: truncate df/d12/d1b/f8c 833896 0 2023-10-08T08:46:01.708 INFO:tasks.workunit.client.0.smithi070.stdout:3/995: stat d0/d12/d14/d5c/dc4/c124 0 2023-10-08T08:46:01.708 INFO:tasks.workunit.client.0.smithi070.stdout:3/996: fdatasync d0/d12/d14/d5c/db1/dbe/d100/f123 0 2023-10-08T08:46:01.709 INFO:tasks.workunit.client.0.smithi070.stdout:3/997: readlink d0/d12/d8d/dcc/d151/d52/la9 0 2023-10-08T08:46:01.709 INFO:tasks.workunit.client.0.smithi070.stdout:3/998: write d0/d12/d14/d5c/dc4/f141 [592581,69755] 0 2023-10-08T08:46:01.711 INFO:tasks.workunit.client.0.smithi070.stdout:2/947: mknod df/d12/d1b/d1c/d69/d100/d83/c132 0 2023-10-08T08:46:01.712 INFO:tasks.workunit.client.0.smithi070.stdout:2/948: truncate df/d12/d1b/d82/d85/d65/fcc 1690658 0 2023-10-08T08:46:01.712 INFO:tasks.workunit.client.0.smithi070.stdout:2/949: dread - df/d12/d15/fe9 zero size 2023-10-08T08:46:01.712 INFO:tasks.workunit.client.0.smithi070.stdout:8/880: write d1/d2/f1e [1245763,69144] 0 2023-10-08T08:46:01.712 INFO:tasks.workunit.client.0.smithi070.stdout:2/950: rmdir df/d12/d1b/dd9 39 2023-10-08T08:46:01.715 INFO:tasks.workunit.client.0.smithi070.stdout:3/999: fsync d0/d12/d14/d48/d113/f3a 0 2023-10-08T08:46:01.720 INFO:tasks.workunit.client.0.smithi070.stdout:9/647: dwrite d1/dd/d19/d38/d4f/db9/f95 [0,4194304] 0 2023-10-08T08:46:01.720 INFO:tasks.workunit.client.0.smithi070.stdout:9/648: chown d1/dd/d1a/d40/d76/d93/fa1 104286 1 2023-10-08T08:46:01.720 INFO:tasks.workunit.client.0.smithi070.stdout:4/712: sync 2023-10-08T08:46:01.721 INFO:tasks.workunit.client.0.smithi070.stdout:0/941: write d1/d1d/d4d/d9d/f4f [5154225,11843] 0 2023-10-08T08:46:01.724 INFO:tasks.workunit.client.0.smithi070.stdout:4/713: rmdir dc/d17/d1f/d5e 39 2023-10-08T08:46:01.726 INFO:tasks.workunit.client.0.smithi070.stdout:1/938: dwrite d6/f65 [0,4194304] 0 2023-10-08T08:46:01.726 INFO:tasks.workunit.client.0.smithi070.stdout:4/714: mknod dc/d17/dbf/ce7 0 2023-10-08T08:46:01.730 INFO:tasks.workunit.client.0.smithi070.stdout:1/939: symlink d6/dc/d14/d1f/d127/l13e 0 2023-10-08T08:46:01.731 INFO:tasks.workunit.client.0.smithi070.stdout:1/940: symlink d6/dc/d128/l13f 0 2023-10-08T08:46:01.732 INFO:tasks.workunit.client.0.smithi070.stdout:1/941: chown d6/dc/d14/d1f/d63/db3/d38/f4e 113717 1 2023-10-08T08:46:01.740 INFO:tasks.workunit.client.0.smithi070.stdout:4/715: dread dc/d17/d24/d4c/d4e/f57 [0,4194304] 0 2023-10-08T08:46:01.741 INFO:tasks.workunit.client.0.smithi070.stdout:4/716: symlink dc/d17/d1f/d5e/le8 0 2023-10-08T08:46:01.742 INFO:tasks.workunit.client.0.smithi070.stdout:4/717: symlink dc/d17/d24/d6b/le9 0 2023-10-08T08:46:01.743 INFO:tasks.workunit.client.0.smithi070.stdout:4/718: creat dc/d17/fea x:0 0 0 2023-10-08T08:46:01.767 INFO:tasks.workunit.client.0.smithi070.stdout:4/719: dwrite dc/d17/d24/d4c/d4e/f5d [0,4194304] 0 2023-10-08T08:46:01.767 INFO:tasks.workunit.client.0.smithi070.stdout:0/942: dread d1/d1d/d24/df4/f6c [0,4194304] 0 2023-10-08T08:46:01.768 INFO:tasks.workunit.client.0.smithi070.stdout:6/725: sync 2023-10-08T08:46:01.768 INFO:tasks.workunit.client.0.smithi070.stdout:6/726: chown df/d26/d42/d43/d4a/d75/d7e 2313213 1 2023-10-08T08:46:01.769 INFO:tasks.workunit.client.0.smithi070.stdout:6/727: stat df/d26/d42/db1/c91 0 2023-10-08T08:46:01.769 INFO:tasks.workunit.client.0.smithi070.stdout:5/833: sync 2023-10-08T08:46:01.769 INFO:tasks.workunit.client.0.smithi070.stdout:0/943: creat d1/d62/d103/f128 x:0 0 0 2023-10-08T08:46:01.771 INFO:tasks.workunit.client.0.smithi070.stdout:0/944: rename d1/d62/d54/d5e/fb0 to d1/d62/d54/d5e/f129 0 2023-10-08T08:46:01.772 INFO:tasks.workunit.client.0.smithi070.stdout:6/728: write df/d11/f4d [4147168,95878] 0 2023-10-08T08:46:01.772 INFO:tasks.workunit.client.0.smithi070.stdout:6/729: getdents df/d26/d42/d4b/db6/d7d/dc8 0 2023-10-08T08:46:01.773 INFO:tasks.workunit.client.0.smithi070.stdout:0/945: symlink d1/d76/d102/l12a 0 2023-10-08T08:46:01.777 INFO:tasks.workunit.client.0.smithi070.stdout:5/834: unlink d5/cc4 0 2023-10-08T08:46:01.779 INFO:tasks.workunit.client.0.smithi070.stdout:9/649: dread d1/f74 [0,4194304] 0 2023-10-08T08:46:01.780 INFO:tasks.workunit.client.0.smithi070.stdout:9/650: creat d1/dd/d19/d38/d77/d96/fc1 x:0 0 0 2023-10-08T08:46:01.780 INFO:tasks.workunit.client.0.smithi070.stdout:9/651: fsync d1/dd/f18 0 2023-10-08T08:46:01.781 INFO:tasks.workunit.client.0.smithi070.stdout:5/835: write d5/da/d22/f59 [835903,69440] 0 2023-10-08T08:46:01.783 INFO:tasks.workunit.client.0.smithi070.stdout:4/720: dread dc/d17/d24/d4c/fc6 [0,4194304] 0 2023-10-08T08:46:01.783 INFO:tasks.workunit.client.0.smithi070.stdout:9/652: creat d1/dd/d39/fc2 x:0 0 0 2023-10-08T08:46:01.784 INFO:tasks.workunit.client.0.smithi070.stdout:5/836: symlink d5/da/df6/l115 0 2023-10-08T08:46:01.788 INFO:tasks.workunit.client.0.smithi070.stdout:9/653: write d1/f25 [1423087,3007] 0 2023-10-08T08:46:01.788 INFO:tasks.workunit.client.0.smithi070.stdout:5/837: getdents d5/da/d22/ddd/d38/d55 0 2023-10-08T08:46:01.788 INFO:tasks.workunit.client.0.smithi070.stdout:9/654: stat d1/dd/d26/d27/d2d/c9c 0 2023-10-08T08:46:01.790 INFO:tasks.workunit.client.0.smithi070.stdout:5/838: write d5/da/d22/ddd/d2a/f58 [1443393,117748] 0 2023-10-08T08:46:01.792 INFO:tasks.workunit.client.0.smithi070.stdout:8/881: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/d11a/f28 [4194304,4194304] 0 2023-10-08T08:46:01.792 INFO:tasks.workunit.client.0.smithi070.stdout:8/882: readlink d1/d2/d6/d22/d5b/d74/de1/d1a/l36 0 2023-10-08T08:46:01.792 INFO:tasks.workunit.client.0.smithi070.stdout:8/883: chown d1/d2/d6/d22/d5b/d74/de1/d3a/dea/d106 8 1 2023-10-08T08:46:01.792 INFO:tasks.workunit.client.0.smithi070.stdout:7/849: dwrite d3/d19/f3c [0,4194304] 0 2023-10-08T08:46:01.795 INFO:tasks.workunit.client.0.smithi070.stdout:8/884: creat d1/d2/d6/d22/d9e/da7/df9/f12e x:0 0 0 2023-10-08T08:46:01.796 INFO:tasks.workunit.client.0.smithi070.stdout:7/850: mkdir d3/d77/d11c 0 2023-10-08T08:46:01.796 INFO:tasks.workunit.client.0.smithi070.stdout:7/851: write d3/da9/d4a/d9/da4/dae/fe5 [1573396,91199] 0 2023-10-08T08:46:01.796 INFO:tasks.workunit.client.0.smithi070.stdout:7/852: fdatasync d3/d79/de3/f10e 0 2023-10-08T08:46:01.797 INFO:tasks.workunit.client.0.smithi070.stdout:5/839: write d5/d5f/d61/d30/d83/f8c [1511044,115907] 0 2023-10-08T08:46:01.813 INFO:tasks.workunit.client.0.smithi070.stdout:8/885: dread d1/d4d/f81 [0,4194304] 0 2023-10-08T08:46:01.814 INFO:tasks.workunit.client.0.smithi070.stdout:8/886: chown d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/cb2 13 1 2023-10-08T08:46:01.817 INFO:tasks.workunit.client.0.smithi070.stdout:1/942: dwrite f5 [0,4194304] 0 2023-10-08T08:46:01.817 INFO:tasks.workunit.client.0.smithi070.stdout:1/943: fsync d6/dc/d14/dc1/dca/d117/da1/ddb/f119 0 2023-10-08T08:46:01.818 INFO:tasks.workunit.client.0.smithi070.stdout:9/655: dread d1/dd/d19/d38/d4f/db9/f95 [0,4194304] 0 2023-10-08T08:46:01.818 INFO:tasks.workunit.client.0.smithi070.stdout:0/946: dwrite d1/d76/d7a/f104 [0,4194304] 0 2023-10-08T08:46:01.818 INFO:tasks.workunit.client.0.smithi070.stdout:6/730: dwrite df/d53/f5a [0,4194304] 0 2023-10-08T08:46:01.818 INFO:tasks.workunit.client.0.smithi070.stdout:4/721: dread dc/d17/d24/f73 [0,4194304] 0 2023-10-08T08:46:01.818 INFO:tasks.workunit.client.0.smithi070.stdout:6/731: stat df/lc7 0 2023-10-08T08:46:01.819 INFO:tasks.workunit.client.0.smithi070.stdout:1/944: rename d6/dc/d14/d90/de4/c12b to d6/dc/d136/dfc/c140 0 2023-10-08T08:46:01.819 INFO:tasks.workunit.client.0.smithi070.stdout:4/722: truncate dc/d5f/fbe 2582997 0 2023-10-08T08:46:01.819 INFO:tasks.workunit.client.0.smithi070.stdout:4/723: stat dc/lbc 0 2023-10-08T08:46:01.819 INFO:tasks.workunit.client.0.smithi070.stdout:4/724: chown dc/d5a/lb5 7842 1 2023-10-08T08:46:01.819 INFO:tasks.workunit.client.0.smithi070.stdout:4/725: chown dc/d17/d24/d4c/d4e/fbd 0 1 2023-10-08T08:46:01.821 INFO:tasks.workunit.client.0.smithi070.stdout:9/656: mkdir d1/dd/d39/da4/dc3 0 2023-10-08T08:46:01.821 INFO:tasks.workunit.client.0.smithi070.stdout:7/853: dread d3/f96 [0,4194304] 0 2023-10-08T08:46:01.823 INFO:tasks.workunit.client.0.smithi070.stdout:9/657: write d1/dd/d1a/d40/f4e [3164214,3541] 0 2023-10-08T08:46:01.824 INFO:tasks.workunit.client.0.smithi070.stdout:6/732: link df/d26/d42/db1/f9c df/d26/d42/d43/fea 0 2023-10-08T08:46:01.825 INFO:tasks.workunit.client.0.smithi070.stdout:1/945: truncate d6/dc/d97/fcf 1437461 0 2023-10-08T08:46:01.826 INFO:tasks.workunit.client.0.smithi070.stdout:7/854: creat d3/d79/de3/f11d x:0 0 0 2023-10-08T08:46:01.826 INFO:tasks.workunit.client.0.smithi070.stdout:4/726: read dc/d5f/fb3 [180815,97584] 0 2023-10-08T08:46:01.827 INFO:tasks.workunit.client.0.smithi070.stdout:4/727: write dc/d17/d24/d55/fd3 [319561,54543] 0 2023-10-08T08:46:01.828 INFO:tasks.workunit.client.0.smithi070.stdout:7/855: read d3/d19/d1a/f22 [865049,33915] 0 2023-10-08T08:46:01.832 INFO:tasks.workunit.client.0.smithi070.stdout:6/733: creat df/d26/d78/dd5/feb x:0 0 0 2023-10-08T08:46:01.833 INFO:tasks.workunit.client.0.smithi070.stdout:5/840: dwrite d5/d5f/d61/d30/d54/dab/fd1 [0,4194304] 0 2023-10-08T08:46:01.833 INFO:tasks.workunit.client.0.smithi070.stdout:7/856: truncate d3/d19/d1a/f4b 2256045 0 2023-10-08T08:46:01.836 INFO:tasks.workunit.client.0.smithi070.stdout:9/658: rmdir d1/dd/d8d 39 2023-10-08T08:46:01.836 INFO:tasks.workunit.client.0.smithi070.stdout:0/947: dread d1/d14/d1f/fe8 [0,4194304] 0 2023-10-08T08:46:01.836 INFO:tasks.workunit.client.0.smithi070.stdout:7/857: truncate d3/da9/d4a/f8 6325457 0 2023-10-08T08:46:01.838 INFO:tasks.workunit.client.0.smithi070.stdout:7/858: symlink d3/da9/d4a/d9/da4/dd6/ddb/l11e 0 2023-10-08T08:46:01.838 INFO:tasks.workunit.client.0.smithi070.stdout:7/859: fdatasync d3/da9/d1e/f10f 0 2023-10-08T08:46:01.840 INFO:tasks.workunit.client.0.smithi070.stdout:6/734: rename df/d26/d42/d43/c69 to df/cec 0 2023-10-08T08:46:01.842 INFO:tasks.workunit.client.0.smithi070.stdout:5/841: link d5/da/d22/d75/cba d5/d5f/d61/d30/d54/dab/c116 0 2023-10-08T08:46:01.842 INFO:tasks.workunit.client.0.smithi070.stdout:4/728: dread dc/d17/f21 [0,4194304] 0 2023-10-08T08:46:01.843 INFO:tasks.workunit.client.0.smithi070.stdout:0/948: rename d1/d1d/d24/df4/cc2 to d1/d14/dff/c12b 0 2023-10-08T08:46:01.843 INFO:tasks.workunit.client.0.smithi070.stdout:5/842: creat d5/da/d22/ddd/d2a/dc0/f117 x:0 0 0 2023-10-08T08:46:01.843 INFO:tasks.workunit.client.0.smithi070.stdout:4/729: creat dc/d68/feb x:0 0 0 2023-10-08T08:46:01.844 INFO:tasks.workunit.client.0.smithi070.stdout:4/730: truncate dc/d5a/fa2 2459677 0 2023-10-08T08:46:01.845 INFO:tasks.workunit.client.0.smithi070.stdout:5/843: rename d5/d5f/d61/d30/d54/cce to d5/d5f/c118 0 2023-10-08T08:46:01.847 INFO:tasks.workunit.client.0.smithi070.stdout:4/731: rename dc/d17/d24/f73 to dc/d17/d79/fec 0 2023-10-08T08:46:01.867 INFO:tasks.workunit.client.0.smithi070.stdout:7/860: dwrite d3/da9/d4a/d9/f74 [0,4194304] 0 2023-10-08T08:46:01.867 INFO:tasks.workunit.client.0.smithi070.stdout:7/861: fdatasync d3/da9/d4a/d9/d97/f9b 0 2023-10-08T08:46:01.868 INFO:tasks.workunit.client.0.smithi070.stdout:5/844: write d5/da/f15 [4368788,37719] 0 2023-10-08T08:46:01.868 INFO:tasks.workunit.client.0.smithi070.stdout:0/949: dwrite d1/d1d/d4d/f5c [0,4194304] 0 2023-10-08T08:46:01.869 INFO:tasks.workunit.client.0.smithi070.stdout:7/862: rmdir d3/d77/d112 39 2023-10-08T08:46:01.872 INFO:tasks.workunit.client.0.smithi070.stdout:5/845: symlink d5/da/d4d/dc2/l119 0 2023-10-08T08:46:01.872 INFO:tasks.workunit.client.0.smithi070.stdout:5/846: stat d5/da/d4d/dfb/c110 0 2023-10-08T08:46:01.880 INFO:tasks.workunit.client.0.smithi070.stdout:1/946: dwrite d6/dc/d14/d90/ff1 [0,4194304] 0 2023-10-08T08:46:01.881 INFO:tasks.workunit.client.0.smithi070.stdout:4/732: dread dc/d17/d24/d4c/d4e/dab/fc5 [0,4194304] 0 2023-10-08T08:46:01.884 INFO:tasks.workunit.client.0.smithi070.stdout:7/863: write d3/da9/d1e/fab [3733306,112421] 0 2023-10-08T08:46:01.884 INFO:tasks.workunit.client.0.smithi070.stdout:7/864: stat d3/da9/d4a/d9/da4/dae/fe5 0 2023-10-08T08:46:01.884 INFO:tasks.workunit.client.0.smithi070.stdout:9/659: dwrite d1/dd/d26/d27/d2d/d70/d90/f9e [4194304,4194304] 0 2023-10-08T08:46:01.886 INFO:tasks.workunit.client.0.smithi070.stdout:4/733: symlink dc/d17/d79/dad/db6/dc1/dc3/led 0 2023-10-08T08:46:01.886 INFO:tasks.workunit.client.0.smithi070.stdout:7/865: symlink d3/da9/d4a/d9/da4/dd6/ddb/l11f 0 2023-10-08T08:46:01.887 INFO:tasks.workunit.client.0.smithi070.stdout:9/660: write d1/dd/f87 [694094,6121] 0 2023-10-08T08:46:01.892 INFO:tasks.workunit.client.0.smithi070.stdout:9/661: rename d1/dd/d8d/l73 to d1/dd/d19/d38/d4f/db9/lc4 0 2023-10-08T08:46:01.892 INFO:tasks.workunit.client.0.smithi070.stdout:9/662: fsync d1/dd/d19/d38/d77/d96/fc1 0 2023-10-08T08:46:01.894 INFO:tasks.workunit.client.0.smithi070.stdout:9/663: rename d1/dd/d19/d38/f5a to d1/dd/d26/d27/d2d/d70/d90/dab/fc5 0 2023-10-08T08:46:01.906 INFO:tasks.workunit.client.0.smithi070.stdout:7/866: dwrite d3/da9/d4a/d9/d97/fda [0,4194304] 0 2023-10-08T08:46:01.908 INFO:tasks.workunit.client.0.smithi070.stdout:7/867: read d3/da9/d4a/d9/d97/fda [442044,15764] 0 2023-10-08T08:46:01.920 INFO:tasks.workunit.client.0.smithi070.stdout:7/868: dread d3/da9/d4a/d9/d97/fda [0,4194304] 0 2023-10-08T08:46:01.920 INFO:tasks.workunit.client.0.smithi070.stdout:7/869: chown d3/l27 906 1 2023-10-08T08:46:01.977 INFO:tasks.workunit.client.0.smithi070.stdout:7/870: dwrite d3/da9/f64 [0,4194304] 0 2023-10-08T08:46:01.977 INFO:tasks.workunit.client.0.smithi070.stdout:7/871: readlink d3/l75 0 2023-10-08T08:46:01.999 INFO:tasks.workunit.client.0.smithi070.stdout:7/872: dwrite d3/d19/d1a/f20 [0,4194304] 0 2023-10-08T08:46:02.000 INFO:tasks.workunit.client.0.smithi070.stdout:0/950: dwrite d1/d1d/d4d/d9d/f4f [0,4194304] 0 2023-10-08T08:46:02.002 INFO:tasks.workunit.client.0.smithi070.stdout:0/951: write d1/dd/dae/fc7 [7579945,43836] 0 2023-10-08T08:46:02.038 INFO:tasks.workunit.client.0.smithi070.stdout:9/664: dread d1/dd/f61 [0,4194304] 0 2023-10-08T08:46:02.039 INFO:tasks.workunit.client.0.smithi070.stdout:9/665: creat d1/dd/d19/d38/d77/fc6 x:0 0 0 2023-10-08T08:46:02.040 INFO:tasks.workunit.client.0.smithi070.stdout:9/666: stat d1/dd/d19/d38/ca5 0 2023-10-08T08:46:02.041 INFO:tasks.workunit.client.0.smithi070.stdout:9/667: rename d1/dd/d26/d5d to d1/dd/d19/d38/d4f/dc7 0 2023-10-08T08:46:02.043 INFO:tasks.workunit.client.0.smithi070.stdout:4/734: write dc/d68/fcb [671150,11730] 0 2023-10-08T08:46:02.044 INFO:tasks.workunit.client.0.smithi070.stdout:5/847: dwrite d5/da/d22/ddd/d38/dc3/fe7 [0,4194304] 0 2023-10-08T08:46:02.044 INFO:tasks.workunit.client.0.smithi070.stdout:0/952: dread d1/d1d/f2e [0,4194304] 0 2023-10-08T08:46:02.044 INFO:tasks.workunit.client.0.smithi070.stdout:4/735: write dc/d17/d24/d6b/f8f [269676,120395] 0 2023-10-08T08:46:02.044 INFO:tasks.workunit.client.0.smithi070.stdout:0/953: symlink d1/d62/d103/l12c 0 2023-10-08T08:46:02.045 INFO:tasks.workunit.client.0.smithi070.stdout:5/848: creat d5/da/f11a x:0 0 0 2023-10-08T08:46:02.045 INFO:tasks.workunit.client.0.smithi070.stdout:4/736: creat dc/d17/d1f/d5e/dd0/fee x:0 0 0 2023-10-08T08:46:02.046 INFO:tasks.workunit.client.0.smithi070.stdout:5/849: fsync d5/f101 0 2023-10-08T08:46:02.046 INFO:tasks.workunit.client.0.smithi070.stdout:5/850: truncate d5/d5f/d61/d30/d54/d62/fbc 888335 0 2023-10-08T08:46:02.047 INFO:tasks.workunit.client.0.smithi070.stdout:0/954: rename d1/dd/fb4 to d1/d62/d54/d5e/d80/f12d 0 2023-10-08T08:46:02.056 INFO:tasks.workunit.client.0.smithi070.stdout:0/955: write d1/d62/d54/f73 [524483,75140] 0 2023-10-08T08:46:02.057 INFO:tasks.workunit.client.0.smithi070.stdout:4/737: dread dc/d17/d24/d55/fa0 [0,4194304] 0 2023-10-08T08:46:02.058 INFO:tasks.workunit.client.0.smithi070.stdout:0/956: symlink d1/d14/d1f/l12e 0 2023-10-08T08:46:02.059 INFO:tasks.workunit.client.0.smithi070.stdout:4/738: rename dc/d17/d24/d37/c5c to dc/d17/d24/d6b/cef 0 2023-10-08T08:46:02.061 INFO:tasks.workunit.client.0.smithi070.stdout:0/957: creat d1/dd/dae/f12f x:0 0 0 2023-10-08T08:46:02.061 INFO:tasks.workunit.client.0.smithi070.stdout:0/958: dread - d1/d62/f106 zero size 2023-10-08T08:46:02.061 INFO:tasks.workunit.client.0.smithi070.stdout:0/959: chown d1/dd/f13 225108 1 2023-10-08T08:46:02.062 INFO:tasks.workunit.client.0.smithi070.stdout:0/960: getdents d1/d76/dd5/d122 0 2023-10-08T08:46:02.063 INFO:tasks.workunit.client.0.smithi070.stdout:0/961: symlink d1/d14/de5/d11d/l130 0 2023-10-08T08:46:02.066 INFO:tasks.workunit.client.0.smithi070.stdout:0/962: read d1/faa [3858323,130367] 0 2023-10-08T08:46:02.066 INFO:tasks.workunit.client.0.smithi070.stdout:0/963: write d1/d14/fd9 [4276884,4064] 0 2023-10-08T08:46:02.067 INFO:tasks.workunit.client.0.smithi070.stdout:9/668: dwrite d1/dd/d8d/fad [0,4194304] 0 2023-10-08T08:46:02.068 INFO:tasks.workunit.client.0.smithi070.stdout:0/964: unlink d1/d62/d54/d5e/d80/d8a/dc3/lc9 0 2023-10-08T08:46:02.069 INFO:tasks.workunit.client.0.smithi070.stdout:0/965: readlink d1/d1d/d24/l2a 0 2023-10-08T08:46:02.069 INFO:tasks.workunit.client.0.smithi070.stdout:9/669: creat d1/dd/d19/fc8 x:0 0 0 2023-10-08T08:46:02.069 INFO:tasks.workunit.client.0.smithi070.stdout:5/851: dwrite d5/d5f/d63/d8b/da8/dac/fb8 [0,4194304] 0 2023-10-08T08:46:02.069 INFO:tasks.workunit.client.0.smithi070.stdout:5/852: stat d5/da/d22/ddd/d38/dc3 0 2023-10-08T08:46:02.073 INFO:tasks.workunit.client.0.smithi070.stdout:9/670: write d1/dd/d26/f54 [1409838,84900] 0 2023-10-08T08:46:02.078 INFO:tasks.workunit.client.0.smithi070.stdout:9/671: mkdir d1/dd/d39/dc9 0 2023-10-08T08:46:02.080 INFO:tasks.workunit.client.0.smithi070.stdout:9/672: rename d1/dd/d1a/d40/la6 to d1/dd/d19/d38/d77/lca 0 2023-10-08T08:46:02.081 INFO:tasks.workunit.client.0.smithi070.stdout:5/853: dread d5/da/d22/f59 [0,4194304] 0 2023-10-08T08:46:02.082 INFO:tasks.workunit.client.0.smithi070.stdout:5/854: mknod d5/da/d22/d75/dfe/c11b 0 2023-10-08T08:46:02.083 INFO:tasks.workunit.client.0.smithi070.stdout:4/739: dwrite dc/d17/d24/f40 [0,4194304] 0 2023-10-08T08:46:02.084 INFO:tasks.workunit.client.0.smithi070.stdout:5/855: creat d5/d5f/d61/f11c x:0 0 0 2023-10-08T08:46:02.084 INFO:tasks.workunit.client.0.smithi070.stdout:5/856: fsync d5/da/d22/ff2 0 2023-10-08T08:46:02.085 INFO:tasks.workunit.client.0.smithi070.stdout:4/740: symlink dc/d17/d79/dad/db6/dc1/lf0 0 2023-10-08T08:46:02.086 INFO:tasks.workunit.client.0.smithi070.stdout:2/951: sync 2023-10-08T08:46:02.086 INFO:tasks.workunit.client.0.smithi070.stdout:2/952: write df/d4c/ff2 [1520416,96407] 0 2023-10-08T08:46:02.086 INFO:tasks.workunit.client.0.smithi070.stdout:2/953: chown df/d73/f7f 0 1 2023-10-08T08:46:02.086 INFO:tasks.workunit.client.0.smithi070.stdout:4/741: mknod dc/d17/d79/dad/db6/cf1 0 2023-10-08T08:46:02.088 INFO:tasks.workunit.client.0.smithi070.stdout:2/954: truncate df/d12/d1b/d1c/d69/d100/fa7 1536224 0 2023-10-08T08:46:02.088 INFO:tasks.workunit.client.0.smithi070.stdout:2/955: chown df/d12/d1b/d1c/d79/lc6 1807 1 2023-10-08T08:46:02.089 INFO:tasks.workunit.client.0.smithi070.stdout:4/742: rename dc/d17/d24/d55/fbb to dc/d17/d1f/ff2 0 2023-10-08T08:46:02.089 INFO:tasks.workunit.client.0.smithi070.stdout:9/673: dread d1/dd/d19/d38/f71 [0,4194304] 0 2023-10-08T08:46:02.089 INFO:tasks.workunit.client.0.smithi070.stdout:2/956: link df/c126 df/d3a/c133 0 2023-10-08T08:46:02.090 INFO:tasks.workunit.client.0.smithi070.stdout:9/674: creat d1/dd/fcb x:0 0 0 2023-10-08T08:46:02.091 INFO:tasks.workunit.client.0.smithi070.stdout:9/675: write d1/dd/d26/d27/d2d/fb0 [885208,8939] 0 2023-10-08T08:46:02.093 INFO:tasks.workunit.client.0.smithi070.stdout:9/676: write d1/dd/d1a/d40/f4e [3679017,100773] 0 2023-10-08T08:46:02.093 INFO:tasks.workunit.client.0.smithi070.stdout:9/677: write d1/dd/d26/f54 [2327684,92806] 0 2023-10-08T08:46:02.096 INFO:tasks.workunit.client.0.smithi070.stdout:9/678: symlink d1/dd/d26/d27/lcc 0 2023-10-08T08:46:02.096 INFO:tasks.workunit.client.0.smithi070.stdout:9/679: stat d1/dd/d19/d38/d4f/dc7 0 2023-10-08T08:46:02.096 INFO:tasks.workunit.client.0.smithi070.stdout:9/680: chown d1/dd/c69 31845785 1 2023-10-08T08:46:02.096 INFO:tasks.workunit.client.0.smithi070.stdout:9/681: write d1/fb [5159173,90157] 0 2023-10-08T08:46:02.097 INFO:tasks.workunit.client.0.smithi070.stdout:9/682: creat d1/dd/d19/d97/fcd x:0 0 0 2023-10-08T08:46:02.098 INFO:tasks.workunit.client.0.smithi070.stdout:9/683: creat d1/dd/d19/d38/d4f/db9/fce x:0 0 0 2023-10-08T08:46:02.098 INFO:tasks.workunit.client.0.smithi070.stdout:0/966: dwrite d1/d62/d54/d5e/d80/f12d [0,4194304] 0 2023-10-08T08:46:02.099 INFO:tasks.workunit.client.0.smithi070.stdout:9/684: getdents d1/dd/d39/d66 0 2023-10-08T08:46:02.100 INFO:tasks.workunit.client.0.smithi070.stdout:0/967: fsync d1/d62/d54/f73 0 2023-10-08T08:46:02.100 INFO:tasks.workunit.client.0.smithi070.stdout:0/968: fsync d1/faa 0 2023-10-08T08:46:02.101 INFO:tasks.workunit.client.0.smithi070.stdout:5/857: dread d5/f9f [0,4194304] 0 2023-10-08T08:46:02.103 INFO:tasks.workunit.client.0.smithi070.stdout:5/858: creat d5/da/d4d/dc2/f11d x:0 0 0 2023-10-08T08:46:02.104 INFO:tasks.workunit.client.0.smithi070.stdout:9/685: rename d1/dd/d26/d27/d2d/d70/d90/fbf to d1/dd/fcf 0 2023-10-08T08:46:02.104 INFO:tasks.workunit.client.0.smithi070.stdout:9/686: truncate d1/dd/d19/d97/fcd 764829 0 2023-10-08T08:46:02.104 INFO:tasks.workunit.client.0.smithi070.stdout:5/859: mknod d5/da/d22/ddd/d38/d55/c11e 0 2023-10-08T08:46:02.104 INFO:tasks.workunit.client.0.smithi070.stdout:9/687: write d1/dd/d1a/d40/d76/d93/fa1 [1275909,41000] 0 2023-10-08T08:46:02.105 INFO:tasks.workunit.client.0.smithi070.stdout:9/688: mkdir d1/dd/d1a/d40/d76/d93/dd0 0 2023-10-08T08:46:02.106 INFO:tasks.workunit.client.0.smithi070.stdout:9/689: creat d1/dd/d26/d27/fd1 x:0 0 0 2023-10-08T08:46:02.106 INFO:tasks.workunit.client.0.smithi070.stdout:5/860: creat d5/d5f/d63/d8b/da8/f11f x:0 0 0 2023-10-08T08:46:02.107 INFO:tasks.workunit.client.0.smithi070.stdout:4/743: dread dc/d17/d24/d6b/f6c [0,4194304] 0 2023-10-08T08:46:02.110 INFO:tasks.workunit.client.0.smithi070.stdout:4/744: write dc/d17/f21 [3991281,9490] 0 2023-10-08T08:46:02.112 INFO:tasks.workunit.client.0.smithi070.stdout:4/745: creat dc/d17/d24/d55/ff3 x:0 0 0 2023-10-08T08:46:02.115 INFO:tasks.workunit.client.0.smithi070.stdout:4/746: mkdir dc/d17/d24/d4c/d4e/dda/df4 0 2023-10-08T08:46:02.117 INFO:tasks.workunit.client.0.smithi070.stdout:4/747: read dc/d5f/fb3 [426238,69938] 0 2023-10-08T08:46:02.126 INFO:tasks.workunit.client.0.smithi070.stdout:5/861: dread d5/da/d4d/f85 [0,4194304] 0 2023-10-08T08:46:02.127 INFO:tasks.workunit.client.0.smithi070.stdout:0/969: dwrite d1/dd/fda [0,4194304] 0 2023-10-08T08:46:02.127 INFO:tasks.workunit.client.0.smithi070.stdout:0/970: fdatasync d1/fa 0 2023-10-08T08:46:02.129 INFO:tasks.workunit.client.0.smithi070.stdout:5/862: creat d5/da/d22/d75/dfa/f120 x:0 0 0 2023-10-08T08:46:02.130 INFO:tasks.workunit.client.0.smithi070.stdout:0/971: truncate d1/d76/d7a/f88 323206 0 2023-10-08T08:46:02.130 INFO:tasks.workunit.client.0.smithi070.stdout:0/972: chown d1/d76/d102 276 1 2023-10-08T08:46:02.132 INFO:tasks.workunit.client.0.smithi070.stdout:5/863: rename d5/da/df6 to d5/d5f/d61/d30/d83/d121 0 2023-10-08T08:46:02.132 INFO:tasks.workunit.client.0.smithi070.stdout:5/864: chown d5/da/l4b 272 1 2023-10-08T08:46:02.134 INFO:tasks.workunit.client.0.smithi070.stdout:0/973: rename d1/d1d/d4d/fdb to d1/dd/dae/f131 0 2023-10-08T08:46:02.149 INFO:tasks.workunit.client.0.smithi070.stdout:5/865: dread d5/f7c [4194304,4194304] 0 2023-10-08T08:46:02.165 INFO:tasks.workunit.client.0.smithi070.stdout:5/866: truncate d5/d5f/d63/d8b/da8/dac/fb8 1571467 0 2023-10-08T08:46:02.167 INFO:tasks.workunit.client.0.smithi070.stdout:0/974: dread d1/fa7 [0,4194304] 0 2023-10-08T08:46:02.167 INFO:tasks.workunit.client.0.smithi070.stdout:0/975: getdents d1/d76/d7a/d11f 0 2023-10-08T08:46:02.167 INFO:tasks.workunit.client.0.smithi070.stdout:0/976: fdatasync d1/fa 0 2023-10-08T08:46:02.168 INFO:tasks.workunit.client.0.smithi070.stdout:9/690: dwrite d1/dd/d1a/d40/f4e [4194304,4194304] 0 2023-10-08T08:46:02.168 INFO:tasks.workunit.client.0.smithi070.stdout:5/867: write d5/d5f/d63/d8b/f9e [395546,102527] 0 2023-10-08T08:46:02.168 INFO:tasks.workunit.client.0.smithi070.stdout:6/735: sync 2023-10-08T08:46:02.168 INFO:tasks.workunit.client.0.smithi070.stdout:8/887: sync 2023-10-08T08:46:02.168 INFO:tasks.workunit.client.0.smithi070.stdout:6/736: readlink df/d11/l2a 0 2023-10-08T08:46:02.168 INFO:tasks.workunit.client.0.smithi070.stdout:8/888: fsync d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/f87 0 2023-10-08T08:46:02.168 INFO:tasks.workunit.client.0.smithi070.stdout:0/977: creat d1/d14/d1f/f132 x:0 0 0 2023-10-08T08:46:02.170 INFO:tasks.workunit.client.0.smithi070.stdout:0/978: creat d1/d1d/d4d/d9d/dd3/f133 x:0 0 0 2023-10-08T08:46:02.170 INFO:tasks.workunit.client.0.smithi070.stdout:1/947: sync 2023-10-08T08:46:02.171 INFO:tasks.workunit.client.0.smithi070.stdout:5/868: truncate d5/d5f/d61/fde 243056 0 2023-10-08T08:46:02.171 INFO:tasks.workunit.client.0.smithi070.stdout:9/691: rmdir d1/dd/d26/d27/d2d/d70/d90/dab 39 2023-10-08T08:46:02.171 INFO:tasks.workunit.client.0.smithi070.stdout:9/692: chown d1/f4b 9358 1 2023-10-08T08:46:02.172 INFO:tasks.workunit.client.0.smithi070.stdout:0/979: truncate d1/d62/f55 1066519 0 2023-10-08T08:46:02.172 INFO:tasks.workunit.client.0.smithi070.stdout:0/980: fsync d1/d1d/ff6 0 2023-10-08T08:46:02.177 INFO:tasks.workunit.client.0.smithi070.stdout:0/981: rename d1/d62/d54/dfc/f11c to d1/d62/d54/f134 0 2023-10-08T08:46:02.177 INFO:tasks.workunit.client.0.smithi070.stdout:0/982: chown d1/d14/d1f/d6f/d10c 271 1 2023-10-08T08:46:02.177 INFO:tasks.workunit.client.0.smithi070.stdout:0/983: truncate d1/d62/d54/d5e/d80/d11e/f123 24302 0 2023-10-08T08:46:02.177 INFO:tasks.workunit.client.0.smithi070.stdout:1/948: unlink d6/dc/d14/dc1/dca/d117/d88/le7 0 2023-10-08T08:46:02.179 INFO:tasks.workunit.client.0.smithi070.stdout:0/984: truncate d1/d1d/d4d/d9d/f4f 8259172 0 2023-10-08T08:46:02.180 INFO:tasks.workunit.client.0.smithi070.stdout:1/949: creat d6/dc/d14/dc1/dca/f141 x:0 0 0 2023-10-08T08:46:02.188 INFO:tasks.workunit.client.0.smithi070.stdout:1/950: creat d6/dc/d14/d1f/d11f/d126/d10b/f142 x:0 0 0 2023-10-08T08:46:02.189 INFO:tasks.workunit.client.0.smithi070.stdout:8/889: dread d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/fdb [0,4194304] 0 2023-10-08T08:46:02.190 INFO:tasks.workunit.client.0.smithi070.stdout:8/890: truncate d1/d2/d6/f14 1563271 0 2023-10-08T08:46:02.191 INFO:tasks.workunit.client.0.smithi070.stdout:6/737: dwrite df/d26/f88 [0,4194304] 0 2023-10-08T08:46:02.191 INFO:tasks.workunit.client.0.smithi070.stdout:8/891: creat d1/d2/d6/d22/d9e/d115/f12f x:0 0 0 2023-10-08T08:46:02.193 INFO:tasks.workunit.client.0.smithi070.stdout:1/951: rename d6/dc/d14/dc1/dca/d117/d88/l132 to d6/dc/d14/d70/df6/d11d/l143 0 2023-10-08T08:46:02.193 INFO:tasks.workunit.client.0.smithi070.stdout:1/952: chown d6/dc/d14/d62/lf3 351 1 2023-10-08T08:46:02.194 INFO:tasks.workunit.client.0.smithi070.stdout:8/892: write d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/ffb [226352,111415] 0 2023-10-08T08:46:02.194 INFO:tasks.workunit.client.0.smithi070.stdout:8/893: chown d1/d2/d6/d22/d9e/lf6 833351003 1 2023-10-08T08:46:02.196 INFO:tasks.workunit.client.0.smithi070.stdout:8/894: mknod d1/d4d/c130 0 2023-10-08T08:46:02.196 INFO:tasks.workunit.client.0.smithi070.stdout:9/693: dwrite d1/f2a [0,4194304] 0 2023-10-08T08:46:02.197 INFO:tasks.workunit.client.0.smithi070.stdout:9/694: fsync d1/dd/d26/d27/d2d/fb0 0 2023-10-08T08:46:02.201 INFO:tasks.workunit.client.0.smithi070.stdout:1/953: creat d6/dc/d14/d1f/d11f/f144 x:0 0 0 2023-10-08T08:46:02.203 INFO:tasks.workunit.client.0.smithi070.stdout:5/869: read d5/d5f/d61/fde [133085,26485] 0 2023-10-08T08:46:02.205 INFO:tasks.workunit.client.0.smithi070.stdout:6/738: rmdir df/d26/d42/d55 39 2023-10-08T08:46:02.205 INFO:tasks.workunit.client.0.smithi070.stdout:5/870: truncate d5/f101 4113546 0 2023-10-08T08:46:02.205 INFO:tasks.workunit.client.0.smithi070.stdout:6/739: chown df/d26/d42/db1 482 1 2023-10-08T08:46:02.206 INFO:tasks.workunit.client.0.smithi070.stdout:5/871: rmdir d5/d5f/d63/d8b/d8f 39 2023-10-08T08:46:02.206 INFO:tasks.workunit.client.0.smithi070.stdout:1/954: symlink d6/dc/d14/d1f/l145 0 2023-10-08T08:46:02.207 INFO:tasks.workunit.client.0.smithi070.stdout:6/740: unlink df/d26/d42/d4b/lce 0 2023-10-08T08:46:02.208 INFO:tasks.workunit.client.0.smithi070.stdout:5/872: getdents d5/da/d22/ddd/d38/d55/ddf 0 2023-10-08T08:46:02.209 INFO:tasks.workunit.client.0.smithi070.stdout:5/873: read d5/da/d22/ddd/d38/d55/f90 [5713801,72412] 0 2023-10-08T08:46:02.210 INFO:tasks.workunit.client.0.smithi070.stdout:6/741: rename df/d26/d42/d55/f93 to df/d26/d42/d4b/fed 0 2023-10-08T08:46:02.212 INFO:tasks.workunit.client.0.smithi070.stdout:6/742: creat df/d26/d42/d4b/db6/d7d/dc8/fee x:0 0 0 2023-10-08T08:46:02.214 INFO:tasks.workunit.client.0.smithi070.stdout:6/743: mknod df/d26/d42/d43/d4a/d75/cef 0 2023-10-08T08:46:02.227 INFO:tasks.workunit.client.0.smithi070.stdout:1/955: dwrite d6/dc/f2d [0,4194304] 0 2023-10-08T08:46:02.228 INFO:tasks.workunit.client.0.smithi070.stdout:1/956: mknod d6/dc/d136/dfc/c146 0 2023-10-08T08:46:02.248 INFO:tasks.workunit.client.0.smithi070.stdout:8/895: dread d1/d2/d6/d22/d5b/d74/de1/d2e/d45/f70 [0,4194304] 0 2023-10-08T08:46:02.263 INFO:tasks.workunit.client.0.smithi070.stdout:0/985: dwrite d1/d1d/d4d/d9d/f6a [0,4194304] 0 2023-10-08T08:46:02.263 INFO:tasks.workunit.client.0.smithi070.stdout:0/986: write d1/dd/f10b [5202652,50115] 0 2023-10-08T08:46:02.267 INFO:tasks.workunit.client.0.smithi070.stdout:0/987: mknod d1/d76/dd5/c135 0 2023-10-08T08:46:02.267 INFO:tasks.workunit.client.0.smithi070.stdout:0/988: write d1/d76/f9c [330685,130484] 0 2023-10-08T08:46:02.273 INFO:tasks.workunit.client.0.smithi070.stdout:5/874: dwrite d5/da/d22/f59 [0,4194304] 0 2023-10-08T08:46:02.274 INFO:tasks.workunit.client.0.smithi070.stdout:6/744: dwrite df/d26/d42/d43/d4a/d75/f9b [0,4194304] 0 2023-10-08T08:46:02.274 INFO:tasks.workunit.client.0.smithi070.stdout:5/875: mknod d5/d5f/d61/d30/d54/c122 0 2023-10-08T08:46:02.275 INFO:tasks.workunit.client.0.smithi070.stdout:1/957: dwrite d6/f55 [4194304,4194304] 0 2023-10-08T08:46:02.275 INFO:tasks.workunit.client.0.smithi070.stdout:1/958: chown d6/dc/d14/d62/f77 21 1 2023-10-08T08:46:02.275 INFO:tasks.workunit.client.0.smithi070.stdout:1/959: write d6/dc/d14/f129 [433246,363] 0 2023-10-08T08:46:02.276 INFO:tasks.workunit.client.0.smithi070.stdout:8/896: dwrite d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/d10d/f122 [0,4194304] 0 2023-10-08T08:46:02.276 INFO:tasks.workunit.client.0.smithi070.stdout:8/897: fsync d1/d2/d6/d22/d5b/d74/f8b 0 2023-10-08T08:46:02.285 INFO:tasks.workunit.client.0.smithi070.stdout:1/960: creat d6/dc/d14/d1f/d63/db3/d13b/f147 x:0 0 0 2023-10-08T08:46:02.293 INFO:tasks.workunit.client.0.smithi070.stdout:7/873: sync 2023-10-08T08:46:02.293 INFO:tasks.workunit.client.0.smithi070.stdout:7/874: truncate d3/da9/d4a/d9/da4/dae/fe5 1733627 0 2023-10-08T08:46:02.295 INFO:tasks.workunit.client.0.smithi070.stdout:8/898: dread d1/d2/d6/d22/d5b/d74/de1/d2e/f6e [0,4194304] 0 2023-10-08T08:46:02.295 INFO:tasks.workunit.client.0.smithi070.stdout:7/875: creat d3/d19/d95/f120 x:0 0 0 2023-10-08T08:46:02.300 INFO:tasks.workunit.client.0.smithi070.stdout:7/876: unlink d3/l75 0 2023-10-08T08:46:02.307 INFO:tasks.workunit.client.0.smithi070.stdout:1/961: dwrite d6/dc/d14/dc1/dca/d117/d7e/f11e [0,4194304] 0 2023-10-08T08:46:02.307 INFO:tasks.workunit.client.0.smithi070.stdout:1/962: getdents d6/dc/d14/d62/d131 0 2023-10-08T08:46:02.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:46:02.339 INFO:tasks.workunit.client.0.smithi070.stdout:6/745: dwrite df/d26/d42/d43/d4a/f68 [4194304,4194304] 0 2023-10-08T08:46:02.345 INFO:tasks.workunit.client.0.smithi070.stdout:8/899: dread d1/d2/d6/d22/d5b/d74/de1/d1a/fc1 [0,4194304] 0 2023-10-08T08:46:02.345 INFO:tasks.workunit.client.0.smithi070.stdout:8/900: chown d1/d2/d6/l9 44729 1 2023-10-08T08:46:02.345 INFO:tasks.workunit.client.0.smithi070.stdout:8/901: chown d1/d2/d6/d22/d5c/f8d 4127214 1 2023-10-08T08:46:02.346 INFO:tasks.workunit.client.0.smithi070.stdout:8/902: chown d1/l11 3241 1 2023-10-08T08:46:02.347 INFO:tasks.workunit.client.0.smithi070.stdout:8/903: chown d1/d2/d6/d22/d5c/c120 3384416 1 2023-10-08T08:46:02.347 INFO:tasks.workunit.client.0.smithi070.stdout:8/904: stat d1/d2/d6/d22/d5b/d74/de1/d1a/f1b 0 2023-10-08T08:46:02.347 INFO:tasks.workunit.client.0.smithi070.stdout:1/963: dread d6/dc/d14/dc1/dca/d117/d7e/f8d [0,4194304] 0 2023-10-08T08:46:02.347 INFO:tasks.workunit.client.0.smithi070.stdout:8/905: stat d1/d2/d6/d22/d5b/d74/de1/d3a/le6 0 2023-10-08T08:46:02.347 INFO:tasks.workunit.client.0.smithi070.stdout:0/989: dwrite d1/d1d/d24/df4/f59 [0,4194304] 0 2023-10-08T08:46:02.347 INFO:tasks.workunit.client.0.smithi070.stdout:0/990: fsync d1/d62/d54/f134 0 2023-10-08T08:46:02.348 INFO:tasks.workunit.client.0.smithi070.stdout:7/877: dwrite d3/d79/de3/f10e [0,4194304] 0 2023-10-08T08:46:02.348 INFO:tasks.workunit.client.0.smithi070.stdout:8/906: symlink d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/ded/l131 0 2023-10-08T08:46:02.348 INFO:tasks.workunit.client.0.smithi070.stdout:1/964: creat d6/dc/d14/dc1/dca/d117/da1/ddb/d12f/f148 x:0 0 0 2023-10-08T08:46:02.349 INFO:tasks.workunit.client.0.smithi070.stdout:8/907: creat d1/d2/d6/f132 x:0 0 0 2023-10-08T08:46:02.350 INFO:tasks.workunit.client.0.smithi070.stdout:6/746: unlink df/d26/d42/d4b/db6/l79 0 2023-10-08T08:46:02.351 INFO:tasks.workunit.client.0.smithi070.stdout:1/965: write d6/dc/d14/d62/f6e [3360528,89019] 0 2023-10-08T08:46:02.351 INFO:tasks.workunit.client.0.smithi070.stdout:0/991: mkdir d1/d14/d1f/d6f/d136 0 2023-10-08T08:46:02.359 INFO:tasks.workunit.client.0.smithi070.stdout:6/747: dread - df/d26/d42/d4b/db6/fd2 zero size 2023-10-08T08:46:02.361 INFO:tasks.workunit.client.0.smithi070.stdout:1/966: creat d6/dc/d14/d1f/d63/db3/d38/d4b/f149 x:0 0 0 2023-10-08T08:46:02.362 INFO:tasks.workunit.client.0.smithi070.stdout:0/992: mknod d1/d14/d1f/d6f/c137 0 2023-10-08T08:46:02.363 INFO:tasks.workunit.client.0.smithi070.stdout:1/967: write d6/dc/d14/d1f/d63/db3/d38/f4a [1012722,67976] 0 2023-10-08T08:46:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:6/748: symlink df/d26/d42/d43/d4a/d75/d7e/lf0 0 2023-10-08T08:46:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:6/749: dread - df/d26/d42/d55/fac zero size 2023-10-08T08:46:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:6/750: chown df/d26/d42/d4b/ce2 95418 1 2023-10-08T08:46:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:0/993: mkdir d1/d76/d7a/d11f/d138 0 2023-10-08T08:46:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:1/968: unlink d6/dc/d14/d1f/d63/db3/d38/f9f 0 2023-10-08T08:46:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:1/969: readlink d6/dc/d14/d90/lee 0 2023-10-08T08:46:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:1/970: dread - d6/dc/d14/dc1/f11c zero size 2023-10-08T08:46:02.388 INFO:tasks.workunit.client.0.smithi070.stdout:0/994: dread d1/d1d/d4d/d9d/fa1 [0,4194304] 0 2023-10-08T08:46:02.396 INFO:tasks.workunit.client.0.smithi070.stdout:7/878: dwrite d3/da9/d4a/d9/da4/dd6/fea [0,4194304] 0 2023-10-08T08:46:02.398 INFO:tasks.workunit.client.0.smithi070.stdout:6/751: dwrite df/d26/d78/d90/fb7 [0,4194304] 0 2023-10-08T08:46:02.402 INFO:tasks.workunit.client.0.smithi070.stdout:6/752: symlink df/d26/d42/d4b/lf1 0 2023-10-08T08:46:02.403 INFO:tasks.workunit.client.0.smithi070.stdout:1/971: dwrite d6/dc/d14/d1f/f2b [0,4194304] 0 2023-10-08T08:46:02.403 INFO:tasks.workunit.client.0.smithi070.stdout:6/753: creat df/d26/d78/ff2 x:0 0 0 2023-10-08T08:46:02.409 INFO:tasks.workunit.client.0.smithi070.stdout:6/754: creat df/d11/ff3 x:0 0 0 2023-10-08T08:46:02.409 INFO:tasks.workunit.client.0.smithi070.stdout:6/755: readlink df/d26/l33 0 2023-10-08T08:46:02.409 INFO:tasks.workunit.client.0.smithi070.stdout:6/756: truncate df/f61 1001547 0 2023-10-08T08:46:02.412 INFO:tasks.workunit.client.0.smithi070.stdout:0/995: dwrite d1/d14/d1f/f42 [0,4194304] 0 2023-10-08T08:46:02.412 INFO:tasks.workunit.client.0.smithi070.stdout:6/757: read df/d11/f7f [5467898,10768] 0 2023-10-08T08:46:02.414 INFO:tasks.workunit.client.0.smithi070.stdout:0/996: write d1/fa [403689,46365] 0 2023-10-08T08:46:02.414 INFO:tasks.workunit.client.0.smithi070.stdout:6/758: creat df/d26/d42/d4b/dba/ff4 x:0 0 0 2023-10-08T08:46:02.414 INFO:tasks.workunit.client.0.smithi070.stdout:7/879: write d3/da9/d1e/d76/fb7 [58695,51263] 0 2023-10-08T08:46:02.415 INFO:tasks.workunit.client.0.smithi070.stdout:0/997: creat d1/d62/d54/dfc/d10d/f139 x:0 0 0 2023-10-08T08:46:02.416 INFO:tasks.workunit.client.0.smithi070.stdout:6/759: mknod df/d26/d42/d4b/cf5 0 2023-10-08T08:46:02.418 INFO:tasks.workunit.client.0.smithi070.stdout:0/998: mknod d1/d76/d7a/d11f/c13a 0 2023-10-08T08:46:02.419 INFO:tasks.workunit.client.0.smithi070.stdout:7/880: write d3/f96 [1592260,126493] 0 2023-10-08T08:46:02.423 INFO:tasks.workunit.client.0.smithi070.stdout:6/760: rename df/d26/d42/d4b/lf1 to df/d26/d78/d90/lf6 0 2023-10-08T08:46:02.427 INFO:tasks.workunit.client.0.smithi070.stdout:1/972: dwrite d6/dc/d14/d1f/d63/db3/d38/d4b/fc6 [0,4194304] 0 2023-10-08T08:46:02.429 INFO:tasks.workunit.client.0.smithi070.stdout:1/973: unlink d6/dc/d97/d11b/f139 0 2023-10-08T08:46:02.439 INFO:tasks.workunit.client.0.smithi070.stdout:1/974: dread d6/dc/d97/fec [4194304,4194304] 0 2023-10-08T08:46:02.442 INFO:tasks.workunit.client.0.smithi070.stdout:1/975: link d6/dc/d14/d90/de4/fe6 d6/dc/d14/dc1/dca/d135/f14a 0 2023-10-08T08:46:02.443 INFO:tasks.workunit.client.0.smithi070.stdout:7/881: dwrite d3/da9/d4a/d9/d97/fda [4194304,4194304] 0 2023-10-08T08:46:02.444 INFO:tasks.workunit.client.0.smithi070.stdout:1/976: creat d6/dc/d14/dc1/dca/f14b x:0 0 0 2023-10-08T08:46:02.449 INFO:tasks.workunit.client.0.smithi070.stdout:7/882: rename d3/d19/d1a/cc6 to d3/d77/c121 0 2023-10-08T08:46:02.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.479+0000 7f71e37ea700 1 -- 172.21.15.70:0/2167372539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc0ff620 msgr2=0x7f71dc0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:02.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.479+0000 7f71e37ea700 1 --2- 172.21.15.70:0/2167372539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc0ff620 0x7f71dc0ffaa0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009990 tx=0x7f71cc009ca0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.479+0000 7f71e37ea700 1 -- 172.21.15.70:0/2167372539 shutdown_connections 2023-10-08T08:46:02.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.479+0000 7f71e37ea700 1 --2- 172.21.15.70:0/2167372539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71dc0fffe0 0x7f71dc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.479+0000 7f71e37ea700 1 --2- 172.21.15.70:0/2167372539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71dc1056b0 0x7f71dc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.479+0000 7f71e37ea700 1 --2- 172.21.15.70:0/2167372539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc0ff620 0x7f71dc0ffaa0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.479+0000 7f71e37ea700 1 -- 172.21.15.70:0/2167372539 >> 172.21.15.70:0/2167372539 conn(0x7f71dc076780 msgr2=0x7f71dc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:02.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.479+0000 7f71e37ea700 1 -- 172.21.15.70:0/2167372539 shutdown_connections 2023-10-08T08:46:02.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.479+0000 7f71e37ea700 1 -- 172.21.15.70:0/2167372539 wait complete. 2023-10-08T08:46:02.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e37ea700 1 Processor -- start 2023-10-08T08:46:02.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e37ea700 1 -- start start 2023-10-08T08:46:02.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e37ea700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71dc0ff620 0x7f71dc197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e37ea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71dc0fffe0 0x7f71dc197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e37ea700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc1056b0 0x7f71dc1a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e37ea700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc198750 con 0x7f71dc1056b0 2023-10-08T08:46:02.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e37ea700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1a2f10 con 0x7f71dc0ff620 2023-10-08T08:46:02.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e37ea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1a3050 con 0x7f71dc0fffe0 2023-10-08T08:46:02.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e1d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc1056b0 0x7f71dc1a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e1d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc1056b0 0x7f71dc1a29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52796/0 (socket says 172.21.15.70:52796) 2023-10-08T08:46:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e1d87700 1 -- 172.21.15.70:0/673627803 learned_addr learned my addr 172.21.15.70:0/673627803 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e0d85700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71dc0fffe0 0x7f71dc197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e1586700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71dc0ff620 0x7f71dc197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e1d87700 1 -- 172.21.15.70:0/673627803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71dc0fffe0 msgr2=0x7f71dc197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e1d87700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71dc0fffe0 0x7f71dc197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.480+0000 7f71e1d87700 1 -- 172.21.15.70:0/673627803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71dc0ff620 msgr2=0x7f71dc197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.481+0000 7f71e1d87700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71dc0ff620 0x7f71dc197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.481+0000 7f71e1d87700 1 -- 172.21.15.70:0/673627803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0095f0 con 0x7f71dc1056b0 2023-10-08T08:46:02.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.481+0000 7f71e1d87700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc1056b0 0x7f71dc1a29d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f71d400ef30 tx=0x7f71d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:02.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.481+0000 7f71d27fc700 1 -- 172.21.15.70:0/673627803 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4018070 con 0x7f71dc1056b0 2023-10-08T08:46:02.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.481+0000 7f71e37ea700 1 -- 172.21.15.70:0/673627803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc1a32d0 con 0x7f71dc1056b0 2023-10-08T08:46:02.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.481+0000 7f71d27fc700 1 -- 172.21.15.70:0/673627803 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d400f040 con 0x7f71dc1056b0 2023-10-08T08:46:02.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.481+0000 7f71d27fc700 1 -- 172.21.15.70:0/673627803 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400cd00 con 0x7f71dc1056b0 2023-10-08T08:46:02.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.481+0000 7f71e37ea700 1 -- 172.21.15.70:0/673627803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc1a3760 con 0x7f71dc1056b0 2023-10-08T08:46:02.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.484+0000 7f71d27fc700 1 -- 172.21.15.70:0/673627803 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f71d4003a00 con 0x7f71dc1056b0 2023-10-08T08:46:02.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.484+0000 7f71d27fc700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71c80a15f0 0x7f71c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.484+0000 7f71d27fc700 1 -- 172.21.15.70:0/673627803 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f71d40ccf50 con 0x7f71dc1056b0 2023-10-08T08:46:02.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.484+0000 7f71e1586700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71c80a15f0 0x7f71c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71e1586700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71c80a15f0 0x7f71c80a3ab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f71dc077ab0 tx=0x7f71d8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:02.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71ef9d3b80 1 Processor -- start 2023-10-08T08:46:02.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71ef9d3b80 1 -- start start 2023-10-08T08:46:02.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d689e5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e57a0 0x562d689f0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d6894e460 con 0x562d689e4e80 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d6893fc20 con 0x562d689f0650 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d6893d540 con 0x562d689e57a0 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71e1586700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d689e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71e1586700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d689e5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52800/0 (socket says 172.21.15.70:52800) 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71e1586700 1 -- 172.21.15.70:0/3230160448 learned_addr learned my addr 172.21.15.70:0/3230160448 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71e0d85700 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e57a0 0x562d689f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.485+0000 7f71e1d87700 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71e1586700 1 -- 172.21.15.70:0/3230160448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e57a0 msgr2=0x562d689f0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71e1586700 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e57a0 0x562d689f0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71e1586700 1 -- 172.21.15.70:0/3230160448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 msgr2=0x562d689f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71e1586700 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71e1586700 1 -- 172.21.15.70:0/3230160448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d68763de0 con 0x562d689e4e80 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71e1d87700 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71e1586700 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d689e5260 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f71d8011d50 tx=0x7f71d8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf23a07a7ba60d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71c77fe700 1 -- 172.21.15.70:0/3230160448 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800ed20 con 0x562d689e4e80 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71c77fe700 1 -- 172.21.15.70:0/3230160448 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d8021070 con 0x562d689e4e80 2023-10-08T08:46:02.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.486+0000 7f71c77fe700 1 -- 172.21.15.70:0/3230160448 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d801d410 con 0x562d689e4e80 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3230160448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 msgr2=0x562d689e5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d689e5260 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f71d8011d50 tx=0x7f71d8014000 comp rx=0 tx=0).stop 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3230160448 shutdown_connections 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d689e5260 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3230160448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e57a0 0x562d689f0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3230160448 >> 172.21.15.70:0/3230160448 conn(0x562d6895a260 msgr2=0x562d689e12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3230160448 shutdown_connections 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3230160448 wait complete. 2023-10-08T08:46:02.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 -- start start 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 Processor -- start 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 0x562d689f0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e57a0 0x562d689ed410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.487+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689edb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d68938e30 con 0x562d689e57a0 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d688d5710 con 0x562d689f0650 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d688d53b0 con 0x562d689e4e80 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71ef9d3b80 10 client.0 _ll_register_callbacks cb 0x562d68732800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e0d85700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e57a0 0x562d689ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e1586700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 0x562d689f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e0d85700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e57a0 0x562d689ed410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52808/0 (socket says 172.21.15.70:52808) 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e0d85700 1 -- 172.21.15.70:0/3738842760 learned_addr learned my addr 172.21.15.70:0/3738842760 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e1d87700 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689edb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e1586700 1 -- 172.21.15.70:0/3738842760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 msgr2=0x562d689edb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e1586700 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689edb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e1586700 1 -- 172.21.15.70:0/3738842760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e57a0 msgr2=0x562d689ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e1586700 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e57a0 0x562d689ed410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e1586700 1 -- 172.21.15.70:0/3738842760 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d40b9040 con 0x562d689e4e80 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e0d85700 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e57a0 0x562d689ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:02.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e1d87700 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689edb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71e1586700 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 0x562d689f0080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71d8011d20 tx=0x7f71d801cd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58a132281b445912 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71c4ff9700 1 -- 172.21.15.70:0/3738842760 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800ed30 con 0x562d689e4e80 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3738842760 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d68900eb0 con 0x562d689e4e80 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.488+0000 7f71c4ff9700 1 -- 172.21.15.70:0/3738842760 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f71d8011e40 con 0x562d689e4e80 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71c4ff9700 1 -- 172.21.15.70:0/3738842760 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71d801c410 con 0x562d689e4e80 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71ef9d3b80 10 client.25792 fetch_fsmap learned FSMap version 32 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3738842760 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f71d8017070 con 0x562d689e4e80 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71c4ff9700 1 -- 172.21.15.70:0/3738842760 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562d68900eb0 con 0x562d689e4e80 2023-10-08T08:46:02.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71c4ff9700 1 -- 172.21.15.70:0/3738842760 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 32) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f71d80046f0 con 0x562d689e4e80 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71ef9d3b80 10 client.25792 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71ef9d3b80 10 client.25792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71ef9d3b80 20 client.25792 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562d68a002c0 0x562d68a026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71ef9d3b80 4 client.25792 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3738842760 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d68931e10 con 0x562d68a002c0 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.489+0000 7f71e0d85700 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562d68a002c0 0x562d68a026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71c4ff9700 10 client.25792 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71e0d85700 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562d68a002c0 0x562d68a026e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3acf964cb9eb98e2 server_cookie=94948f13782aba16 in_seq=0 out_seq=0 2023-10-08T08:46:02.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71c4ff9700 1 -- 172.21.15.70:0/3738842760 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562d68931e10 con 0x562d68a002c0 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71c4ff9700 10 client.25792 handle_command_reply: tid=0 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71ef9d3b80 1 client.25792 shutdown 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3738842760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 msgr2=0x562d689f0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 0x562d689f0080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71d8011d20 tx=0x7f71d801cd20 comp rx=0 tx=0).stop 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3738842760 shutdown_connections 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562d68a002c0 0x562d68a026e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689f0650 0x562d689edb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71c4ff9700 0 client.25792 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 0x562d689f0080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/3738842760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e57a0 0x562d689ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.490+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3738842760 >> 172.21.15.70:0/3738842760 conn(0x562d6895a260 msgr2=0x562d689e0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:02.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.491+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3738842760 shutdown_connections 2023-10-08T08:46:02.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.491+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/3738842760 wait complete. 2023-10-08T08:46:02.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.491+0000 7f71ef9d3b80 20 client.25792 trim_cache size 0 max 16384 2023-10-08T08:46:02.506 INFO:tasks.workunit.client.0.smithi070.stdout:0/999: dwrite d1/d1d/d24/f7f [0,4194304] 0 2023-10-08T08:46:02.509 INFO:tasks.workunit.client.0.smithi070.stdout:6/761: dwrite df/d26/d42/d4b/db6/f8b [0,4194304] 0 2023-10-08T08:46:02.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.509+0000 7f71ef9d3b80 1 Processor -- start 2023-10-08T08:46:02.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.509+0000 7f71ef9d3b80 1 -- start start 2023-10-08T08:46:02.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.509+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 0x562d689efc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.509+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 0x562d689f7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.509+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689f0650 0x562d689e8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.509+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d687b9920 con 0x562d689f0650 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.509+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d689e8270 con 0x562d689e57a0 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.509+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d689e6950 con 0x562d689e4e80 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e0d85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 0x562d689f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e1d87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689f0650 0x562d689e8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e0d85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 0x562d689f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40272/0 (socket says 172.21.15.70:40272) 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e0d85700 1 -- 172.21.15.70:0/2136120779 learned_addr learned my addr 172.21.15.70:0/2136120779 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e1586700 1 --2- 172.21.15.70:0/2136120779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 0x562d689efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e1d87700 1 -- 172.21.15.70:0/2136120779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 msgr2=0x562d689efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e1d87700 1 --2- 172.21.15.70:0/2136120779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 0x562d689efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e1d87700 1 -- 172.21.15.70:0/2136120779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 msgr2=0x562d689f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e1d87700 1 --2- 172.21.15.70:0/2136120779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 0x562d689f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e1d87700 1 -- 172.21.15.70:0/2136120779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d6874cc60 con 0x562d689f0650 2023-10-08T08:46:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71e1d87700 1 --2- 172.21.15.70:0/2136120779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689f0650 0x562d689e8750 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f71d40ca3d0 tx=0x7f71d4095910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c138023603559c4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71c7fff700 1 -- 172.21.15.70:0/2136120779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4004ad0 con 0x562d689f0650 2023-10-08T08:46:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71c7fff700 1 -- 172.21.15.70:0/2136120779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d401b320 con 0x562d689f0650 2023-10-08T08:46:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.510+0000 7f71c7fff700 1 -- 172.21.15.70:0/2136120779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40b2510 con 0x562d689f0650 2023-10-08T08:46:02.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/2136120779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689f0650 msgr2=0x562d689e8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:02.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/2136120779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689f0650 0x562d689e8750 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f71d40ca3d0 tx=0x7f71d4095910 comp rx=0 tx=0).stop 2023-10-08T08:46:02.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/2136120779 shutdown_connections 2023-10-08T08:46:02.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/2136120779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689f0650 0x562d689e8750 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/2136120779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689e4e80 0x562d689efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/2136120779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 0x562d689f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/2136120779 >> 172.21.15.70:0/2136120779 conn(0x562d6895a260 msgr2=0x562d689e04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:02.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/2136120779 shutdown_connections 2023-10-08T08:46:02.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/2136120779 wait complete. 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 -- start start 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.511+0000 7f71ef9d3b80 1 Processor -- start 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d68a06750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 0x562d68a06c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71ef9d3b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689f0650 0x562d68a04fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d68a054e0 con 0x562d689e4e80 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d68a05650 con 0x562d689e57a0 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71ef9d3b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d68a05810 con 0x562d689f0650 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71ef9d3b80 10 client.0 _ll_register_callbacks cb 0x7f71d4009390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:02.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1586700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d68a06750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1586700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d68a06750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52818/0 (socket says 172.21.15.70:52818) 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1d87700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689f0650 0x562d68a04fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1586700 1 -- 172.21.15.70:0/897987606 learned_addr learned my addr 172.21.15.70:0/897987606 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e0d85700 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 0x562d68a06c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1d87700 1 -- 172.21.15.70:0/897987606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 msgr2=0x562d68a06c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1d87700 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 0x562d68a06c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1d87700 1 -- 172.21.15.70:0/897987606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 msgr2=0x562d68a06750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1d87700 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d68a06750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1d87700 1 -- 172.21.15.70:0/897987606 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc1a3760 con 0x562d689f0650 2023-10-08T08:46:02.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1586700 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d68a06750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71e1d87700 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689f0650 0x562d68a04fa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x562d689db680 tx=0x7f71d4009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4198a8519443a5f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.512+0000 7f71c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71c4ff9700 1 -- 172.21.15.70:0/897987606 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400ce60 con 0x562d689f0650 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71c4ff9700 1 -- 172.21.15.70:0/897987606 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f71d40a1ff0 con 0x562d689f0650 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/897987606 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71d8021070 con 0x562d689f0650 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71c4ff9700 1 -- 172.21.15.70:0/897987606 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71d4099cf0 con 0x562d689f0650 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71ef9d3b80 10 client.25798 fetch_fsmap learned FSMap version 32 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/897987606 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x562d6878a250 con 0x562d689f0650 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71c4ff9700 1 -- 172.21.15.70:0/897987606 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d8021070 con 0x562d689f0650 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71c4ff9700 1 -- 172.21.15.70:0/897987606 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 32) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f71d40a1c60 con 0x562d689f0650 2023-10-08T08:46:02.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71ef9d3b80 10 client.25798 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71ef9d3b80 10 client.25798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71ef9d3b80 20 client.25798 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562d68a002c0 0x562d68a5f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71ef9d3b80 4 client.25798 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/897987606 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562d68931b30 con 0x562d68a002c0 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.513+0000 7f71e1586700 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562d68a002c0 0x562d68a5f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71c4ff9700 10 client.25798 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71e1586700 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562d68a002c0 0x562d68a5f9a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4078876f50263bd0 server_cookie=dbc65ed289e09245 in_seq=0 out_seq=0 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71c4ff9700 1 -- 172.21.15.70:0/897987606 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562d68931b30 con 0x562d68a002c0 2023-10-08T08:46:02.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71c4ff9700 10 client.25798 handle_command_reply: tid=0 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 client.25798 shutdown 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/897987606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689f0650 msgr2=0x562d68a04fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689f0650 0x562d68a04fa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x562d689db680 tx=0x7f71d4009ed0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/897987606 shutdown_connections 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562d689f0650 0x562d68a04fa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d689e4e80 0x562d68a06750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562d68a002c0 0x562d68a5f9a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 --2- 172.21.15.70:0/897987606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562d689e57a0 0x562d68a06c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71c4ff9700 0 client.25798 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/897987606 >> 172.21.15.70:0/897987606 conn(0x562d6895a260 msgr2=0x562d689e8750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:02.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/897987606 shutdown_connections 2023-10-08T08:46:02.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 1 -- 172.21.15.70:0/897987606 wait complete. 2023-10-08T08:46:02.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.514+0000 7f71ef9d3b80 20 client.25798 trim_cache size 0 max 16384 2023-10-08T08:46:02.524 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:46:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T08:46:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2023-10-08T08:46:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "1fdc564a-5636-4203-adbe-f48f96886df6": { 2023-10-08T08:46:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2023-10-08T08:46:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "1fdc564a-5636-4203-adbe-f48f96886df6", 2023-10-08T08:46:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2023-10-08T08:46:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:46:02.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:46:02.525 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:46:02.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 -- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71c80a15f0 msgr2=0x7f71c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:02.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71c80a15f0 0x7f71c80a3ab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f71dc077ab0 tx=0x7f71d8009260 comp rx=0 tx=0).stop 2023-10-08T08:46:02.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 -- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc1056b0 msgr2=0x7f71dc1a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:02.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc1056b0 0x7f71dc1a29d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f71d400ef30 tx=0x7f71d400c3a0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 -- 172.21.15.70:0/673627803 shutdown_connections 2023-10-08T08:46:02.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f71c80a15f0 0x7f71c80a3ab0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc1056b0 0x7f71dc1a29d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71dc0ff620 0x7f71dc197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 --2- 172.21.15.70:0/673627803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71dc0fffe0 0x7f71dc197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:02.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 -- 172.21.15.70:0/673627803 >> 172.21.15.70:0/673627803 conn(0x7f71dc076780 msgr2=0x7f71dc0fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:02.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 -- 172.21.15.70:0/673627803 shutdown_connections 2023-10-08T08:46:02.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:02.515+0000 7f71e37ea700 1 -- 172.21.15.70:0/673627803 wait complete. 2023-10-08T08:46:02.528 INFO:tasks.cephfs.filesystem:scrub status for tag:1fdc564a-5636-4203-adbe-f48f96886df6 - {'path': '/', 'tag': '1fdc564a-5636-4203-adbe-f48f96886df6', 'options': 'recursive,force'} 2023-10-08T08:46:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:02 smithi191 ceph-mon[104220]: pgmap v358: 129 pgs: 129 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 MiB/s rd, 88 MiB/s wr, 161 op/s 2023-10-08T08:46:02.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:02 smithi070 ceph-mon[99513]: pgmap v358: 129 pgs: 129 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 MiB/s rd, 88 MiB/s wr, 161 op/s 2023-10-08T08:46:02.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:02 smithi105 ceph-mon[103798]: pgmap v358: 129 pgs: 129 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 MiB/s rd, 88 MiB/s wr, 161 op/s 2023-10-08T08:46:03.197 INFO:tasks.workunit.client.0.smithi070.stdout:8/908: sync 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:4/748: sync 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:1/977: sync 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:2/957: sync 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:6/762: sync 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:6/763: fsync df/f27 0 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:6/764: read - df/d26/f9f zero size 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:9/695: sync 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:8/909: write d1/d2/fe7 [332656,114782] 0 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:7/883: sync 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:8/910: readlink d1/d2/d6/l9 0 2023-10-08T08:46:03.198 INFO:tasks.workunit.client.0.smithi070.stdout:5/876: sync 2023-10-08T08:46:03.199 INFO:tasks.workunit.client.0.smithi070.stdout:4/749: getdents dc/d17/d24/d55 0 2023-10-08T08:46:03.199 INFO:tasks.workunit.client.0.smithi070.stdout:5/877: write d5/da/d4d/f3f [53409,53185] 0 2023-10-08T08:46:03.200 INFO:tasks.workunit.client.0.smithi070.stdout:9/696: stat d1/dd/d19/l29 0 2023-10-08T08:46:03.201 INFO:tasks.workunit.client.0.smithi070.stdout:9/697: rmdir d1/dd/d26/d7b 39 2023-10-08T08:46:03.202 INFO:tasks.workunit.client.0.smithi070.stdout:5/878: symlink d5/d5f/d63/d8b/da8/dac/l123 0 2023-10-08T08:46:03.203 INFO:tasks.workunit.client.0.smithi070.stdout:5/879: chown d5/da/d22/ddd/d38/lb6 4310 1 2023-10-08T08:46:03.203 INFO:tasks.workunit.client.0.smithi070.stdout:2/958: mkdir df/d12/d1b/d1c/d69/d100/d83/d92/d102/d134 0 2023-10-08T08:46:03.203 INFO:tasks.workunit.client.0.smithi070.stdout:2/959: write df/d93/dc2/dae/dce/f127 [139551,1288] 0 2023-10-08T08:46:03.205 INFO:tasks.workunit.client.0.smithi070.stdout:9/698: write d1/dd/d26/d27/d2d/d70/d90/f9e [7817838,72255] 0 2023-10-08T08:46:03.205 INFO:tasks.workunit.client.0.smithi070.stdout:1/978: rename d6/dc/d14/d1f/f2b to d6/dc/d14/dc1/dca/d135/f14c 0 2023-10-08T08:46:03.205 INFO:tasks.workunit.client.0.smithi070.stdout:9/699: write d1/dd/d26/f98 [362740,35103] 0 2023-10-08T08:46:03.206 INFO:tasks.workunit.client.0.smithi070.stdout:6/765: mkdir df/d26/d42/d43/d4a/d97/dc0/df7 0 2023-10-08T08:46:03.206 INFO:tasks.workunit.client.0.smithi070.stdout:5/880: creat d5/d5f/d61/d30/d54/f124 x:0 0 0 2023-10-08T08:46:03.208 INFO:tasks.workunit.client.0.smithi070.stdout:2/960: symlink df/d93/l135 0 2023-10-08T08:46:03.208 INFO:tasks.workunit.client.0.smithi070.stdout:9/700: creat d1/dd/d26/d27/d2d/d70/d90/dab/fd2 x:0 0 0 2023-10-08T08:46:03.209 INFO:tasks.workunit.client.0.smithi070.stdout:6/766: symlink df/d26/d42/d4b/dba/lf8 0 2023-10-08T08:46:03.213 INFO:tasks.workunit.client.0.smithi070.stdout:2/961: write df/d12/d1b/d1c/dcd/d117/f119 [3463355,58721] 0 2023-10-08T08:46:03.213 INFO:tasks.workunit.client.0.smithi070.stdout:9/701: rename d1/dd/d26/d7b/f7d to d1/dd/d1a/d40/d76/d93/fd3 0 2023-10-08T08:46:03.213 INFO:tasks.workunit.client.0.smithi070.stdout:6/767: mkdir df/d26/d78/dd5/de0/df9 0 2023-10-08T08:46:03.215 INFO:tasks.workunit.client.0.smithi070.stdout:5/881: symlink d5/da/d22/ddd/d38/d55/ddf/l125 0 2023-10-08T08:46:03.215 INFO:tasks.workunit.client.0.smithi070.stdout:8/911: dread d1/d2/d6/d22/d5b/d74/de1/d3a/f6c [0,4194304] 0 2023-10-08T08:46:03.215 INFO:tasks.workunit.client.0.smithi070.stdout:8/912: fsync d1/fb4 0 2023-10-08T08:46:03.215 INFO:tasks.workunit.client.0.smithi070.stdout:8/913: chown d1/d2/d6/d22/d5b/d74/de1/d2e/d11a/l2f 758220 1 2023-10-08T08:46:03.215 INFO:tasks.workunit.client.0.smithi070.stdout:2/962: rename df/d12/d7e/f129 to df/d12/d7e/f136 0 2023-10-08T08:46:03.215 INFO:tasks.workunit.client.0.smithi070.stdout:9/702: mkdir d1/dd/d19/d38/d77/d96/dd4 0 2023-10-08T08:46:03.217 INFO:tasks.workunit.client.0.smithi070.stdout:2/963: mkdir df/d12/d1b/d1c/dcd/d117/d137 0 2023-10-08T08:46:03.218 INFO:tasks.workunit.client.0.smithi070.stdout:6/768: write df/d53/f5a [4028951,46812] 0 2023-10-08T08:46:03.219 INFO:tasks.workunit.client.0.smithi070.stdout:5/882: creat d5/d5f/d61/d30/d54/dab/f126 x:0 0 0 2023-10-08T08:46:03.221 INFO:tasks.workunit.client.0.smithi070.stdout:2/964: write df/d12/d1b/d1c/dcd/d117/f119 [3981292,10480] 0 2023-10-08T08:46:03.223 INFO:tasks.workunit.client.0.smithi070.stdout:8/914: creat d1/d2/d6/d22/d9e/d115/f133 x:0 0 0 2023-10-08T08:46:03.223 INFO:tasks.workunit.client.0.smithi070.stdout:8/915: chown d1/d2/d6/d22/c27 6250823 1 2023-10-08T08:46:03.223 INFO:tasks.workunit.client.0.smithi070.stdout:2/965: creat df/d12/d7e/dc9/f138 x:0 0 0 2023-10-08T08:46:03.223 INFO:tasks.workunit.client.0.smithi070.stdout:2/966: fdatasync df/d12/d1b/d82/d85/d65/fe6 0 2023-10-08T08:46:03.223 INFO:tasks.workunit.client.0.smithi070.stdout:2/967: chown df/d93/dc2/lb9 112 1 2023-10-08T08:46:03.224 INFO:tasks.workunit.client.0.smithi070.stdout:2/968: readlink df/d12/d1b/l50 0 2023-10-08T08:46:03.224 INFO:tasks.workunit.client.0.smithi070.stdout:2/969: truncate df/d12/d1b/d1c/f5d 1112765 0 2023-10-08T08:46:03.227 INFO:tasks.workunit.client.0.smithi070.stdout:2/970: symlink df/d12/d15/d54/l139 0 2023-10-08T08:46:03.229 INFO:tasks.workunit.client.0.smithi070.stdout:8/916: dread d1/d2/d6/d22/d5b/d74/de1/d3a/d56/f95 [0,4194304] 0 2023-10-08T08:46:03.229 INFO:tasks.workunit.client.0.smithi070.stdout:2/971: dread df/d12/f71 [0,4194304] 0 2023-10-08T08:46:03.233 INFO:tasks.workunit.client.0.smithi070.stdout:2/972: mknod df/d12/d1b/d82/d85/d65/da0/c13a 0 2023-10-08T08:46:03.234 INFO:tasks.workunit.client.0.smithi070.stdout:5/883: rename d5/d5f/d61/d30/d54/d62/fd4 to d5/da/d22/ddd/d38/dc3/f127 0 2023-10-08T08:46:03.234 INFO:tasks.workunit.client.0.smithi070.stdout:5/884: chown d5 355438939 1 2023-10-08T08:46:03.234 INFO:tasks.workunit.client.0.smithi070.stdout:5/885: chown d5/da/d22/ddd/d2a/dc0/f117 9095 1 2023-10-08T08:46:03.234 INFO:tasks.workunit.client.0.smithi070.stdout:7/884: dwrite d3/d19/d6d/f8f [0,4194304] 0 2023-10-08T08:46:03.236 INFO:tasks.workunit.client.0.smithi070.stdout:2/973: link df/d12/d15/l81 df/d93/dc2/dae/dce/l13b 0 2023-10-08T08:46:03.237 INFO:tasks.workunit.client.0.smithi070.stdout:7/885: write d3/da9/d4a/d9/d97/fa0 [2889702,91451] 0 2023-10-08T08:46:03.237 INFO:tasks.workunit.client.0.smithi070.stdout:7/886: truncate d3/da9/f64 4250015 0 2023-10-08T08:46:03.241 INFO:tasks.workunit.client.0.smithi070.stdout:9/703: dwrite d1/dd/d19/f1b [0,4194304] 0 2023-10-08T08:46:03.241 INFO:tasks.workunit.client.0.smithi070.stdout:9/704: fdatasync d1/dd/d19/d97/fcd 0 2023-10-08T08:46:03.241 INFO:tasks.workunit.client.0.smithi070.stdout:9/705: chown d1/dd/d19/d38/d4f/fa9 37563041 1 2023-10-08T08:46:03.241 INFO:tasks.workunit.client.0.smithi070.stdout:9/706: write d1/dd/d19/d38/f42 [5264225,71406] 0 2023-10-08T08:46:03.241 INFO:tasks.workunit.client.0.smithi070.stdout:9/707: chown d1/dd/d19/d38/d4f/dc7/c63 299 1 2023-10-08T08:46:03.241 INFO:tasks.workunit.client.0.smithi070.stdout:2/974: creat df/d93/dc2/dae/dce/f13c x:0 0 0 2023-10-08T08:46:03.243 INFO:tasks.workunit.client.0.smithi070.stdout:7/887: read d3/da9/d1e/d76/f116 [3431330,93844] 0 2023-10-08T08:46:03.243 INFO:tasks.workunit.client.0.smithi070.stdout:7/888: chown d3/d19/d1a/f40 13063 1 2023-10-08T08:46:03.243 INFO:tasks.workunit.client.0.smithi070.stdout:1/979: dwrite d6/fd2 [0,4194304] 0 2023-10-08T08:46:03.247 INFO:tasks.workunit.client.0.smithi070.stdout:6/769: write df/d26/d42/d43/d4a/d75/d7e/fa6 [2476443,79203] 0 2023-10-08T08:46:03.247 INFO:tasks.workunit.client.0.smithi070.stdout:7/889: creat d3/d19/d95/da3/dc8/f122 x:0 0 0 2023-10-08T08:46:03.254 INFO:tasks.workunit.client.0.smithi070.stdout:7/890: creat d3/d77/f123 x:0 0 0 2023-10-08T08:46:03.255 INFO:tasks.workunit.client.0.smithi070.stdout:7/891: fsync d3/da9/d4a/d9/d97/f9b 0 2023-10-08T08:46:03.256 INFO:tasks.workunit.client.0.smithi070.stdout:2/975: rmdir df/d12/d1b/d1c/d69 39 2023-10-08T08:46:03.257 INFO:tasks.workunit.client.0.smithi070.stdout:2/976: symlink df/d12/d1b/d1c/d69/d100/d83/d92/d102/l13d 0 2023-10-08T08:46:03.258 INFO:tasks.workunit.client.0.smithi070.stdout:4/750: creat dc/d17/d24/d55/ff5 x:0 0 0 2023-10-08T08:46:03.261 INFO:tasks.workunit.client.0.smithi070.stdout:6/770: dread df/d26/d78/d90/fb9 [0,4194304] 0 2023-10-08T08:46:03.264 INFO:tasks.workunit.client.0.smithi070.stdout:4/751: creat dc/d17/d24/d55/da4/ff6 x:0 0 0 2023-10-08T08:46:03.264 INFO:tasks.workunit.client.0.smithi070.stdout:4/752: truncate dc/d17/d79/dad/db6/dc1/fc9 616290 0 2023-10-08T08:46:03.265 INFO:tasks.workunit.client.0.smithi070.stdout:5/886: dwrite d5/f101 [0,4194304] 0 2023-10-08T08:46:03.265 INFO:tasks.workunit.client.0.smithi070.stdout:5/887: stat d5/d5f/d63/d8b/d8f/lb2 0 2023-10-08T08:46:03.265 INFO:tasks.workunit.client.0.smithi070.stdout:6/771: mknod df/d26/d42/d43/cfa 0 2023-10-08T08:46:03.266 INFO:tasks.workunit.client.0.smithi070.stdout:5/888: truncate d5/f7c 1596741 0 2023-10-08T08:46:03.266 INFO:tasks.workunit.client.0.smithi070.stdout:5/889: truncate d5/d5f/d61/d30/d54/dab/fd1 4922662 0 2023-10-08T08:46:03.267 INFO:tasks.workunit.client.0.smithi070.stdout:6/772: creat df/d26/d42/d43/d4a/d97/dc0/ffb x:0 0 0 2023-10-08T08:46:03.267 INFO:tasks.workunit.client.0.smithi070.stdout:6/773: chown df/d26/d42/d4b/ce2 774 1 2023-10-08T08:46:03.268 INFO:tasks.workunit.client.0.smithi070.stdout:5/890: mknod d5/da/d22/ddd/c128 0 2023-10-08T08:46:03.268 INFO:tasks.workunit.client.0.smithi070.stdout:4/753: rename f9 to dc/d17/d24/d4c/d4e/dab/ff7 0 2023-10-08T08:46:03.269 INFO:tasks.workunit.client.0.smithi070.stdout:6/774: getdents df 0 2023-10-08T08:46:03.269 INFO:tasks.workunit.client.0.smithi070.stdout:2/977: dread df/d12/d1b/d1c/d69/d100/fa6 [0,4194304] 0 2023-10-08T08:46:03.270 INFO:tasks.workunit.client.0.smithi070.stdout:5/891: link d5/da/d4d/dfb/c108 d5/da/d22/ddd/d38/c129 0 2023-10-08T08:46:03.270 INFO:tasks.workunit.client.0.smithi070.stdout:4/754: creat dc/d17/d24/d4c/d4e/dda/df4/ff8 x:0 0 0 2023-10-08T08:46:03.273 INFO:tasks.workunit.client.0.smithi070.stdout:6/775: rename df/d26/d42/d4b/d80/d94/fad to df/d26/d42/db1/ffc 0 2023-10-08T08:46:03.274 INFO:tasks.workunit.client.0.smithi070.stdout:6/776: mkdir df/d26/d78/d90/dae/dfd 0 2023-10-08T08:46:03.275 INFO:tasks.workunit.client.0.smithi070.stdout:8/917: dwrite d1/d2/d6/d22/d5b/d74/de1/d15/f20 [0,4194304] 0 2023-10-08T08:46:03.275 INFO:tasks.workunit.client.0.smithi070.stdout:5/892: creat d5/d5f/d61/d30/f12a x:0 0 0 2023-10-08T08:46:03.275 INFO:tasks.workunit.client.0.smithi070.stdout:1/980: dwrite d6/dc/d14/dc1/dca/d117/d7e/f11e [0,4194304] 0 2023-10-08T08:46:03.275 INFO:tasks.workunit.client.0.smithi070.stdout:1/981: chown d6/dc/d14/dc1/dca/d117/da1/ddb/ffb 920 1 2023-10-08T08:46:03.280 INFO:tasks.workunit.client.0.smithi070.stdout:7/892: dread d3/da9/d4a/d9/f48 [0,4194304] 0 2023-10-08T08:46:03.281 INFO:tasks.workunit.client.0.smithi070.stdout:9/708: dwrite d1/dd/d1a/f1c [4194304,4194304] 0 2023-10-08T08:46:03.282 INFO:tasks.workunit.client.0.smithi070.stdout:5/893: creat d5/d5f/d61/d30/d54/d62/f12b x:0 0 0 2023-10-08T08:46:03.284 INFO:tasks.workunit.client.0.smithi070.stdout:8/918: getdents d1/d2/d6/d22/d9e/da7/dbe/d128 0 2023-10-08T08:46:03.284 INFO:tasks.workunit.client.0.smithi070.stdout:8/919: fsync d1/d2/d6/d22/d5c/f6f 0 2023-10-08T08:46:03.284 INFO:tasks.workunit.client.0.smithi070.stdout:1/982: symlink d6/dc/d97/d11b/l14d 0 2023-10-08T08:46:03.285 INFO:tasks.workunit.client.0.smithi070.stdout:6/777: mkdir df/d26/d42/d4b/db6/d7d/dc8/dfe 0 2023-10-08T08:46:03.287 INFO:tasks.workunit.client.0.smithi070.stdout:5/894: link d5/d5f/d63/d8b/da8/dac/l123 d5/da/d22/ddd/d38/d55/l12c 0 2023-10-08T08:46:03.289 INFO:tasks.workunit.client.0.smithi070.stdout:1/983: write d6/dc/d14/f71 [462212,54806] 0 2023-10-08T08:46:03.289 INFO:tasks.workunit.client.0.smithi070.stdout:1/984: write d6/dc/d14/dc1/dca/d117/f115 [754873,38930] 0 2023-10-08T08:46:03.289 INFO:tasks.workunit.client.0.smithi070.stdout:2/978: dread df/d12/d1b/d1c/f6a [0,4194304] 0 2023-10-08T08:46:03.289 INFO:tasks.workunit.client.0.smithi070.stdout:2/979: getdents df/d12/d1b/d82/d85/d65/da0/d111 0 2023-10-08T08:46:03.289 INFO:tasks.workunit.client.0.smithi070.stdout:9/709: rmdir d1/dd/d19/d38/d4f/db9 39 2023-10-08T08:46:03.297 INFO:tasks.workunit.client.0.smithi070.stdout:8/920: write d1/d2/d6/d22/f4b [422691,61289] 0 2023-10-08T08:46:03.297 INFO:tasks.workunit.client.0.smithi070.stdout:6/778: write df/d26/d78/d90/daa/fb0 [415366,17387] 0 2023-10-08T08:46:03.297 INFO:tasks.workunit.client.0.smithi070.stdout:6/779: truncate df/d11/fe6 861586 0 2023-10-08T08:46:03.297 INFO:tasks.workunit.client.0.smithi070.stdout:2/980: link df/d12/d1b/d1c/d69/d100/f44 df/d12/d1b/d82/d85/f13e 0 2023-10-08T08:46:03.297 INFO:tasks.workunit.client.0.smithi070.stdout:2/981: chown df/d12/d15/d54/l139 81 1 2023-10-08T08:46:03.298 INFO:tasks.workunit.client.0.smithi070.stdout:2/982: fsync df/d12/d1b/d1c/d79/da4/ffb 0 2023-10-08T08:46:03.298 INFO:tasks.workunit.client.0.smithi070.stdout:5/895: mknod d5/d5f/d61/d30/d83/d121/c12d 0 2023-10-08T08:46:03.299 INFO:tasks.workunit.client.0.smithi070.stdout:6/780: mkdir df/d26/d78/dd5/dff 0 2023-10-08T08:46:03.300 INFO:tasks.workunit.client.0.smithi070.stdout:5/896: link d5/d5f/d63/d8b/f9e d5/da/d4d/dfb/f12e 0 2023-10-08T08:46:03.300 INFO:tasks.workunit.client.0.smithi070.stdout:5/897: dread - d5/d5f/d61/d30/d54/dab/ff0 zero size 2023-10-08T08:46:03.301 INFO:tasks.workunit.client.0.smithi070.stdout:2/983: symlink df/d4c/d91/d130/l13f 0 2023-10-08T08:46:03.301 INFO:tasks.workunit.client.0.smithi070.stdout:5/898: creat d5/da/d22/ddd/d38/dc3/f12f x:0 0 0 2023-10-08T08:46:03.302 INFO:tasks.workunit.client.0.smithi070.stdout:5/899: dread - d5/f98 zero size 2023-10-08T08:46:03.302 INFO:tasks.workunit.client.0.smithi070.stdout:6/781: creat df/d26/d42/d43/d4a/d97/da5/f100 x:0 0 0 2023-10-08T08:46:03.303 INFO:tasks.workunit.client.0.smithi070.stdout:2/984: read df/d12/d1b/f10d [1359629,959] 0 2023-10-08T08:46:03.303 INFO:tasks.workunit.client.0.smithi070.stdout:2/985: truncate df/d12/d7e/f136 118828 0 2023-10-08T08:46:03.304 INFO:tasks.workunit.client.0.smithi070.stdout:5/900: link d5/da/d22/ddd/d38/d55/dbf/f105 d5/d5f/d63/d8b/da8/dac/f130 0 2023-10-08T08:46:03.305 INFO:tasks.workunit.client.0.smithi070.stdout:2/986: creat df/d12/d1b/d82/d85/d65/da0/f140 x:0 0 0 2023-10-08T08:46:03.307 INFO:tasks.workunit.client.0.smithi070.stdout:7/893: dwrite d3/d19/f67 [4194304,4194304] 0 2023-10-08T08:46:03.310 INFO:tasks.workunit.client.0.smithi070.stdout:6/782: dread df/d26/d42/d4b/fed [0,4194304] 0 2023-10-08T08:46:03.311 INFO:tasks.workunit.client.0.smithi070.stdout:6/783: truncate df/d71/fe7 1004078 0 2023-10-08T08:46:03.311 INFO:tasks.workunit.client.0.smithi070.stdout:6/784: dread - df/d26/d78/dd5/fdd zero size 2023-10-08T08:46:03.311 INFO:tasks.workunit.client.0.smithi070.stdout:2/987: dread df/fe7 [0,4194304] 0 2023-10-08T08:46:03.312 INFO:tasks.workunit.client.0.smithi070.stdout:6/785: truncate df/d11/f58 1721287 0 2023-10-08T08:46:03.312 INFO:tasks.workunit.client.0.smithi070.stdout:6/786: chown df/d26/d42/db1/c5f 61034 1 2023-10-08T08:46:03.316 INFO:tasks.workunit.client.0.smithi070.stdout:2/988: symlink df/d3a/d77/d116/l141 0 2023-10-08T08:46:03.316 INFO:tasks.workunit.client.0.smithi070.stdout:6/787: rename df/d26/d42/d4b/db6/d7d/dc8/fee to df/d26/d42/d4b/db6/d7d/f101 0 2023-10-08T08:46:03.316 INFO:tasks.workunit.client.0.smithi070.stdout:2/989: dread - df/d12/d7e/ff5 zero size 2023-10-08T08:46:03.316 INFO:tasks.workunit.client.0.smithi070.stdout:2/990: stat df/d12/d1b/d1c/c89 0 2023-10-08T08:46:03.318 INFO:tasks.workunit.client.0.smithi070.stdout:2/991: truncate df/d12/d7e/fff 1171544 0 2023-10-08T08:46:03.318 INFO:tasks.workunit.client.0.smithi070.stdout:2/992: chown df/d12/d1b/d1c/c3f 3401195 1 2023-10-08T08:46:03.318 INFO:tasks.workunit.client.0.smithi070.stdout:2/993: chown df/d3a/db6/dde/fee 1818940 1 2023-10-08T08:46:03.318 INFO:tasks.workunit.client.0.smithi070.stdout:2/994: write df/d12/d1b/d1c/d2d/fdf [1920999,44172] 0 2023-10-08T08:46:03.320 INFO:tasks.workunit.client.0.smithi070.stdout:6/788: mknod df/d26/d42/d4b/db6/d7d/dc8/dfe/c102 0 2023-10-08T08:46:03.328 INFO:tasks.workunit.client.0.smithi070.stdout:5/901: dread d5/da/d22/ddd/ff8 [0,4194304] 0 2023-10-08T08:46:03.329 INFO:tasks.workunit.client.0.smithi070.stdout:5/902: dread d5/d5f/d61/d30/d54/d62/dae/fb0 [0,4194304] 0 2023-10-08T08:46:03.330 INFO:tasks.workunit.client.0.smithi070.stdout:1/985: dwrite d6/dc/d14/dc1/dca/d117/f8c [0,4194304] 0 2023-10-08T08:46:03.330 INFO:tasks.workunit.client.0.smithi070.stdout:8/921: dread d1/d2/d6/d22/d5b/d74/de1/d1a/f1b [0,4194304] 0 2023-10-08T08:46:03.330 INFO:tasks.workunit.client.0.smithi070.stdout:9/710: dwrite d1/dd/d19/d38/f42 [0,4194304] 0 2023-10-08T08:46:03.331 INFO:tasks.workunit.client.0.smithi070.stdout:7/894: dread d3/d19/d1a/f70 [0,4194304] 0 2023-10-08T08:46:03.332 INFO:tasks.workunit.client.0.smithi070.stdout:9/711: mkdir d1/dd/d1a/d40/d76/d93/dd0/dd5 0 2023-10-08T08:46:03.334 INFO:tasks.workunit.client.0.smithi070.stdout:9/712: symlink d1/dd/d19/d38/d77/ld6 0 2023-10-08T08:46:03.334 INFO:tasks.workunit.client.0.smithi070.stdout:9/713: chown d1/dd/d1a/d40/f4e 312837026 1 2023-10-08T08:46:03.335 INFO:tasks.workunit.client.0.smithi070.stdout:5/903: dread d5/da/d22/ddd/d2a/f58 [0,4194304] 0 2023-10-08T08:46:03.336 INFO:tasks.workunit.client.0.smithi070.stdout:9/714: unlink d1/dd/d19/d38/d4f/dc7/l5f 0 2023-10-08T08:46:03.336 INFO:tasks.workunit.client.0.smithi070.stdout:9/715: mknod d1/dd/d39/d66/cd7 0 2023-10-08T08:46:03.338 INFO:tasks.workunit.client.0.smithi070.stdout:2/995: truncate df/d12/d1b/d82/d85/d65/fe6 888619 0 2023-10-08T08:46:03.338 INFO:tasks.workunit.client.0.smithi070.stdout:2/996: fsync df/d12/d1b/d1c/d69/d100/d83/d92/f12f 0 2023-10-08T08:46:03.341 INFO:tasks.workunit.client.0.smithi070.stdout:1/986: symlink d6/dc/d97/l14e 0 2023-10-08T08:46:03.342 INFO:tasks.workunit.client.0.smithi070.stdout:7/895: mknod d3/da9/d4a/d9/c124 0 2023-10-08T08:46:03.342 INFO:tasks.workunit.client.0.smithi070.stdout:7/896: readlink d3/d79/lf2 0 2023-10-08T08:46:03.348 INFO:tasks.workunit.client.0.smithi070.stdout:6/789: rename df/d26/d78/dd5 to df/d26/d42/d4b/db6/d7d/dc8/d103 0 2023-10-08T08:46:03.351 INFO:tasks.workunit.client.0.smithi070.stdout:6/790: unlink df/d26/d42/d43/d4a/f6d 0 2023-10-08T08:46:03.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/922: rename d1/d2/d6/d22/d5b/d74/de1/d3a/f3f to d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/d10d/f134 0 2023-10-08T08:46:03.351 INFO:tasks.workunit.client.0.smithi070.stdout:1/987: dread d6/dc/d14/d1f/d63/db3/f51 [0,4194304] 0 2023-10-08T08:46:03.352 INFO:tasks.workunit.client.0.smithi070.stdout:9/716: dread d1/dd/f61 [4194304,4194304] 0 2023-10-08T08:46:03.352 INFO:tasks.workunit.client.0.smithi070.stdout:9/717: dread - d1/dd/d19/d38/d77/fc6 zero size 2023-10-08T08:46:03.352 INFO:tasks.workunit.client.0.smithi070.stdout:9/718: fdatasync d1/f4b 0 2023-10-08T08:46:03.354 INFO:tasks.workunit.client.0.smithi070.stdout:8/923: rmdir d1/d2/d6/d22/d5b 39 2023-10-08T08:46:03.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/719: mkdir d1/dd/d1a/d40/d76/d93/dd8 0 2023-10-08T08:46:03.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/720: write d1/dd/d26/d27/d2d/d70/d90/dab/fb6 [893824,99409] 0 2023-10-08T08:46:03.355 INFO:tasks.workunit.client.0.smithi070.stdout:1/988: rmdir d6/dc/d14/d1f/d63/db3 39 2023-10-08T08:46:03.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/721: creat d1/dd/d19/d97/fd9 x:0 0 0 2023-10-08T08:46:03.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/722: chown d1/dd/d8d/db3 92587202 1 2023-10-08T08:46:03.356 INFO:tasks.workunit.client.0.smithi070.stdout:8/924: truncate d1/d2/d6/d22/d5b/d74/de1/d1a/f66 65973 0 2023-10-08T08:46:03.359 INFO:tasks.workunit.client.0.smithi070.stdout:1/989: rename d6/dc/d14/d90/de4 to d6/dc/d14/d1f/d118/d14f 0 2023-10-08T08:46:03.360 INFO:tasks.workunit.client.0.smithi070.stdout:1/990: creat d6/dc/d14/d1f/d118/d14f/d12a/f150 x:0 0 0 2023-10-08T08:46:03.360 INFO:tasks.workunit.client.0.smithi070.stdout:1/991: dread - d6/dc/d14/dc1/f11c zero size 2023-10-08T08:46:03.365 INFO:tasks.workunit.client.0.smithi070.stdout:2/997: dwrite df/d12/d1b/d82/d85/d65/ffa [0,4194304] 0 2023-10-08T08:46:03.368 INFO:tasks.workunit.client.0.smithi070.stdout:2/998: mkdir df/d12/d7e/d142 0 2023-10-08T08:46:03.369 INFO:tasks.workunit.client.0.smithi070.stdout:2/999: truncate df/d12/d1b/d1c/f6a 1798780 0 2023-10-08T08:46:03.423 INFO:tasks.workunit.client.0.smithi070.stdout:8/925: read d1/d2/d6/d22/d5b/d74/de1/d3a/d56/f95 [489400,109118] 0 2023-10-08T08:46:03.423 INFO:tasks.workunit.client.0.smithi070.stdout:8/926: fsync d1/d2/d6/d22/d5b/d74/de1/d15/f40 0 2023-10-08T08:46:03.426 INFO:tasks.workunit.client.0.smithi070.stdout:8/927: symlink d1/d2/d6/d22/d5b/d74/de1/d2e/d11a/df4/l135 0 2023-10-08T08:46:03.428 INFO:tasks.workunit.client.0.smithi070.stdout:8/928: write d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/f71 [190974,93619] 0 2023-10-08T08:46:03.429 INFO:tasks.workunit.client.0.smithi070.stdout:1/992: dread d6/dc/d14/dc1/dca/d117/d7e/f8d [0,4194304] 0 2023-10-08T08:46:03.441 INFO:tasks.workunit.client.0.smithi070.stdout:1/993: unlink d6/dc/d14/d90/ca2 0 2023-10-08T08:46:03.445 INFO:tasks.workunit.client.0.smithi070.stdout:1/994: unlink d6/dc/d14/dc1/dca/d135/f14a 0 2023-10-08T08:46:03.445 INFO:tasks.workunit.client.0.smithi070.stdout:1/995: chown d6/dc/d14/d90 9803224 1 2023-10-08T08:46:03.446 INFO:tasks.workunit.client.0.smithi070.stdout:7/897: dwrite d3/d19/d95/da3/dc8/dfb/d9f/dc5/fdf [0,4194304] 0 2023-10-08T08:46:03.447 INFO:tasks.workunit.client.0.smithi070.stdout:1/996: creat d6/dc/d14/d1f/d63/daa/f151 x:0 0 0 2023-10-08T08:46:03.447 INFO:tasks.workunit.client.0.smithi070.stdout:1/997: chown d6/dc/d14/d1f/d11f/d126 2555 1 2023-10-08T08:46:03.451 INFO:tasks.workunit.client.0.smithi070.stdout:9/723: dwrite d1/dd/d26/d27/d2d/d70/d90/f9e [4194304,4194304] 0 2023-10-08T08:46:03.451 INFO:tasks.workunit.client.0.smithi070.stdout:9/724: chown d1/dd/d39/da4 206301 1 2023-10-08T08:46:03.451 INFO:tasks.workunit.client.0.smithi070.stdout:9/725: dread - d1/dd/d19/d38/d77/d96/fc1 zero size 2023-10-08T08:46:03.451 INFO:tasks.workunit.client.0.smithi070.stdout:7/898: mknod d3/da9/d4a/d9/da4/dd6/c125 0 2023-10-08T08:46:03.452 INFO:tasks.workunit.client.0.smithi070.stdout:8/929: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/f42 [0,4194304] 0 2023-10-08T08:46:03.453 INFO:tasks.workunit.client.0.smithi070.stdout:7/899: read d3/d19/f56 [393729,68795] 0 2023-10-08T08:46:03.454 INFO:tasks.workunit.client.0.smithi070.stdout:1/998: creat d6/dc/d136/dfc/f152 x:0 0 0 2023-10-08T08:46:03.454 INFO:tasks.workunit.client.0.smithi070.stdout:1/999: read - d6/dc/d14/dc1/dca/d117/da1/ddb/ffb zero size 2023-10-08T08:46:03.455 INFO:tasks.workunit.client.0.smithi070.stdout:7/900: rmdir d3/d19/d95/dfe 39 2023-10-08T08:46:03.455 INFO:tasks.workunit.client.0.smithi070.stdout:7/901: dread - d3/da9/d1e/d76/fb8 zero size 2023-10-08T08:46:03.456 INFO:tasks.workunit.client.0.smithi070.stdout:7/902: fsync d3/da9/d4a/f8 0 2023-10-08T08:46:03.458 INFO:tasks.workunit.client.0.smithi070.stdout:8/930: creat d1/d2/d6/d22/d5b/d74/de1/d2e/d11a/df4/f136 x:0 0 0 2023-10-08T08:46:03.458 INFO:tasks.workunit.client.0.smithi070.stdout:8/931: readlink d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/l10f 0 2023-10-08T08:46:03.460 INFO:tasks.workunit.client.0.smithi070.stdout:8/932: unlink d1/d2/d6/d22/d5b/d74/de1/d1a/f1b 0 2023-10-08T08:46:03.461 INFO:tasks.workunit.client.0.smithi070.stdout:8/933: mkdir d1/d2/d6/d22/d5b/d74/de1/d3a/dea/d137 0 2023-10-08T08:46:03.463 INFO:tasks.workunit.client.0.smithi070.stdout:7/903: rename d3/da9/d4a/d9/da4/dae to d3/da9/d1e/d4c/d126 0 2023-10-08T08:46:03.463 INFO:tasks.workunit.client.0.smithi070.stdout:8/934: truncate d1/d2/d6/d22/d5b/d74/de1/f34 408713 0 2023-10-08T08:46:03.465 INFO:tasks.workunit.client.0.smithi070.stdout:7/904: mknod d3/d77/de2/df6/c127 0 2023-10-08T08:46:03.465 INFO:tasks.workunit.client.0.smithi070.stdout:8/935: unlink d1/d2/d6/d22/d5b/d74/de1/d1a/f79 0 2023-10-08T08:46:03.466 INFO:tasks.workunit.client.0.smithi070.stdout:7/905: write d3/da9/d4a/d9/f48 [8456006,25001] 0 2023-10-08T08:46:03.468 INFO:tasks.workunit.client.0.smithi070.stdout:7/906: unlink d3/d19/d1a/lba 0 2023-10-08T08:46:03.469 INFO:tasks.workunit.client.0.smithi070.stdout:9/726: dwrite d1/dd/d1a/fae [0,4194304] 0 2023-10-08T08:46:03.469 INFO:tasks.workunit.client.0.smithi070.stdout:7/907: truncate d3/da9/d4a/f8 3887885 0 2023-10-08T08:46:03.469 INFO:tasks.workunit.client.0.smithi070.stdout:7/908: chown d3/da9/d1e/d76/f87 0 1 2023-10-08T08:46:03.469 INFO:tasks.workunit.client.0.smithi070.stdout:7/909: fsync d3/da9/f58 0 2023-10-08T08:46:03.469 INFO:tasks.workunit.client.0.smithi070.stdout:7/910: fdatasync d3/da9/f64 0 2023-10-08T08:46:03.469 INFO:tasks.workunit.client.0.smithi070.stdout:7/911: fsync d3/d19/d6d/dd7/ff1 0 2023-10-08T08:46:03.471 INFO:tasks.workunit.client.0.smithi070.stdout:7/912: mknod d3/d79/de3/c128 0 2023-10-08T08:46:03.474 INFO:tasks.workunit.client.0.smithi070.stdout:9/727: dread d1/dd/d1a/d40/d76/d93/fd3 [0,4194304] 0 2023-10-08T08:46:03.474 INFO:tasks.workunit.client.0.smithi070.stdout:7/913: write d3/f69 [1410586,62941] 0 2023-10-08T08:46:03.481 INFO:tasks.workunit.client.0.smithi070.stdout:7/914: write d3/d19/d1a/f40 [5230484,27908] 0 2023-10-08T08:46:03.481 INFO:tasks.workunit.client.0.smithi070.stdout:7/915: chown d3/d19/d95/da3/dc8/dfb/d9f/dc5 15781548 1 2023-10-08T08:46:03.481 INFO:tasks.workunit.client.0.smithi070.stdout:7/916: chown d3/d19/d95/la5 2237 1 2023-10-08T08:46:03.481 INFO:tasks.workunit.client.0.smithi070.stdout:7/917: fdatasync d3/da9/d4a/d9/d97/fda 0 2023-10-08T08:46:03.481 INFO:tasks.workunit.client.0.smithi070.stdout:7/918: truncate d3/d19/d95/da3/dc8/dfb/f66 4968432 0 2023-10-08T08:46:03.484 INFO:tasks.workunit.client.0.smithi070.stdout:7/919: link d3/da9/d1e/f115 d3/da9/d4a/d9/da4/dd6/f129 0 2023-10-08T08:46:03.486 INFO:tasks.workunit.client.0.smithi070.stdout:7/920: unlink d3/d19/f3c 0 2023-10-08T08:46:03.489 INFO:tasks.workunit.client.0.smithi070.stdout:7/921: rename d3/da9/d4a/d9/f74 to d3/d19/f12a 0 2023-10-08T08:46:03.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/936: dwrite d1/d4d/f84 [0,4194304] 0 2023-10-08T08:46:03.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/937: chown d1/d2/d6/d22/d5b/d74/dc3/dd6/ce8 80608587 1 2023-10-08T08:46:03.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/938: write d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/fdb [5198081,54736] 0 2023-10-08T08:46:03.492 INFO:tasks.workunit.client.0.smithi070.stdout:8/939: write d1/d4d/fa3 [3636620,63129] 0 2023-10-08T08:46:03.493 INFO:tasks.workunit.client.0.smithi070.stdout:9/728: dwrite d1/dd/d1a/d40/d76/d93/fd3 [0,4194304] 0 2023-10-08T08:46:03.497 INFO:tasks.workunit.client.0.smithi070.stdout:8/940: rename d1/d2/d6/d22/d5b/d74/de1/d3a/f6c to d1/d2/d6/d22/d5b/d74/de1/d3a/dea/d137/f138 0 2023-10-08T08:46:03.497 INFO:tasks.workunit.client.0.smithi070.stdout:8/941: stat d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/ff2 0 2023-10-08T08:46:03.524 INFO:tasks.workunit.client.0.smithi070.stdout:6/791: sync 2023-10-08T08:46:03.524 INFO:tasks.workunit.client.0.smithi070.stdout:4/755: sync 2023-10-08T08:46:03.524 INFO:tasks.workunit.client.0.smithi070.stdout:5/904: sync 2023-10-08T08:46:03.524 INFO:tasks.workunit.client.0.smithi070.stdout:4/756: fsync dc/d17/d1f/d5e/d9f/fe5 0 2023-10-08T08:46:03.524 INFO:tasks.workunit.client.0.smithi070.stdout:4/757: write dc/d17/d24/d4c/f60 [408565,76583] 0 2023-10-08T08:46:03.524 INFO:tasks.workunit.client.0.smithi070.stdout:4/758: chown dc/d17/d1f/d5e/d9f/fc2 133 1 2023-10-08T08:46:03.530 INFO:tasks.workunit.client.0.smithi070.stdout:8/942: dwrite d1/d2/d6/fa [0,4194304] 0 2023-10-08T08:46:03.530 INFO:tasks.workunit.client.0.smithi070.stdout:4/759: dread dc/d17/d24/d6b/f8f [0,4194304] 0 2023-10-08T08:46:03.533 INFO:tasks.workunit.client.0.smithi070.stdout:8/943: unlink d1/d2/d6/d22/d5b/d74/de1/d2e/c5a 0 2023-10-08T08:46:03.533 INFO:tasks.workunit.client.0.smithi070.stdout:8/944: chown d1/d2/d6/d22/d5b/d74/de1/d2e/d11a/l2f 117200901 1 2023-10-08T08:46:03.543 INFO:tasks.workunit.client.0.smithi070.stdout:4/760: dread dc/d17/d1f/f43 [0,4194304] 0 2023-10-08T08:46:03.544 INFO:tasks.workunit.client.0.smithi070.stdout:4/761: mkdir dc/d17/d24/d4c/df9 0 2023-10-08T08:46:03.547 INFO:tasks.workunit.client.0.smithi070.stdout:7/922: dwrite d3/da9/d1e/d4c/fcf [0,4194304] 0 2023-10-08T08:46:03.547 INFO:tasks.workunit.client.0.smithi070.stdout:7/923: readlink d3/da9/d1e/d76/lbb 0 2023-10-08T08:46:03.548 INFO:tasks.workunit.client.0.smithi070.stdout:4/762: rename dc/d17/d24/d6b/dc7/cce to dc/d17/d24/d55/cfa 0 2023-10-08T08:46:03.552 INFO:tasks.workunit.client.0.smithi070.stdout:7/924: rmdir d3/d19/d1a 39 2023-10-08T08:46:03.553 INFO:tasks.workunit.client.0.smithi070.stdout:7/925: mkdir d3/d77/d112/d12b 0 2023-10-08T08:46:03.553 INFO:tasks.workunit.client.0.smithi070.stdout:7/926: read - d3/da9/d1e/d76/fb8 zero size 2023-10-08T08:46:03.553 INFO:tasks.workunit.client.0.smithi070.stdout:8/945: dwrite d1/f24 [0,4194304] 0 2023-10-08T08:46:03.554 INFO:tasks.workunit.client.0.smithi070.stdout:7/927: mknod d3/d19/c12c 0 2023-10-08T08:46:03.558 INFO:tasks.workunit.client.0.smithi070.stdout:8/946: write d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/d10d/f122 [3861326,74127] 0 2023-10-08T08:46:03.558 INFO:tasks.workunit.client.0.smithi070.stdout:8/947: stat d1/d2/d6/d22/d5b/d74/de1/da9/d113 0 2023-10-08T08:46:03.563 INFO:tasks.workunit.client.0.smithi070.stdout:6/792: dwrite df/d53/f5e [0,4194304] 0 2023-10-08T08:46:03.564 INFO:tasks.workunit.client.0.smithi070.stdout:7/928: write d3/d19/d1a/f4b [775527,115884] 0 2023-10-08T08:46:03.564 INFO:tasks.workunit.client.0.smithi070.stdout:7/929: chown d3/d19/cca 5276 1 2023-10-08T08:46:03.565 INFO:tasks.workunit.client.0.smithi070.stdout:6/793: symlink df/d26/d78/d90/dae/dfd/l104 0 2023-10-08T08:46:03.565 INFO:tasks.workunit.client.0.smithi070.stdout:4/763: dread dc/d17/d1f/f29 [0,4194304] 0 2023-10-08T08:46:03.565 INFO:tasks.workunit.client.0.smithi070.stdout:5/905: dwrite d5/f9f [0,4194304] 0 2023-10-08T08:46:03.566 INFO:tasks.workunit.client.0.smithi070.stdout:7/930: mknod d3/d77/de2/df6/c12d 0 2023-10-08T08:46:03.566 INFO:tasks.workunit.client.0.smithi070.stdout:7/931: truncate d3/da9/d1e/d4c/f80 1106827 0 2023-10-08T08:46:03.567 INFO:tasks.workunit.client.0.smithi070.stdout:4/764: mkdir dc/d17/dbf/dfb 0 2023-10-08T08:46:03.567 INFO:tasks.workunit.client.0.smithi070.stdout:6/794: write df/d26/d42/d4b/f5b [2267437,66567] 0 2023-10-08T08:46:03.568 INFO:tasks.workunit.client.0.smithi070.stdout:6/795: creat df/d26/d42/d43/d4a/d97/dc0/f105 x:0 0 0 2023-10-08T08:46:03.570 INFO:tasks.workunit.client.0.smithi070.stdout:4/765: rename dc/d17/f2e to dc/d17/d1f/ffc 0 2023-10-08T08:46:03.570 INFO:tasks.workunit.client.0.smithi070.stdout:4/766: truncate dc/d17/d24/d4c/d4e/faa 278172 0 2023-10-08T08:46:03.571 INFO:tasks.workunit.client.0.smithi070.stdout:6/796: symlink df/d26/d42/d43/d4a/d97/da5/l106 0 2023-10-08T08:46:03.573 INFO:tasks.workunit.client.0.smithi070.stdout:4/767: rename dc/f4b to dc/d17/d1f/d5e/d9f/ffd 0 2023-10-08T08:46:03.573 INFO:tasks.workunit.client.0.smithi070.stdout:4/768: write dc/d17/d1f/fe6 [829586,96179] 0 2023-10-08T08:46:03.573 INFO:tasks.workunit.client.0.smithi070.stdout:4/769: read - dc/d17/fea zero size 2023-10-08T08:46:03.573 INFO:tasks.workunit.client.0.smithi070.stdout:6/797: link df/d26/d42/db1/f9c df/d26/d42/d4b/db6/d7d/dc8/d103/dff/f107 0 2023-10-08T08:46:03.573 INFO:tasks.workunit.client.0.smithi070.stdout:6/798: truncate df/d26/f9f 60942 0 2023-10-08T08:46:03.576 INFO:tasks.workunit.client.0.smithi070.stdout:6/799: write df/d26/d42/d4b/db6/f8b [3025807,93503] 0 2023-10-08T08:46:03.578 INFO:tasks.workunit.client.0.smithi070.stdout:6/800: link f5 df/d26/d42/d43/d4a/d75/f108 0 2023-10-08T08:46:03.580 INFO:tasks.workunit.client.0.smithi070.stdout:5/906: dread d5/d5f/d61/d30/d83/f8c [0,4194304] 0 2023-10-08T08:46:03.586 INFO:tasks.workunit.client.0.smithi070.stdout:5/907: rename d5/da/d22/ddd/d38/d55/dbf to d5/d5f/d63/d8b/d8f/d131 0 2023-10-08T08:46:03.587 INFO:tasks.workunit.client.0.smithi070.stdout:5/908: symlink d5/d5f/d61/l132 0 2023-10-08T08:46:03.592 INFO:tasks.workunit.client.0.smithi070.stdout:5/909: rename d5/d5f/d63/d8b/da8/dac/de2 to d5/d5f/d63/d133 0 2023-10-08T08:46:03.593 INFO:tasks.workunit.client.0.smithi070.stdout:5/910: mknod d5/d5f/d63/d8b/da8/c134 0 2023-10-08T08:46:03.593 INFO:tasks.workunit.client.0.smithi070.stdout:5/911: truncate d5/f101 1025051 0 2023-10-08T08:46:03.595 INFO:tasks.workunit.client.0.smithi070.stdout:5/912: creat d5/da/d22/ddd/d2a/f135 x:0 0 0 2023-10-08T08:46:03.595 INFO:tasks.workunit.client.0.smithi070.stdout:5/913: truncate d5/da/d22/ddd/d38/d55/f53 1560730 0 2023-10-08T08:46:03.595 INFO:tasks.workunit.client.0.smithi070.stdout:5/914: truncate d5/d5f/d61/d30/d54/d62/dae/fb0 1676012 0 2023-10-08T08:46:03.596 INFO:tasks.workunit.client.0.smithi070.stdout:4/770: dwrite dc/d17/d24/d55/fa0 [0,4194304] 0 2023-10-08T08:46:03.596 INFO:tasks.workunit.client.0.smithi070.stdout:4/771: chown dc/d5a/c85 315 1 2023-10-08T08:46:03.602 INFO:tasks.workunit.client.0.smithi070.stdout:6/801: dwrite f7 [0,4194304] 0 2023-10-08T08:46:03.613 INFO:tasks.workunit.client.0.smithi070.stdout:4/772: dread dc/d17/d1f/d54/f72 [4194304,4194304] 0 2023-10-08T08:46:03.613 INFO:tasks.workunit.client.0.smithi070.stdout:4/773: chown dc/l22 223 1 2023-10-08T08:46:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:6/802: dread df/d26/d42/db1/f3d [0,4194304] 0 2023-10-08T08:46:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:4/774: creat dc/d17/d24/d4c/d4e/dab/ffe x:0 0 0 2023-10-08T08:46:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:6/803: rmdir df/d53 39 2023-10-08T08:46:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:4/775: mkdir dc/d17/d24/d4c/d4e/dab/dff 0 2023-10-08T08:46:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:4/776: fdatasync dc/d17/d1f/d5e/fb2 0 2023-10-08T08:46:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:6/804: rmdir df/d26/d42/d43/d4a/d97 39 2023-10-08T08:46:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:6/805: getdents df/d26/d78 0 2023-10-08T08:46:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:4/777: getdents dc/d17/dbf 0 2023-10-08T08:46:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:5/915: dread d5/da/d22/f89 [0,4194304] 0 2023-10-08T08:46:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:5/916: write d5/da/d22/ddd/ff8 [4913329,25400] 0 2023-10-08T08:46:03.620 INFO:tasks.workunit.client.0.smithi070.stdout:6/806: rename df/d26/c60 to df/d26/d42/d43/d4a/d97/de3/c109 0 2023-10-08T08:46:03.621 INFO:tasks.workunit.client.0.smithi070.stdout:6/807: dread df/d71/fe7 [0,4194304] 0 2023-10-08T08:46:03.622 INFO:tasks.workunit.client.0.smithi070.stdout:6/808: mknod df/d26/d78/d90/c10a 0 2023-10-08T08:46:03.625 INFO:tasks.workunit.client.0.smithi070.stdout:6/809: creat df/d26/d42/d43/d4a/d75/d7e/f10b x:0 0 0 2023-10-08T08:46:03.625 INFO:tasks.workunit.client.0.smithi070.stdout:6/810: readlink df/d11/l14 0 2023-10-08T08:46:03.625 INFO:tasks.workunit.client.0.smithi070.stdout:6/811: stat df/d26/d78/d90/dae 0 2023-10-08T08:46:03.626 INFO:tasks.workunit.client.0.smithi070.stdout:4/778: dread dc/d17/d1f/fe6 [0,4194304] 0 2023-10-08T08:46:03.628 INFO:tasks.workunit.client.0.smithi070.stdout:4/779: creat dc/d17/dbf/dfb/f100 x:0 0 0 2023-10-08T08:46:03.628 INFO:tasks.workunit.client.0.smithi070.stdout:4/780: fdatasync dc/d17/d24/d4c/d4e/fd6 0 2023-10-08T08:46:03.628 INFO:tasks.workunit.client.0.smithi070.stdout:4/781: truncate dc/d17/d79/dad/db6/dc1/dc3/fdc 564116 0 2023-10-08T08:46:03.628 INFO:tasks.workunit.client.0.smithi070.stdout:6/812: getdents df/d26/d78/d90/dae/dfd 0 2023-10-08T08:46:03.628 INFO:tasks.workunit.client.0.smithi070.stdout:5/917: dread d5/da/d4d/f64 [0,4194304] 0 2023-10-08T08:46:03.629 INFO:tasks.workunit.client.0.smithi070.stdout:6/813: truncate df/d26/f88 930551 0 2023-10-08T08:46:03.629 INFO:tasks.workunit.client.0.smithi070.stdout:6/814: readlink df/d26/d42/d43/d4a/d97/lc5 0 2023-10-08T08:46:03.629 INFO:tasks.workunit.client.0.smithi070.stdout:6/815: stat df/d26/d42/d4b/db6/d7d/dc8/d103/feb 0 2023-10-08T08:46:03.629 INFO:tasks.workunit.client.0.smithi070.stdout:6/816: truncate df/d26/d42/d43/d4a/d75/d7e/f10b 888368 0 2023-10-08T08:46:03.629 INFO:tasks.workunit.client.0.smithi070.stdout:6/817: mkdir df/d26/d42/d4b/db6/d7d/dc8/d103/de0/df9/d10c 0 2023-10-08T08:46:03.631 INFO:tasks.workunit.client.0.smithi070.stdout:6/818: rename df/l72 to df/d26/d42/d4b/db6/d7d/dc8/dfe/l10d 0 2023-10-08T08:46:03.634 INFO:tasks.workunit.client.0.smithi070.stdout:4/782: creat dc/d17/d1f/d54/f101 x:0 0 0 2023-10-08T08:46:03.634 INFO:tasks.workunit.client.0.smithi070.stdout:6/819: creat df/d53/f10e x:0 0 0 2023-10-08T08:46:03.634 INFO:tasks.workunit.client.0.smithi070.stdout:6/820: dread - df/d26/d42/d43/d4a/d75/d7e/fa3 zero size 2023-10-08T08:46:03.634 INFO:tasks.workunit.client.0.smithi070.stdout:6/821: chown df/d26/d42/d43/fea 3030491 1 2023-10-08T08:46:03.634 INFO:tasks.workunit.client.0.smithi070.stdout:6/822: chown df/d71 10720 1 2023-10-08T08:46:03.634 INFO:tasks.workunit.client.0.smithi070.stdout:4/783: mkdir dc/d17/d24/d4c/d4e/dda/d102 0 2023-10-08T08:46:03.636 INFO:tasks.workunit.client.0.smithi070.stdout:4/784: symlink dc/d17/d24/d4c/d4e/dda/l103 0 2023-10-08T08:46:03.637 INFO:tasks.workunit.client.0.smithi070.stdout:4/785: write dc/d17/d24/d4c/d4e/f82 [3391062,67635] 0 2023-10-08T08:46:03.641 INFO:tasks.workunit.client.0.smithi070.stdout:4/786: write dc/d17/d1f/f29 [4648493,82497] 0 2023-10-08T08:46:03.642 INFO:tasks.workunit.client.0.smithi070.stdout:4/787: dread - dc/d17/d1f/d54/f101 zero size 2023-10-08T08:46:03.643 INFO:tasks.workunit.client.0.smithi070.stdout:4/788: rmdir dc/d17/d24/d55/da4 39 2023-10-08T08:46:03.644 INFO:tasks.workunit.client.0.smithi070.stdout:4/789: symlink dc/d17/d24/d6b/dc7/l104 0 2023-10-08T08:46:03.644 INFO:tasks.workunit.client.0.smithi070.stdout:4/790: dread - dc/d17/d24/d55/ff5 zero size 2023-10-08T08:46:03.648 INFO:tasks.workunit.client.0.smithi070.stdout:4/791: dread dc/d17/d24/d4c/f60 [0,4194304] 0 2023-10-08T08:46:03.648 INFO:tasks.workunit.client.0.smithi070.stdout:4/792: dread - dc/d17/d24/d55/da4/fb8 zero size 2023-10-08T08:46:03.649 INFO:tasks.workunit.client.0.smithi070.stdout:4/793: creat dc/d17/d1f/d5e/dd0/f105 x:0 0 0 2023-10-08T08:46:03.649 INFO:tasks.workunit.client.0.smithi070.stdout:5/918: dwrite d5/da/d4d/dc2/f10d [0,4194304] 0 2023-10-08T08:46:03.652 INFO:tasks.workunit.client.0.smithi070.stdout:5/919: creat d5/d5f/d61/d30/d83/d121/f136 x:0 0 0 2023-10-08T08:46:03.654 INFO:tasks.workunit.client.0.smithi070.stdout:5/920: write d5/da/d4d/f64 [4524490,72432] 0 2023-10-08T08:46:03.658 INFO:tasks.workunit.client.0.smithi070.stdout:5/921: rename d5/lb7 to d5/d5f/d61/d30/d83/d121/l137 0 2023-10-08T08:46:03.658 INFO:tasks.workunit.client.0.smithi070.stdout:5/922: readlink d5/da/d22/ddd/d38/lb6 0 2023-10-08T08:46:03.663 INFO:tasks.workunit.client.0.smithi070.stdout:6/823: dwrite df/d26/d42/d43/d4a/d97/dc0/ffb [0,4194304] 0 2023-10-08T08:46:03.663 INFO:tasks.workunit.client.0.smithi070.stdout:6/824: write df/d26/d78/d90/fd4 [373762,97524] 0 2023-10-08T08:46:03.664 INFO:tasks.workunit.client.0.smithi070.stdout:6/825: fsync df/d26/d42/d4b/db6/d7d/faf 0 2023-10-08T08:46:03.664 INFO:tasks.workunit.client.0.smithi070.stdout:4/794: dread dc/f51 [0,4194304] 0 2023-10-08T08:46:03.673 INFO:tasks.workunit.client.0.smithi070.stdout:6/826: dread df/d26/d42/d4b/d80/d94/f99 [0,4194304] 0 2023-10-08T08:46:03.674 INFO:tasks.workunit.client.0.smithi070.stdout:6/827: chown df/d26/d42/d43/d4a/l76 131522 1 2023-10-08T08:46:03.674 INFO:tasks.workunit.client.0.smithi070.stdout:5/923: dread d5/ff [0,4194304] 0 2023-10-08T08:46:03.674 INFO:tasks.workunit.client.0.smithi070.stdout:4/795: fsync dc/d17/d24/d4c/d4e/f82 0 2023-10-08T08:46:03.674 INFO:tasks.workunit.client.0.smithi070.stdout:5/924: mknod d5/d5f/d63/d8b/d8f/d131/d103/c138 0 2023-10-08T08:46:03.675 INFO:tasks.workunit.client.0.smithi070.stdout:6/828: unlink df/d11/c49 0 2023-10-08T08:46:03.675 INFO:tasks.workunit.client.0.smithi070.stdout:4/796: unlink dc/d17/d79/l97 0 2023-10-08T08:46:03.676 INFO:tasks.workunit.client.0.smithi070.stdout:5/925: getdents d5/da/d4d/dc2 0 2023-10-08T08:46:03.676 INFO:tasks.workunit.client.0.smithi070.stdout:4/797: creat dc/d5a/f106 x:0 0 0 2023-10-08T08:46:03.679 INFO:tasks.workunit.client.0.smithi070.stdout:5/926: truncate d5/d5f/d61/d30/d83/f8c 2721403 0 2023-10-08T08:46:03.680 INFO:tasks.workunit.client.0.smithi070.stdout:6/829: dread df/d11/f58 [0,4194304] 0 2023-10-08T08:46:03.681 INFO:tasks.workunit.client.0.smithi070.stdout:5/927: unlink d5/d5f/d63/d8b/f9e 0 2023-10-08T08:46:03.681 INFO:tasks.workunit.client.0.smithi070.stdout:5/928: write d5/da/d22/ddd/d38/d55/fe0 [192676,26518] 0 2023-10-08T08:46:03.684 INFO:tasks.workunit.client.0.smithi070.stdout:6/830: link df/d11/f58 df/d26/d42/d43/d4a/f10f 0 2023-10-08T08:46:03.684 INFO:tasks.workunit.client.0.smithi070.stdout:6/831: truncate df/d26/f84 577793 0 2023-10-08T08:46:03.685 INFO:tasks.workunit.client.0.smithi070.stdout:6/832: unlink df/d26/d78/fbe 0 2023-10-08T08:46:03.687 INFO:tasks.workunit.client.0.smithi070.stdout:6/833: symlink df/d26/d42/d4b/db6/d7d/dc8/d103/dff/l110 0 2023-10-08T08:46:03.689 INFO:tasks.workunit.client.0.smithi070.stdout:6/834: link f5 df/d26/d42/d43/d4a/d97/f111 0 2023-10-08T08:46:03.689 INFO:tasks.workunit.client.0.smithi070.stdout:6/835: fdatasync df/d26/d42/d43/d4a/d97/dc0/f105 0 2023-10-08T08:46:03.718 INFO:tasks.workunit.client.0.smithi070.stdout:6/836: dwrite df/d26/f2f [0,4194304] 0 2023-10-08T08:46:03.718 INFO:tasks.workunit.client.0.smithi070.stdout:6/837: chown df/d26/d42/d43/d4a/d97/dc0/f105 331718 1 2023-10-08T08:46:03.718 INFO:tasks.workunit.client.0.smithi070.stdout:5/929: dread d5/da/d22/f59 [0,4194304] 0 2023-10-08T08:46:03.720 INFO:tasks.workunit.client.0.smithi070.stdout:5/930: creat d5/da/d22/f139 x:0 0 0 2023-10-08T08:46:03.724 INFO:tasks.workunit.client.0.smithi070.stdout:5/931: truncate d5/f26 646297 0 2023-10-08T08:46:03.726 INFO:tasks.workunit.client.0.smithi070.stdout:5/932: creat d5/da/d22/ddd/d38/f13a x:0 0 0 2023-10-08T08:46:03.728 INFO:tasks.workunit.client.0.smithi070.stdout:5/933: rename d5/da/d22/ddd/d38/d55/ddf/deb to d5/d5f/d61/d30/d83/df5/d13b 0 2023-10-08T08:46:03.733 INFO:tasks.workunit.client.0.smithi070.stdout:5/934: dread d5/f101 [0,4194304] 0 2023-10-08T08:46:03.735 INFO:tasks.workunit.client.0.smithi070.stdout:5/935: rmdir d5/d5f/d63/d8b/da8/dac 39 2023-10-08T08:46:03.735 INFO:tasks.workunit.client.0.smithi070.stdout:5/936: fdatasync d5/d5f/d63/d8b/da8/dac/fcc 0 2023-10-08T08:46:03.736 INFO:tasks.workunit.client.0.smithi070.stdout:5/937: creat d5/d5f/d61/d30/d54/dab/f13c x:0 0 0 2023-10-08T08:46:03.748 INFO:tasks.workunit.client.0.smithi070.stdout:5/938: dread d5/da/d22/ddd/d2a/f95 [0,4194304] 0 2023-10-08T08:46:03.749 INFO:tasks.workunit.client.0.smithi070.stdout:6/838: mkdir df/d26/d78/d90/d112 0 2023-10-08T08:46:03.753 INFO:tasks.workunit.client.0.smithi070.stdout:6/839: link df/d26/d78/d90/daa/fb0 df/d26/d42/d4b/db6/d7d/dc8/d103/de0/df9/f113 0 2023-10-08T08:46:03.753 INFO:tasks.workunit.client.0.smithi070.stdout:6/840: write df/d26/d78/fb8 [239181,32253] 0 2023-10-08T08:46:03.754 INFO:tasks.workunit.client.0.smithi070.stdout:6/841: creat df/d26/d42/d43/d4a/d97/dc0/f114 x:0 0 0 2023-10-08T08:46:03.756 INFO:tasks.workunit.client.0.smithi070.stdout:5/939: dread d5/da/d22/f59 [0,4194304] 0 2023-10-08T08:46:03.757 INFO:tasks.workunit.client.0.smithi070.stdout:6/842: unlink df/d26/d42/d43/d4a/d75/d7e/fa6 0 2023-10-08T08:46:03.757 INFO:tasks.workunit.client.0.smithi070.stdout:6/843: truncate df/d26/d42/d4b/d80/fcb 682133 0 2023-10-08T08:46:03.757 INFO:tasks.workunit.client.0.smithi070.stdout:5/940: creat d5/f13d x:0 0 0 2023-10-08T08:46:03.760 INFO:tasks.workunit.client.0.smithi070.stdout:5/941: unlink d5/d5f/d61/d30/d54/dab/lea 0 2023-10-08T08:46:03.761 INFO:tasks.workunit.client.0.smithi070.stdout:5/942: mknod d5/d5f/d63/dca/c13e 0 2023-10-08T08:46:03.762 INFO:tasks.workunit.client.0.smithi070.stdout:5/943: creat d5/da/d22/ddd/d38/d55/d112/f13f x:0 0 0 2023-10-08T08:46:03.779 INFO:tasks.workunit.client.0.smithi070.stdout:6/844: dwrite df/d26/d42/d4b/fed [0,4194304] 0 2023-10-08T08:46:03.779 INFO:tasks.workunit.client.0.smithi070.stdout:6/845: chown df/d26/d42/d4b/db6/d7d/dc8/d103/dff/l110 0 1 2023-10-08T08:46:03.783 INFO:tasks.workunit.client.0.smithi070.stdout:6/846: symlink df/d26/d78/d90/dae/db3/l115 0 2023-10-08T08:46:03.784 INFO:tasks.workunit.client.0.smithi070.stdout:5/944: dwrite d5/da/d22/ddd/d38/d55/fe0 [0,4194304] 0 2023-10-08T08:46:03.784 INFO:tasks.workunit.client.0.smithi070.stdout:5/945: chown d5/da/fbd 5723 1 2023-10-08T08:46:03.786 INFO:tasks.workunit.client.0.smithi070.stdout:5/946: write d5/da/d4d/f85 [1339757,99083] 0 2023-10-08T08:46:03.786 INFO:tasks.workunit.client.0.smithi070.stdout:5/947: getdents d5/da/d22/d75 0 2023-10-08T08:46:03.786 INFO:tasks.workunit.client.0.smithi070.stdout:6/847: rename df/d26/d42/db1/f3d to df/d26/d42/d4b/db6/f116 0 2023-10-08T08:46:03.787 INFO:tasks.workunit.client.0.smithi070.stdout:5/948: getdents d5/d5f/d63/d8b/da8/dac 0 2023-10-08T08:46:03.788 INFO:tasks.workunit.client.0.smithi070.stdout:6/848: creat df/d26/d78/d90/dae/db3/f117 x:0 0 0 2023-10-08T08:46:03.790 INFO:tasks.workunit.client.0.smithi070.stdout:6/849: write df/d26/d78/d90/fb7 [983249,109201] 0 2023-10-08T08:46:03.792 INFO:tasks.workunit.client.0.smithi070.stdout:6/850: rename df/d26/d42/d4b/d80/fcb to df/d26/d42/d43/d4a/d97/dc0/df7/f118 0 2023-10-08T08:46:03.806 INFO:tasks.workunit.client.0.smithi070.stdout:6/851: dread df/d26/d42/db1/ffc [0,4194304] 0 2023-10-08T08:46:03.806 INFO:tasks.workunit.client.0.smithi070.stdout:5/949: dwrite d5/d5f/d63/d8b/d8f/d131/f105 [0,4194304] 0 2023-10-08T08:46:03.811 INFO:tasks.workunit.client.0.smithi070.stdout:6/852: rename df/d26/d42/d43/d4a/d97/da5 to df/d26/d42/db1/d119 0 2023-10-08T08:46:03.812 INFO:tasks.workunit.client.0.smithi070.stdout:6/853: symlink df/d26/l11a 0 2023-10-08T08:46:03.814 INFO:tasks.workunit.client.0.smithi070.stdout:5/950: rename d5/d5f/d61/d30/d54/c122 to d5/d5f/d63/d8b/da8/c140 0 2023-10-08T08:46:03.814 INFO:tasks.workunit.client.0.smithi070.stdout:5/951: dread - d5/da/d22/ddd/d38/dc3/f12f zero size 2023-10-08T08:46:03.814 INFO:tasks.workunit.client.0.smithi070.stdout:5/952: stat d5/d5f/d61/d30/d54/d62/dae 0 2023-10-08T08:46:03.814 INFO:tasks.workunit.client.0.smithi070.stdout:6/854: truncate df/d26/d42/d4b/db6/f8b 2144080 0 2023-10-08T08:46:03.816 INFO:tasks.workunit.client.0.smithi070.stdout:5/953: link d5/da/d22/ddd/d2a/dc0/f117 d5/da/d22/ddd/f141 0 2023-10-08T08:46:03.816 INFO:tasks.workunit.client.0.smithi070.stdout:5/954: read - d5/d5f/d61/d30/d54/dab/ff0 zero size 2023-10-08T08:46:03.816 INFO:tasks.workunit.client.0.smithi070.stdout:5/955: write d5/d5f/d61/f11c [109020,77774] 0 2023-10-08T08:46:03.816 INFO:tasks.workunit.client.0.smithi070.stdout:6/855: symlink df/d26/d42/d4b/db6/d7d/dc8/l11b 0 2023-10-08T08:46:03.816 INFO:tasks.workunit.client.0.smithi070.stdout:6/856: getdents df/d26/d78/d90/dae/dfd 0 2023-10-08T08:46:03.817 INFO:tasks.workunit.client.0.smithi070.stdout:5/956: unlink d5/d5f/d63/dca/c10f 0 2023-10-08T08:46:03.817 INFO:tasks.workunit.client.0.smithi070.stdout:5/957: write d5/da/d22/ddd/d2a/dc0/f117 [515799,128651] 0 2023-10-08T08:46:03.818 INFO:tasks.workunit.client.0.smithi070.stdout:6/857: read df/d71/f7b [167438,19900] 0 2023-10-08T08:46:03.818 INFO:tasks.workunit.client.0.smithi070.stdout:6/858: chown df/d26/d78/fb8 75 1 2023-10-08T08:46:03.818 INFO:tasks.workunit.client.0.smithi070.stdout:6/859: chown df/d26/f2f 15869 1 2023-10-08T08:46:03.818 INFO:tasks.workunit.client.0.smithi070.stdout:6/860: mkdir df/d26/d42/d4b/db6/d7d/dc8/d11c 0 2023-10-08T08:46:03.820 INFO:tasks.workunit.client.0.smithi070.stdout:6/861: mknod df/d26/d42/d43/d4a/d97/de8/c11d 0 2023-10-08T08:46:03.822 INFO:tasks.workunit.client.0.smithi070.stdout:4/798: sync 2023-10-08T08:46:03.822 INFO:tasks.workunit.client.0.smithi070.stdout:8/948: sync 2023-10-08T08:46:03.823 INFO:tasks.workunit.client.0.smithi070.stdout:7/932: sync 2023-10-08T08:46:03.823 INFO:tasks.workunit.client.0.smithi070.stdout:9/729: sync 2023-10-08T08:46:03.823 INFO:tasks.workunit.client.0.smithi070.stdout:4/799: dread - dc/d17/d1f/d54/f101 zero size 2023-10-08T08:46:03.823 INFO:tasks.workunit.client.0.smithi070.stdout:7/933: dread - d3/d19/d1a/f99 zero size 2023-10-08T08:46:03.823 INFO:tasks.workunit.client.0.smithi070.stdout:7/934: write d3/d19/d95/da3/dc8/dfb/d9f/dc5/f101 [901471,93079] 0 2023-10-08T08:46:03.824 INFO:tasks.workunit.client.0.smithi070.stdout:6/862: creat df/d26/d42/d4b/d80/f11e x:0 0 0 2023-10-08T08:46:03.824 INFO:tasks.workunit.client.0.smithi070.stdout:4/800: creat dc/d17/d24/d4c/d4e/dab/dff/f107 x:0 0 0 2023-10-08T08:46:03.824 INFO:tasks.workunit.client.0.smithi070.stdout:4/801: dread - dc/d17/d1f/d5e/f87 zero size 2023-10-08T08:46:03.826 INFO:tasks.workunit.client.0.smithi070.stdout:4/802: creat dc/d17/d24/d4c/d4e/f108 x:0 0 0 2023-10-08T08:46:03.826 INFO:tasks.workunit.client.0.smithi070.stdout:4/803: read - dc/f13 zero size 2023-10-08T08:46:03.826 INFO:tasks.workunit.client.0.smithi070.stdout:4/804: chown dc/d17/fea 594 1 2023-10-08T08:46:03.826 INFO:tasks.workunit.client.0.smithi070.stdout:4/805: symlink dc/d17/d79/dad/l109 0 2023-10-08T08:46:03.827 INFO:tasks.workunit.client.0.smithi070.stdout:4/806: mkdir dc/d17/dbf/dfb/d10a 0 2023-10-08T08:46:03.831 INFO:tasks.workunit.client.0.smithi070.stdout:8/949: unlink d1/d2/lc 0 2023-10-08T08:46:03.832 INFO:tasks.workunit.client.0.smithi070.stdout:4/807: read dc/d5f/fbe [1300811,16827] 0 2023-10-08T08:46:03.833 INFO:tasks.workunit.client.0.smithi070.stdout:4/808: getdents dc/d17/d24/d4c/d4e/dda/df4 0 2023-10-08T08:46:03.834 INFO:tasks.workunit.client.0.smithi070.stdout:4/809: fsync dc/d17/d24/fa6 0 2023-10-08T08:46:03.835 INFO:tasks.workunit.client.0.smithi070.stdout:5/958: rename d5/d5f to d5/da/d22/ddd/d38/d142 0 2023-10-08T08:46:03.839 INFO:tasks.workunit.client.0.smithi070.stdout:6/863: rename df/d26/d42/d43/d4a/d97/dc0/f114 to df/d26/d78/f11f 0 2023-10-08T08:46:03.840 INFO:tasks.workunit.client.0.smithi070.stdout:6/864: mkdir df/d26/d42/d43/d120 0 2023-10-08T08:46:03.840 INFO:tasks.workunit.client.0.smithi070.stdout:6/865: truncate df/d26/d42/d4b/db6/d7d/dc8/d103/feb 266352 0 2023-10-08T08:46:03.841 INFO:tasks.workunit.client.0.smithi070.stdout:8/950: rename d1/d2/d6/d22/d5b/d74/de1/d2e/f6e to d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/f139 0 2023-10-08T08:46:03.848 INFO:tasks.workunit.client.0.smithi070.stdout:9/730: dwrite d1/dd/d19/fc8 [0,4194304] 0 2023-10-08T08:46:03.850 INFO:tasks.workunit.client.0.smithi070.stdout:7/935: dwrite d3/d19/d95/da3/dc8/dfb/f94 [0,4194304] 0 2023-10-08T08:46:03.850 INFO:tasks.workunit.client.0.smithi070.stdout:7/936: write d3/d19/d6d/f8c [349779,111471] 0 2023-10-08T08:46:03.869 INFO:tasks.workunit.client.0.smithi070.stdout:8/951: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d80/f124 [0,4194304] 0 2023-10-08T08:46:03.869 INFO:tasks.workunit.client.0.smithi070.stdout:8/952: truncate d1/d2/d6/d22/d5b/d74/de1/f4f 206544 0 2023-10-08T08:46:03.872 INFO:tasks.workunit.client.0.smithi070.stdout:7/937: dread d3/d19/d95/da3/dc8/dfb/f66 [0,4194304] 0 2023-10-08T08:46:03.873 INFO:tasks.workunit.client.0.smithi070.stdout:9/731: dread d1/dd/d26/d27/d2d/d70/d90/f9e [0,4194304] 0 2023-10-08T08:46:03.873 INFO:tasks.workunit.client.0.smithi070.stdout:8/953: rename d1/d2/d6/d22/f33 to d1/d2/d6/d22/d5b/d74/dc3/f13a 0 2023-10-08T08:46:03.873 INFO:tasks.workunit.client.0.smithi070.stdout:9/732: fsync d1/dd/d26/f8a 0 2023-10-08T08:46:03.874 INFO:tasks.workunit.client.0.smithi070.stdout:4/810: dwrite dc/d17/d24/d4c/d4e/fa9 [0,4194304] 0 2023-10-08T08:46:03.874 INFO:tasks.workunit.client.0.smithi070.stdout:4/811: read - dc/d17/d24/d4c/d4e/dda/df4/ff8 zero size 2023-10-08T08:46:03.874 INFO:tasks.workunit.client.0.smithi070.stdout:5/959: dwrite d5/da/d22/ddd/f39 [0,4194304] 0 2023-10-08T08:46:03.874 INFO:tasks.workunit.client.0.smithi070.stdout:6/866: dwrite df/d26/f37 [0,4194304] 0 2023-10-08T08:46:03.874 INFO:tasks.workunit.client.0.smithi070.stdout:6/867: chown df/d26/d42/db1/d119/l106 14802250 1 2023-10-08T08:46:03.876 INFO:tasks.workunit.client.0.smithi070.stdout:8/954: rmdir d1/d2/d6/d22/d5b/d74/de1/d2e/d11a 39 2023-10-08T08:46:03.878 INFO:tasks.workunit.client.0.smithi070.stdout:4/812: rmdir dc/d17/dbf/dfb/d10a 0 2023-10-08T08:46:03.882 INFO:tasks.workunit.client.0.smithi070.stdout:8/955: symlink d1/d4d/d61/l13b 0 2023-10-08T08:46:03.885 INFO:tasks.workunit.client.0.smithi070.stdout:8/956: link d1/d2/d6/d22/d5b/d74/de1/d2e/d45/fd9 d1/d2/d6/d22/d5b/f13c 0 2023-10-08T08:46:03.886 INFO:tasks.workunit.client.0.smithi070.stdout:8/957: fdatasync d1/d2/d6/d22/d5b/d74/de1/d21/f47 0 2023-10-08T08:46:03.893 INFO:tasks.workunit.client.0.smithi070.stdout:9/733: dread d1/f4b [0,4194304] 0 2023-10-08T08:46:03.893 INFO:tasks.workunit.client.0.smithi070.stdout:9/734: chown d1/dd/d1a/f62 1973 1 2023-10-08T08:46:03.894 INFO:tasks.workunit.client.0.smithi070.stdout:5/960: dread d5/da/f15 [4194304,4194304] 0 2023-10-08T08:46:03.894 INFO:tasks.workunit.client.0.smithi070.stdout:5/961: fsync d5/da/d22/ddd/d38/d142/d61/d30/d54/d62/dae/f10a 0 2023-10-08T08:46:03.895 INFO:tasks.workunit.client.0.smithi070.stdout:5/962: mkdir d5/da/d22/ddd/d38/d142/d61/d30/d143 0 2023-10-08T08:46:03.897 INFO:tasks.workunit.client.0.smithi070.stdout:9/735: rmdir d1/dd/d26/d27/d2d 39 2023-10-08T08:46:03.897 INFO:tasks.workunit.client.0.smithi070.stdout:9/736: chown d1/dd/d26 228348869 1 2023-10-08T08:46:03.897 INFO:tasks.workunit.client.0.smithi070.stdout:9/737: readlink d1/dd/d39/d66/l6e 0 2023-10-08T08:46:03.898 INFO:tasks.workunit.client.0.smithi070.stdout:5/963: write d5/da/d22/ddd/d38/d142/d61/d30/d54/d62/dae/fc5 [6895033,59240] 0 2023-10-08T08:46:03.901 INFO:tasks.workunit.client.0.smithi070.stdout:7/938: dread d3/da9/d4a/f108 [0,4194304] 0 2023-10-08T08:46:03.901 INFO:tasks.workunit.client.0.smithi070.stdout:7/939: write d3/d19/d6d/f10c [187191,117780] 0 2023-10-08T08:46:03.903 INFO:tasks.workunit.client.0.smithi070.stdout:7/940: mknod d3/d19/d95/da3/dc8/dfb/d9f/dc5/c12e 0 2023-10-08T08:46:03.903 INFO:tasks.workunit.client.0.smithi070.stdout:9/738: dread d1/f55 [0,4194304] 0 2023-10-08T08:46:03.903 INFO:tasks.workunit.client.0.smithi070.stdout:9/739: fdatasync d1/dd/d19/d38/f71 0 2023-10-08T08:46:03.904 INFO:tasks.workunit.client.0.smithi070.stdout:4/813: dwrite dc/d17/d24/d4c/d4e/f57 [0,4194304] 0 2023-10-08T08:46:03.904 INFO:tasks.workunit.client.0.smithi070.stdout:4/814: dread - dc/d17/d1f/d5e/d9f/fe5 zero size 2023-10-08T08:46:03.904 INFO:tasks.workunit.client.0.smithi070.stdout:4/815: fdatasync dc/d17/d79/dad/db6/dc1/dc3/fdc 0 2023-10-08T08:46:03.904 INFO:tasks.workunit.client.0.smithi070.stdout:4/816: dread - dc/d17/d1f/d54/f101 zero size 2023-10-08T08:46:03.904 INFO:tasks.workunit.client.0.smithi070.stdout:7/941: creat d3/d19/d6d/f12f x:0 0 0 2023-10-08T08:46:03.904 INFO:tasks.workunit.client.0.smithi070.stdout:7/942: write d3/da9/d4a/d9/d97/f9a [595992,15308] 0 2023-10-08T08:46:03.905 INFO:tasks.workunit.client.0.smithi070.stdout:4/817: dread dc/d17/d79/dad/db6/dc1/fc9 [0,4194304] 0 2023-10-08T08:46:03.905 INFO:tasks.workunit.client.0.smithi070.stdout:9/740: write d1/dd/d1a/d40/d76/d93/fa1 [1114829,107420] 0 2023-10-08T08:46:03.906 INFO:tasks.workunit.client.0.smithi070.stdout:4/818: symlink dc/d17/d24/d4c/df9/l10b 0 2023-10-08T08:46:03.907 INFO:tasks.workunit.client.0.smithi070.stdout:9/741: mkdir d1/dd/d1a/d40/d76/d93/dd0/dd5/dda 0 2023-10-08T08:46:03.907 INFO:tasks.workunit.client.0.smithi070.stdout:4/819: truncate dc/d17/d24/d4c/fc6 3596632 0 2023-10-08T08:46:03.908 INFO:tasks.workunit.client.0.smithi070.stdout:4/820: creat dc/d17/d24/d55/da4/f10c x:0 0 0 2023-10-08T08:46:03.909 INFO:tasks.workunit.client.0.smithi070.stdout:9/742: mknod d1/dd/d1a/d40/cdb 0 2023-10-08T08:46:03.909 INFO:tasks.workunit.client.0.smithi070.stdout:4/821: link dc/d17/d24/d4c/fdb dc/d17/dbf/f10d 0 2023-10-08T08:46:03.910 INFO:tasks.workunit.client.0.smithi070.stdout:9/743: truncate d1/dd/d26/d27/d2d/f2f 2760209 0 2023-10-08T08:46:03.911 INFO:tasks.workunit.client.0.smithi070.stdout:9/744: creat d1/dd/d19/d97/fdc x:0 0 0 2023-10-08T08:46:03.911 INFO:tasks.workunit.client.0.smithi070.stdout:9/745: chown d1/dd/d19 30733 1 2023-10-08T08:46:03.911 INFO:tasks.workunit.client.0.smithi070.stdout:4/822: rename dc/d17/d1f/d54/c6a to dc/d5f/c10e 0 2023-10-08T08:46:03.911 INFO:tasks.workunit.client.0.smithi070.stdout:4/823: write dc/d17/d24/d37/f53 [742323,28574] 0 2023-10-08T08:46:03.912 INFO:tasks.workunit.client.0.smithi070.stdout:9/746: mknod d1/dd/d19/d38/d77/d96/dd4/cdd 0 2023-10-08T08:46:03.912 INFO:tasks.workunit.client.0.smithi070.stdout:5/964: dread d5/da/d22/ddd/d38/d142/d63/d8b/d8f/d131/f105 [0,4194304] 0 2023-10-08T08:46:03.913 INFO:tasks.workunit.client.0.smithi070.stdout:9/747: mkdir d1/dd/d1a/d40/d76/d93/dd0/dd5/dda/dde 0 2023-10-08T08:46:03.913 INFO:tasks.workunit.client.0.smithi070.stdout:4/824: creat dc/d17/d79/dad/db6/dc1/dc3/f10f x:0 0 0 2023-10-08T08:46:03.914 INFO:tasks.workunit.client.0.smithi070.stdout:5/965: rename d5/da/d22/ddd/d38/c51 to d5/da/d22/ddd/d38/d142/d61/d30/d143/c144 0 2023-10-08T08:46:03.918 INFO:tasks.workunit.client.0.smithi070.stdout:4/825: mkdir dc/d68/d110 0 2023-10-08T08:46:03.918 INFO:tasks.workunit.client.0.smithi070.stdout:5/966: rename d5/da/d22/ddd/d38/d142/d63/d8b/d8f/d131/d103 to d5/da/d22/ddd/d38/d142/d63/d8b/d8f/d145 0 2023-10-08T08:46:03.918 INFO:tasks.workunit.client.0.smithi070.stdout:5/967: rename d5/da/d22 to d5/da/d22/d75/d146 22 2023-10-08T08:46:03.918 INFO:tasks.workunit.client.0.smithi070.stdout:4/826: write dc/d17/d24/d37/f53 [141937,41336] 0 2023-10-08T08:46:03.918 INFO:tasks.workunit.client.0.smithi070.stdout:7/943: dread d3/da9/d1e/d4c/fcf [0,4194304] 0 2023-10-08T08:46:03.918 INFO:tasks.workunit.client.0.smithi070.stdout:5/968: read d5/da/d22/ddd/d2a/f95 [3455253,76533] 0 2023-10-08T08:46:03.919 INFO:tasks.workunit.client.0.smithi070.stdout:5/969: readlink d5/da/d22/ddd/d38/d142/lec 0 2023-10-08T08:46:03.919 INFO:tasks.workunit.client.0.smithi070.stdout:5/970: dread - d5/da/d22/ddd/d38/d142/d63/d8b/d8f/d131/fed zero size 2023-10-08T08:46:03.925 INFO:tasks.workunit.client.0.smithi070.stdout:4/827: symlink dc/d17/d24/d37/l111 0 2023-10-08T08:46:03.926 INFO:tasks.workunit.client.0.smithi070.stdout:4/828: mknod dc/d5a/c112 0 2023-10-08T08:46:03.939 INFO:tasks.workunit.client.0.smithi070.stdout:9/748: dwrite d1/dd/d1a/f62 [0,4194304] 0 2023-10-08T08:46:03.939 INFO:tasks.workunit.client.0.smithi070.stdout:9/749: readlink d1/l7a 0 2023-10-08T08:46:03.939 INFO:tasks.workunit.client.0.smithi070.stdout:7/944: dwrite d3/da9/d1e/f115 [0,4194304] 0 2023-10-08T08:46:03.940 INFO:tasks.workunit.client.0.smithi070.stdout:4/829: write dc/d17/d79/dad/db6/dc1/dc3/fdc [41645,104864] 0 2023-10-08T08:46:03.941 INFO:tasks.workunit.client.0.smithi070.stdout:9/750: creat d1/dd/d39/d66/d82/fdf x:0 0 0 2023-10-08T08:46:03.942 INFO:tasks.workunit.client.0.smithi070.stdout:7/945: write d3/d19/d95/da3/dc8/dfb/d9f/dc5/fdf [2537175,51103] 0 2023-10-08T08:46:03.942 INFO:tasks.workunit.client.0.smithi070.stdout:7/946: write d3/d19/d6d/f10c [68389,14164] 0 2023-10-08T08:46:03.942 INFO:tasks.workunit.client.0.smithi070.stdout:9/751: mknod d1/dd/d1a/d40/d76/d93/dd0/dd5/ce0 0 2023-10-08T08:46:03.944 INFO:tasks.workunit.client.0.smithi070.stdout:7/947: rmdir d3/d79/de3 39 2023-10-08T08:46:03.945 INFO:tasks.workunit.client.0.smithi070.stdout:7/948: mknod d3/d19/d6d/c130 0 2023-10-08T08:46:03.946 INFO:tasks.workunit.client.0.smithi070.stdout:7/949: truncate d3/da9/d4a/f43 4894375 0 2023-10-08T08:46:03.947 INFO:tasks.workunit.client.0.smithi070.stdout:5/971: dwrite d5/da/d22/ddd/d2a/f58 [0,4194304] 0 2023-10-08T08:46:03.948 INFO:tasks.workunit.client.0.smithi070.stdout:7/950: creat d3/d19/d6d/dd7/f131 x:0 0 0 2023-10-08T08:46:03.948 INFO:tasks.workunit.client.0.smithi070.stdout:7/951: chown d3/d19/d6d/dd7/cd9 73 1 2023-10-08T08:46:03.948 INFO:tasks.workunit.client.0.smithi070.stdout:7/952: truncate d3/da9/d1e/d4c/d126/fe1 784952 0 2023-10-08T08:46:03.949 INFO:tasks.workunit.client.0.smithi070.stdout:7/953: mknod d3/da9/d4a/d9/d97/c132 0 2023-10-08T08:46:03.950 INFO:tasks.workunit.client.0.smithi070.stdout:7/954: mkdir d3/d19/d6d/d133 0 2023-10-08T08:46:03.954 INFO:tasks.workunit.client.0.smithi070.stdout:9/752: getdents d1/dd/d1a/d40/d76/d93/dd0/dd5 0 2023-10-08T08:46:03.957 INFO:tasks.workunit.client.0.smithi070.stdout:9/753: creat d1/dd/d26/d27/d2d/fe1 x:0 0 0 2023-10-08T08:46:03.959 INFO:tasks.workunit.client.0.smithi070.stdout:9/754: link d1/dd/d39/f9f d1/dd/d1a/d40/d76/d93/dd0/dd5/dda/dde/fe2 0 2023-10-08T08:46:03.959 INFO:tasks.workunit.client.0.smithi070.stdout:9/755: chown d1/dd/d39/dc9 836716 1 2023-10-08T08:46:03.960 INFO:tasks.workunit.client.0.smithi070.stdout:9/756: write d1/dd/d19/d38/d4f/db9/fa0 [552207,31195] 0 2023-10-08T08:46:03.960 INFO:tasks.workunit.client.0.smithi070.stdout:9/757: stat d1/dd/fcf 0 2023-10-08T08:46:03.962 INFO:tasks.workunit.client.0.smithi070.stdout:9/758: read d1/dd/d1a/fae [3332772,41266] 0 2023-10-08T08:46:03.963 INFO:tasks.workunit.client.0.smithi070.stdout:9/759: truncate d1/dd/d19/d38/f71 3711744 0 2023-10-08T08:46:03.965 INFO:tasks.workunit.client.0.smithi070.stdout:4/830: dwrite dc/d17/d24/d55/ff3 [0,4194304] 0 2023-10-08T08:46:03.965 INFO:tasks.workunit.client.0.smithi070.stdout:7/955: dread d3/f69 [0,4194304] 0 2023-10-08T08:46:03.965 INFO:tasks.workunit.client.0.smithi070.stdout:9/760: rename d1/dd/d39/f9f to d1/dd/d39/d6f/fe3 0 2023-10-08T08:46:03.967 INFO:tasks.workunit.client.0.smithi070.stdout:4/831: rename dc/d17/d1f/d5e/f6f to dc/d17/f113 0 2023-10-08T08:46:03.968 INFO:tasks.workunit.client.0.smithi070.stdout:7/956: truncate d3/da9/d4a/d9/da4/dd6/f129 223700 0 2023-10-08T08:46:03.977 INFO:tasks.workunit.client.0.smithi070.stdout:8/958: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/fc8 [0,4194304] 0 2023-10-08T08:46:03.978 INFO:tasks.workunit.client.0.smithi070.stdout:5/972: dwrite d5/f9 [4194304,4194304] 0 2023-10-08T08:46:03.986 INFO:tasks.workunit.client.0.smithi070.stdout:8/959: creat d1/d2/d6/d22/d9e/da7/df9/f13d x:0 0 0 2023-10-08T08:46:03.991 INFO:tasks.workunit.client.0.smithi070.stdout:5/973: symlink d5/da/d22/ddd/d38/d142/d63/d8b/d8f/d131/l147 0 2023-10-08T08:46:03.991 INFO:tasks.workunit.client.0.smithi070.stdout:5/974: fdatasync d5/da/f68 0 2023-10-08T08:46:03.993 INFO:tasks.workunit.client.0.smithi070.stdout:4/832: dwrite dc/f13 [0,4194304] 0 2023-10-08T08:46:04.002 INFO:tasks.workunit.client.0.smithi070.stdout:5/975: link d5/da/l56 d5/l148 0 2023-10-08T08:46:04.006 INFO:tasks.workunit.client.0.smithi070.stdout:9/761: dwrite d1/dd/d26/d27/d2d/d70/f86 [0,4194304] 0 2023-10-08T08:46:04.007 INFO:tasks.workunit.client.0.smithi070.stdout:5/976: creat d5/da/d4d/dfb/f149 x:0 0 0 2023-10-08T08:46:04.010 INFO:tasks.workunit.client.0.smithi070.stdout:7/957: dwrite d3/da9/d4a/f8 [0,4194304] 0 2023-10-08T08:46:04.010 INFO:tasks.workunit.client.0.smithi070.stdout:7/958: read - d3/d19/d95/da3/dc8/dfb/d9f/dc5/fff zero size 2023-10-08T08:46:04.011 INFO:tasks.workunit.client.0.smithi070.stdout:7/959: chown d3/da9/d4a/d9/da4/cde 968 1 2023-10-08T08:46:04.014 INFO:tasks.workunit.client.0.smithi070.stdout:8/960: dwrite d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/f139 [4194304,4194304] 0 2023-10-08T08:46:04.014 INFO:tasks.workunit.client.0.smithi070.stdout:7/960: mkdir d3/d77/d112/d134 0 2023-10-08T08:46:04.014 INFO:tasks.workunit.client.0.smithi070.stdout:7/961: fdatasync d3/d19/d1a/f22 0 2023-10-08T08:46:04.014 INFO:tasks.workunit.client.0.smithi070.stdout:7/962: write d3/d79/de3/f10e [4355677,61694] 0 2023-10-08T08:46:04.019 INFO:tasks.workunit.client.0.smithi070.stdout:9/762: dread d1/dd/f10 [0,4194304] 0 2023-10-08T08:46:04.021 INFO:tasks.workunit.client.0.smithi070.stdout:4/833: dwrite dc/d17/d24/d4c/d4e/dab/dff/f107 [0,4194304] 0 2023-10-08T08:46:04.021 INFO:tasks.workunit.client.0.smithi070.stdout:4/834: chown dc/d17/d24/d4c/d4e/dab/ce1 7473 1 2023-10-08T08:46:04.021 INFO:tasks.workunit.client.0.smithi070.stdout:4/835: dread - dc/d17/d1f/d5e/d9f/fe5 zero size 2023-10-08T08:46:04.022 INFO:tasks.workunit.client.0.smithi070.stdout:9/763: rmdir d1/dd/d1a/d40/d76/d93/dd0 39 2023-10-08T08:46:04.022 INFO:tasks.workunit.client.0.smithi070.stdout:9/764: getdents d1/dd/d1a/d40/d76/d93/dd0/dd5/dda/dde 0 2023-10-08T08:46:04.023 INFO:tasks.workunit.client.0.smithi070.stdout:9/765: chown d1/dd/d26/d27/d2d/l64 1 1 2023-10-08T08:46:04.024 INFO:tasks.workunit.client.0.smithi070.stdout:9/766: mknod d1/dd/d19/d38/d77/d96/ce4 0 2023-10-08T08:46:04.024 INFO:tasks.workunit.client.0.smithi070.stdout:9/767: chown d1/dd/d26/d27/d2d/l7f 0 1 2023-10-08T08:46:04.026 INFO:tasks.workunit.client.0.smithi070.stdout:9/768: getdents d1/dd 0 2023-10-08T08:46:04.029 INFO:tasks.workunit.client.0.smithi070.stdout:9/769: creat d1/dd/d39/da4/dc3/fe5 x:0 0 0 2023-10-08T08:46:04.030 INFO:tasks.workunit.client.0.smithi070.stdout:9/770: getdents d1/dd/d19/d97 0 2023-10-08T08:46:04.034 INFO:tasks.workunit.client.0.smithi070.stdout:8/961: dwrite d1/d2/d6/d22/d5b/d74/de1/d2e/d45/fd9 [0,4194304] 0 2023-10-08T08:46:04.037 INFO:tasks.workunit.client.0.smithi070.stdout:8/962: mknod d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/dfa/c13e 0 2023-10-08T08:46:04.039 INFO:tasks.workunit.client.0.smithi070.stdout:8/963: read d1/d2/fe7 [284205,41611] 0 2023-10-08T08:46:04.041 INFO:tasks.workunit.client.0.smithi070.stdout:8/964: mknod d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/dd7/c13f 0 2023-10-08T08:46:04.041 INFO:tasks.workunit.client.0.smithi070.stdout:8/965: write d1/d2/d6/d22/d5b/d74/de1/d2e/fa8 [663356,86234] 0 2023-10-08T08:46:04.041 INFO:tasks.workunit.client.0.smithi070.stdout:8/966: truncate d1/d2/d6/d22/d5b/d74/de1/d2e/d11a/f108 5087207 0 2023-10-08T08:46:04.045 INFO:tasks.workunit.client.0.smithi070.stdout:4/836: dwrite dc/d17/dbf/fde [0,4194304] 0 2023-10-08T08:46:04.047 INFO:tasks.workunit.client.0.smithi070.stdout:5/977: dwrite d5/da/d22/ddd/d38/d55/d112/f13f [0,4194304] 0 2023-10-08T08:46:04.048 INFO:tasks.workunit.client.0.smithi070.stdout:4/837: rmdir dc/d17/d1f/d5e/dd0 39 2023-10-08T08:46:04.051 INFO:tasks.workunit.client.0.smithi070.stdout:4/838: unlink dc/d17/d1f/d5e/le8 0 2023-10-08T08:46:04.052 INFO:tasks.workunit.client.0.smithi070.stdout:4/839: creat dc/d17/f114 x:0 0 0 2023-10-08T08:46:04.056 INFO:tasks.workunit.client.0.smithi070.stdout:9/771: dwrite d1/dd/d19/d38/d4f/f91 [0,4194304] 0 2023-10-08T08:46:04.056 INFO:tasks.workunit.client.0.smithi070.stdout:9/772: stat d1/dd/d1a/d40/d76/d93/fa1 0 2023-10-08T08:46:04.056 INFO:tasks.workunit.client.0.smithi070.stdout:9/773: chown d1/dd/d19/d38/d77/d96 993 1 2023-10-08T08:46:04.065 INFO:tasks.workunit.client.0.smithi070.stdout:5/978: dread d5/da/d22/f47 [4194304,4194304] 0 2023-10-08T08:46:04.066 INFO:tasks.workunit.client.0.smithi070.stdout:5/979: mknod d5/da/d22/ddd/d38/d142/d63/d133/c14a 0 2023-10-08T08:46:04.067 INFO:tasks.workunit.client.0.smithi070.stdout:5/980: creat d5/da/d22/ddd/d38/d55/d112/f14b x:0 0 0 2023-10-08T08:46:04.071 INFO:tasks.workunit.client.0.smithi070.stdout:8/967: dwrite d1/d4d/d61/fa2 [0,4194304] 0 2023-10-08T08:46:04.071 INFO:tasks.workunit.client.0.smithi070.stdout:4/840: dread dc/d5f/fbe [0,4194304] 0 2023-10-08T08:46:04.071 INFO:tasks.workunit.client.0.smithi070.stdout:4/841: chown dc/d17/d24/d4c/d4e/c8e 26259113 1 2023-10-08T08:46:04.071 INFO:tasks.workunit.client.0.smithi070.stdout:4/842: stat dc/l42 0 2023-10-08T08:46:04.071 INFO:tasks.workunit.client.0.smithi070.stdout:5/981: write d5/da/d22/fcf [2314961,121260] 0 2023-10-08T08:46:04.071 INFO:tasks.workunit.client.0.smithi070.stdout:8/968: dread d1/d2/d6/d22/d5b/fd5 [0,4194304] 0 2023-10-08T08:46:04.072 INFO:tasks.workunit.client.0.smithi070.stdout:4/843: rename dc/d17/d24/d55/fa0 to dc/d17/dbf/dfb/f115 0 2023-10-08T08:46:04.075 INFO:tasks.workunit.client.0.smithi070.stdout:8/969: mknod d1/d2/d6/d22/d5b/d74/de1/dca/c140 0 2023-10-08T08:46:04.075 INFO:tasks.workunit.client.0.smithi070.stdout:8/970: truncate d1/d2/d6/d22/d5b/fcf 4899975 0 2023-10-08T08:46:04.075 INFO:tasks.workunit.client.0.smithi070.stdout:8/971: truncate d1/d4d/d61/fbf 133530 0 2023-10-08T08:46:04.076 INFO:tasks.workunit.client.0.smithi070.stdout:8/972: creat d1/d2/d6/d22/d5b/d74/f141 x:0 0 0 2023-10-08T08:46:04.076 INFO:tasks.workunit.client.0.smithi070.stdout:8/973: write d1/d2/d6/d22/f4b [2604046,10718] 0 2023-10-08T08:46:04.083 INFO:tasks.workunit.client.0.smithi070.stdout:9/774: dwrite d1/dd/d26/d27/d2d/fb0 [0,4194304] 0 2023-10-08T08:46:04.084 INFO:tasks.workunit.client.0.smithi070.stdout:8/974: dread d1/d2/d6/d22/d9e/de2/ff0 [0,4194304] 0 2023-10-08T08:46:04.086 INFO:tasks.workunit.client.0.smithi070.stdout:9/775: read d1/f74 [1912695,101997] 0 2023-10-08T08:46:04.086 INFO:tasks.workunit.client.0.smithi070.stdout:8/975: rmdir d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/d10d 39 2023-10-08T08:46:04.087 INFO:tasks.workunit.client.0.smithi070.stdout:9/776: mknod d1/dd/d19/d38/d77/ce6 0 2023-10-08T08:46:04.087 INFO:tasks.workunit.client.0.smithi070.stdout:4/844: rmdir dc/d17 39 2023-10-08T08:46:04.088 INFO:tasks.workunit.client.0.smithi070.stdout:9/777: creat d1/dd/d1a/d40/d76/d93/dd0/fe7 x:0 0 0 2023-10-08T08:46:04.089 INFO:tasks.workunit.client.0.smithi070.stdout:4/845: creat dc/d17/d79/dad/db6/dc1/f116 x:0 0 0 2023-10-08T08:46:04.091 INFO:tasks.workunit.client.0.smithi070.stdout:8/976: dread d1/d2/d6/f14 [0,4194304] 0 2023-10-08T08:46:04.092 INFO:tasks.workunit.client.0.smithi070.stdout:8/977: mkdir d1/d2/d6/d22/d5b/d74/de1/d2e/d11a/d142 0 2023-10-08T08:46:04.092 INFO:tasks.workunit.client.0.smithi070.stdout:8/978: fdatasync d1/d2/d6/d22/d5c/d99/f9d 0 2023-10-08T08:46:04.093 INFO:tasks.workunit.client.0.smithi070.stdout:9/778: rename d1/dd/d26/d27/d2d/c51 to d1/dd/d19/d38/d4f/db9/ce8 0 2023-10-08T08:46:04.093 INFO:tasks.workunit.client.0.smithi070.stdout:9/779: readlink d1/dd/d39/d66/l6e 0 2023-10-08T08:46:04.093 INFO:tasks.workunit.client.0.smithi070.stdout:8/979: creat d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/f143 x:0 0 0 2023-10-08T08:46:04.094 INFO:tasks.workunit.client.0.smithi070.stdout:8/980: dread - d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/fc2 zero size 2023-10-08T08:46:04.094 INFO:tasks.workunit.client.0.smithi070.stdout:8/981: chown d1/d2/d6/d22/d9e/lf6 142314 1 2023-10-08T08:46:04.094 INFO:tasks.workunit.client.0.smithi070.stdout:9/780: symlink d1/dd/d1a/d40/d76/d93/dd0/dd5/dda/dde/le9 0 2023-10-08T08:46:04.094 INFO:tasks.workunit.client.0.smithi070.stdout:9/781: chown d1/dd/d26/c5c 14370 1 2023-10-08T08:46:04.095 INFO:tasks.workunit.client.0.smithi070.stdout:8/982: mknod d1/d2/d8c/c144 0 2023-10-08T08:46:04.096 INFO:tasks.workunit.client.0.smithi070.stdout:8/983: symlink d1/d2/d6/d22/d5b/d74/dc3/dd6/d123/l145 0 2023-10-08T08:46:04.096 INFO:tasks.workunit.client.0.smithi070.stdout:9/782: read d1/dd/d19/d38/f3c [1256334,66454] 0 2023-10-08T08:46:04.098 INFO:tasks.workunit.client.0.smithi070.stdout:8/984: mkdir d1/d2/d6/d22/d5b/d74/de1/d3a/d92/d146 0 2023-10-08T08:46:04.103 INFO:tasks.workunit.client.0.smithi070.stdout:4/846: rename dc/d17/d79/dad/db6/dc1 to dc/d17/d24/d4c/d4e/dda/df4/d117 0 2023-10-08T08:46:04.114 INFO:tasks.workunit.client.0.smithi070.stdout:4/847: dread dc/f15 [0,4194304] 0 2023-10-08T08:46:04.115 INFO:tasks.workunit.client.0.smithi070.stdout:4/848: mknod dc/d17/d79/dad/c118 0 2023-10-08T08:46:04.116 INFO:tasks.workunit.client.0.smithi070.stdout:4/849: creat dc/d17/d24/d4c/d4e/dab/dff/f119 x:0 0 0 2023-10-08T08:46:04.117 INFO:tasks.workunit.client.0.smithi070.stdout:4/850: mkdir dc/d17/d24/d4c/d4e/dda/df4/d117/d11a 0 2023-10-08T08:46:04.118 INFO:tasks.workunit.client.0.smithi070.stdout:4/851: dread - dc/d17/d1f/d5e/fb2 zero size 2023-10-08T08:46:04.119 INFO:tasks.workunit.client.0.smithi070.stdout:8/985: dwrite d1/d2/d6/d22/d9e/da7/df9/f13d [0,4194304] 0 2023-10-08T08:46:04.120 INFO:tasks.workunit.client.0.smithi070.stdout:9/783: dwrite d1/dd/d1a/d40/d76/d93/dd0/dd5/dda/dde/fe2 [0,4194304] 0 2023-10-08T08:46:04.120 INFO:tasks.workunit.client.0.smithi070.stdout:9/784: chown d1/dd/fa 106020149 1 2023-10-08T08:46:04.121 INFO:tasks.workunit.client.0.smithi070.stdout:9/785: creat d1/dd/d1a/fea x:0 0 0 2023-10-08T08:46:04.121 INFO:tasks.workunit.client.0.smithi070.stdout:9/786: fdatasync d1/dd/d26/d27/d2d/f2f 0 2023-10-08T08:46:04.124 INFO:tasks.workunit.client.0.smithi070.stdout:8/986: rename d1/d2/d6/d22/d5b/d74/de1/d3a/d92/ca4 to d1/d2/d6/d22/d5b/d74/de1/d1a/c147 0 2023-10-08T08:46:04.124 INFO:tasks.workunit.client.0.smithi070.stdout:9/787: write d1/dd/d26/d27/f36 [1130623,117462] 0 2023-10-08T08:46:04.127 INFO:tasks.workunit.client.0.smithi070.stdout:8/987: creat d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/dfa/f148 x:0 0 0 2023-10-08T08:46:04.127 INFO:tasks.workunit.client.0.smithi070.stdout:8/988: write d1/d2/d6/d22/d5b/d74/f141 [234014,38957] 0 2023-10-08T08:46:04.128 INFO:tasks.workunit.client.0.smithi070.stdout:8/989: mknod d1/d2/d6/d22/d5b/d74/de1/d2e/d11a/df4/c149 0 2023-10-08T08:46:04.132 INFO:tasks.workunit.client.0.smithi070.stdout:8/990: write d1/d2/d6/d22/d5b/d74/dc3/f13a [1856849,42550] 0 2023-10-08T08:46:04.132 INFO:tasks.workunit.client.0.smithi070.stdout:8/991: chown d1/d2/d6/d22/d5b/d74/de1/d1a/c147 7479 1 2023-10-08T08:46:04.133 INFO:tasks.workunit.client.0.smithi070.stdout:8/992: symlink d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/da0/d10d/l14a 0 2023-10-08T08:46:04.136 INFO:tasks.workunit.client.0.smithi070.stdout:4/852: dwrite dc/d17/d24/d4c/fc6 [0,4194304] 0 2023-10-08T08:46:04.138 INFO:tasks.workunit.client.0.smithi070.stdout:9/788: write d1/dd/d26/d27/f60 [56771,17147] 0 2023-10-08T08:46:04.138 INFO:tasks.workunit.client.0.smithi070.stdout:4/853: write dc/d17/d24/d55/fd3 [357959,118762] 0 2023-10-08T08:46:04.139 INFO:tasks.workunit.client.0.smithi070.stdout:9/789: creat d1/dd/d26/d27/d2d/feb x:0 0 0 2023-10-08T08:46:04.140 INFO:tasks.workunit.client.0.smithi070.stdout:4/854: rename dc/d17/d24/d4c/d4e/dda/df4/d117/le4 to dc/d17/d24/d4c/l11b 0 2023-10-08T08:46:04.141 INFO:tasks.workunit.client.0.smithi070.stdout:4/855: link dc/d17/d1f/d54/f67 dc/d17/d24/d4c/d4e/dda/f11c 0 2023-10-08T08:46:04.142 INFO:tasks.workunit.client.0.smithi070.stdout:9/790: rename d1/dd/d1a/c21 to d1/dd/d26/d27/d2d/d70/d90/cec 0 2023-10-08T08:46:04.142 INFO:tasks.workunit.client.0.smithi070.stdout:9/791: stat d1/dd/d19/d38/d77/ld6 0 2023-10-08T08:46:04.142 INFO:tasks.workunit.client.0.smithi070.stdout:4/856: creat dc/d17/d79/dad/f11d x:0 0 0 2023-10-08T08:46:04.143 INFO:tasks.workunit.client.0.smithi070.stdout:4/857: creat dc/d17/d24/d6b/dc7/f11e x:0 0 0 2023-10-08T08:46:04.144 INFO:tasks.workunit.client.0.smithi070.stdout:4/858: mknod dc/d17/d24/d6b/c11f 0 2023-10-08T08:46:04.144 INFO:tasks.workunit.client.0.smithi070.stdout:9/792: rename d1/dd/d19/d38/d4f/f9b to d1/dd/d26/d7b/fed 0 2023-10-08T08:46:04.146 INFO:tasks.workunit.client.0.smithi070.stdout:4/859: rename dc/d17/d24/d6b/cef to dc/d17/d24/d4c/d4e/dda/df4/d117/dc3/c120 0 2023-10-08T08:46:04.147 INFO:tasks.workunit.client.0.smithi070.stdout:4/860: symlink dc/d17/d24/d37/l121 0 2023-10-08T08:46:04.149 INFO:tasks.workunit.client.0.smithi070.stdout:4/861: creat dc/d17/d24/d4c/d4e/dda/df4/d117/d11a/f122 x:0 0 0 2023-10-08T08:46:04.153 INFO:tasks.workunit.client.0.smithi070.stdout:4/862: rmdir dc 39 2023-10-08T08:46:04.154 INFO:tasks.workunit.client.0.smithi070.stdout:8/993: dwrite d1/d2/d6/d22/d5b/d74/de1/d3a/d56/d65/ff2 [0,4194304] 0 2023-10-08T08:46:04.155 INFO:tasks.workunit.client.0.smithi070.stdout:4/863: creat dc/d17/d24/d55/f123 x:0 0 0 2023-10-08T08:46:04.157 INFO:tasks.workunit.client.0.smithi070.stdout:4/864: symlink dc/d17/d24/d6b/l124 0 2023-10-08T08:46:04.157 INFO:tasks.workunit.client.0.smithi070.stdout:8/994: symlink d1/d2/d6/d22/d5b/d74/de1/d3a/dea/d137/l14b 0 2023-10-08T08:46:04.157 INFO:tasks.workunit.client.0.smithi070.stdout:8/995: truncate d1/d2/f117 61583 0 2023-10-08T08:46:04.158 INFO:tasks.workunit.client.0.smithi070.stdout:8/996: truncate d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/f9c 3569660 0 2023-10-08T08:46:04.158 INFO:tasks.workunit.client.0.smithi070.stdout:4/865: unlink dc/d17/d24/d4c/fd9 0 2023-10-08T08:46:04.161 INFO:tasks.workunit.client.0.smithi070.stdout:6/868: sync 2023-10-08T08:46:04.161 INFO:tasks.workunit.client.0.smithi070.stdout:4/866: unlink dc/d17/d79/dad/db6/cc8 0 2023-10-08T08:46:04.161 INFO:tasks.workunit.client.0.smithi070.stdout:6/869: dread - df/d26/d42/d4b/db6/fa9 zero size 2023-10-08T08:46:04.162 INFO:tasks.workunit.client.0.smithi070.stdout:6/870: creat df/d26/d42/d43/d4a/d75/f121 x:0 0 0 2023-10-08T08:46:04.164 INFO:tasks.workunit.client.0.smithi070.stdout:6/871: unlink df/d26/d42/d4b/db6/d7d/dc8/d103/fd7 0 2023-10-08T08:46:04.166 INFO:tasks.workunit.client.0.smithi070.stdout:6/872: mkdir df/d26/d42/d4b/db6/d122 0 2023-10-08T08:46:04.166 INFO:tasks.workunit.client.0.smithi070.stdout:8/997: read d1/d2/d6/d22/d5b/d74/de1/d2e/d45/d7b/fc6 [2107732,104424] 0 2023-10-08T08:46:04.167 INFO:tasks.workunit.client.0.smithi070.stdout:9/793: dwrite d1/dd/f10 [0,4194304] 0 2023-10-08T08:46:04.167 INFO:tasks.workunit.client.0.smithi070.stdout:6/873: mkdir df/d71/d123 0 2023-10-08T08:46:04.171 INFO:tasks.workunit.client.0.smithi070.stdout:6/874: unlink df/d26/d78/d90/dae/db3/f117 0 2023-10-08T08:46:04.171 INFO:tasks.workunit.client.0.smithi070.stdout:6/875: fsync df/d26/d42/d43/d4a/d97/dc0/df7/f118 0 2023-10-08T08:46:04.172 INFO:tasks.workunit.client.0.smithi070.stdout:6/876: fsync df/d11/f4d 0 2023-10-08T08:46:04.172 INFO:tasks.workunit.client.0.smithi070.stdout:6/877: truncate df/d26/d42/d4b/db6/d7d/fb2 576398 0 2023-10-08T08:46:04.172 INFO:tasks.workunit.client.0.smithi070.stdout:6/878: unlink df/d11/c95 0 2023-10-08T08:46:04.175 INFO:tasks.workunit.client.0.smithi070.stdout:6/879: rename df/d26/d42/d43/d4a/f85 to df/d26/d42/d43/d4a/d97/dc0/df7/f124 0 2023-10-08T08:46:04.176 INFO:tasks.workunit.client.0.smithi070.stdout:4/867: dread dc/d17/d1f/d54/f67 [0,4194304] 0 2023-10-08T08:46:04.177 INFO:tasks.workunit.client.0.smithi070.stdout:4/868: creat dc/d17/d24/d6b/f125 x:0 0 0 2023-10-08T08:46:04.177 INFO:tasks.workunit.client.0.smithi070.stdout:6/880: rmdir df/d26/d42/d4b/db6/d7d/dc8/d103/de0/df9/d10c 0 2023-10-08T08:46:04.178 INFO:tasks.workunit.client.0.smithi070.stdout:6/881: creat df/d26/d42/d43/d4a/d75/d7e/f125 x:0 0 0 2023-10-08T08:46:04.179 INFO:tasks.workunit.client.0.smithi070.stdout:4/869: rmdir dc/d17/d1f 39 2023-10-08T08:46:04.179 INFO:tasks.workunit.client.0.smithi070.stdout:4/870: readlink dc/d17/d24/d4c/d4e/dda/df4/d117/dc3/led 0 2023-10-08T08:46:04.181 INFO:tasks.workunit.client.0.smithi070.stdout:4/871: write dc/d17/d24/f49 [1064088,66686] 0 2023-10-08T08:46:04.181 INFO:tasks.workunit.client.0.smithi070.stdout:4/872: write dc/d17/d24/d55/ff5 [880902,24988] 0 2023-10-08T08:46:04.201 INFO:tasks.workunit.client.0.smithi070.stdout:8/998: dwrite d1/d2/d6/d22/d5b/d74/de1/d3a/fa6 [0,4194304] 0 2023-10-08T08:46:04.202 INFO:tasks.workunit.client.0.smithi070.stdout:6/882: dread df/d53/f5e [0,4194304] 0 2023-10-08T08:46:04.202 INFO:tasks.workunit.client.0.smithi070.stdout:9/794: dwrite d1/dd/fa [0,4194304] 0 2023-10-08T08:46:04.202 INFO:tasks.workunit.client.0.smithi070.stdout:6/883: fdatasync df/d26/d78/d90/fb9 0 2023-10-08T08:46:04.202 INFO:tasks.workunit.client.0.smithi070.stdout:9/795: chown d1/f25 321 1 2023-10-08T08:46:04.203 INFO:tasks.workunit.client.0.smithi070.stdout:6/884: mknod df/d26/d78/d90/dae/db3/c126 0 2023-10-08T08:46:04.204 INFO:tasks.workunit.client.0.smithi070.stdout:6/885: mknod df/d26/d42/d4b/db6/d7d/dc8/d103/c127 0 2023-10-08T08:46:04.206 INFO:tasks.workunit.client.0.smithi070.stdout:6/886: write df/d11/f1a [1625204,107537] 0 2023-10-08T08:46:04.206 INFO:tasks.workunit.client.0.smithi070.stdout:6/887: fdatasync df/d26/d42/d4b/db6/d7d/dc8/d103/de0/df9/f113 0 2023-10-08T08:46:04.206 INFO:tasks.workunit.client.0.smithi070.stdout:4/873: dwrite dc/d17/d1f/ff2 [0,4194304] 0 2023-10-08T08:46:04.208 INFO:tasks.workunit.client.0.smithi070.stdout:9/796: mkdir d1/dd/d1a/d40/d76/d93/dd8/dee 0 2023-10-08T08:46:04.208 INFO:tasks.workunit.client.0.smithi070.stdout:9/797: read - d1/dd/d39/da4/dc3/fe5 zero size 2023-10-08T08:46:04.209 INFO:tasks.workunit.client.0.smithi070.stdout:9/798: write d1/dd/d1a/fea [180269,93273] 0 2023-10-08T08:46:04.211 INFO:tasks.workunit.client.0.smithi070.stdout:9/799: mkdir d1/dd/d39/da4/def 0 2023-10-08T08:46:04.218 INFO:tasks.workunit.client.0.smithi070.stdout:6/888: dread df/d53/f5e [0,4194304] 0 2023-10-08T08:46:04.219 INFO:tasks.workunit.client.0.smithi070.stdout:9/800: read d1/dd/d1a/d40/f4e [8213300,58820] 0 2023-10-08T08:46:04.220 INFO:tasks.workunit.client.0.smithi070.stdout:6/889: mkdir df/d26/d42/d43/d4a/d97/d128 0 2023-10-08T08:46:04.223 INFO:tasks.workunit.client.0.smithi070.stdout:8/999: dwrite d1/d2/fe7 [0,4194304] 0 2023-10-08T08:46:04.223 INFO:tasks.workunit.client.0.smithi070.stdout:9/801: write d1/dd/d1a/d40/d76/fb7 [2751278,115925] 0 2023-10-08T08:46:04.225 INFO:tasks.workunit.client.0.smithi070.stdout:9/802: creat d1/dd/d1a/d40/d76/d93/dd0/dd5/ff0 x:0 0 0 2023-10-08T08:46:04.226 INFO:tasks.workunit.client.0.smithi070.stdout:9/803: getdents d1/dd/d39/dc9 0 2023-10-08T08:46:04.226 INFO:tasks.workunit.client.0.smithi070.stdout:9/804: write d1/dd/d19/d97/fdc [376297,9658] 0 2023-10-08T08:46:04.228 INFO:tasks.workunit.client.0.smithi070.stdout:7/963: sync 2023-10-08T08:46:04.228 INFO:tasks.workunit.client.0.smithi070.stdout:7/964: readlink d3/d19/d95/da3/l100 0 2023-10-08T08:46:04.231 INFO:tasks.workunit.client.0.smithi070.stdout:7/965: mknod d3/c135 0 2023-10-08T08:46:04.239 INFO:tasks.workunit.client.0.smithi070.stdout:9/805: dread d1/dd/d26/d27/d2d/d70/f86 [0,4194304] 0 2023-10-08T08:46:04.239 INFO:tasks.workunit.client.0.smithi070.stdout:9/806: chown d1/f55 21684593 1 2023-10-08T08:46:04.240 INFO:tasks.workunit.client.0.smithi070.stdout:9/807: mknod d1/dd/d1a/d40/d76/d93/dd0/dd5/cf1 0 2023-10-08T08:46:04.242 INFO:tasks.workunit.client.0.smithi070.stdout:9/808: rename d1/dd/d1a/d40/d76/fb7 to d1/dd/d1a/d40/d76/ff2 0 2023-10-08T08:46:04.244 INFO:tasks.workunit.client.0.smithi070.stdout:9/809: symlink d1/dd/d39/lf3 0 2023-10-08T08:46:04.289 INFO:tasks.workunit.client.0.smithi070.stdout:7/966: dwrite d3/d19/d1a/f20 [0,4194304] 0 2023-10-08T08:46:04.289 INFO:tasks.workunit.client.0.smithi070.stdout:7/967: chown d3/da9/d4a/d9/da4/dd6/ddb 192 1 2023-10-08T08:46:04.289 INFO:tasks.workunit.client.0.smithi070.stdout:7/968: chown d3/d79/d110 265680 1 2023-10-08T08:46:04.290 INFO:tasks.workunit.client.0.smithi070.stdout:7/969: stat d3/d19/d95/la5 0 2023-10-08T08:46:04.290 INFO:tasks.workunit.client.0.smithi070.stdout:9/810: rmdir d1/dd/d1a/d40/d76 39 2023-10-08T08:46:04.293 INFO:tasks.workunit.client.0.smithi070.stdout:9/811: rename d1/dd/d39/d66/d82/caf to d1/dd/d39/da4/dc3/cf4 0 2023-10-08T08:46:04.294 INFO:tasks.workunit.client.0.smithi070.stdout:9/812: mkdir d1/dd/d39/d66/df5 0 2023-10-08T08:46:04.296 INFO:tasks.workunit.client.0.smithi070.stdout:9/813: symlink d1/lf6 0 2023-10-08T08:46:04.305 INFO:tasks.workunit.client.0.smithi070.stdout:7/970: dread d3/d79/f93 [0,4194304] 0 2023-10-08T08:46:04.314 INFO:tasks.workunit.client.0.smithi070.stdout:9/814: dwrite d1/dd/d19/f79 [0,4194304] 0 2023-10-08T08:46:04.316 INFO:tasks.workunit.client.0.smithi070.stdout:9/815: mkdir d1/dd/d26/d27/df7 0 2023-10-08T08:46:04.318 INFO:tasks.workunit.client.0.smithi070.stdout:9/816: mknod d1/dd/d19/d38/d77/d96/cf8 0 2023-10-08T08:46:04.330 INFO:tasks.workunit.client.0.smithi070.stdout:9/817: dread d1/dd/d39/d6f/fe3 [0,4194304] 0 2023-10-08T08:46:04.330 INFO:tasks.workunit.client.0.smithi070.stdout:9/818: dread - d1/dd/d39/d66/f6d zero size 2023-10-08T08:46:04.331 INFO:tasks.workunit.client.0.smithi070.stdout:9/819: read d1/dd/d19/d38/d4f/db9/f95 [379726,47185] 0 2023-10-08T08:46:04.333 INFO:tasks.workunit.client.0.smithi070.stdout:9/820: write d1/dd/d19/f1b [2975010,101910] 0 2023-10-08T08:46:04.333 INFO:tasks.workunit.client.0.smithi070.stdout:9/821: dread - d1/dd/d26/d27/d2d/d70/d90/dab/fd2 zero size 2023-10-08T08:46:04.333 INFO:tasks.workunit.client.0.smithi070.stdout:9/822: write d1/dd/d19/d38/d77/fc6 [950611,101451] 0 2023-10-08T08:46:04.333 INFO:tasks.workunit.client.0.smithi070.stdout:9/823: chown d1/dd/d19/d38/d4f/db9/fa0 4 1 2023-10-08T08:46:04.353 INFO:tasks.workunit.client.0.smithi070.stdout:9/824: dwrite d1/dd/d1a/d40/d76/ff2 [0,4194304] 0 2023-10-08T08:46:04.353 INFO:tasks.workunit.client.0.smithi070.stdout:9/825: truncate d1/dd/d26/d27/d2d/d70/d90/dab/fd2 87964 0 2023-10-08T08:46:04.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/826: creat d1/dd/d19/d38/d77/d96/dd4/ff9 x:0 0 0 2023-10-08T08:46:04.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/827: chown d1/dd/d39/d66 428884512 1 2023-10-08T08:46:04.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/828: chown d1/dd/d19/d38/d4f/dc7/c94 1 1 2023-10-08T08:46:04.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/829: symlink d1/dd/d39/d66/d82/lfa 0 2023-10-08T08:46:04.357 INFO:tasks.workunit.client.0.smithi070.stdout:9/830: fdatasync d1/dd/d1a/d40/d76/ff2 0 2023-10-08T08:46:04.357 INFO:tasks.workunit.client.0.smithi070.stdout:9/831: write d1/dd/d19/d38/d4f/db9/fce [312966,17456] 0 2023-10-08T08:46:04.358 INFO:tasks.workunit.client.0.smithi070.stdout:9/832: mknod d1/dd/d39/da4/dc3/cfb 0 2023-10-08T08:46:04.359 INFO:tasks.workunit.client.0.smithi070.stdout:9/833: creat d1/dd/d19/d38/d4f/db9/ffc x:0 0 0 2023-10-08T08:46:04.360 INFO:tasks.workunit.client.0.smithi070.stdout:9/834: truncate d1/dd/f10 2188610 0 2023-10-08T08:46:04.361 INFO:tasks.workunit.client.0.smithi070.stdout:9/835: truncate d1/dd/d1a/fae 3078464 0 2023-10-08T08:46:04.374 INFO:tasks.workunit.client.0.smithi070.stdout:9/836: dread d1/f25 [4194304,4194304] 0 2023-10-08T08:46:04.375 INFO:tasks.workunit.client.0.smithi070.stdout:9/837: truncate d1/f74 1193982 0 2023-10-08T08:46:04.376 INFO:tasks.workunit.client.0.smithi070.stdout:9/838: mkdir d1/dd/d26/d27/df7/dfd 0 2023-10-08T08:46:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:04 smithi191 ceph-mon[104220]: pgmap v359: 129 pgs: 129 active+clean; 1.7 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 90 MiB/s wr, 156 op/s 2023-10-08T08:46:04.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:04 smithi070 ceph-mon[99513]: pgmap v359: 129 pgs: 129 active+clean; 1.7 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 90 MiB/s wr, 156 op/s 2023-10-08T08:46:04.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:04 smithi105 ceph-mon[103798]: pgmap v359: 129 pgs: 129 active+clean; 1.7 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 90 MiB/s wr, 156 op/s 2023-10-08T08:46:05.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:05 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:05.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:05 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:05.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:05 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:06.528 INFO:tasks.workunit.client.0.smithi070.stdout:5/982: sync 2023-10-08T08:46:06.531 INFO:tasks.workunit.client.0.smithi070.stdout:5/983: unlink d5/da/d22/ddd/d38/d142/d61/d30/d54/d62/c9d 0 2023-10-08T08:46:06.531 INFO:tasks.workunit.client.0.smithi070.stdout:5/984: stat d5/da/d4d/dc2/f10d 0 2023-10-08T08:46:06.531 INFO:tasks.workunit.client.0.smithi070.stdout:5/985: fdatasync d5/da/f1f 0 2023-10-08T08:46:06.532 INFO:tasks.workunit.client.0.smithi070.stdout:5/986: symlink d5/da/d22/ddd/d38/d142/d61/d30/d83/l14c 0 2023-10-08T08:46:06.533 INFO:tasks.workunit.client.0.smithi070.stdout:5/987: read - d5/da/d22/d75/dfa/f120 zero size 2023-10-08T08:46:06.534 INFO:tasks.workunit.client.0.smithi070.stdout:5/988: creat d5/da/d22/ddd/f14d x:0 0 0 2023-10-08T08:46:06.535 INFO:tasks.workunit.client.0.smithi070.stdout:5/989: chown d5/da/d22/d75/fdc 111120470 1 2023-10-08T08:46:06.535 INFO:tasks.workunit.client.0.smithi070.stdout:5/990: readlink d5/da/d22/ddd/d38/d142/d61/d30/l21 0 2023-10-08T08:46:06.535 INFO:tasks.workunit.client.0.smithi070.stdout:5/991: fdatasync d5/da/d22/ddd/d38/d142/d61/d30/d54/d62/dae/f10a 0 2023-10-08T08:46:06.535 INFO:tasks.workunit.client.0.smithi070.stdout:5/992: readlink d5/da/d22/ddd/d38/d142/l104 0 2023-10-08T08:46:06.536 INFO:tasks.workunit.client.0.smithi070.stdout:5/993: link d5/da/d22/ddd/d38/lb6 d5/da/d22/ddd/d38/d142/d63/d133/l14e 0 2023-10-08T08:46:06.537 INFO:tasks.workunit.client.0.smithi070.stdout:5/994: chown d5/da/d22/ddd/d38/d142/d61/f9c 0 1 2023-10-08T08:46:06.537 INFO:tasks.workunit.client.0.smithi070.stdout:5/995: truncate d5/da/d22/f47 7956802 0 2023-10-08T08:46:06.537 INFO:tasks.workunit.client.0.smithi070.stdout:5/996: write d5/da/d22/ddd/d38/d142/d61/d30/d83/d121/f136 [245901,23414] 0 2023-10-08T08:46:06.539 INFO:tasks.workunit.client.0.smithi070.stdout:5/997: link d5/da/d22/ddd/d38/d142/d63/d8b/da8/ce4 d5/da/d22/ddd/d38/d142/c14f 0 2023-10-08T08:46:06.541 INFO:tasks.workunit.client.0.smithi070.stdout:5/998: mknod d5/c150 0 2023-10-08T08:46:06.541 INFO:tasks.workunit.client.0.smithi070.stdout:5/999: fsync d5/da/d22/ddd/d38/d142/d61/d30/d83/f10c 0 2023-10-08T08:46:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:06 smithi191 ceph-mon[104220]: pgmap v360: 129 pgs: 129 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s rd, 104 MiB/s wr, 188 op/s 2023-10-08T08:46:06.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:06 smithi070 ceph-mon[99513]: pgmap v360: 129 pgs: 129 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s rd, 104 MiB/s wr, 188 op/s 2023-10-08T08:46:06.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:06 smithi105 ceph-mon[103798]: pgmap v360: 129 pgs: 129 active+clean; 1.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s rd, 104 MiB/s wr, 188 op/s 2023-10-08T08:46:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:08 smithi191 ceph-mon[104220]: pgmap v361: 129 pgs: 129 active+clean; 2.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 133 MiB/s wr, 246 op/s 2023-10-08T08:46:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:08 smithi070 ceph-mon[99513]: pgmap v361: 129 pgs: 129 active+clean; 2.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 133 MiB/s wr, 246 op/s 2023-10-08T08:46:08.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:08 smithi105 ceph-mon[103798]: pgmap v361: 129 pgs: 129 active+clean; 2.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 133 MiB/s wr, 246 op/s 2023-10-08T08:46:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 -- 172.21.15.70:0/815185232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 msgr2=0x7f8ed010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 --2- 172.21.15.70:0/815185232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 0x7f8ed010d5a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800b0a0 tx=0x7f8ec800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 -- 172.21.15.70:0/815185232 shutdown_connections 2023-10-08T08:46:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 --2- 172.21.15.70:0/815185232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 0x7f8ed010d5a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 --2- 172.21.15.70:0/815185232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed01066e0 0x7f8ed0106ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 --2- 172.21.15.70:0/815185232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed01006d0 0x7f8ed0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 -- 172.21.15.70:0/815185232 >> 172.21.15.70:0/815185232 conn(0x7f8ed00fc200 msgr2=0x7f8ed00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 -- 172.21.15.70:0/815185232 shutdown_connections 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 -- 172.21.15.70:0/815185232 wait complete. 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 Processor -- start 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.618+0000 7f8ed683d700 1 -- start start 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ed683d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed01006d0 0x7f8ed019c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ed683d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 0x7f8ed019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ed683d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed01066e0 0x7f8ed01968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ed683d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0197080 con 0x7f8ed0101090 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ed683d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed01971f0 con 0x7f8ed01006d0 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ed683d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed01973b0 con 0x7f8ed01066e0 2023-10-08T08:46:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecf7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 0x7f8ed019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecf7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 0x7f8ed019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52834/0 (socket says 172.21.15.70:52834) 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed01006d0 0x7f8ed019c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecf7fe700 1 -- 172.21.15.70:0/779068990 learned_addr learned my addr 172.21.15.70:0/779068990 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ed4dda700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed01066e0 0x7f8ed01968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecf7fe700 1 -- 172.21.15.70:0/779068990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed01066e0 msgr2=0x7f8ed01968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed01066e0 0x7f8ed01968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecf7fe700 1 -- 172.21.15.70:0/779068990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed01006d0 msgr2=0x7f8ed019c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed01006d0 0x7f8ed019c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecf7fe700 1 -- 172.21.15.70:0/779068990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8009d00 con 0x7f8ed0101090 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecffff700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed01006d0 0x7f8ed019c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 0x7f8ed019cd50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400e9a0 tx=0x7f8ec400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecd7fa700 1 -- 172.21.15.70:0/779068990 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4009790 con 0x7f8ed0101090 2023-10-08T08:46:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.619+0000 7f8ecd7fa700 1 -- 172.21.15.70:0/779068990 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ec4010430 con 0x7f8ed0101090 2023-10-08T08:46:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.620+0000 7f8ed683d700 1 -- 172.21.15.70:0/779068990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed0197690 con 0x7f8ed0101090 2023-10-08T08:46:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.620+0000 7f8ecd7fa700 1 -- 172.21.15.70:0/779068990 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4018680 con 0x7f8ed0101090 2023-10-08T08:46:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.620+0000 7f8ed683d700 1 -- 172.21.15.70:0/779068990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed01a3790 con 0x7f8ed0101090 2023-10-08T08:46:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.622+0000 7f8ecd7fa700 1 -- 172.21.15.70:0/779068990 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8ec40105a0 con 0x7f8ed0101090 2023-10-08T08:46:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.622+0000 7f8ecd7fa700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8eb80a15f0 0x7f8eb80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.622+0000 7f8ecd7fa700 1 -- 172.21.15.70:0/779068990 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8ec4014070 con 0x7f8ed0101090 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.622+0000 7f8ecffff700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8eb80a15f0 0x7f8eb80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ecffff700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8eb80a15f0 0x7f8eb80a3ab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009fd0 tx=0x7f8ec0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ee2a26b80 1 Processor -- start 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ee2a26b80 1 -- start start 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564181957880 0x564181957c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819581a0 0x564181951b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x564181952510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641818ba400 con 0x5641819520b0 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641818abbc0 con 0x564181957880 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641818a94e0 con 0x5641819581a0 2023-10-08T08:46:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ed4dda700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x564181952510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564181957880 0x564181957c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ed4dda700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x564181952510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52844/0 (socket says 172.21.15.70:52844) 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564181957880 0x564181957c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40298/0 (socket says 172.21.15.70:40298) 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ed4dda700 1 -- 172.21.15.70:0/2471596238 learned_addr learned my addr 172.21.15.70:0/2471596238 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.623+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/2471596238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819581a0 0x564181951b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8ed4dda700 1 -- 172.21.15.70:0/2471596238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819581a0 msgr2=0x564181951b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8ed4dda700 1 --2- 172.21.15.70:0/2471596238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819581a0 0x564181951b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8ed4dda700 1 -- 172.21.15.70:0/2471596238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564181957880 msgr2=0x564181957c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8ed4dda700 1 --2- 172.21.15.70:0/2471596238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564181957880 0x564181957c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8ed4dda700 1 -- 172.21.15.70:0/2471596238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641816cfd80 con 0x5641819520b0 2023-10-08T08:46:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8ecffff700 1 --2- 172.21.15.70:0/2471596238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564181957880 0x564181957c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8ed4dda700 1 --2- 172.21.15.70:0/2471596238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x564181952510 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8006120 tx=0x7f8ec8009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb967da19bcdb8f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8eb67fc700 1 -- 172.21.15.70:0/2471596238 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800e040 con 0x5641819520b0 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8eb67fc700 1 -- 172.21.15.70:0/2471596238 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ec8009b80 con 0x5641819520b0 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.624+0000 7f8eb67fc700 1 -- 172.21.15.70:0/2471596238 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8007740 con 0x5641819520b0 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2471596238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 msgr2=0x564181952510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2471596238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x564181952510 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8006120 tx=0x7f8ec8009450 comp rx=0 tx=0).stop 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2471596238 shutdown_connections 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2471596238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x564181952510 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2471596238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564181957880 0x564181957c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2471596238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819581a0 0x564181951b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2471596238 >> 172.21.15.70:0/2471596238 conn(0x5641818c6200 msgr2=0x56418194cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2471596238 shutdown_connections 2023-10-08T08:46:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2471596238 wait complete. 2023-10-08T08:46:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 -- start start 2023-10-08T08:46:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.625+0000 7f8ee2a26b80 1 Processor -- start 2023-10-08T08:46:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x56418195b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418195ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 0x56418195bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641818a4dd0 con 0x5641819520b0 2023-10-08T08:46:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641818416b0 con 0x5641819581a0 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564181841350 con 0x564181957880 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ee2a26b80 10 client.0 _ll_register_callbacks cb 0x56418169e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x56418195b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x56418195b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52846/0 (socket says 172.21.15.70:52846) 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecf7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418195ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecffff700 1 -- 172.21.15.70:0/3185160773 learned_addr learned my addr 172.21.15.70:0/3185160773 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ed4dda700 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 0x56418195bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecf7fe700 1 -- 172.21.15.70:0/3185160773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 msgr2=0x56418195bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 0x56418195bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecf7fe700 1 -- 172.21.15.70:0/3185160773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 msgr2=0x56418195b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x56418195b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecf7fe700 1 -- 172.21.15.70:0/3185160773 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec0017070 con 0x564181957880 2023-10-08T08:46:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecffff700 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x56418195b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418195ba30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40caa10 tx=0x7f8ec409aa90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392c3a65a8abd16e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8eaf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/3185160773 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec409e3f0 con 0x564181957880 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/3185160773 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8ec40a2630 con 0x564181957880 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/3185160773 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56418189ddb0 con 0x564181957880 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.626+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/3185160773 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec4010880 con 0x564181957880 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ee2a26b80 10 client.25810 fetch_fsmap learned FSMap version 33 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/3185160773 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f8ed010dea0 con 0x564181957880 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/3185160773 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56418189ddb0 con 0x564181957880 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/3185160773 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 33) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f8ec40a22a0 con 0x564181957880 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ee2a26b80 10 client.25810 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T08:46:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ee2a26b80 10 client.25810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ee2a26b80 20 client.25810 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56418196bc50 0x56418196e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ee2a26b80 4 client.25810 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/3185160773 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56418189dad0 con 0x56418196bc50 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ecffff700 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56418196bc50 0x56418196e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8eaf7fe700 10 client.25810 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.627+0000 7f8ecffff700 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56418196bc50 0x56418196e070 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a11b8abdad9129 server_cookie=82de75532a59b4c6 in_seq=0 out_seq=0 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/3185160773 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56418189dad0 con 0x56418196bc50 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8eaf7fe700 10 client.25810 handle_command_reply: tid=0 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 client.25810 shutdown 2023-10-08T08:46:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/3185160773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 msgr2=0x56418195ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418195ba30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40caa10 tx=0x7f8ec409aa90 comp rx=0 tx=0).stop 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/3185160773 shutdown_connections 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x56418196bc50 0x56418196e070 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 0x56418195bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8eaf7fe700 0 client.25810 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819520b0 0x56418195b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/3185160773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418195ba30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/3185160773 >> 172.21.15.70:0/3185160773 conn(0x5641818c6200 msgr2=0x56418194c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/3185160773 shutdown_connections 2023-10-08T08:46:09.638 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/3185160773 wait complete. 2023-10-08T08:46:09.639 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.628+0000 7f8ee2a26b80 20 client.25810 trim_cache size 0 max 16384 2023-10-08T08:46:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ee2a26b80 1 Processor -- start 2023-10-08T08:46:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ee2a26b80 1 -- start start 2023-10-08T08:46:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819520b0 0x564181951b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418194c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819581a0 0x56418194ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641817258c0 con 0x5641819581a0 2023-10-08T08:46:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56418189ddb0 con 0x5641819520b0 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641819472b0 con 0x564181957880 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819520b0 0x564181951b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ed4dda700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819581a0 0x56418194ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819520b0 0x564181951b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40312/0 (socket says 172.21.15.70:40312) 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ecffff700 1 -- 172.21.15.70:0/1175042022 learned_addr learned my addr 172.21.15.70:0/1175042022 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.643+0000 7f8ecf7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418194c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8ecffff700 1 -- 172.21.15.70:0/1175042022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 msgr2=0x56418194c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8ecffff700 1 --2- 172.21.15.70:0/1175042022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418194c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8ecffff700 1 -- 172.21.15.70:0/1175042022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819581a0 msgr2=0x56418194ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8ecffff700 1 --2- 172.21.15.70:0/1175042022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819581a0 0x56418194ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8ecffff700 1 -- 172.21.15.70:0/1175042022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641816b8c00 con 0x5641819520b0 2023-10-08T08:46:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/1175042022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418194c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8ed4dda700 1 --2- 172.21.15.70:0/1175042022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819581a0 0x56418194ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8ecffff700 1 --2- 172.21.15.70:0/1175042022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819520b0 0x564181951b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0011b60 tx=0x7f8ec0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a628f760fe70dcab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8eb6ffd700 1 -- 172.21.15.70:0/1175042022 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0024040 con 0x5641819520b0 2023-10-08T08:46:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8eb6ffd700 1 -- 172.21.15.70:0/1175042022 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ec001e8b0 con 0x5641819520b0 2023-10-08T08:46:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.644+0000 7f8eb6ffd700 1 -- 172.21.15.70:0/1175042022 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000f620 con 0x5641819520b0 2023-10-08T08:46:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/1175042022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819520b0 msgr2=0x564181951b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/1175042022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819520b0 0x564181951b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0011b60 tx=0x7f8ec0014000 comp rx=0 tx=0).stop 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/1175042022 shutdown_connections 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/1175042022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641819581a0 0x56418194ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/1175042022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819520b0 0x564181951b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/1175042022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564181957880 0x56418194c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/1175042022 >> 172.21.15.70:0/1175042022 conn(0x5641818c6200 msgr2=0x564181959e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/1175042022 shutdown_connections 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/1175042022 wait complete. 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 -- start start 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 Processor -- start 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819520b0 0x564181960d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564181957880 0x5641819612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 0x5641819b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641819b9000 con 0x564181957880 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641819b9170 con 0x5641819581a0 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641819b9330 con 0x5641819520b0 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.645+0000 7f8ee2a26b80 10 client.0 _ll_register_callbacks cb 0x7f8ec4099c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecf7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564181957880 0x5641819612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819520b0 0x564181960d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819520b0 0x564181960d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40438/0 (socket says 172.21.15.70:40438) 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecf7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564181957880 0x5641819612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52862/0 (socket says 172.21.15.70:52862) 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecffff700 1 -- 172.21.15.70:0/2394020534 learned_addr learned my addr 172.21.15.70:0/2394020534 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ed4dda700 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 0x5641819b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecffff700 1 -- 172.21.15.70:0/2394020534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 msgr2=0x5641819b8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecffff700 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 0x5641819b8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecffff700 1 -- 172.21.15.70:0/2394020534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564181957880 msgr2=0x5641819612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecffff700 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564181957880 0x5641819612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecffff700 1 -- 172.21.15.70:0/2394020534 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed010dea0 con 0x5641819520b0 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564181957880 0x5641819612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ecffff700 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819520b0 0x564181960d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0005c30 tx=0x7f8ec0029420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef6d24ec0f7537f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8eaf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/2394020534 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0024050 con 0x5641819520b0 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2394020534 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56418186ce50 con 0x5641819520b0 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/2394020534 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8ec001e5f0 con 0x5641819520b0 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/2394020534 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec001ea20 con 0x5641819520b0 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ee2a26b80 10 client.25816 fetch_fsmap learned FSMap version 33 2023-10-08T08:46:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.646+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2394020534 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5641816cfd80 con 0x5641819520b0 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/2394020534 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56418186ce50 con 0x5641819520b0 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/2394020534 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 33) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f8ec0004790 con 0x5641819520b0 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8ee2a26b80 10 client.25816 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8ee2a26b80 10 client.25816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8ee2a26b80 20 client.25816 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5641819c0c60 0x5641819c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8ee2a26b80 4 client.25816 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2394020534 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5641816f0f10 con 0x5641819c0c60 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5641819c0c60 0x5641819c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8eaf7fe700 10 client.25816 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.647+0000 7f8ecf7fe700 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5641819c0c60 0x5641819c3080 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e788452fa8faa7 server_cookie=d91fb711fddc9068 in_seq=0 out_seq=0 2023-10-08T08:46:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8eaf7fe700 1 -- 172.21.15.70:0/2394020534 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5641816f0f10 con 0x5641819c0c60 2023-10-08T08:46:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8eaf7fe700 10 client.25816 handle_command_reply: tid=0 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 client.25816 shutdown 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2394020534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819520b0 msgr2=0x564181960d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819520b0 0x564181960d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0005c30 tx=0x7f8ec0029420 comp rx=0 tx=0).stop 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2394020534 shutdown_connections 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5641819c0c60 0x5641819c3080 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5641819581a0 0x5641819b8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5641819520b0 0x564181960d60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8eaf7fe700 0 client.25816 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 --2- 172.21.15.70:0/2394020534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564181957880 0x5641819612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2394020534 >> 172.21.15.70:0/2394020534 conn(0x5641818c6200 msgr2=0x564181958580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2394020534 shutdown_connections 2023-10-08T08:46:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 1 -- 172.21.15.70:0/2394020534 wait complete. 2023-10-08T08:46:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.660+0000 7f8ee2a26b80 20 client.25816 trim_cache size 0 max 16384 2023-10-08T08:46:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:46:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:46:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:46:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:46:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 -- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8eb80a15f0 msgr2=0x7f8eb80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8eb80a15f0 0x7f8eb80a3ab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009fd0 tx=0x7f8ec0009260 comp rx=0 tx=0).stop 2023-10-08T08:46:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 -- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 msgr2=0x7f8ed019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 0x7f8ed019cd50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400e9a0 tx=0x7f8ec400ecb0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 -- 172.21.15.70:0/779068990 shutdown_connections 2023-10-08T08:46:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8eb80a15f0 0x7f8eb80a3ab0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ed01066e0 0x7f8ed01968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ed01006d0 0x7f8ed019c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 --2- 172.21.15.70:0/779068990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ed0101090 0x7f8ed019cd50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 -- 172.21.15.70:0/779068990 >> 172.21.15.70:0/779068990 conn(0x7f8ed00fc200 msgr2=0x7f8ed00fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 -- 172.21.15.70:0/779068990 shutdown_connections 2023-10-08T08:46:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:09.661+0000 7f8ed683d700 1 -- 172.21.15.70:0/779068990 wait complete. 2023-10-08T08:46:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:10 smithi191 ceph-mon[104220]: pgmap v362: 129 pgs: 129 active+clean; 2.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 132 MiB/s wr, 248 op/s 2023-10-08T08:46:10.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:10 smithi070 ceph-mon[99513]: pgmap v362: 129 pgs: 129 active+clean; 2.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 132 MiB/s wr, 248 op/s 2023-10-08T08:46:10.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:10 smithi105 ceph-mon[103798]: pgmap v362: 129 pgs: 129 active+clean; 2.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 132 MiB/s wr, 248 op/s 2023-10-08T08:46:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:12 smithi191 ceph-mon[104220]: pgmap v363: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 122 MiB/s wr, 237 op/s 2023-10-08T08:46:12.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:12 smithi070 ceph-mon[99513]: pgmap v363: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 122 MiB/s wr, 237 op/s 2023-10-08T08:46:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:12 smithi105 ceph-mon[103798]: pgmap v363: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 122 MiB/s wr, 237 op/s 2023-10-08T08:46:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:46:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:13 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:46:13.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:13 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:46:13.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:13.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:13 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:14 smithi191 ceph-mon[104220]: pgmap v364: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 68 MiB/s wr, 149 op/s 2023-10-08T08:46:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:46:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:46:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:14 smithi070 ceph-mon[99513]: pgmap v364: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 68 MiB/s wr, 149 op/s 2023-10-08T08:46:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:46:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:46:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:14 smithi105 ceph-mon[103798]: pgmap v364: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 68 MiB/s wr, 149 op/s 2023-10-08T08:46:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:46:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:46:14.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:46:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:15 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:15 smithi191 ceph-mon[104220]: pgmap v365: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 55 MiB/s wr, 147 op/s 2023-10-08T08:46:15.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:15 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:15.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:15 smithi070 ceph-mon[99513]: pgmap v365: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 55 MiB/s wr, 147 op/s 2023-10-08T08:46:16.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:15 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:16.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:15 smithi105 ceph-mon[103798]: pgmap v365: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 55 MiB/s wr, 147 op/s 2023-10-08T08:46:18.473 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:18 smithi070 ceph-mon[99513]: pgmap v366: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 39 MiB/s wr, 117 op/s 2023-10-08T08:46:18.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:18 smithi105 ceph-mon[103798]: pgmap v366: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 39 MiB/s wr, 117 op/s 2023-10-08T08:46:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:18 smithi191 ceph-mon[104220]: pgmap v366: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 39 MiB/s wr, 117 op/s 2023-10-08T08:46:19.891 INFO:tasks.workunit.client.0.smithi070.stdout:7/971: rmdir d3/d77/d11c 0 2023-10-08T08:46:19.892 INFO:tasks.workunit.client.0.smithi070.stdout:7/972: chown d3/d19/d95/da3/dc8/dfb/d9f/dc5/c12e 60885 1 2023-10-08T08:46:19.896 INFO:tasks.workunit.client.0.smithi070.stdout:7/973: rename d3/d19/f67 to d3/d77/de2/df6/f136 0 2023-10-08T08:46:19.896 INFO:tasks.workunit.client.0.smithi070.stdout:7/974: write d3/da9/d4a/f8 [4719490,63794] 0 2023-10-08T08:46:19.898 INFO:tasks.workunit.client.0.smithi070.stdout:7/975: mkdir d3/da9/d4a/d137 0 2023-10-08T08:46:19.901 INFO:tasks.workunit.client.0.smithi070.stdout:7/976: mkdir d3/d19/d95/d138 0 2023-10-08T08:46:19.911 INFO:tasks.workunit.client.0.smithi070.stdout:7/977: write d3/da9/d1e/d4c/f80 [2067266,123575] 0 2023-10-08T08:46:19.911 INFO:tasks.workunit.client.0.smithi070.stdout:7/978: chown d3/d77/d112/d12b 78 1 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:7/979: fdatasync d3/d19/d95/da3/dc8/dfb/d9f/dc5/fdf 0 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:4/874: sync 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:6/890: sync 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:9/839: sync 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:7/980: readlink d3/da9/d4a/lc7 0 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:7/981: write d3/d19/d1a/fc1 [1024517,122730] 0 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:7/982: stat d3/d79/c106 0 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:4/875: rename dc/d17/d79/dad/lb0 to dc/d17/d24/d55/da4/l126 0 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:6/891: symlink df/d11/l129 0 2023-10-08T08:46:19.912 INFO:tasks.workunit.client.0.smithi070.stdout:6/892: chown df/d26/d42/d4b/db6/fd2 752858742 1 2023-10-08T08:46:19.913 INFO:tasks.workunit.client.0.smithi070.stdout:9/840: rmdir d1/dd/d39/d66 39 2023-10-08T08:46:19.913 INFO:tasks.workunit.client.0.smithi070.stdout:7/983: mknod d3/d77/c139 0 2023-10-08T08:46:19.913 INFO:tasks.workunit.client.0.smithi070.stdout:4/876: read dc/d17/d24/f2f [428510,41729] 0 2023-10-08T08:46:19.914 INFO:tasks.workunit.client.0.smithi070.stdout:6/893: read df/d26/d42/d43/d4a/d97/dc0/ffb [865537,54938] 0 2023-10-08T08:46:19.914 INFO:tasks.workunit.client.0.smithi070.stdout:4/877: mkdir dc/d17/d79/dad/db6/d127 0 2023-10-08T08:46:19.914 INFO:tasks.workunit.client.0.smithi070.stdout:4/878: readlink dc/d17/d24/d4c/d4e/dda/df4/d117/dc3/led 0 2023-10-08T08:46:19.915 INFO:tasks.workunit.client.0.smithi070.stdout:7/984: creat d3/d19/d95/dad/f13a x:0 0 0 2023-10-08T08:46:19.915 INFO:tasks.workunit.client.0.smithi070.stdout:9/841: write d1/dd/d26/f54 [164291,10882] 0 2023-10-08T08:46:19.915 INFO:tasks.workunit.client.0.smithi070.stdout:9/842: truncate d1/dd/d26/d27/f36 4454077 0 2023-10-08T08:46:19.916 INFO:tasks.workunit.client.0.smithi070.stdout:9/843: creat d1/dd/d19/d99/ffe x:0 0 0 2023-10-08T08:46:19.916 INFO:tasks.workunit.client.0.smithi070.stdout:9/844: truncate d1/dd/d26/d27/fd1 530655 0 2023-10-08T08:46:19.916 INFO:tasks.workunit.client.0.smithi070.stdout:6/894: dread df/d26/d42/db1/f9c [0,4194304] 0 2023-10-08T08:46:19.917 INFO:tasks.workunit.client.0.smithi070.stdout:9/845: creat d1/dd/d26/d27/df7/dfd/fff x:0 0 0 2023-10-08T08:46:19.917 INFO:tasks.workunit.client.0.smithi070.stdout:4/879: write dc/d17/d1f/ffc [736962,106485] 0 2023-10-08T08:46:19.918 INFO:tasks.workunit.client.0.smithi070.stdout:6/895: mkdir df/d26/d42/d4b/d12a 0 2023-10-08T08:46:19.919 INFO:tasks.workunit.client.0.smithi070.stdout:4/880: creat dc/d17/d24/f128 x:0 0 0 2023-10-08T08:46:19.919 INFO:tasks.workunit.client.0.smithi070.stdout:4/881: write dc/d17/d24/d55/da4/ff6 [378739,47019] 0 2023-10-08T08:46:19.919 INFO:tasks.workunit.client.0.smithi070.stdout:4/882: chown dc/d17/d79 196815884 1 2023-10-08T08:46:19.919 INFO:tasks.workunit.client.0.smithi070.stdout:9/846: read d1/dd/f18 [673016,76752] 0 2023-10-08T08:46:19.919 INFO:tasks.workunit.client.0.smithi070.stdout:9/847: fdatasync d1/dd/d19/d38/d4f/f91 0 2023-10-08T08:46:19.920 INFO:tasks.workunit.client.0.smithi070.stdout:7/985: write d3/f37 [3007415,129539] 0 2023-10-08T08:46:19.920 INFO:tasks.workunit.client.0.smithi070.stdout:4/883: rename dc/c4a to dc/d17/d1f/d54/c129 0 2023-10-08T08:46:19.920 INFO:tasks.workunit.client.0.smithi070.stdout:4/884: chown dc/d17/d24/f52 2 1 2023-10-08T08:46:19.922 INFO:tasks.workunit.client.0.smithi070.stdout:4/885: chown dc/d17/d24/d55/f66 37844 1 2023-10-08T08:46:19.923 INFO:tasks.workunit.client.0.smithi070.stdout:7/986: creat d3/d19/d95/da3/dc8/ddd/f13b x:0 0 0 2023-10-08T08:46:19.925 INFO:tasks.workunit.client.0.smithi070.stdout:7/987: symlink d3/da9/d4a/d9/da4/dd6/l13c 0 2023-10-08T08:46:19.930 INFO:tasks.workunit.client.0.smithi070.stdout:7/988: mkdir d3/da9/d4a/d9/d97/d13d 0 2023-10-08T08:46:19.934 INFO:tasks.workunit.client.0.smithi070.stdout:9/848: dread d1/dd/d8d/fad [0,4194304] 0 2023-10-08T08:46:19.940 INFO:tasks.workunit.client.0.smithi070.stdout:4/886: dread dc/d17/d24/d37/f3b [0,4194304] 0 2023-10-08T08:46:19.941 INFO:tasks.workunit.client.0.smithi070.stdout:4/887: truncate dc/d17/dbf/dfb/f100 457422 0 2023-10-08T08:46:19.943 INFO:tasks.workunit.client.0.smithi070.stdout:4/888: mkdir dc/d17/d12a 0 2023-10-08T08:46:19.945 INFO:tasks.workunit.client.0.smithi070.stdout:4/889: creat dc/d17/d24/d4c/df9/f12b x:0 0 0 2023-10-08T08:46:19.948 INFO:tasks.workunit.client.0.smithi070.stdout:4/890: unlink dc/d17/d24/d6b/f6c 0 2023-10-08T08:46:19.950 INFO:tasks.workunit.client.0.smithi070.stdout:6/896: dwrite df/d26/d42/d43/d4a/d97/dc0/df7/f124 [0,4194304] 0 2023-10-08T08:46:19.951 INFO:tasks.workunit.client.0.smithi070.stdout:4/891: rename dc/d17/d24/d4c/d4e/dda/df4/d117/dc3 to dc/d68/d110/d12c 0 2023-10-08T08:46:19.951 INFO:tasks.workunit.client.0.smithi070.stdout:4/892: chown dc/d17/d79/dad 346 1 2023-10-08T08:46:19.954 INFO:tasks.workunit.client.0.smithi070.stdout:4/893: getdents dc/d68 0 2023-10-08T08:46:19.963 INFO:tasks.workunit.client.0.smithi070.stdout:7/989: dwrite d3/da9/d4a/f8e [0,4194304] 0 2023-10-08T08:46:19.963 INFO:tasks.workunit.client.0.smithi070.stdout:7/990: chown d3/da9/d4a/d9/d97/fa0 48 1 2023-10-08T08:46:19.964 INFO:tasks.workunit.client.0.smithi070.stdout:7/991: rmdir d3/d19/d95/dfe 39 2023-10-08T08:46:19.968 INFO:tasks.workunit.client.0.smithi070.stdout:7/992: symlink d3/da9/d1e/d4c/l13e 0 2023-10-08T08:46:19.968 INFO:tasks.workunit.client.0.smithi070.stdout:4/894: dread dc/d17/d24/f40 [0,4194304] 0 2023-10-08T08:46:19.969 INFO:tasks.workunit.client.0.smithi070.stdout:7/993: write d3/da9/d4a/d9/d97/fa0 [4564549,18297] 0 2023-10-08T08:46:19.969 INFO:tasks.workunit.client.0.smithi070.stdout:6/897: dwrite df/d26/d42/db1/d119/fd8 [0,4194304] 0 2023-10-08T08:46:19.972 INFO:tasks.workunit.client.0.smithi070.stdout:6/898: link df/d26/d42/db1/d119/l106 df/d26/d78/d90/dae/dfd/l12b 0 2023-10-08T08:46:19.975 INFO:tasks.workunit.client.0.smithi070.stdout:7/994: rename d3/d19/d95/da3/dc8/dfb/d9f/dc5 to d3/d19/d95/da3/dc8/dfb/d13f 0 2023-10-08T08:46:20.019 INFO:tasks.workunit.client.0.smithi070.stdout:6/899: dwrite df/d26/d42/d4b/f56 [0,4194304] 0 2023-10-08T08:46:20.021 INFO:tasks.workunit.client.0.smithi070.stdout:4/895: dwrite dc/d17/d24/d4c/d4e/f5d [0,4194304] 0 2023-10-08T08:46:20.021 INFO:tasks.workunit.client.0.smithi070.stdout:4/896: stat dc/d17/c44 0 2023-10-08T08:46:20.021 INFO:tasks.workunit.client.0.smithi070.stdout:4/897: chown dc/d17/d79/dad/db6/d127 1268 1 2023-10-08T08:46:20.023 INFO:tasks.workunit.client.0.smithi070.stdout:6/900: mknod df/d26/d42/d43/d4a/d75/d7e/c12c 0 2023-10-08T08:46:20.024 INFO:tasks.workunit.client.0.smithi070.stdout:6/901: getdents df/d26/d78/d90/daa 0 2023-10-08T08:46:20.025 INFO:tasks.workunit.client.0.smithi070.stdout:6/902: symlink df/d53/l12d 0 2023-10-08T08:46:20.042 INFO:tasks.workunit.client.0.smithi070.stdout:6/903: dwrite df/d26/d42/d4b/db6/fa9 [0,4194304] 0 2023-10-08T08:46:20.042 INFO:tasks.workunit.client.0.smithi070.stdout:4/898: dwrite dc/d17/d24/d4c/d4e/dab/dff/f107 [4194304,4194304] 0 2023-10-08T08:46:20.044 INFO:tasks.workunit.client.0.smithi070.stdout:4/899: read dc/d17/d24/f52 [145082,69802] 0 2023-10-08T08:46:20.058 INFO:tasks.workunit.client.0.smithi070.stdout:4/900: dwrite dc/d17/d24/d4c/d4e/dda/df4/d117/d11a/f122 [0,4194304] 0 2023-10-08T08:46:20.078 INFO:tasks.workunit.client.0.smithi070.stdout:4/901: dwrite dc/d17/f114 [0,4194304] 0 2023-10-08T08:46:20.081 INFO:tasks.workunit.client.0.smithi070.stdout:4/902: creat dc/d17/d1f/d5e/d9f/f12d x:0 0 0 2023-10-08T08:46:20.082 INFO:tasks.workunit.client.0.smithi070.stdout:4/903: truncate dc/d17/d24/d37/f53 146218 0 2023-10-08T08:46:20.085 INFO:tasks.workunit.client.0.smithi070.stdout:4/904: dread dc/d17/d24/f52 [0,4194304] 0 2023-10-08T08:46:20.087 INFO:tasks.workunit.client.0.smithi070.stdout:4/905: rename dc/d17/d24/d55/da4/fb8 to dc/d17/d24/d4c/df9/f12e 0 2023-10-08T08:46:20.088 INFO:tasks.workunit.client.0.smithi070.stdout:4/906: symlink dc/d17/d1f/l12f 0 2023-10-08T08:46:20.088 INFO:tasks.workunit.client.0.smithi070.stdout:4/907: dread - dc/d17/d1f/d5e/f87 zero size 2023-10-08T08:46:20.088 INFO:tasks.workunit.client.0.smithi070.stdout:4/908: mkdir dc/d17/d24/d4c/d4e/dda/d130 0 2023-10-08T08:46:20.089 INFO:tasks.workunit.client.0.smithi070.stdout:4/909: mknod dc/d17/d24/d6b/c131 0 2023-10-08T08:46:20.090 INFO:tasks.workunit.client.0.smithi070.stdout:4/910: unlink dc/d17/d79/dad/c118 0 2023-10-08T08:46:20.108 INFO:tasks.workunit.client.0.smithi070.stdout:4/911: dwrite dc/d5f/fb3 [0,4194304] 0 2023-10-08T08:46:20.108 INFO:tasks.workunit.client.0.smithi070.stdout:4/912: dread - dc/d17/d24/d4c/df9/f12b zero size 2023-10-08T08:46:20.115 INFO:tasks.workunit.client.0.smithi070.stdout:4/913: creat dc/d17/d24/d4c/d4e/dda/d130/f132 x:0 0 0 2023-10-08T08:46:20.116 INFO:tasks.workunit.client.0.smithi070.stdout:4/914: fdatasync dc/d17/d24/d55/ff3 0 2023-10-08T08:46:20.132 INFO:tasks.workunit.client.0.smithi070.stdout:4/915: dwrite dc/d17/fea [0,4194304] 0 2023-10-08T08:46:20.133 INFO:tasks.workunit.client.0.smithi070.stdout:4/916: chown dc/c47 260574844 1 2023-10-08T08:46:20.134 INFO:tasks.workunit.client.0.smithi070.stdout:4/917: mknod dc/d17/dbf/c133 0 2023-10-08T08:46:20.135 INFO:tasks.workunit.client.0.smithi070.stdout:4/918: getdents dc/d5f 0 2023-10-08T08:46:20.135 INFO:tasks.workunit.client.0.smithi070.stdout:4/919: fsync dc/f51 0 2023-10-08T08:46:20.137 INFO:tasks.workunit.client.0.smithi070.stdout:4/920: write dc/d17/f27 [2028990,118724] 0 2023-10-08T08:46:20.138 INFO:tasks.workunit.client.0.smithi070.stdout:4/921: unlink dc/d17/d1f/c2d 0 2023-10-08T08:46:20.138 INFO:tasks.workunit.client.0.smithi070.stdout:4/922: fdatasync dc/d17/d24/d55/da4/fa7 0 2023-10-08T08:46:20.324 INFO:tasks.workunit.client.0.smithi070.stdout:9/849: sync 2023-10-08T08:46:20.324 INFO:tasks.workunit.client.0.smithi070.stdout:6/904: sync 2023-10-08T08:46:20.324 INFO:tasks.workunit.client.0.smithi070.stdout:7/995: sync 2023-10-08T08:46:20.324 INFO:tasks.workunit.client.0.smithi070.stdout:7/996: write d3/da9/d4a/d9/da4/fb3 [814497,71030] 0 2023-10-08T08:46:20.324 INFO:tasks.workunit.client.0.smithi070.stdout:7/997: chown d3/d77/c139 60089032 1 2023-10-08T08:46:20.324 INFO:tasks.workunit.client.0.smithi070.stdout:9/850: write d1/dd/d26/f8a [770790,128010] 0 2023-10-08T08:46:20.325 INFO:tasks.workunit.client.0.smithi070.stdout:7/998: unlink d3/da9/d4a/d9/da4/dd6/l13c 0 2023-10-08T08:46:20.325 INFO:tasks.workunit.client.0.smithi070.stdout:9/851: getdents d1/dd/d26/d27/d2d/d70/d90/dab 0 2023-10-08T08:46:20.325 INFO:tasks.workunit.client.0.smithi070.stdout:9/852: fsync d1/dd/d1a/d40/d76/d93/dd0/dd5/ff0 0 2023-10-08T08:46:20.326 INFO:tasks.workunit.client.0.smithi070.stdout:7/999: symlink d3/da9/d1e/d4c/l140 0 2023-10-08T08:46:20.326 INFO:tasks.workunit.client.0.smithi070.stdout:9/853: creat d1/dd/d26/d27/f100 x:0 0 0 2023-10-08T08:46:20.327 INFO:tasks.workunit.client.0.smithi070.stdout:9/854: creat d1/dd/d26/d27/df7/dfd/f101 x:0 0 0 2023-10-08T08:46:20.329 INFO:tasks.workunit.client.0.smithi070.stdout:9/855: symlink d1/dd/d1a/d40/d76/d93/l102 0 2023-10-08T08:46:20.330 INFO:tasks.workunit.client.0.smithi070.stdout:9/856: getdents d1/dd/d26/d27/d2d/d70/d90 0 2023-10-08T08:46:20.330 INFO:tasks.workunit.client.0.smithi070.stdout:9/857: truncate d1/dd/d26/f98 1164586 0 2023-10-08T08:46:20.331 INFO:tasks.workunit.client.0.smithi070.stdout:9/858: creat d1/f103 x:0 0 0 2023-10-08T08:46:20.332 INFO:tasks.workunit.client.0.smithi070.stdout:9/859: mkdir d1/dd/d19/d38/d4f/dc7/d104 0 2023-10-08T08:46:20.336 INFO:tasks.workunit.client.0.smithi070.stdout:6/905: dread df/d26/d42/d4b/f5b [0,4194304] 0 2023-10-08T08:46:20.336 INFO:tasks.workunit.client.0.smithi070.stdout:6/906: readlink df/d11/l57 0 2023-10-08T08:46:20.336 INFO:tasks.workunit.client.0.smithi070.stdout:6/907: chown df/d26/d42/d4b/db6 1306 1 2023-10-08T08:46:20.336 INFO:tasks.workunit.client.0.smithi070.stdout:6/908: stat df/d71/f7b 0 2023-10-08T08:46:20.342 INFO:tasks.workunit.client.0.smithi070.stdout:6/909: write df/f10 [1996826,29550] 0 2023-10-08T08:46:20.343 INFO:tasks.workunit.client.0.smithi070.stdout:6/910: mkdir df/d71/d12e 0 2023-10-08T08:46:20.353 INFO:tasks.workunit.client.0.smithi070.stdout:9/860: dwrite d1/dd/d19/d38/d4f/db9/fce [0,4194304] 0 2023-10-08T08:46:20.353 INFO:tasks.workunit.client.0.smithi070.stdout:9/861: fdatasync d1/dd/d19/d38/d4f/db9/ffc 0 2023-10-08T08:46:20.360 INFO:tasks.workunit.client.0.smithi070.stdout:6/911: dread df/d71/f8c [0,4194304] 0 2023-10-08T08:46:20.362 INFO:tasks.workunit.client.0.smithi070.stdout:6/912: write df/d26/d78/d90/fb7 [549221,112010] 0 2023-10-08T08:46:20.373 INFO:tasks.workunit.client.0.smithi070.stdout:9/862: dwrite d1/dd/d1a/fea [0,4194304] 0 2023-10-08T08:46:20.375 INFO:tasks.workunit.client.0.smithi070.stdout:9/863: creat d1/dd/d19/d38/d77/f105 x:0 0 0 2023-10-08T08:46:20.375 INFO:tasks.workunit.client.0.smithi070.stdout:9/864: dread - d1/dd/fcf zero size 2023-10-08T08:46:20.382 INFO:tasks.workunit.client.0.smithi070.stdout:9/865: write d1/dd/d19/d38/d4f/db9/f95 [211966,97325] 0 2023-10-08T08:46:20.384 INFO:tasks.workunit.client.0.smithi070.stdout:9/866: creat d1/dd/d19/dbe/f106 x:0 0 0 2023-10-08T08:46:20.384 INFO:tasks.workunit.client.0.smithi070.stdout:9/867: dread d1/dd/d26/d27/d2d/d70/d90/dab/fd2 [0,4194304] 0 2023-10-08T08:46:20.385 INFO:tasks.workunit.client.0.smithi070.stdout:9/868: creat d1/dd/d1a/d40/d76/d93/dd8/f107 x:0 0 0 2023-10-08T08:46:20.387 INFO:tasks.workunit.client.0.smithi070.stdout:6/913: dwrite df/d26/d42/d4b/db6/d7d/fb2 [0,4194304] 0 2023-10-08T08:46:20.387 INFO:tasks.workunit.client.0.smithi070.stdout:6/914: dread - df/d26/d42/fca zero size 2023-10-08T08:46:20.392 INFO:tasks.workunit.client.0.smithi070.stdout:6/915: link df/d26/d42/d43/d4a/c7c df/d26/d78/c12f 0 2023-10-08T08:46:20.392 INFO:tasks.workunit.client.0.smithi070.stdout:6/916: readlink df/d26/l32 0 2023-10-08T08:46:20.392 INFO:tasks.workunit.client.0.smithi070.stdout:6/917: fdatasync df/d26/f3b 0 2023-10-08T08:46:20.394 INFO:tasks.workunit.client.0.smithi070.stdout:6/918: mknod df/d26/d42/d4b/db6/c130 0 2023-10-08T08:46:20.394 INFO:tasks.workunit.client.0.smithi070.stdout:4/923: sync 2023-10-08T08:46:20.394 INFO:tasks.workunit.client.0.smithi070.stdout:6/919: mknod df/d26/d42/d4b/d80/c131 0 2023-10-08T08:46:20.405 INFO:tasks.workunit.client.0.smithi070.stdout:6/920: write df/d26/f37 [79319,55585] 0 2023-10-08T08:46:20.405 INFO:tasks.workunit.client.0.smithi070.stdout:6/921: read - df/d26/d78/f11f zero size 2023-10-08T08:46:20.406 INFO:tasks.workunit.client.0.smithi070.stdout:6/922: creat df/d26/d42/d4b/db6/d7d/dc8/d103/de0/df9/f132 x:0 0 0 2023-10-08T08:46:20.407 INFO:tasks.workunit.client.0.smithi070.stdout:9/869: dwrite d1/dd/fcf [0,4194304] 0 2023-10-08T08:46:20.409 INFO:tasks.workunit.client.0.smithi070.stdout:6/923: mkdir df/d26/d42/d4b/d80/d133 0 2023-10-08T08:46:20.411 INFO:tasks.workunit.client.0.smithi070.stdout:6/924: creat df/d26/d42/d43/d4a/d75/d7e/de4/f134 x:0 0 0 2023-10-08T08:46:20.414 INFO:tasks.workunit.client.0.smithi070.stdout:6/925: getdents df/d26/d42/d4b/db6/d7d 0 2023-10-08T08:46:20.416 INFO:tasks.workunit.client.0.smithi070.stdout:4/924: dwrite dc/d17/d1f/f26 [0,4194304] 0 2023-10-08T08:46:20.416 INFO:tasks.workunit.client.0.smithi070.stdout:4/925: dread - dc/d17/d1f/d54/f101 zero size 2023-10-08T08:46:20.416 INFO:tasks.workunit.client.0.smithi070.stdout:9/870: write d1/dd/d26/d27/fd1 [337951,34524] 0 2023-10-08T08:46:20.420 INFO:tasks.workunit.client.0.smithi070.stdout:4/926: write dc/d17/d1f/d54/f67 [4147090,81062] 0 2023-10-08T08:46:20.421 INFO:tasks.workunit.client.0.smithi070.stdout:4/927: creat dc/d17/d79/f134 x:0 0 0 2023-10-08T08:46:20.425 INFO:tasks.workunit.client.0.smithi070.stdout:4/928: write dc/d17/d24/d4c/d4e/faa [1063148,43858] 0 2023-10-08T08:46:20.426 INFO:tasks.workunit.client.0.smithi070.stdout:4/929: symlink dc/d68/d110/l135 0 2023-10-08T08:46:20.429 INFO:tasks.workunit.client.0.smithi070.stdout:6/926: dread df/d26/d42/d43/d4a/d97/dc0/ffb [0,4194304] 0 2023-10-08T08:46:20.430 INFO:tasks.workunit.client.0.smithi070.stdout:6/927: getdents df/d71/d12e 0 2023-10-08T08:46:20.439 INFO:tasks.workunit.client.0.smithi070.stdout:9/871: dwrite d1/f8b [0,4194304] 0 2023-10-08T08:46:20.442 INFO:tasks.workunit.client.0.smithi070.stdout:6/928: dread df/d26/f3b [0,4194304] 0 2023-10-08T08:46:20.442 INFO:tasks.workunit.client.0.smithi070.stdout:9/872: unlink d1/dd/d26/ca2 0 2023-10-08T08:46:20.446 INFO:tasks.workunit.client.0.smithi070.stdout:6/929: mknod df/d26/d42/d4b/d80/d94/c135 0 2023-10-08T08:46:20.447 INFO:tasks.workunit.client.0.smithi070.stdout:6/930: dread df/d11/fe6 [0,4194304] 0 2023-10-08T08:46:20.448 INFO:tasks.workunit.client.0.smithi070.stdout:6/931: unlink df/d26/d78/d90/dae/db3/c126 0 2023-10-08T08:46:20.449 INFO:tasks.workunit.client.0.smithi070.stdout:4/930: dwrite dc/d17/d1f/d5e/dd0/f105 [0,4194304] 0 2023-10-08T08:46:20.456 INFO:tasks.workunit.client.0.smithi070.stdout:4/931: mknod dc/d17/d24/d55/da4/c136 0 2023-10-08T08:46:20.456 INFO:tasks.workunit.client.0.smithi070.stdout:4/932: fsync dc/d17/d24/d4c/d4e/f57 0 2023-10-08T08:46:20.456 INFO:tasks.workunit.client.0.smithi070.stdout:4/933: write dc/d17/d24/d4c/d4e/f108 [15975,20122] 0 2023-10-08T08:46:20.464 INFO:tasks.workunit.client.0.smithi070.stdout:9/873: dwrite f0 [0,4194304] 0 2023-10-08T08:46:20.464 INFO:tasks.workunit.client.0.smithi070.stdout:9/874: dread - d1/dd/d26/d27/d2d/fe1 zero size 2023-10-08T08:46:20.464 INFO:tasks.workunit.client.0.smithi070.stdout:9/875: chown d1/dd/d1a/d40/d76/f8c 81057 1 2023-10-08T08:46:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:20 smithi070 ceph-mon[99513]: pgmap v367: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.3 MiB/s wr, 50 op/s 2023-10-08T08:46:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:20 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:4/934: dread dc/d17/d1f/f43 [0,4194304] 0 2023-10-08T08:46:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:4/935: chown dc/d17/dbf/fde 218299 1 2023-10-08T08:46:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:4/936: truncate dc/d17/d24/d55/da4/f10c 42345 0 2023-10-08T08:46:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:9/876: write d1/dd/d19/f67 [716174,34636] 0 2023-10-08T08:46:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:9/877: write d1/dd/d39/fc2 [399342,14928] 0 2023-10-08T08:46:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:4/937: mknod dc/d68/c137 0 2023-10-08T08:46:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:4/938: dread - dc/d17/d24/d4c/d4e/dda/d130/f132 zero size 2023-10-08T08:46:20.473 INFO:tasks.workunit.client.0.smithi070.stdout:4/939: creat dc/d17/d79/dad/db6/f138 x:0 0 0 2023-10-08T08:46:20.475 INFO:tasks.workunit.client.0.smithi070.stdout:4/940: symlink dc/d17/dbf/l139 0 2023-10-08T08:46:20.478 INFO:tasks.workunit.client.0.smithi070.stdout:6/932: dwrite df/d26/d42/d43/d4a/d97/f111 [0,4194304] 0 2023-10-08T08:46:20.480 INFO:tasks.workunit.client.0.smithi070.stdout:6/933: creat df/d26/d42/f136 x:0 0 0 2023-10-08T08:46:20.500 INFO:tasks.workunit.client.0.smithi070.stdout:6/934: write df/d26/d42/d4b/db6/f8b [2057366,17009] 0 2023-10-08T08:46:20.500 INFO:tasks.workunit.client.0.smithi070.stdout:9/878: dwrite d1/dd/d26/d7b/fed [0,4194304] 0 2023-10-08T08:46:20.500 INFO:tasks.workunit.client.0.smithi070.stdout:9/879: read d1/dd/d19/d97/fcd [138784,114183] 0 2023-10-08T08:46:20.500 INFO:tasks.workunit.client.0.smithi070.stdout:9/880: dread - d1/dd/d26/d27/df7/dfd/fff zero size 2023-10-08T08:46:20.504 INFO:tasks.workunit.client.0.smithi070.stdout:6/935: truncate df/d26/d42/d43/d4a/d75/f108 2418447 0 2023-10-08T08:46:20.505 INFO:tasks.workunit.client.0.smithi070.stdout:6/936: mknod df/d26/d42/d4b/c137 0 2023-10-08T08:46:20.505 INFO:tasks.workunit.client.0.smithi070.stdout:6/937: chown df/d26/d78/d90/dae/dfd/l12b 29 1 2023-10-08T08:46:20.505 INFO:tasks.workunit.client.0.smithi070.stdout:6/938: chown df/d71/c8a 242687 1 2023-10-08T08:46:20.505 INFO:tasks.workunit.client.0.smithi070.stdout:6/939: symlink df/d26/d78/d90/dae/db3/l138 0 2023-10-08T08:46:20.506 INFO:tasks.workunit.client.0.smithi070.stdout:4/941: dwrite dc/f13 [0,4194304] 0 2023-10-08T08:46:20.508 INFO:tasks.workunit.client.0.smithi070.stdout:6/940: rename df/d11/l2a to df/d26/d42/d4b/d12a/l139 0 2023-10-08T08:46:20.509 INFO:tasks.workunit.client.0.smithi070.stdout:4/942: creat dc/d17/d24/d55/f13a x:0 0 0 2023-10-08T08:46:20.509 INFO:tasks.workunit.client.0.smithi070.stdout:6/941: mkdir df/d26/d78/d90/daa/d13a 0 2023-10-08T08:46:20.511 INFO:tasks.workunit.client.0.smithi070.stdout:4/943: rename dc/d17/d24/d4c/d4e/c8e to dc/d5f/c13b 0 2023-10-08T08:46:20.511 INFO:tasks.workunit.client.0.smithi070.stdout:4/944: stat dc/d68/d110/d12c/fdc 0 2023-10-08T08:46:20.511 INFO:tasks.workunit.client.0.smithi070.stdout:4/945: fsync dc/d17/d24/d4c/d4e/dda/df4/d117/fc9 0 2023-10-08T08:46:20.511 INFO:tasks.workunit.client.0.smithi070.stdout:9/881: dread d1/dd/f10 [0,4194304] 0 2023-10-08T08:46:20.515 INFO:tasks.workunit.client.0.smithi070.stdout:4/946: symlink dc/d17/d79/dad/l13c 0 2023-10-08T08:46:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:20 smithi105 ceph-mon[103798]: pgmap v367: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.3 MiB/s wr, 50 op/s 2023-10-08T08:46:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:20 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:20.521 INFO:tasks.workunit.client.0.smithi070.stdout:4/947: write dc/d17/d24/fa6 [1584441,118329] 0 2023-10-08T08:46:20.522 INFO:tasks.workunit.client.0.smithi070.stdout:4/948: chown dc/d17/d24/f49 1042456539 1 2023-10-08T08:46:20.528 INFO:tasks.workunit.client.0.smithi070.stdout:9/882: rename d1/dd/d19/d38 to d1/dd/d39/dc9/d108 0 2023-10-08T08:46:20.530 INFO:tasks.workunit.client.0.smithi070.stdout:9/883: rename d1/dd/d1a/d40/f4e to d1/dd/d39/da4/dc3/f109 0 2023-10-08T08:46:20.531 INFO:tasks.workunit.client.0.smithi070.stdout:9/884: creat d1/dd/d39/dc9/d108/d77/d96/dd4/f10a x:0 0 0 2023-10-08T08:46:20.549 INFO:tasks.workunit.client.0.smithi070.stdout:9/885: dwrite d1/dd/d26/fbb [0,4194304] 0 2023-10-08T08:46:20.549 INFO:tasks.workunit.client.0.smithi070.stdout:9/886: truncate d1/dd/f18 3041115 0 2023-10-08T08:46:20.549 INFO:tasks.workunit.client.0.smithi070.stdout:9/887: stat d1/dd/d39/dc9/d108/d77/d96/ce4 0 2023-10-08T08:46:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:20 smithi191 ceph-mon[104220]: pgmap v367: 129 pgs: 129 active+clean; 2.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.3 MiB/s wr, 50 op/s 2023-10-08T08:46:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:20 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:20.647 INFO:tasks.workunit.client.0.smithi070.stdout:6/942: sync 2023-10-08T08:46:20.647 INFO:tasks.workunit.client.0.smithi070.stdout:4/949: sync 2023-10-08T08:46:20.647 INFO:tasks.workunit.client.0.smithi070.stdout:9/888: sync 2023-10-08T08:46:20.648 INFO:tasks.workunit.client.0.smithi070.stdout:6/943: mkdir df/d26/d42/d4b/db6/d7d/dc8/d103/d13b 0 2023-10-08T08:46:20.648 INFO:tasks.workunit.client.0.smithi070.stdout:9/889: symlink d1/dd/d19/d97/l10b 0 2023-10-08T08:46:20.648 INFO:tasks.workunit.client.0.smithi070.stdout:9/890: chown d1/dd/d39/d6f 3911721 1 2023-10-08T08:46:20.649 INFO:tasks.workunit.client.0.smithi070.stdout:6/944: mkdir df/d26/d42/d4b/db6/d7d/dc8/d103/dff/d13c 0 2023-10-08T08:46:20.649 INFO:tasks.workunit.client.0.smithi070.stdout:4/950: unlink dc/d17/d1f/d54/c80 0 2023-10-08T08:46:20.649 INFO:tasks.workunit.client.0.smithi070.stdout:4/951: fsync dc/d17/d1f/d5e/f84 0 2023-10-08T08:46:20.650 INFO:tasks.workunit.client.0.smithi070.stdout:9/891: unlink d1/dd/d1a/d40/d76/ff2 0 2023-10-08T08:46:20.650 INFO:tasks.workunit.client.0.smithi070.stdout:6/945: unlink df/d26/d42/d4b/dba/lf8 0 2023-10-08T08:46:20.650 INFO:tasks.workunit.client.0.smithi070.stdout:6/946: readlink df/d26/d42/d43/d4a/l76 0 2023-10-08T08:46:20.651 INFO:tasks.workunit.client.0.smithi070.stdout:6/947: mknod df/d26/d42/d4b/db6/c13d 0 2023-10-08T08:46:20.651 INFO:tasks.workunit.client.0.smithi070.stdout:6/948: fdatasync df/d11/f4d 0 2023-10-08T08:46:20.652 INFO:tasks.workunit.client.0.smithi070.stdout:6/949: dread - df/d26/d42/d4b/db6/d7d/dc8/d103/de0/df9/f132 zero size 2023-10-08T08:46:20.652 INFO:tasks.workunit.client.0.smithi070.stdout:4/952: rename dc/d17/f113 to dc/d17/d79/dad/db6/d127/f13d 0 2023-10-08T08:46:20.652 INFO:tasks.workunit.client.0.smithi070.stdout:6/950: readlink l0 0 2023-10-08T08:46:20.652 INFO:tasks.workunit.client.0.smithi070.stdout:9/892: dread d1/dd/d26/f98 [0,4194304] 0 2023-10-08T08:46:20.653 INFO:tasks.workunit.client.0.smithi070.stdout:9/893: creat d1/dd/d1a/f10c x:0 0 0 2023-10-08T08:46:20.653 INFO:tasks.workunit.client.0.smithi070.stdout:6/951: mkdir df/d26/d42/d4b/d12a/d13e 0 2023-10-08T08:46:20.653 INFO:tasks.workunit.client.0.smithi070.stdout:6/952: fsync df/d26/d42/d43/d4a/d75/d7e/f125 0 2023-10-08T08:46:20.654 INFO:tasks.workunit.client.0.smithi070.stdout:4/953: rmdir dc/d17/d1f/d5e 39 2023-10-08T08:46:20.654 INFO:tasks.workunit.client.0.smithi070.stdout:4/954: truncate dc/d17/d24/d6b/dc7/f11e 486332 0 2023-10-08T08:46:20.654 INFO:tasks.workunit.client.0.smithi070.stdout:9/894: truncate d1/f55 1203885 0 2023-10-08T08:46:20.655 INFO:tasks.workunit.client.0.smithi070.stdout:4/955: truncate dc/d17/dbf/dfb/f115 1344314 0 2023-10-08T08:46:20.655 INFO:tasks.workunit.client.0.smithi070.stdout:6/953: link df/d11/c34 df/c13f 0 2023-10-08T08:46:20.659 INFO:tasks.workunit.client.0.smithi070.stdout:4/956: write dc/d17/d24/d37/f53 [282180,42284] 0 2023-10-08T08:46:20.661 INFO:tasks.workunit.client.0.smithi070.stdout:4/957: creat dc/d17/d24/d4c/f13e x:0 0 0 2023-10-08T08:46:20.661 INFO:tasks.workunit.client.0.smithi070.stdout:6/954: mknod df/d26/d42/d4b/db6/c140 0 2023-10-08T08:46:20.663 INFO:tasks.workunit.client.0.smithi070.stdout:6/955: creat df/d26/d42/d43/d4a/dde/f141 x:0 0 0 2023-10-08T08:46:20.664 INFO:tasks.workunit.client.0.smithi070.stdout:6/956: mkdir df/d26/d42/d43/d4a/d75/d7e/de4/d142 0 2023-10-08T08:46:20.665 INFO:tasks.workunit.client.0.smithi070.stdout:4/958: creat dc/f13f x:0 0 0 2023-10-08T08:46:20.665 INFO:tasks.workunit.client.0.smithi070.stdout:4/959: stat dc/lbc 0 2023-10-08T08:46:20.666 INFO:tasks.workunit.client.0.smithi070.stdout:4/960: chown dc/d17/d24/d4c/d4e/dda/df4/d117/f116 1 1 2023-10-08T08:46:20.666 INFO:tasks.workunit.client.0.smithi070.stdout:9/895: dread d1/dd/d39/dc9/d108/d4f/db9/f95 [0,4194304] 0 2023-10-08T08:46:20.667 INFO:tasks.workunit.client.0.smithi070.stdout:4/961: mkdir dc/d17/d24/d140 0 2023-10-08T08:46:20.667 INFO:tasks.workunit.client.0.smithi070.stdout:9/896: symlink d1/dd/d39/da4/l10d 0 2023-10-08T08:46:20.667 INFO:tasks.workunit.client.0.smithi070.stdout:6/957: mknod df/d26/d42/d43/d4a/d75/c143 0 2023-10-08T08:46:20.667 INFO:tasks.workunit.client.0.smithi070.stdout:6/958: chown df/d26/d42/d4b/db6/d7d/dc8/dfe/c102 487869 1 2023-10-08T08:46:20.669 INFO:tasks.workunit.client.0.smithi070.stdout:6/959: link df/d53/f62 df/d26/f144 0 2023-10-08T08:46:20.669 INFO:tasks.workunit.client.0.smithi070.stdout:6/960: readlink df/d11/l2e 0 2023-10-08T08:46:20.670 INFO:tasks.workunit.client.0.smithi070.stdout:6/961: mknod df/d26/d42/d4b/db6/d7d/dc8/d11c/c145 0 2023-10-08T08:46:20.671 INFO:tasks.workunit.client.0.smithi070.stdout:6/962: readlink lb 0 2023-10-08T08:46:20.671 INFO:tasks.workunit.client.0.smithi070.stdout:6/963: creat df/d71/d123/f146 x:0 0 0 2023-10-08T08:46:20.673 INFO:tasks.workunit.client.0.smithi070.stdout:6/964: creat df/d26/d78/d90/dae/dfd/f147 x:0 0 0 2023-10-08T08:46:20.675 INFO:tasks.workunit.client.0.smithi070.stdout:6/965: rename df/d26/d78/d90/dae/dfd/l104 to df/d26/d42/d43/d4a/d75/d7e/de4/l148 0 2023-10-08T08:46:20.676 INFO:tasks.workunit.client.0.smithi070.stdout:6/966: creat df/d26/d42/d43/d120/f149 x:0 0 0 2023-10-08T08:46:20.677 INFO:tasks.workunit.client.0.smithi070.stdout:6/967: creat df/d26/d42/d4b/db6/d7d/dc8/dfe/f14a x:0 0 0 2023-10-08T08:46:20.678 INFO:tasks.workunit.client.0.smithi070.stdout:6/968: creat df/d26/d42/d4b/f14b x:0 0 0 2023-10-08T08:46:20.679 INFO:tasks.workunit.client.0.smithi070.stdout:6/969: creat df/d26/d78/d90/f14c x:0 0 0 2023-10-08T08:46:20.682 INFO:tasks.workunit.client.0.smithi070.stdout:6/970: symlink df/d26/d78/d90/l14d 0 2023-10-08T08:46:20.684 INFO:tasks.workunit.client.0.smithi070.stdout:6/971: mkdir df/d71/d12e/d14e 0 2023-10-08T08:46:20.684 INFO:tasks.workunit.client.0.smithi070.stdout:6/972: rename df/d26 to df/d26/d78/d90/dae/db3/d14f 22 2023-10-08T08:46:20.684 INFO:tasks.workunit.client.0.smithi070.stdout:6/973: write df/d26/d42/d4b/db6/d7d/dc8/d103/feb [967243,81483] 0 2023-10-08T08:46:20.685 INFO:tasks.workunit.client.0.smithi070.stdout:6/974: truncate df/d26/d42/db1/f9c 1566491 0 2023-10-08T08:46:20.685 INFO:tasks.workunit.client.0.smithi070.stdout:6/975: chown df/d26/l33 6748 1 2023-10-08T08:46:20.685 INFO:tasks.workunit.client.0.smithi070.stdout:6/976: chown df/d26/d78/d90/fb7 3968 1 2023-10-08T08:46:20.685 INFO:tasks.workunit.client.0.smithi070.stdout:6/977: stat l3 0 2023-10-08T08:46:20.688 INFO:tasks.workunit.client.0.smithi070.stdout:9/897: dwrite d1/dd/f87 [0,4194304] 0 2023-10-08T08:46:20.688 INFO:tasks.workunit.client.0.smithi070.stdout:9/898: fdatasync d1/dd/d26/d27/f44 0 2023-10-08T08:46:20.688 INFO:tasks.workunit.client.0.smithi070.stdout:9/899: chown d1/dd/d26/l30 707780 1 2023-10-08T08:46:20.690 INFO:tasks.workunit.client.0.smithi070.stdout:9/900: creat d1/dd/d39/da4/def/f10e x:0 0 0 2023-10-08T08:46:20.691 INFO:tasks.workunit.client.0.smithi070.stdout:9/901: creat d1/dd/d1a/d40/f10f x:0 0 0 2023-10-08T08:46:20.692 INFO:tasks.workunit.client.0.smithi070.stdout:9/902: rmdir d1/dd/d26/d7b 39 2023-10-08T08:46:20.692 INFO:tasks.workunit.client.0.smithi070.stdout:9/903: chown d1/dd/d39/dc9/d108/d77/d96/dd4/cdd 401392 1 2023-10-08T08:46:20.701 INFO:tasks.workunit.client.0.smithi070.stdout:6/978: write df/d26/f84 [113388,91675] 0 2023-10-08T08:46:20.702 INFO:tasks.workunit.client.0.smithi070.stdout:6/979: chown df/d26/d42/d4b/d80/d133 12 1 2023-10-08T08:46:20.703 INFO:tasks.workunit.client.0.smithi070.stdout:6/980: symlink df/d26/d42/d4b/db6/d7d/dc8/d103/dff/d13c/l150 0 2023-10-08T08:46:20.703 INFO:tasks.workunit.client.0.smithi070.stdout:6/981: fdatasync df/d26/d78/d90/fb9 0 2023-10-08T08:46:20.704 INFO:tasks.workunit.client.0.smithi070.stdout:6/982: link df/d26/d78/fb8 df/d26/d42/d4b/db6/d122/f151 0 2023-10-08T08:46:20.704 INFO:tasks.workunit.client.0.smithi070.stdout:6/983: chown df/d26/d42/d43/d4a/d75/d7e/f125 0 1 2023-10-08T08:46:20.704 INFO:tasks.workunit.client.0.smithi070.stdout:6/984: chown df/d26/d42/d4b/db6/c130 318 1 2023-10-08T08:46:20.707 INFO:tasks.workunit.client.0.smithi070.stdout:6/985: dread df/d26/d42/d43/d4a/d97/dc0/df7/f118 [0,4194304] 0 2023-10-08T08:46:20.708 INFO:tasks.workunit.client.0.smithi070.stdout:6/986: symlink df/d53/l152 0 2023-10-08T08:46:20.713 INFO:tasks.workunit.client.0.smithi070.stdout:9/904: dwrite d1/f4b [4194304,4194304] 0 2023-10-08T08:46:20.717 INFO:tasks.workunit.client.0.smithi070.stdout:9/905: write d1/f4b [5999762,121310] 0 2023-10-08T08:46:20.718 INFO:tasks.workunit.client.0.smithi070.stdout:9/906: symlink d1/dd/d39/l110 0 2023-10-08T08:46:20.719 INFO:tasks.workunit.client.0.smithi070.stdout:9/907: rename f0 to d1/dd/d26/d27/df7/dfd/f111 0 2023-10-08T08:46:20.720 INFO:tasks.workunit.client.0.smithi070.stdout:9/908: mknod d1/dd/d1a/d40/d76/d93/dd8/c112 0 2023-10-08T08:46:20.721 INFO:tasks.workunit.client.0.smithi070.stdout:9/909: rmdir d1/dd/d1a/d40/d76/d93/dd0/dd5 39 2023-10-08T08:46:20.733 INFO:tasks.workunit.client.0.smithi070.stdout:6/987: dwrite df/d26/d78/d90/daa/fb0 [0,4194304] 0 2023-10-08T08:46:20.734 INFO:tasks.workunit.client.0.smithi070.stdout:6/988: dread - df/d26/d42/d4b/db6/d7d/faf zero size 2023-10-08T08:46:20.739 INFO:tasks.workunit.client.0.smithi070.stdout:4/962: sync 2023-10-08T08:46:20.743 INFO:tasks.workunit.client.0.smithi070.stdout:9/910: dwrite d1/dd/d1a/d40/f10f [0,4194304] 0 2023-10-08T08:46:20.746 INFO:tasks.workunit.client.0.smithi070.stdout:9/911: rename d1/dd/d39/dc9/d108/d77/fc6 to d1/dd/d39/f113 0 2023-10-08T08:46:20.746 INFO:tasks.workunit.client.0.smithi070.stdout:9/912: stat d1/dd/l2b 0 2023-10-08T08:46:20.749 INFO:tasks.workunit.client.0.smithi070.stdout:9/913: link d1/dd/d39/dc9/d108/d4f/db9/ce8 d1/dd/d26/d27/d2d/c114 0 2023-10-08T08:46:20.749 INFO:tasks.workunit.client.0.smithi070.stdout:9/914: fsync d1/dd/d26/f98 0 2023-10-08T08:46:20.749 INFO:tasks.workunit.client.0.smithi070.stdout:9/915: dread - d1/dd/d26/d27/df7/dfd/fff zero size 2023-10-08T08:46:20.749 INFO:tasks.workunit.client.0.smithi070.stdout:9/916: chown d1/dd/d39/d6f/c89 39300 1 2023-10-08T08:46:20.750 INFO:tasks.workunit.client.0.smithi070.stdout:9/917: creat d1/dd/d8d/f115 x:0 0 0 2023-10-08T08:46:20.752 INFO:tasks.workunit.client.0.smithi070.stdout:6/989: dwrite df/d26/d42/d4b/db6/fa9 [0,4194304] 0 2023-10-08T08:46:20.757 INFO:tasks.workunit.client.0.smithi070.stdout:6/990: write df/d11/f7f [5895325,103769] 0 2023-10-08T08:46:20.759 INFO:tasks.workunit.client.0.smithi070.stdout:6/991: creat df/d26/d42/db1/f153 x:0 0 0 2023-10-08T08:46:20.759 INFO:tasks.workunit.client.0.smithi070.stdout:6/992: chown df/d26/d78/d90 85458108 1 2023-10-08T08:46:20.761 INFO:tasks.workunit.client.0.smithi070.stdout:6/993: fsync df/d26/d42/db1/f153 0 2023-10-08T08:46:20.767 INFO:tasks.workunit.client.0.smithi070.stdout:4/963: dwrite dc/d17/d24/d4c/f9b [0,4194304] 0 2023-10-08T08:46:20.768 INFO:tasks.workunit.client.0.smithi070.stdout:6/994: write df/d11/f65 [1563809,93663] 0 2023-10-08T08:46:20.773 INFO:tasks.workunit.client.0.smithi070.stdout:4/964: write dc/d17/d1f/d5e/f93 [169060,14570] 0 2023-10-08T08:46:20.777 INFO:tasks.workunit.client.0.smithi070.stdout:6/995: write f7 [2566573,106065] 0 2023-10-08T08:46:20.780 INFO:tasks.workunit.client.0.smithi070.stdout:6/996: write df/f61 [1149328,72900] 0 2023-10-08T08:46:20.780 INFO:tasks.workunit.client.0.smithi070.stdout:9/918: dwrite d1/dd/d26/d27/fd1 [0,4194304] 0 2023-10-08T08:46:20.782 INFO:tasks.workunit.client.0.smithi070.stdout:6/997: rename df/d26/d42/d43/d4a/l4c to df/d71/l154 0 2023-10-08T08:46:20.786 INFO:tasks.workunit.client.0.smithi070.stdout:9/919: rmdir d1/dd/d26/d27 39 2023-10-08T08:46:20.786 INFO:tasks.workunit.client.0.smithi070.stdout:9/920: chown d1/dd/d39/f113 112652492 1 2023-10-08T08:46:20.786 INFO:tasks.workunit.client.0.smithi070.stdout:9/921: chown d1/dd/d1a/d40/d76/d93/dd0/dd5/dda 1 1 2023-10-08T08:46:20.787 INFO:tasks.workunit.client.0.smithi070.stdout:9/922: mknod d1/dd/d19/d97/c116 0 2023-10-08T08:46:20.789 INFO:tasks.workunit.client.0.smithi070.stdout:9/923: getdents d1/dd/d1a/d40/d76 0 2023-10-08T08:46:20.789 INFO:tasks.workunit.client.0.smithi070.stdout:9/924: truncate d1/dd/d1a/d40/d76/d93/dd0/fe7 311705 0 2023-10-08T08:46:20.791 INFO:tasks.workunit.client.0.smithi070.stdout:9/925: getdents d1/dd/d19/dbe 0 2023-10-08T08:46:20.791 INFO:tasks.workunit.client.0.smithi070.stdout:9/926: chown d1/dd/d39/d66/d82/c92 186992598 1 2023-10-08T08:46:20.791 INFO:tasks.workunit.client.0.smithi070.stdout:4/965: dwrite dc/d68/feb [0,4194304] 0 2023-10-08T08:46:20.793 INFO:tasks.workunit.client.0.smithi070.stdout:9/927: rename d1/f8b to d1/dd/d39/dc9/d108/d77/f117 0 2023-10-08T08:46:20.795 INFO:tasks.workunit.client.0.smithi070.stdout:9/928: creat d1/dd/d19/f118 x:0 0 0 2023-10-08T08:46:20.796 INFO:tasks.workunit.client.0.smithi070.stdout:9/929: mkdir d1/dd/d26/d27/d2d/d119 0 2023-10-08T08:46:20.797 INFO:tasks.workunit.client.0.smithi070.stdout:9/930: creat d1/dd/d1a/d40/d76/d93/dd0/dd5/dda/f11a x:0 0 0 2023-10-08T08:46:20.799 INFO:tasks.workunit.client.0.smithi070.stdout:9/931: write d1/dd/d39/dc9/d108/d77/f117 [1306670,46944] 0 2023-10-08T08:46:20.801 INFO:tasks.workunit.client.0.smithi070.stdout:9/932: write d1/dd/f87 [2852915,105476] 0 2023-10-08T08:46:20.806 INFO:tasks.workunit.client.0.smithi070.stdout:9/933: dread d1/f55 [0,4194304] 0 2023-10-08T08:46:20.806 INFO:tasks.workunit.client.0.smithi070.stdout:9/934: chown d1/dd/d26/d27/l8e 20169 1 2023-10-08T08:46:20.806 INFO:tasks.workunit.client.0.smithi070.stdout:9/935: stat d1/dd/f61 0 2023-10-08T08:46:20.806 INFO:tasks.workunit.client.0.smithi070.stdout:9/936: chown d1/dd/d1a/d40/d76/d93/l102 24 1 2023-10-08T08:46:20.815 INFO:tasks.workunit.client.0.smithi070.stdout:4/966: dwrite dc/d17/d24/d55/da4/fa7 [0,4194304] 0 2023-10-08T08:46:20.818 INFO:tasks.workunit.client.0.smithi070.stdout:4/967: link dc/d17/d24/d6b/c11f dc/d17/d24/d4c/d4e/dda/c141 0 2023-10-08T08:46:20.819 INFO:tasks.workunit.client.0.smithi070.stdout:9/937: dread d1/dd/d26/d27/d2d/f7e [0,4194304] 0 2023-10-08T08:46:20.820 INFO:tasks.workunit.client.0.smithi070.stdout:6/998: dwrite f9 [0,4194304] 0 2023-10-08T08:46:20.820 INFO:tasks.workunit.client.0.smithi070.stdout:6/999: fdatasync df/d26/d42/d43/fea 0 2023-10-08T08:46:20.820 INFO:tasks.workunit.client.0.smithi070.stdout:4/968: mkdir dc/d17/d24/d4c/d4e/dda/df4/d142 0 2023-10-08T08:46:20.820 INFO:tasks.workunit.client.0.smithi070.stdout:4/969: write dc/d68/f83 [828629,71158] 0 2023-10-08T08:46:20.820 INFO:tasks.workunit.client.0.smithi070.stdout:4/970: write dc/d17/d24/f2f [1791426,111116] 0 2023-10-08T08:46:20.820 INFO:tasks.workunit.client.0.smithi070.stdout:9/938: symlink d1/dd/d19/d99/l11b 0 2023-10-08T08:46:20.821 INFO:tasks.workunit.client.0.smithi070.stdout:4/971: mknod dc/d17/d24/c143 0 2023-10-08T08:46:20.821 INFO:tasks.workunit.client.0.smithi070.stdout:9/939: read d1/dd/d26/d27/d2d/f41 [3201181,16563] 0 2023-10-08T08:46:20.823 INFO:tasks.workunit.client.0.smithi070.stdout:9/940: symlink d1/dd/d19/d99/l11c 0 2023-10-08T08:46:20.823 INFO:tasks.workunit.client.0.smithi070.stdout:9/941: chown d1/dd/d39/d66/df5 0 1 2023-10-08T08:46:20.824 INFO:tasks.workunit.client.0.smithi070.stdout:9/942: mkdir d1/dd/d26/d27/d2d/d70/d90/dab/d11d 0 2023-10-08T08:46:20.825 INFO:tasks.workunit.client.0.smithi070.stdout:9/943: creat d1/dd/d39/dc9/d108/d4f/db9/f11e x:0 0 0 2023-10-08T08:46:20.826 INFO:tasks.workunit.client.0.smithi070.stdout:9/944: mknod d1/dd/d39/dc9/d108/d4f/c11f 0 2023-10-08T08:46:20.827 INFO:tasks.workunit.client.0.smithi070.stdout:9/945: write d1/dd/d39/dc9/d108/d77/f117 [3896434,82891] 0 2023-10-08T08:46:20.830 INFO:tasks.workunit.client.0.smithi070.stdout:4/972: dread dc/d17/d24/d37/f3b [0,4194304] 0 2023-10-08T08:46:20.831 INFO:tasks.workunit.client.0.smithi070.stdout:4/973: read dc/d17/d24/d55/ff5 [163590,5261] 0 2023-10-08T08:46:20.844 INFO:tasks.workunit.client.0.smithi070.stdout:9/946: dread d1/dd/d26/d27/d2d/f7e [0,4194304] 0 2023-10-08T08:46:20.857 INFO:tasks.workunit.client.0.smithi070.stdout:4/974: dwrite dc/d17/d24/d4c/f60 [0,4194304] 0 2023-10-08T08:46:20.860 INFO:tasks.workunit.client.0.smithi070.stdout:9/947: dread d1/dd/d1a/fea [0,4194304] 0 2023-10-08T08:46:20.882 INFO:tasks.workunit.client.0.smithi070.stdout:9/948: dwrite d1/dd/d26/d27/df7/dfd/f111 [0,4194304] 0 2023-10-08T08:46:20.882 INFO:tasks.workunit.client.0.smithi070.stdout:4/975: dwrite dc/d17/f21 [0,4194304] 0 2023-10-08T08:46:20.883 INFO:tasks.workunit.client.0.smithi070.stdout:9/949: mknod d1/dd/d26/d27/c120 0 2023-10-08T08:46:20.884 INFO:tasks.workunit.client.0.smithi070.stdout:4/976: mknod dc/d68/d110/c144 0 2023-10-08T08:46:20.884 INFO:tasks.workunit.client.0.smithi070.stdout:4/977: chown dc/d17/d24/d4c/df9/f12e 194 1 2023-10-08T08:46:20.885 INFO:tasks.workunit.client.0.smithi070.stdout:9/950: unlink d1/dd/d26/d27/lb5 0 2023-10-08T08:46:20.885 INFO:tasks.workunit.client.0.smithi070.stdout:9/951: chown d1/dd/d39/dc9/d108/d77/d96/ce4 0 1 2023-10-08T08:46:20.885 INFO:tasks.workunit.client.0.smithi070.stdout:4/978: mkdir dc/d17/d79/dad/db6/d145 0 2023-10-08T08:46:20.887 INFO:tasks.workunit.client.0.smithi070.stdout:4/979: symlink dc/d17/d24/d4c/d4e/dab/dff/l146 0 2023-10-08T08:46:20.888 INFO:tasks.workunit.client.0.smithi070.stdout:4/980: symlink dc/d17/d24/d4c/df9/l147 0 2023-10-08T08:46:20.889 INFO:tasks.workunit.client.0.smithi070.stdout:9/952: getdents d1/dd/d26/d27/d2d 0 2023-10-08T08:46:20.891 INFO:tasks.workunit.client.0.smithi070.stdout:9/953: symlink d1/dd/d1a/d40/d76/d93/dd0/dd5/l121 0 2023-10-08T08:46:20.896 INFO:tasks.workunit.client.0.smithi070.stdout:9/954: getdents d1/dd/d39/da4/def 0 2023-10-08T08:46:20.912 INFO:tasks.workunit.client.0.smithi070.stdout:4/981: dwrite dc/d68/f83 [0,4194304] 0 2023-10-08T08:46:20.912 INFO:tasks.workunit.client.0.smithi070.stdout:4/982: chown dc/d17/d24/d4c/f60 6642276 1 2023-10-08T08:46:20.912 INFO:tasks.workunit.client.0.smithi070.stdout:9/955: dread d1/dd/d39/dc9/d108/f42 [0,4194304] 0 2023-10-08T08:46:20.912 INFO:tasks.workunit.client.0.smithi070.stdout:9/956: mknod d1/dd/d26/c122 0 2023-10-08T08:46:20.913 INFO:tasks.workunit.client.0.smithi070.stdout:9/957: mknod d1/dd/d39/dc9/c123 0 2023-10-08T08:46:20.914 INFO:tasks.workunit.client.0.smithi070.stdout:4/983: creat dc/d17/d24/d4c/d4e/dda/df4/d117/f148 x:0 0 0 2023-10-08T08:46:20.914 INFO:tasks.workunit.client.0.smithi070.stdout:9/958: symlink d1/dd/d39/d66/df5/l124 0 2023-10-08T08:46:20.915 INFO:tasks.workunit.client.0.smithi070.stdout:4/984: mkdir dc/d17/d24/d4c/d149 0 2023-10-08T08:46:20.915 INFO:tasks.workunit.client.0.smithi070.stdout:9/959: mkdir d1/dd/d8d/d125 0 2023-10-08T08:46:20.915 INFO:tasks.workunit.client.0.smithi070.stdout:9/960: stat d1/dd/d39/d6f/fe3 0 2023-10-08T08:46:20.916 INFO:tasks.workunit.client.0.smithi070.stdout:4/985: mkdir dc/d17/d79/dad/db6/d127/d14a 0 2023-10-08T08:46:20.919 INFO:tasks.workunit.client.0.smithi070.stdout:9/961: dread d1/dd/d26/f8a [0,4194304] 0 2023-10-08T08:46:20.919 INFO:tasks.workunit.client.0.smithi070.stdout:4/986: rename dc/d17/d24/d4c/d4e/dda/df4/d117/f116 to dc/d17/d24/f14b 0 2023-10-08T08:46:20.922 INFO:tasks.workunit.client.0.smithi070.stdout:9/962: rename d1/dd/d39/d66/df5/l124 to d1/dd/d1a/d40/d76/d93/l126 0 2023-10-08T08:46:20.922 INFO:tasks.workunit.client.0.smithi070.stdout:4/987: dread dc/d17/d24/d4c/d4e/f108 [0,4194304] 0 2023-10-08T08:46:20.922 INFO:tasks.workunit.client.0.smithi070.stdout:9/963: truncate d1/dd/f61 1311874 0 2023-10-08T08:46:20.922 INFO:tasks.workunit.client.0.smithi070.stdout:9/964: creat d1/dd/d26/f127 x:0 0 0 2023-10-08T08:46:20.924 INFO:tasks.workunit.client.0.smithi070.stdout:9/965: truncate d1/dd/d8d/fad 751366 0 2023-10-08T08:46:20.930 INFO:tasks.workunit.client.0.smithi070.stdout:4/988: rmdir dc/d17/d24 39 2023-10-08T08:46:20.933 INFO:tasks.workunit.client.0.smithi070.stdout:4/989: rename dc/d17/d24/d4c/d4e/fbd to dc/d17/f14c 0 2023-10-08T08:46:20.933 INFO:tasks.workunit.client.0.smithi070.stdout:4/990: fsync dc/d17/d24/d4c/d4e/f108 0 2023-10-08T08:46:20.939 INFO:tasks.workunit.client.0.smithi070.stdout:9/966: read d1/dd/f61 [963426,57542] 0 2023-10-08T08:46:20.939 INFO:tasks.workunit.client.0.smithi070.stdout:9/967: write d1/dd/d39/fc2 [230302,80604] 0 2023-10-08T08:46:20.967 INFO:tasks.workunit.client.0.smithi070.stdout:4/991: dwrite dc/d17/d24/d55/da4/f10c [0,4194304] 0 2023-10-08T08:46:20.967 INFO:tasks.workunit.client.0.smithi070.stdout:9/968: dwrite d1/dd/d39/dc9/d108/d4f/db9/f95 [4194304,4194304] 0 2023-10-08T08:46:20.967 INFO:tasks.workunit.client.0.smithi070.stdout:9/969: stat d1/dd/d26/d27/c120 0 2023-10-08T08:46:20.967 INFO:tasks.workunit.client.0.smithi070.stdout:9/970: truncate d1/dd/d39/da4/dc3/f109 2063598 0 2023-10-08T08:46:20.973 INFO:tasks.workunit.client.0.smithi070.stdout:9/971: dread d1/dd/d39/dc9/d108/f42 [4194304,4194304] 0 2023-10-08T08:46:20.974 INFO:tasks.workunit.client.0.smithi070.stdout:9/972: unlink d1/dd/d1a/c6a 0 2023-10-08T08:46:20.976 INFO:tasks.workunit.client.0.smithi070.stdout:9/973: mkdir d1/dd/d39/dc9/d108/d77/d96/dd4/d128 0 2023-10-08T08:46:20.977 INFO:tasks.workunit.client.0.smithi070.stdout:4/992: dread dc/d17/d1f/d54/f67 [0,4194304] 0 2023-10-08T08:46:20.980 INFO:tasks.workunit.client.0.smithi070.stdout:4/993: creat dc/d17/d24/d6b/f14d x:0 0 0 2023-10-08T08:46:20.982 INFO:tasks.workunit.client.0.smithi070.stdout:9/974: truncate d1/dd/d39/dc9/d108/d4f/db9/f95 4906823 0 2023-10-08T08:46:20.982 INFO:tasks.workunit.client.0.smithi070.stdout:9/975: write d1/dd/d19/d97/fd9 [271135,6903] 0 2023-10-08T08:46:20.982 INFO:tasks.workunit.client.0.smithi070.stdout:9/976: chown d1/dd/d39 4 1 2023-10-08T08:46:20.982 INFO:tasks.workunit.client.0.smithi070.stdout:9/977: chown d1/dd/d26/d27/d2d/d70/d90/dab/fc5 13651979 1 2023-10-08T08:46:20.982 INFO:tasks.workunit.client.0.smithi070.stdout:4/994: creat dc/d5a/f14e x:0 0 0 2023-10-08T08:46:20.983 INFO:tasks.workunit.client.0.smithi070.stdout:4/995: mknod dc/d17/d1f/d5e/dd0/c14f 0 2023-10-08T08:46:20.983 INFO:tasks.workunit.client.0.smithi070.stdout:4/996: readlink dc/d17/d24/d4c/d4e/l56 0 2023-10-08T08:46:20.984 INFO:tasks.workunit.client.0.smithi070.stdout:4/997: write dc/d68/d110/d12c/f10f [316287,44687] 0 2023-10-08T08:46:20.984 INFO:tasks.workunit.client.0.smithi070.stdout:9/978: rename d1/dd/d19/f1b to d1/dd/d26/d27/d2d/f129 0 2023-10-08T08:46:20.984 INFO:tasks.workunit.client.0.smithi070.stdout:4/998: symlink dc/d17/d24/d4c/df9/l150 0 2023-10-08T08:46:20.984 INFO:tasks.workunit.client.0.smithi070.stdout:4/999: fsync dc/d17/d1f/ff2 0 2023-10-08T08:46:20.991 INFO:tasks.workunit.client.0.smithi070.stdout:9/979: truncate d1/dd/d26/d27/df7/dfd/f111 998250 0 2023-10-08T08:46:20.991 INFO:tasks.workunit.client.0.smithi070.stdout:9/980: write d1/dd/d19/f118 [347762,60001] 0 2023-10-08T08:46:20.992 INFO:tasks.workunit.client.0.smithi070.stdout:9/981: creat d1/dd/d39/da4/f12a x:0 0 0 2023-10-08T08:46:20.992 INFO:tasks.workunit.client.0.smithi070.stdout:9/982: write d1/dd/d8d/f115 [756636,125590] 0 2023-10-08T08:46:20.996 INFO:tasks.workunit.client.0.smithi070.stdout:9/983: truncate d1/dd/d8d/f115 154781 0 2023-10-08T08:46:21.018 INFO:tasks.workunit.client.0.smithi070.stdout:9/984: dwrite d1/dd/d26/d27/d2d/d70/d90/dab/fc5 [4194304,4194304] 0 2023-10-08T08:46:21.018 INFO:tasks.workunit.client.0.smithi070.stdout:9/985: chown d1/dd/d26/d27/d2d/feb 19351451 1 2023-10-08T08:46:21.020 INFO:tasks.workunit.client.0.smithi070.stdout:9/986: unlink d1/dd/d19/c68 0 2023-10-08T08:46:21.037 INFO:tasks.workunit.client.0.smithi070.stdout:9/987: dwrite d1/dd/d39/da4/dc3/fe5 [0,4194304] 0 2023-10-08T08:46:21.055 INFO:tasks.workunit.client.0.smithi070.stdout:9/988: dwrite d1/dd/d26/d27/d2d/d70/d90/dab/fb6 [0,4194304] 0 2023-10-08T08:46:21.057 INFO:tasks.workunit.client.0.smithi070.stdout:9/989: creat d1/dd/d39/dc9/d108/d77/d96/dd4/d128/f12b x:0 0 0 2023-10-08T08:46:21.058 INFO:tasks.workunit.client.0.smithi070.stdout:9/990: rmdir d1/dd/d39/dc9 39 2023-10-08T08:46:21.078 INFO:tasks.workunit.client.0.smithi070.stdout:9/991: dwrite d1/dd/d19/fc8 [0,4194304] 0 2023-10-08T08:46:21.096 INFO:tasks.workunit.client.0.smithi070.stdout:9/992: dwrite d1/dd/f10 [0,4194304] 0 2023-10-08T08:46:21.099 INFO:tasks.workunit.client.0.smithi070.stdout:9/993: rmdir d1/dd/d39/da4 39 2023-10-08T08:46:21.101 INFO:tasks.workunit.client.0.smithi070.stdout:9/994: creat d1/dd/d8d/d125/f12c x:0 0 0 2023-10-08T08:46:21.102 INFO:tasks.workunit.client.0.smithi070.stdout:9/995: symlink d1/dd/d39/dc9/d108/d77/d96/l12d 0 2023-10-08T08:46:21.103 INFO:tasks.workunit.client.0.smithi070.stdout:9/996: chown d1/dd/d8d/fad 1273105 1 2023-10-08T08:46:21.103 INFO:tasks.workunit.client.0.smithi070.stdout:9/997: chown d1/dd/d1a/l37 687298 1 2023-10-08T08:46:21.103 INFO:tasks.workunit.client.0.smithi070.stdout:9/998: creat d1/dd/d26/f12e x:0 0 0 2023-10-08T08:46:21.254 INFO:tasks.workunit.client.0.smithi070.stdout:9/999: sync 2023-10-08T08:46:21.258 INFO:tasks.workunit.client.0.smithi070.stderr:+ rm -rf -- ./tmp.d0CxhQbRKL 2023-10-08T08:46:22.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:22 smithi070 ceph-mon[99513]: pgmap v368: 129 pgs: 129 active+clean; 2.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.7 MiB/s wr, 47 op/s 2023-10-08T08:46:22.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:22 smithi105 ceph-mon[103798]: pgmap v368: 129 pgs: 129 active+clean; 2.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.7 MiB/s wr, 47 op/s 2023-10-08T08:46:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:22 smithi191 ceph-mon[104220]: pgmap v368: 129 pgs: 129 active+clean; 2.3 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.7 MiB/s wr, 47 op/s 2023-10-08T08:46:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.772+0000 7f51722e2700 1 -- 172.21.15.70:0/2020718998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1066f0 msgr2=0x7f516c106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.772+0000 7f51722e2700 1 --2- 172.21.15.70:0/2020718998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1066f0 0x7f516c106ad0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f515c009990 tx=0x7f515c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.772+0000 7f51722e2700 1 -- 172.21.15.70:0/2020718998 shutdown_connections 2023-10-08T08:46:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.772+0000 7f51722e2700 1 --2- 172.21.15.70:0/2020718998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f516c1010a0 0x7f516c10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.772+0000 7f51722e2700 1 --2- 172.21.15.70:0/2020718998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1066f0 0x7f516c106ad0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.772+0000 7f51722e2700 1 --2- 172.21.15.70:0/2020718998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f516c1006e0 0x7f516c100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.772+0000 7f51722e2700 1 -- 172.21.15.70:0/2020718998 >> 172.21.15.70:0/2020718998 conn(0x7f516c0fc1f0 msgr2=0x7f516c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.772+0000 7f51722e2700 1 -- 172.21.15.70:0/2020718998 shutdown_connections 2023-10-08T08:46:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.772+0000 7f51722e2700 1 -- 172.21.15.70:0/2020718998 wait complete. 2023-10-08T08:46:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.773+0000 7f51722e2700 1 Processor -- start 2023-10-08T08:46:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.773+0000 7f51722e2700 1 -- start start 2023-10-08T08:46:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.773+0000 7f51722e2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f516c1006e0 0x7f516c19c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.773+0000 7f51722e2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1010a0 0x7f516c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.773+0000 7f51722e2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f516c1066f0 0x7f516c196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.773+0000 7f51722e2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c196fc0 con 0x7f516c1010a0 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.773+0000 7f51722e2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c197130 con 0x7f516c1006e0 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.773+0000 7f51722e2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c1972f0 con 0x7f516c1066f0 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1010a0 0x7f516c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1010a0 0x7f516c19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52876/0 (socket says 172.21.15.70:52876) 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516b7fe700 1 -- 172.21.15.70:0/2754359825 learned_addr learned my addr 172.21.15.70:0/2754359825 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516bfff700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f516c1006e0 0x7f516c19c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f517087f700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f516c1066f0 0x7f516c196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516b7fe700 1 -- 172.21.15.70:0/2754359825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f516c1066f0 msgr2=0x7f516c196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516b7fe700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f516c1066f0 0x7f516c196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516b7fe700 1 -- 172.21.15.70:0/2754359825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f516c1006e0 msgr2=0x7f516c19c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516b7fe700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f516c1006e0 0x7f516c19c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516b7fe700 1 -- 172.21.15.70:0/2754359825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c0095f0 con 0x7f516c1010a0 2023-10-08T08:46:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f516b7fe700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1010a0 0x7f516c19cd70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f516000e9a0 tx=0x7f516000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f51697fa700 1 -- 172.21.15.70:0/2754359825 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160009790 con 0x7f516c1010a0 2023-10-08T08:46:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f51697fa700 1 -- 172.21.15.70:0/2754359825 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5160010430 con 0x7f516c1010a0 2023-10-08T08:46:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f51722e2700 1 -- 172.21.15.70:0/2754359825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c1975d0 con 0x7f516c1010a0 2023-10-08T08:46:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f51697fa700 1 -- 172.21.15.70:0/2754359825 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160018680 con 0x7f516c1010a0 2023-10-08T08:46:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.774+0000 7f51722e2700 1 -- 172.21.15.70:0/2754359825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c1a3820 con 0x7f516c1010a0 2023-10-08T08:46:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.776+0000 7f51697fa700 1 -- 172.21.15.70:0/2754359825 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f51600105a0 con 0x7f516c1010a0 2023-10-08T08:46:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.777+0000 7f51697fa700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f51540a1670 0x7f51540a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.777+0000 7f516bfff700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f51540a1670 0x7f51540a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.777+0000 7f51697fa700 1 -- 172.21.15.70:0/2754359825 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5160014070 con 0x7f516c1010a0 2023-10-08T08:46:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.777+0000 7f516bfff700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f51540a1670 0x7f51540a3b30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f515c00b2e0 tx=0x7f515c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.777+0000 7f517e4cbb80 1 Processor -- start 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f517e4cbb80 1 -- start start 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x560237477b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 0x560237478510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602373e0400 con 0x56023747e1a0 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602373d1bc0 con 0x56023747d880 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602373cf4e0 con 0x5602374780b0 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f516b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x560237477b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f516b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x560237477b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52882/0 (socket says 172.21.15.70:52882) 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f516bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f516b7fe700 1 -- 172.21.15.70:0/548329377 learned_addr learned my addr 172.21.15.70:0/548329377 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f517087f700 1 --2- 172.21.15.70:0/548329377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 0x560237478510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f516b7fe700 1 -- 172.21.15.70:0/548329377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 msgr2=0x560237478510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f516b7fe700 1 --2- 172.21.15.70:0/548329377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 0x560237478510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f516b7fe700 1 -- 172.21.15.70:0/548329377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 msgr2=0x56023747dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f516b7fe700 1 --2- 172.21.15.70:0/548329377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.778+0000 7f516b7fe700 1 -- 172.21.15.70:0/548329377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602371f5d80 con 0x56023747e1a0 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f516b7fe700 1 --2- 172.21.15.70:0/548329377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x560237477b70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5160096d10 tx=0x7f5160099f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e98c0c502cdef93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f51527fc700 1 -- 172.21.15.70:0/548329377 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51600b1070 con 0x56023747e1a0 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f51527fc700 1 -- 172.21.15.70:0/548329377 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f516009e3f0 con 0x56023747e1a0 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f51527fc700 1 -- 172.21.15.70:0/548329377 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51600109f0 con 0x56023747e1a0 2023-10-08T08:46:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f517e4cbb80 1 -- 172.21.15.70:0/548329377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 msgr2=0x560237477b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/548329377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x560237477b70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5160096d10 tx=0x7f5160099f10 comp rx=0 tx=0).stop 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f517e4cbb80 1 -- 172.21.15.70:0/548329377 shutdown_connections 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/548329377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 0x560237478510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/548329377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/548329377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x560237477b70 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f517e4cbb80 1 -- 172.21.15.70:0/548329377 >> 172.21.15.70:0/548329377 conn(0x5602373ec200 msgr2=0x560237472b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f517e4cbb80 1 -- 172.21.15.70:0/548329377 shutdown_connections 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.779+0000 7f517e4cbb80 1 -- 172.21.15.70:0/548329377 wait complete. 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517e4cbb80 1 -- start start 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517e4cbb80 1 Processor -- start 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237484180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x560237481470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 0x560237481bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602373cadd0 con 0x5602374780b0 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602373676b0 con 0x56023747d880 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560237367350 con 0x56023747e1a0 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517e4cbb80 10 client.0 _ll_register_callbacks cb 0x5602371c47a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f516bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237484180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f517087f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 0x560237481bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f516b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x560237481470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f516bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237484180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52886/0 (socket says 172.21.15.70:52886) 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.780+0000 7f516bfff700 1 -- 172.21.15.70:0/2192653012 learned_addr learned my addr 172.21.15.70:0/2192653012 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f516bfff700 1 -- 172.21.15.70:0/2192653012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 msgr2=0x560237481bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f516bfff700 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 0x560237481bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f516bfff700 1 -- 172.21.15.70:0/2192653012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 msgr2=0x560237481470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f516bfff700 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x560237481470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f516bfff700 1 -- 172.21.15.70:0/2192653012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c1a3820 con 0x5602374780b0 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f516bfff700 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237484180 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f515c009990 tx=0x7f515c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c77c1a622e85cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f514b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f514b7fe700 1 -- 172.21.15.70:0/2192653012 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00be80 con 0x5602374780b0 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f514b7fe700 1 -- 172.21.15.70:0/2192653012 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f515c004e50 con 0x5602374780b0 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2192653012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560237392e50 con 0x5602374780b0 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f514b7fe700 1 -- 172.21.15.70:0/2192653012 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f515c00f460 con 0x5602374780b0 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f517e4cbb80 10 client.16479 fetch_fsmap learned FSMap version 35 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2192653012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5602371dec00 con 0x5602374780b0 2023-10-08T08:46:22.790 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f514b7fe700 1 -- 172.21.15.70:0/2192653012 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560237392e50 con 0x5602374780b0 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.781+0000 7f514b7fe700 1 -- 172.21.15.70:0/2192653012 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f515c02f070 con 0x5602374780b0 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.782+0000 7f517e4cbb80 10 client.16479 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.782+0000 7f517e4cbb80 10 client.16479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.782+0000 7f517e4cbb80 20 client.16479 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.782+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560237491d90 0x5602374941b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.782+0000 7f517e4cbb80 4 client.16479 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.782+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2192653012 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602373c3db0 con 0x560237491d90 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.782+0000 7f516b7fe700 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560237491d90 0x5602374941b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.782+0000 7f514b7fe700 10 client.16479 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.782+0000 7f516b7fe700 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560237491d90 0x5602374941b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e08c7618cc6b0f server_cookie=c0660055cfab2f0e in_seq=0 out_seq=0 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f514b7fe700 1 -- 172.21.15.70:0/2192653012 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5602373c3db0 con 0x560237491d90 2023-10-08T08:46:22.791 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f514b7fe700 10 client.16479 handle_command_reply: tid=0 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 client.16479 shutdown 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2192653012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 msgr2=0x560237484180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237484180 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f515c009990 tx=0x7f515c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2192653012 shutdown_connections 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 0x560237481bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237484180 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x560237491d90 0x5602374941b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2192653012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x560237481470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f514b7fe700 0 client.16479 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2192653012 >> 172.21.15.70:0/2192653012 conn(0x5602373ec200 msgr2=0x560237472010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2192653012 shutdown_connections 2023-10-08T08:46:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2192653012 wait complete. 2023-10-08T08:46:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.783+0000 7f517e4cbb80 20 client.16479 trim_cache size 0 max 16384 2023-10-08T08:46:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f517e4cbb80 1 Processor -- start 2023-10-08T08:46:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f517e4cbb80 1 -- start start 2023-10-08T08:46:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237477b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x560237472790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 0x560237472cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023724b8c0 con 0x5602374780b0 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023748e740 con 0x56023747d880 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023746a6a0 con 0x56023747e1a0 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237477b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x560237472790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237477b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52894/0 (socket says 172.21.15.70:52894) 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516bfff700 1 -- 172.21.15.70:0/81855289 learned_addr learned my addr 172.21.15.70:0/81855289 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f517087f700 1 --2- 172.21.15.70:0/81855289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 0x560237472cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516bfff700 1 -- 172.21.15.70:0/81855289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 msgr2=0x560237472cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516bfff700 1 --2- 172.21.15.70:0/81855289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 0x560237472cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516bfff700 1 -- 172.21.15.70:0/81855289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 msgr2=0x560237472790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516bfff700 1 --2- 172.21.15.70:0/81855289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x560237472790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516bfff700 1 -- 172.21.15.70:0/81855289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56023721c1f0 con 0x5602374780b0 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516b7fe700 1 --2- 172.21.15.70:0/81855289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x560237472790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.798+0000 7f516bfff700 1 --2- 172.21.15.70:0/81855289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237477b70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f515c006010 tx=0x7f515c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2eb6f9ed22fb7be server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f5152ffd700 1 -- 172.21.15.70:0/81855289 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c004e50 con 0x5602374780b0 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f5152ffd700 1 -- 172.21.15.70:0/81855289 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f515c028040 con 0x5602374780b0 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f5152ffd700 1 -- 172.21.15.70:0/81855289 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00fa50 con 0x5602374780b0 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f517e4cbb80 1 -- 172.21.15.70:0/81855289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 msgr2=0x560237477b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/81855289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237477b70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f515c006010 tx=0x7f515c005a50 comp rx=0 tx=0).stop 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f517e4cbb80 1 -- 172.21.15.70:0/81855289 shutdown_connections 2023-10-08T08:46:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/81855289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56023747e1a0 0x560237472cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/81855289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5602374780b0 0x560237477b70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/81855289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x560237472790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f517e4cbb80 1 -- 172.21.15.70:0/81855289 >> 172.21.15.70:0/81855289 conn(0x5602373ec200 msgr2=0x560237478490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f517e4cbb80 1 -- 172.21.15.70:0/81855289 shutdown_connections 2023-10-08T08:46:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.799+0000 7f517e4cbb80 1 -- 172.21.15.70:0/81855289 wait complete. 2023-10-08T08:46:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517e4cbb80 1 -- start start 2023-10-08T08:46:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517e4cbb80 1 Processor -- start 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 0x56023747a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517e4cbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x5602374792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023747ae30 con 0x56023747e1a0 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023747afa0 con 0x56023747d880 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517e4cbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023747b160 con 0x5602374780b0 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517e4cbb80 10 client.0 _ll_register_callbacks cb 0x7f515c00ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517087f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x5602374792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f516b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f516bfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 0x56023747a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f516b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40360/0 (socket says 172.21.15.70:40360) 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517087f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x5602374792c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52904/0 (socket says 172.21.15.70:52904) 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f516b7fe700 1 -- 172.21.15.70:0/2615129703 learned_addr learned my addr 172.21.15.70:0/2615129703 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f516b7fe700 1 -- 172.21.15.70:0/2615129703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 msgr2=0x56023747a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f516b7fe700 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 0x56023747a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f516b7fe700 1 -- 172.21.15.70:0/2615129703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 msgr2=0x5602374792c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f516b7fe700 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x5602374792c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f516b7fe700 1 -- 172.21.15.70:0/2615129703 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602371f5d80 con 0x56023747d880 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.800+0000 7f517087f700 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x5602374792c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f516b7fe700 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747a8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f516000e970 tx=0x7f5160010c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa341edfdf0a56e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f514b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f514b7fe700 1 -- 172.21.15.70:0/2615129703 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51600b1040 con 0x56023747d880 2023-10-08T08:46:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2615129703 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f516009e3f0 con 0x56023747d880 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f514b7fe700 1 -- 172.21.15.70:0/2615129703 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5160010880 con 0x56023747d880 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f514b7fe700 1 -- 172.21.15.70:0/2615129703 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f516009a070 con 0x56023747d880 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f517e4cbb80 10 client.25901 fetch_fsmap learned FSMap version 35 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2615129703 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5602371dec00 con 0x56023747d880 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f514b7fe700 1 -- 172.21.15.70:0/2615129703 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f516009e3f0 con 0x56023747d880 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f514b7fe700 1 -- 172.21.15.70:0/2615129703 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f516009a500 con 0x56023747d880 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f517e4cbb80 10 client.25901 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f517e4cbb80 10 client.25901 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f517e4cbb80 20 client.25901 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5602374e6660 0x5602374e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f517e4cbb80 4 client.25901 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:46:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.801+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2615129703 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5602373c3ad0 con 0x5602374e6660 2023-10-08T08:46:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.802+0000 7f516bfff700 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5602374e6660 0x5602374e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.802+0000 7f514b7fe700 10 client.25901 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:22.802+0000 7f516bfff700 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5602374e6660 0x5602374e8a80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb19fb2361088fdf server_cookie=20c5309e60e18c95 in_seq=0 out_seq=0 2023-10-08T08:46:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.114+0000 7f514b7fe700 1 -- 172.21.15.70:0/2615129703 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5602373c3ad0 con 0x5602374e6660 2023-10-08T08:46:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.114+0000 7f514b7fe700 10 client.25901 handle_command_reply: tid=0 2023-10-08T08:46:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.114+0000 7f517e4cbb80 1 client.25901 shutdown 2023-10-08T08:46:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.114+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2615129703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 msgr2=0x56023747a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.114+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747a8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f516000e970 tx=0x7f5160010c80 comp rx=0 tx=0).stop 2023-10-08T08:46:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2615129703 shutdown_connections 2023-10-08T08:46:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56023747e1a0 0x5602374792c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602374780b0 0x56023747a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5602374e6660 0x5602374e8a80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f517e4cbb80 1 --2- 172.21.15.70:0/2615129703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56023747d880 0x56023747a8f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f514b7fe700 0 client.25901 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2615129703 >> 172.21.15.70:0/2615129703 conn(0x5602373ec200 msgr2=0x56023747fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2615129703 shutdown_connections 2023-10-08T08:46:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f517e4cbb80 1 -- 172.21.15.70:0/2615129703 wait complete. 2023-10-08T08:46:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f517e4cbb80 20 client.25901 trim_cache size 0 max 16384 2023-10-08T08:46:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:46:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:46:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:46:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 -- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f51540a1670 msgr2=0x7f51540a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f51540a1670 0x7f51540a3b30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f515c00b2e0 tx=0x7f515c005960 comp rx=0 tx=0).stop 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 -- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1010a0 msgr2=0x7f516c19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1010a0 0x7f516c19cd70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f516000e9a0 tx=0x7f516000ecb0 comp rx=0 tx=0).stop 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 -- 172.21.15.70:0/2754359825 shutdown_connections 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f51540a1670 0x7f51540a3b30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f516c1066f0 0x7f516c196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f516c1006e0 0x7f516c19c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 --2- 172.21.15.70:0/2754359825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f516c1010a0 0x7f516c19cd70 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 -- 172.21.15.70:0/2754359825 >> 172.21.15.70:0/2754359825 conn(0x7f516c0fc1f0 msgr2=0x7f516c0fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 -- 172.21.15.70:0/2754359825 shutdown_connections 2023-10-08T08:46:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:23.115+0000 7f51722e2700 1 -- 172.21.15.70:0/2754359825 wait complete. 2023-10-08T08:46:24.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:24 smithi070 ceph-mon[99513]: pgmap v369: 129 pgs: 129 active+clean; 2.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.4 MiB/s wr, 36 op/s 2023-10-08T08:46:24.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:24 smithi105 ceph-mon[103798]: pgmap v369: 129 pgs: 129 active+clean; 2.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.4 MiB/s wr, 36 op/s 2023-10-08T08:46:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:24 smithi191 ceph-mon[104220]: pgmap v369: 129 pgs: 129 active+clean; 2.3 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.4 MiB/s wr, 36 op/s 2023-10-08T08:46:25.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:25 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:25.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:25 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:25.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:25 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:26.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:26 smithi070 ceph-mon[99513]: pgmap v370: 129 pgs: 129 active+clean; 2.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 127 op/s 2023-10-08T08:46:26.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:26 smithi105 ceph-mon[103798]: pgmap v370: 129 pgs: 129 active+clean; 2.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 127 op/s 2023-10-08T08:46:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:26 smithi191 ceph-mon[104220]: pgmap v370: 129 pgs: 129 active+clean; 2.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 127 op/s 2023-10-08T08:46:28.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:28 smithi070 ceph-mon[99513]: pgmap v371: 129 pgs: 129 active+clean; 2.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 16 MiB/s wr, 229 op/s 2023-10-08T08:46:28.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:28 smithi105 ceph-mon[103798]: pgmap v371: 129 pgs: 129 active+clean; 2.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 16 MiB/s wr, 229 op/s 2023-10-08T08:46:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:28 smithi191 ceph-mon[104220]: pgmap v371: 129 pgs: 129 active+clean; 2.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 16 MiB/s wr, 229 op/s 2023-10-08T08:46:30.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:30 smithi070 ceph-mon[99513]: pgmap v372: 129 pgs: 129 active+clean; 2.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 16 MiB/s wr, 271 op/s 2023-10-08T08:46:30.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:30 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:30 smithi105 ceph-mon[103798]: pgmap v372: 129 pgs: 129 active+clean; 2.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 16 MiB/s wr, 271 op/s 2023-10-08T08:46:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:30 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:30 smithi191 ceph-mon[104220]: pgmap v372: 129 pgs: 129 active+clean; 2.3 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 16 MiB/s wr, 271 op/s 2023-10-08T08:46:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:30 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:31.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:31 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:46:31.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:31 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:46:31.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:31 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:46:32.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:32 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:46:32.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:32 smithi070 ceph-mon[99513]: pgmap v373: 129 pgs: 129 active+clean; 2.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 16 MiB/s wr, 320 op/s 2023-10-08T08:46:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:32 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:46:32.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:32 smithi105 ceph-mon[103798]: pgmap v373: 129 pgs: 129 active+clean; 2.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 16 MiB/s wr, 320 op/s 2023-10-08T08:46:32.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:46:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:32 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:46:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:32 smithi191 ceph-mon[104220]: pgmap v373: 129 pgs: 129 active+clean; 2.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 16 MiB/s wr, 320 op/s 2023-10-08T08:46:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 -- 172.21.15.70:0/1162216038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 msgr2=0x7f661c10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 --2- 172.21.15.70:0/1162216038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 0x7f661c10d670 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f661400b0a0 tx=0x7f661400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 -- 172.21.15.70:0/1162216038 shutdown_connections 2023-10-08T08:46:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 --2- 172.21.15.70:0/1162216038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 0x7f661c10d670 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 --2- 172.21.15.70:0/1162216038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f661c0fef50 0x7f661c0ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 --2- 172.21.15.70:0/1162216038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f661c0ff900 0x7f661c1053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 -- 172.21.15.70:0/1162216038 >> 172.21.15.70:0/1162216038 conn(0x7f661c075c20 msgr2=0x7f661c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 -- 172.21.15.70:0/1162216038 shutdown_connections 2023-10-08T08:46:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 -- 172.21.15.70:0/1162216038 wait complete. 2023-10-08T08:46:32.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.659+0000 7f6620d60700 1 Processor -- start 2023-10-08T08:46:32.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6620d60700 1 -- start start 2023-10-08T08:46:32.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6620d60700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f661c0fef50 0x7f661c196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6620d60700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 0x7f661c197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6620d60700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f661c19a550 0x7f661c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6620d60700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c19af40 con 0x7f661c105aa0 2023-10-08T08:46:32.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6620d60700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c19b0b0 con 0x7f661c0fef50 2023-10-08T08:46:32.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6620d60700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c19b270 con 0x7f661c19a550 2023-10-08T08:46:32.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6619d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 0x7f661c197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6619d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 0x7f661c197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52916/0 (socket says 172.21.15.70:52916) 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f661ad9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f661c19a550 0x7f661c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6619d9b700 1 -- 172.21.15.70:0/2737505795 learned_addr learned my addr 172.21.15.70:0/2737505795 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f661a59c700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f661c0fef50 0x7f661c196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6619d9b700 1 -- 172.21.15.70:0/2737505795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f661c19a550 msgr2=0x7f661c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6619d9b700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f661c19a550 0x7f661c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6619d9b700 1 -- 172.21.15.70:0/2737505795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f661c0fef50 msgr2=0x7f661c196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6619d9b700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f661c0fef50 0x7f661c196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6619d9b700 1 -- 172.21.15.70:0/2737505795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614009d00 con 0x7f661c105aa0 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f661ad9d700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f661c19a550 0x7f661c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.660+0000 7f6619d9b700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 0x7f661c197260 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f661000e940 tx=0x7f661000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.661+0000 7f660b7fe700 1 -- 172.21.15.70:0/2737505795 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610009730 con 0x7f661c105aa0 2023-10-08T08:46:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.661+0000 7f6620d60700 1 -- 172.21.15.70:0/2737505795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661c1a38e0 con 0x7f661c105aa0 2023-10-08T08:46:32.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.661+0000 7f660b7fe700 1 -- 172.21.15.70:0/2737505795 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6610010430 con 0x7f661c105aa0 2023-10-08T08:46:32.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.661+0000 7f660b7fe700 1 -- 172.21.15.70:0/2737505795 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661000cea0 con 0x7f661c105aa0 2023-10-08T08:46:32.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.661+0000 7f6620d60700 1 -- 172.21.15.70:0/2737505795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c1a3e40 con 0x7f661c105aa0 2023-10-08T08:46:32.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.663+0000 7f660b7fe700 1 -- 172.21.15.70:0/2737505795 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6610010810 con 0x7f661c105aa0 2023-10-08T08:46:32.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.664+0000 7f660b7fe700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66040a1620 0x7f66040a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.664+0000 7f661a59c700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66040a1620 0x7f66040a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.664+0000 7f660b7fe700 1 -- 172.21.15.70:0/2737505795 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6610014070 con 0x7f661c105aa0 2023-10-08T08:46:32.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.664+0000 7f661a59c700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66040a1620 0x7f66040a3ae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f660c007be0 tx=0x7f660c0073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:32.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.664+0000 7f662cf49b80 1 Processor -- start 2023-10-08T08:46:32.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f662cf49b80 1 -- start start 2023-10-08T08:46:32.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eee5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 0x557f4eef0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 0x557f4eef2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f662cf49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4ee4e460 con 0x557f4eee4e80 2023-10-08T08:46:32.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f662cf49b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4ee3fc20 con 0x557f4eef0650 2023-10-08T08:46:32.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f662cf49b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4ee3d540 con 0x557f4eee57a0 2023-10-08T08:46:32.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eee5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eee5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52922/0 (socket says 172.21.15.70:52922) 2023-10-08T08:46:32.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661a59c700 1 -- 172.21.15.70:0/3906275183 learned_addr learned my addr 172.21.15.70:0/3906275183 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:32.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f6619d9b700 1 --2- 172.21.15.70:0/3906275183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 0x557f4eef0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661ad9d700 1 --2- 172.21.15.70:0/3906275183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 0x557f4eef2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661a59c700 1 -- 172.21.15.70:0/3906275183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 msgr2=0x557f4eef0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:32.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661a59c700 1 --2- 172.21.15.70:0/3906275183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 0x557f4eef0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661a59c700 1 -- 172.21.15.70:0/3906275183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 msgr2=0x557f4eef2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:32.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661a59c700 1 --2- 172.21.15.70:0/3906275183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 0x557f4eef2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661a59c700 1 -- 172.21.15.70:0/3906275183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f4ec63de0 con 0x557f4eee4e80 2023-10-08T08:46:32.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f661a59c700 1 --2- 172.21.15.70:0/3906275183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eee5260 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f660c010e80 tx=0x7f660c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c22806029ab9071 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:32.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f6608ff9700 1 -- 172.21.15.70:0/3906275183 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c010eb0 con 0x557f4eee4e80 2023-10-08T08:46:32.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f6608ff9700 1 -- 172.21.15.70:0/3906275183 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f660c003b40 con 0x557f4eee4e80 2023-10-08T08:46:32.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.665+0000 7f6608ff9700 1 -- 172.21.15.70:0/3906275183 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c011bd0 con 0x557f4eee4e80 2023-10-08T08:46:32.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.666+0000 7f662cf49b80 1 -- 172.21.15.70:0/3906275183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 msgr2=0x557f4eee5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:32.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.666+0000 7f662cf49b80 1 --2- 172.21.15.70:0/3906275183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eee5260 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f660c010e80 tx=0x7f660c013000 comp rx=0 tx=0).stop 2023-10-08T08:46:32.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.666+0000 7f662cf49b80 1 -- 172.21.15.70:0/3906275183 shutdown_connections 2023-10-08T08:46:32.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.666+0000 7f662cf49b80 1 --2- 172.21.15.70:0/3906275183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 0x557f4eef2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.666+0000 7f662cf49b80 1 --2- 172.21.15.70:0/3906275183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eee5260 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.666+0000 7f662cf49b80 1 --2- 172.21.15.70:0/3906275183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 0x557f4eef0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.666+0000 7f662cf49b80 1 -- 172.21.15.70:0/3906275183 >> 172.21.15.70:0/3906275183 conn(0x557f4ee5a260 msgr2=0x557f4eee12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:32.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.666+0000 7f662cf49b80 1 -- 172.21.15.70:0/3906275183 shutdown_connections 2023-10-08T08:46:32.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.666+0000 7f662cf49b80 1 -- 172.21.15.70:0/3906275183 wait complete. 2023-10-08T08:46:32.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f662cf49b80 1 -- start start 2023-10-08T08:46:32.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f662cf49b80 1 Processor -- start 2023-10-08T08:46:32.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eef0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 0x557f4eeed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 0x557f4eeeda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f662cf49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4ee38e30 con 0x557f4eee4e80 2023-10-08T08:46:32.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f662cf49b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4edd5710 con 0x557f4eef0650 2023-10-08T08:46:32.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f662cf49b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4edd53b0 con 0x557f4eee57a0 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f662cf49b80 10 client.0 _ll_register_callbacks cb 0x557f4ec32800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eef0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eef0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52928/0 (socket says 172.21.15.70:52928) 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661a59c700 1 -- 172.21.15.70:0/2075245342 learned_addr learned my addr 172.21.15.70:0/2075245342 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661ad9d700 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 0x557f4eeeda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f6619d9b700 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 0x557f4eeed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661a59c700 1 -- 172.21.15.70:0/2075245342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 msgr2=0x557f4eeed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661a59c700 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 0x557f4eeed3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661a59c700 1 -- 172.21.15.70:0/2075245342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 msgr2=0x557f4eeeda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661a59c700 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 0x557f4eeeda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661a59c700 1 -- 172.21.15.70:0/2075245342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c010b60 con 0x557f4eee4e80 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.667+0000 7f661ad9d700 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 0x557f4eeeda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f661a59c700 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eef0060 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f660c011480 tx=0x7f660c003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788f48082b48efde server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f6601ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f6601ffb700 1 -- 172.21.15.70:0/2075245342 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c02e070 con 0x557f4eee4e80 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f6601ffb700 1 -- 172.21.15.70:0/2075245342 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f660c017070 con 0x557f4eee4e80 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f662cf49b80 1 -- 172.21.15.70:0/2075245342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f4ee00eb0 con 0x557f4eee4e80 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f6601ffb700 1 -- 172.21.15.70:0/2075245342 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f660c010eb0 con 0x557f4eee4e80 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f662cf49b80 10 client.16497 fetch_fsmap learned FSMap version 38 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f662cf49b80 1 -- 172.21.15.70:0/2075245342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x557f4ec4cc60 con 0x557f4eee4e80 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f6601ffb700 1 -- 172.21.15.70:0/2075245342 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557f4ee00eb0 con 0x557f4eee4e80 2023-10-08T08:46:32.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f6601ffb700 1 -- 172.21.15.70:0/2075245342 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f660c0053f0 con 0x557f4eee4e80 2023-10-08T08:46:32.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f662cf49b80 10 client.16497 fetch_fsmap finished waiting for FSMap version 38 2023-10-08T08:46:32.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f662cf49b80 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:32.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f662cf49b80 20 client.16497 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:32.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557f4ef00150 0x557f4ef02570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f662cf49b80 4 client.16497 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:46:32.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f662cf49b80 1 -- 172.21.15.70:0/2075245342 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f4ee31e10 con 0x557f4ef00150 2023-10-08T08:46:32.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.668+0000 7f6619d9b700 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557f4ef00150 0x557f4ef02570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f6601ffb700 10 client.16497 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:32.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f6619d9b700 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557f4ef00150 0x557f4ef02570 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fae91d1a514accab server_cookie=be3cf564af346e86 in_seq=0 out_seq=0 2023-10-08T08:46:32.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f6601ffb700 1 -- 172.21.15.70:0/2075245342 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557f4ee31e10 con 0x557f4ef00150 2023-10-08T08:46:32.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f6601ffb700 10 client.16497 handle_command_reply: tid=0 2023-10-08T08:46:32.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f662cf49b80 1 client.16497 shutdown 2023-10-08T08:46:32.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f662cf49b80 1 -- 172.21.15.70:0/2075245342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 msgr2=0x557f4eef0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:32.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eef0060 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f660c011480 tx=0x7f660c003ec0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f662cf49b80 1 -- 172.21.15.70:0/2075245342 shutdown_connections 2023-10-08T08:46:32.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557f4ef00150 0x557f4ef02570 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eef0650 0x557f4eeeda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f6601ffb700 0 client.16497 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:32.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eee4e80 0x557f4eef0060 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2075245342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee57a0 0x557f4eeed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.669+0000 7f662cf49b80 1 -- 172.21.15.70:0/2075245342 >> 172.21.15.70:0/2075245342 conn(0x557f4ee5a260 msgr2=0x557f4eee0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:32.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.670+0000 7f662cf49b80 1 -- 172.21.15.70:0/2075245342 shutdown_connections 2023-10-08T08:46:32.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.670+0000 7f662cf49b80 1 -- 172.21.15.70:0/2075245342 wait complete. 2023-10-08T08:46:32.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.670+0000 7f662cf49b80 20 client.16497 trim_cache size 0 max 16384 2023-10-08T08:46:32.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f662cf49b80 1 Processor -- start 2023-10-08T08:46:32.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f662cf49b80 1 -- start start 2023-10-08T08:46:32.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eeebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eeec200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f662cf49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4ecb9920 con 0x557f4eef0650 2023-10-08T08:46:32.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f662cf49b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4eee54b0 con 0x557f4eee57a0 2023-10-08T08:46:32.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f662cf49b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4eefcd30 con 0x557f4eee4e80 2023-10-08T08:46:32.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f661ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eeec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f661a59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f6619d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eeebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f661a59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40514/0 (socket says 172.21.15.70:40514) 2023-10-08T08:46:32.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f661ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eeec200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52940/0 (socket says 172.21.15.70:52940) 2023-10-08T08:46:32.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.687+0000 7f661a59c700 1 -- 172.21.15.70:0/2118309364 learned_addr learned my addr 172.21.15.70:0/2118309364 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:32.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.688+0000 7f6619d9b700 1 -- 172.21.15.70:0/2118309364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 msgr2=0x557f4eef71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:32.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.688+0000 7f6619d9b700 1 --2- 172.21.15.70:0/2118309364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.688+0000 7f6619d9b700 1 -- 172.21.15.70:0/2118309364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 msgr2=0x557f4eeec200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:32.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.688+0000 7f6619d9b700 1 --2- 172.21.15.70:0/2118309364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eeec200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.688+0000 7f6619d9b700 1 -- 172.21.15.70:0/2118309364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f4ec8a250 con 0x557f4eee57a0 2023-10-08T08:46:32.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.688+0000 7f6619d9b700 1 --2- 172.21.15.70:0/2118309364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eeebcc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66100ca950 tx=0x7f661009d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d469df2193f2c78 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.688+0000 7f66097fa700 1 -- 172.21.15.70:0/2118309364 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661009e330 con 0x557f4eee57a0 2023-10-08T08:46:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.688+0000 7f66097fa700 1 -- 172.21.15.70:0/2118309364 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66100a2570 con 0x557f4eee57a0 2023-10-08T08:46:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.688+0000 7f66097fa700 1 -- 172.21.15.70:0/2118309364 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661009a6a0 con 0x557f4eee57a0 2023-10-08T08:46:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 -- 172.21.15.70:0/2118309364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 msgr2=0x557f4eeebcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2118309364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eeebcc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66100ca950 tx=0x7f661009d040 comp rx=0 tx=0).stop 2023-10-08T08:46:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 -- 172.21.15.70:0/2118309364 shutdown_connections 2023-10-08T08:46:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2118309364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eeec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2118309364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 --2- 172.21.15.70:0/2118309364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eeebcc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 -- 172.21.15.70:0/2118309364 >> 172.21.15.70:0/2118309364 conn(0x557f4ee5a260 msgr2=0x557f4eee86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 -- 172.21.15.70:0/2118309364 shutdown_connections 2023-10-08T08:46:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 -- 172.21.15.70:0/2118309364 wait complete. 2023-10-08T08:46:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 -- start start 2023-10-08T08:46:32.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 Processor -- start 2023-10-08T08:46:32.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.689+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eef53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f662cf49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eef5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f662cf49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4eef5e40 con 0x557f4eef0650 2023-10-08T08:46:32.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f662cf49b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4eef5fb0 con 0x557f4eee57a0 2023-10-08T08:46:32.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f662cf49b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4eef6170 con 0x557f4eee4e80 2023-10-08T08:46:32.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f662cf49b80 10 client.0 _ll_register_callbacks cb 0x7f6610005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:32.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661a59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eef5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f6619d9b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eef53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661a59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40520/0 (socket says 172.21.15.70:40520) 2023-10-08T08:46:32.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661ad9d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eef5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52946/0 (socket says 172.21.15.70:52946) 2023-10-08T08:46:32.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661a59c700 1 -- 172.21.15.70:0/4257956012 learned_addr learned my addr 172.21.15.70:0/4257956012 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:32.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661ad9d700 1 -- 172.21.15.70:0/4257956012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 msgr2=0x557f4eef6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:32.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661ad9d700 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661ad9d700 1 -- 172.21.15.70:0/4257956012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 msgr2=0x557f4eef53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:32.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661ad9d700 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eef53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661ad9d700 1 -- 172.21.15.70:0/4257956012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c1a3e40 con 0x557f4eef0650 2023-10-08T08:46:32.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661a59c700 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:32.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f6619d9b700 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eef53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:32.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f661ad9d700 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eef5900 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x557f4ee31f50 tx=0x7f6614003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311d4426ac561c4e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:32.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f6601ffb700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:46:32.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f6601ffb700 1 -- 172.21.15.70:0/4257956012 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614022070 con 0x557f4eef0650 2023-10-08T08:46:32.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f6601ffb700 1 -- 172.21.15.70:0/4257956012 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f66140077b0 con 0x557f4eef0650 2023-10-08T08:46:32.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.690+0000 7f662cf49b80 1 -- 172.21.15.70:0/4257956012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f660c003b40 con 0x557f4eef0650 2023-10-08T08:46:32.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f6601ffb700 1 -- 172.21.15.70:0/4257956012 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f661400e040 con 0x557f4eef0650 2023-10-08T08:46:32.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f662cf49b80 10 client.16503 fetch_fsmap learned FSMap version 38 2023-10-08T08:46:32.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f662cf49b80 1 -- 172.21.15.70:0/4257956012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x557f4ec622b0 con 0x557f4eef0650 2023-10-08T08:46:32.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f6601ffb700 1 -- 172.21.15.70:0/4257956012 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f660c003b40 con 0x557f4eef0650 2023-10-08T08:46:32.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f6601ffb700 1 -- 172.21.15.70:0/4257956012 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f661400b0d0 con 0x557f4eef0650 2023-10-08T08:46:32.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f662cf49b80 10 client.16503 fetch_fsmap finished waiting for FSMap version 38 2023-10-08T08:46:32.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f662cf49b80 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:32.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f662cf49b80 20 client.16503 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:32.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f662cf49b80 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557f4ef555a0 0x557f4ef579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:32.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f662cf49b80 4 client.16503 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:46:32.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f662cf49b80 1 -- 172.21.15.70:0/4257956012 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557f4ee31b30 con 0x557f4ef555a0 2023-10-08T08:46:32.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f661a59c700 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557f4ef555a0 0x557f4ef579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:32.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f6601ffb700 10 client.16503 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:32.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.691+0000 7f661a59c700 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557f4ef555a0 0x557f4ef579c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=821030cb61a84ca2 server_cookie=dd8f6cc0701f64e6 in_seq=0 out_seq=0 2023-10-08T08:46:32.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f6601ffb700 1 -- 172.21.15.70:0/4257956012 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557f4ee31b30 con 0x557f4ef555a0 2023-10-08T08:46:32.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f6601ffb700 10 client.16503 handle_command_reply: tid=0 2023-10-08T08:46:32.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 client.16503 shutdown 2023-10-08T08:46:32.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 -- 172.21.15.70:0/4257956012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 msgr2=0x557f4eef5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:32.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eef5900 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x557f4ee31f50 tx=0x7f6614003eb0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 -- 172.21.15.70:0/4257956012 shutdown_connections 2023-10-08T08:46:32.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f4eef0650 0x557f4eef5900 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f4eee4e80 0x557f4eef6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x557f4ef555a0 0x557f4ef579c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 --2- 172.21.15.70:0/4257956012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557f4eee57a0 0x557f4eef53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f6601ffb700 0 client.16503 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:32.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 -- 172.21.15.70:0/4257956012 >> 172.21.15.70:0/4257956012 conn(0x557f4ee5a260 msgr2=0x557f4eeebc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:32.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 -- 172.21.15.70:0/4257956012 shutdown_connections 2023-10-08T08:46:32.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 1 -- 172.21.15.70:0/4257956012 wait complete. 2023-10-08T08:46:32.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f662cf49b80 20 client.16503 trim_cache size 0 max 16384 2023-10-08T08:46:32.708 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:46:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T08:46:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2023-10-08T08:46:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "1fdc564a-5636-4203-adbe-f48f96886df6": { 2023-10-08T08:46:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2023-10-08T08:46:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "1fdc564a-5636-4203-adbe-f48f96886df6", 2023-10-08T08:46:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2023-10-08T08:46:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:46:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:46:32.710 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:46:32.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f6620d60700 1 -- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66040a1620 msgr2=0x7f66040a3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:32.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f6620d60700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66040a1620 0x7f66040a3ae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f660c007be0 tx=0x7f660c0073d0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f6620d60700 1 -- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 msgr2=0x7f661c197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:32.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.692+0000 7f6620d60700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 0x7f661c197260 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f661000e940 tx=0x7f661000ec50 comp rx=0 tx=0).stop 2023-10-08T08:46:32.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.693+0000 7f6620d60700 1 -- 172.21.15.70:0/2737505795 shutdown_connections 2023-10-08T08:46:32.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.693+0000 7f6620d60700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f66040a1620 0x7f66040a3ae0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.693+0000 7f6620d60700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f661c19a550 0x7f661c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.693+0000 7f6620d60700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f661c0fef50 0x7f661c196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.693+0000 7f6620d60700 1 --2- 172.21.15.70:0/2737505795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f661c105aa0 0x7f661c197260 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:32.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.693+0000 7f6620d60700 1 -- 172.21.15.70:0/2737505795 >> 172.21.15.70:0/2737505795 conn(0x7f661c075c20 msgr2=0x7f661c103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:32.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.693+0000 7f6620d60700 1 -- 172.21.15.70:0/2737505795 shutdown_connections 2023-10-08T08:46:32.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:46:32.693+0000 7f6620d60700 1 -- 172.21.15.70:0/2737505795 wait complete. 2023-10-08T08:46:32.713 INFO:tasks.cephfs.filesystem:scrub status for tag:1fdc564a-5636-4203-adbe-f48f96886df6 - {'path': '/', 'tag': '1fdc564a-5636-4203-adbe-f48f96886df6', 'options': 'recursive,force'} 2023-10-08T08:46:33.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:33 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:33.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:33 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:33.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:33 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:34.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:34 smithi070 ceph-mon[99513]: pgmap v374: 129 pgs: 129 active+clean; 2.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 323 op/s 2023-10-08T08:46:34.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:34 smithi105 ceph-mon[103798]: pgmap v374: 129 pgs: 129 active+clean; 2.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 323 op/s 2023-10-08T08:46:34.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:34 smithi191 ceph-mon[104220]: pgmap v374: 129 pgs: 129 active+clean; 2.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 323 op/s 2023-10-08T08:46:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.226+0000 7f3de20a4700 1 -- 172.21.15.70:0/4010232795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc0ffd70 msgr2=0x7f3ddc1001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.226+0000 7f3de20a4700 1 --2- 172.21.15.70:0/4010232795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc0ffd70 0x7f3ddc1001f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009990 tx=0x7f3dd0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.226+0000 7f3de20a4700 1 -- 172.21.15.70:0/4010232795 shutdown_connections 2023-10-08T08:46:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.226+0000 7f3de20a4700 1 --2- 172.21.15.70:0/4010232795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ddc100730 0x7f3ddc10c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.226+0000 7f3de20a4700 1 --2- 172.21.15.70:0/4010232795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ddc1045b0 0x7f3ddc104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.226+0000 7f3de20a4700 1 --2- 172.21.15.70:0/4010232795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc0ffd70 0x7f3ddc1001f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.226+0000 7f3de20a4700 1 -- 172.21.15.70:0/4010232795 >> 172.21.15.70:0/4010232795 conn(0x7f3ddc075bf0 msgr2=0x7f3ddc0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.226+0000 7f3de20a4700 1 -- 172.21.15.70:0/4010232795 shutdown_connections 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.226+0000 7f3de20a4700 1 -- 172.21.15.70:0/4010232795 wait complete. 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3de20a4700 1 Processor -- start 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3de20a4700 1 -- start start 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3de20a4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ddc0ffd70 0x7f3ddc19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3de20a4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc100730 0x7f3ddc19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3de20a4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ddc1045b0 0x7f3ddc198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3de20a4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc199190 con 0x7f3ddc100730 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3de20a4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc199300 con 0x7f3ddc0ffd70 2023-10-08T08:46:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3de20a4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1994c0 con 0x7f3ddc1045b0 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc100730 0x7f3ddc19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc100730 0x7f3ddc19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52958/0 (socket says 172.21.15.70:52958) 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddaffd700 1 -- 172.21.15.70:0/2090640256 learned_addr learned my addr 172.21.15.70:0/2090640256 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ddc0ffd70 0x7f3ddc19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddbfff700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ddc1045b0 0x7f3ddc198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddaffd700 1 -- 172.21.15.70:0/2090640256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ddc1045b0 msgr2=0x7f3ddc198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ddc1045b0 0x7f3ddc198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddaffd700 1 -- 172.21.15.70:0/2090640256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ddc0ffd70 msgr2=0x7f3ddc19e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ddc0ffd70 0x7f3ddc19e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.227+0000 7f3ddaffd700 1 -- 172.21.15.70:0/2090640256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00095f0 con 0x7f3ddc100730 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.228+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc100730 0x7f3ddc19eee0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0005910 tx=0x7f3dd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.228+0000 7f3dd8ff9700 1 -- 172.21.15.70:0/2090640256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd001d070 con 0x7f3ddc100730 2023-10-08T08:46:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.228+0000 7f3dd8ff9700 1 -- 172.21.15.70:0/2090640256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dd0022470 con 0x7f3ddc100730 2023-10-08T08:46:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.228+0000 7f3de20a4700 1 -- 172.21.15.70:0/2090640256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc199740 con 0x7f3ddc100730 2023-10-08T08:46:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.228+0000 7f3dd8ff9700 1 -- 172.21.15.70:0/2090640256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0017650 con 0x7f3ddc100730 2023-10-08T08:46:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.228+0000 7f3de20a4700 1 -- 172.21.15.70:0/2090640256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc1a5a40 con 0x7f3ddc100730 2023-10-08T08:46:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.230+0000 7f3dd8ff9700 1 -- 172.21.15.70:0/2090640256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3dd00225e0 con 0x7f3ddc100730 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.230+0000 7f3dd8ff9700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3dc40a1670 0x7f3dc40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.230+0000 7f3dd8ff9700 1 -- 172.21.15.70:0/2090640256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3dd00ce5a0 con 0x7f3ddc100730 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.230+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3dc40a1670 0x7f3dc40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.231+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3dc40a1670 0x7f3dc40a3b30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009c60 tx=0x7f3dcc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.231+0000 7f3dee28db80 1 Processor -- start 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.231+0000 7f3dee28db80 1 -- start start 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.231+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2f880 0x562bf5e2fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e301a0 0x562bf5e29b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 0x562bf5e2a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3dee28db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5d92400 con 0x562bf5e301a0 2023-10-08T08:46:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3dee28db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5d83bc0 con 0x562bf5e2f880 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3dee28db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5d814e0 con 0x562bf5e2a0b0 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e301a0 0x562bf5e29b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e301a0 0x562bf5e29b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52966/0 (socket says 172.21.15.70:52966) 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddaffd700 1 -- 172.21.15.70:0/312851607 learned_addr learned my addr 172.21.15.70:0/312851607 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/312851607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2f880 0x562bf5e2fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddbfff700 1 --2- 172.21.15.70:0/312851607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 0x562bf5e2a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddaffd700 1 -- 172.21.15.70:0/312851607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 msgr2=0x562bf5e2a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/312851607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 0x562bf5e2a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddaffd700 1 -- 172.21.15.70:0/312851607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2f880 msgr2=0x562bf5e2fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/312851607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2f880 0x562bf5e2fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddaffd700 1 -- 172.21.15.70:0/312851607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bf5ba7d80 con 0x562bf5e301a0 2023-10-08T08:46:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/312851607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e301a0 0x562bf5e29b70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0097960 tx=0x7f3dd0022f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ea72f096990680 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3dc1ffb700 1 -- 172.21.15.70:0/312851607 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd009bb60 con 0x562bf5e301a0 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3dc1ffb700 1 -- 172.21.15.70:0/312851607 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dd00b3e90 con 0x562bf5e301a0 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.232+0000 7f3dc1ffb700 1 -- 172.21.15.70:0/312851607 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00228c0 con 0x562bf5e301a0 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 -- 172.21.15.70:0/312851607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e301a0 msgr2=0x562bf5e29b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 --2- 172.21.15.70:0/312851607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e301a0 0x562bf5e29b70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0097960 tx=0x7f3dd0022f90 comp rx=0 tx=0).stop 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 -- 172.21.15.70:0/312851607 shutdown_connections 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 --2- 172.21.15.70:0/312851607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 0x562bf5e2a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 --2- 172.21.15.70:0/312851607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2f880 0x562bf5e2fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 --2- 172.21.15.70:0/312851607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e301a0 0x562bf5e29b70 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 -- 172.21.15.70:0/312851607 >> 172.21.15.70:0/312851607 conn(0x562bf5d9e200 msgr2=0x562bf5e24b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 -- 172.21.15.70:0/312851607 shutdown_connections 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 -- 172.21.15.70:0/312851607 wait complete. 2023-10-08T08:46:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.233+0000 7f3dee28db80 1 -- start start 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3dee28db80 1 Processor -- start 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 0x562bf5e36150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e33440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 0x562bf5e33ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3dee28db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5d7cdd0 con 0x562bf5e2f880 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3dee28db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5d196b0 con 0x562bf5e301a0 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3dee28db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5d19350 con 0x562bf5e2a0b0 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3dee28db80 10 client.0 _ll_register_callbacks cb 0x562bf5b767a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e33440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e33440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52972/0 (socket says 172.21.15.70:52972) 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddaffd700 1 -- 172.21.15.70:0/1563356079 learned_addr learned my addr 172.21.15.70:0/1563356079 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 0x562bf5e36150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddbfff700 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 0x562bf5e33ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddaffd700 1 -- 172.21.15.70:0/1563356079 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 msgr2=0x562bf5e36150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 0x562bf5e36150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddaffd700 1 -- 172.21.15.70:0/1563356079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 msgr2=0x562bf5e33ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 0x562bf5e33ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.234+0000 7f3ddaffd700 1 -- 172.21.15.70:0/1563356079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc1a5a40 con 0x562bf5e2f880 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e33440 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000f740 tx=0x7f3dd009aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fd668c6ebd5cad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dbaffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dbaffd700 1 -- 172.21.15.70:0/1563356079 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0080070 con 0x562bf5e2f880 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dbaffd700 1 -- 172.21.15.70:0/1563356079 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3dd009f5b0 con 0x562bf5e2f880 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dee28db80 1 -- 172.21.15.70:0/1563356079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bf5d44e50 con 0x562bf5e2f880 2023-10-08T08:46:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dbaffd700 1 -- 172.21.15.70:0/1563356079 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3dd009bb60 con 0x562bf5e2f880 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dee28db80 10 client.16515 fetch_fsmap learned FSMap version 39 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dee28db80 1 -- 172.21.15.70:0/1563356079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x562bf5b90c00 con 0x562bf5e2f880 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dbaffd700 1 -- 172.21.15.70:0/1563356079 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562bf5d44e50 con 0x562bf5e2f880 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dbaffd700 1 -- 172.21.15.70:0/1563356079 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 39) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f3dd009b6c0 con 0x562bf5e2f880 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dee28db80 10 client.16515 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dee28db80 10 client.16515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dee28db80 20 client.16515 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dee28db80 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562bf5e43490 0x562bf5e458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dee28db80 4 client.16515 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3dee28db80 1 -- 172.21.15.70:0/1563356079 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bf5d75db0 con 0x562bf5e43490 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.235+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562bf5e43490 0x562bf5e458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.236+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562bf5e43490 0x562bf5e458b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ec49a413feff41 server_cookie=876e2b1c05ea208e in_seq=0 out_seq=0 2023-10-08T08:46:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.236+0000 7f3dbaffd700 10 client.16515 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.236+0000 7f3dbaffd700 1 -- 172.21.15.70:0/1563356079 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562bf5d75db0 con 0x562bf5e43490 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.236+0000 7f3dbaffd700 10 client.16515 handle_command_reply: tid=0 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.236+0000 7f3dee28db80 1 client.16515 shutdown 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 -- 172.21.15.70:0/1563356079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 msgr2=0x562bf5e33440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e33440 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000f740 tx=0x7f3dd009aee0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 -- 172.21.15.70:0/1563356079 shutdown_connections 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562bf5e43490 0x562bf5e458b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 0x562bf5e33ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2a0b0 0x562bf5e36150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 --2- 172.21.15.70:0/1563356079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e33440 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 -- 172.21.15.70:0/1563356079 >> 172.21.15.70:0/1563356079 conn(0x562bf5d9e200 msgr2=0x562bf5e24010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dbaffd700 0 client.16515 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:36.246 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 -- 172.21.15.70:0/1563356079 shutdown_connections 2023-10-08T08:46:36.246 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 1 -- 172.21.15.70:0/1563356079 wait complete. 2023-10-08T08:46:36.246 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.237+0000 7f3dee28db80 20 client.16515 trim_cache size 0 max 16384 2023-10-08T08:46:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.251+0000 7f3dee28db80 1 Processor -- start 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.251+0000 7f3dee28db80 1 -- start start 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2a0b0 0x562bf5e29b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2f880 0x562bf5e24790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 0x562bf5e24cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3dee28db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5bfd8c0 con 0x562bf5e2a0b0 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3dee28db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5e1f2b0 con 0x562bf5e301a0 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3dee28db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5e36740 con 0x562bf5e2f880 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2a0b0 0x562bf5e29b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddb7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2a0b0 0x562bf5e29b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52978/0 (socket says 172.21.15.70:52978) 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddb7fe700 1 -- 172.21.15.70:0/927155225 learned_addr learned my addr 172.21.15.70:0/927155225 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/927155225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2f880 0x562bf5e24790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddbfff700 1 --2- 172.21.15.70:0/927155225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 0x562bf5e24cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddb7fe700 1 -- 172.21.15.70:0/927155225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2f880 msgr2=0x562bf5e24790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/927155225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2f880 0x562bf5e24790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddb7fe700 1 -- 172.21.15.70:0/927155225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 msgr2=0x562bf5e24cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/927155225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 0x562bf5e24cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddb7fe700 1 -- 172.21.15.70:0/927155225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bf5e4a4a0 con 0x562bf5e2a0b0 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/927155225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2a0b0 0x562bf5e29b70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc011ab0 tx=0x7f3dcc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98824c72c303834 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3dc27fc700 1 -- 172.21.15.70:0/927155225 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc022030 con 0x562bf5e2a0b0 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3dc27fc700 1 -- 172.21.15.70:0/927155225 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dcc023040 con 0x562bf5e2a0b0 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.252+0000 7f3dc27fc700 1 -- 172.21.15.70:0/927155225 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc01d670 con 0x562bf5e2a0b0 2023-10-08T08:46:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 -- 172.21.15.70:0/927155225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2a0b0 msgr2=0x562bf5e29b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 --2- 172.21.15.70:0/927155225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2a0b0 0x562bf5e29b70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc011ab0 tx=0x7f3dcc014000 comp rx=0 tx=0).stop 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 -- 172.21.15.70:0/927155225 shutdown_connections 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 --2- 172.21.15.70:0/927155225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e301a0 0x562bf5e24cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 --2- 172.21.15.70:0/927155225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2a0b0 0x562bf5e29b70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 --2- 172.21.15.70:0/927155225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e2f880 0x562bf5e24790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 -- 172.21.15.70:0/927155225 >> 172.21.15.70:0/927155225 conn(0x562bf5d9e200 msgr2=0x562bf5e2d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 -- 172.21.15.70:0/927155225 shutdown_connections 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 -- 172.21.15.70:0/927155225 wait complete. 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 -- start start 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.253+0000 7f3dee28db80 1 Processor -- start 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2a0b0 0x562bf5e2c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e2c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dee28db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e301a0 0x562bf5e2b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dee28db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5e2d050 con 0x562bf5e2f880 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dee28db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5e2d1c0 con 0x562bf5e2a0b0 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dee28db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bf5e2b970 con 0x562bf5e301a0 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dee28db80 10 client.0 _ll_register_callbacks cb 0x562bf5b767a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e2c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddaffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e2c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52986/0 (socket says 172.21.15.70:52986) 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddaffd700 1 -- 172.21.15.70:0/3625090561 learned_addr learned my addr 172.21.15.70:0/3625090561 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddbfff700 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e301a0 0x562bf5e2b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2a0b0 0x562bf5e2c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddaffd700 1 -- 172.21.15.70:0/3625090561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e301a0 msgr2=0x562bf5e2b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e301a0 0x562bf5e2b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddaffd700 1 -- 172.21.15.70:0/3625090561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2a0b0 msgr2=0x562bf5e2c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2a0b0 0x562bf5e2c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddaffd700 1 -- 172.21.15.70:0/3625090561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc017070 con 0x562bf5e2f880 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3ddaffd700 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e2c9c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0000c00 tx=0x7f3dd0022ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24040c57fb7d41ae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dbaffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dbaffd700 1 -- 172.21.15.70:0/3625090561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0080020 con 0x562bf5e2f880 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dbaffd700 1 -- 172.21.15.70:0/3625090561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3dd009f170 con 0x562bf5e2f880 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.254+0000 7f3dee28db80 1 -- 172.21.15.70:0/3625090561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3dd00b3e90 con 0x562bf5e2f880 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dbaffd700 1 -- 172.21.15.70:0/3625090561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3dd009bb60 con 0x562bf5e2f880 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dee28db80 10 client.16521 fetch_fsmap learned FSMap version 39 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dee28db80 1 -- 172.21.15.70:0/3625090561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x562bf5bce1f0 con 0x562bf5e2f880 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dbaffd700 1 -- 172.21.15.70:0/3625090561 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dd00ae030 con 0x562bf5e2f880 2023-10-08T08:46:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dbaffd700 1 -- 172.21.15.70:0/3625090561 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 39) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f3dd0097250 con 0x562bf5e2f880 2023-10-08T08:46:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dee28db80 10 client.16521 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T08:46:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dee28db80 10 client.16521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dee28db80 20 client.16521 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dee28db80 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562bf5e97b00 0x562bf5e99f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dee28db80 4 client.16521 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:46:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dee28db80 1 -- 172.21.15.70:0/3625090561 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562bf5d75ad0 con 0x562bf5e97b00 2023-10-08T08:46:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562bf5e97b00 0x562bf5e99f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3dbaffd700 10 client.16521 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.255+0000 7f3ddb7fe700 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562bf5e97b00 0x562bf5e99f20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bc54eedfe6f061f server_cookie=1b352e6e14225501 in_seq=0 out_seq=0 2023-10-08T08:46:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.358+0000 7f3dbaffd700 1 -- 172.21.15.70:0/3625090561 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562bf5d75ad0 con 0x562bf5e97b00 2023-10-08T08:46:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.358+0000 7f3dbaffd700 10 client.16521 handle_command_reply: tid=0 2023-10-08T08:46:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.358+0000 7f3dee28db80 1 client.16521 shutdown 2023-10-08T08:46:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.358+0000 7f3dee28db80 1 -- 172.21.15.70:0/3625090561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 msgr2=0x562bf5e2c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.358+0000 7f3dee28db80 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e2c9c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0000c00 tx=0x7f3dd0022ad0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.358+0000 7f3dee28db80 1 -- 172.21.15.70:0/3625090561 shutdown_connections 2023-10-08T08:46:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.358+0000 7f3dee28db80 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562bf5e301a0 0x562bf5e2b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.358+0000 7f3dee28db80 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x562bf5e97b00 0x562bf5e99f20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.358+0000 7f3dee28db80 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562bf5e2a0b0 0x562bf5e2c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3dee28db80 1 --2- 172.21.15.70:0/3625090561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bf5e2f880 0x562bf5e2c9c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3dbaffd700 0 client.16521 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3dee28db80 1 -- 172.21.15.70:0/3625090561 >> 172.21.15.70:0/3625090561 conn(0x562bf5d9e200 msgr2=0x562bf5e31cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3dee28db80 1 -- 172.21.15.70:0/3625090561 shutdown_connections 2023-10-08T08:46:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3dee28db80 1 -- 172.21.15.70:0/3625090561 wait complete. 2023-10-08T08:46:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3dee28db80 20 client.16521 trim_cache size 0 max 16384 2023-10-08T08:46:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:46:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:46:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:46:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 -- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3dc40a1670 msgr2=0x7f3dc40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3dc40a1670 0x7f3dc40a3b30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009c60 tx=0x7f3dcc009260 comp rx=0 tx=0).stop 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 -- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc100730 msgr2=0x7f3ddc19eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc100730 0x7f3ddc19eee0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0005910 tx=0x7f3dd0004730 comp rx=0 tx=0).stop 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 -- 172.21.15.70:0/2090640256 shutdown_connections 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3dc40a1670 0x7f3dc40a3b30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ddc1045b0 0x7f3ddc198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ddc0ffd70 0x7f3ddc19e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 --2- 172.21.15.70:0/2090640256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ddc100730 0x7f3ddc19eee0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:36.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 -- 172.21.15.70:0/2090640256 >> 172.21.15.70:0/2090640256 conn(0x7f3ddc075bf0 msgr2=0x7f3ddc103530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 -- 172.21.15.70:0/2090640256 shutdown_connections 2023-10-08T08:46:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:36.359+0000 7f3de20a4700 1 -- 172.21.15.70:0/2090640256 wait complete. 2023-10-08T08:46:36.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:36 smithi070 ceph-mon[99513]: pgmap v375: 129 pgs: 129 active+clean; 2.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.9 MiB/s wr, 341 op/s 2023-10-08T08:46:36.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:36 smithi105 ceph-mon[103798]: pgmap v375: 129 pgs: 129 active+clean; 2.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.9 MiB/s wr, 341 op/s 2023-10-08T08:46:36.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:36 smithi191 ceph-mon[104220]: pgmap v375: 129 pgs: 129 active+clean; 2.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.9 MiB/s wr, 341 op/s 2023-10-08T08:46:37.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:37 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:37.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:37 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:37.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:37 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:38 smithi105 ceph-mon[103798]: pgmap v376: 129 pgs: 129 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.4 MiB/s wr, 290 op/s 2023-10-08T08:46:38.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:38 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:38 smithi191 ceph-mon[104220]: pgmap v376: 129 pgs: 129 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.4 MiB/s wr, 290 op/s 2023-10-08T08:46:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:38 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:38 smithi070 ceph-mon[99513]: pgmap v376: 129 pgs: 129 active+clean; 2.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.4 MiB/s wr, 290 op/s 2023-10-08T08:46:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:38 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:40 smithi105 ceph-mon[103798]: pgmap v377: 129 pgs: 129 active+clean; 2.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.1 MiB/s wr, 230 op/s 2023-10-08T08:46:40.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:40 smithi191 ceph-mon[104220]: pgmap v377: 129 pgs: 129 active+clean; 2.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.1 MiB/s wr, 230 op/s 2023-10-08T08:46:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:40 smithi070 ceph-mon[99513]: pgmap v377: 129 pgs: 129 active+clean; 2.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.1 MiB/s wr, 230 op/s 2023-10-08T08:46:42.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:42 smithi105 ceph-mon[103798]: pgmap v378: 129 pgs: 129 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 258 op/s 2023-10-08T08:46:42.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:42 smithi191 ceph-mon[104220]: pgmap v378: 129 pgs: 129 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 258 op/s 2023-10-08T08:46:42.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:42 smithi070 ceph-mon[99513]: pgmap v378: 129 pgs: 129 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 258 op/s 2023-10-08T08:46:44.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:44 smithi105 ceph-mon[103798]: pgmap v379: 129 pgs: 129 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 744 KiB/s wr, 214 op/s 2023-10-08T08:46:44.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:44 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:44.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:44 smithi191 ceph-mon[104220]: pgmap v379: 129 pgs: 129 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 744 KiB/s wr, 214 op/s 2023-10-08T08:46:44.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:44 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:44.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:44 smithi070 ceph-mon[99513]: pgmap v379: 129 pgs: 129 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 744 KiB/s wr, 214 op/s 2023-10-08T08:46:44.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:44 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:46.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:46 smithi105 ceph-mon[103798]: pgmap v380: 129 pgs: 129 active+clean; 1.8 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 754 KiB/s wr, 204 op/s 2023-10-08T08:46:46.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:46 smithi191 ceph-mon[104220]: pgmap v380: 129 pgs: 129 active+clean; 1.8 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 754 KiB/s wr, 204 op/s 2023-10-08T08:46:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:46 smithi070 ceph-mon[99513]: pgmap v380: 129 pgs: 129 active+clean; 1.8 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 754 KiB/s wr, 204 op/s 2023-10-08T08:46:47.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:47 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:47.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:47 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:47.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:47 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:48.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:48 smithi105 ceph-mon[103798]: pgmap v381: 129 pgs: 129 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 742 KiB/s wr, 203 op/s 2023-10-08T08:46:48.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:48 smithi191 ceph-mon[104220]: pgmap v381: 129 pgs: 129 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 742 KiB/s wr, 203 op/s 2023-10-08T08:46:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:48 smithi070 ceph-mon[99513]: pgmap v381: 129 pgs: 129 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 742 KiB/s wr, 203 op/s 2023-10-08T08:46:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.474+0000 7f2222101700 1 -- 172.21.15.70:0/2521417004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c105670 msgr2=0x7f221c105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.474+0000 7f2222101700 1 --2- 172.21.15.70:0/2521417004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c105670 0x7f221c105a50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f221400b0a0 tx=0x7f221400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.474+0000 7f2222101700 1 -- 172.21.15.70:0/2521417004 shutdown_connections 2023-10-08T08:46:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.474+0000 7f2222101700 1 --2- 172.21.15.70:0/2521417004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c100290 0x7f221c10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.474+0000 7f2222101700 1 --2- 172.21.15.70:0/2521417004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c105670 0x7f221c105a50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.474+0000 7f2222101700 1 --2- 172.21.15.70:0/2521417004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f221c0ff8d0 0x7f221c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.474+0000 7f2222101700 1 -- 172.21.15.70:0/2521417004 >> 172.21.15.70:0/2521417004 conn(0x7f221c0764c0 msgr2=0x7f221c0768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.475+0000 7f2222101700 1 -- 172.21.15.70:0/2521417004 shutdown_connections 2023-10-08T08:46:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.475+0000 7f2222101700 1 -- 172.21.15.70:0/2521417004 wait complete. 2023-10-08T08:46:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.476+0000 7f2222101700 1 Processor -- start 2023-10-08T08:46:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.476+0000 7f2222101700 1 -- start start 2023-10-08T08:46:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f2222101700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c0ff8d0 0x7f221c10ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f2222101700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c100290 0x7f221c10f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f2222101700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f221c105670 0x7f221c10f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f2222101700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1a9590 con 0x7f221c100290 2023-10-08T08:46:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f2222101700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1a96d0 con 0x7f221c105670 2023-10-08T08:46:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f2222101700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1a9840 con 0x7f221c0ff8d0 2023-10-08T08:46:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f221affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c100290 0x7f221c10f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f221affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c100290 0x7f221c10f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53002/0 (socket says 172.21.15.70:53002) 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f221affd700 1 -- 172.21.15.70:0/920496140 learned_addr learned my addr 172.21.15.70:0/920496140 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.477+0000 7f221bfff700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f221c105670 0x7f221c10f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f221affd700 1 -- 172.21.15.70:0/920496140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c0ff8d0 msgr2=0x7f221c10ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f221affd700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c0ff8d0 0x7f221c10ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f221affd700 1 -- 172.21.15.70:0/920496140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f221c105670 msgr2=0x7f221c10f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f221affd700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f221c105670 0x7f221c10f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f221affd700 1 -- 172.21.15.70:0/920496140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214009d00 con 0x7f221c100290 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f221bfff700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f221c105670 0x7f221c10f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f221affd700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c100290 0x7f221c10f200 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f221000c920 tx=0x7f221000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f2218ff9700 1 -- 172.21.15.70:0/920496140 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210007b00 con 0x7f221c100290 2023-10-08T08:46:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f2218ff9700 1 -- 172.21.15.70:0/920496140 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f221000ce70 con 0x7f221c100290 2023-10-08T08:46:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.478+0000 7f2218ff9700 1 -- 172.21.15.70:0/920496140 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22100054b0 con 0x7f221c100290 2023-10-08T08:46:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.479+0000 7f2222101700 1 -- 172.21.15.70:0/920496140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c1a9b20 con 0x7f221c100290 2023-10-08T08:46:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.479+0000 7f2222101700 1 -- 172.21.15.70:0/920496140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c1a9fe0 con 0x7f221c100290 2023-10-08T08:46:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.483+0000 7f2218ff9700 1 -- 172.21.15.70:0/920496140 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f2210004750 con 0x7f221c100290 2023-10-08T08:46:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f222e2eab80 1 Processor -- start 2023-10-08T08:46:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f222e2eab80 1 -- start start 2023-10-08T08:46:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f2218ff9700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22040a16b0 0x7f22040a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1d3880 0x55e47e1d3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1ce0b0 0x55e47e1ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f222e2eab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e136400 con 0x55e47e1ce0b0 2023-10-08T08:46:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f222e2eab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e127bc0 con 0x55e47e1d3880 2023-10-08T08:46:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f222e2eab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e1254e0 con 0x55e47e1d41a0 2023-10-08T08:46:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f2218ff9700 1 -- 172.21.15.70:0/920496140 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f22100cd280 con 0x7f221c100290 2023-10-08T08:46:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.484+0000 7f221b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1d3880 0x55e47e1d3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221bfff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1ce0b0 0x55e47e1ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1d3880 0x55e47e1d3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40462/0 (socket says 172.21.15.70:40462) 2023-10-08T08:46:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221b7fe700 1 -- 172.21.15.70:0/930341524 learned_addr learned my addr 172.21.15.70:0/930341524 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221bfff700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22040a16b0 0x7f22040a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221affd700 1 --2- 172.21.15.70:0/930341524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221b7fe700 1 -- 172.21.15.70:0/930341524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 msgr2=0x55e47e1cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221b7fe700 1 --2- 172.21.15.70:0/930341524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221b7fe700 1 -- 172.21.15.70:0/930341524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1ce0b0 msgr2=0x55e47e1ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221b7fe700 1 --2- 172.21.15.70:0/930341524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1ce0b0 0x55e47e1ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221b7fe700 1 -- 172.21.15.70:0/930341524 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e47df4bd80 con 0x55e47e1d3880 2023-10-08T08:46:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221b7fe700 1 --2- 172.21.15.70:0/930341524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1d3880 0x55e47e1d3c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f221400cde0 tx=0x7f221400ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edf0c00679de9b95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f221bfff700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22040a16b0 0x7f22040a3b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f220c015b00 tx=0x7f220c009060 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f2201ffb700 1 -- 172.21.15.70:0/930341524 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221400e040 con 0x55e47e1d3880 2023-10-08T08:46:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f2201ffb700 1 -- 172.21.15.70:0/930341524 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2214007e40 con 0x55e47e1d3880 2023-10-08T08:46:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.485+0000 7f2201ffb700 1 -- 172.21.15.70:0/930341524 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214007970 con 0x55e47e1d3880 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.486+0000 7f222e2eab80 1 -- 172.21.15.70:0/930341524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1d3880 msgr2=0x55e47e1d3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.486+0000 7f222e2eab80 1 --2- 172.21.15.70:0/930341524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1d3880 0x55e47e1d3c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f221400cde0 tx=0x7f221400ce10 comp rx=0 tx=0).stop 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.486+0000 7f222e2eab80 1 -- 172.21.15.70:0/930341524 shutdown_connections 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.486+0000 7f222e2eab80 1 --2- 172.21.15.70:0/930341524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1ce0b0 0x55e47e1ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.486+0000 7f222e2eab80 1 --2- 172.21.15.70:0/930341524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1d3880 0x55e47e1d3c60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.486+0000 7f222e2eab80 1 --2- 172.21.15.70:0/930341524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.486+0000 7f222e2eab80 1 -- 172.21.15.70:0/930341524 >> 172.21.15.70:0/930341524 conn(0x55e47e142200 msgr2=0x55e47e1c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.487+0000 7f222e2eab80 1 -- 172.21.15.70:0/930341524 shutdown_connections 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.487+0000 7f222e2eab80 1 -- 172.21.15.70:0/930341524 wait complete. 2023-10-08T08:46:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.487+0000 7f222e2eab80 1 -- start start 2023-10-08T08:46:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.487+0000 7f222e2eab80 1 Processor -- start 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1d7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1d7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1d7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f222e2eab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e120dd0 con 0x55e47e1d3880 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f222e2eab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e0bd6b0 con 0x55e47e1ce0b0 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f222e2eab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e0bd350 con 0x55e47e1d41a0 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f222e2eab80 10 client.0 _ll_register_callbacks cb 0x55e47df1a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f221affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1d7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f221affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1d7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53014/0 (socket says 172.21.15.70:53014) 2023-10-08T08:46:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f221affd700 1 -- 172.21.15.70:0/510742298 learned_addr learned my addr 172.21.15.70:0/510742298 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.490+0000 7f221b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1d7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.491+0000 7f221b7fe700 1 -- 172.21.15.70:0/510742298 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 msgr2=0x55e47e1d7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.491+0000 7f221b7fe700 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1d7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.491+0000 7f221b7fe700 1 -- 172.21.15.70:0/510742298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 msgr2=0x55e47e1d7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.491+0000 7f221b7fe700 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1d7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.491+0000 7f221b7fe700 1 -- 172.21.15.70:0/510742298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c069330 con 0x55e47e1ce0b0 2023-10-08T08:46:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.491+0000 7f221affd700 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1d7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:46:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.491+0000 7f221b7fe700 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1d7540 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2214009fd0 tx=0x7f22140095d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfe27c365d0a9d45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.491+0000 7f21faffd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:46:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.491+0000 7f21faffd700 1 -- 172.21.15.70:0/510742298 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221400e040 con 0x55e47e1ce0b0 2023-10-08T08:46:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.492+0000 7f222e2eab80 1 -- 172.21.15.70:0/510742298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e47e0e8e50 con 0x55e47e1ce0b0 2023-10-08T08:46:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.492+0000 7f21faffd700 1 -- 172.21.15.70:0/510742298 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f22140076f0 con 0x55e47e1ce0b0 2023-10-08T08:46:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.493+0000 7f21faffd700 1 -- 172.21.15.70:0/510742298 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2214009b80 con 0x55e47e1ce0b0 2023-10-08T08:46:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.493+0000 7f222e2eab80 10 client.25940 fetch_fsmap learned FSMap version 42 2023-10-08T08:46:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.493+0000 7f222e2eab80 1 -- 172.21.15.70:0/510742298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55e47df34c00 con 0x55e47e1ce0b0 2023-10-08T08:46:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.494+0000 7f21faffd700 1 -- 172.21.15.70:0/510742298 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e47e0e8e50 con 0x55e47e1ce0b0 2023-10-08T08:46:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.494+0000 7f21faffd700 1 -- 172.21.15.70:0/510742298 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 42) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f2214019070 con 0x55e47e1ce0b0 2023-10-08T08:46:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.494+0000 7f222e2eab80 10 client.25940 fetch_fsmap finished waiting for FSMap version 42 2023-10-08T08:46:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.494+0000 7f222e2eab80 10 client.25940 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.494+0000 7f222e2eab80 20 client.25940 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.494+0000 7f222e2eab80 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e47e1f8990 0x55e47e1fadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.494+0000 7f222e2eab80 4 client.25940 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:46:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.494+0000 7f222e2eab80 1 -- 172.21.15.70:0/510742298 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e47e119db0 con 0x55e47e1f8990 2023-10-08T08:46:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.494+0000 7f221affd700 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e47e1f8990 0x55e47e1fadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.495+0000 7f21faffd700 10 client.25940 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.495+0000 7f221affd700 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e47e1f8990 0x55e47e1fadb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99a436ddf18ddf50 server_cookie=f12edda932fd5761 in_seq=0 out_seq=0 2023-10-08T08:46:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.497+0000 7f21faffd700 1 -- 172.21.15.70:0/510742298 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e47e119db0 con 0x55e47e1f8990 2023-10-08T08:46:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.497+0000 7f21faffd700 10 client.25940 handle_command_reply: tid=0 2023-10-08T08:46:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.497+0000 7f222e2eab80 1 client.25940 shutdown 2023-10-08T08:46:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.497+0000 7f222e2eab80 1 -- 172.21.15.70:0/510742298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 msgr2=0x55e47e1d7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.497+0000 7f222e2eab80 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1d7540 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2214009fd0 tx=0x7f22140095d0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f222e2eab80 1 -- 172.21.15.70:0/510742298 shutdown_connections 2023-10-08T08:46:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f222e2eab80 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1d7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f222e2eab80 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e47e1f8990 0x55e47e1fadb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f222e2eab80 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1d7540 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f222e2eab80 1 --2- 172.21.15.70:0/510742298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1d7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f222e2eab80 1 -- 172.21.15.70:0/510742298 >> 172.21.15.70:0/510742298 conn(0x55e47e142200 msgr2=0x55e47e1c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f21faffd700 0 client.25940 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f222e2eab80 1 -- 172.21.15.70:0/510742298 shutdown_connections 2023-10-08T08:46:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f222e2eab80 1 -- 172.21.15.70:0/510742298 wait complete. 2023-10-08T08:46:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.498+0000 7f222e2eab80 20 client.25940 trim_cache size 0 max 16384 2023-10-08T08:46:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f222e2eab80 1 Processor -- start 2023-10-08T08:46:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f222e2eab80 1 -- start start 2023-10-08T08:46:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d3880 0x55e47e1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d41a0 0x55e47e1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f222e2eab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47dfa18c0 con 0x55e47e1d41a0 2023-10-08T08:46:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f222e2eab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e1f5750 con 0x55e47e1ce0b0 2023-10-08T08:46:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f222e2eab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e1ceb50 con 0x55e47e1d3880 2023-10-08T08:46:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f221affd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d3880 0x55e47e1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f221affd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d3880 0x55e47e1c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40600/0 (socket says 172.21.15.70:40600) 2023-10-08T08:46:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.525+0000 7f221affd700 1 -- 172.21.15.70:0/3440774855 learned_addr learned my addr 172.21.15.70:0/3440774855 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.526+0000 7f221bfff700 1 --2- 172.21.15.70:0/3440774855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d41a0 0x55e47e1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.526+0000 7f221affd700 1 -- 172.21.15.70:0/3440774855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 msgr2=0x55e47e1ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.526+0000 7f221affd700 1 --2- 172.21.15.70:0/3440774855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.526+0000 7f221affd700 1 -- 172.21.15.70:0/3440774855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d41a0 msgr2=0x55e47e1c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.526+0000 7f221affd700 1 --2- 172.21.15.70:0/3440774855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d41a0 0x55e47e1c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.526+0000 7f221affd700 1 -- 172.21.15.70:0/3440774855 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e47df721f0 con 0x55e47e1d3880 2023-10-08T08:46:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.526+0000 7f221bfff700 1 --2- 172.21.15.70:0/3440774855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d41a0 0x55e47e1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:46:49.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.526+0000 7f221affd700 1 --2- 172.21.15.70:0/3440774855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d3880 0x55e47e1c8790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2210099c90 tx=0x7f221001a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f40d7667724d88 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.527+0000 7f22027fc700 1 -- 172.21.15.70:0/3440774855 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221009e0e0 con 0x55e47e1d3880 2023-10-08T08:46:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.527+0000 7f22027fc700 1 -- 172.21.15.70:0/3440774855 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22100a2320 con 0x55e47e1d3880 2023-10-08T08:46:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.527+0000 7f22027fc700 1 -- 172.21.15.70:0/3440774855 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000d5a0 con 0x55e47e1d3880 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 -- 172.21.15.70:0/3440774855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d3880 msgr2=0x55e47e1c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3440774855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d3880 0x55e47e1c8790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2210099c90 tx=0x7f221001a040 comp rx=0 tx=0).stop 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 -- 172.21.15.70:0/3440774855 shutdown_connections 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3440774855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d41a0 0x55e47e1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3440774855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3440774855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d3880 0x55e47e1c8790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 -- 172.21.15.70:0/3440774855 >> 172.21.15.70:0/3440774855 conn(0x55e47e142200 msgr2=0x55e47e1d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 -- 172.21.15.70:0/3440774855 shutdown_connections 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 -- 172.21.15.70:0/3440774855 wait complete. 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 -- start start 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.528+0000 7f222e2eab80 1 Processor -- start 2023-10-08T08:46:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1efd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f222e2eab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1ee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f222e2eab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e1ee810 con 0x55e47e1d3880 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f222e2eab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e1ee980 con 0x55e47e1ce0b0 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f222e2eab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e47e24b800 con 0x55e47e1d41a0 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f222e2eab80 10 client.0 _ll_register_callbacks cb 0x7f220c009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221bfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221affd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53028/0 (socket says 172.21.15.70:53028) 2023-10-08T08:46:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221affd700 1 -- 172.21.15.70:0/3963352601 learned_addr learned my addr 172.21.15.70:0/3963352601 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221affd700 1 -- 172.21.15.70:0/3963352601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 msgr2=0x55e47e1ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221affd700 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221affd700 1 -- 172.21.15.70:0/3963352601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 msgr2=0x55e47e1efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221affd700 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221affd700 1 -- 172.21.15.70:0/3963352601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c1a9fe0 con 0x55e47e1d3880 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f221affd700 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1edb80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f22100ca6a0 tx=0x7f2210095bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905d27c1e64823b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.529+0000 7f21faffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f21faffd700 1 -- 172.21.15.70:0/3963352601 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000d540 con 0x55e47e1d3880 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f21faffd700 1 -- 172.21.15.70:0/3963352601 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f221009e0e0 con 0x55e47e1d3880 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f222e2eab80 1 -- 172.21.15.70:0/3963352601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2214007e40 con 0x55e47e1d3880 2023-10-08T08:46:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f21faffd700 1 -- 172.21.15.70:0/3963352601 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f221009a1f0 con 0x55e47e1d3880 2023-10-08T08:46:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f222e2eab80 10 client.16536 fetch_fsmap learned FSMap version 42 2023-10-08T08:46:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f222e2eab80 1 -- 172.21.15.70:0/3963352601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55e47df4a250 con 0x55e47e1d3880 2023-10-08T08:46:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f21faffd700 1 -- 172.21.15.70:0/3963352601 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2214007e40 con 0x55e47e1d3880 2023-10-08T08:46:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f21faffd700 1 -- 172.21.15.70:0/3963352601 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) v1 ==== 7958+0+0 (secure 0 0 0) 0x7f22100a1e90 con 0x55e47e1d3880 2023-10-08T08:46:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f222e2eab80 10 client.16536 fetch_fsmap finished waiting for FSMap version 42 2023-10-08T08:46:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f222e2eab80 10 client.16536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:46:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f222e2eab80 20 client.16536 populate_metadata read hostname 'smithi070' 2023-10-08T08:46:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e47e24cc60 0x55e47e24f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:46:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f222e2eab80 4 client.16536 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:46:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f222e2eab80 1 -- 172.21.15.70:0/3963352601 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e47e119ad0 con 0x55e47e24cc60 2023-10-08T08:46:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.530+0000 7f221b7fe700 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e47e24cc60 0x55e47e24f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:46:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.531+0000 7f21faffd700 10 client.16536 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.531+0000 7f221b7fe700 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e47e24cc60 0x55e47e24f080 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=401db07639e2ac79 server_cookie=ba5e3df418f490f in_seq=0 out_seq=0 2023-10-08T08:46:49.555 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f21faffd700 1 -- 172.21.15.70:0/3963352601 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e47e119ad0 con 0x55e47e24cc60 2023-10-08T08:46:49.555 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f21faffd700 10 client.16536 handle_command_reply: tid=0 2023-10-08T08:46:49.555 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 client.16536 shutdown 2023-10-08T08:46:49.555 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 -- 172.21.15.70:0/3963352601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 msgr2=0x55e47e1edb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:49.555 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1edb80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f22100ca6a0 tx=0x7f2210095bb0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.555 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 -- 172.21.15.70:0/3963352601 shutdown_connections 2023-10-08T08:46:49.555 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e47e1d41a0 0x55e47e1ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e47e24cc60 0x55e47e24f080 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e47e1ce0b0 0x55e47e1efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f21faffd700 0 client.16536 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:46:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 --2- 172.21.15.70:0/3963352601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e47e1d3880 0x55e47e1edb80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 -- 172.21.15.70:0/3963352601 >> 172.21.15.70:0/3963352601 conn(0x55e47e142200 msgr2=0x55e47e1d5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 -- 172.21.15.70:0/3963352601 shutdown_connections 2023-10-08T08:46:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.553+0000 7f222e2eab80 1 -- 172.21.15.70:0/3963352601 wait complete. 2023-10-08T08:46:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f222e2eab80 20 client.16536 trim_cache size 0 max 16384 2023-10-08T08:46:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:46:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:46:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:46:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:46:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 -- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22040a16b0 msgr2=0x7f22040a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22040a16b0 0x7f22040a3b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f220c015b00 tx=0x7f220c009060 comp rx=0 tx=0).stop 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 -- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c100290 msgr2=0x7f221c10f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c100290 0x7f221c10f200 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f221000c920 tx=0x7f221000cc30 comp rx=0 tx=0).stop 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 -- 172.21.15.70:0/920496140 shutdown_connections 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f22040a16b0 0x7f22040a3b70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f221c105670 0x7f221c10f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f221c0ff8d0 0x7f221c10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 --2- 172.21.15.70:0/920496140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221c100290 0x7f221c10f200 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 -- 172.21.15.70:0/920496140 >> 172.21.15.70:0/920496140 conn(0x7f221c0764c0 msgr2=0x7f221c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:46:49.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 -- 172.21.15.70:0/920496140 shutdown_connections 2023-10-08T08:46:49.559 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:46:49.554+0000 7f2222101700 1 -- 172.21.15.70:0/920496140 wait complete. 2023-10-08T08:46:50.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:50 smithi105 ceph-mon[103798]: pgmap v382: 129 pgs: 129 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 501 KiB/s wr, 171 op/s 2023-10-08T08:46:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:50 smithi191 ceph-mon[104220]: pgmap v382: 129 pgs: 129 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 501 KiB/s wr, 171 op/s 2023-10-08T08:46:50.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:50 smithi070 ceph-mon[99513]: pgmap v382: 129 pgs: 129 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 501 KiB/s wr, 171 op/s 2023-10-08T08:46:52.302 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-08T08:46:52.302 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-08T08:46:52.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:52 smithi105 ceph-mon[103798]: pgmap v383: 129 pgs: 129 active+clean; 1.7 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 475 KiB/s wr, 147 op/s 2023-10-08T08:46:52.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:52 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:52 smithi191 ceph-mon[104220]: pgmap v383: 129 pgs: 129 active+clean; 1.7 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 475 KiB/s wr, 147 op/s 2023-10-08T08:46:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:52 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:52 smithi070 ceph-mon[99513]: pgmap v383: 129 pgs: 129 active+clean; 1.7 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 475 KiB/s wr, 147 op/s 2023-10-08T08:46:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:52 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:53.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:53 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:53.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:53 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:53.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:53 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:54.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:54 smithi191 ceph-mon[104220]: pgmap v384: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 456 KiB/s wr, 91 op/s 2023-10-08T08:46:54.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:54 smithi070 ceph-mon[99513]: pgmap v384: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 456 KiB/s wr, 91 op/s 2023-10-08T08:46:54.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:54 smithi105 ceph-mon[103798]: pgmap v384: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 456 KiB/s wr, 91 op/s 2023-10-08T08:46:56.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:56 smithi191 ceph-mon[104220]: pgmap v385: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 604 KiB/s wr, 93 op/s 2023-10-08T08:46:56.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:56 smithi070 ceph-mon[99513]: pgmap v385: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 604 KiB/s wr, 93 op/s 2023-10-08T08:46:56.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:56 smithi105 ceph-mon[103798]: pgmap v385: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 604 KiB/s wr, 93 op/s 2023-10-08T08:46:57.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:57 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:57.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:57 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:57.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:57 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:46:58.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:46:58 smithi191 ceph-mon[104220]: pgmap v386: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 944 KiB/s wr, 106 op/s 2023-10-08T08:46:58.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:46:58 smithi070 ceph-mon[99513]: pgmap v386: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 944 KiB/s wr, 106 op/s 2023-10-08T08:46:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:46:58 smithi105 ceph-mon[103798]: pgmap v386: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 944 KiB/s wr, 106 op/s 2023-10-08T08:47:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:00 smithi191 ceph-mon[104220]: pgmap v387: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 962 KiB/s wr, 110 op/s 2023-10-08T08:47:00.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:00 smithi070 ceph-mon[99513]: pgmap v387: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 962 KiB/s wr, 110 op/s 2023-10-08T08:47:00.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:00 smithi105 ceph-mon[103798]: pgmap v387: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 962 KiB/s wr, 110 op/s 2023-10-08T08:47:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:02 smithi191 ceph-mon[104220]: pgmap v388: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-08T08:47:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.693+0000 7f17a3e4b700 1 -- 172.21.15.70:0/1677702208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 msgr2=0x7f179c1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.693+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/1677702208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 0x7f179c1049c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1798009990 tx=0x7f1798009ca0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.693+0000 7f17a3e4b700 1 -- 172.21.15.70:0/1677702208 shutdown_connections 2023-10-08T08:47:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.693+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/1677702208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c0fff90 0x7f179c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.693+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/1677702208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 0x7f179c1049c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.693+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/1677702208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c0ff5d0 0x7f179c0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.693+0000 7f17a3e4b700 1 -- 172.21.15.70:0/1677702208 >> 172.21.15.70:0/1677702208 conn(0x7f179c076790 msgr2=0x7f179c076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.694+0000 7f17a3e4b700 1 -- 172.21.15.70:0/1677702208 shutdown_connections 2023-10-08T08:47:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.694+0000 7f17a3e4b700 1 -- 172.21.15.70:0/1677702208 wait complete. 2023-10-08T08:47:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a3e4b700 1 Processor -- start 2023-10-08T08:47:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a3e4b700 1 -- start start 2023-10-08T08:47:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a3e4b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c0ff5d0 0x7f179c19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a3e4b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c0fff90 0x7f179c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a3e4b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 0x7f179c194810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a3e4b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c194fb0 con 0x7f179c1045e0 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a3e4b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c195120 con 0x7f179c0ff5d0 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a3e4b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c1952e0 con 0x7f179c0fff90 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a23e8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 0x7f179c194810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a23e8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 0x7f179c194810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53046/0 (socket says 172.21.15.70:53046) 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.695+0000 7f17a23e8700 1 -- 172.21.15.70:0/4105877083 learned_addr learned my addr 172.21.15.70:0/4105877083 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f17a13e6700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c0fff90 0x7f179c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f17a1be7700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c0ff5d0 0x7f179c19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f17a23e8700 1 -- 172.21.15.70:0/4105877083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c0fff90 msgr2=0x7f179c19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f17a23e8700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c0fff90 0x7f179c19bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f17a23e8700 1 -- 172.21.15.70:0/4105877083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c0ff5d0 msgr2=0x7f179c19b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f17a23e8700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c0ff5d0 0x7f179c19b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f17a23e8700 1 -- 172.21.15.70:0/4105877083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17980095f0 con 0x7f179c1045e0 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f17a13e6700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c0fff90 0x7f179c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f17a23e8700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 0x7f179c194810 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1794009c10 tx=0x7f179400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f1792ffd700 1 -- 172.21.15.70:0/4105877083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794009e70 con 0x7f179c1045e0 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f1792ffd700 1 -- 172.21.15.70:0/4105877083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1794013070 con 0x7f179c1045e0 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.696+0000 7f1792ffd700 1 -- 172.21.15.70:0/4105877083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17940045c0 con 0x7f179c1045e0 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.697+0000 7f17a3e4b700 1 -- 172.21.15.70:0/4105877083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c1991e0 con 0x7f179c1045e0 2023-10-08T08:47:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.697+0000 7f17a3e4b700 1 -- 172.21.15.70:0/4105877083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c1996a0 con 0x7f179c1045e0 2023-10-08T08:47:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.701+0000 7f17b0034b80 1 Processor -- start 2023-10-08T08:47:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.702+0000 7f17b0034b80 1 -- start start 2023-10-08T08:47:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.702+0000 7f1792ffd700 1 -- 172.21.15.70:0/4105877083 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1794004720 con 0x7f179c1045e0 2023-10-08T08:47:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.702+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 0x5642d8209c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.702+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d820a1a0 0x5642d8203b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.702+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8204510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.702+0000 7f17b0034b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d816c400 con 0x5642d82040b0 2023-10-08T08:47:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.702+0000 7f17b0034b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d815dbc0 con 0x5642d8209880 2023-10-08T08:47:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.702+0000 7f17b0034b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d815b4e0 con 0x5642d820a1a0 2023-10-08T08:47:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.703+0000 7f1792ffd700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17880a16f0 0x7f17880a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.703+0000 7f1792ffd700 1 -- 172.21.15.70:0/4105877083 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1794015070 con 0x7f179c1045e0 2023-10-08T08:47:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.703+0000 7f17a23e8700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17880a16f0 0x7f17880a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.704+0000 7f17a13e6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 0x5642d8209c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.704+0000 7f17a13e6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 0x5642d8209c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40508/0 (socket says 172.21.15.70:40508) 2023-10-08T08:47:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.704+0000 7f17a13e6700 1 -- 172.21.15.70:0/1155468118 learned_addr learned my addr 172.21.15.70:0/1155468118 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.704+0000 7f17a13e6700 1 --2- 172.21.15.70:0/1155468118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8204510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.704+0000 7f17a23e8700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17880a16f0 0x7f17880a3bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f17940c9d00 tx=0x7f179400b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.705+0000 7f17a13e6700 1 -- 172.21.15.70:0/1155468118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d820a1a0 msgr2=0x5642d8203b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T08:47:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.705+0000 7f17a13e6700 1 --2- 172.21.15.70:0/1155468118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d820a1a0 0x5642d8203b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.705+0000 7f17a13e6700 1 -- 172.21.15.70:0/1155468118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 msgr2=0x5642d8209c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.705+0000 7f17a13e6700 1 --2- 172.21.15.70:0/1155468118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 0x5642d8209c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.705+0000 7f17a13e6700 1 -- 172.21.15.70:0/1155468118 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d7f81d80 con 0x5642d82040b0 2023-10-08T08:47:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.706+0000 7f17a13e6700 1 --2- 172.21.15.70:0/1155468118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8204510 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f178c0168b0 tx=0x7f178c00b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383abde7d0295a0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.707+0000 7f1787fff700 1 -- 172.21.15.70:0/1155468118 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c004230 con 0x5642d82040b0 2023-10-08T08:47:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.707+0000 7f1787fff700 1 -- 172.21.15.70:0/1155468118 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f178c011070 con 0x5642d82040b0 2023-10-08T08:47:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.707+0000 7f1787fff700 1 -- 172.21.15.70:0/1155468118 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c01a600 con 0x5642d82040b0 2023-10-08T08:47:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.708+0000 7f17b0034b80 1 -- 172.21.15.70:0/1155468118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 msgr2=0x5642d8204510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.708+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1155468118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8204510 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f178c0168b0 tx=0x7f178c00b340 comp rx=0 tx=0).stop 2023-10-08T08:47:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.709+0000 7f17b0034b80 1 -- 172.21.15.70:0/1155468118 shutdown_connections 2023-10-08T08:47:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.709+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1155468118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8204510 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.709+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1155468118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 0x5642d8209c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.709+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1155468118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d820a1a0 0x5642d8203b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.709+0000 7f17b0034b80 1 -- 172.21.15.70:0/1155468118 >> 172.21.15.70:0/1155468118 conn(0x5642d8178200 msgr2=0x5642d81feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.709+0000 7f17b0034b80 1 -- 172.21.15.70:0/1155468118 shutdown_connections 2023-10-08T08:47:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.709+0000 7f17b0034b80 1 -- 172.21.15.70:0/1155468118 wait complete. 2023-10-08T08:47:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.710+0000 7f17b0034b80 1 -- start start 2023-10-08T08:47:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.710+0000 7f17b0034b80 1 Processor -- start 2023-10-08T08:47:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.710+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d820d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.710+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 0x5642d820dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.710+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 0x5642d820e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.710+0000 7f17b0034b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d8156dd0 con 0x5642d820a1a0 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.710+0000 7f17b0034b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d80f36b0 con 0x5642d82040b0 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.710+0000 7f17b0034b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d80f3350 con 0x5642d8209880 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.710+0000 7f17b0034b80 10 client.0 _ll_register_callbacks cb 0x5642d7f507a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a1be7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 0x5642d820dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a1be7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 0x5642d820dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40632/0 (socket says 172.21.15.70:40632) 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a1be7700 1 -- 172.21.15.70:0/1984621687 learned_addr learned my addr 172.21.15.70:0/1984621687 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a13e6700 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 0x5642d820e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a13e6700 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d820d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a13e6700 1 -- 172.21.15.70:0/1984621687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 msgr2=0x5642d820dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a13e6700 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 0x5642d820dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a13e6700 1 -- 172.21.15.70:0/1984621687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 msgr2=0x5642d820d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a13e6700 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d820d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a13e6700 1 -- 172.21.15.70:0/1984621687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c016560 con 0x5642d820a1a0 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17a13e6700 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 0x5642d820e0f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f178c003d50 tx=0x7f178c00b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09ac6d3c07fbe38 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17857fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.711+0000 7f17857fa700 1 -- 172.21.15.70:0/1984621687 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c003a60 con 0x5642d820a1a0 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17857fa700 1 -- 172.21.15.70:0/1984621687 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f178c003fc0 con 0x5642d820a1a0 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17b0034b80 1 -- 172.21.15.70:0/1984621687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642d811ee50 con 0x5642d820a1a0 2023-10-08T08:47:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17857fa700 1 -- 172.21.15.70:0/1984621687 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f178c004180 con 0x5642d820a1a0 2023-10-08T08:47:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17b0034b80 10 client.16548 fetch_fsmap learned FSMap version 45 2023-10-08T08:47:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17b0034b80 1 -- 172.21.15.70:0/1984621687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5642d7f6ac00 con 0x5642d820a1a0 2023-10-08T08:47:02.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:47:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17857fa700 1 -- 172.21.15.70:0/1984621687 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5642d811ee50 con 0x5642d820a1a0 2023-10-08T08:47:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17857fa700 1 -- 172.21.15.70:0/1984621687 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f178c004750 con 0x5642d820a1a0 2023-10-08T08:47:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17b0034b80 10 client.16548 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T08:47:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17b0034b80 10 client.16548 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17b0034b80 20 client.16548 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5642d821dde0 0x5642d8220200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17b0034b80 4 client.16548 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.712+0000 7f17b0034b80 1 -- 172.21.15.70:0/1984621687 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642d814fdb0 con 0x5642d821dde0 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.713+0000 7f17a1be7700 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5642d821dde0 0x5642d8220200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.713+0000 7f17857fa700 10 client.16548 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.713+0000 7f17a1be7700 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5642d821dde0 0x5642d8220200 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1864902602d577a8 server_cookie=1249f441215e3233 in_seq=0 out_seq=0 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.714+0000 7f17857fa700 1 -- 172.21.15.70:0/1984621687 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5642d814fdb0 con 0x5642d821dde0 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.714+0000 7f17857fa700 10 client.16548 handle_command_reply: tid=0 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.714+0000 7f17b0034b80 1 client.16548 shutdown 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 -- 172.21.15.70:0/1984621687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 msgr2=0x5642d820e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 0x5642d820e0f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f178c003d50 tx=0x7f178c00b510 comp rx=0 tx=0).stop 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 -- 172.21.15.70:0/1984621687 shutdown_connections 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 0x5642d820e0f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5642d821dde0 0x5642d8220200 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d820d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17857fa700 0 client.16548 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 --2- 172.21.15.70:0/1984621687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 0x5642d820dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 -- 172.21.15.70:0/1984621687 >> 172.21.15.70:0/1984621687 conn(0x5642d8178200 msgr2=0x5642d81fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 -- 172.21.15.70:0/1984621687 shutdown_connections 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 1 -- 172.21.15.70:0/1984621687 wait complete. 2023-10-08T08:47:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.715+0000 7f17b0034b80 20 client.16548 trim_cache size 0 max 16384 2023-10-08T08:47:02.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:02 smithi070 ceph-mon[99513]: pgmap v388: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-08T08:47:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.741+0000 7f17b0034b80 1 Processor -- start 2023-10-08T08:47:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.741+0000 7f17b0034b80 1 -- start start 2023-10-08T08:47:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.741+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d8203b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.741+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 0x5642d82201d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.741+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 0x5642d820cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.741+0000 7f17b0034b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d7fd78c0 con 0x5642d820a1a0 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.741+0000 7f17b0034b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d814fdb0 con 0x5642d82040b0 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.741+0000 7f17b0034b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d811ee50 con 0x5642d8209880 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 0x5642d820cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d8203b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d8203b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40520/0 (socket says 172.21.15.70:40520) 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 -- 172.21.15.70:0/3666298882 learned_addr learned my addr 172.21.15.70:0/3666298882 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a1be7700 1 --2- 172.21.15.70:0/3666298882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 0x5642d82201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 -- 172.21.15.70:0/3666298882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 msgr2=0x5642d82201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 --2- 172.21.15.70:0/3666298882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 0x5642d82201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 -- 172.21.15.70:0/3666298882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 msgr2=0x5642d820cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 --2- 172.21.15.70:0/3666298882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 0x5642d820cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 -- 172.21.15.70:0/3666298882 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d7fa81f0 con 0x5642d82040b0 2023-10-08T08:47:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f17a13e6700 1 --2- 172.21.15.70:0/3666298882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d8203b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f178c028000 tx=0x7f178c016f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66deeacbcecf173 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f1790ff9700 1 -- 172.21.15.70:0/3666298882 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c003a40 con 0x5642d82040b0 2023-10-08T08:47:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f1790ff9700 1 -- 172.21.15.70:0/3666298882 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f178c004480 con 0x5642d82040b0 2023-10-08T08:47:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.742+0000 7f1790ff9700 1 -- 172.21.15.70:0/3666298882 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c005230 con 0x5642d82040b0 2023-10-08T08:47:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.743+0000 7f17b0034b80 1 -- 172.21.15.70:0/3666298882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 msgr2=0x5642d8203b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.743+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3666298882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d8203b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f178c028000 tx=0x7f178c016f90 comp rx=0 tx=0).stop 2023-10-08T08:47:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.743+0000 7f17b0034b80 1 -- 172.21.15.70:0/3666298882 shutdown_connections 2023-10-08T08:47:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.743+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3666298882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d820a1a0 0x5642d820cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.743+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3666298882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d82040b0 0x5642d8203b70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.743+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3666298882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d8209880 0x5642d82201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.743+0000 7f17b0034b80 1 -- 172.21.15.70:0/3666298882 >> 172.21.15.70:0/3666298882 conn(0x5642d8178200 msgr2=0x5642d82044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.744+0000 7f17b0034b80 1 -- 172.21.15.70:0/3666298882 shutdown_connections 2023-10-08T08:47:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.744+0000 7f17b0034b80 1 -- 172.21.15.70:0/3666298882 wait complete. 2023-10-08T08:47:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.745+0000 7f17b0034b80 1 -- start start 2023-10-08T08:47:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.745+0000 7f17b0034b80 1 Processor -- start 2023-10-08T08:47:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.745+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8214a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.745+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 0x5642d8211f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.745+0000 7f17b0034b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d820a1a0 0x5642d8212460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.745+0000 7f17b0034b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d82129a0 con 0x5642d82040b0 2023-10-08T08:47:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.745+0000 7f17b0034b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d8212b10 con 0x5642d8209880 2023-10-08T08:47:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.745+0000 7f17b0034b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d8212cd0 con 0x5642d820a1a0 2023-10-08T08:47:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.746+0000 7f17b0034b80 10 client.0 _ll_register_callbacks cb 0x7f178c016450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.746+0000 7f17a13e6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d820a1a0 0x5642d8212460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.746+0000 7f17a13e6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8214a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.746+0000 7f17a13e6700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8214a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53068/0 (socket says 172.21.15.70:53068) 2023-10-08T08:47:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.746+0000 7f17a13e6700 1 -- 172.21.15.70:0/3094195134 learned_addr learned my addr 172.21.15.70:0/3094195134 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.747+0000 7f17a1be7700 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 0x5642d8211f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.747+0000 7f17a13e6700 1 -- 172.21.15.70:0/3094195134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d820a1a0 msgr2=0x5642d8212460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.747+0000 7f17a13e6700 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d820a1a0 0x5642d8212460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.747+0000 7f17a13e6700 1 -- 172.21.15.70:0/3094195134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 msgr2=0x5642d8211f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.747+0000 7f17a13e6700 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 0x5642d8211f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.747+0000 7f17a13e6700 1 -- 172.21.15.70:0/3094195134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642d7f6ac00 con 0x5642d82040b0 2023-10-08T08:47:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.747+0000 7f17a13e6700 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8214a90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f178c004b60 tx=0x7f178c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3766d4d5a37bb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.748+0000 7f17857fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:47:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.748+0000 7f17857fa700 1 -- 172.21.15.70:0/3094195134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c004710 con 0x5642d82040b0 2023-10-08T08:47:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.748+0000 7f17857fa700 1 -- 172.21.15.70:0/3094195134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f178c004870 con 0x5642d82040b0 2023-10-08T08:47:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.748+0000 7f17b0034b80 1 -- 172.21.15.70:0/3094195134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f178c011070 con 0x5642d82040b0 2023-10-08T08:47:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.748+0000 7f17857fa700 1 -- 172.21.15.70:0/3094195134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f178c003fc0 con 0x5642d82040b0 2023-10-08T08:47:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.748+0000 7f17b0034b80 10 client.16554 fetch_fsmap learned FSMap version 45 2023-10-08T08:47:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.748+0000 7f17b0034b80 1 -- 172.21.15.70:0/3094195134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5642d7f80250 con 0x5642d82040b0 2023-10-08T08:47:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.748+0000 7f17857fa700 1 -- 172.21.15.70:0/3094195134 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f178c011070 con 0x5642d82040b0 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17857fa700 1 -- 172.21.15.70:0/3094195134 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f178c034440 con 0x5642d82040b0 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17b0034b80 10 client.16554 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17b0034b80 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17b0034b80 20 client.16554 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5642d8271de0 0x5642d8274200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17b0034b80 4 client.16554 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17b0034b80 1 -- 172.21.15.70:0/3094195134 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5642d814fad0 con 0x5642d8271de0 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17a1be7700 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5642d8271de0 0x5642d8274200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17857fa700 10 client.16554 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:02.749+0000 7f17a1be7700 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5642d8271de0 0x5642d8274200 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ece63451c7549931 server_cookie=29704322eccefeec in_seq=0 out_seq=0 2023-10-08T08:47:02.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:02 smithi105 ceph-mon[103798]: pgmap v388: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 155 op/s 2023-10-08T08:47:02.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.863+0000 7f1aaff8f700 1 -- 172.21.15.70:0/1027994897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ffbf0 msgr2=0x7f1aa8105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.863+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/1027994897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ffbf0 0x7f1aa8105320 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009990 tx=0x7f1a9c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.863+0000 7f1aaff8f700 1 -- 172.21.15.70:0/1027994897 shutdown_connections 2023-10-08T08:47:02.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.863+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/1027994897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1aa8105a50 0x7f1aa810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.863+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/1027994897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa80ff240 0x7f1aa80ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.863+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/1027994897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ffbf0 0x7f1aa8105320 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.863+0000 7f1aaff8f700 1 -- 172.21.15.70:0/1027994897 >> 172.21.15.70:0/1027994897 conn(0x7f1aa8074860 msgr2=0x7f1aa8074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:02.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.863+0000 7f1aaff8f700 1 -- 172.21.15.70:0/1027994897 shutdown_connections 2023-10-08T08:47:02.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.863+0000 7f1aaff8f700 1 -- 172.21.15.70:0/1027994897 wait complete. 2023-10-08T08:47:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aaff8f700 1 Processor -- start 2023-10-08T08:47:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aaff8f700 1 -- start start 2023-10-08T08:47:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aaff8f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ff240 0x7f1aa81001b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aaff8f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa8105a50 0x7f1aa81006f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aaff8f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1aa8100c30 0x7f1aa81a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aaff8f700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa81a5300 con 0x7f1aa80ff240 2023-10-08T08:47:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aaff8f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa81a5470 con 0x7f1aa8100c30 2023-10-08T08:47:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aaff8f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa81a5630 con 0x7f1aa8105a50 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aadd2b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ff240 0x7f1aa81001b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aadd2b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ff240 0x7f1aa81001b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53082/0 (socket says 172.21.15.70:53082) 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aadd2b700 1 -- 172.21.15.70:0/2208590656 learned_addr learned my addr 172.21.15.70:0/2208590656 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aae52c700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1aa8100c30 0x7f1aa81a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.864+0000 7f1aad52a700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa8105a50 0x7f1aa81006f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aadd2b700 1 -- 172.21.15.70:0/2208590656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa8105a50 msgr2=0x7f1aa81006f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa8105a50 0x7f1aa81006f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aadd2b700 1 -- 172.21.15.70:0/2208590656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1aa8100c30 msgr2=0x7f1aa81a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1aa8100c30 0x7f1aa81a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aadd2b700 1 -- 172.21.15.70:0/2208590656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0095f0 con 0x7f1aa80ff240 2023-10-08T08:47:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aae52c700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1aa8100c30 0x7f1aa81a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ff240 0x7f1aa81001b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800ef10 tx=0x7f1a9800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aa6ffd700 1 -- 172.21.15.70:0/2208590656 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9800c9c0 con 0x7f1aa80ff240 2023-10-08T08:47:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aa6ffd700 1 -- 172.21.15.70:0/2208590656 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a9800f040 con 0x7f1aa80ff240 2023-10-08T08:47:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aaff8f700 1 -- 172.21.15.70:0/2208590656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa81a58b0 con 0x7f1aa80ff240 2023-10-08T08:47:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aa6ffd700 1 -- 172.21.15.70:0/2208590656 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98014480 con 0x7f1aa80ff240 2023-10-08T08:47:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.865+0000 7f1aaff8f700 1 -- 172.21.15.70:0/2208590656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa81a5d90 con 0x7f1aa80ff240 2023-10-08T08:47:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.867+0000 7f1aa6ffd700 1 -- 172.21.15.70:0/2208590656 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1a98007690 con 0x7f1aa80ff240 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.868+0000 7f1aa6ffd700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1a900a15e0 0x7f1a900a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.868+0000 7f1aad52a700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1a900a15e0 0x7f1a900a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.868+0000 7f1aa6ffd700 1 -- 172.21.15.70:0/2208590656 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1a980cd6a0 con 0x7f1aa80ff240 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.868+0000 7f1aad52a700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1a900a15e0 0x7f1a900a3aa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00b2e0 tx=0x7f1a9c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1abc178b80 1 Processor -- start 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1abc178b80 1 -- start start 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 0x563d93165260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 0x563d93170110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93170650 0x563d93172a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1abc178b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d930ce460 con 0x563d93170650 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1abc178b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d930bfc20 con 0x563d931657a0 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1abc178b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d930bd540 con 0x563d93164e80 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aae52c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93170650 0x563d93172a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aae52c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93170650 0x563d93172a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53094/0 (socket says 172.21.15.70:53094) 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aadd2b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 0x563d93165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aae52c700 1 -- 172.21.15.70:0/544337995 learned_addr learned my addr 172.21.15.70:0/544337995 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aad52a700 1 --2- 172.21.15.70:0/544337995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 0x563d93170110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aae52c700 1 -- 172.21.15.70:0/544337995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 msgr2=0x563d93165260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aae52c700 1 --2- 172.21.15.70:0/544337995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 0x563d93165260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aae52c700 1 -- 172.21.15.70:0/544337995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 msgr2=0x563d93170110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aae52c700 1 --2- 172.21.15.70:0/544337995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 0x563d93170110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.869+0000 7f1aae52c700 1 -- 172.21.15.70:0/544337995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d92ee3de0 con 0x563d93170650 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.870+0000 7f1aae52c700 1 --2- 172.21.15.70:0/544337995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93170650 0x563d93172a40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0011540 tx=0x7f1aa0011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d1dd0920c8d5e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.870+0000 7f1a8ffff700 1 -- 172.21.15.70:0/544337995 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0019630 con 0x563d93170650 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.870+0000 7f1a8ffff700 1 -- 172.21.15.70:0/544337995 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1aa0019c50 con 0x563d93170650 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.870+0000 7f1a8ffff700 1 -- 172.21.15.70:0/544337995 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000ec00 con 0x563d93170650 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.870+0000 7f1abc178b80 1 -- 172.21.15.70:0/544337995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93170650 msgr2=0x563d93172a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.870+0000 7f1abc178b80 1 --2- 172.21.15.70:0/544337995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93170650 0x563d93172a40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0011540 tx=0x7f1aa0011850 comp rx=0 tx=0).stop 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 -- 172.21.15.70:0/544337995 shutdown_connections 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 --2- 172.21.15.70:0/544337995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93170650 0x563d93172a40 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 --2- 172.21.15.70:0/544337995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 0x563d93165260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 --2- 172.21.15.70:0/544337995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 0x563d93170110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 -- 172.21.15.70:0/544337995 >> 172.21.15.70:0/544337995 conn(0x563d930da260 msgr2=0x563d931612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 -- 172.21.15.70:0/544337995 shutdown_connections 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 -- 172.21.15.70:0/544337995 wait complete. 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 -- start start 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 Processor -- start 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93164e80 0x563d93170090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 0x563d9316db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d930b8e30 con 0x563d931657a0 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d93055710 con 0x563d93164e80 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d930553b0 con 0x563d93170650 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.871+0000 7f1abc178b80 10 client.0 _ll_register_callbacks cb 0x563d92eb2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aad52a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aadd2b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93164e80 0x563d93170090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aad52a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53098/0 (socket says 172.21.15.70:53098) 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aad52a700 1 -- 172.21.15.70:0/2731822963 learned_addr learned my addr 172.21.15.70:0/2731822963 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93164e80 0x563d93170090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40554/0 (socket says 172.21.15.70:40554) 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aae52c700 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 0x563d9316db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aadd2b700 1 -- 172.21.15.70:0/2731822963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 msgr2=0x563d9316db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 0x563d9316db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aadd2b700 1 -- 172.21.15.70:0/2731822963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 msgr2=0x563d9316d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aadd2b700 1 -- 172.21.15.70:0/2731822963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa0009d50 con 0x563d93164e80 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aad52a700 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93164e80 0x563d93170090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a980cab00 tx=0x7f1a98099cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2352d4c39910832 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1a8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:47:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/2731822963 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9809a390 con 0x563d93164e80 2023-10-08T08:47:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/2731822963 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1a9809e4e0 con 0x563d93164e80 2023-10-08T08:47:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1abc178b80 1 -- 172.21.15.70:0/2731822963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d93080eb0 con 0x563d93164e80 2023-10-08T08:47:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/2731822963 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a980a2720 con 0x563d93164e80 2023-10-08T08:47:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1abc178b80 10 client.25970 fetch_fsmap learned FSMap version 45 2023-10-08T08:47:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.872+0000 7f1abc178b80 1 -- 172.21.15.70:0/2731822963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x563d92eccc60 con 0x563d93164e80 2023-10-08T08:47:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/2731822963 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563d93080eb0 con 0x563d93164e80 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/2731822963 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 45) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f1a98099880 con 0x563d93164e80 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1abc178b80 10 client.25970 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1abc178b80 10 client.25970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1abc178b80 20 client.25970 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1abc178b80 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563d93180300 0x563d93182720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1abc178b80 4 client.25970 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1abc178b80 1 -- 172.21.15.70:0/2731822963 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d930b1e10 con 0x563d93180300 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1aad52a700 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563d93180300 0x563d93182720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1a8d7fa700 10 client.25970 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:02.873+0000 7f1aad52a700 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563d93180300 0x563d93182720 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27abfe307acaf783 server_cookie=25ade3f45fea6a7a in_seq=0 out_seq=0 2023-10-08T08:47:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:04 smithi191 ceph-mon[104220]: pgmap v389: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 152 op/s 2023-10-08T08:47:04.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:04 smithi070 ceph-mon[99513]: pgmap v389: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 152 op/s 2023-10-08T08:47:04.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:04 smithi105 ceph-mon[103798]: pgmap v389: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 152 op/s 2023-10-08T08:47:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.966+0000 7f17857fa700 1 -- 172.21.15.70:0/3094195134 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5642d814fad0 con 0x5642d8271de0 2023-10-08T08:47:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.966+0000 7f17857fa700 10 client.16554 handle_command_reply: tid=0 2023-10-08T08:47:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.966+0000 7f17b0034b80 1 client.16554 shutdown 2023-10-08T08:47:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 -- 172.21.15.70:0/3094195134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 msgr2=0x5642d8214a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8214a90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f178c004b60 tx=0x7f178c00b8d0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/2731822963 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563d930b1e10 con 0x563d93180300 2023-10-08T08:47:04.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1a8d7fa700 10 client.25970 handle_command_reply: tid=0 2023-10-08T08:47:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 -- 172.21.15.70:0/3094195134 shutdown_connections 2023-10-08T08:47:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d820a1a0 0x5642d8212460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d82040b0 0x5642d8214a90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x5642d8271de0 0x5642d8274200 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 --2- 172.21.15.70:0/3094195134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642d8209880 0x5642d8211f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17857fa700 0 client.16554 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 -- 172.21.15.70:0/3094195134 >> 172.21.15.70:0/3094195134 conn(0x5642d8178200 msgr2=0x5642d8208730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 client.25970 shutdown 2023-10-08T08:47:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 -- 172.21.15.70:0/3094195134 shutdown_connections 2023-10-08T08:47:04.970 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 1 -- 172.21.15.70:0/3094195134 wait complete. 2023-10-08T08:47:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 -- 172.21.15.70:0/2731822963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93164e80 msgr2=0x563d93170090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93164e80 0x563d93170090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a980cab00 tx=0x7f1a98099cf0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 -- 172.21.15.70:0/2731822963 shutdown_connections 2023-10-08T08:47:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 0x563d9316db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563d93180300 0x563d93182720 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17b0034b80 20 client.16554 trim_cache size 0 max 16384 2023-10-08T08:47:04.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93164e80 0x563d93170090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1a8d7fa700 0 client.25970 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:04.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 --2- 172.21.15.70:0/2731822963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 -- 172.21.15.70:0/2731822963 >> 172.21.15.70:0/2731822963 conn(0x563d930da260 msgr2=0x563d93160ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:04.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 -- 172.21.15.70:0/2731822963 shutdown_connections 2023-10-08T08:47:04.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 1 -- 172.21.15.70:0/2731822963 wait complete. 2023-10-08T08:47:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:47:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:47:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:47:04.973 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:47:04.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f1abc178b80 20 client.25970 trim_cache size 0 max 16384 2023-10-08T08:47:04.974 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17a3e4b700 1 -- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17880a16f0 msgr2=0x7f17880a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:04.974 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17880a16f0 0x7f17880a3bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f17940c9d00 tx=0x7f179400b040 comp rx=0 tx=0).stop 2023-10-08T08:47:04.974 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17a3e4b700 1 -- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 msgr2=0x7f179c194810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:04.974 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.967+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 0x7f179c194810 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1794009c10 tx=0x7f179400d3b0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.968+0000 7f17a3e4b700 1 -- 172.21.15.70:0/4105877083 shutdown_connections 2023-10-08T08:47:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.968+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f17880a16f0 0x7f17880a3bb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.968+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f179c1045e0 0x7f179c194810 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.968+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179c0ff5d0 0x7f179c19b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.968+0000 7f17a3e4b700 1 --2- 172.21.15.70:0/4105877083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f179c0fff90 0x7f179c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.968+0000 7f17a3e4b700 1 -- 172.21.15.70:0/4105877083 >> 172.21.15.70:0/4105877083 conn(0x7f179c076790 msgr2=0x7f179c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.968+0000 7f17a3e4b700 1 -- 172.21.15.70:0/4105877083 shutdown_connections 2023-10-08T08:47:04.975 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:04.968+0000 7f17a3e4b700 1 -- 172.21.15.70:0/4105877083 wait complete. 2023-10-08T08:47:04.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.984+0000 7f1abc178b80 1 Processor -- start 2023-10-08T08:47:04.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.984+0000 7f1abc178b80 1 -- start start 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 0x563d931771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93170650 0x563d931686f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1abc178b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d92f39920 con 0x563d931657a0 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1abc178b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9317fff0 con 0x563d93170650 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1abc178b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d931776e0 con 0x563d93164e80 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aad52a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aad52a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53104/0 (socket says 172.21.15.70:53104) 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aad52a700 1 -- 172.21.15.70:0/1344742871 learned_addr learned my addr 172.21.15.70:0/1344742871 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/1344742871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 0x563d931771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:04.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aae52c700 1 --2- 172.21.15.70:0/1344742871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93170650 0x563d931686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aad52a700 1 -- 172.21.15.70:0/1344742871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 msgr2=0x563d931771a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aad52a700 1 --2- 172.21.15.70:0/1344742871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 0x563d931771a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aad52a700 1 -- 172.21.15.70:0/1344742871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93170650 msgr2=0x563d931686f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aad52a700 1 --2- 172.21.15.70:0/1344742871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93170650 0x563d931686f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aad52a700 1 -- 172.21.15.70:0/1344742871 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d92f0a250 con 0x563d931657a0 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aad52a700 1 --2- 172.21.15.70:0/1344742871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316fca0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0059d0 tx=0x7f1a9c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbfe33da0c1e02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.985+0000 7f1aa4ff9700 1 -- 172.21.15.70:0/1344742871 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00bda0 con 0x563d931657a0 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1aa4ff9700 1 -- 172.21.15.70:0/1344742871 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a9c01e040 con 0x563d931657a0 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1aa4ff9700 1 -- 172.21.15.70:0/1344742871 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c004b40 con 0x563d931657a0 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1abc178b80 1 -- 172.21.15.70:0/1344742871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 msgr2=0x563d9316fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1abc178b80 1 --2- 172.21.15.70:0/1344742871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316fca0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0059d0 tx=0x7f1a9c020000 comp rx=0 tx=0).stop 2023-10-08T08:47:04.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1abc178b80 1 -- 172.21.15.70:0/1344742871 shutdown_connections 2023-10-08T08:47:04.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1abc178b80 1 --2- 172.21.15.70:0/1344742871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d93170650 0x563d931686f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1abc178b80 1 --2- 172.21.15.70:0/1344742871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93164e80 0x563d931771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1abc178b80 1 --2- 172.21.15.70:0/1344742871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d931657a0 0x563d9316fca0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:04.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1abc178b80 1 -- 172.21.15.70:0/1344742871 >> 172.21.15.70:0/1344742871 conn(0x563d930da260 msgr2=0x563d931604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:04.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1abc178b80 1 -- 172.21.15.70:0/1344742871 shutdown_connections 2023-10-08T08:47:04.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.986+0000 7f1abc178b80 1 -- 172.21.15.70:0/1344742871 wait complete. 2023-10-08T08:47:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1abc178b80 1 -- start start 2023-10-08T08:47:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1abc178b80 1 Processor -- start 2023-10-08T08:47:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93164e80 0x563d93175470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 0x563d931759b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1abc178b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 0x563d931766b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1abc178b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d93176cb0 con 0x563d93164e80 2023-10-08T08:47:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1abc178b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d93176e20 con 0x563d931657a0 2023-10-08T08:47:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1abc178b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d93176fe0 con 0x563d93170650 2023-10-08T08:47:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1abc178b80 10 client.0 _ll_register_callbacks cb 0x7f1a9809a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1aadd2b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93164e80 0x563d93175470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1aadd2b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93164e80 0x563d93175470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53108/0 (socket says 172.21.15.70:53108) 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1aadd2b700 1 -- 172.21.15.70:0/3721491447 learned_addr learned my addr 172.21.15.70:0/3721491447 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1aad52a700 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 0x563d931759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.987+0000 7f1aae52c700 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 0x563d931766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1aadd2b700 1 -- 172.21.15.70:0/3721491447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 msgr2=0x563d931766b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 0x563d931766b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1aadd2b700 1 -- 172.21.15.70:0/3721491447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 msgr2=0x563d931759b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 0x563d931759b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1aadd2b700 1 -- 172.21.15.70:0/3721491447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa810de60 con 0x563d93164e80 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1aadd2b700 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93164e80 0x563d93175470 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1a98096e00 tx=0x7f1a98007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bd10dcc64a0d0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1a8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/3721491447 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9809e4e0 con 0x563d93164e80 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/3721491447 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1a9809a390 con 0x563d93164e80 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1abc178b80 1 -- 172.21.15.70:0/3721491447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1aa0019c50 con 0x563d93164e80 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/3721491447 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a980a2720 con 0x563d93164e80 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1abc178b80 10 client.16572 fetch_fsmap learned FSMap version 45 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1abc178b80 1 -- 172.21.15.70:0/3721491447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x563d92ee22b0 con 0x563d93164e80 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/3721491447 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1aa0019c50 con 0x563d93164e80 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/3721491447 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f1a9809a5f0 con 0x563d93164e80 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1abc178b80 10 client.16572 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1abc178b80 10 client.16572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1abc178b80 20 client.16572 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:05.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1abc178b80 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563d931d5080 0x563d931d7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1abc178b80 4 client.16572 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1abc178b80 1 -- 172.21.15.70:0/3721491447 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563d930b1b30 con 0x563d931d5080 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.988+0000 7f1aad52a700 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563d931d5080 0x563d931d7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1a8d7fa700 10 client.16572 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1aad52a700 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563d931d5080 0x563d931d7470 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c8bdd67f2bae90e server_cookie=6b50c250d8c954bd in_seq=0 out_seq=0 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1a8d7fa700 1 -- 172.21.15.70:0/3721491447 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563d930b1b30 con 0x563d931d5080 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1a8d7fa700 10 client.16572 handle_command_reply: tid=0 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 client.16572 shutdown 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 -- 172.21.15.70:0/3721491447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93164e80 msgr2=0x563d93175470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93164e80 0x563d93175470 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1a98096e00 tx=0x7f1a98007a30 comp rx=0 tx=0).stop 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 -- 172.21.15.70:0/3721491447 shutdown_connections 2023-10-08T08:47:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563d93170650 0x563d931766b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d93164e80 0x563d93175470 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x563d931d5080 0x563d931d7470 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 --2- 172.21.15.70:0/3721491447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d931657a0 0x563d931759b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1a8d7fa700 0 client.16572 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 -- 172.21.15.70:0/3721491447 >> 172.21.15.70:0/3721491447 conn(0x563d930da260 msgr2=0x563d931686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 -- 172.21.15.70:0/3721491447 shutdown_connections 2023-10-08T08:47:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 1 -- 172.21.15.70:0/3721491447 wait complete. 2023-10-08T08:47:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.989+0000 7f1abc178b80 20 client.16572 trim_cache size 0 max 16384 2023-10-08T08:47:05.005 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:47:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T08:47:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2023-10-08T08:47:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "1fdc564a-5636-4203-adbe-f48f96886df6": { 2023-10-08T08:47:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2023-10-08T08:47:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "1fdc564a-5636-4203-adbe-f48f96886df6", 2023-10-08T08:47:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2023-10-08T08:47:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:47:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:47:05.006 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 -- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1a900a15e0 msgr2=0x7f1a900a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1a900a15e0 0x7f1a900a3aa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00b2e0 tx=0x7f1a9c005960 comp rx=0 tx=0).stop 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 -- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ff240 msgr2=0x7f1aa81001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ff240 0x7f1aa81001b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800ef10 tx=0x7f1a9800c3a0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 -- 172.21.15.70:0/2208590656 shutdown_connections 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f1a900a15e0 0x7f1a900a3aa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1aa8100c30 0x7f1aa81a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa80ff240 0x7f1aa81001b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 --2- 172.21.15.70:0/2208590656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa8105a50 0x7f1aa81006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 -- 172.21.15.70:0/2208590656 >> 172.21.15.70:0/2208590656 conn(0x7f1aa8074860 msgr2=0x7f1aa80fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:05.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 -- 172.21.15.70:0/2208590656 shutdown_connections 2023-10-08T08:47:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:04.990+0000 7f1aaff8f700 1 -- 172.21.15.70:0/2208590656 wait complete. 2023-10-08T08:47:05.009 INFO:tasks.cephfs.filesystem:scrub status for tag:1fdc564a-5636-4203-adbe-f48f96886df6 - {'path': '/', 'tag': '1fdc564a-5636-4203-adbe-f48f96886df6', 'options': 'recursive,force'} 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: *** Caught signal (Segmentation fault) ** 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: in thread 7f2753124700 thread_name:md_log_replay 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f2763cd3cf0] 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2: /usr/bin/ceph-mds(+0x4f3ce2) [0x55b6bd1b6ce2] 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55b6bd1b8f33] 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 4: (MDLog::_replay_thread()+0x647) [0x55b6bd214957] 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55b6bd21de41] 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f2763cc91ca] 2023-10-08T08:47:06.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 7: clone() 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2023-10-08T08:47:05.730+0000 7f2753124700 -1 *** Caught signal (Segmentation fault) ** 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: in thread 7f2753124700 thread_name:md_log_replay 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f2763cd3cf0] 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2: /usr/bin/ceph-mds(+0x4f3ce2) [0x55b6bd1b6ce2] 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55b6bd1b8f33] 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 4: (MDLog::_replay_thread()+0x647) [0x55b6bd214957] 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55b6bd21de41] 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f2763cc91ca] 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 7: clone() 2023-10-08T08:47:06.022 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 0> 2023-10-08T08:47:05.730+0000 7f2753124700 -1 *** Caught signal (Segmentation fault) ** 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: in thread 7f2753124700 thread_name:md_log_replay 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f2763cd3cf0] 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2: /usr/bin/ceph-mds(+0x4f3ce2) [0x55b6bd1b6ce2] 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55b6bd1b8f33] 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 4: (MDLog::_replay_thread()+0x647) [0x55b6bd214957] 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55b6bd21de41] 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f2763cc91ca] 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 7: clone() 2023-10-08T08:47:06.023 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 0> 2023-10-08T08:47:05.730+0000 7f2753124700 -1 *** Caught signal (Segmentation fault) ** 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: in thread 7f2753124700 thread_name:md_log_replay 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f2763cd3cf0] 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2: /usr/bin/ceph-mds(+0x4f3ce2) [0x55b6bd1b6ce2] 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55b6bd1b8f33] 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 4: (MDLog::_replay_thread()+0x647) [0x55b6bd214957] 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55b6bd21de41] 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f2763cc91ca] 2023-10-08T08:47:06.024 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 7: clone() 2023-10-08T08:47:06.025 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-08T08:47:06.025 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:05 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[144792]: 2023-10-08T08:47:06.436 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:06 smithi105 ceph-mon[103798]: pgmap v390: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.0 MiB/s wr, 145 op/s 2023-10-08T08:47:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:06 smithi191 ceph-mon[104220]: pgmap v390: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.0 MiB/s wr, 145 op/s 2023-10-08T08:47:06.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:06 smithi070 ceph-mon[99513]: pgmap v390: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.0 MiB/s wr, 145 op/s 2023-10-08T08:47:06.770 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:06 smithi105 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service: Main process exited, code=exited, status=139/n/a 2023-10-08T08:47:06.771 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:06 smithi105 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service: Failed with result 'exit-code'. 2023-10-08T08:47:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:08 smithi191 ceph-mon[104220]: pgmap v391: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 252 op/s 2023-10-08T08:47:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:08 smithi070 ceph-mon[99513]: pgmap v391: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 252 op/s 2023-10-08T08:47:08.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:08 smithi105 ceph-mon[103798]: pgmap v391: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 252 op/s 2023-10-08T08:47:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:10 smithi191 ceph-mon[104220]: pgmap v392: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.1 MiB/s wr, 293 op/s 2023-10-08T08:47:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:10 smithi070 ceph-mon[99513]: pgmap v392: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.1 MiB/s wr, 293 op/s 2023-10-08T08:47:10.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:10 smithi105 ceph-mon[103798]: pgmap v392: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.1 MiB/s wr, 293 op/s 2023-10-08T08:47:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:12 smithi191 ceph-mon[104220]: pgmap v393: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 335 op/s 2023-10-08T08:47:12.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:12 smithi070 ceph-mon[99513]: pgmap v393: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 335 op/s 2023-10-08T08:47:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:12 smithi105 ceph-mon[103798]: pgmap v393: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 335 op/s 2023-10-08T08:47:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:14 smithi191 ceph-mon[104220]: pgmap v394: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1.1 MiB/s wr, 297 op/s 2023-10-08T08:47:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:47:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:47:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:47:14.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:14 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:47:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:14 smithi070 ceph-mon[99513]: pgmap v394: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1.1 MiB/s wr, 297 op/s 2023-10-08T08:47:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:47:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:47:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:47:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:14 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:47:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:14 smithi105 ceph-mon[103798]: pgmap v394: 129 pgs: 129 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1.1 MiB/s wr, 297 op/s 2023-10-08T08:47:14.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:47:14.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:47:14.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:47:14.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:14 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:47:16.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:16 smithi191 ceph-mon[104220]: pgmap v395: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 1.1 MiB/s wr, 285 op/s 2023-10-08T08:47:16.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:16 smithi070 ceph-mon[99513]: pgmap v395: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 1.1 MiB/s wr, 285 op/s 2023-10-08T08:47:16.771 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:16 smithi105 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service: Service RestartSec=10s expired, scheduling restart. 2023-10-08T08:47:16.772 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:16 smithi105 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service: Scheduled restart job, restart counter is at 2. 2023-10-08T08:47:16.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:16 smithi105 ceph-mon[103798]: pgmap v395: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 1.1 MiB/s wr, 285 op/s 2023-10-08T08:47:17.122 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:16 smithi105 systemd[1]: Stopped Ceph mds.e for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:47:17.122 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:16 smithi105 systemd[1]: Starting Ceph mds.e for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:47:17.372 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:17 smithi105 podman[145444]: 2023-10-08T08:47:17.770 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:17 smithi105 ceph-mds[145483]: -- 172.21.15.105:0/3469528875 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5646a07431e0 con 0x5646a0719000 2023-10-08T08:47:17.770 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:17 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[145459]: starting mds.e at 2023-10-08T08:47:17.771 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:17 smithi105 bash[145444]: 28afd06ba02db4c4781b03a44202de52bd30f415d331451d6fbdf1e6a2b89908 2023-10-08T08:47:17.771 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:47:17 smithi105 systemd[1]: Started Ceph mds.e for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:47:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.075+0000 7f7657b11700 1 -- 172.21.15.70:0/2348721188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 msgr2=0x7f76500ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.075+0000 7f7657b11700 1 --2- 172.21.15.70:0/2348721188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 0x7f76500ffa50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f764c009990 tx=0x7f764c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.075+0000 7f7657b11700 1 -- 172.21.15.70:0/2348721188 shutdown_connections 2023-10-08T08:47:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.075+0000 7f7657b11700 1 --2- 172.21.15.70:0/2348721188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76500fff90 0x7f765010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.075+0000 7f7657b11700 1 --2- 172.21.15.70:0/2348721188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76501045e0 0x7f76501049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.075+0000 7f7657b11700 1 --2- 172.21.15.70:0/2348721188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 0x7f76500ffa50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.075+0000 7f7657b11700 1 -- 172.21.15.70:0/2348721188 >> 172.21.15.70:0/2348721188 conn(0x7f7650076790 msgr2=0x7f7650076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.075+0000 7f7657b11700 1 -- 172.21.15.70:0/2348721188 shutdown_connections 2023-10-08T08:47:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.075+0000 7f7657b11700 1 -- 172.21.15.70:0/2348721188 wait complete. 2023-10-08T08:47:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f7657b11700 1 Processor -- start 2023-10-08T08:47:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f7657b11700 1 -- start start 2023-10-08T08:47:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f7657b11700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 0x7f7650197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f7657b11700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76500fff90 0x7f7650197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f7657b11700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76501045e0 0x7f76501a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f7657b11700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76501986e0 con 0x7f76500ff5d0 2023-10-08T08:47:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f7657b11700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76501a2f10 con 0x7f76501045e0 2023-10-08T08:47:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f7657b11700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76501a3050 con 0x7f76500fff90 2023-10-08T08:47:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76558ad700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 0x7f7650197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76558ad700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 0x7f7650197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53120/0 (socket says 172.21.15.70:53120) 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76558ad700 1 -- 172.21.15.70:0/3684660940 learned_addr learned my addr 172.21.15.70:0/3684660940 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76560ae700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76501045e0 0x7f76501a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76550ac700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76500fff90 0x7f7650197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76558ad700 1 -- 172.21.15.70:0/3684660940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76500fff90 msgr2=0x7f7650197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76558ad700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76500fff90 0x7f7650197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76558ad700 1 -- 172.21.15.70:0/3684660940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76501045e0 msgr2=0x7f76501a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76558ad700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76501045e0 0x7f76501a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76558ad700 1 -- 172.21.15.70:0/3684660940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c0095f0 con 0x7f76500ff5d0 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f76558ad700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 0x7f7650197950 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f764000e9a0 tx=0x7f764000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.076+0000 7f7646ffd700 1 -- 172.21.15.70:0/3684660940 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640009790 con 0x7f76500ff5d0 2023-10-08T08:47:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.077+0000 7f7646ffd700 1 -- 172.21.15.70:0/3684660940 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76400044e0 con 0x7f76500ff5d0 2023-10-08T08:47:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.077+0000 7f7657b11700 1 -- 172.21.15.70:0/3684660940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76501a32b0 con 0x7f76500ff5d0 2023-10-08T08:47:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.077+0000 7f7646ffd700 1 -- 172.21.15.70:0/3684660940 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640003d20 con 0x7f76500ff5d0 2023-10-08T08:47:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.077+0000 7f7657b11700 1 -- 172.21.15.70:0/3684660940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76501a37c0 con 0x7f76500ff5d0 2023-10-08T08:47:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.079+0000 7f7646ffd700 1 -- 172.21.15.70:0/3684660940 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f7640003e80 con 0x7f76500ff5d0 2023-10-08T08:47:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.079+0000 7f7646ffd700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f763c0a15f0 0x7f763c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.079+0000 7f76550ac700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f763c0a15f0 0x7f763c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.079+0000 7f7646ffd700 1 -- 172.21.15.70:0/3684660940 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7640014070 con 0x7f76500ff5d0 2023-10-08T08:47:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.080+0000 7f76550ac700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f763c0a15f0 0x7f763c0a3ab0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f764c006010 tx=0x7f764c00b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.080+0000 7f7663cfab80 1 Processor -- start 2023-10-08T08:47:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.080+0000 7f7663cfab80 1 -- start start 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.080+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dd170 0x55ed8e4dd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.080+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.080+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.080+0000 7f7663cfab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e441400 con 0x55ed8e4dda90 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.080+0000 7f7663cfab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e432bc0 con 0x55ed8e4dd170 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.080+0000 7f7663cfab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e4304e0 con 0x55ed8e4e1e60 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76550ac700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76558ad700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dd170 0x55ed8e4dd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76550ac700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53130/0 (socket says 172.21.15.70:53130) 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76558ad700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dd170 0x55ed8e4dd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40586/0 (socket says 172.21.15.70:40586) 2023-10-08T08:47:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76550ac700 1 -- 172.21.15.70:0/712312577 learned_addr learned my addr 172.21.15.70:0/712312577 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76560ae700 1 --2- 172.21.15.70:0/712312577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76550ac700 1 -- 172.21.15.70:0/712312577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4e1e60 msgr2=0x55ed8e4e22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76550ac700 1 --2- 172.21.15.70:0/712312577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76550ac700 1 -- 172.21.15.70:0/712312577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dd170 msgr2=0x55ed8e4dd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76550ac700 1 --2- 172.21.15.70:0/712312577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dd170 0x55ed8e4dd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76550ac700 1 -- 172.21.15.70:0/712312577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed8e256d80 con 0x55ed8e4dda90 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76558ad700 1 --2- 172.21.15.70:0/712312577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dd170 0x55ed8e4dd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f76550ac700 1 --2- 172.21.15.70:0/712312577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e1920 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f764c00b640 tx=0x7f764c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd04b3c68b5d59f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f763bfff700 1 -- 172.21.15.70:0/712312577 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c02b070 con 0x55ed8e4dda90 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f763bfff700 1 -- 172.21.15.70:0/712312577 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f764c01e040 con 0x55ed8e4dda90 2023-10-08T08:47:18.089 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.081+0000 7f763bfff700 1 -- 172.21.15.70:0/712312577 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c004cc0 con 0x55ed8e4dda90 2023-10-08T08:47:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 -- 172.21.15.70:0/712312577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4dda90 msgr2=0x55ed8e4e1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 --2- 172.21.15.70:0/712312577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e1920 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f764c00b640 tx=0x7f764c01f000 comp rx=0 tx=0).stop 2023-10-08T08:47:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 -- 172.21.15.70:0/712312577 shutdown_connections 2023-10-08T08:47:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 --2- 172.21.15.70:0/712312577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 --2- 172.21.15.70:0/712312577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dd170 0x55ed8e4dd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 --2- 172.21.15.70:0/712312577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e1920 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 -- 172.21.15.70:0/712312577 >> 172.21.15.70:0/712312577 conn(0x55ed8e44d200 msgr2=0x55ed8e4d3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 -- 172.21.15.70:0/712312577 shutdown_connections 2023-10-08T08:47:18.090 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 -- 172.21.15.70:0/712312577 wait complete. 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 -- start start 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.082+0000 7f7663cfab80 1 Processor -- start 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f7663cfab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e42bdd0 con 0x55ed8e4e1e60 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f7663cfab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e3c86b0 con 0x55ed8e4dda90 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f7663cfab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e3c8350 con 0x55ed8e4dd170 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f7663cfab80 10 client.0 _ll_register_callbacks cb 0x55ed8e2257a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76560ae700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.091 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76560ae700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53138/0 (socket says 172.21.15.70:53138) 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76560ae700 1 -- 172.21.15.70:0/1056678132 learned_addr learned my addr 172.21.15.70:0/1056678132 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76558ad700 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76550ac700 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76560ae700 1 -- 172.21.15.70:0/1056678132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 msgr2=0x55ed8e4e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76560ae700 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4e96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76560ae700 1 -- 172.21.15.70:0/1056678132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 msgr2=0x55ed8e4e69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76560ae700 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76560ae700 1 -- 172.21.15.70:0/1056678132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76501a37c0 con 0x55ed8e4e1e60 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76560ae700 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e7100 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7648011f60 tx=0x7f7648014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb376d90fb1ab2bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.083+0000 7f76397fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f76397fa700 1 -- 172.21.15.70:0/1056678132 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800e040 con 0x55ed8e4e1e60 2023-10-08T08:47:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f76397fa700 1 -- 172.21.15.70:0/1056678132 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7648014ba0 con 0x55ed8e4e1e60 2023-10-08T08:47:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f7663cfab80 1 -- 172.21.15.70:0/1056678132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed8e3f3e50 con 0x55ed8e4e1e60 2023-10-08T08:47:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f76397fa700 1 -- 172.21.15.70:0/1056678132 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7648014d60 con 0x55ed8e4e1e60 2023-10-08T08:47:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f7663cfab80 10 client.16590 fetch_fsmap learned FSMap version 45 2023-10-08T08:47:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f7663cfab80 1 -- 172.21.15.70:0/1056678132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x7f765010cd90 con 0x55ed8e4e1e60 2023-10-08T08:47:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f76397fa700 1 -- 172.21.15.70:0/1056678132 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ed8e3f3e50 con 0x55ed8e4e1e60 2023-10-08T08:47:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f76397fa700 1 -- 172.21.15.70:0/1056678132 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f764801c020 con 0x55ed8e4e1e60 2023-10-08T08:47:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f7663cfab80 10 client.16590 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T08:47:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f7663cfab80 10 client.16590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f7663cfab80 20 client.16590 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ed8e4f7200 0x55ed8e4f9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f7663cfab80 4 client.16590 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:47:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f7663cfab80 1 -- 172.21.15.70:0/1056678132 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed8e424db0 con 0x55ed8e4f7200 2023-10-08T08:47:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.084+0000 7f76558ad700 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ed8e4f7200 0x55ed8e4f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.085+0000 7f76397fa700 10 client.16590 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.085+0000 7f76558ad700 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ed8e4f7200 0x55ed8e4f9620 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c0c0545822cd77b server_cookie=4cbe2e6b80bd0b3 in_seq=0 out_seq=0 2023-10-08T08:47:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.089+0000 7f76397fa700 1 -- 172.21.15.70:0/1056678132 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ed8e424db0 con 0x55ed8e4f7200 2023-10-08T08:47:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.089+0000 7f76397fa700 10 client.16590 handle_command_reply: tid=0 2023-10-08T08:47:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 client.16590 shutdown 2023-10-08T08:47:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 -- 172.21.15.70:0/1056678132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 msgr2=0x55ed8e4e7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e7100 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7648011f60 tx=0x7f7648014600 comp rx=0 tx=0).stop 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 -- 172.21.15.70:0/1056678132 shutdown_connections 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4e7100 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ed8e4f7200 0x55ed8e4f9620 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1056678132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f76397fa700 0 client.16590 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 -- 172.21.15.70:0/1056678132 >> 172.21.15.70:0/1056678132 conn(0x55ed8e44d200 msgr2=0x55ed8e4e32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 -- 172.21.15.70:0/1056678132 shutdown_connections 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 1 -- 172.21.15.70:0/1056678132 wait complete. 2023-10-08T08:47:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.090+0000 7f7663cfab80 20 client.16590 trim_cache size 0 max 16384 2023-10-08T08:47:18.110 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.104+0000 7f7663cfab80 1 Processor -- start 2023-10-08T08:47:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7663cfab80 1 -- start start 2023-10-08T08:47:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4ee020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4f2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7663cfab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e2ac8c0 con 0x55ed8e4e1e60 2023-10-08T08:47:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7663cfab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e4ee590 con 0x55ed8e4dda90 2023-10-08T08:47:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7663cfab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e4e4f10 con 0x55ed8e4dd170 2023-10-08T08:47:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76560ae700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76560ae700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53146/0 (socket says 172.21.15.70:53146) 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76560ae700 1 -- 172.21.15.70:0/1023299297 learned_addr learned my addr 172.21.15.70:0/1023299297 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76558ad700 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4ee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76550ac700 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76560ae700 1 -- 172.21.15.70:0/1023299297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 msgr2=0x55ed8e4ee020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76560ae700 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4ee020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76560ae700 1 -- 172.21.15.70:0/1023299297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 msgr2=0x55ed8e4cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76560ae700 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76560ae700 1 -- 172.21.15.70:0/1023299297 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed8e23fc00 con 0x55ed8e4e1e60 2023-10-08T08:47:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76550ac700 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f76560ae700 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4f2770 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7648004920 tx=0x7f7648004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5285a8203fe7d2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7644d82700 1 -- 172.21.15.70:0/1023299297 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800e040 con 0x55ed8e4e1e60 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7644d82700 1 -- 172.21.15.70:0/1023299297 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f764800f040 con 0x55ed8e4e1e60 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.105+0000 7f7644d82700 1 -- 172.21.15.70:0/1023299297 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480079f0 con 0x55ed8e4e1e60 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 -- 172.21.15.70:0/1023299297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 msgr2=0x55ed8e4f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4f2770 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7648004920 tx=0x7f7648004950 comp rx=0 tx=0).stop 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 -- 172.21.15.70:0/1023299297 shutdown_connections 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e4f2770 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4ee020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 --2- 172.21.15.70:0/1023299297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 -- 172.21.15.70:0/1023299297 >> 172.21.15.70:0/1023299297 conn(0x55ed8e44d200 msgr2=0x55ed8e4fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 -- 172.21.15.70:0/1023299297 shutdown_connections 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 -- 172.21.15.70:0/1023299297 wait complete. 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 -- start start 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.106+0000 7f7663cfab80 1 Processor -- start 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4ec000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4ec540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f7663cfab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e54a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f7663cfab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e4eccb0 con 0x55ed8e4e1e60 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f7663cfab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e4ece20 con 0x55ed8e4dda90 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f7663cfab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8e54a570 con 0x55ed8e4dd170 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f7663cfab80 10 client.0 _ll_register_callbacks cb 0x7f76480118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76560ae700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e54a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76558ad700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76560ae700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e54a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53152/0 (socket says 172.21.15.70:53152) 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76560ae700 1 -- 172.21.15.70:0/3549519540 learned_addr learned my addr 172.21.15.70:0/3549519540 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76550ac700 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4ec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76560ae700 1 -- 172.21.15.70:0/3549519540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 msgr2=0x55ed8e4ec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76560ae700 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4ec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76560ae700 1 -- 172.21.15.70:0/3549519540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 msgr2=0x55ed8e4ec540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76560ae700 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4ec540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76560ae700 1 -- 172.21.15.70:0/3549519540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765010cd90 con 0x55ed8e4e1e60 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76558ad700 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76560ae700 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e54a030 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7648000f80 tx=0x7f7648009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0100d639bbd936 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.107+0000 7f76397fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f76397fa700 1 -- 172.21.15.70:0/3549519540 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800e040 con 0x55ed8e4e1e60 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f76397fa700 1 -- 172.21.15.70:0/3549519540 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7648004c80 con 0x55ed8e4e1e60 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f7663cfab80 1 -- 172.21.15.70:0/3549519540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f764c01e040 con 0x55ed8e4e1e60 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f76397fa700 1 -- 172.21.15.70:0/3549519540 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7648004e60 con 0x55ed8e4e1e60 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f7663cfab80 10 client.16596 fetch_fsmap learned FSMap version 45 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f7663cfab80 1 -- 172.21.15.70:0/3549519540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ed8e27d1f0 con 0x55ed8e4e1e60 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f76397fa700 1 -- 172.21.15.70:0/3549519540 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f764c01e040 con 0x55ed8e4e1e60 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f76397fa700 1 -- 172.21.15.70:0/3549519540 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f7648033070 con 0x55ed8e4e1e60 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f7663cfab80 10 client.16596 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f7663cfab80 10 client.16596 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f7663cfab80 20 client.16596 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f7663cfab80 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ed8e54b910 0x55ed8e54dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f7663cfab80 4 client.16596 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:47:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f7663cfab80 1 -- 172.21.15.70:0/3549519540 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ed8e424ad0 con 0x55ed8e54b910 2023-10-08T08:47:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.108+0000 7f76558ad700 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ed8e54b910 0x55ed8e54dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.109+0000 7f76397fa700 10 client.16596 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.109+0000 7f76558ad700 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ed8e54b910 0x55ed8e54dd30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d2fb7aa5adaf21 server_cookie=640755f1ab1b1b28 in_seq=0 out_seq=0 2023-10-08T08:47:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f76397fa700 1 -- 172.21.15.70:0/3549519540 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ed8e424ad0 con 0x55ed8e54b910 2023-10-08T08:47:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f76397fa700 10 client.16596 handle_command_reply: tid=0 2023-10-08T08:47:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 client.16596 shutdown 2023-10-08T08:47:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 -- 172.21.15.70:0/3549519540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 msgr2=0x55ed8e54a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e54a030 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7648000f80 tx=0x7f7648009510 comp rx=0 tx=0).stop 2023-10-08T08:47:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 -- 172.21.15.70:0/3549519540 shutdown_connections 2023-10-08T08:47:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed8e4e1e60 0x55ed8e54a030 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ed8e4dd170 0x55ed8e4ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ed8e54b910 0x55ed8e54dd30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 --2- 172.21.15.70:0/3549519540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed8e4dda90 0x55ed8e4ec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 -- 172.21.15.70:0/3549519540 >> 172.21.15.70:0/3549519540 conn(0x55ed8e44d200 msgr2=0x55ed8e4cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f76397fa700 0 client.16596 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 -- 172.21.15.70:0/3549519540 shutdown_connections 2023-10-08T08:47:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 1 -- 172.21.15.70:0/3549519540 wait complete. 2023-10-08T08:47:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.205+0000 7f7663cfab80 20 client.16596 trim_cache size 0 max 16384 2023-10-08T08:47:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:47:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:47:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:47:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:47:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 -- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f763c0a15f0 msgr2=0x7f763c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f763c0a15f0 0x7f763c0a3ab0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f764c006010 tx=0x7f764c00b260 comp rx=0 tx=0).stop 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 -- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 msgr2=0x7f7650197950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 0x7f7650197950 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f764000e9a0 tx=0x7f764000ecb0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 -- 172.21.15.70:0/3684660940 shutdown_connections 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f763c0a15f0 0x7f763c0a3ab0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76501045e0 0x7f76501a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76500ff5d0 0x7f7650197950 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 --2- 172.21.15.70:0/3684660940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76500fff90 0x7f7650197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 -- 172.21.15.70:0/3684660940 >> 172.21.15.70:0/3684660940 conn(0x7f7650076790 msgr2=0x7f76500fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 -- 172.21.15.70:0/3684660940 shutdown_connections 2023-10-08T08:47:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:18.206+0000 7f7657b11700 1 -- 172.21.15.70:0/3684660940 wait complete. 2023-10-08T08:47:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:18 smithi191 ceph-mon[104220]: pgmap v396: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 1.4 MiB/s wr, 343 op/s 2023-10-08T08:47:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:18 smithi191 ceph-mon[104220]: daemon mds.e restarted 2023-10-08T08:47:18.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:18 smithi070 ceph-mon[99513]: pgmap v396: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 1.4 MiB/s wr, 343 op/s 2023-10-08T08:47:18.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:18 smithi070 ceph-mon[99513]: daemon mds.e restarted 2023-10-08T08:47:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:18 smithi105 ceph-mon[103798]: pgmap v396: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 1.4 MiB/s wr, 343 op/s 2023-10-08T08:47:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:18 smithi105 ceph-mon[103798]: daemon mds.e restarted 2023-10-08T08:47:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:19 smithi191 ceph-mon[104220]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T08:47:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:19 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6834/269007402,v1:172.21.15.105:6835/269007402] up:boot 2023-10-08T08:47:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:19 smithi191 ceph-mon[104220]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T08:47:19.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:47:19.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:19 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:47:19.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:19 smithi070 ceph-mon[99513]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T08:47:19.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:19 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6834/269007402,v1:172.21.15.105:6835/269007402] up:boot 2023-10-08T08:47:19.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:19 smithi070 ceph-mon[99513]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T08:47:19.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:47:19.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:19 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:47:19.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:19 smithi105 ceph-mon[103798]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T08:47:19.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:19 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6834/269007402,v1:172.21.15.105:6835/269007402] up:boot 2023-10-08T08:47:19.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:19 smithi105 ceph-mon[103798]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T08:47:19.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:47:19.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:19 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:47:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:20 smithi191 ceph-mon[104220]: pgmap v398: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 1.0 MiB/s wr, 238 op/s 2023-10-08T08:47:20.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:20 smithi070 ceph-mon[99513]: pgmap v398: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 1.0 MiB/s wr, 238 op/s 2023-10-08T08:47:20.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:20 smithi105 ceph-mon[103798]: pgmap v398: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 1.0 MiB/s wr, 238 op/s 2023-10-08T08:47:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:22 smithi191 ceph-mon[104220]: pgmap v399: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 270 op/s 2023-10-08T08:47:22.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:22 smithi070 ceph-mon[99513]: pgmap v399: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 270 op/s 2023-10-08T08:47:22.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:22 smithi105 ceph-mon[103798]: pgmap v399: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 270 op/s 2023-10-08T08:47:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:24 smithi191 ceph-mon[104220]: pgmap v400: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 307 op/s 2023-10-08T08:47:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:24 smithi070 ceph-mon[99513]: pgmap v400: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 307 op/s 2023-10-08T08:47:24.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:24 smithi105 ceph-mon[103798]: pgmap v400: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 307 op/s 2023-10-08T08:47:25.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:25 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:47:25.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:25 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:47:25.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:25 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:47:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:26 smithi191 ceph-mon[104220]: scrub summary: active paths [/] 2023-10-08T08:47:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:26 smithi191 ceph-mon[104220]: scrub summary: idle+waiting paths [/] 2023-10-08T08:47:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:26 smithi191 ceph-mon[104220]: pgmap v401: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 837 KiB/s wr, 326 op/s 2023-10-08T08:47:26.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:26 smithi070 ceph-mon[99513]: scrub summary: active paths [/] 2023-10-08T08:47:26.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:26 smithi070 ceph-mon[99513]: scrub summary: idle+waiting paths [/] 2023-10-08T08:47:26.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:26 smithi070 ceph-mon[99513]: pgmap v401: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 837 KiB/s wr, 326 op/s 2023-10-08T08:47:26.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:26 smithi105 ceph-mon[103798]: scrub summary: active paths [/] 2023-10-08T08:47:26.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:26 smithi105 ceph-mon[103798]: scrub summary: idle+waiting paths [/] 2023-10-08T08:47:26.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:26 smithi105 ceph-mon[103798]: pgmap v401: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 837 KiB/s wr, 326 op/s 2023-10-08T08:47:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:28 smithi191 ceph-mon[104220]: pgmap v402: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 398 op/s 2023-10-08T08:47:28.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:28 smithi070 ceph-mon[99513]: pgmap v402: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 398 op/s 2023-10-08T08:47:28.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:28 smithi105 ceph-mon[103798]: pgmap v402: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 398 op/s 2023-10-08T08:47:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:30 smithi191 ceph-mon[104220]: pgmap v403: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 407 op/s 2023-10-08T08:47:30.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:30 smithi070 ceph-mon[99513]: pgmap v403: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 407 op/s 2023-10-08T08:47:30.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:30 smithi105 ceph-mon[103798]: pgmap v403: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 407 op/s 2023-10-08T08:47:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 -- 172.21.15.70:0/975025237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb40fff90 msgr2=0x7efeb410c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 --2- 172.21.15.70:0/975025237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb40fff90 0x7efeb410c490 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7efea4009990 tx=0x7efea4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 -- 172.21.15.70:0/975025237 shutdown_connections 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 --2- 172.21.15.70:0/975025237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb40fff90 0x7efeb410c490 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 --2- 172.21.15.70:0/975025237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeb41045e0 0x7efeb41049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 --2- 172.21.15.70:0/975025237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb40ff5d0 0x7efeb40ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 -- 172.21.15.70:0/975025237 >> 172.21.15.70:0/975025237 conn(0x7efeb4076790 msgr2=0x7efeb4076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 -- 172.21.15.70:0/975025237 shutdown_connections 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 -- 172.21.15.70:0/975025237 wait complete. 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.314+0000 7efeb9731700 1 Processor -- start 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb9731700 1 -- start start 2023-10-08T08:47:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb9731700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb40ff5d0 0x7efeb41978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb9731700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeb40fff90 0x7efeb4197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb9731700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb41045e0 0x7efeb41a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb9731700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4198660 con 0x7efeb41045e0 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb9731700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41a2e90 con 0x7efeb40ff5d0 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb9731700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41a2fd0 con 0x7efeb40fff90 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb41045e0 0x7efeb41a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb41045e0 0x7efeb41a2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53166/0 (socket says 172.21.15.70:53166) 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb37fe700 1 -- 172.21.15.70:0/1700454182 learned_addr learned my addr 172.21.15.70:0/1700454182 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb27fc700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeb40fff90 0x7efeb4197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb40ff5d0 0x7efeb41978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb37fe700 1 -- 172.21.15.70:0/1700454182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeb40fff90 msgr2=0x7efeb4197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb37fe700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeb40fff90 0x7efeb4197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb37fe700 1 -- 172.21.15.70:0/1700454182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb40ff5d0 msgr2=0x7efeb41978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb37fe700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb40ff5d0 0x7efeb41978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb37fe700 1 -- 172.21.15.70:0/1700454182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40095f0 con 0x7efeb41045e0 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb27fc700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeb40fff90 0x7efeb4197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.315+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb40ff5d0 0x7efeb41978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.316+0000 7efeb37fe700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb41045e0 0x7efeb41a2950 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7efea4004760 tx=0x7efea4004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.316+0000 7efeabfff700 1 -- 172.21.15.70:0/1700454182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea401d070 con 0x7efeb41045e0 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.316+0000 7efeabfff700 1 -- 172.21.15.70:0/1700454182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efea4022470 con 0x7efeb41045e0 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.316+0000 7efeb9731700 1 -- 172.21.15.70:0/1700454182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb41a31d0 con 0x7efeb41045e0 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.316+0000 7efeabfff700 1 -- 172.21.15.70:0/1700454182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4017650 con 0x7efeb41045e0 2023-10-08T08:47:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.316+0000 7efeb9731700 1 -- 172.21.15.70:0/1700454182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb41a35f0 con 0x7efeb41045e0 2023-10-08T08:47:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.318+0000 7efeabfff700 1 -- 172.21.15.70:0/1700454182 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7efea400fad0 con 0x7efeb41045e0 2023-10-08T08:47:31.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.318+0000 7efeabfff700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efea00a15f0 0x7efea00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.319+0000 7efeabfff700 1 -- 172.21.15.70:0/1700454182 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7efea40ce700 con 0x7efeb41045e0 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.319+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efea00a15f0 0x7efea00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.319+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efea00a15f0 0x7efea00a3ab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efeb4069cf0 tx=0x7efeac00b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.319+0000 7efec591ab80 1 Processor -- start 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efec591ab80 1 -- start start 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efec591ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 0x55e1c77e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efec591ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efec591ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e20b0 0x55e1c77e2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efec591ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c774a400 con 0x55e1c77e81a0 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efec591ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c773bbc0 con 0x55e1c77e7880 2023-10-08T08:47:31.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efec591ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c77394e0 con 0x55e1c77e20b0 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53172/0 (socket says 172.21.15.70:53172) 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb27fc700 1 -- 172.21.15.70:0/3252500959 learned_addr learned my addr 172.21.15.70:0/3252500959 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb37fe700 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e20b0 0x55e1c77e2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 0x55e1c77e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb27fc700 1 -- 172.21.15.70:0/3252500959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e20b0 msgr2=0x55e1c77e2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb27fc700 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e20b0 0x55e1c77e2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb27fc700 1 -- 172.21.15.70:0/3252500959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 msgr2=0x55e1c77e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb27fc700 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 0x55e1c77e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb27fc700 1 -- 172.21.15.70:0/3252500959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1c755fd80 con 0x55e1c77e81a0 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 0x55e1c77e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:47:31.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.320+0000 7efeb27fc700 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e1b70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0115f0 tx=0x7efe9c011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae57b92c49200c63 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efea97fa700 1 -- 172.21.15.70:0/3252500959 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c004230 con 0x55e1c77e81a0 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efea97fa700 1 -- 172.21.15.70:0/3252500959 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe9c004390 con 0x55e1c77e81a0 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efea97fa700 1 -- 172.21.15.70:0/3252500959 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c019830 con 0x55e1c77e81a0 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efec591ab80 1 -- 172.21.15.70:0/3252500959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 msgr2=0x55e1c77e1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efec591ab80 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e1b70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0115f0 tx=0x7efe9c011900 comp rx=0 tx=0).stop 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efec591ab80 1 -- 172.21.15.70:0/3252500959 shutdown_connections 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efec591ab80 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e20b0 0x55e1c77e2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efec591ab80 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 0x55e1c77e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efec591ab80 1 --2- 172.21.15.70:0/3252500959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e1b70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efec591ab80 1 -- 172.21.15.70:0/3252500959 >> 172.21.15.70:0/3252500959 conn(0x55e1c7756200 msgr2=0x55e1c77dcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:31.330 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efec591ab80 1 -- 172.21.15.70:0/3252500959 shutdown_connections 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.321+0000 7efec591ab80 1 -- 172.21.15.70:0/3252500959 wait complete. 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efec591ab80 1 -- start start 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efec591ab80 1 Processor -- start 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efec591ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e20b0 0x55e1c77ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efec591ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 0x55e1c77eb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efec591ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 0x55e1c77ebb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efec591ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c7734dd0 con 0x55e1c77e20b0 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efec591ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c76d16b0 con 0x55e1c77e7880 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efec591ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c76d1350 con 0x55e1c77e81a0 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efeb2ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e20b0 0x55e1c77ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efec591ab80 10 client.0 _ll_register_callbacks cb 0x55e1c752e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efeb2ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e20b0 0x55e1c77ee1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53176/0 (socket says 172.21.15.70:53176) 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efeb2ffd700 1 -- 172.21.15.70:0/1044482464 learned_addr learned my addr 172.21.15.70:0/1044482464 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efeb37fe700 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 0x55e1c77ebb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.322+0000 7efeb27fc700 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 0x55e1c77eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efeb2ffd700 1 -- 172.21.15.70:0/1044482464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 msgr2=0x55e1c77ebb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 0x55e1c77ebb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efeb2ffd700 1 -- 172.21.15.70:0/1044482464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 msgr2=0x55e1c77eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 0x55e1c77eb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efeb2ffd700 1 -- 172.21.15.70:0/1044482464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c009d50 con 0x55e1c77e20b0 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efeb37fe700 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 0x55e1c77ebb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e20b0 0x55e1c77ee1a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7efeac00ef70 tx=0x7efeac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b316c9406db791a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efe9a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1044482464 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac017dc0 con 0x55e1c77e20b0 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1044482464 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7efeac01c040 con 0x55e1c77e20b0 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efec591ab80 1 -- 172.21.15.70:0/1044482464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1c76fce50 con 0x55e1c77e20b0 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1044482464 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7efeac004bb0 con 0x55e1c77e20b0 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efec591ab80 10 client.16608 fetch_fsmap learned FSMap version 47 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efec591ab80 1 -- 172.21.15.70:0/1044482464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55e1c7548c00 con 0x55e1c77e20b0 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1044482464 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e1c76fce50 con 0x55e1c77e20b0 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1044482464 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7efeac005920 con 0x55e1c77e20b0 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efec591ab80 10 client.16608 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efec591ab80 10 client.16608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efec591ab80 20 client.16608 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.323+0000 7efec591ab80 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e1c77fbd30 0x55e1c77fe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.324+0000 7efec591ab80 4 client.16608 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.324+0000 7efec591ab80 1 -- 172.21.15.70:0/1044482464 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1c772ddb0 con 0x55e1c77fbd30 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.324+0000 7efeb27fc700 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e1c77fbd30 0x55e1c77fe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.324+0000 7efe9a7fc700 10 client.16608 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.324+0000 7efeb27fc700 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e1c77fbd30 0x55e1c77fe150 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38b8179c998a738 server_cookie=e2568dcab7975656 in_seq=0 out_seq=0 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1044482464 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e1c772ddb0 con 0x55e1c77fbd30 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efe9a7fc700 10 client.16608 handle_command_reply: tid=0 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 client.16608 shutdown 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 -- 172.21.15.70:0/1044482464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e20b0 msgr2=0x55e1c77ee1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e20b0 0x55e1c77ee1a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7efeac00ef70 tx=0x7efeac004ad0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 -- 172.21.15.70:0/1044482464 shutdown_connections 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 0x55e1c77ebb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e20b0 0x55e1c77ee1a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e1c77fbd30 0x55e1c77fe150 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 --2- 172.21.15.70:0/1044482464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e7880 0x55e1c77eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efe9a7fc700 0 client.16608 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 -- 172.21.15.70:0/1044482464 >> 172.21.15.70:0/1044482464 conn(0x55e1c7756200 msgr2=0x55e1c77dc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 -- 172.21.15.70:0/1044482464 shutdown_connections 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 1 -- 172.21.15.70:0/1044482464 wait complete. 2023-10-08T08:47:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.325+0000 7efec591ab80 20 client.16608 trim_cache size 0 max 16384 2023-10-08T08:47:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efec591ab80 1 Processor -- start 2023-10-08T08:47:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efec591ab80 1 -- start start 2023-10-08T08:47:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efec591ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 0x55e1c77f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efec591ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e7880 0x55e1c77e2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efec591ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 0x55e1c77dc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efec591ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c75b58c0 con 0x55e1c77e7880 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efec591ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c77ec410 con 0x55e1c77e20b0 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efec591ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c77d46f0 con 0x55e1c77e81a0 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e7880 0x55e1c77e2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb27fc700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e7880 0x55e1c77e2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53186/0 (socket says 172.21.15.70:53186) 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb27fc700 1 -- 172.21.15.70:0/3110726577 learned_addr learned my addr 172.21.15.70:0/3110726577 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb37fe700 1 --2- 172.21.15.70:0/3110726577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 0x55e1c77dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/3110726577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 0x55e1c77f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb27fc700 1 -- 172.21.15.70:0/3110726577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 msgr2=0x55e1c77dc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb27fc700 1 --2- 172.21.15.70:0/3110726577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 0x55e1c77dc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb27fc700 1 -- 172.21.15.70:0/3110726577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 msgr2=0x55e1c77f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb27fc700 1 --2- 172.21.15.70:0/3110726577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 0x55e1c77f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.340+0000 7efeb27fc700 1 -- 172.21.15.70:0/3110726577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1c75861f0 con 0x55e1c77e7880 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.341+0000 7efeb27fc700 1 --2- 172.21.15.70:0/3110726577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e7880 0x55e1c77e2490 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7efe9c01b040 tx=0x7efe9c011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5afd958c1482e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.341+0000 7efea9ffb700 1 -- 172.21.15.70:0/3110726577 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c029040 con 0x55e1c77e7880 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.341+0000 7efea9ffb700 1 -- 172.21.15.70:0/3110726577 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe9c005c20 con 0x55e1c77e7880 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.341+0000 7efea9ffb700 1 -- 172.21.15.70:0/3110726577 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c02ab20 con 0x55e1c77e7880 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.341+0000 7efec591ab80 1 -- 172.21.15.70:0/3110726577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e7880 msgr2=0x55e1c77e2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.341+0000 7efec591ab80 1 --2- 172.21.15.70:0/3110726577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e7880 0x55e1c77e2490 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7efe9c01b040 tx=0x7efe9c011900 comp rx=0 tx=0).stop 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 -- 172.21.15.70:0/3110726577 shutdown_connections 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 --2- 172.21.15.70:0/3110726577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e81a0 0x55e1c77dc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 --2- 172.21.15.70:0/3110726577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 0x55e1c77f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 --2- 172.21.15.70:0/3110726577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e7880 0x55e1c77e2490 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 -- 172.21.15.70:0/3110726577 >> 172.21.15.70:0/3110726577 conn(0x55e1c7756200 msgr2=0x55e1c7802ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 -- 172.21.15.70:0/3110726577 shutdown_connections 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 -- 172.21.15.70:0/3110726577 wait complete. 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 -- start start 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 Processor -- start 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 0x55e1c77e3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e7880 0x55e1c77e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c77e43a0 con 0x55e1c77e81a0 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c77e4510 con 0x55e1c77e20b0 2023-10-08T08:47:31.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.342+0000 7efec591ab80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c77e46d0 con 0x55e1c77e7880 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efec591ab80 10 client.0 _ll_register_callbacks cb 0x7efeac00e890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb2ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 0x55e1c77e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb37fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53194/0 (socket says 172.21.15.70:53194) 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb37fe700 1 -- 172.21.15.70:0/1972860198 learned_addr learned my addr 172.21.15.70:0/1972860198 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb27fc700 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e7880 0x55e1c77e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb37fe700 1 -- 172.21.15.70:0/1972860198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e7880 msgr2=0x55e1c77e38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb37fe700 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e7880 0x55e1c77e38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb37fe700 1 -- 172.21.15.70:0/1972860198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 msgr2=0x55e1c77e3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb37fe700 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 0x55e1c77e3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb37fe700 1 -- 172.21.15.70:0/1972860198 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1c755fd80 con 0x55e1c77e81a0 2023-10-08T08:47:31.349 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb27fc700 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e7880 0x55e1c77e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:31.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efeb37fe700 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e3e10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7efea4004800 tx=0x7efea409afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedae627af0fd086 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:31.350 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.343+0000 7efe9a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:47:31.351 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1972860198 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea409bba0 con 0x55e1c77e81a0 2023-10-08T08:47:31.351 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1972860198 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7efea409b4a0 con 0x55e1c77e81a0 2023-10-08T08:47:31.351 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efec591ab80 1 -- 172.21.15.70:0/1972860198 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe9c004390 con 0x55e1c77e81a0 2023-10-08T08:47:31.351 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1972860198 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7efea409f5f0 con 0x55e1c77e81a0 2023-10-08T08:47:31.351 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efec591ab80 10 client.16614 fetch_fsmap learned FSMap version 47 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efec591ab80 1 -- 172.21.15.70:0/1972860198 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55e1c755e250 con 0x55e1c77e81a0 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1972860198 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe9c004390 con 0x55e1c77e81a0 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1972860198 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7efea409a990 con 0x55e1c77e81a0 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efec591ab80 10 client.16614 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efec591ab80 10 client.16614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efec591ab80 20 client.16614 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efec591ab80 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e1c7850560 0x55e1c7852980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efec591ab80 4 client.16614 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.345+0000 7efec591ab80 1 -- 172.21.15.70:0/1972860198 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e1c772dad0 con 0x55e1c7850560 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.346+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e1c7850560 0x55e1c7852980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.346+0000 7efe9a7fc700 10 client.16614 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.346+0000 7efeb2ffd700 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e1c7850560 0x55e1c7852980 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=511d1d55586e9504 server_cookie=4d5ba90dc4021c59 in_seq=0 out_seq=0 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efe9a7fc700 1 -- 172.21.15.70:0/1972860198 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e1c772dad0 con 0x55e1c7850560 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efe9a7fc700 10 client.16614 handle_command_reply: tid=0 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 client.16614 shutdown 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 -- 172.21.15.70:0/1972860198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 msgr2=0x55e1c77e3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e3e10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7efea4004800 tx=0x7efea409afe0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 -- 172.21.15.70:0/1972860198 shutdown_connections 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e1c77e81a0 0x55e1c77e3e10 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55e1c7850560 0x55e1c7852980 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e1c77e20b0 0x55e1c77e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efe9a7fc700 0 client.16614 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 --2- 172.21.15.70:0/1972860198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e1c77e7880 0x55e1c77e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 -- 172.21.15.70:0/1972860198 >> 172.21.15.70:0/1972860198 conn(0x55e1c7756200 msgr2=0x55e1c77e2490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 -- 172.21.15.70:0/1972860198 shutdown_connections 2023-10-08T08:47:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 1 -- 172.21.15.70:0/1972860198 wait complete. 2023-10-08T08:47:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.409+0000 7efec591ab80 20 client.16614 trim_cache size 0 max 16384 2023-10-08T08:47:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:47:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:47:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:47:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:47:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 -- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efea00a15f0 msgr2=0x7efea00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efea00a15f0 0x7efea00a3ab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efeb4069cf0 tx=0x7efeac00b040 comp rx=0 tx=0).stop 2023-10-08T08:47:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 -- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb41045e0 msgr2=0x7efeb41a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb41045e0 0x7efeb41a2950 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7efea4004760 tx=0x7efea4004790 comp rx=0 tx=0).stop 2023-10-08T08:47:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 -- 172.21.15.70:0/1700454182 shutdown_connections 2023-10-08T08:47:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efea00a15f0 0x7efea00a3ab0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeb41045e0 0x7efeb41a2950 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb40ff5d0 0x7efeb41978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 --2- 172.21.15.70:0/1700454182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efeb40fff90 0x7efeb4197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 -- 172.21.15.70:0/1700454182 >> 172.21.15.70:0/1700454182 conn(0x7efeb4076790 msgr2=0x7efeb40fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 -- 172.21.15.70:0/1700454182 shutdown_connections 2023-10-08T08:47:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:31.410+0000 7efeb9731700 1 -- 172.21.15.70:0/1700454182 wait complete. 2023-10-08T08:47:32.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:32 smithi070 ceph-mon[99513]: pgmap v404: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 493 op/s 2023-10-08T08:47:32.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:32 smithi105 ceph-mon[103798]: pgmap v404: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 493 op/s 2023-10-08T08:47:32.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:32 smithi191 ceph-mon[104220]: pgmap v404: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 493 op/s 2023-10-08T08:47:34.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:34 smithi070 ceph-mon[99513]: pgmap v405: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 456 op/s 2023-10-08T08:47:34.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:34 smithi105 ceph-mon[103798]: pgmap v405: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 456 op/s 2023-10-08T08:47:34.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:34 smithi191 ceph-mon[104220]: pgmap v405: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 456 op/s 2023-10-08T08:47:35.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:47:35.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.138+0000 7f162bd94700 1 -- 172.21.15.70:0/3910267728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624106750 msgr2=0x7f1624106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.138+0000 7f162bd94700 1 --2- 172.21.15.70:0/3910267728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624106750 0x7f1624106b30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1620009990 tx=0x7f1620009ca0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.138+0000 7f162bd94700 1 -- 172.21.15.70:0/3910267728 shutdown_connections 2023-10-08T08:47:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.138+0000 7f162bd94700 1 --2- 172.21.15.70:0/3910267728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1624069740 0x7f162410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.138+0000 7f162bd94700 1 --2- 172.21.15.70:0/3910267728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624106750 0x7f1624106b30 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.138+0000 7f162bd94700 1 --2- 172.21.15.70:0/3910267728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1624068d80 0x7f1624069200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.138+0000 7f162bd94700 1 -- 172.21.15.70:0/3910267728 >> 172.21.15.70:0/3910267728 conn(0x7f16240767f0 msgr2=0x7f1624076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.138+0000 7f162bd94700 1 -- 172.21.15.70:0/3910267728 shutdown_connections 2023-10-08T08:47:35.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162bd94700 1 -- 172.21.15.70:0/3910267728 wait complete. 2023-10-08T08:47:35.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162bd94700 1 Processor -- start 2023-10-08T08:47:35.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162bd94700 1 -- start start 2023-10-08T08:47:35.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162bd94700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1624068d80 0x7f16240ff660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162bd94700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624069740 0x7f16240ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162bd94700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1624106750 0x7f16241000e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162bd94700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16241a4ef0 con 0x7f1624069740 2023-10-08T08:47:35.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162bd94700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16241a5060 con 0x7f1624068d80 2023-10-08T08:47:35.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162bd94700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16241a5220 con 0x7f1624106750 2023-10-08T08:47:35.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162932f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624069740 0x7f16240ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162932f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624069740 0x7f16240ffba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53204/0 (socket says 172.21.15.70:53204) 2023-10-08T08:47:35.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.139+0000 7f162932f700 1 -- 172.21.15.70:0/3091169514 learned_addr learned my addr 172.21.15.70:0/3091169514 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:35.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f1629b30700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1624068d80 0x7f16240ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f162a331700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1624106750 0x7f16241000e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f162932f700 1 -- 172.21.15.70:0/3091169514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1624106750 msgr2=0x7f16241000e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:35.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f162932f700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1624106750 0x7f16241000e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f162932f700 1 -- 172.21.15.70:0/3091169514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1624068d80 msgr2=0x7f16240ff660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:35.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f162932f700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1624068d80 0x7f16240ff660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f162932f700 1 -- 172.21.15.70:0/3091169514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200095f0 con 0x7f1624069740 2023-10-08T08:47:35.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f162932f700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624069740 0x7f16240ffba0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f161400e9a0 tx=0x7f161400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:35.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f161affd700 1 -- 172.21.15.70:0/3091169514 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614009790 con 0x7f1624069740 2023-10-08T08:47:35.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f162bd94700 1 -- 172.21.15.70:0/3091169514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16241a5500 con 0x7f1624069740 2023-10-08T08:47:35.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f161affd700 1 -- 172.21.15.70:0/3091169514 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1614010430 con 0x7f1624069740 2023-10-08T08:47:35.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f161affd700 1 -- 172.21.15.70:0/3091169514 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614018680 con 0x7f1624069740 2023-10-08T08:47:35.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.140+0000 7f162bd94700 1 -- 172.21.15.70:0/3091169514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16241a5a60 con 0x7f1624069740 2023-10-08T08:47:35.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.143+0000 7f161affd700 1 -- 172.21.15.70:0/3091169514 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f16140105a0 con 0x7f1624069740 2023-10-08T08:47:35.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.143+0000 7f161affd700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16100a15f0 0x7f16100a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.144+0000 7f161affd700 1 -- 172.21.15.70:0/3091169514 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1614014070 con 0x7f1624069740 2023-10-08T08:47:35.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.144+0000 7f1629b30700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16100a15f0 0x7f16100a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.144+0000 7f1629b30700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16100a15f0 0x7f16100a3ab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f162000b2e0 tx=0x7f1620005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:35.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f1637f7db80 1 Processor -- start 2023-10-08T08:47:35.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f1637f7db80 1 -- start start 2023-10-08T08:47:35.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f0e80 0x55dec35f1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec35fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f1637f7db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec355a460 con 0x55dec35f17a0 2023-10-08T08:47:35.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f1637f7db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec354bc20 con 0x55dec35fc650 2023-10-08T08:47:35.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f1637f7db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec3549540 con 0x55dec35f0e80 2023-10-08T08:47:35.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f162932f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec35fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f162a331700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f1629b30700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f0e80 0x55dec35f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f162932f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec35fc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53212/0 (socket says 172.21.15.70:53212) 2023-10-08T08:47:35.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f162a331700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35fea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40672/0 (socket says 172.21.15.70:40672) 2023-10-08T08:47:35.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.145+0000 7f162932f700 1 -- 172.21.15.70:0/3716811292 learned_addr learned my addr 172.21.15.70:0/3716811292 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:35.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f162932f700 1 -- 172.21.15.70:0/3716811292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f0e80 msgr2=0x55dec35f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:35.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f162932f700 1 --2- 172.21.15.70:0/3716811292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f0e80 0x55dec35f1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f162932f700 1 -- 172.21.15.70:0/3716811292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 msgr2=0x55dec35fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:35.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f162932f700 1 --2- 172.21.15.70:0/3716811292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f162932f700 1 -- 172.21.15.70:0/3716811292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dec336fde0 con 0x55dec35f17a0 2023-10-08T08:47:35.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f162a331700 1 --2- 172.21.15.70:0/3716811292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:35.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f162932f700 1 --2- 172.21.15.70:0/3716811292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec35fc110 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f16140a2100 tx=0x7f1614099ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930bc5970785c506 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:35.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f160ffff700 1 -- 172.21.15.70:0/3716811292 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16140b1070 con 0x55dec35f17a0 2023-10-08T08:47:35.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f160ffff700 1 -- 172.21.15.70:0/3716811292 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f161409e3f0 con 0x55dec35f17a0 2023-10-08T08:47:35.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.146+0000 7f160ffff700 1 -- 172.21.15.70:0/3716811292 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161409a500 con 0x55dec35f17a0 2023-10-08T08:47:35.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 -- 172.21.15.70:0/3716811292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 msgr2=0x55dec35fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:35.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3716811292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec35fc110 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f16140a2100 tx=0x7f1614099ef0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 -- 172.21.15.70:0/3716811292 shutdown_connections 2023-10-08T08:47:35.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3716811292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3716811292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f0e80 0x55dec35f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3716811292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec35fc110 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 -- 172.21.15.70:0/3716811292 >> 172.21.15.70:0/3716811292 conn(0x55dec3566260 msgr2=0x55dec35ed2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 -- 172.21.15.70:0/3716811292 shutdown_connections 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 -- 172.21.15.70:0/3716811292 wait complete. 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 -- start start 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 Processor -- start 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.147+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec35fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 0x55dec35f9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35fc650 0x55dec35f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1637f7db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec3544e30 con 0x55dec35fc650 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1637f7db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec34e1710 con 0x55dec35f0e80 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1637f7db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec34e13b0 con 0x55dec35f17a0 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1637f7db80 10 client.0 _ll_register_callbacks cb 0x55dec333e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1629b30700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec35fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f162a331700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35fc650 0x55dec35f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f162932f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 0x55dec35f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1629b30700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec35fc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40674/0 (socket says 172.21.15.70:40674) 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1629b30700 1 -- 172.21.15.70:0/3356477777 learned_addr learned my addr 172.21.15.70:0/3356477777 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f162a331700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35fc650 0x55dec35f9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53220/0 (socket says 172.21.15.70:53220) 2023-10-08T08:47:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1629b30700 1 -- 172.21.15.70:0/3356477777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 msgr2=0x55dec35f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1629b30700 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 0x55dec35f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1629b30700 1 -- 172.21.15.70:0/3356477777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35fc650 msgr2=0x55dec35f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1629b30700 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35fc650 0x55dec35f9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1629b30700 1 -- 172.21.15.70:0/3356477777 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c011230 con 0x55dec35f0e80 2023-10-08T08:47:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f162a331700 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35fc650 0x55dec35f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f162932f700 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 0x55dec35f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1629b30700 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec35fc090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1620009990 tx=0x7f1620009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adee52bf3b3e67cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f160d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f160d7fa700 1 -- 172.21.15.70:0/3356477777 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000be80 con 0x55dec35f0e80 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f1637f7db80 1 -- 172.21.15.70:0/3356477777 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dec350ceb0 con 0x55dec35f0e80 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.148+0000 7f160d7fa700 1 -- 172.21.15.70:0/3356477777 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1620004e50 con 0x55dec35f0e80 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f160d7fa700 1 -- 172.21.15.70:0/3356477777 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f162000f460 con 0x55dec35f0e80 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f1637f7db80 10 client.26030 fetch_fsmap learned FSMap version 47 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f1637f7db80 1 -- 172.21.15.70:0/3356477777 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f16241a5a60 con 0x55dec35f0e80 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f160d7fa700 1 -- 172.21.15.70:0/3356477777 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dec350ceb0 con 0x55dec35f0e80 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f160d7fa700 1 -- 172.21.15.70:0/3356477777 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f162002f070 con 0x55dec35f0e80 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f1637f7db80 10 client.26030 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:47:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f1637f7db80 10 client.26030 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f1637f7db80 20 client.26030 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dec360c2b0 0x55dec360e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f1637f7db80 4 client.26030 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:47:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f1637f7db80 1 -- 172.21.15.70:0/3356477777 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dec353de10 con 0x55dec360c2b0 2023-10-08T08:47:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f162932f700 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dec360c2b0 0x55dec360e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f160d7fa700 10 client.26030 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.149+0000 7f162932f700 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dec360c2b0 0x55dec360e6d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4964d079ce271a server_cookie=ccd0f86b2389f282 in_seq=0 out_seq=0 2023-10-08T08:47:35.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f160d7fa700 1 -- 172.21.15.70:0/3356477777 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dec353de10 con 0x55dec360c2b0 2023-10-08T08:47:35.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f160d7fa700 10 client.26030 handle_command_reply: tid=0 2023-10-08T08:47:35.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 client.26030 shutdown 2023-10-08T08:47:35.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 -- 172.21.15.70:0/3356477777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 msgr2=0x55dec35fc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec35fc090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1620009990 tx=0x7f1620009ca0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 -- 172.21.15.70:0/3356477777 shutdown_connections 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35fc650 0x55dec35f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dec360c2b0 0x55dec360e6d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec35fc090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f160d7fa700 0 client.26030 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3356477777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 0x55dec35f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 -- 172.21.15.70:0/3356477777 >> 172.21.15.70:0/3356477777 conn(0x55dec3566260 msgr2=0x55dec35ecec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 -- 172.21.15.70:0/3356477777 shutdown_connections 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 1 -- 172.21.15.70:0/3356477777 wait complete. 2023-10-08T08:47:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.152+0000 7f1637f7db80 20 client.26030 trim_cache size 0 max 16384 2023-10-08T08:47:35.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.169+0000 7f1637f7db80 1 Processor -- start 2023-10-08T08:47:35.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.169+0000 7f1637f7db80 1 -- start start 2023-10-08T08:47:35.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.169+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f0e80 0x55dec36031a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.169+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 0x55dec35fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.169+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.169+0000 7f1637f7db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec33c5920 con 0x55dec35f0e80 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.169+0000 7f1637f7db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec35ee8b0 con 0x55dec35fc650 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1637f7db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec35fee00 con 0x55dec35f17a0 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1629b30700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f0e80 0x55dec36031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1629b30700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f0e80 0x55dec36031a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53224/0 (socket says 172.21.15.70:53224) 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1629b30700 1 -- 172.21.15.70:0/3381214441 learned_addr learned my addr 172.21.15.70:0/3381214441 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f162932f700 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 0x55dec35fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f162a331700 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1629b30700 1 -- 172.21.15.70:0/3381214441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 msgr2=0x55dec35fbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:35.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1629b30700 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 0x55dec35fbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1629b30700 1 -- 172.21.15.70:0/3381214441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 msgr2=0x55dec35f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1629b30700 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35f46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1629b30700 1 -- 172.21.15.70:0/3381214441 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dec3358c60 con 0x55dec35f0e80 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f162a331700 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1629b30700 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f0e80 0x55dec36031a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1620024970 tx=0x7f16200059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5228e0d8aecc12 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1618ff9700 1 -- 172.21.15.70:0/3381214441 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000be80 con 0x55dec35f0e80 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1618ff9700 1 -- 172.21.15.70:0/3381214441 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1620028040 con 0x55dec35f0e80 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.170+0000 7f1618ff9700 1 -- 172.21.15.70:0/3381214441 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000fb80 con 0x55dec35f0e80 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 -- 172.21.15.70:0/3381214441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f0e80 msgr2=0x55dec36031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f0e80 0x55dec36031a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1620024970 tx=0x7f16200059d0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 -- 172.21.15.70:0/3381214441 shutdown_connections 2023-10-08T08:47:35.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35fc650 0x55dec35f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f0e80 0x55dec36031a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3381214441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35f17a0 0x55dec35fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 -- 172.21.15.70:0/3381214441 >> 172.21.15.70:0/3381214441 conn(0x55dec3566260 msgr2=0x55dec35ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 -- 172.21.15.70:0/3381214441 shutdown_connections 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 -- 172.21.15.70:0/3381214441 wait complete. 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 -- start start 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.171+0000 7f1637f7db80 1 Processor -- start 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec3602aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec3602fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1637f7db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35fc650 0x55dec3601180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1637f7db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec3601750 con 0x55dec35f17a0 2023-10-08T08:47:35.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1637f7db80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec3601890 con 0x55dec35f0e80 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1637f7db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dec3601a50 con 0x55dec35fc650 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1637f7db80 10 client.0 _ll_register_callbacks cb 0x55dec333e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f162932f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec3602fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f162932f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec3602fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53232/0 (socket says 172.21.15.70:53232) 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f162932f700 1 -- 172.21.15.70:0/3845382207 learned_addr learned my addr 172.21.15.70:0/3845382207 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1629b30700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec3602aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f162a331700 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35fc650 0x55dec3601180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1629b30700 1 -- 172.21.15.70:0/3845382207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35fc650 msgr2=0x55dec3601180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1629b30700 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35fc650 0x55dec3601180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1629b30700 1 -- 172.21.15.70:0/3845382207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 msgr2=0x55dec3602fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:35.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1629b30700 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec3602fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1629b30700 1 -- 172.21.15.70:0/3845382207 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16241a5a60 con 0x55dec35f0e80 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f162932f700 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec3602fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f1629b30700 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec3602aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1620000c00 tx=0x7f162000b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c29733259ef893b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.172+0000 7f160d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f160d7fa700 1 -- 172.21.15.70:0/3845382207 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162004f660 con 0x55dec35f0e80 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f160d7fa700 1 -- 172.21.15.70:0/3845382207 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f162000be80 con 0x55dec35f0e80 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f1637f7db80 1 -- 172.21.15.70:0/3845382207 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f161409e3f0 con 0x55dec35f0e80 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f160d7fa700 1 -- 172.21.15.70:0/3845382207 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1620004e50 con 0x55dec35f0e80 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f1637f7db80 10 client.26036 fetch_fsmap learned FSMap version 47 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f1637f7db80 1 -- 172.21.15.70:0/3845382207 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55dec3396250 con 0x55dec35f0e80 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f160d7fa700 1 -- 172.21.15.70:0/3845382207 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f161409e3f0 con 0x55dec35f0e80 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f160d7fa700 1 -- 172.21.15.70:0/3845382207 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f162004b070 con 0x55dec35f0e80 2023-10-08T08:47:35.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f1637f7db80 10 client.26036 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f1637f7db80 10 client.26036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f1637f7db80 20 client.26036 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dec3660f50 0x55dec3663370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f1637f7db80 4 client.26036 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f1637f7db80 1 -- 172.21.15.70:0/3845382207 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dec353db30 con 0x55dec3660f50 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.173+0000 7f162932f700 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dec3660f50 0x55dec3663370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f160d7fa700 10 client.26036 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f162932f700 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dec3660f50 0x55dec3663370 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec7d1c6261b460b0 server_cookie=f6e07894ba9ae971 in_seq=0 out_seq=0 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f160d7fa700 1 -- 172.21.15.70:0/3845382207 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55dec353db30 con 0x55dec3660f50 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f160d7fa700 10 client.26036 handle_command_reply: tid=0 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 client.26036 shutdown 2023-10-08T08:47:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 -- 172.21.15.70:0/3845382207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 msgr2=0x55dec3602aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec3602aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1620000c00 tx=0x7f162000b660 comp rx=0 tx=0).stop 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 -- 172.21.15.70:0/3845382207 shutdown_connections 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dec35fc650 0x55dec3601180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55dec3660f50 0x55dec3663370 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dec35f0e80 0x55dec3602aa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 --2- 172.21.15.70:0/3845382207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec35f17a0 0x55dec3602fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 -- 172.21.15.70:0/3845382207 >> 172.21.15.70:0/3845382207 conn(0x55dec3566260 msgr2=0x55dec35f46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f160d7fa700 0 client.26036 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 -- 172.21.15.70:0/3845382207 shutdown_connections 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 1 -- 172.21.15.70:0/3845382207 wait complete. 2023-10-08T08:47:35.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.174+0000 7f1637f7db80 20 client.26036 trim_cache size 0 max 16384 2023-10-08T08:47:35.186 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:47:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T08:47:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2023-10-08T08:47:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "1fdc564a-5636-4203-adbe-f48f96886df6": { 2023-10-08T08:47:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2023-10-08T08:47:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "1fdc564a-5636-4203-adbe-f48f96886df6", 2023-10-08T08:47:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2023-10-08T08:47:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:47:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:47:35.187 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:47:35.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 -- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16100a15f0 msgr2=0x7f16100a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:35.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16100a15f0 0x7f16100a3ab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f162000b2e0 tx=0x7f1620005960 comp rx=0 tx=0).stop 2023-10-08T08:47:35.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 -- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624069740 msgr2=0x7f16240ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:35.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624069740 0x7f16240ffba0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f161400e9a0 tx=0x7f161400ecb0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 -- 172.21.15.70:0/3091169514 shutdown_connections 2023-10-08T08:47:35.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f16100a15f0 0x7f16100a3ab0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1624106750 0x7f16241000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1624068d80 0x7f16240ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 --2- 172.21.15.70:0/3091169514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1624069740 0x7f16240ffba0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:35.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 -- 172.21.15.70:0/3091169514 >> 172.21.15.70:0/3091169514 conn(0x7f16240767f0 msgr2=0x7f16240fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:35.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 -- 172.21.15.70:0/3091169514 shutdown_connections 2023-10-08T08:47:35.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:47:35.175+0000 7f162bd94700 1 -- 172.21.15.70:0/3091169514 wait complete. 2023-10-08T08:47:35.189 INFO:tasks.cephfs.filesystem:scrub status for tag:1fdc564a-5636-4203-adbe-f48f96886df6 - {'path': '/', 'tag': '1fdc564a-5636-4203-adbe-f48f96886df6', 'options': 'recursive,force'} 2023-10-08T08:47:36.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:36 smithi070 ceph-mon[99513]: pgmap v406: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 457 op/s 2023-10-08T08:47:36.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:36 smithi105 ceph-mon[103798]: pgmap v406: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 457 op/s 2023-10-08T08:47:36.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:36 smithi191 ceph-mon[104220]: pgmap v406: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 457 op/s 2023-10-08T08:47:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:38 smithi070 ceph-mon[99513]: pgmap v407: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 534 op/s 2023-10-08T08:47:38.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:38 smithi105 ceph-mon[103798]: pgmap v407: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 534 op/s 2023-10-08T08:47:38.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:38 smithi191 ceph-mon[104220]: pgmap v407: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 534 op/s 2023-10-08T08:47:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:40 smithi070 ceph-mon[99513]: pgmap v408: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 436 op/s 2023-10-08T08:47:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:40 smithi070 ceph-mon[99513]: scrub summary: idle 2023-10-08T08:47:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:40 smithi070 ceph-mon[99513]: scrub summary: idle 2023-10-08T08:47:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:40 smithi070 ceph-mon[99513]: scrub summary: idle 2023-10-08T08:47:40.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:40 smithi105 ceph-mon[103798]: pgmap v408: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 436 op/s 2023-10-08T08:47:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:40 smithi105 ceph-mon[103798]: scrub summary: idle 2023-10-08T08:47:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:40 smithi105 ceph-mon[103798]: scrub summary: idle 2023-10-08T08:47:40.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:40 smithi105 ceph-mon[103798]: scrub summary: idle 2023-10-08T08:47:40.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:40 smithi191 ceph-mon[104220]: pgmap v408: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 436 op/s 2023-10-08T08:47:40.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:40 smithi191 ceph-mon[104220]: scrub summary: idle 2023-10-08T08:47:40.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:40 smithi191 ceph-mon[104220]: scrub summary: idle 2023-10-08T08:47:40.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:40 smithi191 ceph-mon[104220]: scrub summary: idle 2023-10-08T08:47:41.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:41 smithi070 ceph-mon[99513]: scrub summary: idle 2023-10-08T08:47:41.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:41 smithi070 ceph-mon[99513]: scrub summary: idle 2023-10-08T08:47:41.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:41 smithi105 ceph-mon[103798]: scrub summary: idle 2023-10-08T08:47:41.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:41 smithi105 ceph-mon[103798]: scrub summary: idle 2023-10-08T08:47:41.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:41 smithi191 ceph-mon[104220]: scrub summary: idle 2023-10-08T08:47:41.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:41 smithi191 ceph-mon[104220]: scrub summary: idle 2023-10-08T08:47:42.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:42 smithi070 ceph-mon[99513]: pgmap v409: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 438 op/s 2023-10-08T08:47:42.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:42 smithi105 ceph-mon[103798]: pgmap v409: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 438 op/s 2023-10-08T08:47:42.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:42 smithi191 ceph-mon[104220]: pgmap v409: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 438 op/s 2023-10-08T08:47:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.521+0000 7f138ddb8700 1 -- 172.21.15.70:0/3332620206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13880689b0 msgr2=0x7f1388068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.521+0000 7f138ddb8700 1 --2- 172.21.15.70:0/3332620206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13880689b0 0x7f1388068e10 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1378009990 tx=0x7f1378009ca0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.521+0000 7f138ddb8700 1 -- 172.21.15.70:0/3332620206 shutdown_connections 2023-10-08T08:47:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.521+0000 7f138ddb8700 1 --2- 172.21.15.70:0/3332620206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388069350 0x7f138810d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.521+0000 7f138ddb8700 1 --2- 172.21.15.70:0/3332620206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1388106780 0x7f1388106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.521+0000 7f138ddb8700 1 --2- 172.21.15.70:0/3332620206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13880689b0 0x7f1388068e10 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.521+0000 7f138ddb8700 1 -- 172.21.15.70:0/3332620206 >> 172.21.15.70:0/3332620206 conn(0x7f1388076460 msgr2=0x7f1388076870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.521+0000 7f138ddb8700 1 -- 172.21.15.70:0/3332620206 shutdown_connections 2023-10-08T08:47:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.521+0000 7f138ddb8700 1 -- 172.21.15.70:0/3332620206 wait complete. 2023-10-08T08:47:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f138ddb8700 1 Processor -- start 2023-10-08T08:47:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f138ddb8700 1 -- start start 2023-10-08T08:47:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f138ddb8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13880689b0 0x7f138819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f138ddb8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388069350 0x7f138819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f138ddb8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388106780 0x7f1388196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f138ddb8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13881970c0 con 0x7f1388106780 2023-10-08T08:47:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f138ddb8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1388197230 con 0x7f13880689b0 2023-10-08T08:47:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f138ddb8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13881973f0 con 0x7f1388069350 2023-10-08T08:47:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f1387fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388106780 0x7f1388196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f13877fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13880689b0 0x7f138819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.522+0000 7f1387fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388106780 0x7f1388196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53248/0 (socket says 172.21.15.70:53248) 2023-10-08T08:47:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f13877fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13880689b0 0x7f138819c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40702/0 (socket says 172.21.15.70:40702) 2023-10-08T08:47:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1387fff700 1 -- 172.21.15.70:0/2575252145 learned_addr learned my addr 172.21.15.70:0/2575252145 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1386ffd700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388069350 0x7f138819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1387fff700 1 -- 172.21.15.70:0/2575252145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388069350 msgr2=0x7f138819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1387fff700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388069350 0x7f138819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1387fff700 1 -- 172.21.15.70:0/2575252145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13880689b0 msgr2=0x7f138819c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1387fff700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13880689b0 0x7f138819c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1387fff700 1 -- 172.21.15.70:0/2575252145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780095f0 con 0x7f1388106780 2023-10-08T08:47:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1387fff700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388106780 0x7f1388196a60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f138000ef30 tx=0x7f138000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1384ff9700 1 -- 172.21.15.70:0/2575252145 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380018070 con 0x7f1388106780 2023-10-08T08:47:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f138ddb8700 1 -- 172.21.15.70:0/2575252145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1388197670 con 0x7f1388106780 2023-10-08T08:47:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1384ff9700 1 -- 172.21.15.70:0/2575252145 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f138000f040 con 0x7f1388106780 2023-10-08T08:47:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f1384ff9700 1 -- 172.21.15.70:0/2575252145 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000cd00 con 0x7f1388106780 2023-10-08T08:47:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.523+0000 7f138ddb8700 1 -- 172.21.15.70:0/2575252145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13881a3920 con 0x7f1388106780 2023-10-08T08:47:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.526+0000 7f1384ff9700 1 -- 172.21.15.70:0/2575252145 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1380003a00 con 0x7f1388106780 2023-10-08T08:47:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.526+0000 7f1384ff9700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13700a15f0 0x7f13700a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.526+0000 7f13877fe700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13700a15f0 0x7f13700a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.526+0000 7f1384ff9700 1 -- 172.21.15.70:0/2575252145 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f13800ccf50 con 0x7f1388106780 2023-10-08T08:47:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f13877fe700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13700a15f0 0x7f13700a3ab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f137c009be0 tx=0x7f137c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1399fa1b80 1 Processor -- start 2023-10-08T08:47:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1399fa1b80 1 -- start start 2023-10-08T08:47:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf16c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf171a0 0x559d4bf10b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf110b0 0x559d4bf11510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4be79400 con 0x559d4bf16880 2023-10-08T08:47:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4be6abc0 con 0x559d4bf171a0 2023-10-08T08:47:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4be684e0 con 0x559d4bf110b0 2023-10-08T08:47:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f13877fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf16c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f13877fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf16c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53252/0 (socket says 172.21.15.70:53252) 2023-10-08T08:47:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f13877fe700 1 -- 172.21.15.70:0/3279999175 learned_addr learned my addr 172.21.15.70:0/3279999175 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1387fff700 1 --2- 172.21.15.70:0/3279999175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf110b0 0x559d4bf11510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.527+0000 7f1386ffd700 1 --2- 172.21.15.70:0/3279999175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf171a0 0x559d4bf10b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.528+0000 7f13877fe700 1 -- 172.21.15.70:0/3279999175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf110b0 msgr2=0x559d4bf11510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.528+0000 7f13877fe700 1 --2- 172.21.15.70:0/3279999175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf110b0 0x559d4bf11510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.528+0000 7f13877fe700 1 -- 172.21.15.70:0/3279999175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf171a0 msgr2=0x559d4bf10b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.528+0000 7f13877fe700 1 --2- 172.21.15.70:0/3279999175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf171a0 0x559d4bf10b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.528+0000 7f13877fe700 1 -- 172.21.15.70:0/3279999175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d4bc8ed80 con 0x559d4bf16880 2023-10-08T08:47:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.528+0000 7f13877fe700 1 --2- 172.21.15.70:0/3279999175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf16c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f137c011d70 tx=0x7f137c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d2cb84c1164ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.528+0000 7f136dffb700 1 -- 172.21.15.70:0/3279999175 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c011da0 con 0x559d4bf16880 2023-10-08T08:47:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.528+0000 7f136dffb700 1 -- 172.21.15.70:0/3279999175 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f137c004020 con 0x559d4bf16880 2023-10-08T08:47:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.528+0000 7f136dffb700 1 -- 172.21.15.70:0/3279999175 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c003bc0 con 0x559d4bf16880 2023-10-08T08:47:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 -- 172.21.15.70:0/3279999175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 msgr2=0x559d4bf16c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/3279999175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf16c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f137c011d70 tx=0x7f137c014000 comp rx=0 tx=0).stop 2023-10-08T08:47:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 -- 172.21.15.70:0/3279999175 shutdown_connections 2023-10-08T08:47:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/3279999175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf110b0 0x559d4bf11510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/3279999175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf16c60 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/3279999175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf171a0 0x559d4bf10b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 -- 172.21.15.70:0/3279999175 >> 172.21.15.70:0/3279999175 conn(0x559d4be85200 msgr2=0x559d4bf0bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 -- 172.21.15.70:0/3279999175 shutdown_connections 2023-10-08T08:47:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 -- 172.21.15.70:0/3279999175 wait complete. 2023-10-08T08:47:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 -- start start 2023-10-08T08:47:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.529+0000 7f1399fa1b80 1 Processor -- start 2023-10-08T08:47:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf110b0 0x559d4bf1a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf16880 0x559d4bf1aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 0x559d4bf1af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4be63dd0 con 0x559d4bf110b0 2023-10-08T08:47:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4be006b0 con 0x559d4bf16880 2023-10-08T08:47:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4be00350 con 0x559d4bf171a0 2023-10-08T08:47:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1399fa1b80 10 client.0 _ll_register_callbacks cb 0x559d4bc5d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1386ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf16880 0x559d4bf1aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1386ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf16880 0x559d4bf1aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40718/0 (socket says 172.21.15.70:40718) 2023-10-08T08:47:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1386ffd700 1 -- 172.21.15.70:0/2964548783 learned_addr learned my addr 172.21.15.70:0/2964548783 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1387fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 0x559d4bf1af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f13877fe700 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf110b0 0x559d4bf1a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1386ffd700 1 -- 172.21.15.70:0/2964548783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 msgr2=0x559d4bf1af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1386ffd700 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 0x559d4bf1af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1386ffd700 1 -- 172.21.15.70:0/2964548783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf110b0 msgr2=0x559d4bf1a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1386ffd700 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf110b0 0x559d4bf1a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1386ffd700 1 -- 172.21.15.70:0/2964548783 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c017070 con 0x559d4bf16880 2023-10-08T08:47:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f13877fe700 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf110b0 0x559d4bf1a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:47:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1386ffd700 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf16880 0x559d4bf1aa30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1378009990 tx=0x7f1378005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be50eb05ebaad224 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1366ffd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:47:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1366ffd700 1 -- 172.21.15.70:0/2964548783 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137801d070 con 0x559d4bf16880 2023-10-08T08:47:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1399fa1b80 1 -- 172.21.15.70:0/2964548783 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d4be2be50 con 0x559d4bf16880 2023-10-08T08:47:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.530+0000 7f1366ffd700 1 -- 172.21.15.70:0/2964548783 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1378004500 con 0x559d4bf16880 2023-10-08T08:47:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1366ffd700 1 -- 172.21.15.70:0/2964548783 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13780046c0 con 0x559d4bf16880 2023-10-08T08:47:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1399fa1b80 10 client.26048 fetch_fsmap learned FSMap version 47 2023-10-08T08:47:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1399fa1b80 1 -- 172.21.15.70:0/2964548783 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x559d4bc77c00 con 0x559d4bf16880 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1366ffd700 1 -- 172.21.15.70:0/2964548783 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559d4be2be50 con 0x559d4bf16880 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1366ffd700 1 -- 172.21.15.70:0/2964548783 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f137800f880 con 0x559d4bf16880 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1399fa1b80 10 client.26048 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1399fa1b80 10 client.26048 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1399fa1b80 20 client.26048 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559d4bf2add0 0x559d4bf2d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1399fa1b80 4 client.26048 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f1399fa1b80 1 -- 172.21.15.70:0/2964548783 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d4be5cdb0 con 0x559d4bf2add0 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.531+0000 7f13877fe700 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559d4bf2add0 0x559d4bf2d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f13877fe700 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559d4bf2add0 0x559d4bf2d1f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3b9b1b7f9a25353 server_cookie=b64a25b322bc46ea in_seq=0 out_seq=0 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1366ffd700 10 client.26048 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1366ffd700 1 -- 172.21.15.70:0/2964548783 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559d4be5cdb0 con 0x559d4bf2add0 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1366ffd700 10 client.26048 handle_command_reply: tid=0 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1399fa1b80 1 client.26048 shutdown 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1399fa1b80 1 -- 172.21.15.70:0/2964548783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf16880 msgr2=0x559d4bf1aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf16880 0x559d4bf1aa30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1378009990 tx=0x7f1378005800 comp rx=0 tx=0).stop 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1399fa1b80 1 -- 172.21.15.70:0/2964548783 shutdown_connections 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 0x559d4bf1af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf110b0 0x559d4bf1a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559d4bf2add0 0x559d4bf2d1f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/2964548783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf16880 0x559d4bf1aa30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1366ffd700 0 client.26048 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.532+0000 7f1399fa1b80 1 -- 172.21.15.70:0/2964548783 >> 172.21.15.70:0/2964548783 conn(0x559d4be85200 msgr2=0x559d4bf0b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.533+0000 7f1399fa1b80 1 -- 172.21.15.70:0/2964548783 shutdown_connections 2023-10-08T08:47:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.533+0000 7f1399fa1b80 1 -- 172.21.15.70:0/2964548783 wait complete. 2023-10-08T08:47:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.533+0000 7f1399fa1b80 20 client.26048 trim_cache size 0 max 16384 2023-10-08T08:47:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.547+0000 7f1399fa1b80 1 Processor -- start 2023-10-08T08:47:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.547+0000 7f1399fa1b80 1 -- start start 2023-10-08T08:47:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.547+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf0b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.547+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf16880 0x559d4bf0bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.547+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf171a0 0x559d4bf1aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.547+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4bce48c0 con 0x559d4bf171a0 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.547+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4bf0d6b0 con 0x559d4bf110b0 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.547+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4bf18a90 con 0x559d4bf16880 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1387fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf171a0 0x559d4bf1aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f13877fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf0b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1387fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf171a0 0x559d4bf1aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53270/0 (socket says 172.21.15.70:53270) 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1387fff700 1 -- 172.21.15.70:0/1790522497 learned_addr learned my addr 172.21.15.70:0/1790522497 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1386ffd700 1 --2- 172.21.15.70:0/1790522497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf16880 0x559d4bf0bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1387fff700 1 -- 172.21.15.70:0/1790522497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf16880 msgr2=0x559d4bf0bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1387fff700 1 --2- 172.21.15.70:0/1790522497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf16880 0x559d4bf0bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1387fff700 1 -- 172.21.15.70:0/1790522497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 msgr2=0x559d4bf0b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1387fff700 1 --2- 172.21.15.70:0/1790522497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf0b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1387fff700 1 -- 172.21.15.70:0/1790522497 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d4bcb51f0 con 0x559d4bf171a0 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f13877fe700 1 --2- 172.21.15.70:0/1790522497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf0b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f1387fff700 1 --2- 172.21.15.70:0/1790522497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf171a0 0x559d4bf1aa40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1380096760 tx=0x7f1380095910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37543d7499cd1d3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f136e7fc700 1 -- 172.21.15.70:0/1790522497 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380004ad0 con 0x559d4bf171a0 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f136e7fc700 1 -- 172.21.15.70:0/1790522497 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f138001b320 con 0x559d4bf171a0 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.548+0000 7f136e7fc700 1 -- 172.21.15.70:0/1790522497 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13800a1ff0 con 0x559d4bf171a0 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 -- 172.21.15.70:0/1790522497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf171a0 msgr2=0x559d4bf1aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/1790522497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf171a0 0x559d4bf1aa40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1380096760 tx=0x7f1380095910 comp rx=0 tx=0).stop 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 -- 172.21.15.70:0/1790522497 shutdown_connections 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/1790522497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf171a0 0x559d4bf1aa40 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/1790522497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf0b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/1790522497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf16880 0x559d4bf0bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 -- 172.21.15.70:0/1790522497 >> 172.21.15.70:0/1790522497 conn(0x559d4be85200 msgr2=0x559d4bf31b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 -- 172.21.15.70:0/1790522497 shutdown_connections 2023-10-08T08:47:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 -- 172.21.15.70:0/1790522497 wait complete. 2023-10-08T08:47:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 -- start start 2023-10-08T08:47:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.549+0000 7f1399fa1b80 1 Processor -- start 2023-10-08T08:47:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf21550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf21a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1399fa1b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 0x559d4bf1fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4bf201a0 con 0x559d4bf16880 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4bf20310 con 0x559d4bf110b0 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1399fa1b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4bf204d0 con 0x559d4bf171a0 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1399fa1b80 10 client.0 _ll_register_callbacks cb 0x7f1378005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1386ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf21a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1386ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf21a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53274/0 (socket says 172.21.15.70:53274) 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1386ffd700 1 -- 172.21.15.70:0/978801355 learned_addr learned my addr 172.21.15.70:0/978801355 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f13877fe700 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf21550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1387fff700 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 0x559d4bf1fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1386ffd700 1 -- 172.21.15.70:0/978801355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 msgr2=0x559d4bf1fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1386ffd700 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 0x559d4bf1fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1386ffd700 1 -- 172.21.15.70:0/978801355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 msgr2=0x559d4bf21550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1386ffd700 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf21550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1386ffd700 1 -- 172.21.15.70:0/978801355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d4bc8ed80 con 0x559d4bf16880 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f13877fe700 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf21550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1386ffd700 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf21a90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x559d4bf1ba30 tx=0x7f1378005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221a4b6c5032b77f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1366ffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1366ffd700 1 -- 172.21.15.70:0/978801355 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137801d070 con 0x559d4bf16880 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1366ffd700 1 -- 172.21.15.70:0/978801355 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1378000e40 con 0x559d4bf16880 2023-10-08T08:47:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.550+0000 7f1399fa1b80 1 -- 172.21.15.70:0/978801355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f137c004020 con 0x559d4bf16880 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1366ffd700 1 -- 172.21.15.70:0/978801355 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f137800f460 con 0x559d4bf16880 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1399fa1b80 10 client.16647 fetch_fsmap learned FSMap version 47 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1399fa1b80 1 -- 172.21.15.70:0/978801355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f13800b9040 con 0x559d4bf16880 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1366ffd700 1 -- 172.21.15.70:0/978801355 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f137c004020 con 0x559d4bf16880 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1366ffd700 1 -- 172.21.15.70:0/978801355 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f1378024d20 con 0x559d4bf16880 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1399fa1b80 10 client.16647 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1399fa1b80 10 client.16647 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1399fa1b80 20 client.16647 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559d4bf7fae0 0x559d4bf81f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1399fa1b80 4 client.16647 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:47:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f1399fa1b80 1 -- 172.21.15.70:0/978801355 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559d4be5cad0 con 0x559d4bf7fae0 2023-10-08T08:47:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.551+0000 7f13877fe700 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559d4bf7fae0 0x559d4bf81f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.552+0000 7f1366ffd700 10 client.16647 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.552+0000 7f13877fe700 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559d4bf7fae0 0x559d4bf81f00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6ab9f02fffe3e9d server_cookie=47c229af1975e9ca in_seq=0 out_seq=0 2023-10-08T08:47:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1366ffd700 1 -- 172.21.15.70:0/978801355 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559d4be5cad0 con 0x559d4bf7fae0 2023-10-08T08:47:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1366ffd700 10 client.16647 handle_command_reply: tid=0 2023-10-08T08:47:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 client.16647 shutdown 2023-10-08T08:47:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 -- 172.21.15.70:0/978801355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 msgr2=0x559d4bf21a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf21a90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x559d4bf1ba30 tx=0x7f1378005fd0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 -- 172.21.15.70:0/978801355 shutdown_connections 2023-10-08T08:47:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d4bf171a0 0x559d4bf1fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x559d4bf7fae0 0x559d4bf81f00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d4bf110b0 0x559d4bf21550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 --2- 172.21.15.70:0/978801355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d4bf16880 0x559d4bf21a90 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1366ffd700 0 client.16647 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 -- 172.21.15.70:0/978801355 >> 172.21.15.70:0/978801355 conn(0x559d4be85200 msgr2=0x559d4bf18d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 -- 172.21.15.70:0/978801355 shutdown_connections 2023-10-08T08:47:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 1 -- 172.21.15.70:0/978801355 wait complete. 2023-10-08T08:47:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.649+0000 7f1399fa1b80 20 client.16647 trim_cache size 0 max 16384 2023-10-08T08:47:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:47:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:47:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:47:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:47:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 -- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13700a15f0 msgr2=0x7f13700a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13700a15f0 0x7f13700a3ab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f137c009be0 tx=0x7f137c009260 comp rx=0 tx=0).stop 2023-10-08T08:47:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 -- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388106780 msgr2=0x7f1388196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388106780 0x7f1388196a60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f138000ef30 tx=0x7f138000c3a0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 -- 172.21.15.70:0/2575252145 shutdown_connections 2023-10-08T08:47:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f13700a15f0 0x7f13700a3ab0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388106780 0x7f1388196a60 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13880689b0 0x7f138819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 --2- 172.21.15.70:0/2575252145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388069350 0x7f138819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 -- 172.21.15.70:0/2575252145 >> 172.21.15.70:0/2575252145 conn(0x7f1388076460 msgr2=0x7f13880fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 -- 172.21.15.70:0/2575252145 shutdown_connections 2023-10-08T08:47:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:44.650+0000 7f138ddb8700 1 -- 172.21.15.70:0/2575252145 wait complete. 2023-10-08T08:47:44.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:44 smithi070 ceph-mon[99513]: pgmap v410: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 349 op/s 2023-10-08T08:47:44.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:44 smithi105 ceph-mon[103798]: pgmap v410: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 349 op/s 2023-10-08T08:47:44.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:44 smithi191 ceph-mon[104220]: pgmap v410: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 349 op/s 2023-10-08T08:47:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:46 smithi070 ceph-mon[99513]: pgmap v411: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 312 op/s 2023-10-08T08:47:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:46 smithi105 ceph-mon[103798]: pgmap v411: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 312 op/s 2023-10-08T08:47:46.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:46 smithi191 ceph-mon[104220]: pgmap v411: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 312 op/s 2023-10-08T08:47:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:48 smithi070 ceph-mon[99513]: pgmap v412: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 363 op/s 2023-10-08T08:47:48.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:48 smithi105 ceph-mon[103798]: pgmap v412: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 363 op/s 2023-10-08T08:47:48.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:48 smithi191 ceph-mon[104220]: pgmap v412: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 363 op/s 2023-10-08T08:47:50.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:50 smithi070 ceph-mon[99513]: pgmap v413: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 337 op/s 2023-10-08T08:47:50.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:50 smithi105 ceph-mon[103798]: pgmap v413: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 337 op/s 2023-10-08T08:47:50.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:50 smithi191 ceph-mon[104220]: pgmap v413: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 337 op/s 2023-10-08T08:47:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:52 smithi070 ceph-mon[99513]: pgmap v414: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 402 op/s 2023-10-08T08:47:52.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:52 smithi105 ceph-mon[103798]: pgmap v414: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 402 op/s 2023-10-08T08:47:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:52 smithi191 ceph-mon[104220]: pgmap v414: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 402 op/s 2023-10-08T08:47:54.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:54 smithi070 ceph-mon[99513]: pgmap v415: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.1 MiB/s wr, 380 op/s 2023-10-08T08:47:54.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:54 smithi105 ceph-mon[103798]: pgmap v415: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.1 MiB/s wr, 380 op/s 2023-10-08T08:47:54.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:54 smithi191 ceph-mon[104220]: pgmap v415: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.1 MiB/s wr, 380 op/s 2023-10-08T08:47:56.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:56 smithi070 ceph-mon[99513]: pgmap v416: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 380 op/s 2023-10-08T08:47:56.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:56 smithi105 ceph-mon[103798]: pgmap v416: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 380 op/s 2023-10-08T08:47:56.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:56 smithi191 ceph-mon[104220]: pgmap v416: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 380 op/s 2023-10-08T08:47:57.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.762+0000 7f14661f2700 1 -- 172.21.15.70:0/44308089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600ff5d0 msgr2=0x7f14600ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:57.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.762+0000 7f14661f2700 1 --2- 172.21.15.70:0/44308089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600ff5d0 0x7f14600ffa50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1454009990 tx=0x7f1454009ca0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.762+0000 7f14661f2700 1 -- 172.21.15.70:0/44308089 shutdown_connections 2023-10-08T08:47:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.762+0000 7f14661f2700 1 --2- 172.21.15.70:0/44308089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14600fff90 0x7f146010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.762+0000 7f14661f2700 1 --2- 172.21.15.70:0/44308089 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14601045e0 0x7f14601049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.762+0000 7f14661f2700 1 --2- 172.21.15.70:0/44308089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600ff5d0 0x7f14600ffa50 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.762+0000 7f14661f2700 1 -- 172.21.15.70:0/44308089 >> 172.21.15.70:0/44308089 conn(0x7f1460076790 msgr2=0x7f1460076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.762+0000 7f14661f2700 1 -- 172.21.15.70:0/44308089 shutdown_connections 2023-10-08T08:47:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.762+0000 7f14661f2700 1 -- 172.21.15.70:0/44308089 wait complete. 2023-10-08T08:47:57.766 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.763+0000 7f14661f2700 1 Processor -- start 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.763+0000 7f14661f2700 1 -- start start 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.763+0000 7f14661f2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14600ff5d0 0x7f146019b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.763+0000 7f14661f2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600fff90 0x7f146019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.763+0000 7f14661f2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14601045e0 0x7f1460195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.763+0000 7f14661f2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1460195e40 con 0x7f14600fff90 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.763+0000 7f14661f2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1460195fb0 con 0x7f14600ff5d0 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.763+0000 7f14661f2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1460196170 con 0x7f14601045e0 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600fff90 0x7f146019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600fff90 0x7f146019bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53288/0 (socket says 172.21.15.70:53288) 2023-10-08T08:47:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145effd700 1 -- 172.21.15.70:0/2762129333 learned_addr learned my addr 172.21.15.70:0/2762129333 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145f7fe700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14600ff5d0 0x7f146019b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145ffff700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14601045e0 0x7f1460195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145effd700 1 -- 172.21.15.70:0/2762129333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14601045e0 msgr2=0x7f1460195790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145effd700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14601045e0 0x7f1460195790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145effd700 1 -- 172.21.15.70:0/2762129333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14600ff5d0 msgr2=0x7f146019b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145effd700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14600ff5d0 0x7f146019b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145effd700 1 -- 172.21.15.70:0/2762129333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14540095f0 con 0x7f14600fff90 2023-10-08T08:47:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145effd700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600fff90 0x7f146019bb80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1454000c00 tx=0x7f1454004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145cff9700 1 -- 172.21.15.70:0/2762129333 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145401d070 con 0x7f14600fff90 2023-10-08T08:47:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145cff9700 1 -- 172.21.15.70:0/2762129333 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1454022470 con 0x7f14600fff90 2023-10-08T08:47:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f14661f2700 1 -- 172.21.15.70:0/2762129333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14601963f0 con 0x7f14600fff90 2023-10-08T08:47:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f145cff9700 1 -- 172.21.15.70:0/2762129333 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1454017650 con 0x7f14600fff90 2023-10-08T08:47:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.764+0000 7f14661f2700 1 -- 172.21.15.70:0/2762129333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14601a2670 con 0x7f14600fff90 2023-10-08T08:47:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.767+0000 7f145cff9700 1 -- 172.21.15.70:0/2762129333 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f14540225e0 con 0x7f14600fff90 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.767+0000 7f145cff9700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14480a15f0 0x7f14480a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.768+0000 7f145f7fe700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14480a15f0 0x7f14480a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.768+0000 7f145cff9700 1 -- 172.21.15.70:0/2762129333 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f14540ce5d0 con 0x7f14600fff90 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.768+0000 7f145f7fe700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14480a15f0 0x7f14480a3ab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1460069cf0 tx=0x7f1450007400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.768+0000 7f14723dbb80 1 Processor -- start 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.768+0000 7f14723dbb80 1 -- start start 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.768+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b76192ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.768+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192f1a0 0x55b761928b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.768+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7619290b0 0x55b761929510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f14723dbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b761891400 con 0x55b76192e880 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f14723dbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b761882bc0 con 0x55b76192f1a0 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f14723dbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7618804e0 con 0x55b7619290b0 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b76192ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b76192ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53294/0 (socket says 172.21.15.70:53294) 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145f7fe700 1 -- 172.21.15.70:0/682213723 learned_addr learned my addr 172.21.15.70:0/682213723 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145effd700 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192f1a0 0x55b761928b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145ffff700 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7619290b0 0x55b761929510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145f7fe700 1 -- 172.21.15.70:0/682213723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7619290b0 msgr2=0x55b761929510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145f7fe700 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7619290b0 0x55b761929510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145f7fe700 1 -- 172.21.15.70:0/682213723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192f1a0 msgr2=0x55b761928b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145f7fe700 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192f1a0 0x55b761928b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145f7fe700 1 -- 172.21.15.70:0/682213723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7616a6d80 con 0x55b76192e880 2023-10-08T08:47:57.777 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145effd700 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192f1a0 0x55b761928b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f145f7fe700 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b76192ec60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1450010e50 tx=0x7f1450013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c15b047177ba4c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f1445ffb700 1 -- 172.21.15.70:0/682213723 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450010e80 con 0x55b76192e880 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f1445ffb700 1 -- 172.21.15.70:0/682213723 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1450003b40 con 0x55b76192e880 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.769+0000 7f1445ffb700 1 -- 172.21.15.70:0/682213723 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450011b00 con 0x55b76192e880 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 -- 172.21.15.70:0/682213723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 msgr2=0x55b76192ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b76192ec60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1450010e50 tx=0x7f1450013000 comp rx=0 tx=0).stop 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 -- 172.21.15.70:0/682213723 shutdown_connections 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7619290b0 0x55b761929510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b76192ec60 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 --2- 172.21.15.70:0/682213723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192f1a0 0x55b761928b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 -- 172.21.15.70:0/682213723 >> 172.21.15.70:0/682213723 conn(0x55b76189d200 msgr2=0x55b761923b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 -- 172.21.15.70:0/682213723 shutdown_connections 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 -- 172.21.15.70:0/682213723 wait complete. 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.770+0000 7f14723dbb80 1 -- start start 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f14723dbb80 1 Processor -- start 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b7619325e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b761932b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 0x55b761933060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f14723dbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76187bdd0 con 0x55b76192e880 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f14723dbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7618186b0 con 0x55b7619290b0 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f14723dbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b761818350 con 0x55b76192f1a0 2023-10-08T08:47:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f14723dbb80 10 client.0 _ll_register_callbacks cb 0x55b7616757a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b7619325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b761932b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b7619325e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40758/0 (socket says 172.21.15.70:40758) 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b761932b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53302/0 (socket says 172.21.15.70:53302) 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145f7fe700 1 -- 172.21.15.70:0/2857822768 learned_addr learned my addr 172.21.15.70:0/2857822768 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145ffff700 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 0x55b761933060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145f7fe700 1 -- 172.21.15.70:0/2857822768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 msgr2=0x55b761933060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145f7fe700 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 0x55b761933060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145f7fe700 1 -- 172.21.15.70:0/2857822768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 msgr2=0x55b761932b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145f7fe700 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b761932b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145f7fe700 1 -- 172.21.15.70:0/2857822768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14601a2670 con 0x55b7619290b0 2023-10-08T08:47:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145effd700 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b761932b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f145f7fe700 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b7619325e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1450010e20 tx=0x7f1450003ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9754493de00fe54 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.771+0000 7f143effd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f143effd700 1 -- 172.21.15.70:0/2857822768 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450005050 con 0x55b7619290b0 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f143effd700 1 -- 172.21.15.70:0/2857822768 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1450017070 con 0x55b7619290b0 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f14723dbb80 1 -- 172.21.15.70:0/2857822768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b761843e50 con 0x55b7619290b0 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f143effd700 1 -- 172.21.15.70:0/2857822768 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14500051b0 con 0x55b7619290b0 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f14723dbb80 10 client.26066 fetch_fsmap learned FSMap version 47 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f14723dbb80 1 -- 172.21.15.70:0/2857822768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f1450010b00 con 0x55b7619290b0 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f143effd700 1 -- 172.21.15.70:0/2857822768 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b761843e50 con 0x55b7619290b0 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f143effd700 1 -- 172.21.15.70:0/2857822768 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f14500044c0 con 0x55b7619290b0 2023-10-08T08:47:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f14723dbb80 10 client.26066 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f14723dbb80 10 client.26066 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f14723dbb80 20 client.26066 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f14723dbb80 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b761942c30 0x55b761945050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f14723dbb80 4 client.26066 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f14723dbb80 1 -- 172.21.15.70:0/2857822768 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b761874db0 con 0x55b761942c30 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.772+0000 7f145effd700 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b761942c30 0x55b761945050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.773+0000 7f143effd700 10 client.26066 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.773+0000 7f145effd700 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b761942c30 0x55b761945050 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b14fa83304328f3 server_cookie=6182b83994105963 in_seq=0 out_seq=0 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.773+0000 7f143effd700 1 -- 172.21.15.70:0/2857822768 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b761874db0 con 0x55b761942c30 2023-10-08T08:47:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.773+0000 7f143effd700 10 client.26066 handle_command_reply: tid=0 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.773+0000 7f14723dbb80 1 client.26066 shutdown 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.773+0000 7f14723dbb80 1 -- 172.21.15.70:0/2857822768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 msgr2=0x55b7619325e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.773+0000 7f14723dbb80 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b7619325e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1450010e20 tx=0x7f1450003ee0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f14723dbb80 1 -- 172.21.15.70:0/2857822768 shutdown_connections 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f14723dbb80 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 0x55b761933060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f14723dbb80 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b761942c30 0x55b761945050 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f14723dbb80 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b7619325e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f14723dbb80 1 --2- 172.21.15.70:0/2857822768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192e880 0x55b761932b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f14723dbb80 1 -- 172.21.15.70:0/2857822768 >> 172.21.15.70:0/2857822768 conn(0x55b76189d200 msgr2=0x55b761923010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f143effd700 0 client.26066 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f14723dbb80 1 -- 172.21.15.70:0/2857822768 shutdown_connections 2023-10-08T08:47:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f14723dbb80 1 -- 172.21.15.70:0/2857822768 wait complete. 2023-10-08T08:47:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.774+0000 7f14723dbb80 20 client.26066 trim_cache size 0 max 16384 2023-10-08T08:47:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.789+0000 7f14723dbb80 1 Processor -- start 2023-10-08T08:47:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.789+0000 7f14723dbb80 1 -- start start 2023-10-08T08:47:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.789+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b761928b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.789+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192e880 0x55b761939bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.789+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192f1a0 0x55b761923790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.789+0000 7f14723dbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7616fc8c0 con 0x55b76192f1a0 2023-10-08T08:47:57.792 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.789+0000 7f14723dbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b761920830 con 0x55b7619290b0 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.789+0000 7f14723dbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b76193f7f0 con 0x55b76192e880 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192f1a0 0x55b761923790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b761928b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192f1a0 0x55b761923790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53312/0 (socket says 172.21.15.70:53312) 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145ffff700 1 -- 172.21.15.70:0/1703569206 learned_addr learned my addr 172.21.15.70:0/1703569206 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145effd700 1 --2- 172.21.15.70:0/1703569206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192e880 0x55b761939bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145ffff700 1 -- 172.21.15.70:0/1703569206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192e880 msgr2=0x55b761939bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145ffff700 1 --2- 172.21.15.70:0/1703569206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192e880 0x55b761939bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145ffff700 1 -- 172.21.15.70:0/1703569206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 msgr2=0x55b761928b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145ffff700 1 --2- 172.21.15.70:0/1703569206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b761928b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.793 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145ffff700 1 -- 172.21.15.70:0/1703569206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b76168fc00 con 0x55b76192f1a0 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145f7fe700 1 --2- 172.21.15.70:0/1703569206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b761928b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f145ffff700 1 --2- 172.21.15.70:0/1703569206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192f1a0 0x55b761923790 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1458011a00 tx=0x7f1458009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8f91704eedae7a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f14467fc700 1 -- 172.21.15.70:0/1703569206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800e040 con 0x55b76192f1a0 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f14467fc700 1 -- 172.21.15.70:0/1703569206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f145800f040 con 0x55b76192f1a0 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.790+0000 7f14467fc700 1 -- 172.21.15.70:0/1703569206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458007ba0 con 0x55b76192f1a0 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 -- 172.21.15.70:0/1703569206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192f1a0 msgr2=0x55b761923790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 --2- 172.21.15.70:0/1703569206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192f1a0 0x55b761923790 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1458011a00 tx=0x7f1458009920 comp rx=0 tx=0).stop 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 -- 172.21.15.70:0/1703569206 shutdown_connections 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 --2- 172.21.15.70:0/1703569206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76192f1a0 0x55b761923790 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 --2- 172.21.15.70:0/1703569206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7619290b0 0x55b761928b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 --2- 172.21.15.70:0/1703569206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192e880 0x55b761939bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 -- 172.21.15.70:0/1703569206 >> 172.21.15.70:0/1703569206 conn(0x55b76189d200 msgr2=0x55b76192c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 -- 172.21.15.70:0/1703569206 shutdown_connections 2023-10-08T08:47:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 -- 172.21.15.70:0/1703569206 wait complete. 2023-10-08T08:47:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 -- start start 2023-10-08T08:47:57.797 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.791+0000 7f14723dbb80 1 Processor -- start 2023-10-08T08:47:57.797 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7619290b0 0x55b761992410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.797 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192e880 0x55b761992950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.797 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f14723dbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 0x55b761938f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f14723dbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b761939550 con 0x55b7619290b0 2023-10-08T08:47:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f14723dbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b761939690 con 0x55b76192e880 2023-10-08T08:47:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f14723dbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b761939850 con 0x55b76192f1a0 2023-10-08T08:47:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f14723dbb80 10 client.0 _ll_register_callbacks cb 0x7f1458009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:47:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7619290b0 0x55b761992410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7619290b0 0x55b761992410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53314/0 (socket says 172.21.15.70:53314) 2023-10-08T08:47:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145ffff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 0x55b761938f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145effd700 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192e880 0x55b761992950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145f7fe700 1 -- 172.21.15.70:0/3780909121 learned_addr learned my addr 172.21.15.70:0/3780909121 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145ffff700 1 -- 172.21.15.70:0/3780909121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192e880 msgr2=0x55b761992950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145ffff700 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192e880 0x55b761992950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145ffff700 1 -- 172.21.15.70:0/3780909121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7619290b0 msgr2=0x55b761992410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145ffff700 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7619290b0 0x55b761992410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145ffff700 1 -- 172.21.15.70:0/3780909121 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1450010b00 con 0x55b76192f1a0 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145f7fe700 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7619290b0 0x55b761992410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f145ffff700 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 0x55b761938f80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1458004a10 tx=0x7f1458008a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b3c28c0e83f4ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.792+0000 7f143effd700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f143effd700 1 -- 172.21.15.70:0/3780909121 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800e070 con 0x55b76192f1a0 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f14723dbb80 1 -- 172.21.15.70:0/3780909121 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1450003b40 con 0x55b76192f1a0 2023-10-08T08:47:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f143effd700 1 -- 172.21.15.70:0/3780909121 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f1458017260 con 0x55b76192f1a0 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f143effd700 1 -- 172.21.15.70:0/3780909121 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1458007500 con 0x55b76192f1a0 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f14723dbb80 10 client.26008 fetch_fsmap learned FSMap version 47 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f14723dbb80 1 -- 172.21.15.70:0/3780909121 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f14580116b0 con 0x55b76192f1a0 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f143effd700 1 -- 172.21.15.70:0/3780909121 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1450003b40 con 0x55b76192f1a0 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f143effd700 1 -- 172.21.15.70:0/3780909121 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f1458020c60 con 0x55b76192f1a0 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f14723dbb80 10 client.26008 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f14723dbb80 10 client.26008 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f14723dbb80 20 client.26008 populate_metadata read hostname 'smithi070' 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f14723dbb80 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b76199b530 0x55b76199d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f14723dbb80 4 client.26008 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f14723dbb80 1 -- 172.21.15.70:0/3780909121 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b761874ad0 con 0x55b76199b530 2023-10-08T08:47:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.793+0000 7f145f7fe700 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b76199b530 0x55b76199d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:47:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.794+0000 7f143effd700 10 client.26008 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.794+0000 7f145f7fe700 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b76199b530 0x55b76199d950 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=653c812f399a14ac server_cookie=dd83c427f57a9f45 in_seq=0 out_seq=0 2023-10-08T08:47:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f143effd700 1 -- 172.21.15.70:0/3780909121 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b761874ad0 con 0x55b76199b530 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f143effd700 10 client.26008 handle_command_reply: tid=0 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 client.26008 shutdown 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 -- 172.21.15.70:0/3780909121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 msgr2=0x55b761938f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 0x55b761938f80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1458004a10 tx=0x7f1458008a20 comp rx=0 tx=0).stop 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 -- 172.21.15.70:0/3780909121 shutdown_connections 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b76192f1a0 0x55b761938f80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7619290b0 0x55b761992410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55b76199b530 0x55b76199d950 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 --2- 172.21.15.70:0/3780909121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b76192e880 0x55b761992950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f143effd700 0 client.26008 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:47:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 -- 172.21.15.70:0/3780909121 >> 172.21.15.70:0/3780909121 conn(0x55b76189d200 msgr2=0x55b76192d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 -- 172.21.15.70:0/3780909121 shutdown_connections 2023-10-08T08:47:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.816+0000 7f14723dbb80 1 -- 172.21.15.70:0/3780909121 wait complete. 2023-10-08T08:47:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14723dbb80 20 client.26008 trim_cache size 0 max 16384 2023-10-08T08:47:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2023-10-08T08:47:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2023-10-08T08:47:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2023-10-08T08:47:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2023-10-08T08:47:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 -- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14480a15f0 msgr2=0x7f14480a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:57.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14480a15f0 0x7f14480a3ab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1460069cf0 tx=0x7f1450007400 comp rx=0 tx=0).stop 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 -- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600fff90 msgr2=0x7f146019bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600fff90 0x7f146019bb80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1454000c00 tx=0x7f1454004730 comp rx=0 tx=0).stop 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 -- 172.21.15.70:0/2762129333 shutdown_connections 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14480a15f0 0x7f14480a3ab0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14601045e0 0x7f1460195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14600ff5d0 0x7f146019b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 --2- 172.21.15.70:0/2762129333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14600fff90 0x7f146019bb80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.817+0000 7f14661f2700 1 -- 172.21.15.70:0/2762129333 >> 172.21.15.70:0/2762129333 conn(0x7f1460076790 msgr2=0x7f14600fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.820+0000 7f14661f2700 1 -- 172.21.15.70:0/2762129333 shutdown_connections 2023-10-08T08:47:57.821 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2023-10-08T08:47:57.820+0000 7f14661f2700 1 -- 172.21.15.70:0/2762129333 wait complete. 2023-10-08T08:47:58.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:47:58 smithi070 ceph-mon[99513]: pgmap v417: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 453 op/s 2023-10-08T08:47:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:47:58 smithi105 ceph-mon[103798]: pgmap v417: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 453 op/s 2023-10-08T08:47:58.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:47:58 smithi191 ceph-mon[104220]: pgmap v417: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 453 op/s 2023-10-08T08:48:00.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:00 smithi070 ceph-mon[99513]: pgmap v418: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 403 op/s 2023-10-08T08:48:00.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:00 smithi105 ceph-mon[103798]: pgmap v418: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 403 op/s 2023-10-08T08:48:00.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:00 smithi191 ceph-mon[104220]: pgmap v418: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 403 op/s 2023-10-08T08:48:02.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:02 smithi070 ceph-mon[99513]: pgmap v419: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 406 op/s 2023-10-08T08:48:02.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:02 smithi105 ceph-mon[103798]: pgmap v419: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 406 op/s 2023-10-08T08:48:02.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:02 smithi191 ceph-mon[104220]: pgmap v419: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 406 op/s 2023-10-08T08:48:04.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:04 smithi070 ceph-mon[99513]: pgmap v420: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 344 op/s 2023-10-08T08:48:04.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:04 smithi105 ceph-mon[103798]: pgmap v420: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 344 op/s 2023-10-08T08:48:04.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:04 smithi191 ceph-mon[104220]: pgmap v420: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 344 op/s 2023-10-08T08:48:05.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T08:48:05.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 -- 172.21.15.70:0/2829821638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 msgr2=0x7f27b8105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2829821638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 0x7f27b8105a90 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009990 tx=0x7f27b4009ca0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 -- 172.21.15.70:0/2829821638 shutdown_connections 2023-10-08T08:48:05.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2829821638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b80fffe0 0x7f27b810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2829821638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 0x7f27b8105a90 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2829821638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27b80ff620 0x7f27b80ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 -- 172.21.15.70:0/2829821638 >> 172.21.15.70:0/2829821638 conn(0x7f27b8076780 msgr2=0x7f27b8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 -- 172.21.15.70:0/2829821638 shutdown_connections 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 -- 172.21.15.70:0/2829821638 wait complete. 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 Processor -- start 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.318+0000 7f27bfd92700 1 -- start start 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bfd92700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b80ff620 0x7f27b819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bfd92700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27b80fffe0 0x7f27b819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bfd92700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 0x7f27b8196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bfd92700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b8196fb0 con 0x7f27b81056b0 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bfd92700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b8197120 con 0x7f27b80ff620 2023-10-08T08:48:05.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bfd92700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81972e0 con 0x7f27b80fffe0 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27be32f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 0x7f27b8196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27be32f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 0x7f27b8196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53332/0 (socket says 172.21.15.70:53332) 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27be32f700 1 -- 172.21.15.70:0/2055125046 learned_addr learned my addr 172.21.15.70:0/2055125046 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b80ff620 0x7f27b819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bd32d700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27b80fffe0 0x7f27b819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27be32f700 1 -- 172.21.15.70:0/2055125046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27b80fffe0 msgr2=0x7f27b819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27be32f700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27b80fffe0 0x7f27b819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27be32f700 1 -- 172.21.15.70:0/2055125046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b80ff620 msgr2=0x7f27b819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27be32f700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b80ff620 0x7f27b819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27be32f700 1 -- 172.21.15.70:0/2055125046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40095f0 con 0x7f27b81056b0 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b80ff620 0x7f27b819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27be32f700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 0x7f27b8196950 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f27b000ef30 tx=0x7f27b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27aeffd700 1 -- 172.21.15.70:0/2055125046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0018070 con 0x7f27b81056b0 2023-10-08T08:48:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27aeffd700 1 -- 172.21.15.70:0/2055125046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27b000f040 con 0x7f27b81056b0 2023-10-08T08:48:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bfd92700 1 -- 172.21.15.70:0/2055125046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b8197560 con 0x7f27b81056b0 2023-10-08T08:48:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27aeffd700 1 -- 172.21.15.70:0/2055125046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000cd00 con 0x7f27b81056b0 2023-10-08T08:48:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.319+0000 7f27bfd92700 1 -- 172.21.15.70:0/2055125046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b81a3810 con 0x7f27b81056b0 2023-10-08T08:48:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.321+0000 7f27aeffd700 1 -- 172.21.15.70:0/2055125046 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f27b0003a00 con 0x7f27b81056b0 2023-10-08T08:48:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.322+0000 7f27aeffd700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f27a40a15f0 0x7f27a40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.322+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f27a40a15f0 0x7f27a40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.322+0000 7f27aeffd700 1 -- 172.21.15.70:0/2055125046 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f27b00ccf30 con 0x7f27b81056b0 2023-10-08T08:48:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.322+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f27a40a15f0 0x7f27a40a3ab0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27b4006010 tx=0x7f27b4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27cbf7bb80 1 Processor -- start 2023-10-08T08:48:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27cbf7bb80 1 -- start start 2023-10-08T08:48:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715acde80 0x556715ace260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ad9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 0x556715adba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x556715a37460 con 0x556715acde80 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x556715a28c20 con 0x556715ad9650 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556715a26540 con 0x556715ace7a0 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27bdb2e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715acde80 0x556715ace260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27bdb2e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715acde80 0x556715ace260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53336/0 (socket says 172.21.15.70:53336) 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27bdb2e700 1 -- 172.21.15.70:0/1873378734 learned_addr learned my addr 172.21.15.70:0/1873378734 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27be32f700 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 0x556715adba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.323+0000 7f27bd32d700 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ad9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27bdb2e700 1 -- 172.21.15.70:0/1873378734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 msgr2=0x556715ad9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ad9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27bdb2e700 1 -- 172.21.15.70:0/1873378734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 msgr2=0x556715adba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 0x556715adba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27bdb2e700 1 -- 172.21.15.70:0/1873378734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55671584cde0 con 0x556715acde80 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27be32f700 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 0x556715adba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715acde80 0x556715ace260 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f27b8077ab0 tx=0x7f27b4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4840e417177b045c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27a3fff700 1 -- 172.21.15.70:0/1873378734 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b402b070 con 0x556715acde80 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27a3fff700 1 -- 172.21.15.70:0/1873378734 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27b401e040 con 0x556715acde80 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.324+0000 7f27a3fff700 1 -- 172.21.15.70:0/1873378734 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40049a0 con 0x556715acde80 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/1873378734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715acde80 msgr2=0x556715ace260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715acde80 0x556715ace260 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f27b8077ab0 tx=0x7f27b4020000 comp rx=0 tx=0).stop 2023-10-08T08:48:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/1873378734 shutdown_connections 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 0x556715adba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715acde80 0x556715ace260 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/1873378734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ad9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/1873378734 >> 172.21.15.70:0/1873378734 conn(0x556715a43260 msgr2=0x556715aca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/1873378734 shutdown_connections 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/1873378734 wait complete. 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 -- start start 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.325+0000 7f27cbf7bb80 1 Processor -- start 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 0x556715ad90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ad63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x556715a21e30 con 0x556715ad9650 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567159be710 con 0x556715acde80 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567159be3b0 con 0x556715ace7a0 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27cbf7bb80 10 client.0 _ll_register_callbacks cb 0x55671581b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27be32f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27bdb2e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 0x556715ad90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27be32f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53346/0 (socket says 172.21.15.70:53346) 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27bd32d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ad63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27be32f700 1 -- 172.21.15.70:0/3405339786 learned_addr learned my addr 172.21.15.70:0/3405339786 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27be32f700 1 -- 172.21.15.70:0/3405339786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 msgr2=0x556715ad63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27be32f700 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ad63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27be32f700 1 -- 172.21.15.70:0/3405339786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 msgr2=0x556715ad90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27be32f700 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 0x556715ad90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27be32f700 1 -- 172.21.15.70:0/3405339786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b81a3810 con 0x556715ad9650 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 0x556715ad90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27be32f700 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad6b10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f27b0099c60 tx=0x7f27b0099900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c386e2f88e613 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.326+0000 7f27a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27a17fa700 1 -- 172.21.15.70:0/3405339786 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b009a130 con 0x556715ad9650 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27a17fa700 1 -- 172.21.15.70:0/3405339786 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f27b009a3d0 con 0x556715ad9650 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/3405339786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567159e9eb0 con 0x556715ad9650 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27a17fa700 1 -- 172.21.15.70:0/3405339786 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27b0099cd0 con 0x556715ad9650 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27cbf7bb80 10 client.16677 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/3405339786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f27b810cde0 con 0x556715ad9650 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27a17fa700 1 -- 172.21.15.70:0/3405339786 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27b007c080 con 0x556715ad9650 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27a17fa700 1 -- 172.21.15.70:0/3405339786 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f27b00992c0 con 0x556715ad9650 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27cbf7bb80 10 client.16677 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27cbf7bb80 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27cbf7bb80 20 client.16677 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x556715ae92f0 0x556715aeb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27cbf7bb80 4 client.16677 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/3405339786 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556715a1ae10 con 0x556715ae92f0 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.327+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x556715ae92f0 0x556715aeb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.328+0000 7f27a17fa700 10 client.16677 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:48:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.328+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x556715ae92f0 0x556715aeb710 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1a1e920531c1a5b server_cookie=500b36c86047c829 in_seq=0 out_seq=0 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.329+0000 7f27a17fa700 1 -- 172.21.15.70:0/3405339786 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556715a1ae10 con 0x556715ae92f0 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.329+0000 7f27a17fa700 10 client.16677 handle_command_reply: tid=0 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.329+0000 7f27cbf7bb80 1 client.16677 shutdown 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/3405339786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 msgr2=0x556715ad6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad6b10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f27b0099c60 tx=0x7f27b0099900 comp rx=0 tx=0).stop 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/3405339786 shutdown_connections 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad6b10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x556715ae92f0 0x556715aeb710 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 0x556715ad90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/3405339786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ad63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27a17fa700 0 client.16677 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:48:05.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/3405339786 >> 172.21.15.70:0/3405339786 conn(0x556715a43260 msgr2=0x556715ac9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:05.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/3405339786 shutdown_connections 2023-10-08T08:48:05.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/3405339786 wait complete. 2023-10-08T08:48:05.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.330+0000 7f27cbf7bb80 20 client.16677 trim_cache size 0 max 16384 2023-10-08T08:48:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.348+0000 7f27cbf7bb80 1 Processor -- start 2023-10-08T08:48:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.348+0000 7f27cbf7bb80 1 -- start start 2023-10-08T08:48:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 0x556715ad0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ae5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567158a2920 con 0x556715ad9650 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x556715ac4570 con 0x556715acde80 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556715acf970 con 0x556715ace7a0 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27be32f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27be32f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53354/0 (socket says 172.21.15.70:53354) 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27be32f700 1 -- 172.21.15.70:0/4021027753 learned_addr learned my addr 172.21.15.70:0/4021027753 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/4021027753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 0x556715ad0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27bd32d700 1 --2- 172.21.15.70:0/4021027753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ae5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27be32f700 1 -- 172.21.15.70:0/4021027753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 msgr2=0x556715ae5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27be32f700 1 --2- 172.21.15.70:0/4021027753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ae5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27be32f700 1 -- 172.21.15.70:0/4021027753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 msgr2=0x556715ad0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27be32f700 1 --2- 172.21.15.70:0/4021027753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 0x556715ad0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27be32f700 1 -- 172.21.15.70:0/4021027753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556715835c60 con 0x556715ad9650 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27be32f700 1 --2- 172.21.15.70:0/4021027753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad5d10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f27b00999d0 tx=0x7f27b0009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c97b62fe617a60b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27acff9700 1 -- 172.21.15.70:0/4021027753 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b00993c0 con 0x556715ad9650 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27acff9700 1 -- 172.21.15.70:0/4021027753 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5567159e9eb0 con 0x556715ad9650 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.349+0000 7f27acff9700 1 -- 172.21.15.70:0/4021027753 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b009a190 con 0x556715ad9650 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4021027753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 msgr2=0x556715ad5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4021027753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad5d10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f27b00999d0 tx=0x7f27b0009ed0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4021027753 shutdown_connections 2023-10-08T08:48:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4021027753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ad9650 0x556715ad5d10 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4021027753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715acde80 0x556715ad0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4021027753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715ace7a0 0x556715ae5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4021027753 >> 172.21.15.70:0/4021027753 conn(0x556715a43260 msgr2=0x556715ae48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4021027753 shutdown_connections 2023-10-08T08:48:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4021027753 wait complete. 2023-10-08T08:48:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 -- start start 2023-10-08T08:48:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.350+0000 7f27cbf7bb80 1 Processor -- start 2023-10-08T08:48:05.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715acde80 0x556715adfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ace7a0 0x556715ae0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27cbf7bb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 0x556715ade460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x556715adeb40 con 0x556715ace7a0 2023-10-08T08:48:05.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x556715adecb0 con 0x556715ad9650 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27cbf7bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556715adee70 con 0x556715acde80 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27cbf7bb80 10 client.0 _ll_register_callbacks cb 0x7f27b0096100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bd32d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ace7a0 0x556715ae0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bd32d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ace7a0 0x556715ae0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53358/0 (socket says 172.21.15.70:53358) 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bdb2e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715acde80 0x556715adfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bd32d700 1 -- 172.21.15.70:0/4203133060 learned_addr learned my addr 172.21.15.70:0/4203133060 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27be32f700 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 0x556715ade460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bdb2e700 1 -- 172.21.15.70:0/4203133060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 msgr2=0x556715ade460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 0x556715ade460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bdb2e700 1 -- 172.21.15.70:0/4203133060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ace7a0 msgr2=0x556715ae0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ace7a0 0x556715ae0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bdb2e700 1 -- 172.21.15.70:0/4203133060 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b810cde0 con 0x556715acde80 2023-10-08T08:48:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bd32d700 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ace7a0 0x556715ae0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27bdb2e700 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715acde80 0x556715adfdc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000c00 tx=0x7f27b400fe30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66d57930f6bacce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.351+0000 7f27a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2023-10-08T08:48:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27a17fa700 1 -- 172.21.15.70:0/4203133060 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4035040 con 0x556715acde80 2023-10-08T08:48:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4203133060 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27b401e040 con 0x556715acde80 2023-10-08T08:48:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27a17fa700 1 -- 172.21.15.70:0/4203133060 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f27b4030460 con 0x556715acde80 2023-10-08T08:48:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27a17fa700 1 -- 172.21.15.70:0/4203133060 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27b402b040 con 0x556715acde80 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27cbf7bb80 10 client.26026 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4203133060 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x556715873250 con 0x556715acde80 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27a17fa700 1 -- 172.21.15.70:0/4203133060 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27b401e040 con 0x556715acde80 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27a17fa700 1 -- 172.21.15.70:0/4203133060 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f27b4038030 con 0x556715acde80 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27cbf7bb80 10 client.26026 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27cbf7bb80 10 client.26026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27cbf7bb80 20 client.26026 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x556715b3dfd0 0x556715b403f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27cbf7bb80 4 client.26026 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T08:48:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4203133060 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556715a1ab30 con 0x556715b3dfd0 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.352+0000 7f27bd32d700 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x556715b3dfd0 0x556715b403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27a17fa700 10 client.26026 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27bd32d700 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x556715b3dfd0 0x556715b403f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f62d9b867fc89708 server_cookie=b98e44d8705d7b9b in_seq=0 out_seq=0 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27a17fa700 1 -- 172.21.15.70:0/4203133060 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556715a1ab30 con 0x556715b3dfd0 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27a17fa700 10 client.26026 handle_command_reply: tid=0 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 client.26026 shutdown 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4203133060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715acde80 msgr2=0x556715adfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715acde80 0x556715adfdc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000c00 tx=0x7f27b400fe30 comp rx=0 tx=0).stop 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4203133060 shutdown_connections 2023-10-08T08:48:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x556715b3dfd0 0x556715b403f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556715ad9650 0x556715ade460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27a17fa700 0 client.26026 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:48:05.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556715acde80 0x556715adfdc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 --2- 172.21.15.70:0/4203133060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556715ace7a0 0x556715ae0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4203133060 >> 172.21.15.70:0/4203133060 conn(0x556715a43260 msgr2=0x556715ad8500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:05.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4203133060 shutdown_connections 2023-10-08T08:48:05.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 1 -- 172.21.15.70:0/4203133060 wait complete. 2023-10-08T08:48:05.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.353+0000 7f27cbf7bb80 20 client.26026 trim_cache size 0 max 16384 2023-10-08T08:48:05.364 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:48:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2023-10-08T08:48:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2023-10-08T08:48:05.365 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 -- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f27a40a15f0 msgr2=0x7f27a40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f27a40a15f0 0x7f27a40a3ab0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27b4006010 tx=0x7f27b4005960 comp rx=0 tx=0).stop 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 -- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 msgr2=0x7f27b8196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 0x7f27b8196950 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f27b000ef30 tx=0x7f27b000c3a0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 -- 172.21.15.70:0/2055125046 shutdown_connections 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f27a40a15f0 0x7f27a40a3ab0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27b81056b0 0x7f27b8196950 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b80ff620 0x7f27b819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 --2- 172.21.15.70:0/2055125046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27b80fffe0 0x7f27b819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 -- 172.21.15.70:0/2055125046 >> 172.21.15.70:0/2055125046 conn(0x7f27b8076780 msgr2=0x7f27b80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:05.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 -- 172.21.15.70:0/2055125046 shutdown_connections 2023-10-08T08:48:05.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.354+0000 7f27bfd92700 1 -- 172.21.15.70:0/2055125046 wait complete. 2023-10-08T08:48:05.368 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T08:48:05.368 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:48:05.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 -- 172.21.15.70:0/3850678900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80ff560 msgr2=0x7f90c80ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 --2- 172.21.15.70:0/3850678900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80ff560 0x7f90c80ff9e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f90b80099c0 tx=0x7f90b8009cd0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 -- 172.21.15.70:0/3850678900 shutdown_connections 2023-10-08T08:48:05.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 --2- 172.21.15.70:0/3850678900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90c80fff20 0x7f90c810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 --2- 172.21.15.70:0/3850678900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c8105620 0x7f90c8105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 --2- 172.21.15.70:0/3850678900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80ff560 0x7f90c80ff9e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 -- 172.21.15.70:0/3850678900 >> 172.21.15.70:0/3850678900 conn(0x7f90c80fb050 msgr2=0x7f90c80fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 -- 172.21.15.70:0/3850678900 shutdown_connections 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 -- 172.21.15.70:0/3850678900 wait complete. 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.493+0000 7f90cf954700 1 Processor -- start 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cf954700 1 -- start start 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cf954700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c80ff560 0x7f90c819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cf954700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80fff20 0x7f90c819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cf954700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90c8105620 0x7f90c81968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cf954700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c81970c0 con 0x7f90c80fff20 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cf954700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8197230 con 0x7f90c80ff560 2023-10-08T08:48:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cf954700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c81973f0 con 0x7f90c8105620 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cceef700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80fff20 0x7f90c819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cceef700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80fff20 0x7f90c819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53372/0 (socket says 172.21.15.70:53372) 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cceef700 1 -- 172.21.15.70:0/3371627287 learned_addr learned my addr 172.21.15.70:0/3371627287 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cd6f0700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c80ff560 0x7f90c819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cdef1700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90c8105620 0x7f90c81968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cceef700 1 -- 172.21.15.70:0/3371627287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90c8105620 msgr2=0x7f90c81968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cceef700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90c8105620 0x7f90c81968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cceef700 1 -- 172.21.15.70:0/3371627287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c80ff560 msgr2=0x7f90c819c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cceef700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c80ff560 0x7f90c819c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cceef700 1 -- 172.21.15.70:0/3371627287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b80095f0 con 0x7f90c80fff20 2023-10-08T08:48:05.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cd6f0700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c80ff560 0x7f90c819c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:05.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cceef700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80fff20 0x7f90c819cd90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f90b800b9a0 tx=0x7f90b8005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:05.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90be7fc700 1 -- 172.21.15.70:0/3371627287 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b801d070 con 0x7f90c80fff20 2023-10-08T08:48:05.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90be7fc700 1 -- 172.21.15.70:0/3371627287 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90b800bdd0 con 0x7f90c80fff20 2023-10-08T08:48:05.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c8197670 con 0x7f90c80fff20 2023-10-08T08:48:05.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.494+0000 7f90be7fc700 1 -- 172.21.15.70:0/3371627287 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800f9c0 con 0x7f90c80fff20 2023-10-08T08:48:05.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.495+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c81a37d0 con 0x7f90c80fff20 2023-10-08T08:48:05.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.495+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c8100c80 con 0x7f90c80fff20 2023-10-08T08:48:05.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.496+0000 7f90be7fc700 1 -- 172.21.15.70:0/3371627287 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f90b800fb40 con 0x7f90c80fff20 2023-10-08T08:48:05.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.497+0000 7f90be7fc700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90b40a15f0 0x7f90b40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:05.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.497+0000 7f90be7fc700 1 -- 172.21.15.70:0/3371627287 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f90b80ce3c0 con 0x7f90c80fff20 2023-10-08T08:48:05.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.497+0000 7f90cd6f0700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90b40a15f0 0x7f90b40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:05.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.497+0000 7f90cd6f0700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90b40a15f0 0x7f90b40a3ab0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009fd0 tx=0x7f90c4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:05.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.501+0000 7f90be7fc700 1 -- 172.21.15.70:0/3371627287 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f90b80974a0 con 0x7f90c80fff20 2023-10-08T08:48:05.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.825+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90c80678a0 con 0x7f90c80fff20 2023-10-08T08:48:05.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.826+0000 7f90be7fc700 1 -- 172.21.15.70:0/3371627287 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+11407 (secure 0 0 0) 0x7f90b809aac0 con 0x7f90c80fff20 2023-10-08T08:48:05.828 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:48:05.828 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":47,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:47:18.323164+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":61,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_25918":{"gid":25918,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/269007402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":269007402},{"type":"v1","addr":"172.21.15.105:6835","nonce":269007402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:48:05.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90b40a15f0 msgr2=0x7f90b40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90b40a15f0 0x7f90b40a3ab0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009fd0 tx=0x7f90c4009260 comp rx=0 tx=0).stop 2023-10-08T08:48:05.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80fff20 msgr2=0x7f90c819cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80fff20 0x7f90c819cd90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f90b800b9a0 tx=0x7f90b8005f10 comp rx=0 tx=0).stop 2023-10-08T08:48:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 shutdown_connections 2023-10-08T08:48:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f90b40a15f0 0x7f90b40a3ab0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90c8105620 0x7f90c81968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c80ff560 0x7f90c819c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 --2- 172.21.15.70:0/3371627287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90c80fff20 0x7f90c819cd90 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 >> 172.21.15.70:0/3371627287 conn(0x7f90c80fb050 msgr2=0x7f90c80fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 shutdown_connections 2023-10-08T08:48:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:05.828+0000 7f90cf954700 1 -- 172.21.15.70:0/3371627287 wait complete. 2023-10-08T08:48:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 47 2023-10-08T08:48:05.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T08:48:06.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.005+0000 7faaabe89700 1 -- 172.21.15.70:0/1462606619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaa4100b80 msgr2=0x7faaa410c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.005+0000 7faaabe89700 1 --2- 172.21.15.70:0/1462606619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaa4100b80 0x7faaa410c510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009f90 tx=0x7faa9c00b330 comp rx=0 tx=0).stop 2023-10-08T08:48:06.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.005+0000 7faaabe89700 1 -- 172.21.15.70:0/1462606619 shutdown_connections 2023-10-08T08:48:06.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.005+0000 7faaabe89700 1 --2- 172.21.15.70:0/1462606619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaa4100b80 0x7faaa410c510 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.005+0000 7faaabe89700 1 --2- 172.21.15.70:0/1462606619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa41046a0 0x7faaa4104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.005+0000 7faaabe89700 1 --2- 172.21.15.70:0/1462606619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa41001c0 0x7faaa4100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.005+0000 7faaabe89700 1 -- 172.21.15.70:0/1462606619 >> 172.21.15.70:0/1462606619 conn(0x7faaa40749a0 msgr2=0x7faaa4074db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.006+0000 7faaabe89700 1 -- 172.21.15.70:0/1462606619 shutdown_connections 2023-10-08T08:48:06.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.006+0000 7faaabe89700 1 -- 172.21.15.70:0/1462606619 wait complete. 2023-10-08T08:48:06.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaabe89700 1 Processor -- start 2023-10-08T08:48:06.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaabe89700 1 -- start start 2023-10-08T08:48:06.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaabe89700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa41001c0 0x7faaa419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaabe89700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa4100b80 0x7faaa419cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaabe89700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaa41046a0 0x7faaa4196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaabe89700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4197200 con 0x7faaa41001c0 2023-10-08T08:48:06.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaabe89700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4197370 con 0x7faaa4100b80 2023-10-08T08:48:06.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaabe89700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4197530 con 0x7faaa41046a0 2023-10-08T08:48:06.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaaa426700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaa41046a0 0x7faaa4196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaa9c25700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa41001c0 0x7faaa419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaa9c25700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa41001c0 0x7faaa419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53386/0 (socket says 172.21.15.70:53386) 2023-10-08T08:48:06.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.007+0000 7faaa9c25700 1 -- 172.21.15.70:0/129818132 learned_addr learned my addr 172.21.15.70:0/129818132 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.008+0000 7faaa9c25700 1 -- 172.21.15.70:0/129818132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaa41046a0 msgr2=0x7faaa4196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.008+0000 7faaa9c25700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaa41046a0 0x7faaa4196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.008+0000 7faaa9c25700 1 -- 172.21.15.70:0/129818132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa4100b80 msgr2=0x7faaa419cfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T08:48:06.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.008+0000 7faaa9c25700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa4100b80 0x7faaa419cfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.008+0000 7faaa9c25700 1 -- 172.21.15.70:0/129818132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c009c40 con 0x7faaa41001c0 2023-10-08T08:48:06.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.008+0000 7faaa9c25700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa41001c0 0x7faaa419ca70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009ed0 tx=0x7faaa000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.008+0000 7faa9affd700 1 -- 172.21.15.70:0/129818132 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0013be0 con 0x7faaa41001c0 2023-10-08T08:48:06.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.008+0000 7faaabe89700 1 -- 172.21.15.70:0/129818132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa4197810 con 0x7faaa41001c0 2023-10-08T08:48:06.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.009+0000 7faaabe89700 1 -- 172.21.15.70:0/129818132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa410cc30 con 0x7faaa41001c0 2023-10-08T08:48:06.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.009+0000 7faa9affd700 1 -- 172.21.15.70:0/129818132 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faaa000ee80 con 0x7faaa41001c0 2023-10-08T08:48:06.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.009+0000 7faa9affd700 1 -- 172.21.15.70:0/129818132 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa000ce10 con 0x7faaa41001c0 2023-10-08T08:48:06.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.011+0000 7faa9affd700 1 -- 172.21.15.70:0/129818132 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7faaa0003680 con 0x7faaa41001c0 2023-10-08T08:48:06.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.012+0000 7faa9affd700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faa900a16f0 0x7faa900a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.012+0000 7faa9affd700 1 -- 172.21.15.70:0/129818132 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7faaa00d1470 con 0x7faaa41001c0 2023-10-08T08:48:06.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.012+0000 7faaa9424700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faa900a16f0 0x7faa900a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.013+0000 7faaa9424700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faa900a16f0 0x7faa900a3bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faaa4198240 tx=0x7faa94006cb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.013+0000 7faab8072b80 1 Processor -- start 2023-10-08T08:48:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.013+0000 7faab8072b80 1 -- start start 2023-10-08T08:48:06.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faab8072b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd1e80 0x55c71ccd2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faab8072b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd27a0 0x55c71ccdd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faab8072b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccdfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faab8072b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71cc3b460 con 0x55c71ccd1e80 2023-10-08T08:48:06.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faab8072b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71cc2cc20 con 0x55c71ccd27a0 2023-10-08T08:48:06.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faab8072b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71cc2a540 con 0x55c71ccdd650 2023-10-08T08:48:06.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaaa426700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccdfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaaa426700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccdfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40968/0 (socket says 172.21.15.70:40968) 2023-10-08T08:48:06.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaaa426700 1 -- 172.21.15.70:0/953824896 learned_addr learned my addr 172.21.15.70:0/953824896 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaa9c25700 1 --2- 172.21.15.70:0/953824896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd1e80 0x55c71ccd2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaaa426700 1 -- 172.21.15.70:0/953824896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd27a0 msgr2=0x55c71ccdd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaaa426700 1 --2- 172.21.15.70:0/953824896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd27a0 0x55c71ccdd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaaa426700 1 -- 172.21.15.70:0/953824896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd1e80 msgr2=0x55c71ccd2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaaa426700 1 --2- 172.21.15.70:0/953824896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd1e80 0x55c71ccd2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaaa426700 1 -- 172.21.15.70:0/953824896 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c71ca50de0 con 0x55c71ccdd650 2023-10-08T08:48:06.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.014+0000 7faaaa426700 1 --2- 172.21.15.70:0/953824896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccdfa40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009bd0 tx=0x7faa9c007420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edca7e49db2c2571 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.015+0000 7faa8ffff700 1 -- 172.21.15.70:0/953824896 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00e040 con 0x55c71ccdd650 2023-10-08T08:48:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.015+0000 7faa8ffff700 1 -- 172.21.15.70:0/953824896 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa9c00b9f0 con 0x55c71ccdd650 2023-10-08T08:48:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.015+0000 7faa8ffff700 1 -- 172.21.15.70:0/953824896 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c007e50 con 0x55c71ccdd650 2023-10-08T08:48:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 -- 172.21.15.70:0/953824896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 msgr2=0x55c71ccdfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 --2- 172.21.15.70:0/953824896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccdfa40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009bd0 tx=0x7faa9c007420 comp rx=0 tx=0).stop 2023-10-08T08:48:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 -- 172.21.15.70:0/953824896 shutdown_connections 2023-10-08T08:48:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 --2- 172.21.15.70:0/953824896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccdfa40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 --2- 172.21.15.70:0/953824896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd1e80 0x55c71ccd2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 --2- 172.21.15.70:0/953824896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd27a0 0x55c71ccdd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 -- 172.21.15.70:0/953824896 >> 172.21.15.70:0/953824896 conn(0x55c71cc47260 msgr2=0x55c71ccce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 -- 172.21.15.70:0/953824896 shutdown_connections 2023-10-08T08:48:06.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 -- 172.21.15.70:0/953824896 wait complete. 2023-10-08T08:48:06.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 -- start start 2023-10-08T08:48:06.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.016+0000 7faab8072b80 1 Processor -- start 2023-10-08T08:48:06.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faab8072b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccdcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faab8072b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd27a0 0x55c71ccda2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faab8072b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccda8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faab8072b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71cc25e30 con 0x55c71ccd27a0 2023-10-08T08:48:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faab8072b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71cbc2710 con 0x55c71ccd1e80 2023-10-08T08:48:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faab8072b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71cbc23b0 con 0x55c71ccdd650 2023-10-08T08:48:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faab8072b80 10 client.0 _ll_register_callbacks cb 0x55c71ca1f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faaa9c25700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccdcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faaa9c25700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccdcfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40852/0 (socket says 172.21.15.70:40852) 2023-10-08T08:48:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faaa9c25700 1 -- 172.21.15.70:0/2895910521 learned_addr learned my addr 172.21.15.70:0/2895910521 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faaaa426700 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccda8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.017+0000 7faaa9424700 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd27a0 0x55c71ccda2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faaa9424700 1 -- 172.21.15.70:0/2895910521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 msgr2=0x55c71ccda8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faaa9424700 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccda8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faaa9424700 1 -- 172.21.15.70:0/2895910521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 msgr2=0x55c71ccdcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faaa9424700 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccdcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faaa9424700 1 -- 172.21.15.70:0/2895910521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa40ff400 con 0x55c71ccd27a0 2023-10-08T08:48:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faaaa426700 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccda8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:48:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faaa9c25700 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccdcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:48:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faaa9424700 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd27a0 0x55c71ccda2b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faa94009e50 tx=0x7faa94012740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffc8f053c33fa36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faa8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:48:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faa8d7fa700 1 -- 172.21.15.70:0/2895910521 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9401a070 con 0x55c71ccd27a0 2023-10-08T08:48:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faa8d7fa700 1 -- 172.21.15.70:0/2895910521 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7faa940150d0 con 0x55c71ccd27a0 2023-10-08T08:48:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.018+0000 7faab8072b80 1 -- 172.21.15.70:0/2895910521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c71cbedeb0 con 0x55c71ccd27a0 2023-10-08T08:48:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faa8d7fa700 1 -- 172.21.15.70:0/2895910521 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa94015290 con 0x55c71ccd27a0 2023-10-08T08:48:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faab8072b80 10 client.16701 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faab8072b80 1 -- 172.21.15.70:0/2895910521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55c71ca39c60 con 0x55c71ccd27a0 2023-10-08T08:48:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faa8d7fa700 1 -- 172.21.15.70:0/2895910521 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c71cbedeb0 con 0x55c71ccd27a0 2023-10-08T08:48:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faa8d7fa700 1 -- 172.21.15.70:0/2895910521 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7faa94010480 con 0x55c71ccd27a0 2023-10-08T08:48:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faab8072b80 10 client.16701 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faab8072b80 10 client.16701 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-10-08T08:48:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faab8072b80 20 client.16701 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faab8072b80 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55c71cce4210 0x55c71cce6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faab8072b80 4 client.16701 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faab8072b80 1 -- 172.21.15.70:0/2895910521 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c71cc1ee10 con 0x55c71cce4210 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.019+0000 7faaa9c25700 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55c71cce4210 0x55c71cce6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.020+0000 7faa8d7fa700 10 client.16701 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.020+0000 7faaa9c25700 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55c71cce4210 0x55c71cce6630 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=eec86ddf962ce82c server_cookie=8bd0c96ec1702066 in_seq=0 out_seq=0 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.022+0000 7faa8d7fa700 1 -- 172.21.15.70:0/2895910521 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c71cc1ee10 con 0x55c71cce4210 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.022+0000 7faa8d7fa700 10 client.16701 handle_command_reply: tid=0 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.023+0000 7faab8072b80 1 client.16701 shutdown 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.025+0000 7faab8072b80 1 -- 172.21.15.70:0/2895910521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd27a0 msgr2=0x55c71ccda2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.025+0000 7faab8072b80 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd27a0 0x55c71ccda2b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faa94009e50 tx=0x7faa94012740 comp rx=0 tx=0).stop 2023-10-08T08:48:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.025+0000 7faab8072b80 1 -- 172.21.15.70:0/2895910521 shutdown_connections 2023-10-08T08:48:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.025+0000 7faab8072b80 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccdd650 0x55c71ccda8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.025+0000 7faab8072b80 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccdcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.025+0000 7faab8072b80 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55c71cce4210 0x55c71cce6630 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.025+0000 7faab8072b80 1 --2- 172.21.15.70:0/2895910521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd27a0 0x55c71ccda2b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.025+0000 7faab8072b80 1 -- 172.21.15.70:0/2895910521 >> 172.21.15.70:0/2895910521 conn(0x55c71cc47260 msgr2=0x55c71cccdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.026+0000 7faa8d7fa700 0 client.16701 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:48:06.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.027+0000 7faab8072b80 1 -- 172.21.15.70:0/2895910521 shutdown_connections 2023-10-08T08:48:06.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.027+0000 7faab8072b80 1 -- 172.21.15.70:0/2895910521 wait complete. 2023-10-08T08:48:06.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.027+0000 7faab8072b80 20 client.16701 trim_cache size 0 max 16384 2023-10-08T08:48:06.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.048+0000 7faab8072b80 1 Processor -- start 2023-10-08T08:48:06.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.048+0000 7faab8072b80 1 -- start start 2023-10-08T08:48:06.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.048+0000 7faab8072b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71cc47260 0x55c71ccd4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.048+0000 7faab8072b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd1e80 0x55c71ccd7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.048+0000 7faab8072b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd27a0 0x55c71ccd7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.048+0000 7faab8072b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71caa6920 con 0x55c71ccd1e80 2023-10-08T08:48:06.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.048+0000 7faab8072b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71ccd2b80 con 0x55c71ccd27a0 2023-10-08T08:48:06.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.048+0000 7faab8072b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71ccdaee0 con 0x55c71cc47260 2023-10-08T08:48:06.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.049+0000 7faaa9c25700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71cc47260 0x55c71ccd4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.049+0000 7faaa9c25700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71cc47260 0x55c71ccd4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:40980/0 (socket says 172.21.15.70:40980) 2023-10-08T08:48:06.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.049+0000 7faaa9c25700 1 -- 172.21.15.70:0/1304090232 learned_addr learned my addr 172.21.15.70:0/1304090232 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.049+0000 7faaa9c25700 1 -- 172.21.15.70:0/1304090232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd27a0 msgr2=0x55c71ccd7ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T08:48:06.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.049+0000 7faaa9c25700 1 --2- 172.21.15.70:0/1304090232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd27a0 0x55c71ccd7ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.049+0000 7faaa9c25700 1 -- 172.21.15.70:0/1304090232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd1e80 msgr2=0x55c71ccd7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.049+0000 7faaa9c25700 1 --2- 172.21.15.70:0/1304090232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd1e80 0x55c71ccd7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.049+0000 7faaa9c25700 1 -- 172.21.15.70:0/1304090232 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c71ca77250 con 0x55c71cc47260 2023-10-08T08:48:06.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.049+0000 7faaa9c25700 1 --2- 172.21.15.70:0/1304090232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71cc47260 0x55c71ccd4db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009ea0 tx=0x7faaa0009740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dd17e75b2470b7a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.051+0000 7faa98ff9700 1 -- 172.21.15.70:0/1304090232 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa00a2380 con 0x55c71cc47260 2023-10-08T08:48:06.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.051+0000 7faa98ff9700 1 -- 172.21.15.70:0/1304090232 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faaa00a65c0 con 0x55c71cc47260 2023-10-08T08:48:06.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.051+0000 7faa98ff9700 1 -- 172.21.15.70:0/1304090232 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa00ceb10 con 0x55c71cc47260 2023-10-08T08:48:06.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 -- 172.21.15.70:0/1304090232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71cc47260 msgr2=0x55c71ccd4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 --2- 172.21.15.70:0/1304090232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71cc47260 0x55c71ccd4db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009ea0 tx=0x7faaa0009740 comp rx=0 tx=0).stop 2023-10-08T08:48:06.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 -- 172.21.15.70:0/1304090232 shutdown_connections 2023-10-08T08:48:06.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 --2- 172.21.15.70:0/1304090232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd27a0 0x55c71ccd7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 --2- 172.21.15.70:0/1304090232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71cc47260 0x55c71ccd4db0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 --2- 172.21.15.70:0/1304090232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71ccd1e80 0x55c71ccd7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 -- 172.21.15.70:0/1304090232 >> 172.21.15.70:0/1304090232 conn(0x55c71ccca2a0 msgr2=0x55c71ccd8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 -- 172.21.15.70:0/1304090232 shutdown_connections 2023-10-08T08:48:06.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 -- 172.21.15.70:0/1304090232 wait complete. 2023-10-08T08:48:06.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.052+0000 7faab8072b80 1 -- start start 2023-10-08T08:48:06.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.053+0000 7faab8072b80 1 Processor -- start 2023-10-08T08:48:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.053+0000 7faab8072b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71cc47260 0x55c71cce9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.053+0000 7faab8072b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccea230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.053+0000 7faab8072b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccd27a0 0x55c71cd4bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.053+0000 7faab8072b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71ccea940 con 0x55c71cc47260 2023-10-08T08:48:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.053+0000 7faab8072b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71cd4c090 con 0x55c71ccd1e80 2023-10-08T08:48:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.053+0000 7faab8072b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c71cd4c250 con 0x55c71ccd27a0 2023-10-08T08:48:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.053+0000 7faab8072b80 10 client.0 _ll_register_callbacks cb 0x7faa94015990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.054+0000 7faaa9c25700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71cc47260 0x55c71cce9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.054+0000 7faaa9c25700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71cc47260 0x55c71cce9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53408/0 (socket says 172.21.15.70:53408) 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.054+0000 7faaa9c25700 1 -- 172.21.15.70:0/881638653 learned_addr learned my addr 172.21.15.70:0/881638653 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.054+0000 7faaa9424700 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.054+0000 7faaaa426700 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccd27a0 0x55c71cd4bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.055+0000 7faaa9c25700 1 -- 172.21.15.70:0/881638653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccd27a0 msgr2=0x55c71cd4bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.055+0000 7faaa9c25700 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccd27a0 0x55c71cd4bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.055+0000 7faaa9c25700 1 -- 172.21.15.70:0/881638653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 msgr2=0x55c71ccea230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.055+0000 7faaa9c25700 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccea230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.055+0000 7faaa9c25700 1 -- 172.21.15.70:0/881638653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa410cc30 con 0x55c71cc47260 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.055+0000 7faaa9c25700 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71cc47260 0x55c71cce9cf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7faaa0000c00 tx=0x7faaa009c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3414464d6e08b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.055+0000 7faa8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.055+0000 7faa8d7fa700 1 -- 172.21.15.70:0/881638653 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa00bc2b0 con 0x55c71cc47260 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.055+0000 7faa8d7fa700 1 -- 172.21.15.70:0/881638653 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7faaa00bc410 con 0x55c71cc47260 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faab8072b80 1 -- 172.21.15.70:0/881638653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa9c00b9f0 con 0x55c71cc47260 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faa8d7fa700 1 -- 172.21.15.70:0/881638653 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaa009e490 con 0x55c71cc47260 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faab8072b80 10 client.16704 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faab8072b80 1 -- 172.21.15.70:0/881638653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55c71ca4f2b0 con 0x55c71cc47260 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faa8d7fa700 1 -- 172.21.15.70:0/881638653 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa9c00b9f0 con 0x55c71cc47260 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faa8d7fa700 1 -- 172.21.15.70:0/881638653 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7faaa00a6130 con 0x55c71cc47260 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faab8072b80 10 client.16704 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:06.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faab8072b80 10 client.16704 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2023-10-08T08:48:06.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faab8072b80 20 client.16704 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:06.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faab8072b80 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55c71ccdd650 0x55c71cd4d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faab8072b80 4 client.16704 mds_command: new command op to 24577 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:48:06.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.056+0000 7faab8072b80 1 -- 172.21.15.70:0/881638653 --> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c71cc1eb30 con 0x55c71ccdd650 2023-10-08T08:48:06.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.057+0000 7faaa9424700 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55c71ccdd650 0x55c71cd4d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.057+0000 7faa8d7fa700 10 client.16704 ms_handle_connect on v2:172.21.15.191:6834/2353311301 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.057+0000 7faaa9424700 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55c71ccdd650 0x55c71cd4d4e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a1a7a1d102456c6c server_cookie=35769204a0ff3cf0 in_seq=0 out_seq=0 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.059+0000 7faa8d7fa700 1 -- 172.21.15.70:0/881638653 <== mds.4 v2:172.21.15.191:6834/2353311301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+48916 (crc 0 0 0) 0x55c71cc1eb30 con 0x55c71ccdd650 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.059+0000 7faa8d7fa700 10 client.16704 handle_command_reply: tid=0 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 client.16704 shutdown 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 -- 172.21.15.70:0/881638653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71cc47260 msgr2=0x55c71cce9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71cc47260 0x55c71cce9cf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7faaa0000c00 tx=0x7faaa009c420 comp rx=0 tx=0).stop 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 -- 172.21.15.70:0/881638653 shutdown_connections 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c71ccd27a0 0x55c71cd4bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.191:6834/2353311301,v1:172.21.15.191:6835/2353311301] conn(0x55c71ccdd650 0x55c71cd4d4e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c71cc47260 0x55c71cce9cf0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faa8d7fa700 0 client.16704 ms_handle_reset on v2:172.21.15.191:6834/2353311301 2023-10-08T08:48:06.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 --2- 172.21.15.70:0/881638653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c71ccd1e80 0x55c71ccea230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 -- 172.21.15.70:0/881638653 >> 172.21.15.70:0/881638653 conn(0x55c71ccca2a0 msgr2=0x55c71ccd9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 -- 172.21.15.70:0/881638653 shutdown_connections 2023-10-08T08:48:06.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 1 -- 172.21.15.70:0/881638653 wait complete. 2023-10-08T08:48:06.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.060+0000 7faab8072b80 20 client.16704 trim_cache size 0 max 16384 2023-10-08T08:48:06.065 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-10-08T08:48:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.065 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 19797910, 2023-10-08T08:48:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638411, 2023-10-08T08:48:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit01.c" 2023-10-08T08:48:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 65277391, 2023-10-08T08:48:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638418, 2023-10-08T08:48:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link07.c" 2023-10-08T08:48:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 78472703, 2023-10-08T08:48:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638409, 2023-10-08T08:48:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit02.c" 2023-10-08T08:48:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 79387465, 2023-10-08T08:48:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638511, 2023-10-08T08:48:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill02.c" 2023-10-08T08:48:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 79909693, 2023-10-08T08:48:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637985, 2023-10-08T08:48:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.2" 2023-10-08T08:48:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 127476905, 2023-10-08T08:48:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638561, 2023-10-08T08:48:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/Makefile" 2023-10-08T08:48:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.070 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 221161233, 2023-10-08T08:48:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638143, 2023-10-08T08:48:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority03.c" 2023-10-08T08:48:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 230953438, 2023-10-08T08:48:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637969, 2023-10-08T08:48:06.071 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/vmsplice01.c" 2023-10-08T08:48:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 254832479, 2023-10-08T08:48:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637995, 2023-10-08T08:48:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/dbllist.h" 2023-10-08T08:48:06.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 262362224, 2023-10-08T08:48:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638549, 2023-10-08T08:48:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/Makefile" 2023-10-08T08:48:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 293265870, 2023-10-08T08:48:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638034, 2023-10-08T08:48:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/readlinkat01.c" 2023-10-08T08:48:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 294528804, 2023-10-08T08:48:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638533, 2023-10-08T08:48:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/Makefile" 2023-10-08T08:48:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.075 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 334433423, 2023-10-08T08:48:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637983, 2023-10-08T08:48:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.ps" 2023-10-08T08:48:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 334914005, 2023-10-08T08:48:06.076 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638056, 2023-10-08T08:48:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/Makefile" 2023-10-08T08:48:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 338482076, 2023-10-08T08:48:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637825, 2023-10-08T08:48:06.077 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe10.c" 2023-10-08T08:48:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 342197633, 2023-10-08T08:48:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638596, 2023-10-08T08:48:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock03.c" 2023-10-08T08:48:06.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 349642966, 2023-10-08T08:48:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638423, 2023-10-08T08:48:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link02.c" 2023-10-08T08:48:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 355318562, 2023-10-08T08:48:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637817, 2023-10-08T08:48:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe" 2023-10-08T08:48:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.080 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 357689223, 2023-10-08T08:48:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637821, 2023-10-08T08:48:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/Makefile" 2023-10-08T08:48:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 370859455, 2023-10-08T08:48:06.081 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638142, 2023-10-08T08:48:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority02.c" 2023-10-08T08:48:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 382464723, 2023-10-08T08:48:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637990, 2023-10-08T08:48:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/epoll-test.c" 2023-10-08T08:48:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 387747367, 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638476, 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat" 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 388226816, 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638601, 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid" 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.083 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 389630851, 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638393, 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon03.c" 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 392056223, 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638466, 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill09.c" 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.084 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 414274383, 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637977, 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.ps" 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 416087574, 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638408, 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit" 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.085 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 425499439, 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638033, 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat" 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 431549233, 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638553, 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/Makefile" 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.086 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 468242630, 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638145, 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname01.c" 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 490691246, 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638487, 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.c" 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.087 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 517365430, 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637810, 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset" 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 526645082, 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638460, 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill01.c" 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 527420216, 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638410, 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/Makefile" 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 534824547, 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637889, 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open05.c" 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.089 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 539939939, 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638535, 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/test3.c" 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 566302711, 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637959, 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir03.c" 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.090 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 597313182, 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638467, 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill04.c" 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 609608118, 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638554, 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/tee01.c" 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 610127454, 2023-10-08T08:48:06.091 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637813, 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset01.c" 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 613106392, 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638005, 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil" 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 617194101, 2023-10-08T08:48:06.092 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638347, 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/Makefile" 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 626189175, 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638396, 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon02.c" 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.093 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 644832548, 2023-10-08T08:48:06.094 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637981, 2023-10-08T08:48:06.094 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.txt" 2023-10-08T08:48:06.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.094 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.094 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 654284183, 2023-10-08T08:48:06.094 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638447, 2023-10-08T08:48:06.094 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/Makefile" 2023-10-08T08:48:06.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.095 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.095 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 661724413, 2023-10-08T08:48:06.095 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638022, 2023-10-08T08:48:06.095 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack02.c" 2023-10-08T08:48:06.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.096 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.096 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 692733342, 2023-10-08T08:48:06.096 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637925, 2023-10-08T08:48:06.096 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.mode.sh" 2023-10-08T08:48:06.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.096 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.097 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 707439218, 2023-10-08T08:48:06.097 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638548, 2023-10-08T08:48:06.097 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread01.c" 2023-10-08T08:48:06.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.097 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.097 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 714338236, 2023-10-08T08:48:06.098 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638035, 2023-10-08T08:48:06.098 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/Makefile" 2023-10-08T08:48:06.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.098 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.098 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 808967602, 2023-10-08T08:48:06.099 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637989, 2023-10-08T08:48:06.099 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/Makefile" 2023-10-08T08:48:06.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.099 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.099 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 876265945, 2023-10-08T08:48:06.099 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637988, 2023-10-08T08:48:06.100 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples" 2023-10-08T08:48:06.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.100 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.100 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 891299397, 2023-10-08T08:48:06.100 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637890, 2023-10-08T08:48:06.100 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/Makefile" 2023-10-08T08:48:06.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.101 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.101 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 895302624, 2023-10-08T08:48:06.101 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637766, 2023-10-08T08:48:06.101 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/Makefile" 2023-10-08T08:48:06.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.101 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 933546927, 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638509, 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/Makefile" 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 941060747, 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637987, 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.ps" 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.103 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.103 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 945137632, 2023-10-08T08:48:06.103 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637891, 2023-10-08T08:48:06.103 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open09.c" 2023-10-08T08:48:06.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.103 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.103 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 948642974, 2023-10-08T08:48:06.103 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638058, 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare" 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 978127030, 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638055, 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk" 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.104 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1005394132, 2023-10-08T08:48:06.105 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638510, 2023-10-08T08:48:06.105 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill01.c" 2023-10-08T08:48:06.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.105 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.105 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1031507229, 2023-10-08T08:48:06.105 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638148, 2023-10-08T08:48:06.106 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname03.c" 2023-10-08T08:48:06.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.106 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.106 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1038180888, 2023-10-08T08:48:06.106 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637927, 2023-10-08T08:48:06.106 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod04.c" 2023-10-08T08:48:06.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.107 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.107 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1060850741, 2023-10-08T08:48:06.107 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638531, 2023-10-08T08:48:06.107 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve04.c" 2023-10-08T08:48:06.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.108 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.108 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1067179093, 2023-10-08T08:48:06.108 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637895, 2023-10-08T08:48:06.108 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open07.c" 2023-10-08T08:48:06.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.108 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.109 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1082412642, 2023-10-08T08:48:06.109 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638044, 2023-10-08T08:48:06.109 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall02.c" 2023-10-08T08:48:06.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.109 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.109 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1166458045, 2023-10-08T08:48:06.110 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637971, 2023-10-08T08:48:06.110 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/Makefile" 2023-10-08T08:48:06.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.110 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.110 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1178111749, 2023-10-08T08:48:06.110 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638519, 2023-10-08T08:48:06.110 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat05.c" 2023-10-08T08:48:06.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.111 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.111 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1190027895, 2023-10-08T08:48:06.111 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637942, 2023-10-08T08:48:06.111 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl01.c" 2023-10-08T08:48:06.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.112 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.112 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1193954843, 2023-10-08T08:48:06.112 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638448, 2023-10-08T08:48:06.112 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir02.c" 2023-10-08T08:48:06.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.113 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.113 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1218497484, 2023-10-08T08:48:06.113 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638602, 2023-10-08T08:48:06.113 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid02.c" 2023-10-08T08:48:06.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.114 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.114 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1223569616, 2023-10-08T08:48:06.114 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638565, 2023-10-08T08:48:06.114 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm02.c" 2023-10-08T08:48:06.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.114 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.115 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1239931486, 2023-10-08T08:48:06.115 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637893, 2023-10-08T08:48:06.115 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open02.c" 2023-10-08T08:48:06.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.115 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.115 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1245825892, 2023-10-08T08:48:06.115 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637992, 2023-10-08T08:48:06.116 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src/epoll.c" 2023-10-08T08:48:06.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.116 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.116 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1257215805, 2023-10-08T08:48:06.116 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637938, 2023-10-08T08:48:06.116 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/Makefile" 2023-10-08T08:48:06.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.117 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.117 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1267797396, 2023-10-08T08:48:06.117 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637888, 2023-10-08T08:48:06.117 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open04.c" 2023-10-08T08:48:06.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.118 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.118 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1270380870, 2023-10-08T08:48:06.118 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638338, 2023-10-08T08:48:06.118 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/mem03.c" 2023-10-08T08:48:06.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.118 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.119 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1270421558, 2023-10-08T08:48:06.119 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637855, 2023-10-08T08:48:06.119 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area01.c" 2023-10-08T08:48:06.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.119 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.119 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1294910646, 2023-10-08T08:48:06.120 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638517, 2023-10-08T08:48:06.120 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat04.c" 2023-10-08T08:48:06.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.120 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.120 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1304330189, 2023-10-08T08:48:06.120 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638163, 2023-10-08T08:48:06.121 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/Makefile" 2023-10-08T08:48:06.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.121 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.121 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1317228798, 2023-10-08T08:48:06.121 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638562, 2023-10-08T08:48:06.121 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm07.c" 2023-10-08T08:48:06.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.122 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.122 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1342964399, 2023-10-08T08:48:06.122 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638484, 2023-10-08T08:48:06.122 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/Makefile" 2023-10-08T08:48:06.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.123 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.123 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1347304143, 2023-10-08T08:48:06.123 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637824, 2023-10-08T08:48:06.123 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe06.c" 2023-10-08T08:48:06.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.123 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.124 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1348916396, 2023-10-08T08:48:06.124 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637887, 2023-10-08T08:48:06.124 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open06.c" 2023-10-08T08:48:06.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.124 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.124 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1363010076, 2023-10-08T08:48:06.125 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638060, 2023-10-08T08:48:06.125 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare01.c" 2023-10-08T08:48:06.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.125 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.125 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1468730236, 2023-10-08T08:48:06.126 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637894, 2023-10-08T08:48:06.126 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open08.c" 2023-10-08T08:48:06.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.126 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.126 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1492635274, 2023-10-08T08:48:06.126 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637986, 2023-10-08T08:48:06.127 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.txt" 2023-10-08T08:48:06.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.127 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.127 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1500960736, 2023-10-08T08:48:06.127 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638566, 2023-10-08T08:48:06.127 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm05.c" 2023-10-08T08:48:06.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.128 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.128 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1503783714, 2023-10-08T08:48:06.128 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637919, 2023-10-08T08:48:06.128 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod06.c" 2023-10-08T08:48:06.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.129 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.129 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1528448491, 2023-10-08T08:48:06.129 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638532, 2023-10-08T08:48:06.129 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve03.c" 2023-10-08T08:48:06.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.129 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.129 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1533629303, 2023-10-08T08:48:06.130 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637937, 2023-10-08T08:48:06.130 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl" 2023-10-08T08:48:06.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.130 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.130 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1539345233, 2023-10-08T08:48:06.130 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637921, 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod07.c" 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1558790450, 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637811, 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset02.c" 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.131 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1559939164, 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638007, 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/Makefile" 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1577723771, 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637829, 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe07.c" 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.132 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1602846453, 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637976, 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.4" 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1634104225, 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637926, 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.c" 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.133 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1636957047, 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638463, 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill12.c" 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1658592558, 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638147, 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/Makefile" 2023-10-08T08:48:06.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1669902000, 2023-10-08T08:48:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637827, 2023-10-08T08:48:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe05.c" 2023-10-08T08:48:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1670886528, 2023-10-08T08:48:06.136 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638340, 2023-10-08T08:48:06.136 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/Makefile" 2023-10-08T08:48:06.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.136 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.136 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1681049866, 2023-10-08T08:48:06.136 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637918, 2023-10-08T08:48:06.136 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod" 2023-10-08T08:48:06.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1706820918, 2023-10-08T08:48:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638515, 2023-10-08T08:48:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat" 2023-10-08T08:48:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1712519394, 2023-10-08T08:48:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638424, 2023-10-08T08:48:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link06.c" 2023-10-08T08:48:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.139 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1727385557, 2023-10-08T08:48:06.139 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638560, 2023-10-08T08:48:06.139 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm01.c" 2023-10-08T08:48:06.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.139 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.139 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1732926935, 2023-10-08T08:48:06.140 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637958, 2023-10-08T08:48:06.140 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir01.c" 2023-10-08T08:48:06.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.140 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.140 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1755764008, 2023-10-08T08:48:06.140 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638459, 2023-10-08T08:48:06.141 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill11.c" 2023-10-08T08:48:06.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.141 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.141 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1785774361, 2023-10-08T08:48:06.141 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637920, 2023-10-08T08:48:06.141 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod01.c" 2023-10-08T08:48:06.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.142 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.142 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1789435425, 2023-10-08T08:48:06.142 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638611, 2023-10-08T08:48:06.142 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat" 2023-10-08T08:48:06.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.143 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.143 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1796170649, 2023-10-08T08:48:06.143 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638612, 2023-10-08T08:48:06.143 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/linkat01.c" 2023-10-08T08:48:06.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.143 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1799047014, 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637980, 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.2" 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1805884944, 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638591, 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock04.c" 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.144 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1873874254, 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637957, 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/Makefile" 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1898772272, 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638043, 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall01.c" 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.146 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.146 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1908329557, 2023-10-08T08:48:06.146 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638593, 2023-10-08T08:48:06.146 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/Makefile" 2023-10-08T08:48:06.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.146 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.146 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1948034300, 2023-10-08T08:48:06.146 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638434, 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy" 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1962313420, 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637993, 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include" 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1967350989, 2023-10-08T08:48:06.147 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637812, 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/Makefile" 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1979677028, 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638346, 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect" 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 1993805256, 2023-10-08T08:48:06.148 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638536, 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve05.c" 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2026860323, 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638482, 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate" 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2042826390, 2023-10-08T08:48:06.149 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638024, 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/Makefile" 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2050770159, 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638613, 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/Makefile" 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2110657308, 2023-10-08T08:48:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638478, 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/unlinkat01.c" 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2112885998, 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637970, 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg" 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2132462353, 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637854, 2023-10-08T08:48:06.151 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area" 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2196435056, 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638551, 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread03.c" 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.152 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2216391534, 2023-10-08T08:48:06.153 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638449, 2023-10-08T08:48:06.153 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir01.c" 2023-10-08T08:48:06.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.153 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.153 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2217406023, 2023-10-08T08:48:06.153 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638336, 2023-10-08T08:48:06.154 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap" 2023-10-08T08:48:06.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.154 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.154 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2222454202, 2023-10-08T08:48:06.154 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638605, 2023-10-08T08:48:06.154 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid01.c" 2023-10-08T08:48:06.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.155 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.155 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2266163252, 2023-10-08T08:48:06.155 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637885, 2023-10-08T08:48:06.155 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open" 2023-10-08T08:48:06.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.156 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.156 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2271784172, 2023-10-08T08:48:06.156 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637822, 2023-10-08T08:48:06.156 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe01.c" 2023-10-08T08:48:06.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.156 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.157 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2292783346, 2023-10-08T08:48:06.157 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638348, 2023-10-08T08:48:06.157 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/connect01.c" 2023-10-08T08:48:06.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.157 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.157 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2294452777, 2023-10-08T08:48:06.157 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638520, 2023-10-08T08:48:06.158 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat03.c" 2023-10-08T08:48:06.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.158 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.158 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2309895838, 2023-10-08T08:48:06.159 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638061, 2023-10-08T08:48:06.159 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare02.c" 2023-10-08T08:48:06.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.159 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.159 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2313218725, 2023-10-08T08:48:06.159 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638592, 2023-10-08T08:48:06.160 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock02.c" 2023-10-08T08:48:06.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.160 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.160 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2379368252, 2023-10-08T08:48:06.160 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638337, 2023-10-08T08:48:06.160 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/Makefile" 2023-10-08T08:48:06.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.161 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.161 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2417246078, 2023-10-08T08:48:06.161 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637922, 2023-10-08T08:48:06.161 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod03.c" 2023-10-08T08:48:06.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.162 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.162 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2428154863, 2023-10-08T08:48:06.162 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638421, 2023-10-08T08:48:06.163 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link03.c" 2023-10-08T08:48:06.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.163 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.163 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2458985420, 2023-10-08T08:48:06.163 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637973, 2023-10-08T08:48:06.164 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2" 2023-10-08T08:48:06.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.164 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.164 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2470578654, 2023-10-08T08:48:06.164 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638139, 2023-10-08T08:48:06.164 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/Makefile" 2023-10-08T08:48:06.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.165 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.165 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2475440283, 2023-10-08T08:48:06.165 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638534, 2023-10-08T08:48:06.165 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve01.c" 2023-10-08T08:48:06.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2489542825, 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638603, 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/Makefile" 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2509259874, 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637826, 2023-10-08T08:48:06.166 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe03.c" 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2523624437, 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637956, 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir02.c" 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2539308219, 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638530, 2023-10-08T08:48:06.167 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve" 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2541681315, 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638518, 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/Makefile" 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2584268235, 2023-10-08T08:48:06.168 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638339, 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string" 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2600964390, 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638341, 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/string01.c" 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.169 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2688805915, 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637823, 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe04.c" 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2713439621, 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638559, 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm" 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.170 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2724095610, 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637941, 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl05.c" 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2725338562, 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638563, 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm03.c" 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.171 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2726116410, 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638508, 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill" 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2742995953, 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637974, 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man" 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.172 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2768866187, 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638144, 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname" 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2769654055, 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638486, 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate02.c" 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2775144272, 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637975, 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.ps" 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2805351133, 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638597, 2023-10-08T08:48:06.174 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock06.c" 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2806817748, 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637928, 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod05.c" 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2839490051, 2023-10-08T08:48:06.175 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637858, 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area02.c" 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2877344597, 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638465, 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill05.c" 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.176 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2885637284, 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638137, 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority" 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2897849494, 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637819, 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe02.c" 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2900263414, 2023-10-08T08:48:06.177 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637984, 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/mkpages.sh" 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2903927584, 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637886, 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open10.c" 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2905480293, 2023-10-08T08:48:06.178 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638590, 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock" 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2926182769, 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637853, 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/Makefile" 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.179 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2936910518, 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637828, 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe08.c" 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2961995874, 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638458, 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill03.c" 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.180 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 2976961250, 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637892, 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open01.c" 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3006385283, 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637978, 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.txt" 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.181 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3006436601, 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637852, 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/sigrelse01.c" 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3010767021, 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638006, 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/profil01.c" 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.182 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3014577430, 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637857, 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/Makefile" 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3059914655, 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637968, 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/Makefile" 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3061937219, 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638547, 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread" 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3064563419, 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637955, 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir" 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3068052337, 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638419, 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/Makefile" 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3144812333, 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638395, 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon01.c" 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3150221722, 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637896, 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open03.c" 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3185912139, 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638477, 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/Makefile" 2023-10-08T08:48:06.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3216617303, 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637967, 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice" 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3224786071, 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638435, 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/memcpy01.c" 2023-10-08T08:48:06.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3225997678, 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638456, 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill08.c" 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3257028617, 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638446, 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir" 2023-10-08T08:48:06.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3257177218, 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638468, 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill10.c" 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3262014914, 2023-10-08T08:48:06.189 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638422, 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link04.c" 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3285902668, 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638040, 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall03.c" 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.190 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3291494845, 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638457, 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill02.c" 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3291567405, 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638455, 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill" 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.191 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3301422870, 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638604, 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid03.c" 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3337657485, 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638141, 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority01.c" 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.192 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3341375713, 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638161, 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset" 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3345920622, 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638516, 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat01.c" 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.193 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3349342936, 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638420, 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link05.c" 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3392008142, 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638483, 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate01.c" 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.194 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3398430964, 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638595, 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock01.c" 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3438696223, 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637851, 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse" 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3441841515, 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638039, 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall" 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3492319003, 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637991, 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src" 2023-10-08T08:48:06.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3498338414, 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638059, 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/Makefile" 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3508438762, 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638140, 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority05.c" 2023-10-08T08:48:06.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3542989199, 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637923, 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/Makefile" 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3584263914, 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637764, 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat" 2023-10-08T08:48:06.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3588973334, 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638394, 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/Makefile" 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3615162683, 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637939, 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl03.c" 2023-10-08T08:48:06.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3674862735, 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637924, 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod02.c" 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3683444854, 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638162, 2023-10-08T08:48:06.200 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/memset01.c" 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3712685252, 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638023, 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack01.c" 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3717325043, 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638488, 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.sh" 2023-10-08T08:48:06.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3721430436, 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637972, 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/fmtmsg01.c" 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3748275308, 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637765, 2023-10-08T08:48:06.202 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/mkdirat01.c" 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3766886340, 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638564, 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm06.c" 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3781983862, 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638057, 2023-10-08T08:48:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/sbrk01.c" 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3792966465, 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637994, 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/epoll.h" 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3798511408, 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638550, 2023-10-08T08:48:06.204 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread02.c" 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3807882831, 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637979, 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.txt" 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3812204814, 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637818, 2023-10-08T08:48:06.205 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe11.c" 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3823540584, 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638521, 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat02.c" 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3854273367, 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638462, 2023-10-08T08:48:06.206 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill06.c" 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3869558356, 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638461, 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/Makefile" 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3874271732, 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638552, 2023-10-08T08:48:06.207 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee" 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3878445166, 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638021, 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack" 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.208 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3899592624, 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637940, 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl04.c" 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3908002174, 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638485, 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate03.c" 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3933448776, 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638392, 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon" 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3959866192, 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638436, 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/Makefile" 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3977792603, 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637856, 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area.h" 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 3992192251, 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638464, 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill07.c" 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.211 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4002092889, 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638417, 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link" 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4017359941, 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638594, 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock05.c" 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.212 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4024611317, 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637982, 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.2" 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4113891343, 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638138, 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority04.c" 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.213 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4119772644, 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638042, 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/Makefile" 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4190329852, 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638537, 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve02.c" 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.214 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4220740798, 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511637820, 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe09.c" 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4247705934, 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638041, 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall04.c" 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:48:06.215 INFO:teuthology.orchestra.run.smithi070.stdout: "damage_type": "backtrace", 2023-10-08T08:48:06.216 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4286542211, 2023-10-08T08:48:06.216 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1099511638146, 2023-10-08T08:48:06.216 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname02.c" 2023-10-08T08:48:06.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:48:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-10-08T08:48:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 -- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faa900a16f0 msgr2=0x7faa900a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faa900a16f0 0x7faa900a3bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faaa4198240 tx=0x7faa94006cb0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 -- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa41001c0 msgr2=0x7faaa419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa41001c0 0x7faaa419ca70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009ed0 tx=0x7faaa000eca0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 -- 172.21.15.70:0/129818132 shutdown_connections 2023-10-08T08:48:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7faa900a16f0 0x7faa900a3bb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaa41046a0 0x7faaa4196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa41001c0 0x7faaa419ca70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 --2- 172.21.15.70:0/129818132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa4100b80 0x7faaa419cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 -- 172.21.15.70:0/129818132 >> 172.21.15.70:0/129818132 conn(0x7faaa40749a0 msgr2=0x7faaa40fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 -- 172.21.15.70:0/129818132 shutdown_connections 2023-10-08T08:48:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.061+0000 7faaabe89700 1 -- 172.21.15.70:0/129818132 wait complete. 2023-10-08T08:48:06.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T08:48:06.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.346+0000 7fe2e791e700 1 -- 172.21.15.70:0/1140084229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 msgr2=0x7fe2e0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.346+0000 7fe2e791e700 1 --2- 172.21.15.70:0/1140084229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 0x7fe2e0105a90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009990 tx=0x7fe2d0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.346+0000 7fe2e791e700 1 -- 172.21.15.70:0/1140084229 shutdown_connections 2023-10-08T08:48:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.346+0000 7fe2e791e700 1 --2- 172.21.15.70:0/1140084229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e00fffe0 0x7fe2e010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.346+0000 7fe2e791e700 1 --2- 172.21.15.70:0/1140084229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 0x7fe2e0105a90 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.346+0000 7fe2e791e700 1 --2- 172.21.15.70:0/1140084229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2e00ff620 0x7fe2e00ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.346+0000 7fe2e791e700 1 -- 172.21.15.70:0/1140084229 >> 172.21.15.70:0/1140084229 conn(0x7fe2e0076780 msgr2=0x7fe2e0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.346+0000 7fe2e791e700 1 -- 172.21.15.70:0/1140084229 shutdown_connections 2023-10-08T08:48:06.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.346+0000 7fe2e791e700 1 -- 172.21.15.70:0/1140084229 wait complete. 2023-10-08T08:48:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e791e700 1 Processor -- start 2023-10-08T08:48:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e791e700 1 -- start start 2023-10-08T08:48:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e791e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2e00ff620 0x7fe2e019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e791e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e00fffe0 0x7fe2e019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e791e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 0x7fe2e01969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e791e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0197030 con 0x7fe2e01056b0 2023-10-08T08:48:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e791e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e01971a0 con 0x7fe2e00fffe0 2023-10-08T08:48:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e791e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0197360 con 0x7fe2e00ff620 2023-10-08T08:48:06.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e5ebb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 0x7fe2e01969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e5ebb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 0x7fe2e01969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53426/0 (socket says 172.21.15.70:53426) 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e56ba700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2e00ff620 0x7fe2e019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e5ebb700 1 -- 172.21.15.70:0/3493886809 learned_addr learned my addr 172.21.15.70:0/3493886809 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e4eb9700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e00fffe0 0x7fe2e019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e5ebb700 1 -- 172.21.15.70:0/3493886809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2e00ff620 msgr2=0x7fe2e019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e5ebb700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2e00ff620 0x7fe2e019c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e5ebb700 1 -- 172.21.15.70:0/3493886809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e00fffe0 msgr2=0x7fe2e019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e5ebb700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e00fffe0 0x7fe2e019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e5ebb700 1 -- 172.21.15.70:0/3493886809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00095f0 con 0x7fe2e01056b0 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2e00ff620 0x7fe2e019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2e5ebb700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 0x7fe2e01969d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800ef30 tx=0x7fe2d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.347+0000 7fe2d67fc700 1 -- 172.21.15.70:0/3493886809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8018070 con 0x7fe2e01056b0 2023-10-08T08:48:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.348+0000 7fe2d67fc700 1 -- 172.21.15.70:0/3493886809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2d800f040 con 0x7fe2e01056b0 2023-10-08T08:48:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.348+0000 7fe2e791e700 1 -- 172.21.15.70:0/3493886809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e01975e0 con 0x7fe2e01056b0 2023-10-08T08:48:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.348+0000 7fe2d67fc700 1 -- 172.21.15.70:0/3493886809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800cd00 con 0x7fe2e01056b0 2023-10-08T08:48:06.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.348+0000 7fe2e791e700 1 -- 172.21.15.70:0/3493886809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e01a3890 con 0x7fe2e01056b0 2023-10-08T08:48:06.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.350+0000 7fe2d67fc700 1 -- 172.21.15.70:0/3493886809 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe2d8003a00 con 0x7fe2e01056b0 2023-10-08T08:48:06.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.350+0000 7fe2d67fc700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe2cc0a15f0 0x7fe2cc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.350+0000 7fe2d67fc700 1 -- 172.21.15.70:0/3493886809 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe2d80ccea0 con 0x7fe2e01056b0 2023-10-08T08:48:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.350+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe2cc0a15f0 0x7fe2cc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.351+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe2cc0a15f0 0x7fe2cc0a3ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0006010 tx=0x7fe2d0005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.351+0000 7fe2f3b07b80 1 Processor -- start 2023-10-08T08:48:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.351+0000 7fe2f3b07b80 1 -- start start 2023-10-08T08:48:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.351+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fad9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 0x56065fae8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 0x56065faeae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065fa42460 con 0x56065fad8e80 2023-10-08T08:48:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065fa33c20 con 0x56065fae8a60 2023-10-08T08:48:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065fa31540 con 0x56065fad97a0 2023-10-08T08:48:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e56ba700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fad9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e56ba700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fad9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53430/0 (socket says 172.21.15.70:53430) 2023-10-08T08:48:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e56ba700 1 -- 172.21.15.70:0/3214829742 learned_addr learned my addr 172.21.15.70:0/3214829742 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e4eb9700 1 --2- 172.21.15.70:0/3214829742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 0x56065fae8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e5ebb700 1 --2- 172.21.15.70:0/3214829742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 0x56065faeae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e56ba700 1 -- 172.21.15.70:0/3214829742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 msgr2=0x56065fae8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/3214829742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 0x56065fae8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e56ba700 1 -- 172.21.15.70:0/3214829742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 msgr2=0x56065faeae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/3214829742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 0x56065faeae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e56ba700 1 -- 172.21.15.70:0/3214829742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56065f857de0 con 0x56065fad8e80 2023-10-08T08:48:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/3214829742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fad9260 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0077ab0 tx=0x7fe2d0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae6d045634e2f06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2cb7fe700 1 -- 172.21.15.70:0/3214829742 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d002b070 con 0x56065fad8e80 2023-10-08T08:48:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2cb7fe700 1 -- 172.21.15.70:0/3214829742 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2d001e040 con 0x56065fad8e80 2023-10-08T08:48:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.352+0000 7fe2cb7fe700 1 -- 172.21.15.70:0/3214829742 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d00049a0 con 0x56065fad8e80 2023-10-08T08:48:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/3214829742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 msgr2=0x56065fad9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/3214829742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fad9260 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0077ab0 tx=0x7fe2d0020000 comp rx=0 tx=0).stop 2023-10-08T08:48:06.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/3214829742 shutdown_connections 2023-10-08T08:48:06.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/3214829742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 0x56065faeae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/3214829742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fad9260 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/3214829742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 0x56065fae8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/3214829742 >> 172.21.15.70:0/3214829742 conn(0x56065fa4e260 msgr2=0x56065fad52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/3214829742 shutdown_connections 2023-10-08T08:48:06.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/3214829742 wait complete. 2023-10-08T08:48:06.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 -- start start 2023-10-08T08:48:06.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.353+0000 7fe2f3b07b80 1 Processor -- start 2023-10-08T08:48:06.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 0x56065fae5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fae8a60 0x56065fae5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065fa2ce30 con 0x56065fad8e80 2023-10-08T08:48:06.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065f9c9710 con 0x56065fad97a0 2023-10-08T08:48:06.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065f9c93b0 con 0x56065fae8a60 2023-10-08T08:48:06.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2f3b07b80 10 client.0 _ll_register_callbacks cb 0x56065f826800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e56ba700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e56ba700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53436/0 (socket says 172.21.15.70:53436) 2023-10-08T08:48:06.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e56ba700 1 -- 172.21.15.70:0/1014586407 learned_addr learned my addr 172.21.15.70:0/1014586407 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e4eb9700 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 0x56065fae5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e5ebb700 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fae8a60 0x56065fae5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e56ba700 1 -- 172.21.15.70:0/1014586407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fae8a60 msgr2=0x56065fae5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fae8a60 0x56065fae5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e56ba700 1 -- 172.21.15.70:0/1014586407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 msgr2=0x56065fae5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 0x56065fae5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e56ba700 1 -- 172.21.15.70:0/1014586407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e010cde0 con 0x56065fad8e80 2023-10-08T08:48:06.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.354+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae8420 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000b6f0 tx=0x7fe2d000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca7a67632aa93e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:48:06.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/1014586407 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d002b070 con 0x56065fad8e80 2023-10-08T08:48:06.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/1014586407 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe2d0030870 con 0x56065fad8e80 2023-10-08T08:48:06.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/1014586407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56065f9f4eb0 con 0x56065fad8e80 2023-10-08T08:48:06.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/1014586407 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2d0030a30 con 0x56065fad8e80 2023-10-08T08:48:06.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2f3b07b80 10 client.16716 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:06.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/1014586407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x56065f840c60 con 0x56065fad8e80 2023-10-08T08:48:06.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/1014586407 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56065f9f4eb0 con 0x56065fad8e80 2023-10-08T08:48:06.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/1014586407 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fe2d0039cd0 con 0x56065fad8e80 2023-10-08T08:48:06.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2f3b07b80 10 client.16716 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:06.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2f3b07b80 10 client.16716 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-08T08:48:06.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2f3b07b80 20 client.16716 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:06.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56065faf8130 0x56065fafa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2f3b07b80 4 client.16716 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:48:06.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/1014586407 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56065fa25e10 con 0x56065faf8130 2023-10-08T08:48:06.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.355+0000 7fe2e4eb9700 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56065faf8130 0x56065fafa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2c8ff9700 10 client.16716 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:48:06.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2e4eb9700 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56065faf8130 0x56065fafa550 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=59b022ba8eb0dc01 server_cookie=cbb5c61666ec2773 in_seq=0 out_seq=0 2023-10-08T08:48:06.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/1014586407 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56065fa25e10 con 0x56065faf8130 2023-10-08T08:48:06.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2c8ff9700 10 client.16716 handle_command_reply: tid=0 2023-10-08T08:48:06.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2f3b07b80 1 client.16716 shutdown 2023-10-08T08:48:06.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/1014586407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 msgr2=0x56065fae8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae8420 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000b6f0 tx=0x7fe2d000ff90 comp rx=0 tx=0).stop 2023-10-08T08:48:06.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/1014586407 shutdown_connections 2023-10-08T08:48:06.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56065faf8130 0x56065fafa550 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fae8a60 0x56065fae5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2c8ff9700 0 client.16716 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:48:06.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae8420 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.356+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/1014586407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 0x56065fae5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.357+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/1014586407 >> 172.21.15.70:0/1014586407 conn(0x56065fa4e260 msgr2=0x56065fad4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.357+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/1014586407 shutdown_connections 2023-10-08T08:48:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.357+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/1014586407 wait complete. 2023-10-08T08:48:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.357+0000 7fe2f3b07b80 20 client.16716 trim_cache size 0 max 16384 2023-10-08T08:48:06.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2f3b07b80 1 Processor -- start 2023-10-08T08:48:06.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2f3b07b80 1 -- start start 2023-10-08T08:48:06.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 0x56065fae4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 0x56065fae45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065f8ad920 con 0x56065fad8e80 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065fad5ea0 con 0x56065fae8a60 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065facf570 con 0x56065fad97a0 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e56ba700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e56ba700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53444/0 (socket says 172.21.15.70:53444) 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e56ba700 1 -- 172.21.15.70:0/2529541405 learned_addr learned my addr 172.21.15.70:0/2529541405 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e4eb9700 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 0x56065fae4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e5ebb700 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 0x56065fae45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e56ba700 1 -- 172.21.15.70:0/2529541405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 msgr2=0x56065fae4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 0x56065fae4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e56ba700 1 -- 172.21.15.70:0/2529541405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 msgr2=0x56065fae45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 0x56065fae45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e56ba700 1 -- 172.21.15.70:0/2529541405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56065f87e250 con 0x56065fad8e80 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.370+0000 7fe2e4eb9700 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 0x56065fae4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae5de0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0005640 tx=0x7fe2d0005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1946c8ce8918a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2cbfff700 1 -- 172.21.15.70:0/2529541405 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d002b070 con 0x56065fad8e80 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2cbfff700 1 -- 172.21.15.70:0/2529541405 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2d002c040 con 0x56065fad8e80 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2cbfff700 1 -- 172.21.15.70:0/2529541405 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0039470 con 0x56065fad8e80 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2529541405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 msgr2=0x56065fae5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae5de0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0005640 tx=0x7fe2d0005a10 comp rx=0 tx=0).stop 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2529541405 shutdown_connections 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fae8a60 0x56065fae45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fad8e80 0x56065fae5de0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2529541405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad97a0 0x56065fae4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.371+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2529541405 >> 172.21.15.70:0/2529541405 conn(0x56065fa4e260 msgr2=0x56065fae0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2529541405 shutdown_connections 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2529541405 wait complete. 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 -- start start 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 Processor -- start 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad8e80 0x56065faef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 0x56065faed590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fae8a60 0x56065faedcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065faee3e0 con 0x56065fae8a60 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065fb4af60 con 0x56065fad97a0 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065fb4b0a0 con 0x56065fad8e80 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2f3b07b80 10 client.0 _ll_register_callbacks cb 0x7fe2d8009370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2e5ebb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fae8a60 0x56065faedcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2e5ebb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fae8a60 0x56065faedcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53452/0 (socket says 172.21.15.70:53452) 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2e5ebb700 1 -- 172.21.15.70:0/2236528591 learned_addr learned my addr 172.21.15.70:0/2236528591 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad8e80 0x56065faef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.372+0000 7fe2e4eb9700 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 0x56065faed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2e5ebb700 1 -- 172.21.15.70:0/2236528591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad8e80 msgr2=0x56065faef7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2e5ebb700 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad8e80 0x56065faef7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2e5ebb700 1 -- 172.21.15.70:0/2236528591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 msgr2=0x56065faed590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2e5ebb700 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 0x56065faed590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2e5ebb700 1 -- 172.21.15.70:0/2236528591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc009b30 con 0x56065fae8a60 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2e5ebb700 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fae8a60 0x56065faedcd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80ca920 tx=0x7fe2d80995a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82492b851a94ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/2236528591 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d809a340 con 0x56065fae8a60 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/2236528591 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe2d800ce60 con 0x56065fae8a60 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2236528591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2d001e040 con 0x56065fae8a60 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/2236528591 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2d8099c40 con 0x56065fae8a60 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2f3b07b80 10 client.16722 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2236528591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x56065f840c60 con 0x56065fae8a60 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/2236528591 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2d001e040 con 0x56065fae8a60 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/2236528591 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fe2d80a1ab0 con 0x56065fae8a60 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2f3b07b80 10 client.16722 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2f3b07b80 10 client.16722 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2f3b07b80 20 client.16722 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56065fb4c990 0x56065fb4edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2f3b07b80 4 client.16722 mds_command: new command op to 24589 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.373+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2236528591 --> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56065fa25b30 con 0x56065fb4c990 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56065fb4c990 0x56065fb4edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2c8ff9700 10 client.16722 ms_handle_connect on v2:172.21.15.191:6836/1080059379 2023-10-08T08:48:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2e56ba700 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56065fb4c990 0x56065fb4edb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c9d9efdc5ec08ac7 server_cookie=95c48cd75ee561f6 in_seq=0 out_seq=0 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2c8ff9700 1 -- 172.21.15.70:0/2236528591 <== mds.3 v2:172.21.15.191:6836/1080059379 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56065fa25b30 con 0x56065fb4c990 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2c8ff9700 10 client.16722 handle_command_reply: tid=0 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 client.16722 shutdown 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2236528591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fae8a60 msgr2=0x56065faedcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fae8a60 0x56065faedcd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80ca920 tx=0x7fe2d80995a0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2236528591 shutdown_connections 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56065fae8a60 0x56065faedcd0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.191:6836/1080059379,v1:172.21.15.191:6837/1080059379] conn(0x56065fb4c990 0x56065fb4edb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56065fad8e80 0x56065faef7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2c8ff9700 0 client.16722 ms_handle_reset on v2:172.21.15.191:6836/1080059379 2023-10-08T08:48:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 --2- 172.21.15.70:0/2236528591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56065fad97a0 0x56065faed590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2236528591 >> 172.21.15.70:0/2236528591 conn(0x56065fa4e260 msgr2=0x56065fae3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2236528591 shutdown_connections 2023-10-08T08:48:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.374+0000 7fe2f3b07b80 1 -- 172.21.15.70:0/2236528591 wait complete. 2023-10-08T08:48:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2f3b07b80 20 client.16722 trim_cache size 0 max 16384 2023-10-08T08:48:06.396 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:48:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 -- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe2cc0a15f0 msgr2=0x7fe2cc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe2cc0a15f0 0x7fe2cc0a3ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0006010 tx=0x7fe2d0005960 comp rx=0 tx=0).stop 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 -- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 msgr2=0x7fe2e01969d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 0x7fe2e01969d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800ef30 tx=0x7fe2d800c3a0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 -- 172.21.15.70:0/3493886809 shutdown_connections 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe2cc0a15f0 0x7fe2cc0a3ab0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2e01056b0 0x7fe2e01969d0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2e00ff620 0x7fe2e019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 --2- 172.21.15.70:0/3493886809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e00fffe0 0x7fe2e019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 -- 172.21.15.70:0/3493886809 >> 172.21.15.70:0/3493886809 conn(0x7fe2e0076780 msgr2=0x7fe2e0103930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 -- 172.21.15.70:0/3493886809 shutdown_connections 2023-10-08T08:48:06.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.375+0000 7fe2e791e700 1 -- 172.21.15.70:0/3493886809 wait complete. 2023-10-08T08:48:06.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T08:48:06.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.526+0000 7f5c9c167700 1 -- 172.21.15.70:0/2714662642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c941056b0 msgr2=0x7f5c94105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.526+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2714662642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c941056b0 0x7f5c94105a90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c00b0a0 tx=0x7f5c8c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.526+0000 7f5c9c167700 1 -- 172.21.15.70:0/2714662642 shutdown_connections 2023-10-08T08:48:06.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.526+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2714662642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c940fffe0 0x7f5c9410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.526+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2714662642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c941056b0 0x7f5c94105a90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.526+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2714662642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c940ff620 0x7f5c940ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.526+0000 7f5c9c167700 1 -- 172.21.15.70:0/2714662642 >> 172.21.15.70:0/2714662642 conn(0x7f5c94076780 msgr2=0x7f5c94076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.526+0000 7f5c9c167700 1 -- 172.21.15.70:0/2714662642 shutdown_connections 2023-10-08T08:48:06.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.526+0000 7f5c9c167700 1 -- 172.21.15.70:0/2714662642 wait complete. 2023-10-08T08:48:06.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9c167700 1 Processor -- start 2023-10-08T08:48:06.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9c167700 1 -- start start 2023-10-08T08:48:06.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9c167700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c940ff620 0x7f5c9419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9c167700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c940fffe0 0x7f5c9419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9c167700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c941056b0 0x7f5c94196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9c167700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94196f90 con 0x7f5c940fffe0 2023-10-08T08:48:06.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9c167700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94197100 con 0x7f5c941056b0 2023-10-08T08:48:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9c167700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c941972c0 con 0x7f5c940ff620 2023-10-08T08:48:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99702700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c940fffe0 0x7f5c9419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99702700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c940fffe0 0x7f5c9419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53466/0 (socket says 172.21.15.70:53466) 2023-10-08T08:48:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99702700 1 -- 172.21.15.70:0/2131193210 learned_addr learned my addr 172.21.15.70:0/2131193210 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9a704700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c941056b0 0x7f5c94196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99f03700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c940ff620 0x7f5c9419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99702700 1 -- 172.21.15.70:0/2131193210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c940ff620 msgr2=0x7f5c9419c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99702700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c940ff620 0x7f5c9419c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99702700 1 -- 172.21.15.70:0/2131193210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c941056b0 msgr2=0x7f5c94196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99702700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c941056b0 0x7f5c94196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99702700 1 -- 172.21.15.70:0/2131193210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c009d00 con 0x7f5c940fffe0 2023-10-08T08:48:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99f03700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c940ff620 0x7f5c9419c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c9a704700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c941056b0 0x7f5c94196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.527+0000 7f5c99702700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c940fffe0 0x7f5c9419cd40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800e9a0 tx=0x7f5c8800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.528+0000 7f5c92ffd700 1 -- 172.21.15.70:0/2131193210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88009790 con 0x7f5c940fffe0 2023-10-08T08:48:06.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.528+0000 7f5c92ffd700 1 -- 172.21.15.70:0/2131193210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c88010430 con 0x7f5c940fffe0 2023-10-08T08:48:06.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.528+0000 7f5c92ffd700 1 -- 172.21.15.70:0/2131193210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88018680 con 0x7f5c940fffe0 2023-10-08T08:48:06.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.528+0000 7f5c9c167700 1 -- 172.21.15.70:0/2131193210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c941975a0 con 0x7f5c940fffe0 2023-10-08T08:48:06.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.528+0000 7f5c9c167700 1 -- 172.21.15.70:0/2131193210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c941a37f0 con 0x7f5c940fffe0 2023-10-08T08:48:06.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.530+0000 7f5c92ffd700 1 -- 172.21.15.70:0/2131193210 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5c880105a0 con 0x7f5c940fffe0 2023-10-08T08:48:06.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.530+0000 7f5c92ffd700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5c7c0a15f0 0x7f5c7c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.531+0000 7f5c99f03700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5c7c0a15f0 0x7f5c7c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.531+0000 7f5c92ffd700 1 -- 172.21.15.70:0/2131193210 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5c88014070 con 0x7f5c940fffe0 2023-10-08T08:48:06.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.531+0000 7f5c99f03700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5c7c0a15f0 0x7f5c7c0a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009610 tx=0x7f5c8c00b720 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.531+0000 7f5ca8350b80 1 Processor -- start 2023-10-08T08:48:06.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5ca8350b80 1 -- start start 2023-10-08T08:48:06.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb13d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13d7a0 0x5591bb14c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb0a6460 con 0x5591bb13ce80 2023-10-08T08:48:06.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb097c20 con 0x5591bb13d7a0 2023-10-08T08:48:06.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb095540 con 0x5591bb14ca60 2023-10-08T08:48:06.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99f03700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb13d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99f03700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb13d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53472/0 (socket says 172.21.15.70:53472) 2023-10-08T08:48:06.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99702700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13d7a0 0x5591bb14c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99f03700 1 -- 172.21.15.70:0/703368556 learned_addr learned my addr 172.21.15.70:0/703368556 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c9a704700 1 --2- 172.21.15.70:0/703368556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99f03700 1 -- 172.21.15.70:0/703368556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 msgr2=0x5591bb14ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99f03700 1 --2- 172.21.15.70:0/703368556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb14ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99f03700 1 -- 172.21.15.70:0/703368556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13d7a0 msgr2=0x5591bb14c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99f03700 1 --2- 172.21.15.70:0/703368556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13d7a0 0x5591bb14c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99f03700 1 -- 172.21.15.70:0/703368556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591baebbde0 con 0x5591bb13ce80 2023-10-08T08:48:06.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99702700 1 --2- 172.21.15.70:0/703368556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13d7a0 0x5591bb14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.532+0000 7f5c99f03700 1 --2- 172.21.15.70:0/703368556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb13d260 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c015000 tx=0x7f5c8c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cf506f9019145c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5c7bfff700 1 -- 172.21.15.70:0/703368556 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00e040 con 0x5591bb13ce80 2023-10-08T08:48:06.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5c7bfff700 1 -- 172.21.15.70:0/703368556 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c8c003e90 con 0x5591bb13ce80 2023-10-08T08:48:06.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5c7bfff700 1 -- 172.21.15.70:0/703368556 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c028d30 con 0x5591bb13ce80 2023-10-08T08:48:06.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5ca8350b80 1 -- 172.21.15.70:0/703368556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 msgr2=0x5591bb13d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/703368556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb13d260 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c015000 tx=0x7f5c8c01d000 comp rx=0 tx=0).stop 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5ca8350b80 1 -- 172.21.15.70:0/703368556 shutdown_connections 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/703368556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb14ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/703368556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb13d260 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/703368556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13d7a0 0x5591bb14c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5ca8350b80 1 -- 172.21.15.70:0/703368556 >> 172.21.15.70:0/703368556 conn(0x5591bb0b2260 msgr2=0x5591bb1392d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5ca8350b80 1 -- 172.21.15.70:0/703368556 shutdown_connections 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.533+0000 7f5ca8350b80 1 -- 172.21.15.70:0/703368556 wait complete. 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5ca8350b80 1 -- start start 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5ca8350b80 1 Processor -- start 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb14c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb149860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb149e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb090e30 con 0x5591bb13d7a0 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb02d710 con 0x5591bb13ce80 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb02d3b0 con 0x5591bb14ca60 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5ca8350b80 10 client.0 _ll_register_callbacks cb 0x5591bae8a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5c99702700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5c99f03700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb14c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5c99f03700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb14c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40936/0 (socket says 172.21.15.70:40936) 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5c99f03700 1 -- 172.21.15.70:0/1861921214 learned_addr learned my addr 172.21.15.70:0/1861921214 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5c99702700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53480/0 (socket says 172.21.15.70:53480) 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.534+0000 7f5c9a704700 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c99f03700 1 -- 172.21.15.70:0/1861921214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 msgr2=0x5591bb149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c99f03700 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c99f03700 1 -- 172.21.15.70:0/1861921214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 msgr2=0x5591bb149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c99f03700 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c99f03700 1 -- 172.21.15.70:0/1861921214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c941a37f0 con 0x5591bb13ce80 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c9a704700 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c99f03700 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb14c430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c006130 tx=0x7f5c8c009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fe86b1547fba928 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c797fa700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c797fa700 1 -- 172.21.15.70:0/1861921214 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c028ea0 con 0x5591bb13ce80 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5ca8350b80 1 -- 172.21.15.70:0/1861921214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591bb058eb0 con 0x5591bb13ce80 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c797fa700 1 -- 172.21.15.70:0/1861921214 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5c8c0074a0 con 0x5591bb13ce80 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5c797fa700 1 -- 172.21.15.70:0/1861921214 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c8c007660 con 0x5591bb13ce80 2023-10-08T08:48:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5ca8350b80 10 client.26132 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.535+0000 7f5ca8350b80 1 -- 172.21.15.70:0/1861921214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f5c9410cde0 con 0x5591bb13ce80 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5c797fa700 1 -- 172.21.15.70:0/1861921214 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5591bb058eb0 con 0x5591bb13ce80 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5c797fa700 1 -- 172.21.15.70:0/1861921214 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f5c8c033410 con 0x5591bb13ce80 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5ca8350b80 10 client.26132 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5ca8350b80 10 client.26132 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5ca8350b80 20 client.26132 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5591bb15c0d0 0x5591bb15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5ca8350b80 4 client.26132 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5ca8350b80 1 -- 172.21.15.70:0/1861921214 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591bb089e10 con 0x5591bb15c0d0 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5c99702700 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5591bb15c0d0 0x5591bb15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5c797fa700 10 client.26132 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.536+0000 7f5c99702700 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5591bb15c0d0 0x5591bb15e4f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=63261848a771cc67 server_cookie=3ff94fa691d44032 in_seq=0 out_seq=0 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5c797fa700 1 -- 172.21.15.70:0/1861921214 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5591bb089e10 con 0x5591bb15c0d0 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5c797fa700 10 client.26132 handle_command_reply: tid=0 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 client.26132 shutdown 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 -- 172.21.15.70:0/1861921214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 msgr2=0x5591bb14c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb14c430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c006130 tx=0x7f5c8c009570 comp rx=0 tx=0).stop 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 -- 172.21.15.70:0/1861921214 shutdown_connections 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5591bb15c0d0 0x5591bb15e4f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb14c430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5c797fa700 0 client.26132 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:48:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/1861921214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 -- 172.21.15.70:0/1861921214 >> 172.21.15.70:0/1861921214 conn(0x5591bb0b2260 msgr2=0x5591bb138ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 -- 172.21.15.70:0/1861921214 shutdown_connections 2023-10-08T08:48:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 1 -- 172.21.15.70:0/1861921214 wait complete. 2023-10-08T08:48:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.537+0000 7f5ca8350b80 20 client.26132 trim_cache size 0 max 16384 2023-10-08T08:48:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5ca8350b80 1 Processor -- start 2023-10-08T08:48:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5ca8350b80 1 -- start start 2023-10-08T08:48:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb153550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb13d7a0 0x5591bb149050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb14ca60 0x5591bb149590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591baf11920 con 0x5591bb13ce80 2023-10-08T08:48:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb153a90 con 0x5591bb14ca60 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb14a470 con 0x5591bb13d7a0 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99f03700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99f03700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53486/0 (socket says 172.21.15.70:53486) 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99f03700 1 -- 172.21.15.70:0/2732899456 learned_addr learned my addr 172.21.15.70:0/2732899456 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99702700 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb13d7a0 0x5591bb149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c9a704700 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb14ca60 0x5591bb149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99f03700 1 -- 172.21.15.70:0/2732899456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb13d7a0 msgr2=0x5591bb149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99f03700 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb13d7a0 0x5591bb149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99f03700 1 -- 172.21.15.70:0/2732899456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb14ca60 msgr2=0x5591bb149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99f03700 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb14ca60 0x5591bb149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99f03700 1 -- 172.21.15.70:0/2732899456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591baea4c60 con 0x5591bb13ce80 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99702700 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb13d7a0 0x5591bb149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.551+0000 7f5c99f03700 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb153550 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c007b20 tx=0x7f5c8c00afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74606b86faea3f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5c90ff9700 1 -- 172.21.15.70:0/2732899456 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00e070 con 0x5591bb13ce80 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5c90ff9700 1 -- 172.21.15.70:0/2732899456 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c8c037070 con 0x5591bb13ce80 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5c90ff9700 1 -- 172.21.15.70:0/2732899456 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c005310 con 0x5591bb13ce80 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5ca8350b80 1 -- 172.21.15.70:0/2732899456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 msgr2=0x5591bb153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb153550 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c007b20 tx=0x7f5c8c00afe0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5ca8350b80 1 -- 172.21.15.70:0/2732899456 shutdown_connections 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb14ca60 0x5591bb149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13ce80 0x5591bb153550 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/2732899456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb13d7a0 0x5591bb149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5ca8350b80 1 -- 172.21.15.70:0/2732899456 >> 172.21.15.70:0/2732899456 conn(0x5591bb0b2260 msgr2=0x5591bb138cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5ca8350b80 1 -- 172.21.15.70:0/2732899456 shutdown_connections 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.552+0000 7f5ca8350b80 1 -- 172.21.15.70:0/2732899456 wait complete. 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5ca8350b80 1 -- start start 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5ca8350b80 1 Processor -- start 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5ca8350b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb1523e0 con 0x5591bb13d7a0 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb152520 con 0x5591bb13ce80 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5ca8350b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591bb1526e0 con 0x5591bb14ca60 2023-10-08T08:48:06.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5ca8350b80 10 client.0 _ll_register_callbacks cb 0x5591bae8a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99702700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99f03700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99f03700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb1532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40950/0 (socket says 172.21.15.70:40950) 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c9a704700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99702700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53494/0 (socket says 172.21.15.70:53494) 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99f03700 1 -- 172.21.15.70:0/3673689687 learned_addr learned my addr 172.21.15.70:0/3673689687 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99f03700 1 -- 172.21.15.70:0/3673689687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 msgr2=0x5591bb151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99f03700 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99f03700 1 -- 172.21.15.70:0/3673689687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 msgr2=0x5591bb151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99f03700 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99f03700 1 -- 172.21.15.70:0/3673689687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c880cc040 con 0x5591bb13ce80 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.553+0000 7f5c99702700 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5c99f03700 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb1532e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c033890 tx=0x7f5c8c00bc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65c7fb00c17c7b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5c797fa700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5c797fa700 1 -- 172.21.15.70:0/3673689687 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00e070 con 0x5591bb13ce80 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5ca8350b80 1 -- 172.21.15.70:0/3673689687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c8c003e90 con 0x5591bb13ce80 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5c797fa700 1 -- 172.21.15.70:0/3673689687 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5c8c0076a0 con 0x5591bb13ce80 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5c797fa700 1 -- 172.21.15.70:0/3673689687 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c8c007860 con 0x5591bb13ce80 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5ca8350b80 10 client.26138 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5ca8350b80 1 -- 172.21.15.70:0/3673689687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f5c9410cde0 con 0x5591bb13ce80 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5c797fa700 1 -- 172.21.15.70:0/3673689687 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c8c003e90 con 0x5591bb13ce80 2023-10-08T08:48:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5c797fa700 1 -- 172.21.15.70:0/3673689687 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f5c8c03c420 con 0x5591bb13ce80 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5ca8350b80 10 client.26138 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5ca8350b80 10 client.26138 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5ca8350b80 20 client.26138 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5591bb1b1080 0x5591bb1b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5ca8350b80 4 client.26138 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.554+0000 7f5ca8350b80 1 -- 172.21.15.70:0/3673689687 --> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5591bb089b30 con 0x5591bb1b1080 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5c99702700 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5591bb1b1080 0x5591bb1b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5c99702700 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5591bb1b1080 0x5591bb1b34a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5f917da9139831a server_cookie=5d482df6e66414ae in_seq=0 out_seq=0 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5c797fa700 10 client.26138 ms_handle_connect on v2:172.21.15.191:6838/502953702 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5c797fa700 1 -- 172.21.15.70:0/3673689687 <== mds.2 v2:172.21.15.191:6838/502953702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5591bb089b30 con 0x5591bb1b1080 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5c797fa700 10 client.26138 handle_command_reply: tid=0 2023-10-08T08:48:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 client.26138 shutdown 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 -- 172.21.15.70:0/3673689687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 msgr2=0x5591bb1532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb1532e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c033890 tx=0x7f5c8c00bc60 comp rx=0 tx=0).stop 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 -- 172.21.15.70:0/3673689687 shutdown_connections 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.191:6838/502953702,v1:172.21.15.191:6839/502953702] conn(0x5591bb1b1080 0x5591bb1b34a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5591bb14ca60 0x5591bb151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5c797fa700 0 client.26138 ms_handle_reset on v2:172.21.15.191:6838/502953702 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591bb13ce80 0x5591bb1532e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 --2- 172.21.15.70:0/3673689687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591bb13d7a0 0x5591bb151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 -- 172.21.15.70:0/3673689687 >> 172.21.15.70:0/3673689687 conn(0x5591bb0b2260 msgr2=0x5591bb157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 -- 172.21.15.70:0/3673689687 shutdown_connections 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.555+0000 7f5ca8350b80 1 -- 172.21.15.70:0/3673689687 wait complete. 2023-10-08T08:48:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5ca8350b80 20 client.26138 trim_cache size 0 max 16384 2023-10-08T08:48:06.574 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:48:06.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 -- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5c7c0a15f0 msgr2=0x7f5c7c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5c7c0a15f0 0x7f5c7c0a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009610 tx=0x7f5c8c00b720 comp rx=0 tx=0).stop 2023-10-08T08:48:06.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 -- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c940fffe0 msgr2=0x7f5c9419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c940fffe0 0x7f5c9419cd40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800e9a0 tx=0x7f5c8800ecb0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 -- 172.21.15.70:0/2131193210 shutdown_connections 2023-10-08T08:48:06.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5c7c0a15f0 0x7f5c7c0a3ab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c941056b0 0x7f5c94196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c940ff620 0x7f5c9419c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 --2- 172.21.15.70:0/2131193210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c940fffe0 0x7f5c9419cd40 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 -- 172.21.15.70:0/2131193210 >> 172.21.15.70:0/2131193210 conn(0x7f5c94076780 msgr2=0x7f5c941038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 -- 172.21.15.70:0/2131193210 shutdown_connections 2023-10-08T08:48:06.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.556+0000 7f5c9c167700 1 -- 172.21.15.70:0/2131193210 wait complete. 2023-10-08T08:48:06.576 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:06 smithi070 ceph-mon[99513]: pgmap v421: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 297 op/s 2023-10-08T08:48:06.576 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:06 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3371627287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:48:06.577 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T08:48:06.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.701+0000 7f7415ded700 1 -- 172.21.15.70:0/2548839478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74101056b0 msgr2=0x7f7410105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.701+0000 7f7415ded700 1 --2- 172.21.15.70:0/2548839478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74101056b0 0x7f7410105a90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7400009990 tx=0x7f7400009ca0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.701+0000 7f7415ded700 1 -- 172.21.15.70:0/2548839478 shutdown_connections 2023-10-08T08:48:06.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.701+0000 7f7415ded700 1 --2- 172.21.15.70:0/2548839478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74100fffe0 0x7f741010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.701+0000 7f7415ded700 1 --2- 172.21.15.70:0/2548839478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74101056b0 0x7f7410105a90 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.701+0000 7f7415ded700 1 --2- 172.21.15.70:0/2548839478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74100ff620 0x7f74100ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.701+0000 7f7415ded700 1 -- 172.21.15.70:0/2548839478 >> 172.21.15.70:0/2548839478 conn(0x7f7410076780 msgr2=0x7f7410076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.701+0000 7f7415ded700 1 -- 172.21.15.70:0/2548839478 shutdown_connections 2023-10-08T08:48:06.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.701+0000 7f7415ded700 1 -- 172.21.15.70:0/2548839478 wait complete. 2023-10-08T08:48:06.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.702+0000 7f7415ded700 1 Processor -- start 2023-10-08T08:48:06.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.702+0000 7f7415ded700 1 -- start start 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.702+0000 7f7415ded700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74100ff620 0x7f7410195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.702+0000 7f7415ded700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74100fffe0 0x7f7410195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.702+0000 7f7415ded700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74101056b0 0x7f741019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.702+0000 7f7415ded700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741019a900 con 0x7f74101056b0 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.702+0000 7f7415ded700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741019aa70 con 0x7f74100fffe0 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.702+0000 7f7415ded700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741019ac30 con 0x7f74100ff620 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74100ff620 0x7f7410195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74101056b0 0x7f741019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74100ff620 0x7f7410195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:41084/0 (socket says 172.21.15.70:41084) 2023-10-08T08:48:06.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740f7fe700 1 -- 172.21.15.70:0/3047570927 learned_addr learned my addr 172.21.15.70:0/3047570927 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740effd700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74100fffe0 0x7f7410195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740ffff700 1 -- 172.21.15.70:0/3047570927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74100ff620 msgr2=0x7f7410195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740ffff700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74100ff620 0x7f7410195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740ffff700 1 -- 172.21.15.70:0/3047570927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74100fffe0 msgr2=0x7f7410195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740ffff700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74100fffe0 0x7f7410195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740ffff700 1 -- 172.21.15.70:0/3047570927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74000095f0 con 0x7f74101056b0 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740ffff700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74101056b0 0x7f741019a330 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7408007f10 tx=0x7f740800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740cff9700 1 -- 172.21.15.70:0/3047570927 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408004db0 con 0x7f74101056b0 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740cff9700 1 -- 172.21.15.70:0/3047570927 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f740800f040 con 0x7f74101056b0 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f7415ded700 1 -- 172.21.15.70:0/3047570927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741019af10 con 0x7f74101056b0 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f740cff9700 1 -- 172.21.15.70:0/3047570927 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408005990 con 0x7f74101056b0 2023-10-08T08:48:06.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.703+0000 7f7415ded700 1 -- 172.21.15.70:0/3047570927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74101a27c0 con 0x7f74101056b0 2023-10-08T08:48:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.705+0000 7f740cff9700 1 -- 172.21.15.70:0/3047570927 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f740800db20 con 0x7f74101056b0 2023-10-08T08:48:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.706+0000 7f740cff9700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f73f80a15f0 0x7f73f80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.706+0000 7f740f7fe700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f73f80a15f0 0x7f73f80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.706+0000 7f740cff9700 1 -- 172.21.15.70:0/3047570927 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f74080ccc60 con 0x7f74101056b0 2023-10-08T08:48:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.706+0000 7f740f7fe700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f73f80a15f0 0x7f73f80a3ab0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f740000b6f0 tx=0x7f7400005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f7421fd6b80 1 Processor -- start 2023-10-08T08:48:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f7421fd6b80 1 -- start start 2023-10-08T08:48:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a0e80 0x555aa21a1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21ae860 0x555aa21b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa210a460 con 0x555aa21a0e80 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa20fbc20 con 0x555aa21ae860 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa20f9540 con 0x555aa21a17a0 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a0e80 0x555aa21a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a0e80 0x555aa21a1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53514/0 (socket says 172.21.15.70:53514) 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740effd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740f7fe700 1 -- 172.21.15.70:0/3392018165 learned_addr learned my addr 172.21.15.70:0/3392018165 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740ffff700 1 --2- 172.21.15.70:0/3392018165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21ae860 0x555aa21b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740effd700 1 -- 172.21.15.70:0/3392018165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21ae860 msgr2=0x555aa21b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740effd700 1 --2- 172.21.15.70:0/3392018165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21ae860 0x555aa21b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740effd700 1 -- 172.21.15.70:0/3392018165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a0e80 msgr2=0x555aa21a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740effd700 1 --2- 172.21.15.70:0/3392018165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a0e80 0x555aa21a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.707+0000 7f740effd700 1 -- 172.21.15.70:0/3392018165 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aa1f1fde0 con 0x555aa21a17a0 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.708+0000 7f740f7fe700 1 --2- 172.21.15.70:0/3392018165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a0e80 0x555aa21a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.708+0000 7f740effd700 1 --2- 172.21.15.70:0/3392018165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ae320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7404009c80 tx=0x7f7404009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0ed6fd604e08eb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.708+0000 7f73f5ffb700 1 -- 172.21.15.70:0/3392018165 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404011cb0 con 0x555aa21a17a0 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.708+0000 7f73f5ffb700 1 -- 172.21.15.70:0/3392018165 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7404011e10 con 0x555aa21a17a0 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.708+0000 7f73f5ffb700 1 -- 172.21.15.70:0/3392018165 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404005280 con 0x555aa21a17a0 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3392018165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 msgr2=0x555aa21ae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3392018165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ae320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7404009c80 tx=0x7f7404009f90 comp rx=0 tx=0).stop 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3392018165 shutdown_connections 2023-10-08T08:48:06.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3392018165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21ae860 0x555aa21b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3392018165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a0e80 0x555aa21a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3392018165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ae320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3392018165 >> 172.21.15.70:0/3392018165 conn(0x555aa2116260 msgr2=0x555aa219d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3392018165 shutdown_connections 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3392018165 wait complete. 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 -- start start 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 Processor -- start 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21ae230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21abb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa20f4e30 con 0x555aa21ae860 2023-10-08T08:48:06.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa2091710 con 0x555aa21a0e80 2023-10-08T08:48:06.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.709+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa20913b0 con 0x555aa21a17a0 2023-10-08T08:48:06.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f7421fd6b80 10 client.0 _ll_register_callbacks cb 0x555aa1eee800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740effd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53524/0 (socket says 172.21.15.70:53524) 2023-10-08T08:48:06.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740effd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:41100/0 (socket says 172.21.15.70:41100) 2023-10-08T08:48:06.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740ffff700 1 -- 172.21.15.70:0/1062295294 learned_addr learned my addr 172.21.15.70:0/1062295294 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740ffff700 1 -- 172.21.15.70:0/1062295294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 msgr2=0x555aa21ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740ffff700 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740ffff700 1 -- 172.21.15.70:0/1062295294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 msgr2=0x555aa21ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740ffff700 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740ffff700 1 -- 172.21.15.70:0/1062295294 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741010cde0 con 0x555aa21ae860 2023-10-08T08:48:06.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740effd700 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f740ffff700 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21abb30 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7408099900 tx=0x7f74080994b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a45ad8ddff5071 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f73eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:48:06.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f73eeffd700 1 -- 172.21.15.70:0/1062295294 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080b2210 con 0x555aa21ae860 2023-10-08T08:48:06.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f73eeffd700 1 -- 172.21.15.70:0/1062295294 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f740809a070 con 0x555aa21ae860 2023-10-08T08:48:06.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f7421fd6b80 1 -- 172.21.15.70:0/1062295294 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555aa20bceb0 con 0x555aa21ae860 2023-10-08T08:48:06.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f73eeffd700 1 -- 172.21.15.70:0/1062295294 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7408099970 con 0x555aa21ae860 2023-10-08T08:48:06.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f7421fd6b80 10 client.16752 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:06.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.710+0000 7f7421fd6b80 1 -- 172.21.15.70:0/1062295294 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f74040098e0 con 0x555aa21ae860 2023-10-08T08:48:06.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f73eeffd700 1 -- 172.21.15.70:0/1062295294 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7408063020 con 0x555aa21ae860 2023-10-08T08:48:06.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f73eeffd700 1 -- 172.21.15.70:0/1062295294 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f7408099bd0 con 0x555aa21ae860 2023-10-08T08:48:06.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f7421fd6b80 10 client.16752 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:06.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f7421fd6b80 10 client.16752 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-10-08T08:48:06.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f7421fd6b80 20 client.16752 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:06.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x555aa21be470 0x555aa21c0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f7421fd6b80 4 client.16752 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:48:06.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f7421fd6b80 1 -- 172.21.15.70:0/1062295294 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555aa20ede10 con 0x555aa21be470 2023-10-08T08:48:06.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f740f7fe700 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x555aa21be470 0x555aa21c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f73eeffd700 10 client.16752 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:48:06.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.711+0000 7f740f7fe700 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x555aa21be470 0x555aa21c0890 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32173ba75e3eab99 server_cookie=cc4ddda9e6f37332 in_seq=0 out_seq=0 2023-10-08T08:48:06.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f73eeffd700 1 -- 172.21.15.70:0/1062295294 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555aa20ede10 con 0x555aa21be470 2023-10-08T08:48:06.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f73eeffd700 10 client.16752 handle_command_reply: tid=0 2023-10-08T08:48:06.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 client.16752 shutdown 2023-10-08T08:48:06.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 -- 172.21.15.70:0/1062295294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 msgr2=0x555aa21abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21abb30 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7408099900 tx=0x7f74080994b0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 -- 172.21.15.70:0/1062295294 shutdown_connections 2023-10-08T08:48:06.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x555aa21be470 0x555aa21c0890 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21abb30 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f73eeffd700 0 client.16752 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:48:06.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/1062295294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a17a0 0x555aa21ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 -- 172.21.15.70:0/1062295294 >> 172.21.15.70:0/1062295294 conn(0x555aa2116260 msgr2=0x555aa219cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 -- 172.21.15.70:0/1062295294 shutdown_connections 2023-10-08T08:48:06.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 1 -- 172.21.15.70:0/1062295294 wait complete. 2023-10-08T08:48:06.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.713+0000 7f7421fd6b80 20 client.16752 trim_cache size 0 max 16384 2023-10-08T08:48:06.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f7421fd6b80 1 Processor -- start 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f7421fd6b80 1 -- start start 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a0e80 0x555aa21b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a17a0 0x555aa21a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21aa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa1f75920 con 0x555aa21ae860 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa21b58f0 con 0x555aa21a17a0 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa21a9a90 con 0x555aa21a0e80 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740ffff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21aa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53532/0 (socket says 172.21.15.70:53532) 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740ffff700 1 -- 172.21.15.70:0/715293155 learned_addr learned my addr 172.21.15.70:0/715293155 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740f7fe700 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a0e80 0x555aa21b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740effd700 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a17a0 0x555aa21a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740ffff700 1 -- 172.21.15.70:0/715293155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a0e80 msgr2=0x555aa21b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740ffff700 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a0e80 0x555aa21b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740ffff700 1 -- 172.21.15.70:0/715293155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a17a0 msgr2=0x555aa21a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740ffff700 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a17a0 0x555aa21a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740ffff700 1 -- 172.21.15.70:0/715293155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aa1f08c60 con 0x555aa21ae860 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.727+0000 7f740f7fe700 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a0e80 0x555aa21b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f740ffff700 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21aa350 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f74080ca6e0 tx=0x7f7408097f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122beb963a40714c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f73f67fc700 1 -- 172.21.15.70:0/715293155 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080992d0 con 0x555aa21ae860 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f73f67fc700 1 -- 172.21.15.70:0/715293155 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7408063030 con 0x555aa21ae860 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f73f67fc700 1 -- 172.21.15.70:0/715293155 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408099970 con 0x555aa21ae860 2023-10-08T08:48:06.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f7421fd6b80 1 -- 172.21.15.70:0/715293155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 msgr2=0x555aa21aa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21aa350 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f74080ca6e0 tx=0x7f7408097f20 comp rx=0 tx=0).stop 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f7421fd6b80 1 -- 172.21.15.70:0/715293155 shutdown_connections 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21ae860 0x555aa21aa350 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21a0e80 0x555aa21b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/715293155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a17a0 0x555aa21a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.728+0000 7f7421fd6b80 1 -- 172.21.15.70:0/715293155 >> 172.21.15.70:0/715293155 conn(0x555aa2116260 msgr2=0x555aa21a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 -- 172.21.15.70:0/715293155 shutdown_connections 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 -- 172.21.15.70:0/715293155 wait complete. 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 -- start start 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 Processor -- start 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21a8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a17a0 0x555aa21a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21ae860 0x555aa21a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa21a7cf0 con 0x555aa21a17a0 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa21a7e60 con 0x555aa21a0e80 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa21a7fd0 con 0x555aa21ae860 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f7421fd6b80 10 client.0 _ll_register_callbacks cb 0x7f7408095d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f740effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a17a0 0x555aa21a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f740effd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a17a0 0x555aa21a8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53536/0 (socket says 172.21.15.70:53536) 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21a8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:40992/0 (socket says 172.21.15.70:40992) 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f740effd700 1 -- 172.21.15.70:0/3178656908 learned_addr learned my addr 172.21.15.70:0/3178656908 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.729+0000 7f740ffff700 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21ae860 0x555aa21a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f740f7fe700 1 -- 172.21.15.70:0/3178656908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21ae860 msgr2=0x555aa21a77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f740f7fe700 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21ae860 0x555aa21a77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f740f7fe700 1 -- 172.21.15.70:0/3178656908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a17a0 msgr2=0x555aa21a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f740f7fe700 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a17a0 0x555aa21a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f740f7fe700 1 -- 172.21.15.70:0/3178656908 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740000b880 con 0x555aa21a0e80 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f740effd700 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a17a0 0x555aa21a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f740ffff700 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21ae860 0x555aa21a77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f740f7fe700 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21a8910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f740000b2e0 tx=0x7f7400009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be00d343585b6c19 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f73eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f73eeffd700 1 -- 172.21.15.70:0/3178656908 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000363a0 con 0x555aa21a0e80 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3178656908 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7404011e10 con 0x555aa21a0e80 2023-10-08T08:48:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f73eeffd700 1 -- 172.21.15.70:0/3178656908 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7400036500 con 0x555aa21a0e80 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f73eeffd700 1 -- 172.21.15.70:0/3178656908 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7400036b00 con 0x555aa21a0e80 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f7421fd6b80 10 client.26156 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.730+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3178656908 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f74040098e0 con 0x555aa21a0e80 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f73eeffd700 1 -- 172.21.15.70:0/3178656908 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7404011e10 con 0x555aa21a0e80 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f73eeffd700 1 -- 172.21.15.70:0/3178656908 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f740000f460 con 0x555aa21a0e80 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f7421fd6b80 10 client.26156 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f7421fd6b80 10 client.26156 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f7421fd6b80 20 client.26156 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x555aa2215610 0x555aa2217a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f7421fd6b80 4 client.26156 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:48:06.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3178656908 --> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555aa20edb30 con 0x555aa2215610 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f740effd700 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x555aa2215610 0x555aa2217a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f73eeffd700 10 client.26156 ms_handle_connect on v2:172.21.15.105:6836/1223332925 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.731+0000 7f740effd700 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x555aa2215610 0x555aa2217a30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=214c9455500b0506 server_cookie=716b0ece11876e21 in_seq=0 out_seq=0 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f73eeffd700 1 -- 172.21.15.70:0/3178656908 <== mds.1 v2:172.21.15.105:6836/1223332925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555aa20edb30 con 0x555aa2215610 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f73eeffd700 10 client.26156 handle_command_reply: tid=0 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 client.26156 shutdown 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3178656908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 msgr2=0x555aa21a8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21a8910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f740000b2e0 tx=0x7f7400009ca0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3178656908 shutdown_connections 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.105:6836/1223332925,v1:172.21.15.105:6837/1223332925] conn(0x555aa2215610 0x555aa2217a30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555aa21ae860 0x555aa21a77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f73eeffd700 0 client.26156 ms_handle_reset on v2:172.21.15.105:6836/1223332925 2023-10-08T08:48:06.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555aa21a0e80 0x555aa21a8910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 --2- 172.21.15.70:0/3178656908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555aa21a17a0 0x555aa21a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3178656908 >> 172.21.15.70:0/3178656908 conn(0x555aa2116260 msgr2=0x555aa21a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3178656908 shutdown_connections 2023-10-08T08:48:06.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 1 -- 172.21.15.70:0/3178656908 wait complete. 2023-10-08T08:48:06.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7421fd6b80 20 client.26156 trim_cache size 0 max 16384 2023-10-08T08:48:06.741 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:48:06.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7415ded700 1 -- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f73f80a15f0 msgr2=0x7f73f80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7415ded700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f73f80a15f0 0x7f73f80a3ab0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f740000b6f0 tx=0x7f7400005bc0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7415ded700 1 -- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74101056b0 msgr2=0x7f741019a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.732+0000 7f7415ded700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74101056b0 0x7f741019a330 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7408007f10 tx=0x7f740800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.733+0000 7f7415ded700 1 -- 172.21.15.70:0/3047570927 shutdown_connections 2023-10-08T08:48:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.733+0000 7f7415ded700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f73f80a15f0 0x7f73f80a3ab0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.733+0000 7f7415ded700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74101056b0 0x7f741019a330 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.733+0000 7f7415ded700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74100ff620 0x7f7410195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.733+0000 7f7415ded700 1 --2- 172.21.15.70:0/3047570927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74100fffe0 0x7f7410195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.733+0000 7f7415ded700 1 -- 172.21.15.70:0/3047570927 >> 172.21.15.70:0/3047570927 conn(0x7f7410076780 msgr2=0x7f74100fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.733+0000 7f7415ded700 1 -- 172.21.15.70:0/3047570927 shutdown_connections 2023-10-08T08:48:06.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.733+0000 7f7415ded700 1 -- 172.21.15.70:0/3047570927 wait complete. 2023-10-08T08:48:06.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T08:48:06.755 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-10-08T08:48:06.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-08T08:48:06.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:06 smithi105 ceph-mon[103798]: pgmap v421: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 297 op/s 2023-10-08T08:48:06.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:06 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3371627287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:48:06.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:06 smithi191 ceph-mon[104220]: pgmap v421: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 297 op/s 2023-10-08T08:48:06.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:06 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3371627287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:48:06.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.913+0000 7fc989dd2700 1 -- 172.21.15.70:0/3894702975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc984119fd0 msgr2=0x7fc98411c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.913+0000 7fc989dd2700 1 --2- 172.21.15.70:0/3894702975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc984119fd0 0x7fc98411c3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009fc0 tx=0x7fc97c00b330 comp rx=0 tx=0).stop 2023-10-08T08:48:06.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.913+0000 7fc989dd2700 1 -- 172.21.15.70:0/3894702975 shutdown_connections 2023-10-08T08:48:06.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.913+0000 7fc989dd2700 1 --2- 172.21.15.70:0/3894702975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc984119fd0 0x7fc98411c3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.913+0000 7fc989dd2700 1 --2- 172.21.15.70:0/3894702975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc98410ef80 0x7fc9841077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.913+0000 7fc989dd2700 1 --2- 172.21.15.70:0/3894702975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc984107d30 0x7fc9841081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.913+0000 7fc989dd2700 1 -- 172.21.15.70:0/3894702975 >> 172.21.15.70:0/3894702975 conn(0x7fc98406b830 msgr2=0x7fc98406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.913+0000 7fc989dd2700 1 -- 172.21.15.70:0/3894702975 shutdown_connections 2023-10-08T08:48:06.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.913+0000 7fc989dd2700 1 -- 172.21.15.70:0/3894702975 wait complete. 2023-10-08T08:48:06.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.914+0000 7fc989dd2700 1 Processor -- start 2023-10-08T08:48:06.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.914+0000 7fc989dd2700 1 -- start start 2023-10-08T08:48:06.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.914+0000 7fc989dd2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc984107d30 0x7fc984118390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.914+0000 7fc989dd2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc98410ef80 0x7fc9841188d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.914+0000 7fc989dd2700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc984119fd0 0x7fc984111430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.914+0000 7fc989dd2700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc984111c00 con 0x7fc984119fd0 2023-10-08T08:48:06.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.914+0000 7fc989dd2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc984111d70 con 0x7fc984107d30 2023-10-08T08:48:06.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.914+0000 7fc989dd2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc984111f30 con 0x7fc98410ef80 2023-10-08T08:48:06.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.914+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc98410ef80 0x7fc9841188d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.915+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc98410ef80 0x7fc9841188d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:41126/0 (socket says 172.21.15.70:41126) 2023-10-08T08:48:06.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.915+0000 7fc982ffd700 1 -- 172.21.15.70:0/2698115962 learned_addr learned my addr 172.21.15.70:0/2698115962 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.915+0000 7fc983fff700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc984119fd0 0x7fc984111430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.915+0000 7fc982ffd700 1 -- 172.21.15.70:0/2698115962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc984107d30 msgr2=0x7fc984118390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T08:48:06.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.915+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc984107d30 0x7fc984118390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.915+0000 7fc982ffd700 1 -- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc984119fd0 msgr2=0x7fc984111430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.915+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc984119fd0 0x7fc984111430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.915+0000 7fc982ffd700 1 -- 172.21.15.70:0/2698115962 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c009c40 con 0x7fc98410ef80 2023-10-08T08:48:06.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.915+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc98410ef80 0x7fc9841188d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc97400b530 tx=0x7fc97400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.918+0000 7fc980ff9700 1 -- 172.21.15.70:0/2698115962 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9740118f0 con 0x7fc98410ef80 2023-10-08T08:48:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.918+0000 7fc980ff9700 1 -- 172.21.15.70:0/2698115962 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc974010380 con 0x7fc98410ef80 2023-10-08T08:48:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.918+0000 7fc980ff9700 1 -- 172.21.15.70:0/2698115962 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97400f540 con 0x7fc98410ef80 2023-10-08T08:48:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.921+0000 7fc989dd2700 1 -- 172.21.15.70:0/2698115962 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc984112210 con 0x7fc98410ef80 2023-10-08T08:48:06.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.921+0000 7fc989dd2700 1 -- 172.21.15.70:0/2698115962 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc984116150 con 0x7fc98410ef80 2023-10-08T08:48:06.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.926+0000 7fc980ff9700 1 -- 172.21.15.70:0/2698115962 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc9740104f0 con 0x7fc98410ef80 2023-10-08T08:48:06.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.927+0000 7fc980ff9700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc96c0a1740 0x7fc96c0a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.927+0000 7fc980ff9700 1 -- 172.21.15.70:0/2698115962 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc9740ccac0 con 0x7fc98410ef80 2023-10-08T08:48:06.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.928+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc96c0a1740 0x7fc96c0a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.929+0000 7fc995fbbb80 1 Processor -- start 2023-10-08T08:48:06.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.929+0000 7fc995fbbb80 1 -- start start 2023-10-08T08:48:06.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.929+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.929+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.929+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.929+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a313460 con 0x55ce8a3a9e80 2023-10-08T08:48:06.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.929+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a304c20 con 0x55ce8a3b5650 2023-10-08T08:48:06.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.929+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a302540 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.930+0000 7fc983fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.930+0000 7fc983fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:41014/0 (socket says 172.21.15.70:41014) 2023-10-08T08:48:06.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.930+0000 7fc983fff700 1 -- 172.21.15.70:0/2725342006 learned_addr learned my addr 172.21.15.70:0/2725342006 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.930+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.930+0000 7fc983fff700 1 -- 172.21.15.70:0/2725342006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 msgr2=0x55ce8a3b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.930+0000 7fc983fff700 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.930+0000 7fc983fff700 1 -- 172.21.15.70:0/2725342006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 msgr2=0x55ce8a3aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.930+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.931+0000 7fc983fff700 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3aa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.931+0000 7fc983fff700 1 -- 172.21.15.70:0/2725342006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce8a128de0 con 0x55ce8a3b5650 2023-10-08T08:48:06.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.931+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:48:06.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.933+0000 7fc983fff700 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b7a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc97c007c90 tx=0x7fc97c007cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f4f01995aa95ad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.934+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc96c0a1740 0x7fc96c0a3c00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc978005fd0 tx=0x7fc978009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.934+0000 7fc969ffb700 1 -- 172.21.15.70:0/2725342006 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00e040 con 0x55ce8a3b5650 2023-10-08T08:48:06.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.934+0000 7fc969ffb700 1 -- 172.21.15.70:0/2725342006 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc97c003c00 con 0x55ce8a3b5650 2023-10-08T08:48:06.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.934+0000 7fc969ffb700 1 -- 172.21.15.70:0/2725342006 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c01c440 con 0x55ce8a3b5650 2023-10-08T08:48:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.935+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2725342006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 msgr2=0x55ce8a3b7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.935+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b7a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc97c007c90 tx=0x7fc97c007cc0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.935+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2725342006 shutdown_connections 2023-10-08T08:48:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.935+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b7a40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.935+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.935+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2725342006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.935+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2725342006 >> 172.21.15.70:0/2725342006 conn(0x55ce8a31f260 msgr2=0x55ce8a3a62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.937+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2725342006 shutdown_connections 2023-10-08T08:48:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.937+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2725342006 wait complete. 2023-10-08T08:48:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.937+0000 7fc995fbbb80 1 -- start start 2023-10-08T08:48:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.937+0000 7fc995fbbb80 1 Processor -- start 2023-10-08T08:48:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a2fde30 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a29a710 con 0x55ce8a3a9e80 2023-10-08T08:48:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a29a3b0 con 0x55ce8a3b5650 2023-10-08T08:48:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc995fbbb80 10 client.0 _ll_register_callbacks cb 0x55ce8a0f7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.70:41020/0 (socket says 172.21.15.70:41020) 2023-10-08T08:48:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc9837fe700 1 -- 172.21.15.70:0/2579575294 learned_addr learned my addr 172.21.15.70:0/2579575294 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc983fff700 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc9837fe700 1 -- 172.21.15.70:0/2579575294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3b5650 msgr2=0x55ce8a3b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.938+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.939+0000 7fc9837fe700 1 -- 172.21.15.70:0/2579575294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 msgr2=0x55ce8a3b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.939+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.939+0000 7fc9837fe700 1 -- 172.21.15.70:0/2579575294 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98411ccc0 con 0x55ce8a3a9e80 2023-10-08T08:48:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.939+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3b50b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc978010460 tx=0x7fc9780047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1cfd7a0a1962a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.939+0000 7fc962ffd700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-08T08:48:06.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.939+0000 7fc962ffd700 1 -- 172.21.15.70:0/2579575294 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978010c90 con 0x55ce8a3a9e80 2023-10-08T08:48:06.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.939+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2579575294 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce8a2c5eb0 con 0x55ce8a3a9e80 2023-10-08T08:48:06.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.939+0000 7fc962ffd700 1 -- 172.21.15.70:0/2579575294 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc978010df0 con 0x55ce8a3a9e80 2023-10-08T08:48:06.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.939+0000 7fc962ffd700 1 -- 172.21.15.70:0/2579575294 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc978025430 con 0x55ce8a3a9e80 2023-10-08T08:48:06.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc995fbbb80 10 client.26165 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:06.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2579575294 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55ce8a111c60 con 0x55ce8a3a9e80 2023-10-08T08:48:06.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc962ffd700 1 -- 172.21.15.70:0/2579575294 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ce8a2c5eb0 con 0x55ce8a3a9e80 2023-10-08T08:48:06.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc962ffd700 1 -- 172.21.15.70:0/2579575294 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fc97801c720 con 0x55ce8a3a9e80 2023-10-08T08:48:06.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc995fbbb80 10 client.26165 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:06.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc995fbbb80 10 client.26165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:48:06.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc995fbbb80 20 client.26165 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:06.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ce8a3c5160 0x55ce8a3c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc995fbbb80 4 client.26165 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T08:48:06.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.940+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2579575294 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce8a2f6e10 con 0x55ce8a3c5160 2023-10-08T08:48:06.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.941+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ce8a3c5160 0x55ce8a3c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.943+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ce8a3c5160 0x55ce8a3c7580 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d1d1ae9cf31f258 server_cookie=95b0fc8256622a50 in_seq=0 out_seq=0 2023-10-08T08:48:06.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.943+0000 7fc962ffd700 10 client.26165 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:48:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc962ffd700 1 -- 172.21.15.70:0/2579575294 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ce8a2f6e10 con 0x55ce8a3c5160 2023-10-08T08:48:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc962ffd700 10 client.26165 handle_command_reply: tid=0 2023-10-08T08:48:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 client.26165 shutdown 2023-10-08T08:48:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2579575294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3a9e80 msgr2=0x55ce8a3b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3b50b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc978010460 tx=0x7fc9780047c0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2579575294 shutdown_connections 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3b5650 0x55ce8a3b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ce8a3c5160 0x55ce8a3c7580 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3b50b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc962ffd700 0 client.26165 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2579575294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2579575294 >> 172.21.15.70:0/2579575294 conn(0x55ce8a31f260 msgr2=0x55ce8a3a5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2579575294 shutdown_connections 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2579575294 wait complete. 2023-10-08T08:48:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.945+0000 7fc995fbbb80 20 client.26165 trim_cache size 0 max 16384 2023-10-08T08:48:06.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.968+0000 7fc995fbbb80 1 Processor -- start 2023-10-08T08:48:06.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.969+0000 7fc995fbbb80 1 -- start start 2023-10-08T08:48:06.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.969+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3bc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.969+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.969+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3c0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.969+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a17e920 con 0x55ce8a3a9e80 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.969+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a3b3310 con 0x55ce8a3b5650 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.969+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a3b7e00 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.970+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.970+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:41148/0 (socket says 172.21.15.70:41148) 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.970+0000 7fc982ffd700 1 -- 172.21.15.70:0/1750494947 learned_addr learned my addr 172.21.15.70:0/1750494947 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.972+0000 7fc983fff700 1 --2- 172.21.15.70:0/1750494947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.972+0000 7fc982ffd700 1 -- 172.21.15.70:0/1750494947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 msgr2=0x55ce8a3c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.972+0000 7fc982ffd700 1 --2- 172.21.15.70:0/1750494947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3c0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.972+0000 7fc982ffd700 1 -- 172.21.15.70:0/1750494947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 msgr2=0x55ce8a3bc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.972+0000 7fc982ffd700 1 --2- 172.21.15.70:0/1750494947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3bc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.972+0000 7fc982ffd700 1 -- 172.21.15.70:0/1750494947 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce8a14f250 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.974+0000 7fc982ffd700 1 --2- 172.21.15.70:0/1750494947 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3ad750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc974099870 tx=0x7fc974010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5a31052128008eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.976+0000 7fc96a7fc700 1 -- 172.21.15.70:0/1750494947 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9740a1c70 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.976+0000 7fc96a7fc700 1 -- 172.21.15.70:0/1750494947 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9740b7b00 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.976+0000 7fc96a7fc700 1 -- 172.21.15.70:0/1750494947 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974099b40 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.977+0000 7fc995fbbb80 1 -- 172.21.15.70:0/1750494947 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 msgr2=0x55ce8a3ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:06.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.977+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/1750494947 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3ad750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc974099870 tx=0x7fc974010bd0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.979+0000 7fc995fbbb80 1 -- 172.21.15.70:0/1750494947 shutdown_connections 2023-10-08T08:48:06.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.979+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/1750494947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a3c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.979+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/1750494947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3bc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.979+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/1750494947 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3ad750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.979+0000 7fc995fbbb80 1 -- 172.21.15.70:0/1750494947 >> 172.21.15.70:0/1750494947 conn(0x55ce8a31f260 msgr2=0x55ce8a3a54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:06.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.982+0000 7fc995fbbb80 1 -- 172.21.15.70:0/1750494947 shutdown_connections 2023-10-08T08:48:06.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.982+0000 7fc995fbbb80 1 -- 172.21.15.70:0/1750494947 wait complete. 2023-10-08T08:48:06.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.982+0000 7fc995fbbb80 1 -- start start 2023-10-08T08:48:06.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.983+0000 7fc995fbbb80 1 Processor -- start 2023-10-08T08:48:06.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.983+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3bb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.983+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3bb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.983+0000 7fc995fbbb80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a418fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:06.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.983+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a3bbf90 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.983+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a4194e0 con 0x55ce8a3b5650 2023-10-08T08:48:06.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.983+0000 7fc995fbbb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8a419620 con 0x55ce8a3a9e80 2023-10-08T08:48:06.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.983+0000 7fc995fbbb80 10 client.0 _ll_register_callbacks cb 0x7fc97800ebe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T08:48:06.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.984+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3bb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.984+0000 7fc982ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3bb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53578/0 (socket says 172.21.15.70:53578) 2023-10-08T08:48:06.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.984+0000 7fc982ffd700 1 -- 172.21.15.70:0/2495154054 learned_addr learned my addr 172.21.15.70:0/2495154054 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:48:06.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.987+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3bb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.987+0000 7fc983fff700 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a418fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:06.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.988+0000 7fc982ffd700 1 -- 172.21.15.70:0/2495154054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3a9e80 msgr2=0x55ce8a3bb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.988+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3bb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.988+0000 7fc982ffd700 1 -- 172.21.15.70:0/2495154054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 msgr2=0x55ce8a418fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T08:48:06.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.988+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a418fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:06.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.988+0000 7fc982ffd700 1 -- 172.21.15.70:0/2495154054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc984116150 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.992+0000 7fc982ffd700 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3bb6b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc97400bc40 tx=0x7fc9740997e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549f1afbe0ce1e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:48:06.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.992+0000 7fc962ffd700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-10-08T08:48:06.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.993+0000 7fc962ffd700 1 -- 172.21.15.70:0/2495154054 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9740b90b0 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.993+0000 7fc962ffd700 1 -- 172.21.15.70:0/2495154054 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc9740b9210 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.994+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2495154054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc97c003c00 con 0x55ce8a3aa7a0 2023-10-08T08:48:06.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:06.994+0000 7fc962ffd700 1 -- 172.21.15.70:0/2495154054 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc974098dd0 con 0x55ce8a3aa7a0 2023-10-08T08:48:07.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.001+0000 7fc995fbbb80 10 client.16767 fetch_fsmap learned FSMap version 47 2023-10-08T08:48:07.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.001+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2495154054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55ce8a1272b0 con 0x55ce8a3aa7a0 2023-10-08T08:48:07.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.001+0000 7fc962ffd700 1 -- 172.21.15.70:0/2495154054 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc97c003c00 con 0x55ce8a3aa7a0 2023-10-08T08:48:07.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.002+0000 7fc962ffd700 1 -- 172.21.15.70:0/2495154054 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fc9740a17e0 con 0x55ce8a3aa7a0 2023-10-08T08:48:07.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.002+0000 7fc995fbbb80 10 client.16767 fetch_fsmap finished waiting for FSMap version 47 2023-10-08T08:48:07.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.002+0000 7fc995fbbb80 10 client.16767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T08:48:07.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.002+0000 7fc995fbbb80 20 client.16767 populate_metadata read hostname 'smithi070' 2023-10-08T08:48:07.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.002+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ce8a41aa80 0x55ce8a41cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:48:07.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.002+0000 7fc995fbbb80 4 client.16767 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T08:48:07.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.002+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2495154054 --> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ce8a2f6b30 con 0x55ce8a41aa80 2023-10-08T08:48:07.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.008+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ce8a41aa80 0x55ce8a41cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:48:07.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.008+0000 7fc962ffd700 10 client.16767 ms_handle_connect on v2:172.21.15.105:6838/586756410 2023-10-08T08:48:07.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.008+0000 7fc9837fe700 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ce8a41aa80 0x55ce8a41cea0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d6e28e180c3e795 server_cookie=4195a0258634c536 in_seq=0 out_seq=0 2023-10-08T08:48:07.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc962ffd700 1 -- 172.21.15.70:0/2495154054 <== mds.0 v2:172.21.15.105:6838/586756410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ce8a2f6b30 con 0x55ce8a41aa80 2023-10-08T08:48:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc962ffd700 10 client.16767 handle_command_reply: tid=0 2023-10-08T08:48:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc995fbbb80 1 client.16767 shutdown 2023-10-08T08:48:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2495154054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 msgr2=0x55ce8a3bb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:07.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3bb6b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc97400bc40 tx=0x7fc9740997e0 comp rx=0 tx=0).stop 2023-10-08T08:48:07.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2495154054 shutdown_connections 2023-10-08T08:48:07.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.105:6838/586756410,v1:172.21.15.105:6839/586756410] conn(0x55ce8a41aa80 0x55ce8a41cea0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:07.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ce8a3b5650 0x55ce8a418fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:07.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ce8a3a9e80 0x55ce8a3bb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:07.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc995fbbb80 1 --2- 172.21.15.70:0/2495154054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ce8a3aa7a0 0x55ce8a3bb6b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:07.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2495154054 >> 172.21.15.70:0/2495154054 conn(0x55ce8a31f260 msgr2=0x55ce8a3ad750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:07.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.009+0000 7fc962ffd700 0 client.16767 ms_handle_reset on v2:172.21.15.105:6838/586756410 2023-10-08T08:48:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.012+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2495154054 shutdown_connections 2023-10-08T08:48:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.012+0000 7fc995fbbb80 1 -- 172.21.15.70:0/2495154054 wait complete. 2023-10-08T08:48:07.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.012+0000 7fc995fbbb80 20 client.16767 trim_cache size 0 max 16384 2023-10-08T08:48:07.015 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2023-10-08T08:48:07.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.013+0000 7fc989dd2700 1 -- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc96c0a1740 msgr2=0x7fc96c0a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:07.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.013+0000 7fc989dd2700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc96c0a1740 0x7fc96c0a3c00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc978005fd0 tx=0x7fc978009310 comp rx=0 tx=0).stop 2023-10-08T08:48:07.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.013+0000 7fc989dd2700 1 -- 172.21.15.70:0/2698115962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc98410ef80 msgr2=0x7fc9841188d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:48:07.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.013+0000 7fc989dd2700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc98410ef80 0x7fc9841188d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc97400b530 tx=0x7fc97400b840 comp rx=0 tx=0).stop 2023-10-08T08:48:07.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.015+0000 7fc989dd2700 1 -- 172.21.15.70:0/2698115962 shutdown_connections 2023-10-08T08:48:07.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.015+0000 7fc989dd2700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc96c0a1740 0x7fc96c0a3c00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:07.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.015+0000 7fc989dd2700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc984119fd0 0x7fc984111430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:07.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.015+0000 7fc989dd2700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc984107d30 0x7fc984118390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:07.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.015+0000 7fc989dd2700 1 --2- 172.21.15.70:0/2698115962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc98410ef80 0x7fc9841188d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:48:07.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.015+0000 7fc989dd2700 1 -- 172.21.15.70:0/2698115962 >> 172.21.15.70:0/2698115962 conn(0x7fc98406b830 msgr2=0x7fc98406f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:48:07.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.015+0000 7fc989dd2700 1 -- 172.21.15.70:0/2698115962 shutdown_connections 2023-10-08T08:48:07.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:48:07.015+0000 7fc989dd2700 1 -- 172.21.15.70:0/2698115962 wait complete. 2023-10-08T08:48:07.038 ERROR:tasks.fwd_scrub:rank 4 damaged: [{'damage_type': 'backtrace', 'id': 19797910, 'ino': 1099511638411, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit01.c'}, {'damage_type': 'backtrace', 'id': 65277391, 'ino': 1099511638418, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link07.c'}, {'damage_type': 'backtrace', 'id': 78472703, 'ino': 1099511638409, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/getrlimit02.c'}, {'damage_type': 'backtrace', 'id': 79387465, 'ino': 1099511638511, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill02.c'}, {'damage_type': 'backtrace', 'id': 79909693, 'ino': 1099511637985, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.2'}, {'damage_type': 'backtrace', 'id': 127476905, 'ino': 1099511638561, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/Makefile'}, {'damage_type': 'backtrace', 'id': 221161233, 'ino': 1099511638143, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority03.c'}, {'damage_type': 'backtrace', 'id': 230953438, 'ino': 1099511637969, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/vmsplice01.c'}, {'damage_type': 'backtrace', 'id': 254832479, 'ino': 1099511637995, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/dbllist.h'}, {'damage_type': 'backtrace', 'id': 262362224, 'ino': 1099511638549, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/Makefile'}, {'damage_type': 'backtrace', 'id': 293265870, 'ino': 1099511638034, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/readlinkat01.c'}, {'damage_type': 'backtrace', 'id': 294528804, 'ino': 1099511638533, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/Makefile'}, {'damage_type': 'backtrace', 'id': 334433423, 'ino': 1099511637983, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.ps'}, {'damage_type': 'backtrace', 'id': 334914005, 'ino': 1099511638056, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/Makefile'}, {'damage_type': 'backtrace', 'id': 338482076, 'ino': 1099511637825, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe10.c'}, {'damage_type': 'backtrace', 'id': 342197633, 'ino': 1099511638596, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock03.c'}, {'damage_type': 'backtrace', 'id': 349642966, 'ino': 1099511638423, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link02.c'}, {'damage_type': 'backtrace', 'id': 355318562, 'ino': 1099511637817, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe'}, {'damage_type': 'backtrace', 'id': 357689223, 'ino': 1099511637821, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/Makefile'}, {'damage_type': 'backtrace', 'id': 370859455, 'ino': 1099511638142, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority02.c'}, {'damage_type': 'backtrace', 'id': 382464723, 'ino': 1099511637990, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/epoll-test.c'}, {'damage_type': 'backtrace', 'id': 387747367, 'ino': 1099511638476, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat'}, {'damage_type': 'backtrace', 'id': 388226816, 'ino': 1099511638601, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid'}, {'damage_type': 'backtrace', 'id': 389630851, 'ino': 1099511638393, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon03.c'}, {'damage_type': 'backtrace', 'id': 392056223, 'ino': 1099511638466, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill09.c'}, {'damage_type': 'backtrace', 'id': 414274383, 'ino': 1099511637977, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.ps'}, {'damage_type': 'backtrace', 'id': 416087574, 'ino': 1099511638408, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit'}, {'damage_type': 'backtrace', 'id': 425499439, 'ino': 1099511638033, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat'}, {'damage_type': 'backtrace', 'id': 431549233, 'ino': 1099511638553, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/Makefile'}, {'damage_type': 'backtrace', 'id': 468242630, 'ino': 1099511638145, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname01.c'}, {'damage_type': 'backtrace', 'id': 490691246, 'ino': 1099511638487, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.c'}, {'damage_type': 'backtrace', 'id': 517365430, 'ino': 1099511637810, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset'}, {'damage_type': 'backtrace', 'id': 526645082, 'ino': 1099511638460, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill01.c'}, {'damage_type': 'backtrace', 'id': 527420216, 'ino': 1099511638410, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getrlimit/Makefile'}, {'damage_type': 'backtrace', 'id': 534824547, 'ino': 1099511637889, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open05.c'}, {'damage_type': 'backtrace', 'id': 539939939, 'ino': 1099511638535, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/test3.c'}, {'damage_type': 'backtrace', 'id': 566302711, 'ino': 1099511637959, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir03.c'}, {'damage_type': 'backtrace', 'id': 597313182, 'ino': 1099511638467, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill04.c'}, {'damage_type': 'backtrace', 'id': 609608118, 'ino': 1099511638554, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee/tee01.c'}, {'damage_type': 'backtrace', 'id': 610127454, 'ino': 1099511637813, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset01.c'}, {'damage_type': 'backtrace', 'id': 613106392, 'ino': 1099511638005, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil'}, {'damage_type': 'backtrace', 'id': 617194101, 'ino': 1099511638347, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/Makefile'}, {'damage_type': 'backtrace', 'id': 626189175, 'ino': 1099511638396, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon02.c'}, {'damage_type': 'backtrace', 'id': 644832548, 'ino': 1099511637981, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.txt'}, {'damage_type': 'backtrace', 'id': 654284183, 'ino': 1099511638447, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/Makefile'}, {'damage_type': 'backtrace', 'id': 661724413, 'ino': 1099511638022, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack02.c'}, {'damage_type': 'backtrace', 'id': 692733342, 'ino': 1099511637925, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.mode.sh'}, {'damage_type': 'backtrace', 'id': 707439218, 'ino': 1099511638548, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread01.c'}, {'damage_type': 'backtrace', 'id': 714338236, 'ino': 1099511638035, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readlinkat/Makefile'}, {'damage_type': 'backtrace', 'id': 808967602, 'ino': 1099511637989, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples/Makefile'}, {'damage_type': 'backtrace', 'id': 876265945, 'ino': 1099511637988, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/examples'}, {'damage_type': 'backtrace', 'id': 891299397, 'ino': 1099511637890, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/Makefile'}, {'damage_type': 'backtrace', 'id': 895302624, 'ino': 1099511637766, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/Makefile'}, {'damage_type': 'backtrace', 'id': 933546927, 'ino': 1099511638509, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/Makefile'}, {'damage_type': 'backtrace', 'id': 941060747, 'ino': 1099511637987, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.ps'}, {'damage_type': 'backtrace', 'id': 945137632, 'ino': 1099511637891, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open09.c'}, {'damage_type': 'backtrace', 'id': 948642974, 'ino': 1099511638058, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare'}, {'damage_type': 'backtrace', 'id': 978127030, 'ino': 1099511638055, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk'}, {'damage_type': 'backtrace', 'id': 1005394132, 'ino': 1099511638510, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill/tkill01.c'}, {'damage_type': 'backtrace', 'id': 1031507229, 'ino': 1099511638148, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname03.c'}, {'damage_type': 'backtrace', 'id': 1038180888, 'ino': 1099511637927, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod04.c'}, {'damage_type': 'backtrace', 'id': 1060850741, 'ino': 1099511638531, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve04.c'}, {'damage_type': 'backtrace', 'id': 1067179093, 'ino': 1099511637895, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open07.c'}, {'damage_type': 'backtrace', 'id': 1082412642, 'ino': 1099511638044, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall02.c'}, {'damage_type': 'backtrace', 'id': 1166458045, 'ino': 1099511637971, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/Makefile'}, {'damage_type': 'backtrace', 'id': 1178111749, 'ino': 1099511638519, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat05.c'}, {'damage_type': 'backtrace', 'id': 1190027895, 'ino': 1099511637942, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl01.c'}, {'damage_type': 'backtrace', 'id': 1193954843, 'ino': 1099511638448, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir02.c'}, {'damage_type': 'backtrace', 'id': 1218497484, 'ino': 1099511638602, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid02.c'}, {'damage_type': 'backtrace', 'id': 1223569616, 'ino': 1099511638565, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm02.c'}, {'damage_type': 'backtrace', 'id': 1239931486, 'ino': 1099511637893, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open02.c'}, {'damage_type': 'backtrace', 'id': 1245825892, 'ino': 1099511637992, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src/epoll.c'}, {'damage_type': 'backtrace', 'id': 1257215805, 'ino': 1099511637938, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/Makefile'}, {'damage_type': 'backtrace', 'id': 1267797396, 'ino': 1099511637888, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open04.c'}, {'damage_type': 'backtrace', 'id': 1270380870, 'ino': 1099511638338, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/mem03.c'}, {'damage_type': 'backtrace', 'id': 1270421558, 'ino': 1099511637855, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area01.c'}, {'damage_type': 'backtrace', 'id': 1294910646, 'ino': 1099511638517, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat04.c'}, {'damage_type': 'backtrace', 'id': 1304330189, 'ino': 1099511638163, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/Makefile'}, {'damage_type': 'backtrace', 'id': 1317228798, 'ino': 1099511638562, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm07.c'}, {'damage_type': 'backtrace', 'id': 1342964399, 'ino': 1099511638484, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/Makefile'}, {'damage_type': 'backtrace', 'id': 1347304143, 'ino': 1099511637824, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe06.c'}, {'damage_type': 'backtrace', 'id': 1348916396, 'ino': 1099511637887, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open06.c'}, {'damage_type': 'backtrace', 'id': 1363010076, 'ino': 1099511638060, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare01.c'}, {'damage_type': 'backtrace', 'id': 1468730236, 'ino': 1099511637894, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open08.c'}, {'damage_type': 'backtrace', 'id': 1492635274, 'ino': 1099511637986, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_ctl.txt'}, {'damage_type': 'backtrace', 'id': 1500960736, 'ino': 1099511638566, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm05.c'}, {'damage_type': 'backtrace', 'id': 1503783714, 'ino': 1099511637919, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod06.c'}, {'damage_type': 'backtrace', 'id': 1528448491, 'ino': 1099511638532, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve03.c'}, {'damage_type': 'backtrace', 'id': 1533629303, 'ino': 1099511637937, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl'}, {'damage_type': 'backtrace', 'id': 1539345233, 'ino': 1099511637921, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod07.c'}, {'damage_type': 'backtrace', 'id': 1558790450, 'ino': 1099511637811, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/capset02.c'}, {'damage_type': 'backtrace', 'id': 1559939164, 'ino': 1099511638007, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/Makefile'}, {'damage_type': 'backtrace', 'id': 1577723771, 'ino': 1099511637829, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe07.c'}, {'damage_type': 'backtrace', 'id': 1602846453, 'ino': 1099511637976, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll.4'}, {'damage_type': 'backtrace', 'id': 1634104225, 'ino': 1099511637926, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/change_owner.c'}, {'damage_type': 'backtrace', 'id': 1636957047, 'ino': 1099511638463, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill12.c'}, {'damage_type': 'backtrace', 'id': 1658592558, 'ino': 1099511638147, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/Makefile'}, {'damage_type': 'backtrace', 'id': 1669902000, 'ino': 1099511637827, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe05.c'}, {'damage_type': 'backtrace', 'id': 1670886528, 'ino': 1099511638340, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/Makefile'}, {'damage_type': 'backtrace', 'id': 1681049866, 'ino': 1099511637918, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod'}, {'damage_type': 'backtrace', 'id': 1706820918, 'ino': 1099511638515, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat'}, {'damage_type': 'backtrace', 'id': 1712519394, 'ino': 1099511638424, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link06.c'}, {'damage_type': 'backtrace', 'id': 1727385557, 'ino': 1099511638560, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm01.c'}, {'damage_type': 'backtrace', 'id': 1732926935, 'ino': 1099511637958, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir01.c'}, {'damage_type': 'backtrace', 'id': 1755764008, 'ino': 1099511638459, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill11.c'}, {'damage_type': 'backtrace', 'id': 1785774361, 'ino': 1099511637920, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod01.c'}, {'damage_type': 'backtrace', 'id': 1789435425, 'ino': 1099511638611, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat'}, {'damage_type': 'backtrace', 'id': 1796170649, 'ino': 1099511638612, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/linkat01.c'}, {'damage_type': 'backtrace', 'id': 1799047014, 'ino': 1099511637980, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.2'}, {'damage_type': 'backtrace', 'id': 1805884944, 'ino': 1099511638591, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock04.c'}, {'damage_type': 'backtrace', 'id': 1873874254, 'ino': 1099511637957, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/Makefile'}, {'damage_type': 'backtrace', 'id': 1898772272, 'ino': 1099511638043, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall01.c'}, {'damage_type': 'backtrace', 'id': 1908329557, 'ino': 1099511638593, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/Makefile'}, {'damage_type': 'backtrace', 'id': 1948034300, 'ino': 1099511638434, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy'}, {'damage_type': 'backtrace', 'id': 1962313420, 'ino': 1099511637993, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include'}, {'damage_type': 'backtrace', 'id': 1967350989, 'ino': 1099511637812, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/capset/Makefile'}, {'damage_type': 'backtrace', 'id': 1979677028, 'ino': 1099511638346, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect'}, {'damage_type': 'backtrace', 'id': 1993805256, 'ino': 1099511638536, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve05.c'}, {'damage_type': 'backtrace', 'id': 2026860323, 'ino': 1099511638482, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate'}, {'damage_type': 'backtrace', 'id': 2042826390, 'ino': 1099511638024, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/Makefile'}, {'damage_type': 'backtrace', 'id': 2050770159, 'ino': 1099511638613, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/linkat/Makefile'}, {'damage_type': 'backtrace', 'id': 2110657308, 'ino': 1099511638478, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/unlinkat01.c'}, {'damage_type': 'backtrace', 'id': 2112885998, 'ino': 1099511637970, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg'}, {'damage_type': 'backtrace', 'id': 2132462353, 'ino': 1099511637854, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area'}, {'damage_type': 'backtrace', 'id': 2196435056, 'ino': 1099511638551, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread03.c'}, {'damage_type': 'backtrace', 'id': 2216391534, 'ino': 1099511638449, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir/readdir01.c'}, {'damage_type': 'backtrace', 'id': 2217406023, 'ino': 1099511638336, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap'}, {'damage_type': 'backtrace', 'id': 2222454202, 'ino': 1099511638605, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid01.c'}, {'damage_type': 'backtrace', 'id': 2266163252, 'ino': 1099511637885, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open'}, {'damage_type': 'backtrace', 'id': 2271784172, 'ino': 1099511637822, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe01.c'}, {'damage_type': 'backtrace', 'id': 2292783346, 'ino': 1099511638348, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/connect/connect01.c'}, {'damage_type': 'backtrace', 'id': 2294452777, 'ino': 1099511638520, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat03.c'}, {'damage_type': 'backtrace', 'id': 2309895838, 'ino': 1099511638061, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/unshare02.c'}, {'damage_type': 'backtrace', 'id': 2313218725, 'ino': 1099511638592, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock02.c'}, {'damage_type': 'backtrace', 'id': 2379368252, 'ino': 1099511638337, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memmap/Makefile'}, {'damage_type': 'backtrace', 'id': 2417246078, 'ino': 1099511637922, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod03.c'}, {'damage_type': 'backtrace', 'id': 2428154863, 'ino': 1099511638421, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link03.c'}, {'damage_type': 'backtrace', 'id': 2458985420, 'ino': 1099511637973, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2'}, {'damage_type': 'backtrace', 'id': 2470578654, 'ino': 1099511638139, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/Makefile'}, {'damage_type': 'backtrace', 'id': 2475440283, 'ino': 1099511638534, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve01.c'}, {'damage_type': 'backtrace', 'id': 2489542825, 'ino': 1099511638603, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/Makefile'}, {'damage_type': 'backtrace', 'id': 2509259874, 'ino': 1099511637826, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe03.c'}, {'damage_type': 'backtrace', 'id': 2523624437, 'ino': 1099511637956, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir/fchdir02.c'}, {'damage_type': 'backtrace', 'id': 2539308219, 'ino': 1099511638530, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve'}, {'damage_type': 'backtrace', 'id': 2541681315, 'ino': 1099511638518, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/Makefile'}, {'damage_type': 'backtrace', 'id': 2584268235, 'ino': 1099511638339, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string'}, {'damage_type': 'backtrace', 'id': 2600964390, 'ino': 1099511638341, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/string/string01.c'}, {'damage_type': 'backtrace', 'id': 2688805915, 'ino': 1099511637823, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe04.c'}, {'damage_type': 'backtrace', 'id': 2713439621, 'ino': 1099511638559, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm'}, {'damage_type': 'backtrace', 'id': 2724095610, 'ino': 1099511637941, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl05.c'}, {'damage_type': 'backtrace', 'id': 2725338562, 'ino': 1099511638563, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm03.c'}, {'damage_type': 'backtrace', 'id': 2726116410, 'ino': 1099511638508, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tkill'}, {'damage_type': 'backtrace', 'id': 2742995953, 'ino': 1099511637974, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man'}, {'damage_type': 'backtrace', 'id': 2768866187, 'ino': 1099511638144, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname'}, {'damage_type': 'backtrace', 'id': 2769654055, 'ino': 1099511638486, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate02.c'}, {'damage_type': 'backtrace', 'id': 2775144272, 'ino': 1099511637975, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.ps'}, {'damage_type': 'backtrace', 'id': 2805351133, 'ino': 1099511638597, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock06.c'}, {'damage_type': 'backtrace', 'id': 2806817748, 'ino': 1099511637928, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod05.c'}, {'damage_type': 'backtrace', 'id': 2839490051, 'ino': 1099511637858, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area02.c'}, {'damage_type': 'backtrace', 'id': 2877344597, 'ino': 1099511638465, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill05.c'}, {'damage_type': 'backtrace', 'id': 2885637284, 'ino': 1099511638137, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority'}, {'damage_type': 'backtrace', 'id': 2897849494, 'ino': 1099511637819, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe02.c'}, {'damage_type': 'backtrace', 'id': 2900263414, 'ino': 1099511637984, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/mkpages.sh'}, {'damage_type': 'backtrace', 'id': 2903927584, 'ino': 1099511637886, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open10.c'}, {'damage_type': 'backtrace', 'id': 2905480293, 'ino': 1099511638590, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock'}, {'damage_type': 'backtrace', 'id': 2926182769, 'ino': 1099511637853, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/Makefile'}, {'damage_type': 'backtrace', 'id': 2936910518, 'ino': 1099511637828, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe08.c'}, {'damage_type': 'backtrace', 'id': 2961995874, 'ino': 1099511638458, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill03.c'}, {'damage_type': 'backtrace', 'id': 2976961250, 'ino': 1099511637892, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open01.c'}, {'damage_type': 'backtrace', 'id': 3006385283, 'ino': 1099511637978, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.txt'}, {'damage_type': 'backtrace', 'id': 3006436601, 'ino': 1099511637852, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse/sigrelse01.c'}, {'damage_type': 'backtrace', 'id': 3010767021, 'ino': 1099511638006, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/profil/profil01.c'}, {'damage_type': 'backtrace', 'id': 3014577430, 'ino': 1099511637857, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/Makefile'}, {'damage_type': 'backtrace', 'id': 3059914655, 'ino': 1099511637968, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice/Makefile'}, {'damage_type': 'backtrace', 'id': 3061937219, 'ino': 1099511638547, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread'}, {'damage_type': 'backtrace', 'id': 3064563419, 'ino': 1099511637955, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fchdir'}, {'damage_type': 'backtrace', 'id': 3068052337, 'ino': 1099511638419, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/Makefile'}, {'damage_type': 'backtrace', 'id': 3144812333, 'ino': 1099511638395, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/swapon01.c'}, {'damage_type': 'backtrace', 'id': 3150221722, 'ino': 1099511637896, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/open/open03.c'}, {'damage_type': 'backtrace', 'id': 3185912139, 'ino': 1099511638477, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unlinkat/Makefile'}, {'damage_type': 'backtrace', 'id': 3216617303, 'ino': 1099511637967, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/vmsplice'}, {'damage_type': 'backtrace', 'id': 3224786071, 'ino': 1099511638435, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/memcpy01.c'}, {'damage_type': 'backtrace', 'id': 3225997678, 'ino': 1099511638456, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill08.c'}, {'damage_type': 'backtrace', 'id': 3257028617, 'ino': 1099511638446, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/readdir'}, {'damage_type': 'backtrace', 'id': 3257177218, 'ino': 1099511638468, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill10.c'}, {'damage_type': 'backtrace', 'id': 3262014914, 'ino': 1099511638422, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link04.c'}, {'damage_type': 'backtrace', 'id': 3285902668, 'ino': 1099511638040, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall03.c'}, {'damage_type': 'backtrace', 'id': 3291494845, 'ino': 1099511638457, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill02.c'}, {'damage_type': 'backtrace', 'id': 3291567405, 'ino': 1099511638455, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill'}, {'damage_type': 'backtrace', 'id': 3301422870, 'ino': 1099511638604, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresuid/getresuid03.c'}, {'damage_type': 'backtrace', 'id': 3337657485, 'ino': 1099511638141, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority01.c'}, {'damage_type': 'backtrace', 'id': 3341375713, 'ino': 1099511638161, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset'}, {'damage_type': 'backtrace', 'id': 3345920622, 'ino': 1099511638516, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat01.c'}, {'damage_type': 'backtrace', 'id': 3349342936, 'ino': 1099511638420, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link/link05.c'}, {'damage_type': 'backtrace', 'id': 3392008142, 'ino': 1099511638483, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate01.c'}, {'damage_type': 'backtrace', 'id': 3398430964, 'ino': 1099511638595, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock01.c'}, {'damage_type': 'backtrace', 'id': 3438696223, 'ino': 1099511637851, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigrelse'}, {'damage_type': 'backtrace', 'id': 3441841515, 'ino': 1099511638039, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall'}, {'damage_type': 'backtrace', 'id': 3492319003, 'ino': 1099511637991, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/src'}, {'damage_type': 'backtrace', 'id': 3498338414, 'ino': 1099511638059, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/unshare/Makefile'}, {'damage_type': 'backtrace', 'id': 3508438762, 'ino': 1099511638140, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority05.c'}, {'damage_type': 'backtrace', 'id': 3542989199, 'ino': 1099511637923, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/Makefile'}, {'damage_type': 'backtrace', 'id': 3584263914, 'ino': 1099511637764, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat'}, {'damage_type': 'backtrace', 'id': 3588973334, 'ino': 1099511638394, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon/Makefile'}, {'damage_type': 'backtrace', 'id': 3615162683, 'ino': 1099511637939, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl03.c'}, {'damage_type': 'backtrace', 'id': 3674862735, 'ino': 1099511637924, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/chmod/chmod02.c'}, {'damage_type': 'backtrace', 'id': 3683444854, 'ino': 1099511638162, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memset/memset01.c'}, {'damage_type': 'backtrace', 'id': 3712685252, 'ino': 1099511638023, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack/sigaltstack01.c'}, {'damage_type': 'backtrace', 'id': 3717325043, 'ino': 1099511638488, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate04.sh'}, {'damage_type': 'backtrace', 'id': 3721430436, 'ino': 1099511637972, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fmtmsg/fmtmsg01.c'}, {'damage_type': 'backtrace', 'id': 3748275308, 'ino': 1099511637765, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mkdirat/mkdirat01.c'}, {'damage_type': 'backtrace', 'id': 3766886340, 'ino': 1099511638564, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/alarm/alarm06.c'}, {'damage_type': 'backtrace', 'id': 3781983862, 'ino': 1099511638057, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sbrk/sbrk01.c'}, {'damage_type': 'backtrace', 'id': 3792966465, 'ino': 1099511637994, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/include/epoll.h'}, {'damage_type': 'backtrace', 'id': 3798511408, 'ino': 1099511638550, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pread/pread02.c'}, {'damage_type': 'backtrace', 'id': 3807882831, 'ino': 1099511637979, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_wait.txt'}, {'damage_type': 'backtrace', 'id': 3812204814, 'ino': 1099511637818, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe11.c'}, {'damage_type': 'backtrace', 'id': 3823540584, 'ino': 1099511638521, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/fstat/fstat02.c'}, {'damage_type': 'backtrace', 'id': 3854273367, 'ino': 1099511638462, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill06.c'}, {'damage_type': 'backtrace', 'id': 3869558356, 'ino': 1099511638461, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/Makefile'}, {'damage_type': 'backtrace', 'id': 3874271732, 'ino': 1099511638552, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/tee'}, {'damage_type': 'backtrace', 'id': 3878445166, 'ino': 1099511638021, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigaltstack'}, {'damage_type': 'backtrace', 'id': 3899592624, 'ino': 1099511637940, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sysctl/sysctl04.c'}, {'damage_type': 'backtrace', 'id': 3908002174, 'ino': 1099511638485, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/ftruncate/ftruncate03.c'}, {'damage_type': 'backtrace', 'id': 3933448776, 'ino': 1099511638392, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/swapon'}, {'damage_type': 'backtrace', 'id': 3959866192, 'ino': 1099511638436, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/memcpy/Makefile'}, {'damage_type': 'backtrace', 'id': 3977792603, 'ino': 1099511637856, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/set_thread_area/set_thread_area.h'}, {'damage_type': 'backtrace', 'id': 3992192251, 'ino': 1099511638464, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/kill/kill07.c'}, {'damage_type': 'backtrace', 'id': 4002092889, 'ino': 1099511638417, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/link'}, {'damage_type': 'backtrace', 'id': 4017359941, 'ino': 1099511638594, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/flock/flock05.c'}, {'damage_type': 'backtrace', 'id': 4024611317, 'ino': 1099511637982, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll2/man/epoll_create.2'}, {'damage_type': 'backtrace', 'id': 4113891343, 'ino': 1099511638138, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setpriority/setpriority04.c'}, {'damage_type': 'backtrace', 'id': 4119772644, 'ino': 1099511638042, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/Makefile'}, {'damage_type': 'backtrace', 'id': 4190329852, 'ino': 1099511638537, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/execve/execve02.c'}, {'damage_type': 'backtrace', 'id': 4220740798, 'ino': 1099511637820, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pipe/pipe09.c'}, {'damage_type': 'backtrace', 'id': 4247705934, 'ino': 1099511638041, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/socketcall/socketcall04.c'}, {'damage_type': 'backtrace', 'id': 4286542211, 'ino': 1099511638146, 'path': '/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sethostname/sethostname02.c'}] 2023-10-08T08:48:07.038 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-10-08T08:48:07.172 DEBUG:teuthology.parallel:result is None 2023-10-08T08:48:07.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-08T08:48:07.204 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-08T08:48:07.204 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-08T08:48:07.215 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:48:07.252 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-10-08T08:48:07.269 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-10-08T08:48:07.269 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T08:48:07.269 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:48:07.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-10-08T08:48:07.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-10-08T08:48:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:08 smithi070 ceph-mon[99513]: pgmap v422: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 904 KiB/s wr, 304 op/s 2023-10-08T08:48:08.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:08 smithi105 ceph-mon[103798]: pgmap v422: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 904 KiB/s wr, 304 op/s 2023-10-08T08:48:08.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:08 smithi191 ceph-mon[104220]: pgmap v422: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 904 KiB/s wr, 304 op/s 2023-10-08T08:48:10.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:10 smithi070 ceph-mon[99513]: pgmap v423: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 263 op/s 2023-10-08T08:48:10.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:10 smithi105 ceph-mon[103798]: pgmap v423: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 263 op/s 2023-10-08T08:48:10.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:10 smithi191 ceph-mon[104220]: pgmap v423: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 263 op/s 2023-10-08T08:48:12.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:12 smithi070 ceph-mon[99513]: pgmap v424: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 822 KiB/s wr, 265 op/s 2023-10-08T08:48:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:12 smithi105 ceph-mon[103798]: pgmap v424: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 822 KiB/s wr, 265 op/s 2023-10-08T08:48:12.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:12 smithi191 ceph-mon[104220]: pgmap v424: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 822 KiB/s wr, 265 op/s 2023-10-08T08:48:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:14 smithi070 ceph-mon[99513]: pgmap v425: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 720 KiB/s wr, 189 op/s 2023-10-08T08:48:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:14 smithi105 ceph-mon[103798]: pgmap v425: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 720 KiB/s wr, 189 op/s 2023-10-08T08:48:14.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:14 smithi191 ceph-mon[104220]: pgmap v425: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 720 KiB/s wr, 189 op/s 2023-10-08T08:48:15.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:48:15.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:48:15.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:48:15.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:48:15.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:48:15.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:48:15.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:48:15.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:48:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:48:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:48:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:48:15.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:48:16.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:16 smithi070 ceph-mon[99513]: pgmap v426: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 569 KiB/s wr, 155 op/s 2023-10-08T08:48:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:16 smithi105 ceph-mon[103798]: pgmap v426: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 569 KiB/s wr, 155 op/s 2023-10-08T08:48:16.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:16 smithi191 ceph-mon[104220]: pgmap v426: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 569 KiB/s wr, 155 op/s 2023-10-08T08:48:18.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:18 smithi070 ceph-mon[99513]: pgmap v427: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 569 KiB/s wr, 152 op/s 2023-10-08T08:48:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:18 smithi105 ceph-mon[103798]: pgmap v427: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 569 KiB/s wr, 152 op/s 2023-10-08T08:48:18.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:18 smithi191 ceph-mon[104220]: pgmap v427: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 569 KiB/s wr, 152 op/s 2023-10-08T08:48:20.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:20 smithi070 ceph-mon[99513]: pgmap v428: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 463 KiB/s wr, 112 op/s 2023-10-08T08:48:20.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:20 smithi105 ceph-mon[103798]: pgmap v428: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 463 KiB/s wr, 112 op/s 2023-10-08T08:48:20.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:20 smithi191 ceph-mon[104220]: pgmap v428: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 463 KiB/s wr, 112 op/s 2023-10-08T08:48:22.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:22 smithi070 ceph-mon[99513]: pgmap v429: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 33 KiB/s wr, 65 op/s 2023-10-08T08:48:22.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:22 smithi105 ceph-mon[103798]: pgmap v429: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 33 KiB/s wr, 65 op/s 2023-10-08T08:48:22.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:22 smithi191 ceph-mon[104220]: pgmap v429: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 33 KiB/s wr, 65 op/s 2023-10-08T08:48:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:24 smithi070 ceph-mon[99513]: pgmap v430: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 16 op/s 2023-10-08T08:48:24.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:24 smithi105 ceph-mon[103798]: pgmap v430: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 16 op/s 2023-10-08T08:48:24.846 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:24 smithi191 ceph-mon[104220]: pgmap v430: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 16 op/s 2023-10-08T08:48:26.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:26 smithi070 ceph-mon[99513]: pgmap v431: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 13 op/s 2023-10-08T08:48:26.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:26 smithi105 ceph-mon[103798]: pgmap v431: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 13 op/s 2023-10-08T08:48:26.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:26 smithi191 ceph-mon[104220]: pgmap v431: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 13 op/s 2023-10-08T08:48:28.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:28 smithi070 ceph-mon[99513]: pgmap v432: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.4 KiB/s wr, 12 op/s 2023-10-08T08:48:28.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:28 smithi105 ceph-mon[103798]: pgmap v432: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.4 KiB/s wr, 12 op/s 2023-10-08T08:48:28.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:28 smithi191 ceph-mon[104220]: pgmap v432: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.4 KiB/s wr, 12 op/s 2023-10-08T08:48:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:30 smithi070 ceph-mon[99513]: pgmap v433: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2023-10-08T08:48:30.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:30 smithi105 ceph-mon[103798]: pgmap v433: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2023-10-08T08:48:30.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:30 smithi191 ceph-mon[104220]: pgmap v433: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2023-10-08T08:48:32.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:32 smithi070 ceph-mon[99513]: pgmap v434: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-08T08:48:32.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:32 smithi105 ceph-mon[103798]: pgmap v434: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-08T08:48:32.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:32 smithi191 ceph-mon[104220]: pgmap v434: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2023-10-08T08:48:34.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:34 smithi070 ceph-mon[99513]: pgmap v435: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-08T08:48:34.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:34 smithi105 ceph-mon[103798]: pgmap v435: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-08T08:48:34.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:34 smithi191 ceph-mon[104220]: pgmap v435: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-08T08:48:36.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:36 smithi070 ceph-mon[99513]: pgmap v436: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-08T08:48:36.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:36 smithi105 ceph-mon[103798]: pgmap v436: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-08T08:48:36.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:36 smithi191 ceph-mon[104220]: pgmap v436: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-08T08:48:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:38 smithi070 ceph-mon[99513]: pgmap v437: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-10-08T08:48:38.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:38 smithi105 ceph-mon[103798]: pgmap v437: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-10-08T08:48:38.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:38 smithi191 ceph-mon[104220]: pgmap v437: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-10-08T08:48:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:40 smithi070 ceph-mon[99513]: pgmap v438: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-08T08:48:40.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:40 smithi105 ceph-mon[103798]: pgmap v438: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-08T08:48:40.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:40 smithi191 ceph-mon[104220]: pgmap v438: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-08T08:48:42.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:42 smithi070 ceph-mon[99513]: pgmap v439: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:48:42.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:42 smithi105 ceph-mon[103798]: pgmap v439: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:48:42.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:42 smithi191 ceph-mon[104220]: pgmap v439: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:48:44.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:44 smithi070 ceph-mon[99513]: pgmap v440: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:48:44.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:44 smithi105 ceph-mon[103798]: pgmap v440: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:48:44.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:44 smithi191 ceph-mon[104220]: pgmap v440: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:48:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:46 smithi070 ceph-mon[99513]: pgmap v441: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-10-08T08:48:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:46 smithi105 ceph-mon[103798]: pgmap v441: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-10-08T08:48:46.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:46 smithi191 ceph-mon[104220]: pgmap v441: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-10-08T08:48:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:48 smithi070 ceph-mon[99513]: pgmap v442: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:48:48.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:48 smithi105 ceph-mon[103798]: pgmap v442: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:48:48.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:48 smithi191 ceph-mon[104220]: pgmap v442: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:48:50.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:50 smithi070 ceph-mon[99513]: pgmap v443: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2023-10-08T08:48:50.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:50 smithi105 ceph-mon[103798]: pgmap v443: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2023-10-08T08:48:50.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:50 smithi191 ceph-mon[104220]: pgmap v443: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2023-10-08T08:48:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:52 smithi070 ceph-mon[99513]: pgmap v444: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:48:52.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:52 smithi105 ceph-mon[103798]: pgmap v444: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:48:52.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:52 smithi191 ceph-mon[104220]: pgmap v444: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:48:54.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:54 smithi070 ceph-mon[99513]: pgmap v445: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2023-10-08T08:48:54.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:54 smithi105 ceph-mon[103798]: pgmap v445: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2023-10-08T08:48:54.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:54 smithi191 ceph-mon[104220]: pgmap v445: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2023-10-08T08:48:56.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:56 smithi070 ceph-mon[99513]: pgmap v446: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-10-08T08:48:56.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:56 smithi105 ceph-mon[103798]: pgmap v446: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-10-08T08:48:56.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:56 smithi191 ceph-mon[104220]: pgmap v446: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-10-08T08:48:58.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:48:58 smithi070 ceph-mon[99513]: pgmap v447: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:48:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:48:58 smithi105 ceph-mon[103798]: pgmap v447: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:48:58.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:48:58 smithi191 ceph-mon[104220]: pgmap v447: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:00.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:00 smithi070 ceph-mon[99513]: pgmap v448: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:00.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:00 smithi105 ceph-mon[103798]: pgmap v448: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:00.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:00 smithi191 ceph-mon[104220]: pgmap v448: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:02.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:02 smithi105 ceph-mon[103798]: pgmap v449: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T08:49:02.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:02 smithi191 ceph-mon[104220]: pgmap v449: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T08:49:02.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:02 smithi070 ceph-mon[99513]: pgmap v449: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T08:49:04.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:04 smithi105 ceph-mon[103798]: pgmap v450: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-08T08:49:04.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:04 smithi191 ceph-mon[104220]: pgmap v450: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-08T08:49:04.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:04 smithi070 ceph-mon[99513]: pgmap v450: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-08T08:49:06.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:06 smithi105 ceph-mon[103798]: pgmap v451: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-10-08T08:49:06.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:06 smithi191 ceph-mon[104220]: pgmap v451: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-10-08T08:49:06.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:06 smithi070 ceph-mon[99513]: pgmap v451: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-10-08T08:49:08.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:08 smithi105 ceph-mon[103798]: pgmap v452: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-08T08:49:08.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:08 smithi191 ceph-mon[104220]: pgmap v452: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-08T08:49:08.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:08 smithi070 ceph-mon[99513]: pgmap v452: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-08T08:49:10.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:10 smithi105 ceph-mon[103798]: pgmap v453: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-10-08T08:49:10.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:10 smithi191 ceph-mon[104220]: pgmap v453: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-10-08T08:49:10.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:10 smithi070 ceph-mon[99513]: pgmap v453: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-10-08T08:49:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:12 smithi105 ceph-mon[103798]: pgmap v454: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-10-08T08:49:12.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:12 smithi191 ceph-mon[104220]: pgmap v454: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-10-08T08:49:12.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:12 smithi070 ceph-mon[99513]: pgmap v454: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2023-10-08T08:49:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:14 smithi105 ceph-mon[103798]: pgmap v455: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 23 op/s 2023-10-08T08:49:14.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:14 smithi191 ceph-mon[104220]: pgmap v455: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 23 op/s 2023-10-08T08:49:14.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:14 smithi070 ceph-mon[99513]: pgmap v455: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 23 op/s 2023-10-08T08:49:15.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:15 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:49:15.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:15 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:49:15.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:15 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:49:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:16 smithi105 ceph-mon[103798]: pgmap v456: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2023-10-08T08:49:16.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:16 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:49:16.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:49:16.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:49:16.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:49:16.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:16 smithi191 ceph-mon[104220]: pgmap v456: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2023-10-08T08:49:16.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:16 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:49:16.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:49:16.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:49:16.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:49:16.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:16 smithi070 ceph-mon[99513]: pgmap v456: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 22 op/s 2023-10-08T08:49:16.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:16 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:49:16.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:49:16.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:49:16.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:49:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:18 smithi105 ceph-mon[103798]: pgmap v457: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 21 op/s 2023-10-08T08:49:18.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:18 smithi191 ceph-mon[104220]: pgmap v457: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 21 op/s 2023-10-08T08:49:18.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:18 smithi070 ceph-mon[99513]: pgmap v457: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 21 op/s 2023-10-08T08:49:20.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:20 smithi105 ceph-mon[103798]: pgmap v458: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:49:20.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:20 smithi191 ceph-mon[104220]: pgmap v458: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:49:20.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:20 smithi070 ceph-mon[99513]: pgmap v458: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:49:22.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:22 smithi105 ceph-mon[103798]: pgmap v459: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-08T08:49:22.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:22 smithi191 ceph-mon[104220]: pgmap v459: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-08T08:49:22.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:22 smithi070 ceph-mon[99513]: pgmap v459: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-08T08:49:24.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:24 smithi105 ceph-mon[103798]: pgmap v460: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-08T08:49:24.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:24 smithi191 ceph-mon[104220]: pgmap v460: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-08T08:49:24.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:24 smithi070 ceph-mon[99513]: pgmap v460: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 11 op/s 2023-10-08T08:49:26.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:26 smithi105 ceph-mon[103798]: pgmap v461: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:26.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:26 smithi191 ceph-mon[104220]: pgmap v461: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:26.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:26 smithi070 ceph-mon[99513]: pgmap v461: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:28.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:28 smithi105 ceph-mon[103798]: pgmap v462: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:28.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:28 smithi191 ceph-mon[104220]: pgmap v462: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:28.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:28 smithi070 ceph-mon[99513]: pgmap v462: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:30.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:30 smithi105 ceph-mon[103798]: pgmap v463: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:30.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:30 smithi191 ceph-mon[104220]: pgmap v463: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:30.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:30 smithi070 ceph-mon[99513]: pgmap v463: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:32.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:32 smithi105 ceph-mon[103798]: pgmap v464: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:49:32.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:32 smithi191 ceph-mon[104220]: pgmap v464: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:49:32.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:32 smithi070 ceph-mon[99513]: pgmap v464: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:49:34.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:34 smithi191 ceph-mon[104220]: pgmap v465: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:34.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:34 smithi070 ceph-mon[99513]: pgmap v465: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:35.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:34 smithi105 ceph-mon[103798]: pgmap v465: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:36.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:36 smithi191 ceph-mon[104220]: pgmap v466: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:36.973 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:36 smithi070 ceph-mon[99513]: pgmap v466: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:37.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:36 smithi105 ceph-mon[103798]: pgmap v466: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:38.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:38 smithi191 ceph-mon[104220]: pgmap v467: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:38.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:38 smithi070 ceph-mon[99513]: pgmap v467: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:39.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:38 smithi105 ceph-mon[103798]: pgmap v467: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:40.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:40 smithi191 ceph-mon[104220]: pgmap v468: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:40.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:40 smithi070 ceph-mon[99513]: pgmap v468: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:41.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:40 smithi105 ceph-mon[103798]: pgmap v468: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:42.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:42 smithi191 ceph-mon[104220]: pgmap v469: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:49:42.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:42 smithi070 ceph-mon[99513]: pgmap v469: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:49:43.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:42 smithi105 ceph-mon[103798]: pgmap v469: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:49:43.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:43 smithi191 ceph-mon[104220]: pgmap v470: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:43.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:43 smithi070 ceph-mon[99513]: pgmap v470: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:44.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:43 smithi105 ceph-mon[103798]: pgmap v470: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:46.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:46 smithi105 ceph-mon[103798]: pgmap v471: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:46.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:46 smithi191 ceph-mon[104220]: pgmap v471: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:46 smithi070 ceph-mon[99513]: pgmap v471: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:48.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:48 smithi105 ceph-mon[103798]: pgmap v472: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:48.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:48 smithi191 ceph-mon[104220]: pgmap v472: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:48 smithi070 ceph-mon[99513]: pgmap v472: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:50.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:50 smithi105 ceph-mon[103798]: pgmap v473: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:50 smithi191 ceph-mon[104220]: pgmap v473: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:50.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:50 smithi070 ceph-mon[99513]: pgmap v473: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:52.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:52 smithi105 ceph-mon[103798]: pgmap v474: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:49:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:52 smithi191 ceph-mon[104220]: pgmap v474: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:49:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:52 smithi070 ceph-mon[99513]: pgmap v474: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:49:54.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:54 smithi105 ceph-mon[103798]: pgmap v475: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:54.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:54 smithi191 ceph-mon[104220]: pgmap v475: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:54.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:54 smithi070 ceph-mon[99513]: pgmap v475: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:49:56.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:56 smithi105 ceph-mon[103798]: pgmap v476: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:56.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:56 smithi191 ceph-mon[104220]: pgmap v476: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:56.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:56 smithi070 ceph-mon[99513]: pgmap v476: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:49:57.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:57 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:49:57.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:57 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:49:57.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:57 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:49:58.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:49:58 smithi105 ceph-mon[103798]: pgmap v477: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:58.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:49:58 smithi191 ceph-mon[104220]: pgmap v477: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:49:58.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:49:58 smithi070 ceph-mon[99513]: pgmap v477: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:50:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:00 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a[99489]: 2023-10-08T08:49:59.999+0000 7f936d189700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-08T08:50:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:00 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a[99489]: 2023-10-08T08:49:59.999+0000 7f936d189700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-08T08:50:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:00 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a[99489]: 2023-10-08T08:49:59.999+0000 7f936d189700 -1 log_channel(cluster) log [ERR] : mds.f(mds.4): Metadata damage detected 2023-10-08T08:50:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:00 smithi070 ceph-mon[99513]: pgmap v478: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:00 smithi070 ceph-mon[99513]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-08T08:50:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:00 smithi070 ceph-mon[99513]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-08T08:50:00.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:00 smithi070 ceph-mon[99513]: mds.f(mds.4): Metadata damage detected 2023-10-08T08:50:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:00 smithi105 ceph-mon[103798]: pgmap v478: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:00 smithi105 ceph-mon[103798]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-08T08:50:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:00 smithi105 ceph-mon[103798]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-08T08:50:00.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:00 smithi105 ceph-mon[103798]: mds.f(mds.4): Metadata damage detected 2023-10-08T08:50:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:00 smithi191 ceph-mon[104220]: pgmap v478: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:00 smithi191 ceph-mon[104220]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-08T08:50:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:00 smithi191 ceph-mon[104220]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-08T08:50:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:00 smithi191 ceph-mon[104220]: mds.f(mds.4): Metadata damage detected 2023-10-08T08:50:02.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:02 smithi070 ceph-mon[99513]: pgmap v479: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:50:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:02 smithi105 ceph-mon[103798]: pgmap v479: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:50:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:02 smithi191 ceph-mon[104220]: pgmap v479: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-10-08T08:50:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:04 smithi070 ceph-mon[99513]: pgmap v480: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T08:50:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:04 smithi105 ceph-mon[103798]: pgmap v480: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T08:50:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:04 smithi191 ceph-mon[104220]: pgmap v480: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T08:50:06.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:06 smithi070 ceph-mon[99513]: pgmap v481: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T08:50:06.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:06 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:06.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:06 smithi105 ceph-mon[103798]: pgmap v481: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T08:50:06.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:06 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:06 smithi191 ceph-mon[104220]: pgmap v481: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T08:50:06.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:06 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:08.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:08 smithi191 ceph-mon[104220]: pgmap v482: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T08:50:08.345 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:08 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:08.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:08 smithi070 ceph-mon[99513]: pgmap v482: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T08:50:08.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:08 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:08 smithi105 ceph-mon[103798]: pgmap v482: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T08:50:08.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:08 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:10.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:10 smithi070 ceph-mon[99513]: pgmap v483: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-10-08T08:50:10.522 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:10 smithi105 ceph-mon[103798]: pgmap v483: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-10-08T08:50:10.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:10 smithi191 ceph-mon[104220]: pgmap v483: 129 pgs: 129 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-10-08T08:50:11.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:11 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:11.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:11 smithi105 ceph-mon[103798]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T08:50:11.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:11 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:11.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:11 smithi191 ceph-mon[104220]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T08:50:11.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:11 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:11.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:11 smithi070 ceph-mon[99513]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T08:50:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:12 smithi105 ceph-mon[103798]: pgmap v485: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T08:50:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:12 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:12 smithi191 ceph-mon[104220]: pgmap v485: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T08:50:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:12 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:12.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:12 smithi070 ceph-mon[99513]: pgmap v485: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T08:50:12.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:12 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:13.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:13 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:13.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:13 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:13.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:13 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:14.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:14 smithi105 ceph-mon[103798]: pgmap v486: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:50:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:14 smithi191 ceph-mon[104220]: pgmap v486: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:50:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:14 smithi070 ceph-mon[99513]: pgmap v486: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:50:15.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:15 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:15.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:15 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:15.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:15 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:16.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:16 smithi105 ceph-mon[103798]: pgmap v487: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:50:16.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:16 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:50:16.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:16 smithi191 ceph-mon[104220]: pgmap v487: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:50:16.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:16 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:50:16.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:16 smithi070 ceph-mon[99513]: pgmap v487: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:50:16.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:16 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:50:17.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:50:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:50:17.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:50:17.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:50:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:50:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:50:17.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:50:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:50:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:50:18.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:18 smithi070 ceph-mon[99513]: pgmap v488: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:50:18.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:18 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:18 smithi105 ceph-mon[103798]: pgmap v488: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:50:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:18 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:18.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:18 smithi191 ceph-mon[104220]: pgmap v488: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:50:18.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:18 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:19.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:19 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:19.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:19 smithi070 ceph-mon[99513]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T08:50:19.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:19 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:19.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:19 smithi105 ceph-mon[103798]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T08:50:19.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:19 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:19.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:19 smithi191 ceph-mon[104220]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T08:50:20.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:20 smithi070 ceph-mon[99513]: pgmap v489: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:50:20.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:20 smithi105 ceph-mon[103798]: pgmap v489: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:50:20.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:20 smithi191 ceph-mon[104220]: pgmap v489: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:50:22.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:22 smithi070 ceph-mon[99513]: pgmap v491: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:50:22.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:22 smithi105 ceph-mon[103798]: pgmap v491: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:50:22.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:22 smithi191 ceph-mon[104220]: pgmap v491: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:50:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:24 smithi070 ceph-mon[99513]: pgmap v492: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:50:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:24 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:24.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:24 smithi105 ceph-mon[103798]: pgmap v492: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:50:24.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:24 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:24.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:24 smithi191 ceph-mon[104220]: pgmap v492: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:50:24.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:24 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:26.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:26 smithi070 ceph-mon[99513]: pgmap v493: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:50:26.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:26 smithi105 ceph-mon[103798]: pgmap v493: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:50:26.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:26 smithi191 ceph-mon[104220]: pgmap v493: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:50:27.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:27 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:27.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:27 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:27.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:27 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:28.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:28 smithi070 ceph-mon[99513]: pgmap v494: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:50:28.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:28 smithi105 ceph-mon[103798]: pgmap v494: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:50:28.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:28 smithi191 ceph-mon[104220]: pgmap v494: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:50:29.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:29 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:29.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:29 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:29.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:29 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:30.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:30 smithi070 ceph-mon[99513]: pgmap v495: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:50:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:30 smithi105 ceph-mon[103798]: pgmap v495: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:50:30.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:30 smithi191 ceph-mon[104220]: pgmap v495: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:50:32.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:32 smithi070 ceph-mon[99513]: pgmap v496: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:50:32.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:32 smithi105 ceph-mon[103798]: pgmap v496: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:50:32.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:32 smithi191 ceph-mon[104220]: pgmap v496: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:50:33.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:33 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:33.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:33 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:33.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:33 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:34.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:34 smithi070 ceph-mon[99513]: pgmap v497: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:34.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:34 smithi105 ceph-mon[103798]: pgmap v497: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:34.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:34 smithi191 ceph-mon[104220]: pgmap v497: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:36.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:36 smithi070 ceph-mon[99513]: pgmap v498: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:50:36.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:36 smithi105 ceph-mon[103798]: pgmap v498: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:50:36.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:36 smithi191 ceph-mon[104220]: pgmap v498: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:50:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:38 smithi070 ceph-mon[99513]: pgmap v499: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:50:38.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:38 smithi105 ceph-mon[103798]: pgmap v499: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:50:38.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:38 smithi191 ceph-mon[104220]: pgmap v499: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:50:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:40 smithi070 ceph-mon[99513]: pgmap v500: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:40.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:40 smithi070 ceph-mon[99513]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:40.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:40 smithi105 ceph-mon[103798]: pgmap v500: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:40.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:40 smithi105 ceph-mon[103798]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:40.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:40 smithi191 ceph-mon[104220]: pgmap v500: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:40.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:40 smithi191 ceph-mon[104220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T08:50:42.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:42 smithi070 ceph-mon[99513]: pgmap v501: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:50:42.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:42 smithi105 ceph-mon[103798]: pgmap v501: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:50:42.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:42 smithi191 ceph-mon[104220]: pgmap v501: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:50:44.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:44 smithi070 ceph-mon[99513]: pgmap v502: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:44.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:44 smithi105 ceph-mon[103798]: pgmap v502: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:44.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:44 smithi191 ceph-mon[104220]: pgmap v502: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:46 smithi070 ceph-mon[99513]: pgmap v503: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:50:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:46 smithi105 ceph-mon[103798]: pgmap v503: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:50:46.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:46 smithi191 ceph-mon[104220]: pgmap v503: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:50:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:48 smithi070 ceph-mon[99513]: pgmap v504: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:50:48.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:48 smithi105 ceph-mon[103798]: pgmap v504: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:50:48.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:48 smithi191 ceph-mon[104220]: pgmap v504: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:50:50.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:50 smithi070 ceph-mon[99513]: pgmap v505: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:50.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:50 smithi105 ceph-mon[103798]: pgmap v505: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:50 smithi191 ceph-mon[104220]: pgmap v505: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:52.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:52 smithi070 ceph-mon[99513]: pgmap v506: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:50:52.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:52 smithi105 ceph-mon[103798]: pgmap v506: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:50:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:52 smithi191 ceph-mon[104220]: pgmap v506: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:50:54.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:54 smithi070 ceph-mon[99513]: pgmap v507: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:54.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:54 smithi105 ceph-mon[103798]: pgmap v507: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:54.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:54 smithi191 ceph-mon[104220]: pgmap v507: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:50:56.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:56 smithi070 ceph-mon[99513]: pgmap v508: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:50:56.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:56 smithi105 ceph-mon[103798]: pgmap v508: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:50:56.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:56 smithi191 ceph-mon[104220]: pgmap v508: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:50:58.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:50:58 smithi105 ceph-mon[103798]: pgmap v509: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:50:58.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:50:58 smithi191 ceph-mon[104220]: pgmap v509: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:50:58.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:50:58 smithi070 ceph-mon[99513]: pgmap v509: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:00.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:00 smithi070 ceph-mon[99513]: pgmap v510: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:51:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:00 smithi105 ceph-mon[103798]: pgmap v510: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:51:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:00 smithi191 ceph-mon[104220]: pgmap v510: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:51:02.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:02 smithi070 ceph-mon[99513]: pgmap v511: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:51:02.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:02 smithi105 ceph-mon[103798]: pgmap v511: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:51:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:02 smithi191 ceph-mon[104220]: pgmap v511: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T08:51:04.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:04 smithi070 ceph-mon[99513]: pgmap v512: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T08:51:04.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:04 smithi105 ceph-mon[103798]: pgmap v512: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T08:51:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:04 smithi191 ceph-mon[104220]: pgmap v512: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T08:51:06.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:06 smithi105 ceph-mon[103798]: pgmap v513: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T08:51:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:06 smithi191 ceph-mon[104220]: pgmap v513: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T08:51:06.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:06 smithi070 ceph-mon[99513]: pgmap v513: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T08:51:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:08 smithi105 ceph-mon[103798]: pgmap v514: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T08:51:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:08 smithi191 ceph-mon[104220]: pgmap v514: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T08:51:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:08 smithi070 ceph-mon[99513]: pgmap v514: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T08:51:10.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:10 smithi070 ceph-mon[99513]: pgmap v515: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-10-08T08:51:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:10 smithi105 ceph-mon[103798]: pgmap v515: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-10-08T08:51:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:10 smithi191 ceph-mon[104220]: pgmap v515: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-10-08T08:51:11.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:11 smithi105 ceph-mon[103798]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T08:51:11.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:11 smithi191 ceph-mon[104220]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T08:51:11.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:11 smithi070 ceph-mon[99513]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T08:51:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:12 smithi191 ceph-mon[104220]: pgmap v517: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T08:51:12.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:12 smithi070 ceph-mon[99513]: pgmap v517: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T08:51:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:12 smithi105 ceph-mon[103798]: pgmap v517: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T08:51:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:14 smithi191 ceph-mon[104220]: pgmap v518: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:51:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:14 smithi070 ceph-mon[99513]: pgmap v518: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:51:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:14 smithi105 ceph-mon[103798]: pgmap v518: 129 pgs: 12 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 77 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:51:16.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:16 smithi191 ceph-mon[104220]: pgmap v519: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:51:16.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:16 smithi070 ceph-mon[99513]: pgmap v519: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:51:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:16 smithi105 ceph-mon[103798]: pgmap v519: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:51:17.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:51:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:51:17.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:51:17.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:51:17.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:51:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:51:17.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:51:17.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:51:17.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:51:17.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:51:17.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:51:17.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:51:17.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:51:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:18 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi070 to 196.2M 2023-10-08T08:51:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:18 smithi191 ceph-mon[104220]: Unable to set osd_memory_target on smithi070 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T08:51:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:18 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi105 to 196.2M 2023-10-08T08:51:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:18 smithi191 ceph-mon[104220]: Unable to set osd_memory_target on smithi105 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-10-08T08:51:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:18 smithi191 ceph-mon[104220]: pgmap v520: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:51:18.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:18 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi070 to 196.2M 2023-10-08T08:51:18.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:18 smithi070 ceph-mon[99513]: Unable to set osd_memory_target on smithi070 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T08:51:18.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:18 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi105 to 196.2M 2023-10-08T08:51:18.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:18 smithi070 ceph-mon[99513]: Unable to set osd_memory_target on smithi105 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-10-08T08:51:18.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:18 smithi070 ceph-mon[99513]: pgmap v520: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:51:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:18 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi070 to 196.2M 2023-10-08T08:51:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:18 smithi105 ceph-mon[103798]: Unable to set osd_memory_target on smithi070 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T08:51:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:18 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi105 to 196.2M 2023-10-08T08:51:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:18 smithi105 ceph-mon[103798]: Unable to set osd_memory_target on smithi105 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-10-08T08:51:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:18 smithi105 ceph-mon[103798]: pgmap v520: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:51:20.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:20 smithi070 ceph-mon[99513]: pgmap v521: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:51:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:20 smithi105 ceph-mon[103798]: pgmap v521: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:51:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:20 smithi191 ceph-mon[104220]: pgmap v521: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:51:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:22 smithi191 ceph-mon[104220]: pgmap v522: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 186 B/s wr, 11 op/s 2023-10-08T08:51:22.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:22 smithi070 ceph-mon[99513]: pgmap v522: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 186 B/s wr, 11 op/s 2023-10-08T08:51:22.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:22 smithi105 ceph-mon[103798]: pgmap v522: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 186 B/s wr, 11 op/s 2023-10-08T08:51:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:24 smithi191 ceph-mon[104220]: pgmap v523: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:51:24.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:24 smithi191 ceph-mon[104220]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T08:51:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:24 smithi070 ceph-mon[99513]: pgmap v523: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:51:24.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:24 smithi070 ceph-mon[99513]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T08:51:24.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:24 smithi105 ceph-mon[103798]: pgmap v523: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:51:24.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:24 smithi105 ceph-mon[103798]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T08:51:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:26 smithi191 ceph-mon[104220]: pgmap v525: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:51:26.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:26 smithi070 ceph-mon[99513]: pgmap v525: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:51:26.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:26 smithi105 ceph-mon[103798]: pgmap v525: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:51:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:28 smithi191 ceph-mon[104220]: pgmap v526: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:51:28.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:28 smithi070 ceph-mon[99513]: pgmap v526: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:51:28.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:28 smithi105 ceph-mon[103798]: pgmap v526: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:51:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:30 smithi105 ceph-mon[103798]: pgmap v527: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:51:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:30 smithi191 ceph-mon[104220]: pgmap v527: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:51:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:30 smithi070 ceph-mon[99513]: pgmap v527: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:51:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:32 smithi191 ceph-mon[104220]: pgmap v528: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:51:32.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:32 smithi070 ceph-mon[99513]: pgmap v528: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:51:32.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:32 smithi105 ceph-mon[103798]: pgmap v528: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:51:34.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:34 smithi191 ceph-mon[104220]: pgmap v529: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2023-10-08T08:51:34.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:34 smithi070 ceph-mon[99513]: pgmap v529: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2023-10-08T08:51:34.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:34 smithi105 ceph-mon[103798]: pgmap v529: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2023-10-08T08:51:36.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:36 smithi191 ceph-mon[104220]: pgmap v530: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:51:36.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:36 smithi070 ceph-mon[99513]: pgmap v530: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:51:36.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:36 smithi105 ceph-mon[103798]: pgmap v530: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:51:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:38 smithi191 ceph-mon[104220]: pgmap v531: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:38 smithi070 ceph-mon[99513]: pgmap v531: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:38.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:38 smithi105 ceph-mon[103798]: pgmap v531: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:40 smithi105 ceph-mon[103798]: pgmap v532: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:51:40.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:40 smithi191 ceph-mon[104220]: pgmap v532: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:51:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:40 smithi070 ceph-mon[99513]: pgmap v532: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:51:42.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:42 smithi191 ceph-mon[104220]: pgmap v533: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:42.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:42 smithi070 ceph-mon[99513]: pgmap v533: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:42.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:42 smithi105 ceph-mon[103798]: pgmap v533: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:44.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:44 smithi191 ceph-mon[104220]: pgmap v534: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:51:44.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:44 smithi070 ceph-mon[99513]: pgmap v534: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:51:44.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:44 smithi105 ceph-mon[103798]: pgmap v534: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:51:46.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:46 smithi191 ceph-mon[104220]: pgmap v535: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:51:46.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:46 smithi070 ceph-mon[99513]: pgmap v535: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:51:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:46 smithi105 ceph-mon[103798]: pgmap v535: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:51:48.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:48 smithi191 ceph-mon[104220]: pgmap v536: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:48 smithi070 ceph-mon[99513]: pgmap v536: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:48.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:48 smithi105 ceph-mon[103798]: pgmap v536: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:50.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:50 smithi105 ceph-mon[103798]: pgmap v537: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:51:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:50 smithi191 ceph-mon[104220]: pgmap v537: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:51:50.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:50 smithi070 ceph-mon[99513]: pgmap v537: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:51:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:52 smithi191 ceph-mon[104220]: pgmap v538: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:52 smithi070 ceph-mon[99513]: pgmap v538: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:52.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:52 smithi105 ceph-mon[103798]: pgmap v538: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:54.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:54 smithi191 ceph-mon[104220]: pgmap v539: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:51:54.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:54 smithi070 ceph-mon[99513]: pgmap v539: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:51:54.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:54 smithi105 ceph-mon[103798]: pgmap v539: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:51:56.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:56 smithi191 ceph-mon[104220]: pgmap v540: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:51:56.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:56 smithi070 ceph-mon[99513]: pgmap v540: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:51:56.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:56 smithi105 ceph-mon[103798]: pgmap v540: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:51:58.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:51:58 smithi191 ceph-mon[104220]: pgmap v541: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:58.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:51:58 smithi070 ceph-mon[99513]: pgmap v541: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:51:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:51:58 smithi105 ceph-mon[103798]: pgmap v541: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:00 smithi105 ceph-mon[103798]: pgmap v542: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:52:00.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:00 smithi191 ceph-mon[104220]: pgmap v542: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:52:00.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:00 smithi070 ceph-mon[99513]: pgmap v542: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:52:02.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:02 smithi191 ceph-mon[104220]: pgmap v543: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:02.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:02 smithi070 ceph-mon[99513]: pgmap v543: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:02.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:02 smithi105 ceph-mon[103798]: pgmap v543: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:04 smithi191 ceph-mon[104220]: pgmap v544: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 11 op/s 2023-10-08T08:52:04.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:04 smithi070 ceph-mon[99513]: pgmap v544: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 11 op/s 2023-10-08T08:52:04.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:04 smithi105 ceph-mon[103798]: pgmap v544: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 11 op/s 2023-10-08T08:52:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:06 smithi191 ceph-mon[104220]: pgmap v545: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-08T08:52:06.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:06 smithi070 ceph-mon[99513]: pgmap v545: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-08T08:52:06.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:06 smithi105 ceph-mon[103798]: pgmap v545: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-08T08:52:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:08 smithi191 ceph-mon[104220]: pgmap v546: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T08:52:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:08 smithi070 ceph-mon[99513]: pgmap v546: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T08:52:08.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:08 smithi105 ceph-mon[103798]: pgmap v546: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T08:52:10.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:10 smithi105 ceph-mon[103798]: pgmap v547: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:52:10.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:10 smithi191 ceph-mon[104220]: pgmap v547: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:52:10.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:10 smithi070 ceph-mon[99513]: pgmap v547: 129 pgs: 129 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:52:11.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:11 smithi105 ceph-mon[103798]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T08:52:11.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:11 smithi191 ceph-mon[104220]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T08:52:11.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:11 smithi070 ceph-mon[99513]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T08:52:12.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:12 smithi105 ceph-mon[103798]: pgmap v549: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:52:12.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:12 smithi191 ceph-mon[104220]: pgmap v549: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:52:12.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:12 smithi070 ceph-mon[99513]: pgmap v549: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:52:14.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:14 smithi191 ceph-mon[104220]: pgmap v550: 129 pgs: 18 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 55 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:52:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:14 smithi070 ceph-mon[99513]: pgmap v550: 129 pgs: 18 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 55 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:52:14.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:14 smithi105 ceph-mon[103798]: pgmap v550: 129 pgs: 18 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 55 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:52:16.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:16 smithi191 ceph-mon[104220]: pgmap v551: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:52:16.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:16 smithi070 ceph-mon[99513]: pgmap v551: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:52:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:16 smithi105 ceph-mon[103798]: pgmap v551: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-10-08T08:52:17.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:17 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:52:17.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:17 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:52:17.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:17 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:52:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:18 smithi191 ceph-mon[104220]: pgmap v552: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:52:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:52:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:52:18.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:18 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:52:18.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:18 smithi070 ceph-mon[99513]: pgmap v552: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:52:18.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:52:18.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:52:18.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:18 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:52:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:18 smithi105 ceph-mon[103798]: pgmap v552: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:52:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T08:52:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:52:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:52:18.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:18 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:52:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:19 smithi191 ceph-mon[104220]: Adjusting osd_memory_target on smithi191 to 196.2M 2023-10-08T08:52:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:19 smithi191 ceph-mon[104220]: Unable to set osd_memory_target on smithi191 to 205773926: error parsing value: Value '205773926' is below minimum 939524096 2023-10-08T08:52:19.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:19 smithi070 ceph-mon[99513]: Adjusting osd_memory_target on smithi191 to 196.2M 2023-10-08T08:52:19.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:19 smithi070 ceph-mon[99513]: Unable to set osd_memory_target on smithi191 to 205773926: error parsing value: Value '205773926' is below minimum 939524096 2023-10-08T08:52:19.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:19 smithi105 ceph-mon[103798]: Adjusting osd_memory_target on smithi191 to 196.2M 2023-10-08T08:52:19.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:19 smithi105 ceph-mon[103798]: Unable to set osd_memory_target on smithi191 to 205773926: error parsing value: Value '205773926' is below minimum 939524096 2023-10-08T08:52:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:20 smithi191 ceph-mon[104220]: pgmap v553: 129 pgs: 14 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 67 active+clean; 766 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:52:20.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:20 smithi070 ceph-mon[99513]: pgmap v553: 129 pgs: 14 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 67 active+clean; 766 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:52:20.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:20 smithi105 ceph-mon[103798]: pgmap v553: 129 pgs: 14 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 67 active+clean; 766 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:52:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:22 smithi191 ceph-mon[104220]: pgmap v554: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 185 B/s wr, 11 op/s 2023-10-08T08:52:22.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:22 smithi070 ceph-mon[99513]: pgmap v554: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 185 B/s wr, 11 op/s 2023-10-08T08:52:22.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:22 smithi105 ceph-mon[103798]: pgmap v554: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 185 B/s wr, 11 op/s 2023-10-08T08:52:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:24 smithi191 ceph-mon[104220]: pgmap v555: 129 pgs: 129 active+clean; 190 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:52:24.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:24 smithi191 ceph-mon[104220]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T08:52:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:24 smithi070 ceph-mon[99513]: pgmap v555: 129 pgs: 129 active+clean; 190 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:52:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:24 smithi070 ceph-mon[99513]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T08:52:24.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:24 smithi105 ceph-mon[103798]: pgmap v555: 129 pgs: 129 active+clean; 190 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:52:24.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:24 smithi105 ceph-mon[103798]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T08:52:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:26 smithi191 ceph-mon[104220]: pgmap v557: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:52:26.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:26 smithi070 ceph-mon[99513]: pgmap v557: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:52:26.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:26 smithi105 ceph-mon[103798]: pgmap v557: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:52:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:28 smithi191 ceph-mon[104220]: pgmap v558: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:52:28.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:28 smithi070 ceph-mon[99513]: pgmap v558: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:52:28.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:28 smithi105 ceph-mon[103798]: pgmap v558: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:52:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:30 smithi105 ceph-mon[103798]: pgmap v559: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:52:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:30 smithi191 ceph-mon[104220]: pgmap v559: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:52:30.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:30 smithi070 ceph-mon[99513]: pgmap v559: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:52:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:32 smithi191 ceph-mon[104220]: pgmap v560: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:52:32.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:32 smithi070 ceph-mon[99513]: pgmap v560: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:52:32.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:32 smithi105 ceph-mon[103798]: pgmap v560: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:52:34.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:34 smithi191 ceph-mon[104220]: pgmap v561: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:52:34.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:34 smithi070 ceph-mon[99513]: pgmap v561: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:52:34.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:34 smithi105 ceph-mon[103798]: pgmap v561: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:52:36.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:36 smithi191 ceph-mon[104220]: pgmap v562: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:52:36.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:36 smithi070 ceph-mon[99513]: pgmap v562: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:52:36.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:36 smithi105 ceph-mon[103798]: pgmap v562: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:52:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:38 smithi191 ceph-mon[104220]: pgmap v563: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:38 smithi070 ceph-mon[99513]: pgmap v563: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:38.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:38 smithi105 ceph-mon[103798]: pgmap v563: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:40 smithi105 ceph-mon[103798]: pgmap v564: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:52:40.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:40 smithi191 ceph-mon[104220]: pgmap v564: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:52:40.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:40 smithi070 ceph-mon[99513]: pgmap v564: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:52:42.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:42 smithi191 ceph-mon[104220]: pgmap v565: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:42.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:42 smithi070 ceph-mon[99513]: pgmap v565: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:42.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:42 smithi105 ceph-mon[103798]: pgmap v565: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:44.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:44 smithi191 ceph-mon[104220]: pgmap v566: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:52:44.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:44 smithi070 ceph-mon[99513]: pgmap v566: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:52:44.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:44 smithi105 ceph-mon[103798]: pgmap v566: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:52:46.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:46 smithi191 ceph-mon[104220]: pgmap v567: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:52:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:46 smithi070 ceph-mon[99513]: pgmap v567: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:52:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:46 smithi105 ceph-mon[103798]: pgmap v567: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:52:48.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:48 smithi191 ceph-mon[104220]: pgmap v568: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:48 smithi070 ceph-mon[99513]: pgmap v568: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:48.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:48 smithi105 ceph-mon[103798]: pgmap v568: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:50.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:50 smithi105 ceph-mon[103798]: pgmap v569: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:52:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:50 smithi191 ceph-mon[104220]: pgmap v569: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:52:50.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:50 smithi070 ceph-mon[99513]: pgmap v569: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:52:52.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:52 smithi191 ceph-mon[104220]: pgmap v570: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:52 smithi070 ceph-mon[99513]: pgmap v570: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:52.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:52 smithi105 ceph-mon[103798]: pgmap v570: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:54.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:54 smithi191 ceph-mon[104220]: pgmap v571: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:52:54.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:54 smithi070 ceph-mon[99513]: pgmap v571: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:52:54.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:54 smithi105 ceph-mon[103798]: pgmap v571: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:52:56.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:56 smithi191 ceph-mon[104220]: pgmap v572: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:52:56.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:56 smithi070 ceph-mon[99513]: pgmap v572: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:52:56.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:56 smithi105 ceph-mon[103798]: pgmap v572: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:52:58.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:52:58 smithi191 ceph-mon[104220]: pgmap v573: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:58.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:52:58 smithi070 ceph-mon[99513]: pgmap v573: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:52:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:52:58 smithi105 ceph-mon[103798]: pgmap v573: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:00 smithi105 ceph-mon[103798]: pgmap v574: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:53:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:00 smithi191 ceph-mon[104220]: pgmap v574: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:53:00.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:00 smithi070 ceph-mon[99513]: pgmap v574: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:53:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:02 smithi191 ceph-mon[104220]: pgmap v575: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T08:53:02.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:02 smithi070 ceph-mon[99513]: pgmap v575: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T08:53:02.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:02 smithi105 ceph-mon[103798]: pgmap v575: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T08:53:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:04 smithi191 ceph-mon[104220]: pgmap v576: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-08T08:53:04.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:04 smithi070 ceph-mon[99513]: pgmap v576: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-08T08:53:04.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:04 smithi105 ceph-mon[103798]: pgmap v576: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-08T08:53:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:06 smithi191 ceph-mon[104220]: pgmap v577: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T08:53:06.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:06 smithi070 ceph-mon[99513]: pgmap v577: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T08:53:06.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:06 smithi105 ceph-mon[103798]: pgmap v577: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T08:53:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:08 smithi191 ceph-mon[104220]: pgmap v578: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T08:53:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:08 smithi070 ceph-mon[99513]: pgmap v578: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T08:53:08.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:08 smithi105 ceph-mon[103798]: pgmap v578: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T08:53:10.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:10 smithi105 ceph-mon[103798]: pgmap v579: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:53:10.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:10 smithi191 ceph-mon[104220]: pgmap v579: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:53:10.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:10 smithi070 ceph-mon[99513]: pgmap v579: 129 pgs: 129 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:53:11.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:11 smithi105 ceph-mon[103798]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T08:53:11.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:11 smithi191 ceph-mon[104220]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T08:53:11.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:11 smithi070 ceph-mon[99513]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T08:53:12.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:12 smithi191 ceph-mon[104220]: pgmap v581: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 188 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 11 op/s 2023-10-08T08:53:12.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:12 smithi070 ceph-mon[99513]: pgmap v581: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 188 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 11 op/s 2023-10-08T08:53:12.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:12 smithi105 ceph-mon[103798]: pgmap v581: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 188 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 11 op/s 2023-10-08T08:53:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:14 smithi191 ceph-mon[104220]: pgmap v582: 129 pgs: 18 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 55 active+clean; 184 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-10-08T08:53:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:14 smithi070 ceph-mon[99513]: pgmap v582: 129 pgs: 18 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 55 active+clean; 184 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-10-08T08:53:14.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:14 smithi105 ceph-mon[103798]: pgmap v582: 129 pgs: 18 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 55 active+clean; 184 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-10-08T08:53:16.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:16 smithi191 ceph-mon[104220]: pgmap v583: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 180 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:53:16.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:16 smithi070 ceph-mon[99513]: pgmap v583: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 180 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:53:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:16 smithi105 ceph-mon[103798]: pgmap v583: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 180 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:53:18.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:18 smithi191 ceph-mon[104220]: pgmap v584: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 165 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:53:18.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:18 smithi070 ceph-mon[99513]: pgmap v584: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 165 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:53:18.774 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:18 smithi105 ceph-mon[103798]: pgmap v584: 129 pgs: 22 active+clean+snaptrim, 70 active+clean+snaptrim_wait, 37 active+clean; 165 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:53:19.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:53:19.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:53:19.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:53:19.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:19 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:53:19.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:53:19.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:53:19.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:53:19.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:19 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:53:19.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:53:19.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:53:19.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:53:19.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:19 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:53:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:20 smithi191 ceph-mon[104220]: pgmap v585: 129 pgs: 14 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 67 active+clean; 158 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:53:20.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:20 smithi070 ceph-mon[99513]: pgmap v585: 129 pgs: 14 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 67 active+clean; 158 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:53:20.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:20 smithi105 ceph-mon[103798]: pgmap v585: 129 pgs: 14 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 67 active+clean; 158 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:53:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:22 smithi191 ceph-mon[104220]: pgmap v586: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 185 B/s wr, 11 op/s 2023-10-08T08:53:22.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:22 smithi070 ceph-mon[99513]: pgmap v586: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 185 B/s wr, 11 op/s 2023-10-08T08:53:22.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:22 smithi105 ceph-mon[103798]: pgmap v586: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 185 B/s wr, 11 op/s 2023-10-08T08:53:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:24 smithi191 ceph-mon[104220]: pgmap v587: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:53:24.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:24 smithi191 ceph-mon[104220]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T08:53:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:24 smithi070 ceph-mon[99513]: pgmap v587: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:53:24.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:24 smithi070 ceph-mon[99513]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T08:53:24.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:24 smithi105 ceph-mon[103798]: pgmap v587: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-08T08:53:24.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:24 smithi105 ceph-mon[103798]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T08:53:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:26 smithi191 ceph-mon[104220]: pgmap v589: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:53:26.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:26 smithi070 ceph-mon[99513]: pgmap v589: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:53:26.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:26 smithi105 ceph-mon[103798]: pgmap v589: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:53:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:28 smithi191 ceph-mon[104220]: pgmap v590: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:53:28.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:28 smithi070 ceph-mon[99513]: pgmap v590: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:53:28.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:28 smithi105 ceph-mon[103798]: pgmap v590: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:53:30.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:30 smithi105 ceph-mon[103798]: pgmap v591: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:53:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:30 smithi191 ceph-mon[104220]: pgmap v591: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:53:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:30 smithi070 ceph-mon[99513]: pgmap v591: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:53:32.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:32 smithi191 ceph-mon[104220]: pgmap v592: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:53:32.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:32 smithi070 ceph-mon[99513]: pgmap v592: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:53:32.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:32 smithi105 ceph-mon[103798]: pgmap v592: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:53:34.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:34 smithi191 ceph-mon[104220]: pgmap v593: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:53:34.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:34 smithi070 ceph-mon[99513]: pgmap v593: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:53:34.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:34 smithi105 ceph-mon[103798]: pgmap v593: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-08T08:53:36.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:36 smithi191 ceph-mon[104220]: pgmap v594: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:53:36.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:36 smithi070 ceph-mon[99513]: pgmap v594: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:53:36.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:36 smithi105 ceph-mon[103798]: pgmap v594: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T08:53:38.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:38 smithi191 ceph-mon[104220]: pgmap v595: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:38.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:38 smithi070 ceph-mon[99513]: pgmap v595: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:38.879 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:38 smithi105 ceph-mon[103798]: pgmap v595: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:40.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:40 smithi105 ceph-mon[103798]: pgmap v596: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:53:41.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:40 smithi070 ceph-mon[99513]: pgmap v596: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:53:41.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:40 smithi191 ceph-mon[104220]: pgmap v596: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:53:42.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:42 smithi191 ceph-mon[104220]: pgmap v597: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:43.538 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:42 smithi105 ceph-mon[103798]: pgmap v597: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:43.538 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:42 smithi070 ceph-mon[99513]: pgmap v597: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:44.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:44 smithi191 ceph-mon[104220]: pgmap v598: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:53:46.234 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:44 smithi105 ceph-mon[103798]: pgmap v598: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:53:46.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:44 smithi070 ceph-mon[99513]: pgmap v598: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:53:46.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:46 smithi191 ceph-mon[104220]: pgmap v599: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:53:46.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:46 smithi070 ceph-mon[99513]: pgmap v599: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:53:46.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:46 smithi105 ceph-mon[103798]: pgmap v599: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:53:48.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:48 smithi191 ceph-mon[104220]: pgmap v600: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:48.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:48 smithi070 ceph-mon[99513]: pgmap v600: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:48.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:48 smithi105 ceph-mon[103798]: pgmap v600: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:50.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:50 smithi105 ceph-mon[103798]: pgmap v601: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:53:50.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:50 smithi191 ceph-mon[104220]: pgmap v601: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:53:50.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:50 smithi070 ceph-mon[99513]: pgmap v601: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-10-08T08:53:52.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:52 smithi191 ceph-mon[104220]: pgmap v602: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:52.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:52 smithi070 ceph-mon[99513]: pgmap v602: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:52.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:52 smithi105 ceph-mon[103798]: pgmap v602: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T08:53:53.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T08:53:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.540+0000 7eff43e94700 1 -- 172.21.15.70:0/65803193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 msgr2=0x7eff3c106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.540+0000 7eff43e94700 1 --2- 172.21.15.70:0/65803193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 0x7eff3c106b00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009990 tx=0x7eff2c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.540+0000 7eff43e94700 1 -- 172.21.15.70:0/65803193 shutdown_connections 2023-10-08T08:53:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.540+0000 7eff43e94700 1 --2- 172.21.15.70:0/65803193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff3c0698f0 0x7eff3c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.540+0000 7eff43e94700 1 --2- 172.21.15.70:0/65803193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 0x7eff3c106b00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.540+0000 7eff43e94700 1 --2- 172.21.15.70:0/65803193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff3c068f50 0x7eff3c0693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.540+0000 7eff43e94700 1 -- 172.21.15.70:0/65803193 >> 172.21.15.70:0/65803193 conn(0x7eff3c076810 msgr2=0x7eff3c076c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.540+0000 7eff43e94700 1 -- 172.21.15.70:0/65803193 shutdown_connections 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.540+0000 7eff43e94700 1 -- 172.21.15.70:0/65803193 wait complete. 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff43e94700 1 Processor -- start 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff43e94700 1 -- start start 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff43e94700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff3c068f50 0x7eff3c0ff660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff43e94700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff3c0698f0 0x7eff3c0ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff43e94700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 0x7eff3c1000e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff43e94700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1a4f40 con 0x7eff3c106720 2023-10-08T08:53:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff43e94700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1a50b0 con 0x7eff3c068f50 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff43e94700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1a5270 con 0x7eff3c0698f0 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff42431700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 0x7eff3c1000e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff42431700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 0x7eff3c1000e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53612/0 (socket says 172.21.15.70:53612) 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff42431700 1 -- 172.21.15.70:0/2774921976 learned_addr learned my addr 172.21.15.70:0/2774921976 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff41c30700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff3c068f50 0x7eff3c0ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff42431700 1 -- 172.21.15.70:0/2774921976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff3c0698f0 msgr2=0x7eff3c0ffba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff4142f700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff3c0698f0 0x7eff3c0ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff42431700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff3c0698f0 0x7eff3c0ffba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff42431700 1 -- 172.21.15.70:0/2774921976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff3c068f50 msgr2=0x7eff3c0ff660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff42431700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff3c068f50 0x7eff3c0ff660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.541+0000 7eff42431700 1 -- 172.21.15.70:0/2774921976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0095f0 con 0x7eff3c106720 2023-10-08T08:53:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.542+0000 7eff42431700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 0x7eff3c1000e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7eff3400ab50 tx=0x7eff3400ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.542+0000 7eff32ffd700 1 -- 172.21.15.70:0/2774921976 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3400f070 con 0x7eff3c106720 2023-10-08T08:53:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.542+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c1a5550 con 0x7eff3c106720 2023-10-08T08:53:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.542+0000 7eff32ffd700 1 -- 172.21.15.70:0/2774921976 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff34007a80 con 0x7eff3c106720 2023-10-08T08:53:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.542+0000 7eff32ffd700 1 -- 172.21.15.70:0/2774921976 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34005280 con 0x7eff3c106720 2023-10-08T08:53:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.542+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c1a5a10 con 0x7eff3c106720 2023-10-08T08:53:53.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.543+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c108cc0 con 0x7eff3c106720 2023-10-08T08:53:53.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.544+0000 7eff32ffd700 1 -- 172.21.15.70:0/2774921976 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7eff3400c620 con 0x7eff3c106720 2023-10-08T08:53:53.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.544+0000 7eff32ffd700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7eff280a15f0 0x7eff280a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:53.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.544+0000 7eff41c30700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7eff280a15f0 0x7eff280a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:53.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.544+0000 7eff32ffd700 1 -- 172.21.15.70:0/2774921976 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9323+0+0 (secure 0 0 0) 0x7eff340cce20 con 0x7eff3c106720 2023-10-08T08:53:53.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.545+0000 7eff41c30700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7eff280a15f0 0x7eff280a3ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00b5c0 tx=0x7eff2c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:53.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.548+0000 7eff32ffd700 1 -- 172.21.15.70:0/2774921976 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7eff34095eb0 con 0x7eff3c106720 2023-10-08T08:53:53.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.767+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7eff3c110640 con 0x7eff280a15f0 2023-10-08T08:53:53.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.775+0000 7eff32ffd700 1 -- 172.21.15.70:0/2774921976 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+335 (secure 0 0 0) 0x7eff3c110640 con 0x7eff280a15f0 2023-10-08T08:53:53.831 INFO:teuthology.orchestra.run.smithi070.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T08:43:52", "first": "2023-10-08T08:44:00", "last": "2023-10-08T08:53:00", "last_pruned": "2023-10-08T08:53:00", "created_count": 10, "pruned_count": 4, "active": true} 2023-10-08T08:53:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7eff280a15f0 msgr2=0x7eff280a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7eff280a15f0 0x7eff280a3ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00b5c0 tx=0x7eff2c005960 comp rx=0 tx=0).stop 2023-10-08T08:53:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 msgr2=0x7eff3c1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 0x7eff3c1000e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7eff3400ab50 tx=0x7eff3400ae60 comp rx=0 tx=0).stop 2023-10-08T08:53:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 shutdown_connections 2023-10-08T08:53:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7eff280a15f0 0x7eff280a3ab0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c106720 0x7eff3c1000e0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff3c068f50 0x7eff3c0ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 --2- 172.21.15.70:0/2774921976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff3c0698f0 0x7eff3c0ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.777+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 >> 172.21.15.70:0/2774921976 conn(0x7eff3c076810 msgr2=0x7eff3c0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:53.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.778+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 shutdown_connections 2023-10-08T08:53:53.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.778+0000 7eff43e94700 1 -- 172.21.15.70:0/2774921976 wait complete. 2023-10-08T08:53:53.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T08:53:53.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.955+0000 7fe329d0c700 1 -- 172.21.15.70:0/528133386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240ff5d0 msgr2=0x7fe3240ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:53.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.955+0000 7fe329d0c700 1 --2- 172.21.15.70:0/528133386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240ff5d0 0x7fe3240ffa50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe318009990 tx=0x7fe318009ca0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.955+0000 7fe329d0c700 1 -- 172.21.15.70:0/528133386 shutdown_connections 2023-10-08T08:53:53.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.955+0000 7fe329d0c700 1 --2- 172.21.15.70:0/528133386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3240fff90 0x7fe32410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.955+0000 7fe329d0c700 1 --2- 172.21.15.70:0/528133386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3241045e0 0x7fe3241049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.955+0000 7fe329d0c700 1 --2- 172.21.15.70:0/528133386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240ff5d0 0x7fe3240ffa50 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.955+0000 7fe329d0c700 1 -- 172.21.15.70:0/528133386 >> 172.21.15.70:0/528133386 conn(0x7fe324076790 msgr2=0x7fe324076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:53.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.955+0000 7fe329d0c700 1 -- 172.21.15.70:0/528133386 shutdown_connections 2023-10-08T08:53:53.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.955+0000 7fe329d0c700 1 -- 172.21.15.70:0/528133386 wait complete. 2023-10-08T08:53:53.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.956+0000 7fe329d0c700 1 Processor -- start 2023-10-08T08:53:53.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.956+0000 7fe329d0c700 1 -- start start 2023-10-08T08:53:53.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.956+0000 7fe329d0c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3240ff5d0 0x7fe32419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:53.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.956+0000 7fe329d0c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240fff90 0x7fe32419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:53.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.956+0000 7fe329d0c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3241045e0 0x7fe324194720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:53.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.956+0000 7fe329d0c700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324194ef0 con 0x7fe3240fff90 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.956+0000 7fe329d0c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324195060 con 0x7fe3240ff5d0 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.956+0000 7fe329d0c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324195220 con 0x7fe3241045e0 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe322ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240fff90 0x7fe32419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe322ffd700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240fff90 0x7fe32419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53624/0 (socket says 172.21.15.70:53624) 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe322ffd700 1 -- 172.21.15.70:0/3968015891 learned_addr learned my addr 172.21.15.70:0/3968015891 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe3237fe700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3240ff5d0 0x7fe32419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe323fff700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3241045e0 0x7fe324194720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe322ffd700 1 -- 172.21.15.70:0/3968015891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3241045e0 msgr2=0x7fe324194720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe322ffd700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3241045e0 0x7fe324194720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe322ffd700 1 -- 172.21.15.70:0/3968015891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3240ff5d0 msgr2=0x7fe32419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:53.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe322ffd700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3240ff5d0 0x7fe32419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:53.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe322ffd700 1 -- 172.21.15.70:0/3968015891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3180095f0 con 0x7fe3240fff90 2023-10-08T08:53:53.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe322ffd700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240fff90 0x7fe32419ab70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe318009fd0 tx=0x7fe31800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:53.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe320ff9700 1 -- 172.21.15.70:0/3968015891 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31801d070 con 0x7fe3240fff90 2023-10-08T08:53:53.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe320ff9700 1 -- 172.21.15.70:0/3968015891 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe318005050 con 0x7fe3240fff90 2023-10-08T08:53:53.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3241954a0 con 0x7fe3240fff90 2023-10-08T08:53:53.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe320ff9700 1 -- 172.21.15.70:0/3968015891 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318004a90 con 0x7fe3240fff90 2023-10-08T08:53:53.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.957+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3241a15b0 con 0x7fe3240fff90 2023-10-08T08:53:53.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.958+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe324107be0 con 0x7fe3240fff90 2023-10-08T08:53:53.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.959+0000 7fe320ff9700 1 -- 172.21.15.70:0/3968015891 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fe3180051c0 con 0x7fe3240fff90 2023-10-08T08:53:53.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.960+0000 7fe320ff9700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe30c0a3800 0x7fe30c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:53.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.960+0000 7fe320ff9700 1 -- 172.21.15.70:0/3968015891 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9323+0+0 (secure 0 0 0) 0x7fe3180ce5e0 con 0x7fe3240fff90 2023-10-08T08:53:53.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.960+0000 7fe3237fe700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe30c0a3800 0x7fe30c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:53.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.960+0000 7fe3237fe700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe30c0a3800 0x7fe30c0a5cc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe324069cf0 tx=0x7fe31400a3b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:53.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:53.963+0000 7fe320ff9700 1 -- 172.21.15.70:0/3968015891 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe318097610 con 0x7fe3240fff90 2023-10-08T08:53:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.184+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 --> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe324195bb0 con 0x7fe30c0a3800 2023-10-08T08:53:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.192+0000 7fe320ff9700 1 -- 172.21.15.70:0/3968015891 <== mgr.14217 v2:172.21.15.70:6800/1401477652 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fe324195bb0 con 0x7fe30c0a3800 2023-10-08T08:53:54.192 INFO:teuthology.orchestra.run.smithi070.stdout:/ 1m 6m3h 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe30c0a3800 msgr2=0x7fe30c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe30c0a3800 0x7fe30c0a5cc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe324069cf0 tx=0x7fe31400a3b0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240fff90 msgr2=0x7fe32419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240fff90 0x7fe32419ab70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe318009fd0 tx=0x7fe31800f670 comp rx=0 tx=0).stop 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 shutdown_connections 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fe30c0a3800 0x7fe30c0a5cc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3241045e0 0x7fe324194720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3240ff5d0 0x7fe32419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 --2- 172.21.15.70:0/3968015891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3240fff90 0x7fe32419ab70 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 >> 172.21.15.70:0/3968015891 conn(0x7fe324076790 msgr2=0x7fe3240fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:54.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 shutdown_connections 2023-10-08T08:53:54.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.194+0000 7fe329d0c700 1 -- 172.21.15.70:0/3968015891 wait complete. 2023-10-08T08:53:54.206 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-08T08:53:54.217 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-08T08:53:54.217 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-08T08:53:54.218 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-08T08:53:54.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:53:54.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.350+0000 7f96f8025700 1 -- 172.21.15.70:0/3092679829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 msgr2=0x7f96f00ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.350+0000 7f96f8025700 1 --2- 172.21.15.70:0/3092679829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 0x7f96f00ff400 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009990 tx=0x7f96ec009ca0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.350+0000 7f96f8025700 1 -- 172.21.15.70:0/3092679829 shutdown_connections 2023-10-08T08:53:54.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.350+0000 7f96f8025700 1 --2- 172.21.15.70:0/3092679829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f00ff940 0x7f96f010d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.350+0000 7f96f8025700 1 --2- 172.21.15.70:0/3092679829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f0105680 0x7f96f0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.350+0000 7f96f8025700 1 --2- 172.21.15.70:0/3092679829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 0x7f96f00ff400 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.350+0000 7f96f8025700 1 -- 172.21.15.70:0/3092679829 >> 172.21.15.70:0/3092679829 conn(0x7f96f0074860 msgr2=0x7f96f0074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.350+0000 7f96f8025700 1 -- 172.21.15.70:0/3092679829 shutdown_connections 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.350+0000 7f96f8025700 1 -- 172.21.15.70:0/3092679829 wait complete. 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.351+0000 7f96f8025700 1 Processor -- start 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.351+0000 7f96f8025700 1 -- start start 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.351+0000 7f96f8025700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 0x7f96f0100160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.351+0000 7f96f8025700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f00ff940 0x7f96f01006a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.351+0000 7f96f8025700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f0105680 0x7f96f0100be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.351+0000 7f96f8025700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01a4d70 con 0x7f96f00fef80 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.351+0000 7f96f8025700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01a4ee0 con 0x7f96f00ff940 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.351+0000 7f96f8025700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01a50a0 con 0x7f96f0105680 2023-10-08T08:53:54.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.351+0000 7f96f5dc1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 0x7f96f0100160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f5dc1700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 0x7f96f0100160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53636/0 (socket says 172.21.15.70:53636) 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f5dc1700 1 -- 172.21.15.70:0/1176692428 learned_addr learned my addr 172.21.15.70:0/1176692428 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f55c0700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f00ff940 0x7f96f01006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f65c2700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f0105680 0x7f96f0100be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f5dc1700 1 -- 172.21.15.70:0/1176692428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f0105680 msgr2=0x7f96f0100be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f5dc1700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f0105680 0x7f96f0100be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f5dc1700 1 -- 172.21.15.70:0/1176692428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f00ff940 msgr2=0x7f96f01006a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f5dc1700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f00ff940 0x7f96f01006a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f5dc1700 1 -- 172.21.15.70:0/1176692428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec0095f0 con 0x7f96f00fef80 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f65c2700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f0105680 0x7f96f0100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f5dc1700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 0x7f96f0100160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f96e000c920 tx=0x7f96e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96e6ffd700 1 -- 172.21.15.70:0/1176692428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0007b00 con 0x7f96f00fef80 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96e6ffd700 1 -- 172.21.15.70:0/1176692428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96e0004cf0 con 0x7f96f00fef80 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f01a5380 con 0x7f96f00fef80 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96e6ffd700 1 -- 172.21.15.70:0/1176692428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0005610 con 0x7f96f00fef80 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.352+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f01a5890 con 0x7f96f00fef80 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.353+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f0108c00 con 0x7f96f00fef80 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.354+0000 7f96e6ffd700 1 -- 172.21.15.70:0/1176692428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f96e0004750 con 0x7f96f00fef80 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.355+0000 7f96e6ffd700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f96dc0a1670 0x7f96dc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.355+0000 7f96f55c0700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f96dc0a1670 0x7f96dc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.355+0000 7f96e6ffd700 1 -- 172.21.15.70:0/1176692428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f96e00cd490 con 0x7f96f00fef80 2023-10-08T08:53:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.355+0000 7f96f55c0700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f96dc0a1670 0x7f96dc0a3b30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00b5c0 tx=0x7f96ec01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:54.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.358+0000 7f96e6ffd700 1 -- 172.21.15.70:0/1176692428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f96e0096430 con 0x7f96f00fef80 2023-10-08T08:53:54.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:54 smithi070 ceph-mon[99513]: pgmap v603: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:53:54.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.552+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96f0101640 con 0x7f96f00fef80 2023-10-08T08:53:54.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.554+0000 7f96e6ffd700 1 -- 172.21.15.70:0/1176692428 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+24928 (secure 0 0 0) 0x7f96e001d020 con 0x7f96f00fef80 2023-10-08T08:53:54.555 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:53:54.555 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":98,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:53:24.248447+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:53:54.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f96dc0a1670 msgr2=0x7f96dc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f96dc0a1670 0x7f96dc0a3b30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00b5c0 tx=0x7f96ec01a040 comp rx=0 tx=0).stop 2023-10-08T08:53:54.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 msgr2=0x7f96f0100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 0x7f96f0100160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f96e000c920 tx=0x7f96e000cce0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 shutdown_connections 2023-10-08T08:53:54.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f96dc0a1670 0x7f96dc0a3b30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f0105680 0x7f96f0100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96f00fef80 0x7f96f0100160 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 --2- 172.21.15.70:0/1176692428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f00ff940 0x7f96f01006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 >> 172.21.15.70:0/1176692428 conn(0x7f96f0074860 msgr2=0x7f96f00fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:54.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 shutdown_connections 2023-10-08T08:53:54.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.556+0000 7f96f8025700 1 -- 172.21.15.70:0/1176692428 wait complete. 2023-10-08T08:53:54.569 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:53:54.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:53:54.630 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:54 smithi191 ceph-mon[104220]: pgmap v603: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:53:54.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.752+0000 7f3d0db08700 1 -- 172.21.15.70:0/3833118268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d08105630 msgr2=0x7f3d08105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.752+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3833118268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d08105630 0x7f3d08105a10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80099c0 tx=0x7f3cf8009cd0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.753+0000 7f3d0db08700 1 -- 172.21.15.70:0/3833118268 shutdown_connections 2023-10-08T08:53:54.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.753+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3833118268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d081007d0 0x7f3d0810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.753+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3833118268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d08105630 0x7f3d08105a10 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.753+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3833118268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d080ffe10 0x7f3d08100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.753+0000 7f3d0db08700 1 -- 172.21.15.70:0/3833118268 >> 172.21.15.70:0/3833118268 conn(0x7f3d08075c20 msgr2=0x7f3d080fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:54.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.753+0000 7f3d0db08700 1 -- 172.21.15.70:0/3833118268 shutdown_connections 2023-10-08T08:53:54.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.753+0000 7f3d0db08700 1 -- 172.21.15.70:0/3833118268 wait complete. 2023-10-08T08:53:54.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.753+0000 7f3d0db08700 1 Processor -- start 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.753+0000 7f3d0db08700 1 -- start start 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d0db08700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d080ffe10 0x7f3d0819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d0db08700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d081007d0 0x7f3d0819bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d0db08700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d08105630 0x7f3d08195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d0db08700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08195fa0 con 0x7f3d080ffe10 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d0db08700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08196110 con 0x7f3d08105630 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d0db08700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d081962d0 con 0x7f3d081007d0 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d080ffe10 0x7f3d0819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d080ffe10 0x7f3d0819b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53650/0 (socket says 172.21.15.70:53650) 2023-10-08T08:53:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d077fe700 1 -- 172.21.15.70:0/3467263681 learned_addr learned my addr 172.21.15.70:0/3467263681 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d07fff700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d08105630 0x7f3d08195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d06ffd700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d081007d0 0x7f3d0819bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d077fe700 1 -- 172.21.15.70:0/3467263681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d081007d0 msgr2=0x7f3d0819bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d077fe700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d081007d0 0x7f3d0819bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d077fe700 1 -- 172.21.15.70:0/3467263681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d08105630 msgr2=0x7f3d08195940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d077fe700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d08105630 0x7f3d08195940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d077fe700 1 -- 172.21.15.70:0/3467263681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80095f0 con 0x7f3d080ffe10 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d06ffd700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d081007d0 0x7f3d0819bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d077fe700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d080ffe10 0x7f3d0819b810 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800b580 tx=0x7f3cf8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.754+0000 7f3d04ff9700 1 -- 172.21.15.70:0/3467263681 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf801d070 con 0x7f3d080ffe10 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.755+0000 7f3d04ff9700 1 -- 172.21.15.70:0/3467263681 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3cf800fc30 con 0x7f3d080ffe10 2023-10-08T08:53:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.755+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d08196550 con 0x7f3d080ffe10 2023-10-08T08:53:54.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.755+0000 7f3d04ff9700 1 -- 172.21.15.70:0/3467263681 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8022df0 con 0x7f3d080ffe10 2023-10-08T08:53:54.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.755+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d081a2800 con 0x7f3d080ffe10 2023-10-08T08:53:54.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.756+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d08107c40 con 0x7f3d080ffe10 2023-10-08T08:53:54.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.756+0000 7f3d04ff9700 1 -- 172.21.15.70:0/3467263681 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3cf8022500 con 0x7f3d080ffe10 2023-10-08T08:53:54.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.757+0000 7f3d04ff9700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3cf00a15f0 0x7f3cf00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:54.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.757+0000 7f3d06ffd700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3cf00a15f0 0x7f3cf00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:54.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.757+0000 7f3d04ff9700 1 -- 172.21.15.70:0/3467263681 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f3cf80ce560 con 0x7f3d080ffe10 2023-10-08T08:53:54.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.758+0000 7f3d06ffd700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3cf00a15f0 0x7f3cf00a3ab0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc005fd0 tx=0x7f3cfc005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:54.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.761+0000 7f3d04ff9700 1 -- 172.21.15.70:0/3467263681 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3cf805d100 con 0x7f3d080ffe10 2023-10-08T08:53:54.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:54 smithi105 ceph-mon[103798]: pgmap v603: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2023-10-08T08:53:54.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.952+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d08100e20 con 0x7f3d080ffe10 2023-10-08T08:53:54.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.952+0000 7f3d04ff9700 1 -- 172.21.15.70:0/3467263681 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d08100e20 con 0x7f3d080ffe10 2023-10-08T08:53:54.953 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:53:54.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3cf00a15f0 msgr2=0x7f3cf00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3cf00a15f0 0x7f3cf00a3ab0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc005fd0 tx=0x7f3cfc005ee0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d080ffe10 msgr2=0x7f3d0819b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:54.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d080ffe10 0x7f3d0819b810 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800b580 tx=0x7f3cf8005e80 comp rx=0 tx=0).stop 2023-10-08T08:53:54.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 shutdown_connections 2023-10-08T08:53:54.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3cf00a15f0 0x7f3cf00a3ab0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d08105630 0x7f3d08195940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d080ffe10 0x7f3d0819b810 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 --2- 172.21.15.70:0/3467263681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d081007d0 0x7f3d0819bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:54.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 >> 172.21.15.70:0/3467263681 conn(0x7f3d08075c20 msgr2=0x7f3d080fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:54.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 shutdown_connections 2023-10-08T08:53:54.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:54.955+0000 7f3d0db08700 1 -- 172.21.15.70:0/3467263681 wait complete. 2023-10-08T08:53:54.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:53:55.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.091+0000 7f65970e0700 1 -- 172.21.15.70:0/1891936842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65900ff620 msgr2=0x7f65900ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.091+0000 7f65970e0700 1 --2- 172.21.15.70:0/1891936842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65900ff620 0x7f65900ffaa0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f657c009990 tx=0x7f657c009ca0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.091+0000 7f65970e0700 1 -- 172.21.15.70:0/1891936842 shutdown_connections 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.091+0000 7f65970e0700 1 --2- 172.21.15.70:0/1891936842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65900fffe0 0x7f659010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.091+0000 7f65970e0700 1 --2- 172.21.15.70:0/1891936842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65901056b0 0x7f6590105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.091+0000 7f65970e0700 1 --2- 172.21.15.70:0/1891936842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65900ff620 0x7f65900ffaa0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.091+0000 7f65970e0700 1 -- 172.21.15.70:0/1891936842 >> 172.21.15.70:0/1891936842 conn(0x7f6590076780 msgr2=0x7f6590076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 -- 172.21.15.70:0/1891936842 shutdown_connections 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 -- 172.21.15.70:0/1891936842 wait complete. 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 Processor -- start 2023-10-08T08:53:55.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 -- start start 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65900ff620 0x7f6590196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65900fffe0 0x7f6590197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65901056b0 0x7f659019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659019b950 con 0x7f65901056b0 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659019bac0 con 0x7f65900fffe0 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f65970e0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659019bc80 con 0x7f65900ff620 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f659567d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65901056b0 0x7f659019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f659567d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65901056b0 0x7f659019b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53668/0 (socket says 172.21.15.70:53668) 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.092+0000 7f659567d700 1 -- 172.21.15.70:0/1584808241 learned_addr learned my addr 172.21.15.70:0/1584808241 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f6594e7c700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65900ff620 0x7f6590196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f658ffff700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65900fffe0 0x7f6590197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f659567d700 1 -- 172.21.15.70:0/1584808241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65900ff620 msgr2=0x7f6590196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f659567d700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65900ff620 0x7f6590196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f659567d700 1 -- 172.21.15.70:0/1584808241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65900fffe0 msgr2=0x7f6590197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f659567d700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65900fffe0 0x7f6590197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f659567d700 1 -- 172.21.15.70:0/1584808241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c0095f0 con 0x7f65901056b0 2023-10-08T08:53:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f658ffff700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65900fffe0 0x7f6590197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:53:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f659567d700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65901056b0 0x7f659019b380 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6588007ee0 tx=0x7f658800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f658dffb700 1 -- 172.21.15.70:0/1584808241 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658800ddd0 con 0x7f65901056b0 2023-10-08T08:53:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f658dffb700 1 -- 172.21.15.70:0/1584808241 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f658800f040 con 0x7f65901056b0 2023-10-08T08:53:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659019bf60 con 0x7f65901056b0 2023-10-08T08:53:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f658dffb700 1 -- 172.21.15.70:0/1584808241 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880048e0 con 0x7f65901056b0 2023-10-08T08:53:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.093+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65901a3810 con 0x7f65901056b0 2023-10-08T08:53:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.094+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6590100d50 con 0x7f65901056b0 2023-10-08T08:53:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.095+0000 7f658dffb700 1 -- 172.21.15.70:0/1584808241 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6588003a00 con 0x7f65901056b0 2023-10-08T08:53:55.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.096+0000 7f658dffb700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f65800a15f0 0x7f65800a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.096+0000 7f6594e7c700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f65800a15f0 0x7f65800a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.096+0000 7f658dffb700 1 -- 172.21.15.70:0/1584808241 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f65880cce20 con 0x7f65901056b0 2023-10-08T08:53:55.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.096+0000 7f6594e7c700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f65800a15f0 0x7f65800a3ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6590077ab0 tx=0x7f658400a3b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:55.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.100+0000 7f658dffb700 1 -- 172.21.15.70:0/1584808241 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f658804f100 con 0x7f65901056b0 2023-10-08T08:53:55.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.293+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6590197d70 con 0x7f65901056b0 2023-10-08T08:53:55.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.293+0000 7f658dffb700 1 -- 172.21.15.70:0/1584808241 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6588095dc0 con 0x7f65901056b0 2023-10-08T08:53:55.294 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:53:55.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f65800a15f0 msgr2=0x7f65800a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f65800a15f0 0x7f65800a3ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6590077ab0 tx=0x7f658400a3b0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65901056b0 msgr2=0x7f659019b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65901056b0 0x7f659019b380 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6588007ee0 tx=0x7f658800d3b0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 shutdown_connections 2023-10-08T08:53:55.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f65800a15f0 0x7f65800a3ab0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65901056b0 0x7f659019b380 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65900ff620 0x7f6590196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 --2- 172.21.15.70:0/1584808241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65900fffe0 0x7f6590197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 >> 172.21.15.70:0/1584808241 conn(0x7f6590076780 msgr2=0x7f65900fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:55.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 shutdown_connections 2023-10-08T08:53:55.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.295+0000 7f65970e0700 1 -- 172.21.15.70:0/1584808241 wait complete. 2023-10-08T08:53:55.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:53:55.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.432+0000 7f5cf76ec700 1 -- 172.21.15.70:0/1285090137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0100740 msgr2=0x7f5cf0100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.432+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/1285090137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0100740 0x7f5cf0100bc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009990 tx=0x7f5cec009ca0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.432+0000 7f5cf76ec700 1 -- 172.21.15.70:0/1285090137 shutdown_connections 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.432+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/1285090137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf0101100 0x7f5cf010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.432+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/1285090137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cf0106750 0x7f5cf0106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.432+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/1285090137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0100740 0x7f5cf0100bc0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.432+0000 7f5cf76ec700 1 -- 172.21.15.70:0/1285090137 >> 172.21.15.70:0/1285090137 conn(0x7f5cf00fc230 msgr2=0x7f5cf00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.432+0000 7f5cf76ec700 1 -- 172.21.15.70:0/1285090137 shutdown_connections 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.432+0000 7f5cf76ec700 1 -- 172.21.15.70:0/1285090137 wait complete. 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf76ec700 1 Processor -- start 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf76ec700 1 -- start start 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf76ec700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf0100740 0x7f5cf0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf76ec700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0101100 0x7f5cf0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf76ec700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cf0106750 0x7f5cf0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf76ec700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a4ec0 con 0x7f5cf0101100 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf76ec700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a5030 con 0x7f5cf0106750 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf76ec700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a51f0 con 0x7f5cf0100740 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf4c87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0101100 0x7f5cf0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf4c87700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0101100 0x7f5cf0073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53680/0 (socket says 172.21.15.70:53680) 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf4c87700 1 -- 172.21.15.70:0/991044751 learned_addr learned my addr 172.21.15.70:0/991044751 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf5488700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf0100740 0x7f5cf0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf5c89700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cf0106750 0x7f5cf0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf4c87700 1 -- 172.21.15.70:0/991044751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf0100740 msgr2=0x7f5cf0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf4c87700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf0100740 0x7f5cf0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf4c87700 1 -- 172.21.15.70:0/991044751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cf0106750 msgr2=0x7f5cf0073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf4c87700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cf0106750 0x7f5cf0073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf4c87700 1 -- 172.21.15.70:0/991044751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec0095f0 con 0x7f5cf0101100 2023-10-08T08:53:55.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf5c89700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cf0106750 0x7f5cf0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:53:55.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.433+0000 7f5cf4c87700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0101100 0x7f5cf0073030 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5cec005770 tx=0x7f5cec005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:55.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.434+0000 7f5ce27fc700 1 -- 172.21.15.70:0/991044751 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec01d070 con 0x7f5cf0101100 2023-10-08T08:53:55.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.434+0000 7f5ce27fc700 1 -- 172.21.15.70:0/991044751 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cec021410 con 0x7f5cf0101100 2023-10-08T08:53:55.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.434+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf01a54d0 con 0x7f5cf0101100 2023-10-08T08:53:55.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.434+0000 7f5ce27fc700 1 -- 172.21.15.70:0/991044751 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec017650 con 0x7f5cf0101100 2023-10-08T08:53:55.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.434+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf01a59e0 con 0x7f5cf0101100 2023-10-08T08:53:55.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.435+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf0108cd0 con 0x7f5cf0101100 2023-10-08T08:53:55.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.436+0000 7f5ce27fc700 1 -- 172.21.15.70:0/991044751 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f5cec00fb10 con 0x7f5cf0101100 2023-10-08T08:53:55.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.436+0000 7f5ce27fc700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5cdc0a15f0 0x7f5cdc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.436+0000 7f5cf5488700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5cdc0a15f0 0x7f5cdc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.436+0000 7f5ce27fc700 1 -- 172.21.15.70:0/991044751 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f5cec0cef50 con 0x7f5cf0101100 2023-10-08T08:53:55.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.437+0000 7f5cf5488700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5cdc0a15f0 0x7f5cdc0a3ab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009bd0 tx=0x7f5ce4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:55.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.440+0000 7f5ce27fc700 1 -- 172.21.15.70:0/991044751 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5cec097fe0 con 0x7f5cf0101100 2023-10-08T08:53:55.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:55 smithi191 ceph-mon[104220]: from='client.16773 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:53:55.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:55 smithi191 ceph-mon[104220]: from='client.16779 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:53:55.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:55 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1176692428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:53:55.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:55 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3467263681' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:53:55.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:55 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1584808241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:53:55.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.631+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5cf0067560 con 0x7f5cf0101100 2023-10-08T08:53:55.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.632+0000 7f5ce27fc700 1 -- 172.21.15.70:0/991044751 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5cec09b600 con 0x7f5cf0101100 2023-10-08T08:53:55.633 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:53:55.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5cdc0a15f0 msgr2=0x7f5cdc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5cdc0a15f0 0x7f5cdc0a3ab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009bd0 tx=0x7f5ce4009260 comp rx=0 tx=0).stop 2023-10-08T08:53:55.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0101100 msgr2=0x7f5cf0073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0101100 0x7f5cf0073030 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5cec005770 tx=0x7f5cec005ef0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 shutdown_connections 2023-10-08T08:53:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f5cdc0a15f0 0x7f5cdc0a3ab0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cf0106750 0x7f5cf0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf0100740 0x7f5cf0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 --2- 172.21.15.70:0/991044751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf0101100 0x7f5cf0073030 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 >> 172.21.15.70:0/991044751 conn(0x7f5cf00fc230 msgr2=0x7f5cf00fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 shutdown_connections 2023-10-08T08:53:55.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.634+0000 7f5cf76ec700 1 -- 172.21.15.70:0/991044751 wait complete. 2023-10-08T08:53:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:55 smithi070 ceph-mon[99513]: from='client.16773 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:53:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:55 smithi070 ceph-mon[99513]: from='client.16779 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:53:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:55 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1176692428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:53:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:55 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3467263681' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:53:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:55 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1584808241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:53:55.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:53:55.773 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:55 smithi105 ceph-mon[103798]: from='client.16773 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:53:55.773 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:55 smithi105 ceph-mon[103798]: from='client.16779 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T08:53:55.774 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:55 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1176692428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:53:55.774 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:55 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3467263681' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:53:55.774 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:55 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1584808241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:53:55.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.769+0000 7f6b50fa8700 1 -- 172.21.15.70:0/1054505493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c105630 msgr2=0x7f6b4c105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.769+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/1054505493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c105630 0x7f6b4c105a10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0099c0 tx=0x7f6b3c009cd0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.770+0000 7f6b50fa8700 1 -- 172.21.15.70:0/1054505493 shutdown_connections 2023-10-08T08:53:55.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.770+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/1054505493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b4c1007d0 0x7f6b4c10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.770+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/1054505493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c105630 0x7f6b4c105a10 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.770+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/1054505493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0ffe10 0x7f6b4c100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.770+0000 7f6b50fa8700 1 -- 172.21.15.70:0/1054505493 >> 172.21.15.70:0/1054505493 conn(0x7f6b4c075c20 msgr2=0x7f6b4c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:55.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.770+0000 7f6b50fa8700 1 -- 172.21.15.70:0/1054505493 shutdown_connections 2023-10-08T08:53:55.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.770+0000 7f6b50fa8700 1 -- 172.21.15.70:0/1054505493 wait complete. 2023-10-08T08:53:55.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.770+0000 7f6b50fa8700 1 Processor -- start 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.770+0000 7f6b50fa8700 1 -- start start 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b50fa8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0ffe10 0x7f6b4c1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b50fa8700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c1007d0 0x7f6b4c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b50fa8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b4c105630 0x7f6b4c1a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b50fa8700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c198770 con 0x7f6b4c1007d0 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b50fa8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1a2f80 con 0x7f6b4c0ffe10 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b50fa8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1a30c0 con 0x7f6b4c105630 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b49d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c1007d0 0x7f6b4c197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b49d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c1007d0 0x7f6b4c197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53692/0 (socket says 172.21.15.70:53692) 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b49d9b700 1 -- 172.21.15.70:0/4043338543 learned_addr learned my addr 172.21.15.70:0/4043338543 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:53:55.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b4ad9d700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b4c105630 0x7f6b4c1a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b4a59c700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0ffe10 0x7f6b4c1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b49d9b700 1 -- 172.21.15.70:0/4043338543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b4c105630 msgr2=0x7f6b4c1a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b49d9b700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b4c105630 0x7f6b4c1a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b49d9b700 1 -- 172.21.15.70:0/4043338543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0ffe10 msgr2=0x7f6b4c1979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b49d9b700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0ffe10 0x7f6b4c1979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b49d9b700 1 -- 172.21.15.70:0/4043338543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0095f0 con 0x7f6b4c1007d0 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b4ad9d700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b4c105630 0x7f6b4c1a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b4a59c700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0ffe10 0x7f6b4c1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b49d9b700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c1007d0 0x7f6b4c197f00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000e9a0 tx=0x7f6b4000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b3b7fe700 1 -- 172.21.15.70:0/4043338543 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40009790 con 0x7f6b4c1007d0 2023-10-08T08:53:55.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b3b7fe700 1 -- 172.21.15.70:0/4043338543 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b4000cbd0 con 0x7f6b4c1007d0 2023-10-08T08:53:55.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b3b7fe700 1 -- 172.21.15.70:0/4043338543 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40018680 con 0x7f6b4c1007d0 2023-10-08T08:53:55.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c1a3350 con 0x7f6b4c1007d0 2023-10-08T08:53:55.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.771+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c1a3810 con 0x7f6b4c1007d0 2023-10-08T08:53:55.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.772+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c107c20 con 0x7f6b4c1007d0 2023-10-08T08:53:55.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.774+0000 7f6b3b7fe700 1 -- 172.21.15.70:0/4043338543 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f6b4000cd40 con 0x7f6b4c1007d0 2023-10-08T08:53:55.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.774+0000 7f6b3b7fe700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b340a15f0 0x7f6b340a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:55.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.774+0000 7f6b4a59c700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b340a15f0 0x7f6b340a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:55.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.774+0000 7f6b3b7fe700 1 -- 172.21.15.70:0/4043338543 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f6b40014070 con 0x7f6b4c1007d0 2023-10-08T08:53:55.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.774+0000 7f6b4a59c700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b340a15f0 0x7f6b340a3ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00b580 tx=0x7f6b3c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:55.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.778+0000 7f6b3b7fe700 1 -- 172.21.15.70:0/4043338543 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b40096c50 con 0x7f6b4c1007d0 2023-10-08T08:53:55.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.973+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6b4c0ff2c0 con 0x7f6b4c1007d0 2023-10-08T08:53:55.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.974+0000 7f6b3b7fe700 1 -- 172.21.15.70:0/4043338543 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v98) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6b4009a270 con 0x7f6b4c1007d0 2023-10-08T08:53:55.975 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:53:55.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b340a15f0 msgr2=0x7f6b340a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b340a15f0 0x7f6b340a3ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00b580 tx=0x7f6b3c005fb0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c1007d0 msgr2=0x7f6b4c197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:55.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c1007d0 0x7f6b4c197f00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000e9a0 tx=0x7f6b4000ed60 comp rx=0 tx=0).stop 2023-10-08T08:53:55.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 shutdown_connections 2023-10-08T08:53:55.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f6b340a15f0 0x7f6b340a3ab0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b4c105630 0x7f6b4c1a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0ffe10 0x7f6b4c1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 --2- 172.21.15.70:0/4043338543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b4c1007d0 0x7f6b4c197f00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:55.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 >> 172.21.15.70:0/4043338543 conn(0x7f6b4c075c20 msgr2=0x7f6b4c0fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:55.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 shutdown_connections 2023-10-08T08:53:55.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:55.976+0000 7f6b50fa8700 1 -- 172.21.15.70:0/4043338543 wait complete. 2023-10-08T08:53:55.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-08T08:53:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 -- 172.21.15.70:0/2188008718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc454105600 msgr2=0x7fc4541059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 --2- 172.21.15.70:0/2188008718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc454105600 0x7fc4541059e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc4500099c0 tx=0x7fc450009cd0 comp rx=0 tx=0).stop 2023-10-08T08:53:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 -- 172.21.15.70:0/2188008718 shutdown_connections 2023-10-08T08:53:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 --2- 172.21.15.70:0/2188008718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4540fff00 0x7fc45410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 --2- 172.21.15.70:0/2188008718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc454105600 0x7fc4541059e0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 --2- 172.21.15.70:0/2188008718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4540ff540 0x7fc4540ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 -- 172.21.15.70:0/2188008718 >> 172.21.15.70:0/2188008718 conn(0x7fc4540fb030 msgr2=0x7fc4540fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 -- 172.21.15.70:0/2188008718 shutdown_connections 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 -- 172.21.15.70:0/2188008718 wait complete. 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 Processor -- start 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.109+0000 7fc45c263700 1 -- start start 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc45c263700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4540ff540 0x7fc4541978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc45c263700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4540fff00 0x7fc454197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc45c263700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc454105600 0x7fc4541a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc45c263700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541986b0 con 0x7fc4540fff00 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc45c263700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541a2e70 con 0x7fc4540ff540 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc45c263700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541a2fb0 con 0x7fc454105600 2023-10-08T08:53:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc4597fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4540fff00 0x7fc454197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc4597fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4540fff00 0x7fc454197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53706/0 (socket says 172.21.15.70:53706) 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc4597fe700 1 -- 172.21.15.70:0/87390435 learned_addr learned my addr 172.21.15.70:0/87390435 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc45a800700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc454105600 0x7fc4541a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc459fff700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4540ff540 0x7fc4541978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc4597fe700 1 -- 172.21.15.70:0/87390435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc454105600 msgr2=0x7fc4541a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc4597fe700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc454105600 0x7fc4541a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc4597fe700 1 -- 172.21.15.70:0/87390435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4540ff540 msgr2=0x7fc4541978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc4597fe700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4540ff540 0x7fc4541978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc4597fe700 1 -- 172.21.15.70:0/87390435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500095f0 con 0x7fc4540fff00 2023-10-08T08:53:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc459fff700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4540ff540 0x7fc4541978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:53:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc4597fe700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4540fff00 0x7fc454197df0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc44400d950 tx=0x7fc44400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc44affd700 1 -- 172.21.15.70:0/87390435 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444009b40 con 0x7fc4540fff00 2023-10-08T08:53:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc44affd700 1 -- 172.21.15.70:0/87390435 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc444009ca0 con 0x7fc4540fff00 2023-10-08T08:53:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4541a3290 con 0x7fc4540fff00 2023-10-08T08:53:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc44affd700 1 -- 172.21.15.70:0/87390435 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400f620 con 0x7fc4540fff00 2023-10-08T08:53:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.110+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4541a37a0 con 0x7fc4540fff00 2023-10-08T08:53:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.111+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc454107aa0 con 0x7fc4540fff00 2023-10-08T08:53:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.112+0000 7fc44affd700 1 -- 172.21.15.70:0/87390435 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fc444010460 con 0x7fc4540fff00 2023-10-08T08:53:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.113+0000 7fc44affd700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc4400a15f0 0x7fc4400a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:53:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.113+0000 7fc44affd700 1 -- 172.21.15.70:0/87390435 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9323+0+0 (secure 0 0 0) 0x7fc4440cd7c0 con 0x7fc4540fff00 2023-10-08T08:53:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.113+0000 7fc459fff700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc4400a15f0 0x7fc4400a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:53:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.113+0000 7fc459fff700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc4400a15f0 0x7fc4400a3ab0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc450006010 tx=0x7fc450000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:53:56.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.117+0000 7fc44affd700 1 -- 172.21.15.70:0/87390435 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc4440967c0 con 0x7fc4540fff00 2023-10-08T08:53:56.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.366+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fc454100c60 con 0x7fc4540fff00 2023-10-08T08:53:56.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.374+0000 7fc44affd700 1 -- 172.21.15.70:0/87390435 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v22) v1 ==== 81+0+734405 (secure 0 0 0) 0x7fc444099de0 con 0x7fc4540fff00 2023-10-08T08:53:56.384 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:53:56.384 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:53:56.384 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 22, 2023-10-08T08:53:56.384 INFO:teuthology.orchestra.run.smithi070.stdout: "active_gid": 14217, 2023-10-08T08:53:56.384 INFO:teuthology.orchestra.run.smithi070.stdout: "active_name": "x", 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addrs": { 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1401477652 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1401477652 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addr": "172.21.15.70:6801/1401477652", 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "active_change": "2023-10-08T08:36:38.980210+0000", 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "active_mgr_features": 4540138322906710015, 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "available": true, 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "standbys": [ 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24133, 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "z", 2023-10-08T08:53:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540138322906710015, 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T08:53:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2023-10-08T08:53:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2023-10-08T08:53:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2023-10-08T08:53:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2023-10-08T08:53:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2023-10-08T08:53:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2023-10-08T08:53:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2023-10-08T08:53:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2023-10-08T08:53:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2023-10-08T08:53:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2023-10-08T08:53:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T08:53:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2023-10-08T08:53:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2023-10-08T08:53:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T08:53:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2023-10-08T08:53:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2023-10-08T08:53:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap" 2023-10-08T08:53:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2023-10-08T08:53:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2023-10-08T08:53:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2023-10-08T08:53:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T08:53:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T08:53:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2023-10-08T08:53:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2023-10-08T08:53:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T08:53:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T08:53:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2023-10-08T08:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2023-10-08T08:53:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2023-10-08T08:53:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2023-10-08T08:53:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2023-10-08T08:53:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2023-10-08T08:53:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T08:53:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2023-10-08T08:53:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2023-10-08T08:53:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2023-10-08T08:53:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T08:53:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2023-10-08T08:53:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2023-10-08T08:53:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2023-10-08T08:53:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2023-10-08T08:53:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T08:53:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2023-10-08T08:53:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2023-10-08T08:53:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2023-10-08T08:53:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2023-10-08T08:53:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2023-10-08T08:53:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2023-10-08T08:53:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T08:53:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2023-10-08T08:53:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2023-10-08T08:53:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T08:53:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T08:53:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2023-10-08T08:53:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2023-10-08T08:53:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T08:53:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2023-10-08T08:53:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2023-10-08T08:53:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T08:53:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2023-10-08T08:53:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2023-10-08T08:53:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T08:53:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2023-10-08T08:53:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2023-10-08T08:53:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T08:53:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2023-10-08T08:53:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2023-10-08T08:53:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2023-10-08T08:53:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2023-10-08T08:53:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.521 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2023-10-08T08:53:56.522 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.526 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2023-10-08T08:53:56.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.529 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.530 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.531 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.533 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T08:53:56.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.536 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.537 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T08:53:56.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.543 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.544 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.545 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.546 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.548 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.548 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T08:53:56.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T08:53:56.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.548 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.548 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T08:53:56.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.550 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.551 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.552 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.553 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T08:53:56.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.555 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.556 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.557 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.558 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.559 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.560 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.561 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.562 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T08:53:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2023-10-08T08:53:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2023-10-08T08:53:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2023-10-08T08:53:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2023-10-08T08:53:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2023-10-08T08:53:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2023-10-08T08:53:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2023-10-08T08:53:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2023-10-08T08:53:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2023-10-08T08:53:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2023-10-08T08:53:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2023-10-08T08:53:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2023-10-08T08:53:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2023-10-08T08:53:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.650 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.650 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.650 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2023-10-08T08:53:56.650 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.651 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.653 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.654 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.655 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.657 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.658 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.659 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.660 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.661 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.663 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.664 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.665 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.668 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.669 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.671 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.672 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.673 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.673 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.673 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.673 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.673 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.673 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.673 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.673 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.675 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.676 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2023-10-08T08:53:56.679 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.682 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.682 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.682 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.682 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.682 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.684 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2023-10-08T08:53:56.686 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.688 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.689 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.690 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.691 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.693 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.694 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.695 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.696 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.697 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.699 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.700 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.703 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.704 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.706 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.708 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.709 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.711 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2023-10-08T08:53:56.712 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.713 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.714 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.715 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.716 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.716 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.716 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.716 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.716 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.716 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.717 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.718 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.719 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.720 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.720 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.720 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.720 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.720 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.720 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.720 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2023-10-08T08:53:56.721 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2023-10-08T08:53:56.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.721 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.721 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.721 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.721 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.721 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.723 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.724 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.725 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.726 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2023-10-08T08:53:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2023-10-08T08:53:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2023-10-08T08:53:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T08:53:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T08:53:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2023-10-08T08:53:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T08:53:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T08:53:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2023-10-08T08:53:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T08:53:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2023-10-08T08:53:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2023-10-08T08:53:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2023-10-08T08:53:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2023-10-08T08:53:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2023-10-08T08:53:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2023-10-08T08:53:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2023-10-08T08:53:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2023-10-08T08:53:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2023-10-08T08:53:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2023-10-08T08:53:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2023-10-08T08:53:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2023-10-08T08:53:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2023-10-08T08:53:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2023-10-08T08:53:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2023-10-08T08:53:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2023-10-08T08:53:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2023-10-08T08:53:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2023-10-08T08:53:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "drive_group_interval": { 2023-10-08T08:53:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "drive_group_interval", 2023-10-08T08:53:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300.0", 2023-10-08T08:53:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T08:53:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2023-10-08T08:53:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T08:53:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2023-10-08T08:53:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2023-10-08T08:53:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2023-10-08T08:53:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2023-10-08T08:53:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.842 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.843 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.843 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:56.843 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2023-10-08T08:53:56.843 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.843 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.843 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.843 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.843 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.844 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2023-10-08T08:53:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.847 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.847 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.847 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.847 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.847 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.847 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.847 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2023-10-08T08:53:56.848 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.849 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2023-10-08T08:53:56.850 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.851 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.852 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.854 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.855 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.855 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.855 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.855 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.855 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.855 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.856 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.856 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.856 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.856 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.856 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.856 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.857 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.857 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.857 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.858 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.858 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.858 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.858 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.858 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.858 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.859 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.859 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.859 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.859 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.860 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2023-10-08T08:53:56.860 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.860 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.860 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.860 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.860 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.860 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.860 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.861 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.862 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.864 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.865 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.867 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.868 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.869 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.870 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.872 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.873 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.874 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.875 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.876 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.877 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.878 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.879 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.882 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2023-10-08T08:53:56.883 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.885 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.886 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.887 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T08:53:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2023-10-08T08:53:56.888 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2023-10-08T08:53:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.889 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2023-10-08T08:53:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2023-10-08T08:53:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.891 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2023-10-08T08:53:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2023-10-08T08:53:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.893 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T08:53:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.894 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.895 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2023-10-08T08:53:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2023-10-08T08:53:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.896 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:56.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.898 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.900 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.901 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.902 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.903 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.905 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.906 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.908 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.909 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.910 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T08:53:56.911 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2023-10-08T08:53:56.912 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.913 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.914 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24152, 2023-10-08T08:53:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "y", 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540138322906710015, 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2023-10-08T08:53:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T08:53:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2023-10-08T08:53:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2023-10-08T08:53:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2023-10-08T08:53:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap" 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2023-10-08T08:53:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2023-10-08T08:53:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2023-10-08T08:53:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2023-10-08T08:53:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2023-10-08T08:53:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2023-10-08T08:53:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T08:53:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T08:53:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.014 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.016 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2023-10-08T08:53:57.017 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.018 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.019 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2023-10-08T08:53:57.021 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.022 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.023 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2023-10-08T08:53:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2023-10-08T08:53:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T08:53:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T08:53:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2023-10-08T08:53:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2023-10-08T08:53:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T08:53:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T08:53:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2023-10-08T08:53:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2023-10-08T08:53:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T08:53:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2023-10-08T08:53:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2023-10-08T08:53:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T08:53:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2023-10-08T08:53:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2023-10-08T08:53:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T08:53:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2023-10-08T08:53:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2023-10-08T08:53:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T08:53:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T08:53:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T08:53:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2023-10-08T08:53:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T08:53:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T08:53:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T08:53:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T08:53:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T08:53:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T08:53:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T08:53:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T08:53:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T08:53:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T08:53:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T08:53:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T08:53:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T08:53:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T08:53:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T08:53:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T08:53:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T08:53:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T08:53:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T08:53:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T08:53:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2023-10-08T08:53:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2023-10-08T08:53:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2023-10-08T08:53:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T08:53:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2023-10-08T08:53:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2023-10-08T08:53:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2023-10-08T08:53:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2023-10-08T08:53:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2023-10-08T08:53:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2023-10-08T08:53:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2023-10-08T08:53:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2023-10-08T08:53:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2023-10-08T08:53:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2023-10-08T08:53:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2023-10-08T08:53:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2023-10-08T08:53:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2023-10-08T08:53:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T08:53:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2023-10-08T08:53:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2023-10-08T08:53:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T08:53:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T08:53:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2023-10-08T08:53:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2023-10-08T08:53:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2023-10-08T08:53:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T08:53:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2023-10-08T08:53:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2023-10-08T08:53:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2023-10-08T08:53:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2023-10-08T08:53:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2023-10-08T08:53:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T08:53:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2023-10-08T08:53:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2023-10-08T08:53:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T08:53:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2023-10-08T08:53:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2023-10-08T08:53:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2023-10-08T08:53:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2023-10-08T08:53:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2023-10-08T08:53:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2023-10-08T08:53:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.274 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2023-10-08T08:53:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2023-10-08T08:53:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2023-10-08T08:53:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2023-10-08T08:53:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2023-10-08T08:53:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2023-10-08T08:53:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2023-10-08T08:53:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "drive_group_interval": { 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "drive_group_interval", 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300.0", 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2023-10-08T08:53:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2023-10-08T08:53:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2023-10-08T08:53:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2023-10-08T08:53:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2023-10-08T08:53:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T08:53:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T08:53:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2023-10-08T08:53:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2023-10-08T08:53:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2023-10-08T08:53:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2023-10-08T08:53:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2023-10-08T08:53:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T08:53:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "modules": [ 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard", 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "iostat", 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "nfs", 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "restful", 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_schedule" 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2023-10-08T08:53:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T08:53:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2023-10-08T08:53:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T08:53:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T08:53:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2023-10-08T08:53:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2023-10-08T08:53:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2023-10-08T08:53:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2023-10-08T08:53:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2023-10-08T08:53:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap" 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2023-10-08T08:53:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2023-10-08T08:53:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T08:53:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2023-10-08T08:53:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2023-10-08T08:53:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2023-10-08T08:53:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T08:53:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2023-10-08T08:53:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T08:53:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2023-10-08T08:53:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2023-10-08T08:53:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T08:53:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2023-10-08T08:53:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2023-10-08T08:53:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2023-10-08T08:53:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2023-10-08T08:53:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2023-10-08T08:53:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2023-10-08T08:53:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T08:53:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.601 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.603 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T08:53:57.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.607 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.609 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T08:53:57.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.612 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.613 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.614 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.615 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.616 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.618 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.619 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.622 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.623 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.624 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.625 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T08:53:57.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.629 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.630 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T08:53:57.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.633 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T08:53:57.634 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.635 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.638 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.639 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.640 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T08:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.646 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.647 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.648 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.649 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.651 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.652 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.653 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.654 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.655 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.656 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.657 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.658 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.659 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.660 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2023-10-08T08:53:57.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.662 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.663 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2023-10-08T08:53:57.664 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.665 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.666 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.667 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.668 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.669 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.670 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.671 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.672 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.674 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2023-10-08T08:53:57.676 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.677 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.678 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.679 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.680 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.682 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.684 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.685 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.687 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.690 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2023-10-08T08:53:57.691 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2023-10-08T08:53:57.692 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.693 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.694 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.695 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.696 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.698 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.699 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2023-10-08T08:53:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.703 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.704 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:57.705 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.706 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.709 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.710 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.711 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.712 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.715 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.718 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.719 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.720 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.721 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2023-10-08T08:53:57.722 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.724 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.725 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.726 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.727 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.728 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.729 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.730 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.731 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.733 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.734 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.735 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.736 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T08:53:57.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.738 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.739 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.740 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.743 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.744 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.746 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.747 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.750 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.751 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.752 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.754 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.755 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.756 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.757 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.759 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.760 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.761 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.762 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.763 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.764 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.766 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.769 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.770 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.771 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.772 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.773 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.774 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.775 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.777 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.780 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.781 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.784 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.785 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.789 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.790 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.791 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.792 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.793 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.794 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.797 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.798 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.799 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.800 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.801 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.803 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2023-10-08T08:53:57.804 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2023-10-08T08:53:57.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.806 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.807 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.808 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.810 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.811 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.813 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T08:53:57.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.815 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.817 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T08:53:57.818 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.819 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.820 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2023-10-08T08:53:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.823 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.824 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.826 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.827 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.829 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.830 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.831 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.832 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.833 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.834 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.835 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.837 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.838 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.839 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.842 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.843 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.844 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.845 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.846 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.847 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.848 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2023-10-08T08:53:57.849 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "drive_group_interval": { 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "drive_group_interval", 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300.0", 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.850 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.851 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.853 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.854 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.855 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.856 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.857 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.858 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.859 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.860 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.862 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.863 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.864 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2023-10-08T08:53:57.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.867 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.868 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.869 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.870 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.871 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2023-10-08T08:53:57.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.874 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.875 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.877 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.878 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2023-10-08T08:53:57.879 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.881 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.883 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.884 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.887 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.888 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.889 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.890 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.891 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.894 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.895 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.896 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.898 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.899 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.901 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.902 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.905 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.906 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.908 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2023-10-08T08:53:57.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.911 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.912 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.913 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.914 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.915 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.916 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.917 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.919 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2023-10-08T08:53:57.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2023-10-08T08:53:57.921 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.923 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.924 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.929 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2023-10-08T08:53:57.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.932 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.934 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.935 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.936 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.939 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.940 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.942 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.943 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.944 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2023-10-08T08:53:57.946 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.948 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.949 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2023-10-08T08:53:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2023-10-08T08:53:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2023-10-08T08:53:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2023-10-08T08:53:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.952 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.952 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.952 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.952 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.952 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2023-10-08T08:53:57.952 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2023-10-08T08:53:57.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.953 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.953 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.953 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.953 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.953 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.953 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.953 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.954 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.954 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.954 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.954 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.954 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.954 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.954 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.955 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.957 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.958 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2023-10-08T08:53:57.959 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2023-10-08T08:53:57.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: "services": { 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard": "https://172.21.15.70:8443/" 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: "always_on_modules": { 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: "octopus": [ 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2023-10-08T08:53:57.963 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "pacific": [ 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2023-10-08T08:53:57.964 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "quincy": [ 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2023-10-08T08:53:57.965 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "reef": [ 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2023-10-08T08:53:57.966 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "last_failure_osd_epoch": 5, 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "active_clients": [ 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2023-10-08T08:53:57.967 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 111182972 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "libcephsqlite", 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2023-10-08T08:53:57.968 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2897101762 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 170249253 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:57.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1177480376 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.970 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 884833603 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-10-08T08:53:57.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2023-10-08T08:53:57.972 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2023-10-08T08:53:57.972 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 549805397 2023-10-08T08:53:57.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:57.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:57.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-10-08T08:53:57.972 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:53:57.974 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:56 smithi105 ceph-mon[103798]: pgmap v604: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:53:57.974 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:56 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/991044751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:53:57.974 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:56 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4043338543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:53:57.974 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:57 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/87390435' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T08:53:57.974 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:56 smithi191 ceph-mon[104220]: pgmap v604: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:53:57.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:56 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/991044751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:53:57.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:56 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4043338543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:53:57.975 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:57 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/87390435' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T08:53:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc4400a15f0 msgr2=0x7fc4400a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc4400a15f0 0x7fc4400a3ab0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc450006010 tx=0x7fc450000bc0 comp rx=0 tx=0).stop 2023-10-08T08:53:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4540fff00 msgr2=0x7fc454197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:53:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4540fff00 0x7fc454197df0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc44400d950 tx=0x7fc44400dd10 comp rx=0 tx=0).stop 2023-10-08T08:53:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 shutdown_connections 2023-10-08T08:53:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fc4400a15f0 0x7fc4400a3ab0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc454105600 0x7fc4541a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4540ff540 0x7fc4541978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 --2- 172.21.15.70:0/87390435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4540fff00 0x7fc454197df0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:53:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 >> 172.21.15.70:0/87390435 conn(0x7fc4540fb030 msgr2=0x7fc4540fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:53:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 shutdown_connections 2023-10-08T08:53:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:53:56.379+0000 7fc45c263700 1 -- 172.21.15.70:0/87390435 wait complete. 2023-10-08T08:53:58.014 DEBUG:tasks.check_counter:Getting stats from a 2023-10-08T08:53:58.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-08T08:53:58.015 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:56 smithi070 ceph-mon[99513]: pgmap v604: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T08:53:58.015 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:56 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/991044751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:53:58.015 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:56 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4043338543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:53:58.015 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:57 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/87390435' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T08:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:53:58.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:53:58 smithi070 ceph-mon[99513]: pgmap v605: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T08:53:58.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:53:58 smithi105 ceph-mon[103798]: pgmap v605: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T08:53:58.844 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:53:58 smithi191 ceph-mon[104220]: pgmap v605: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T08:53:59.788 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:53:59.789 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:53:59.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1328, 2023-10-08T08:53:59.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 1330, 2023-10-08T08:53:59.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 8786153, 2023-10-08T08:53:59.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 413009, 2023-10-08T08:53:59.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 7, 2023-10-08T08:53:59.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2023-10-08T08:53:59.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.140071324, 2023-10-08T08:53:59.789 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.044582845, 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.036648776, 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.046046732, 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1328, 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.062401048, 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000046988 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 911, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 871, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 9722527, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 324756, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.098979137, 2023-10-08T08:53:59.791 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.031379450, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.037932190, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.025290703, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 871, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.045933822, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000052736 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 721696, 2023-10-08T08:53:59.792 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 120672 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 88, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 236, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 4216720, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 357377, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.019828956, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.010336726, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.005244759, 2023-10-08T08:53:59.793 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.002241955, 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 234, 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.014439027, 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000061705 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T08:53:59.794 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 330320 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3484, 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.103453083, 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000029693 2023-10-08T08:53:59.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.796 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2023-10-08T08:53:59.797 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 4019, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 32, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 3720, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 267, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 3973, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 16, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 1, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2023-10-08T08:53:59.798 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2023-10-08T08:53:59.799 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T08:53:59.800 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2023-10-08T08:53:59.801 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2023-10-08T08:53:59.802 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2023-10-08T08:53:59.805 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2023-10-08T08:53:59.805 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2023-10-08T08:53:59.805 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:53:59.805 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:53:59.805 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2023-10-08T08:53:59.805 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2023-10-08T08:53:59.805 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2023-10-08T08:53:59.806 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 7468, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 12, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 25608691, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 25602181, 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2023-10-08T08:53:59.807 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 7468 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1340, 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 4845, 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 3505, 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 201, 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 541, 2023-10-08T08:53:59.808 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 340, 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 4019, 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 7003, 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 2984, 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 62184, 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 207152 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2023-10-08T08:53:59.809 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.810 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2023-10-08T08:53:59.812 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.814 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.815 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.816 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2023-10-08T08:53:59.817 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.818 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2023-10-08T08:53:59.819 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:53:59.821 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 1, 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 0, 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 1, 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2023-10-08T08:53:59.822 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 2031, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:53:59.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:53:59.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:53:59.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:53:59.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:53:59.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:53:59.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2023-10-08T08:53:59.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:53:59.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:53:59.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:53:59.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2023-10-08T08:53:59.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2023-10-08T08:53:59.826 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2023-10-08T08:53:59.826 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:53:59.826 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:53:59.826 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:53:59.826 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:53:59.826 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 269982, 2023-10-08T08:53:59.826 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 1678, 2023-10-08T08:53:59.827 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2023-10-08T08:53:59.827 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2023-10-08T08:53:59.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2023-10-08T08:53:59.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2023-10-08T08:53:59.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:53:59.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2023-10-08T08:53:59.828 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:53:59.828 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2023-10-08T08:53:59.828 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 9256, 2023-10-08T08:53:59.828 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 177, 2023-10-08T08:53:59.828 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:53:59.828 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:53:59.828 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2023-10-08T08:53:59.829 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2023-10-08T08:53:59.829 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 6495754, 2023-10-08T08:53:59.829 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 157013, 2023-10-08T08:53:59.829 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2023-10-08T08:53:59.829 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2023-10-08T08:53:59.829 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2023-10-08T08:53:59.829 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2023-10-08T08:53:59.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.830 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2023-10-08T08:53:59.830 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2023-10-08T08:53:59.830 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2023-10-08T08:53:59.830 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 2071, 2023-10-08T08:53:59.830 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2023-10-08T08:53:59.830 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2023-10-08T08:53:59.830 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 2071, 2023-10-08T08:53:59.831 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2023-10-08T08:53:59.831 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2071, 2023-10-08T08:53:59.831 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.936911911, 2023-10-08T08:53:59.831 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001418112 2023-10-08T08:53:59.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.831 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2023-10-08T08:53:59.831 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2023-10-08T08:53:59.831 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2071, 2023-10-08T08:53:59.832 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2072 2023-10-08T08:53:59.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.832 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 2071, 2023-10-08T08:53:59.832 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 2071, 2023-10-08T08:53:59.832 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2023-10-08T08:53:59.832 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2023-10-08T08:53:59.832 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2023-10-08T08:53:59.832 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 1299, 2023-10-08T08:53:59.833 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2023-10-08T08:53:59.833 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 770, 2023-10-08T08:53:59.833 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2023-10-08T08:53:59.833 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2023-10-08T08:53:59.833 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2023-10-08T08:53:59.833 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2023-10-08T08:53:59.833 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2023-10-08T08:53:59.833 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2023-10-08T08:53:59.834 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2023-10-08T08:53:59.835 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 98, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 12, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 8, 2023-10-08T08:53:59.836 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 8, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: "osd-slow-ops": { 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:53:59.838 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 2323, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 22500700, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 2323, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2323, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 22500700, 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:53:59.839 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2023-10-08T08:53:59.840 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2071, 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 21414392, 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2071, 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 21414392, 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.841 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2071, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 2071, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2071, 2023-10-08T08:53:59.842 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 2071, 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2023-10-08T08:53:59.843 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:53:59.844 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x561869418960": { 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2023-10-08T08:53:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:53:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:53:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:53:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:53:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:53:59.846 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:54:00.342 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-10-08T08:54:00.342 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-10-08T08:54:00.342 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2023-10-08T08:54:00.343 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2023-10-08T08:54:00.343 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2023-10-08T08:54:00.343 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-10-08T08:54:00.343 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T08:54:00.343 DEBUG:tasks.check_counter:Getting stats from d 2023-10-08T08:54:00.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-08T08:54:00.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:00 smithi105 ceph-mon[103798]: pgmap v606: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 15 op/s 2023-10-08T08:54:00.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:00 smithi191 ceph-mon[104220]: pgmap v606: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 15 op/s 2023-10-08T08:54:00.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:00 smithi070 ceph-mon[99513]: pgmap v606: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 15 op/s 2023-10-08T08:54:00.902 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:54:02.066 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:54:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2023-10-08T08:54:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2023-10-08T08:54:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2023-10-08T08:54:02.066 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.001747787, 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000252676, 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:02.067 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 204, 2023-10-08T08:54:02.068 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 201, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 468736, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 120400, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.030431845, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.012644718, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.013171412, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.004594288, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 200, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.010737913, 2023-10-08T08:54:02.069 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000053689 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 468736, 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 120400 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:02.070 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 5, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 154, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 3152, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 103712, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 3, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.011855993, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.008875064, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.001428603, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 153, 2023-10-08T08:54:02.071 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.013227884, 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000086456 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 103712 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2023-10-08T08:54:02.072 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:02.073 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:02.074 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:02.075 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148984, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 30, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2023-10-08T08:54:02.076 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2023-10-08T08:54:02.077 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 205, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 439909, 2023-10-08T08:54:02.078 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 205, 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 205, 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 439909, 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:02.079 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:54:02.460 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-08T08:54:02.460 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-08T08:54:02.460 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-10-08T08:54:02.460 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-10-08T08:54:02.460 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-10-08T08:54:02.460 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-10-08T08:54:02.460 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-10-08T08:54:02.460 DEBUG:tasks.check_counter:Getting stats from g 2023-10-08T08:54:02.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-08T08:54:02.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:02 smithi070 ceph-mon[99513]: pgmap v607: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-08T08:54:02.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:02 smithi191 ceph-mon[104220]: pgmap v607: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-08T08:54:02.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:02 smithi105 ceph-mon[103798]: pgmap v607: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-08T08:54:03.017 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:54:04.232 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 997, 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 959, 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 5158868, 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 352856, 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.115362851, 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.046060696, 2023-10-08T08:54:04.233 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.032803789, 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.028224933, 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 958, 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.059908325, 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000062534 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 719248, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 121472 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 942, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 1089, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 17016502, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 623992, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.093385648, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.026609130, 2023-10-08T08:54:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.030164867, 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.029524933, 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1088, 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.044444373, 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000040849 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-08T08:54:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 332528 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 390, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 392, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2041336, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 121302, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.036765025, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.010418647, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.010780507, 2023-10-08T08:54:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.012203318, 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 390, 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.017725157, 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000045449 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T08:54:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3465, 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.090305568, 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000026062 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2023-10-08T08:54:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 5857, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 0, 2023-10-08T08:54:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 0, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 5857, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 5857, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 6, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 1, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2023-10-08T08:54:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2023-10-08T08:54:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T08:54:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2023-10-08T08:54:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:54:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2023-10-08T08:54:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 7508, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 11, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 27104575, 2023-10-08T08:54:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 27100551, 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 7508 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1885, 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 6079, 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 4194, 2023-10-08T08:54:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 282, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 695, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 413, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 5857, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 8636, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 2779, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 65360, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 207152 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2023-10-08T08:54:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 2, 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 2, 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 0, 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 2, 2023-10-08T08:54:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 2033, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 274071, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 2307, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 9256, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 177, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 9236558, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 195519, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2023-10-08T08:54:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 2071, 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 2071, 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2071, 2023-10-08T08:54:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 4.980850608, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002405046 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2071, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2072 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 2071, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 2071, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2023-10-08T08:54:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 1295, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 774, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2023-10-08T08:54:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2023-10-08T08:54:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2023-10-08T08:54:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 98, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 12, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 6, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 6, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2023-10-08T08:54:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "osd-slow-ops": { 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2023-10-08T08:54:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 2325, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 23991722, 2023-10-08T08:54:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 2325, 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2325, 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 23991722, 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2071, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 22910276, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2071, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 22910276, 2023-10-08T08:54:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2023-10-08T08:54:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2071, 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 2071, 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2071, 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 2071, 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:54:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x55e5477aa960": { 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:04.283 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:54:04.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:04 smithi191 ceph-mon[104220]: pgmap v608: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-10-08T08:54:04.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:04 smithi070 ceph-mon[99513]: pgmap v608: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-10-08T08:54:04.666 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-10-08T08:54:04.666 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-10-08T08:54:04.666 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-10-08T08:54:04.667 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-10-08T08:54:04.667 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-10-08T08:54:04.667 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-10-08T08:54:04.667 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T08:54:04.667 DEBUG:tasks.check_counter:Getting stats from j 2023-10-08T08:54:04.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-08T08:54:04.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:04 smithi105 ceph-mon[103798]: pgmap v608: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-10-08T08:54:05.262 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T08:54:06.388 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-10-08T08:54:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 205, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 202, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 469008, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 121024, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.032561229, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.013287749, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.013343287, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.004843281, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 201, 2023-10-08T08:54:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.011699213, 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000058205 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 469008, 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 121024 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 154, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 160, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 103616, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 3, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.012229460, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.009330857, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.001182606, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 152, 2023-10-08T08:54:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.008217856, 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000054064 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 103616 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 4, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 4, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2992, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 448, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.000695750, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000037539, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000638468, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000764500, 2023-10-08T08:54:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000254833 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2023-10-08T08:54:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148967, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 29, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2023-10-08T08:54:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 206, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 440039, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 206, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2023-10-08T08:54:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 206, 2023-10-08T08:54:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 440039, 2023-10-08T08:54:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2023-10-08T08:54:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2023-10-08T08:54:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2023-10-08T08:54:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2023-10-08T08:54:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-10-08T08:54:06.401 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-10-08T08:54:06.411 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:06 smithi070 ceph-mon[99513]: pgmap v609: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:54:06.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:06 smithi191 ceph-mon[104220]: pgmap v609: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:54:06.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:06 smithi105 ceph-mon[103798]: pgmap v609: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:54:06.813 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-08T08:54:06.813 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-08T08:54:06.813 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-10-08T08:54:06.813 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-10-08T08:54:06.813 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-10-08T08:54:06.813 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-10-08T08:54:06.814 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-10-08T08:54:06.814 DEBUG:tasks.check_counter:Getting stats from b 2023-10-08T08:54:06.814 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-08T08:54:07.390 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:54:08.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:08 smithi191 ceph-mon[104220]: pgmap v610: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:54:08.604 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2023-10-08T08:54:08.604 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:08.604 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 427431, 2023-10-08T08:54:08.604 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 474556, 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 82040475, 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 135561612, 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 74, 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 5, 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 11.852061368, 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 4.745097726, 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 9.027219064, 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.229127906, 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:08.605 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 474555, 2023-10-08T08:54:08.606 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 28.147242625, 2023-10-08T08:54:08.606 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000059312 2023-10-08T08:54:08.606 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.606 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:08.606 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 870935, 2023-10-08T08:54:08.606 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.071425472, 2023-10-08T08:54:08.606 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000082 2023-10-08T08:54:08.606 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 12180848, 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 39435200 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 123478, 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 119214, 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 27637077, 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 47505978, 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 10, 2023-10-08T08:54:08.607 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 7, 2023-10-08T08:54:08.608 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 4.262888847, 2023-10-08T08:54:08.608 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 1.545105300, 2023-10-08T08:54:08.608 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 2.728224459, 2023-10-08T08:54:08.608 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.369127343, 2023-10-08T08:54:08.608 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:08.608 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 119212, 2023-10-08T08:54:08.608 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 22.910600443, 2023-10-08T08:54:08.608 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000192183 2023-10-08T08:54:08.608 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 221078, 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.022626506, 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000102 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 322224, 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 443120 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:08.609 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 34984, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 35168, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 16460719, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 58201063, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 30, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 7, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 1.851726314, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.742696475, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.922683231, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.325311898, 2023-10-08T08:54:08.610 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 35167, 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 26.376973228, 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000750049 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 45368, 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.006318839, 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000139 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T08:54:08.611 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 1, 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-MDSRank": { 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 6509, 2023-10-08T08:54:08.612 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 22.475984180, 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.003453062 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-PurgeQueue": { 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3074, 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.444509234, 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000144602 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:08.613 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": { 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: "request": 17083, 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: "reply": 16984, 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: "reply_latency": { 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 16984, 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 72.052188996, 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.004242356 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_reply": 0, 2023-10-08T08:54:08.614 INFO:teuthology.orchestra.run.smithi105.stdout: "forward": 99, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_complete": 7, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_keys": 0, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_commit": 2338, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_split": 8, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_merge": 0, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes": 4556, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_top": 2442, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_bottom": 1906, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pin_tail": 208, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pinned": 1058, 2023-10-08T08:54:08.615 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_expired": 18094, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_with_caps": 1, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": 2, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "subtrees": 6, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse": 22639, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_hit": 20164, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_forward": 29, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_discover": 1645, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_dir_fetch": 2, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_remote_ino": 0, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_lock": 33, 2023-10-08T08:54:08.616 INFO:teuthology.orchestra.run.smithi105.stdout: "load_cent": 0, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "q": 0, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "exported": 100, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "exported_inodes": 15053, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "imported": 50, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "imported_inodes": 4900, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_dir_fetch": 0, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_backtrace_fetch": 5125, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_peer_discover": 0, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rfiles": 0, 2023-10-08T08:54:08.617 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rbytes": 0, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rsnaps": 6, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_fetch": 5125, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_set_tag": 0, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_inodes": 782, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_base_inodes": 4, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dirfrag_rstats": 778, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_file_inodes": 4343, 2023-10-08T08:54:08.618 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_inode_file_caps": 62, 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_revoke": 4054, 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_grant": 14016, 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_trunc": 97, 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps": 13094, 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps_dirty": 9307, 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_cap_release": 38, 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: "process_request_cap_release": 4355 2023-10-08T08:54:08.619 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_cache": { 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update": 1035, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update_receipt": 4454, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_try_discover": 3009, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_send_discover": 2991, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_handle_discover": 2293, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays": 312, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_delayed": 0, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_created": 1905, 2023-10-08T08:54:08.620 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_enqueued": 1566, 2023-10-08T08:54:08.621 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_reintegrated": 50, 2023-10-08T08:54:08.621 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_migrated": 0, 2023-10-08T08:54:08.621 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_processing": 0, 2023-10-08T08:54:08.621 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:54:08.621 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:54:08.621 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_started": 0, 2023-10-08T08:54:08.621 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_completed": 0, 2023-10-08T08:54:08.621 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_enqueue_scrub": 4, 2023-10-08T08:54:08.621 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_exportdir": 100, 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_flush": 0, 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragmentdir": 8, 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragstats": 0, 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_inodestats": 0 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_log": { 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: "evlrg": 1, 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: "evadd": 28100, 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: "evex": 26748, 2023-10-08T08:54:08.622 INFO:teuthology.orchestra.run.smithi105.stdout: "evtrm": 26748, 2023-10-08T08:54:08.623 INFO:teuthology.orchestra.run.smithi105.stdout: "ev": 1352, 2023-10-08T08:54:08.623 INFO:teuthology.orchestra.run.smithi105.stdout: "evexg": 0, 2023-10-08T08:54:08.623 INFO:teuthology.orchestra.run.smithi105.stdout: "evexd": 142, 2023-10-08T08:54:08.623 INFO:teuthology.orchestra.run.smithi105.stdout: "segadd": 51, 2023-10-08T08:54:08.623 INFO:teuthology.orchestra.run.smithi105.stdout: "segex": 48, 2023-10-08T08:54:08.623 INFO:teuthology.orchestra.run.smithi105.stdout: "segtrm": 48, 2023-10-08T08:54:08.623 INFO:teuthology.orchestra.run.smithi105.stdout: "seg": 3, 2023-10-08T08:54:08.623 INFO:teuthology.orchestra.run.smithi105.stdout: "segmjr": 1, 2023-10-08T08:54:08.623 INFO:teuthology.orchestra.run.smithi105.stdout: "segexg": 0, 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: "segexd": 1, 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: "expos": 70536427, 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: "wrpos": 74057226, 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: "rdpos": 0, 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: "jlat": { 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2255, 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 151.349125994, 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.067117129 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.624 INFO:teuthology.orchestra.run.smithi105.stdout: "replayed": 0 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_mem": { 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "ino": 1968, 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "ino+": 19710, 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "ino-": 17742, 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "dir": 319, 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "dir+": 3606, 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "dir-": 3287, 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "dn": 4556, 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "dn+": 24433, 2023-10-08T08:54:08.625 INFO:teuthology.orchestra.run.smithi105.stdout: "dn-": 19877, 2023-10-08T08:54:08.626 INFO:teuthology.orchestra.run.smithi105.stdout: "cap": 2, 2023-10-08T08:54:08.626 INFO:teuthology.orchestra.run.smithi105.stdout: "cap+": 16368, 2023-10-08T08:54:08.626 INFO:teuthology.orchestra.run.smithi105.stdout: "cap-": 16366, 2023-10-08T08:54:08.626 INFO:teuthology.orchestra.run.smithi105.stdout: "rss": 146028, 2023-10-08T08:54:08.626 INFO:teuthology.orchestra.run.smithi105.stdout: "heap": 207152 2023-10-08T08:54:08.626 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.626 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_server": { 2023-10-08T08:54:08.626 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_client_request": 19801, 2023-10-08T08:54:08.626 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_server_request": 172, 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_request": 17083, 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_session": 118, 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_peer_request": 571, 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: "req_create_latency": { 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 10981, 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 17.769332813, 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001618188 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getattr_latency": { 2023-10-08T08:54:08.627 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 170, 2023-10-08T08:54:08.628 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.313041270, 2023-10-08T08:54:08.628 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001841419 2023-10-08T08:54:08.628 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.628 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getfilelock_latency": { 2023-10-08T08:54:08.628 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.628 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.628 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.628 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.628 INFO:teuthology.orchestra.run.smithi105.stdout: "req_link_latency": { 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 85, 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.591339670, 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.006956937 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookup_latency": { 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1180, 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 2.054791902, 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001741349 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.629 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookuphash_latency": { 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupino_latency": { 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.630 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupname_latency": { 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupparent_latency": { 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.631 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupsnap_latency": { 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lssnap_latency": { 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 11, 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.002494334, 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000226757 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.632 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mkdir_latency": { 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1466, 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 9.630239227, 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.006569058 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mknod_latency": { 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 176, 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.093950764, 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.006215629 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.633 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mksnap_latency": { 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 11, 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 5.386665598, 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.489696872 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: "req_open_latency": { 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 43, 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.012731782, 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000296087 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.634 INFO:teuthology.orchestra.run.smithi105.stdout: "req_readdir_latency": { 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 353, 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 3.114522986, 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.008823011 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rename_latency": { 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 194, 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 7.284260470, 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.037547734 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.635 INFO:teuthology.orchestra.run.smithi105.stdout: "req_renamesnap_latency": { 2023-10-08T08:54:08.636 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.636 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.636 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.636 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.636 INFO:teuthology.orchestra.run.smithi105.stdout: "req_snapdiff_latency": { 2023-10-08T08:54:08.636 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.636 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.636 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.636 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmdir_latency": { 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 403, 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 13.601240937, 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.033749977 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmsnap_latency": { 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 5, 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.026343068, 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.005268613 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.637 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmxattr_latency": { 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setattr_latency": { 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 100, 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.936270171, 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.019362701 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.638 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setdirlayout_latency": { 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setfilelock_latency": { 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setlayout_latency": { 2023-10-08T08:54:08.639 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.640 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.640 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.640 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.640 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setxattr_latency": { 2023-10-08T08:54:08.640 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1, 2023-10-08T08:54:08.640 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.002520644, 2023-10-08T08:54:08.640 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.002520644 2023-10-08T08:54:08.640 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.640 INFO:teuthology.orchestra.run.smithi105.stdout: "req_symlink_latency": { 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 182, 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 5.821501721, 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.031986273 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: "req_unlink_latency": { 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1623, 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 3.410941639, 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.002101627 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.641 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getvxattr_latency": { 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_sessions": { 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: "session_count": 2, 2023-10-08T08:54:08.642 INFO:teuthology.orchestra.run.smithi105.stdout: "session_add": 3, 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "session_remove": 1, 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_open": 2, 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_stale": 0, 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "total_load": 87, 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "average_load": 43, 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "avg_session_uptime": 607, 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "mdthresh_evicted": 0 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 240, 2023-10-08T08:54:08.643 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 240, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:08.644 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:08.645 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:08.645 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:08.645 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:08.645 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:08.645 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:08.645 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:08.645 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:08.645 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:08.645 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:08.646 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:08.646 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:08.646 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:08.646 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:08.646 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:08.646 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:08.646 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:08.646 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 2745835, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 2792, 2023-10-08T08:54:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 1056, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 12, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 9256, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 177, 2023-10-08T08:54:08.648 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:08.649 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:08.649 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:08.649 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2023-10-08T08:54:08.649 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 8892263, 2023-10-08T08:54:08.649 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 341046, 2023-10-08T08:54:08.649 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:08.649 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2023-10-08T08:54:08.649 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:08.649 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: "objecter": { 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: "op_active": 0, 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: "op_laggy": 0, 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send": 31635, 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send_bytes": 91031355, 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: "op_resend": 31, 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: "op_reply": 31635, 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: "op_latency": { 2023-10-08T08:54:08.650 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 31635, 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 7936.667831598, 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.250882498 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: "op_inflight": 0, 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: "oplen_avg": { 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 31635, 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 64507 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: "op": 31635, 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: "op_r": 5210, 2023-10-08T08:54:08.651 INFO:teuthology.orchestra.run.smithi105.stdout: "op_w": 26425, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "op_rmw": 0, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "op_pg": 0, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_stat": 900, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_create": 18460, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_read": 74, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_write": 2325, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writefull": 121, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writesame": 0, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_append": 0, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_zero": 17, 2023-10-08T08:54:08.652 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_truncate": 8, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_delete": 2980, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_mapext": 0, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_sparse_read": 0, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_clonerange": 0, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_getxattr": 5136, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_setxattr": 29290, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_rmxattr": 0, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_call": 0, 2023-10-08T08:54:08.653 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_watch": 0, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_notify": 0, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls": 0, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_other": 109, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_active": 0, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_send": 0, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_resend": 0, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_ping": 0, 2023-10-08T08:54:08.654 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_active": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_send": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_resend": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_active": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_send": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_resend": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_active": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_send": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_resend": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "command_active": 0, 2023-10-08T08:54:08.655 INFO:teuthology.orchestra.run.smithi105.stdout: "command_send": 0, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "command_resend": 0, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "map_epoch": 98, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "map_full": 0, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "map_inc": 17, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_sessions": 12, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_open": 12, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_close": 0, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_laggy": 0, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_wr": 4619, 2023-10-08T08:54:08.656 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_rd": 14, 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_del": 454 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: "oft": { 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_objs": 1, 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_updates": 0, 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_removes": 0 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: "osd-slow-ops": { 2023-10-08T08:54:08.657 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_ops_count": 0 2023-10-08T08:54:08.658 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.658 INFO:teuthology.orchestra.run.smithi105.stdout: "purge_queue": { 2023-10-08T08:54:08.658 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops": 0, 2023-10-08T08:54:08.658 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops_high_water": 14, 2023-10-08T08:54:08.658 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing": 0, 2023-10-08T08:54:08.658 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_high_water": 8, 2023-10-08T08:54:08.658 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed": 1566, 2023-10-08T08:54:08.658 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_item_in_journal": 0 2023-10-08T08:54:08.658 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.659 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:08.659 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:08.659 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2023-10-08T08:54:08.659 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:08.659 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 585889, 2023-10-08T08:54:08.659 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 72029936, 2023-10-08T08:54:08.659 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:08.659 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 585889, 2023-10-08T08:54:08.659 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 585889, 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 72029936, 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_bytes": { 2023-10-08T08:54:08.660 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 31635, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 91223657, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 31635, 2023-10-08T08:54:08.661 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 91223657, 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_ops": { 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 1024, 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:08.662 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 31635, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 31635, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 31635, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 31635, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.663 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 1566, 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 192414, 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:08.664 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 1566, 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 70, 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 192414, 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:08.665 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle-0x55d2fbc346e0": { 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 60, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 28100, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 69862922, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 28100, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2255, 2023-10-08T08:54:08.666 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 69862862, 2023-10-08T08:54:08.667 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:08.667 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:08.667 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:08.667 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:08.667 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:08.667 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:08.667 INFO:teuthology.orchestra.run.smithi105.stdout:} 2023-10-08T08:54:08.668 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:08 smithi105 ceph-mon[103798]: pgmap v610: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:54:08.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:08 smithi070 ceph-mon[99513]: pgmap v610: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:54:08.944 INFO:tasks.check_counter:Daemon mds.b mds.exported=100 2023-10-08T08:54:08.944 INFO:tasks.check_counter:Daemon mds.b mds.imported=50 2023-10-08T08:54:08.944 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1035 2023-10-08T08:54:08.944 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=4454 2023-10-08T08:54:08.944 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2023-10-08T08:54:08.944 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2023-10-08T08:54:08.945 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2023-10-08T08:54:08.945 DEBUG:tasks.check_counter:Getting stats from e 2023-10-08T08:54:08.945 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-08T08:54:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:54:10.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:10 smithi105 ceph-mon[103798]: pgmap v611: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:54:10.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:10 smithi191 ceph-mon[104220]: pgmap v611: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:54:10.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:10 smithi070 ceph-mon[99513]: pgmap v611: 129 pgs: 129 active+clean; 142 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-10-08T08:54:10.945 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2023-10-08T08:54:10.946 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:10.946 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 848, 2023-10-08T08:54:10.946 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 848, 2023-10-08T08:54:10.946 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 3010471, 2023-10-08T08:54:10.946 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 262942, 2023-10-08T08:54:10.946 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 7, 2023-10-08T08:54:10.946 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 3, 2023-10-08T08:54:10.946 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.081285312, 2023-10-08T08:54:10.946 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.029421671, 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.019084531, 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.024208162, 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 847, 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.039757562, 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000046939 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.947 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 168, 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 152, 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 1214106, 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 77409, 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 4, 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 3, 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.021997652, 2023-10-08T08:54:10.948 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.006095249, 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.010568439, 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.004765609, 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 151, 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.008687502, 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000057533 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.949 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 294528, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 69888 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 437, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 522, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 4303477, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 367718, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 5, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 4, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.044563889, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.012456999, 2023-10-08T08:54:10.950 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.012296319, 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.015454708, 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 520, 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.031281213, 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000060156 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.951 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 232112 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 1, 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-MDSRank": { 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2177, 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.070438185, 2023-10-08T08:54:10.952 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000032355 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-PurgeQueue": { 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": { 2023-10-08T08:54:10.953 INFO:teuthology.orchestra.run.smithi105.stdout: "request": 0, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "reply": 0, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "reply_latency": { 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_reply": 0, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "forward": 0, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_complete": 0, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_keys": 0, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_commit": 0, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_split": 0, 2023-10-08T08:54:10.954 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_merge": 0, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes": 3254, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_top": 1423, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_bottom": 1794, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pin_tail": 37, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pinned": 1221, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_expired": 181, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_with_caps": 0, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": 0, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "subtrees": 2, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse": 0, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_hit": 0, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_forward": 0, 2023-10-08T08:54:10.955 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_discover": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_dir_fetch": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_remote_ino": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_lock": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "load_cent": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "q": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "exported": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "exported_inodes": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "imported": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "imported_inodes": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_dir_fetch": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_backtrace_fetch": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_peer_discover": 0, 2023-10-08T08:54:10.956 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rfiles": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rbytes": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rsnaps": 6, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_set_tag": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_inodes": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_file_inodes": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_inode_file_caps": 0, 2023-10-08T08:54:10.957 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_grant": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps_dirty": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_cap_release": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "process_request_cap_release": 0 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_cache": { 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update_receipt": 0, 2023-10-08T08:54:10.958 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_try_discover": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_send_discover": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_handle_discover": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_delayed": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_created": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_enqueued": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_reintegrated": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_migrated": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_processing": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:54:10.959 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_started": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_completed": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_exportdir": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_flush": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragmentdir": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragstats": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_inodestats": 0 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_log": { 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "evlrg": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "evadd": 0, 2023-10-08T08:54:10.960 INFO:teuthology.orchestra.run.smithi105.stdout: "evex": 0, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "evtrm": 0, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "ev": 2738, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "evexg": 0, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "evexd": 0, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "segadd": 0, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "segex": 0, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "segtrm": 0, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "seg": 3, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "segmjr": 4, 2023-10-08T08:54:10.961 INFO:teuthology.orchestra.run.smithi105.stdout: "segexg": 0, 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "segexd": 0, 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "expos": 70536427, 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "wrpos": 74057226, 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "rdpos": 74057166, 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "jlat": { 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "replayed": 2738 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_mem": { 2023-10-08T08:54:10.962 INFO:teuthology.orchestra.run.smithi105.stdout: "ino": 1187, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "ino+": 1980, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "ino-": 793, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "dir": 140, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "dir+": 160, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "dir-": 20, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "dn": 3254, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "dn+": 3490, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "dn-": 236, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "cap": 0, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "cap+": 0, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "cap-": 0, 2023-10-08T08:54:10.963 INFO:teuthology.orchestra.run.smithi105.stdout: "rss": 55524, 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "heap": 207152 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_server": { 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_client_request": 0, 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_server_request": 0, 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_request": 0, 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_session": 0, 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_peer_request": 0, 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "req_create_latency": { 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.964 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getattr_latency": { 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getfilelock_latency": { 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "req_link_latency": { 2023-10-08T08:54:10.965 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookup_latency": { 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookuphash_latency": { 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.966 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupino_latency": { 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupname_latency": { 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupparent_latency": { 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.967 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupsnap_latency": { 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lssnap_latency": { 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.968 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mkdir_latency": { 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mknod_latency": { 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mksnap_latency": { 2023-10-08T08:54:10.969 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "req_open_latency": { 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "req_readdir_latency": { 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.970 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rename_latency": { 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "req_renamesnap_latency": { 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "req_snapdiff_latency": { 2023-10-08T08:54:10.971 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmdir_latency": { 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmsnap_latency": { 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.972 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmxattr_latency": { 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setattr_latency": { 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.973 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setdirlayout_latency": { 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setfilelock_latency": { 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setlayout_latency": { 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.974 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setxattr_latency": { 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: "req_symlink_latency": { 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.975 INFO:teuthology.orchestra.run.smithi105.stdout: "req_unlink_latency": { 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getvxattr_latency": { 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:10.976 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_sessions": { 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "session_count": 2, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "session_add": 2, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "session_remove": 0, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_open": 0, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_stale": 0, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "total_load": 0, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "average_load": 0, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "avg_session_uptime": 2042, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "mdthresh_evicted": 0 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2023-10-08T08:54:10.977 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:10.978 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:10.979 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 252540, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 1443, 2023-10-08T08:54:10.980 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 9256, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 177, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:10.981 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 5389170, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 68335, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "objecter": { 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "op_active": 0, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "op_laggy": 0, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send": 1304, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send_bytes": 26, 2023-10-08T08:54:10.982 INFO:teuthology.orchestra.run.smithi105.stdout: "op_resend": 4, 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "op_reply": 1304, 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "op_latency": { 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1304, 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.739985406, 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000567473 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "op_inflight": 0, 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "oplen_avg": { 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1304, 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1305 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "op": 1304, 2023-10-08T08:54:10.983 INFO:teuthology.orchestra.run.smithi105.stdout: "op_r": 1304, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "op_w": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "op_rmw": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "op_pg": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_stat": 824, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_create": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_read": 477, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_write": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writefull": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writesame": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_append": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_zero": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_truncate": 0, 2023-10-08T08:54:10.984 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_delete": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_mapext": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_sparse_read": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_clonerange": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_getxattr": 2, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_setxattr": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_rmxattr": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_call": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_watch": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_notify": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:54:10.985 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_other": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_active": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_send": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_resend": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_ping": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_active": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_send": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_resend": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_active": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_send": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_resend": 0, 2023-10-08T08:54:10.986 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_active": 0, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_send": 0, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_resend": 0, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "command_active": 0, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "command_send": 0, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "command_resend": 0, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "map_epoch": 99, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "map_full": 0, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "map_inc": 9, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_sessions": 7, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_open": 7, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_close": 0, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_laggy": 0, 2023-10-08T08:54:10.987 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_wr": 0, 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_rd": 2, 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_del": 0 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "oft": { 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_objs": 0, 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_updates": 0, 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_removes": 0 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "osd-slow-ops": { 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_ops_count": 0 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.988 INFO:teuthology.orchestra.run.smithi105.stdout: "purge_queue": { 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops": 0, 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing": 0, 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_high_water": 0, 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed": 0, 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_item_in_journal": 0 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:10.989 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 1449, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 8387390, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 1449, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 1449, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 8387390, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:10.990 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_bytes": { 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 1304, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 7861010, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 1304, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 7861010, 2023-10-08T08:54:10.991 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_ops": { 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 1024, 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:10.992 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 1304, 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 1304, 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 1304, 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 1304, 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:54:10.993 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.994 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle-0x5646a14d4960": { 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:10.995 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:10.996 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 0, 2023-10-08T08:54:10.996 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 0, 2023-10-08T08:54:10.996 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:10.996 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:10.996 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:10.996 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:10.996 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:10.996 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:10.996 INFO:teuthology.orchestra.run.smithi105.stdout:} 2023-10-08T08:54:11.316 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-08T08:54:11.316 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-08T08:54:11.316 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-10-08T08:54:11.316 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-10-08T08:54:11.316 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2023-10-08T08:54:11.316 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-10-08T08:54:11.316 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T08:54:11.316 DEBUG:tasks.check_counter:Getting stats from h 2023-10-08T08:54:11.317 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-08T08:54:11.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:11 smithi191 ceph-mon[104220]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T08:54:11.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:11 smithi070 ceph-mon[99513]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T08:54:11.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:11 smithi105 ceph-mon[103798]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T08:54:11.875 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:54:12.420 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:12 smithi105 ceph-mon[103798]: pgmap v613: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 140 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 818 B/s wr, 11 op/s 2023-10-08T08:54:12.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:12 smithi191 ceph-mon[104220]: pgmap v613: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 140 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 818 B/s wr, 11 op/s 2023-10-08T08:54:12.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:12 smithi070 ceph-mon[99513]: pgmap v613: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 140 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 818 B/s wr, 11 op/s 2023-10-08T08:54:13.087 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2023-10-08T08:54:13.087 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:13.087 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 29013, 2023-10-08T08:54:13.087 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 29486, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 13160778, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 35028925, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 14, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 6, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 1.437669940, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.547678066, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.942223690, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.113030045, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 29483, 2023-10-08T08:54:13.088 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.223800481, 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000041508 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 49051, 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.006471525, 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000131 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.089 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 27681, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 45472, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 13468846, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 30517955, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 18, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 5, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 1.803420020, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.843824809, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 1.150982701, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.085558747, 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:13.090 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 45472, 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 36.228247962, 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000796715 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 56436, 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.009012416, 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000159 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 4483568, 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 16430856 2023-10-08T08:54:13.091 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 15307, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 17419, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 6445624, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 20658555, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 10, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 7, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.869497344, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.322890519, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.433348010, 2023-10-08T08:54:13.092 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.143993241, 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 17418, 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.998017218, 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000057298 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 19858, 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.002942791, 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000148 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 745232, 2023-10-08T08:54:13.093 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 130864 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 1, 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-MDSRank": { 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 4445, 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 14.054537891, 2023-10-08T08:54:13.094 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.003161875 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-PurgeQueue": { 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 8320, 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.378583535, 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000165695 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:13.095 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": { 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "request": 8215, 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "reply": 8152, 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "reply_latency": { 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 8152, 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 31.671673689, 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.003885141 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_reply": 0, 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "forward": 61, 2023-10-08T08:54:13.096 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_complete": 5, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_keys": 0, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_commit": 11, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_split": 0, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_merge": 0, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes": 10242, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_top": 1, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_bottom": 1, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pin_tail": 10240, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pinned": 10240, 2023-10-08T08:54:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_expired": 3047, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_with_caps": 0, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": 0, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "subtrees": 3, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse": 14131, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_hit": 12073, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_forward": 58, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_discover": 1406, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_dir_fetch": 0, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_remote_ino": 0, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_lock": 26, 2023-10-08T08:54:13.098 INFO:teuthology.orchestra.run.smithi105.stdout: "load_cent": 0, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "q": 0, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "exported": 12, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "exported_inodes": 357, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "imported": 54, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "imported_inodes": 5182, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_dir_fetch": 0, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_backtrace_fetch": 3304, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_peer_discover": 18, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rfiles": 0, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rbytes": 0, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rsnaps": 5, 2023-10-08T08:54:13.099 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_fetch": 3304, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_set_tag": 0, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_inodes": 287, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dirfrag_rstats": 287, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_file_inodes": 3017, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_inode_file_caps": 9, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_revoke": 1633, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_grant": 6103, 2023-10-08T08:54:13.100 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_trunc": 14, 2023-10-08T08:54:13.101 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:54:13.101 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:54:13.101 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps": 4282, 2023-10-08T08:54:13.101 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps_dirty": 2470, 2023-10-08T08:54:13.101 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_cap_release": 57, 2023-10-08T08:54:13.101 INFO:teuthology.orchestra.run.smithi105.stdout: "process_request_cap_release": 6081 2023-10-08T08:54:13.101 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.101 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_cache": { 2023-10-08T08:54:13.101 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update": 1783, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update_receipt": 3879, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_try_discover": 2638, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_send_discover": 2565, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_handle_discover": 3501, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays": 459, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_delayed": 0, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_created": 4969, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_enqueued": 4511, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_reintegrated": 21, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_migrated": 1, 2023-10-08T08:54:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_processing": 0, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_started": 0, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_completed": 0, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_exportdir": 13, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_flush": 0, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragmentdir": 0, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragstats": 0, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_inodestats": 0 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.103 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_log": { 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "evlrg": 1, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "evadd": 16283, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "evex": 0, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "evtrm": 0, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "ev": 16283, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "evexg": 0, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "evexd": 0, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "segadd": 24, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "segex": 0, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "segtrm": 0, 2023-10-08T08:54:13.104 INFO:teuthology.orchestra.run.smithi105.stdout: "seg": 24, 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "segmjr": 3, 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "segexg": 0, 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "segexd": 0, 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "expos": 4194304, 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "wrpos": 48613113, 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "rdpos": 0, 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "jlat": { 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1070, 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 9.987851618, 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.009334440 2023-10-08T08:54:13.105 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "replayed": 0 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_mem": { 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "ino": 4865, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "ino+": 10826, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "ino-": 5961, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "dir": 463, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "dir+": 1852, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "dir-": 1389, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "dn": 10242, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "dn+": 17841, 2023-10-08T08:54:13.106 INFO:teuthology.orchestra.run.smithi105.stdout: "dn-": 7599, 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "cap": 0, 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "cap+": 5381, 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "cap-": 5381, 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "rss": 133388, 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "heap": 198960 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_server": { 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_client_request": 11367, 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_server_request": 227, 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_request": 8215, 2023-10-08T08:54:13.107 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_session": 9, 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_peer_request": 443, 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "req_create_latency": { 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 86, 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.278320272, 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.003236282 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getattr_latency": { 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 14, 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.236982609, 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.016927329 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.108 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getfilelock_latency": { 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: "req_link_latency": { 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 14, 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.025050796, 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001789342 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.109 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookup_latency": { 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2334, 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.318480132, 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000564901 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookuphash_latency": { 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupino_latency": { 2023-10-08T08:54:13.110 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupname_latency": { 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupparent_latency": { 2023-10-08T08:54:13.111 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupsnap_latency": { 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lssnap_latency": { 2023-10-08T08:54:13.112 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mkdir_latency": { 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 34, 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.035697570, 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001049928 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mknod_latency": { 2023-10-08T08:54:13.113 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 39, 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.045388580, 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001163809 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mksnap_latency": { 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: "req_open_latency": { 2023-10-08T08:54:13.114 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: "req_readdir_latency": { 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 495, 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.586229205, 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001184301 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rename_latency": { 2023-10-08T08:54:13.115 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 66, 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.846114630, 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.012819918 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: "req_renamesnap_latency": { 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: "req_snapdiff_latency": { 2023-10-08T08:54:13.116 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmdir_latency": { 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 478, 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 20.945811166, 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.043819688 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmsnap_latency": { 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.117 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmxattr_latency": { 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setattr_latency": { 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 14, 2023-10-08T08:54:13.118 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.025580202, 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001827157 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setdirlayout_latency": { 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setfilelock_latency": { 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.119 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setlayout_latency": { 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setxattr_latency": { 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: "req_symlink_latency": { 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 41, 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.047101207, 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001148809 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: "req_unlink_latency": { 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 4537, 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 7.280917320, 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001604786 2023-10-08T08:54:13.121 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getvxattr_latency": { 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_sessions": { 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: "session_count": 1, 2023-10-08T08:54:13.122 INFO:teuthology.orchestra.run.smithi105.stdout: "session_add": 1, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "session_remove": 0, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_open": 1, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_stale": 0, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "total_load": 4204, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "average_load": 4204, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "avg_session_uptime": 2046, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "mdthresh_evicted": 0 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:13.124 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:13.125 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 4146589, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 5981, 2023-10-08T08:54:13.126 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 704, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 8, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 9496, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 183, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:13.127 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 19842341, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 418330, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "objecter": { 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "op_active": 0, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "op_laggy": 0, 2023-10-08T08:54:13.128 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send": 13703, 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send_bytes": 45306616, 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "op_resend": 33, 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "op_reply": 13703, 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "op_latency": { 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 13703, 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 55.248898638, 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.004031883 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "op_inflight": 0, 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "oplen_avg": { 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 13703, 2023-10-08T08:54:13.129 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 13791 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "op": 13703, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "op_r": 3434, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "op_w": 10269, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "op_rmw": 0, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "op_pg": 0, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_stat": 0, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_create": 10, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_read": 125, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_write": 1195, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writefull": 68, 2023-10-08T08:54:13.130 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writesame": 0, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_append": 0, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_zero": 17, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_truncate": 0, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_delete": 8914, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_mapext": 0, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_sparse_read": 0, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_clonerange": 0, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_getxattr": 3309, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_setxattr": 20, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_rmxattr": 0, 2023-10-08T08:54:13.131 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_call": 0, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_watch": 0, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_notify": 0, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls": 0, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_other": 17, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_active": 0, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_send": 0, 2023-10-08T08:54:13.132 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_resend": 0, 2023-10-08T08:54:13.133 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_ping": 0, 2023-10-08T08:54:13.133 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_active": 0, 2023-10-08T08:54:13.133 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_send": 0, 2023-10-08T08:54:13.133 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_resend": 0, 2023-10-08T08:54:13.133 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_active": 0, 2023-10-08T08:54:13.133 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_send": 0, 2023-10-08T08:54:13.133 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_resend": 0, 2023-10-08T08:54:13.134 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_active": 0, 2023-10-08T08:54:13.134 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_send": 0, 2023-10-08T08:54:13.134 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_resend": 0, 2023-10-08T08:54:13.134 INFO:teuthology.orchestra.run.smithi105.stdout: "command_active": 0, 2023-10-08T08:54:13.134 INFO:teuthology.orchestra.run.smithi105.stdout: "command_send": 0, 2023-10-08T08:54:13.134 INFO:teuthology.orchestra.run.smithi105.stdout: "command_resend": 0, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "map_epoch": 99, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "map_full": 0, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "map_inc": 13, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_sessions": 12, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_open": 12, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_close": 0, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_laggy": 0, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_wr": 78, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_rd": 10, 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_del": 28 2023-10-08T08:54:13.135 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "oft": { 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_objs": 1, 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_updates": 0, 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_removes": 0 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "osd-slow-ops": { 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_ops_count": 0 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "purge_queue": { 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops": 0, 2023-10-08T08:54:13.136 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops_high_water": 15, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing": 0, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_high_water": 9, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed": 4511, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_item_in_journal": 0 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 71997, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 26008484, 2023-10-08T08:54:13.137 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 71997, 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 71997, 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 26008484, 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.138 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_bytes": { 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 13703, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 45862899, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 13703, 2023-10-08T08:54:13.139 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 45862899, 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_ops": { 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 1024, 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:13.140 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 13703, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 13703, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 13703, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 13703, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.141 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 4511, 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 556363, 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:13.142 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 4511, 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 125, 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 556363, 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle-0x55913f6446e0": { 2023-10-08T08:54:13.143 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 16283, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 44418809, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 16283, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 1070, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 44418809, 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:13.144 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:13.145 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:13.145 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:13.145 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:13.145 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:13.145 INFO:teuthology.orchestra.run.smithi105.stdout:} 2023-10-08T08:54:13.533 INFO:tasks.check_counter:Daemon mds.h mds.exported=12 2023-10-08T08:54:13.533 INFO:tasks.check_counter:Daemon mds.h mds.imported=54 2023-10-08T08:54:13.533 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=1783 2023-10-08T08:54:13.533 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=3879 2023-10-08T08:54:13.534 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=5 2023-10-08T08:54:13.534 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-10-08T08:54:13.534 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T08:54:13.534 DEBUG:tasks.check_counter:Getting stats from k 2023-10-08T08:54:13.534 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-08T08:54:14.090 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T08:54:14.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:14 smithi191 ceph-mon[104220]: pgmap v614: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 139 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-10-08T08:54:14.653 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:14 smithi105 ceph-mon[103798]: pgmap v614: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 139 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-10-08T08:54:14.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:14 smithi070 ceph-mon[99513]: pgmap v614: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 139 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-10-08T08:54:15.305 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 995, 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 957, 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 9357136, 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 354290, 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 6, 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 2, 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.119395511, 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.043124738, 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.038798803, 2023-10-08T08:54:15.306 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.029907338, 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 956, 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.052442905, 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000054856 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 722752, 2023-10-08T08:54:15.307 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 126016 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 526, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 681, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 15200152, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 499641, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 6, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 5, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.057217342, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.020213934, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.018008830, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.013721951, 2023-10-08T08:54:15.308 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 679, 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.027562028, 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000040592 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 336304 2023-10-08T08:54:15.309 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 817, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 817, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 21179875, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 253298, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 5, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 4, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.078069372, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.018795128, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.028518650, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.025236181, 2023-10-08T08:54:15.310 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 816, 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.028992724, 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000035530 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T08:54:15.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 1, 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-MDSRank": { 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3510, 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.093977399, 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000026774 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:15.312 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-PurgeQueue": { 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": { 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "request": 0, 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "reply": 0, 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "reply_latency": { 2023-10-08T08:54:15.313 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_reply": 0, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "forward": 0, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_complete": 0, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_keys": 0, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_commit": 0, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_split": 0, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_merge": 0, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes": 14739, 2023-10-08T08:54:15.314 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_top": 3, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_bottom": 10195, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pin_tail": 4541, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pinned": 14734, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_expired": 19, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_with_caps": 0, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": 0, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "subtrees": 1, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse": 0, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_hit": 0, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_forward": 0, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_discover": 0, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_dir_fetch": 0, 2023-10-08T08:54:15.315 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_remote_ino": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_lock": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "load_cent": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "q": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "exported": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "exported_inodes": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "imported": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "imported_inodes": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_dir_fetch": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_backtrace_fetch": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_peer_discover": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rfiles": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rbytes": 0, 2023-10-08T08:54:15.316 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rsnaps": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_set_tag": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_inodes": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_file_inodes": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_inode_file_caps": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_grant": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T08:54:15.317 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps": 0, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps_dirty": 0, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_cap_release": 0, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "process_request_cap_release": 0 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_cache": { 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update": 0, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update_receipt": 0, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_try_discover": 0, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_send_discover": 0, 2023-10-08T08:54:15.318 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_handle_discover": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_delayed": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_created": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_enqueued": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_reintegrated": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_migrated": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_processing": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_started": 0, 2023-10-08T08:54:15.319 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_completed": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_exportdir": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_flush": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragmentdir": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragstats": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_inodestats": 0 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_log": { 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "evlrg": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "evadd": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "evex": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "evtrm": 0, 2023-10-08T08:54:15.320 INFO:teuthology.orchestra.run.smithi105.stdout: "ev": 16283, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "evexg": 0, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "evexd": 0, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "segadd": 0, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "segex": 0, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "segtrm": 0, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "seg": 24, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "segmjr": 3, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "segexg": 0, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "segexd": 0, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "expos": 4194304, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "wrpos": 48613113, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "rdpos": 48608616, 2023-10-08T08:54:15.321 INFO:teuthology.orchestra.run.smithi105.stdout: "jlat": { 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "replayed": 16283 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_mem": { 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "ino": 4860, 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "ino+": 9517, 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "ino-": 4657, 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "dir": 459, 2023-10-08T08:54:15.322 INFO:teuthology.orchestra.run.smithi105.stdout: "dir+": 535, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "dir-": 76, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "dn": 14739, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "dn+": 15214, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "dn-": 475, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "cap": 0, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "cap+": 0, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "cap-": 0, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "rss": 83540, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "heap": 207152 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_server": { 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_client_request": 0, 2023-10-08T08:54:15.323 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_server_request": 0, 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_request": 0, 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_session": 0, 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_peer_request": 0, 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "req_create_latency": { 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getattr_latency": { 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.324 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getfilelock_latency": { 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "req_link_latency": { 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.325 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookup_latency": { 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookuphash_latency": { 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupino_latency": { 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.326 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupname_latency": { 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupparent_latency": { 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.327 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupsnap_latency": { 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lssnap_latency": { 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mkdir_latency": { 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.328 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mknod_latency": { 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mksnap_latency": { 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.329 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "req_open_latency": { 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "req_readdir_latency": { 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rename_latency": { 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.330 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: "req_renamesnap_latency": { 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: "req_snapdiff_latency": { 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.331 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmdir_latency": { 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmsnap_latency": { 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmxattr_latency": { 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.332 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setattr_latency": { 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setdirlayout_latency": { 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.333 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setfilelock_latency": { 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setlayout_latency": { 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setxattr_latency": { 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.334 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: "req_symlink_latency": { 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: "req_unlink_latency": { 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.335 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getvxattr_latency": { 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_sessions": { 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "session_count": 1, 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "session_add": 1, 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "session_remove": 0, 2023-10-08T08:54:15.336 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_open": 1, 2023-10-08T08:54:15.337 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_stale": 0, 2023-10-08T08:54:15.337 INFO:teuthology.orchestra.run.smithi105.stdout: "total_load": 0, 2023-10-08T08:54:15.337 INFO:teuthology.orchestra.run.smithi105.stdout: "average_load": 0, 2023-10-08T08:54:15.337 INFO:teuthology.orchestra.run.smithi105.stdout: "avg_session_uptime": 2048, 2023-10-08T08:54:15.337 INFO:teuthology.orchestra.run.smithi105.stdout: "mdthresh_evicted": 0 2023-10-08T08:54:15.337 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.337 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2023-10-08T08:54:15.337 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:15.337 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:15.338 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:15.339 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 395916, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 5403, 2023-10-08T08:54:15.340 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 9496, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 183, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:15.341 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 22656754, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 395841, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "objecter": { 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "op_active": 0, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "op_laggy": 0, 2023-10-08T08:54:15.342 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send": 2072, 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send_bytes": 21, 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "op_resend": 3, 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "op_reply": 2072, 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "op_latency": { 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2072, 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 3.986920673, 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001924189 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "op_inflight": 0, 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "oplen_avg": { 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2072, 2023-10-08T08:54:15.343 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 2073 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: "op": 2072, 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: "op_r": 2072, 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: "op_w": 0, 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: "op_rmw": 0, 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: "op_pg": 0, 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_stat": 1268, 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_create": 0, 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_read": 802, 2023-10-08T08:54:15.344 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_write": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writefull": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writesame": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_append": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_zero": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_truncate": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_delete": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_mapext": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_sparse_read": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_clonerange": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_getxattr": 1, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_setxattr": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:54:15.345 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_rmxattr": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_call": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_watch": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_notify": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_other": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_active": 0, 2023-10-08T08:54:15.346 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_send": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_resend": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_ping": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_active": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_send": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_resend": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_active": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_send": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_resend": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_active": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_send": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_resend": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "command_active": 0, 2023-10-08T08:54:15.347 INFO:teuthology.orchestra.run.smithi105.stdout: "command_send": 0, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "command_resend": 0, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "map_epoch": 99, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "map_full": 0, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "map_inc": 13, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_sessions": 8, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_open": 8, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_close": 0, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_laggy": 0, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_wr": 0, 2023-10-08T08:54:15.348 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_rd": 2, 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_del": 0 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: "oft": { 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_objs": 0, 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_updates": 0, 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_removes": 0 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: "osd-slow-ops": { 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_ops_count": 0 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.349 INFO:teuthology.orchestra.run.smithi105.stdout: "purge_queue": { 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops": 0, 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing": 0, 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_high_water": 0, 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed": 0, 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_item_in_journal": 0 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:15.350 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 2334, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 45510957, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 2334, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2334, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 45510957, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.351 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_bytes": { 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 2072, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 44425375, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2072, 2023-10-08T08:54:15.352 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 44425375, 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_ops": { 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 1024, 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:15.353 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 2072, 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 2072, 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2072, 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 2072, 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.354 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 0, 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:15.355 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle-0x558ebaefe960": { 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:15.356 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 0, 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 0, 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout: } 2023-10-08T08:54:15.357 INFO:teuthology.orchestra.run.smithi105.stdout:} 2023-10-08T08:54:15.646 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-08T08:54:15.647 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-10-08T08:54:15.647 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2023-10-08T08:54:15.647 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2023-10-08T08:54:15.647 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2023-10-08T08:54:15.647 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-10-08T08:54:15.647 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T08:54:15.647 DEBUG:tasks.check_counter:Getting stats from c 2023-10-08T08:54:15.647 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-08T08:54:16.228 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:54:16.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:16 smithi191 ceph-mon[104220]: pgmap v615: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 137 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:54:16.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:16 smithi070 ceph-mon[99513]: pgmap v615: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 137 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:54:16.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:16 smithi105 ceph-mon[103798]: pgmap v615: 129 pgs: 8 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 96 active+clean; 137 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:54:17.431 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 24525, 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 20333, 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 13344990, 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 17598846, 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 10, 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 3, 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 1.103208506, 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.410747858, 2023-10-08T08:54:17.432 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.802655395, 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.052472465, 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 20336, 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.149045587, 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000056503 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 40302, 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.006211161, 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000154 2023-10-08T08:54:17.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 10688, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 10769, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 5143578, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 13713475, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 10, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.667363253, 2023-10-08T08:54:17.434 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.295348710, 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.362371110, 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.065266086, 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 10767, 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.811672765, 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000075385 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 15703, 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.002638372, 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000168 2023-10-08T08:54:17.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 338368 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 22561, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 28296, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 10973617, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 17948077, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 22, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 11, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 1.462230209, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.644567264, 2023-10-08T08:54:17.436 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.949326942, 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.079037751, 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 28291, 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 4.141481994, 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000146388 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 41747, 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.008824576, 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000211 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.437 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 3864944, 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 9780832 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3311, 2023-10-08T08:54:17.438 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.362761083, 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001619680 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2411, 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.305461842, 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000126695 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:17.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 4099, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 3993, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3993, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 17.548957788, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004394930 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 104, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 16, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2023-10-08T08:54:17.440 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 2740, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 2, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 1, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 2737, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 2737, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 6216, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 1, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 1, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 5, 2023-10-08T08:54:17.441 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 9248, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 7022, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 42, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 1729, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 8, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 14, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 1000, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 1, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 30, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 2861, 2023-10-08T08:54:17.442 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 26, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 2901, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 1862, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 18, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 0, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 0, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 5, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 1862, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:54:17.443 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 206, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 206, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 1656, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 6, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 1285, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 2675, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 98, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 3055, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 1522, 2023-10-08T08:54:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 27, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 2612 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 851, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 4772, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 3209, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 3188, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 1794, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 206, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 1459, 2023-10-08T08:54:17.445 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 1243, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 16, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 6, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 30, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2023-10-08T08:54:17.446 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 7468, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 7468, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 12, 2023-10-08T08:54:17.447 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 12, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 25608691, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1190, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 6.669543797, 2023-10-08T08:54:17.448 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.005604658 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 1332, 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 6478, 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 5146, 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 208, 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 2223, 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 2015, 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 2740, 2023-10-08T08:54:17.449 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 10272, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 7532, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 1, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 3506, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 3505, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 100092, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 198960 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 5915, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 208, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 4099, 2023-10-08T08:54:17.450 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 32, 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 506, 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 307, 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.950092129, 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003094762 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 38, 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.178617263, 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004700454 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2023-10-08T08:54:17.451 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 91, 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.352528974, 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003873944 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 940, 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 4.214359540, 2023-10-08T08:54:17.452 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004483361 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.453 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2023-10-08T08:54:17.454 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 171, 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.449567700, 2023-10-08T08:54:17.455 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002629050 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 174, 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.477781574, 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002745871 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.456 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 266, 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.473966544, 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001781829 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 182, 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.243480743, 2023-10-08T08:54:17.457 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.006832311 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 279, 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.999601025, 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.021503946 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.459 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 103, 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.375667338, 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003647255 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2023-10-08T08:54:17.461 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 157, 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.361903996, 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002305120 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1285, 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.471390962, 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001923261 2023-10-08T08:54:17.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 1, 2023-10-08T08:54:17.463 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 0, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 2136, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 2136, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 629, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:17.464 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:17.465 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:17.466 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 1974923, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 1948, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 352, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 4, 2023-10-08T08:54:17.467 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 9496, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 183, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 5697137, 2023-10-08T08:54:17.468 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 160543, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 5836, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 21758251, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 27, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 5836, 2023-10-08T08:54:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 5836, 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 24.885546374, 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004264144 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 5836, 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5936 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.470 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 5836, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 1933, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 3903, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 55, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 1245, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 42, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2023-10-08T08:54:17.471 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 7, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 2446, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 1877, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2023-10-08T08:54:17.472 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 111, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2023-10-08T08:54:17.473 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 99, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 13, 2023-10-08T08:54:17.474 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 12, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 12, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 67, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 32, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 24 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2023-10-08T08:54:17.475 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 1 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 18, 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 8, 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 1243, 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.476 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 57770, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 23902371, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 57770, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 57770, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 23902371, 2023-10-08T08:54:17.477 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 5836, 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 21913666, 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 5836, 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 21913666, 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:17.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 5836, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 5836, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 5836, 2023-10-08T08:54:17.480 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 5836, 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 1243, 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 155671, 2023-10-08T08:54:17.481 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 1243, 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 55, 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 155671, 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:17.482 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x5575660ce6e0": { 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 7468, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 21414387, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 7468, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1190, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 21414387, 2023-10-08T08:54:17.483 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:17.484 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:17.484 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:17.484 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:17.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:17.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:17.484 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-08T08:54:17.767 INFO:tasks.check_counter:Daemon mds.c mds.exported=30 2023-10-08T08:54:17.767 INFO:tasks.check_counter:Daemon mds.c mds.imported=26 2023-10-08T08:54:17.768 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=851 2023-10-08T08:54:17.768 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=4772 2023-10-08T08:54:17.768 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=5 2023-10-08T08:54:17.768 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-10-08T08:54:17.768 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T08:54:17.768 DEBUG:tasks.check_counter:Getting stats from f 2023-10-08T08:54:17.768 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-08T08:54:18.330 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:54:18.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:18 smithi191 ceph-mon[104220]: pgmap v616: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:54:18.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:18 smithi070 ceph-mon[99513]: pgmap v616: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:54:18.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:18 smithi105 ceph-mon[103798]: pgmap v616: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 9539, 2023-10-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 9613, 2023-10-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 4845937, 2023-10-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 13145121, 2023-10-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 20, 2023-10-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 9, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.609488043, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.273768800, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.357463345, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.038085577, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 9609, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.550018546, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000057239 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 15830, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.003201598, 2023-10-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000202 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 739184, 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 221488 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 401298, 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 400070, 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 75660986, 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 70632830, 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 9, 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 5, 2023-10-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 10.194919285, 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 3.855446346, 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 7.122372777, 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.057485622, 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 400072, 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 4.673089937, 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000011680 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 795315, 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.059222280, 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000074 2023-10-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 338544 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 133728, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 140904, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 28081343, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 45578916, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 14, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 6, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 5.126401993, 2023-10-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 2.236709472, 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 8.290806814, 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.077477929, 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 140902, 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 4.560710734, 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000032367 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 263035, 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.026493729, 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000100 2023-10-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2448976, 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 9531776 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3209, 2023-10-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 6.507257910, 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002027814 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3212, 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.420133915, 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000130801 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2023-10-08T08:54:19.578 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 4017, 2023-10-08T08:54:19.578 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 4002, 2023-10-08T08:54:19.578 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2023-10-08T08:54:19.578 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 4002, 2023-10-08T08:54:19.578 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 17.524673595, 2023-10-08T08:54:19.578 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004378978 2023-10-08T08:54:19.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.578 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2023-10-08T08:54:19.578 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 15, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 1, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 4141, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 4, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 3, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 4134, 2023-10-08T08:54:19.579 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 4134, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 5661, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 1, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 1, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 6, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 8996, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 7079, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 6, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 1508, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 20, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 1000, 2023-10-08T08:54:19.580 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 1, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 20, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 2674, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 22, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 4464, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 2352, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 18, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 0, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 0, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 5, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 2352, 2023-10-08T08:54:19.581 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 266, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 266, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 2086, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 16, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 1032, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 2826, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 23, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:54:19.582 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 2741, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 184, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 34, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 2754 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 1087, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 4297, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 2892, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 2856, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 2178, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 280, 2023-10-08T08:54:19.583 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 2012, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 1736, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 13, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 1, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T08:54:19.584 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 20, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 1, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 7508, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 7508, 2023-10-08T08:54:19.585 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 11, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 11, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 27104575, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2023-10-08T08:54:19.586 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 815, 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 3.349357783, 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004109641 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 1897, 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 7516, 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 5619, 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 295, 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 2197, 2023-10-08T08:54:19.587 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 1902, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 4141, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 11562, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 7421, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 1, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 4542, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 4541, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 114320, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 198960 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 6047, 2023-10-08T08:54:19.588 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 202, 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 4017, 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 27, 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 369, 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 73, 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.166357830, 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002278874 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 19, 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.031502757, 2023-10-08T08:54:19.589 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001658039 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 13, 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.031472914, 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002420993 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.590 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1346, 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.761461391, 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000565721 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.591 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.592 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2023-10-08T08:54:19.593 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 41, 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.058353959, 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001423267 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 35, 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.042023172, 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001200662 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.594 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 313, 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.704858677, 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002251944 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.595 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 57, 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.540145180, 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.009476231 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2023-10-08T08:54:19.596 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 304, 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 12.436310756, 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.040908916 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 26, 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.043826035, 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001685616 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.598 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.599 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 35, 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.045991890, 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001314054 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.600 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1740, 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.662369034, 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001530097 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:19.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 2, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 0, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 2, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 3034, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 1517, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 615, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.602 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:19.603 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:19.604 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:19.605 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 2601123, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 2589, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 176, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 2, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:19.606 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 9496, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 183, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 8231945, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 206209, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2023-10-08T08:54:19.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 6876, 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 23421812, 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 33, 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 6876, 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 6876, 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 26.167522889, 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003805631 2023-10-08T08:54:19.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 6876, 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 6944 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 6876, 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 2423, 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 4453, 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2023-10-08T08:54:19.609 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 70, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 885, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 51, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 12, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 3426, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2023-10-08T08:54:19.610 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 2353, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:54:19.611 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 30, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2023-10-08T08:54:19.612 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 100, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 14, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 12, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 12, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 62, 2023-10-08T08:54:19.613 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 2, 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 23 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 0 2023-10-08T08:54:19.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 14, 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 8, 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 1736, 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2023-10-08T08:54:19.615 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 544561, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 59258820, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 544561, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 544561, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 59258820, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.616 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:19.617 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 6876, 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 23640428, 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 6876, 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 23640428, 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2023-10-08T08:54:19.618 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 6876, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 6876, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 6876, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 6876, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.619 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 1736, 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 218632, 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:19.620 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 1736, 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 70, 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 218632, 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x5625786d66e0": { 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:19.621 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 7508, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 22910271, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 7508, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 815, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 22910271, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:19.622 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:19.623 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:19.623 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:19.623 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:19.623 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-08T08:54:19.972 INFO:tasks.check_counter:Daemon mds.f mds.exported=20 2023-10-08T08:54:19.973 INFO:tasks.check_counter:Daemon mds.f mds.imported=22 2023-10-08T08:54:19.973 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=1087 2023-10-08T08:54:19.973 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=4297 2023-10-08T08:54:19.973 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=5 2023-10-08T08:54:19.973 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-10-08T08:54:19.973 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T08:54:19.973 DEBUG:tasks.check_counter:Getting stats from i 2023-10-08T08:54:19.973 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-08T08:54:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:20 smithi105 ceph-mon[103798]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T08:54:20.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:20 smithi105 ceph-mon[103798]: pgmap v618: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 227 B/s wr, 12 op/s 2023-10-08T08:54:20.521 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:20 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:54:20.542 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:54:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:20 smithi191 ceph-mon[104220]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T08:54:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:20 smithi191 ceph-mon[104220]: pgmap v618: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 227 B/s wr, 12 op/s 2023-10-08T08:54:20.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:20 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:54:20.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:20 smithi070 ceph-mon[99513]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T08:54:20.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:20 smithi070 ceph-mon[99513]: pgmap v618: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 227 B/s wr, 12 op/s 2023-10-08T08:54:20.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:20 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 123241, 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 130450, 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 29490371, 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 53641934, 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 14, 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 4.127446528, 2023-10-08T08:54:21.892 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 1.615195085, 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 2.634692214, 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.172003962, 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 130450, 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 3.730729089, 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000028598 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 242293, 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.023922375, 2023-10-08T08:54:21.893 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000098 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 16568, 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 31743, 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 5858064, 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 34339683, 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 19, 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2023-10-08T08:54:21.894 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 1.253129009, 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.559289841, 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 1.807504778, 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.150447481, 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 31739, 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 3.255142102, 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000102559 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 31551, 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.005427916, 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000172 2023-10-08T08:54:21.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 4562080, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 16313296 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 137704, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 141920, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 29441127, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 37433826, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 10, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 5.255434615, 2023-10-08T08:54:21.896 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 2.245052237, 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 3.527236350, 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.116640275, 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 141920, 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 3.346634077, 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000023581 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 272051, 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.028457671, 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000104 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.897 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 745184, 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 132112 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 4581, 2023-10-08T08:54:21.898 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 13.397961194, 2023-10-08T08:54:21.899 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002924680 2023-10-08T08:54:21.899 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:21.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.899 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2023-10-08T08:54:21.899 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2023-10-08T08:54:21.899 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2023-10-08T08:54:21.899 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 6715, 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.050988782, 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000156513 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 8294, 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 8234, 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 8234, 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 27.416586215, 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003329680 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.900 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 59, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 7, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 9073, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 2, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 1, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 9070, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 9070, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 4298, 2023-10-08T08:54:21.901 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 0, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 0, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 3, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 14425, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 12328, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 33, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 1322, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 8, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 1000, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 1, 2023-10-08T08:54:21.902 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 22, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 1769, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 32, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 5267, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 2813, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 0, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 0, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 5, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 2813, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:54:21.903 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 278, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 278, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 2535, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 20, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 2066, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 5811, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 49, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:54:21.904 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 4094, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 1035, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 49, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 5962 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 2127, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 3680, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 2488, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 2421, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 4278, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 560, 2023-10-08T08:54:21.905 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 4247, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 3686, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 20, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 2, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T08:54:21.906 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 22, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 2, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 14683, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 14683, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2023-10-08T08:54:21.907 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 21, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 21, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 3, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 48095263, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1469, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 11.656177442, 2023-10-08T08:54:21.908 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.007934770 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 4056, 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 10340, 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 6284, 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 557, 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 2027, 2023-10-08T08:54:21.909 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 1470, 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 9073, 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 17108, 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 8035, 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 0, 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 5255, 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 5255, 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 127280, 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 198960 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.910 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 12001, 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 130, 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 8294, 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 23, 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 368, 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 188, 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.567504831, 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003018642 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 25, 2023-10-08T08:54:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.119943231, 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004797729 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 44, 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.112823152, 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002564162 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.912 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2588, 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.454877330, 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000562162 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.914 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.915 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 111, 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.263837518, 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002376914 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 96, 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.199004960, 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002072968 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.916 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1, 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.003344792, 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003344792 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 590, 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.557789378, 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000945405 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.917 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 128, 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.926354567, 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.007237145 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.918 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 596, 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 16.894978954, 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.028347280 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2023-10-08T08:54:21.919 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 51, 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.122626092, 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002404433 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.920 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2023-10-08T08:54:21.921 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 92, 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.202127542, 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002197038 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3724, 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.991373868, 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001608854 2023-10-08T08:54:21.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 2, 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 0, 2023-10-08T08:54:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 2, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 5181, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 2590, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 617, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:21.924 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:21.925 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:21.926 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 4909025, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 5176, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 264, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 3, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2023-10-08T08:54:21.927 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 9496, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 183, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 17476688, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 439143, 2023-10-08T08:54:21.928 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 11926, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 44666372, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 27, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 11926, 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2023-10-08T08:54:21.929 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 11926, 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 51.132067586, 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004287444 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 11926, 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 12015 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 11926, 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 2915, 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 9011, 2023-10-08T08:54:21.930 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 95, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 1564, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 57, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 21, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 7260, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2023-10-08T08:54:21.931 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 2820, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2023-10-08T08:54:21.932 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 55, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2023-10-08T08:54:21.933 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 100, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 14, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 12, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 12, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2023-10-08T08:54:21.934 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 71, 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 14, 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 28 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2023-10-08T08:54:21.935 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 0 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 16, 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 9, 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 3686, 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2023-10-08T08:54:21.936 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 277509, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 39245671, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 277509, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 277509, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 39245671, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.937 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 11926, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 45123634, 2023-10-08T08:54:21.938 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 11926, 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 45123634, 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:21.939 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 11926, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 11926, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 11926, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 11926, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.940 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 3686, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 457374, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 3686, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 95, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 457374, 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:21.941 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x560e029b26e0": { 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 14683, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 43900959, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 14683, 2023-10-08T08:54:21.942 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1469, 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 43900959, 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:21.943 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-08T08:54:22.301 INFO:tasks.check_counter:Daemon mds.i mds.exported=22 2023-10-08T08:54:22.301 INFO:tasks.check_counter:Daemon mds.i mds.imported=32 2023-10-08T08:54:22.301 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=2127 2023-10-08T08:54:22.301 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=3680 2023-10-08T08:54:22.301 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=5 2023-10-08T08:54:22.301 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-10-08T08:54:22.301 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T08:54:22.301 DEBUG:tasks.check_counter:Getting stats from l 2023-10-08T08:54:22.301 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-08T08:54:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:22 smithi191 ceph-mon[104220]: pgmap v619: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:54:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:22 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:22 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:22 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:22 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:22 smithi070 ceph-mon[99513]: pgmap v619: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:54:22.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:22 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:22 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:22 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:22 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:22 smithi105 ceph-mon[103798]: pgmap v619: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-10-08T08:54:22.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:22 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:22 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:22 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:22 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:22.871 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T08:54:23.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:23 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:23.970 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:23 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:23.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:23 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:54:23.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:23 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:54:23.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:23 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:23.971 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:23 smithi070 ceph-mon[99513]: pgmap v620: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:54:24.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:23 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:24.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:23 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:24.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:23 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:54:24.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:23 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:54:24.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:23 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:24.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:23 smithi105 ceph-mon[103798]: pgmap v620: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:54:24.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:23 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:24.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:23 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:24.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:23 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T08:54:24.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:23 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T08:54:24.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:23 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' 2023-10-08T08:54:24.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:23 smithi191 ceph-mon[104220]: pgmap v620: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:54:24.105 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-08T08:54:24.105 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T08:54:24.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 291, 2023-10-08T08:54:24.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 293, 2023-10-08T08:54:24.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 12659057, 2023-10-08T08:54:24.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 90565, 2023-10-08T08:54:24.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 7, 2023-10-08T08:54:24.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 3, 2023-10-08T08:54:24.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.031342882, 2023-10-08T08:54:24.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.006069030, 2023-10-08T08:54:24.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.014463935, 2023-10-08T08:54:24.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.007836459, 2023-10-08T08:54:24.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:24.106 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 291, 2023-10-08T08:54:24.107 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.012479416, 2023-10-08T08:54:24.107 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000042884 2023-10-08T08:54:24.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.107 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:24.107 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.107 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.107 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.107 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 672, 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 829, 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 21138272, 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 548510, 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 6, 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 5, 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.079262414, 2023-10-08T08:54:24.108 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.025907476, 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.023142188, 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.023086515, 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 827, 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.041371553, 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000050026 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.109 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 339824 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1483, 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 1443, 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 11444186, 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 506066, 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 4, 2023-10-08T08:54:24.110 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 3, 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.159943407, 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.046900862, 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.053717322, 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.049054509, 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1443, 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.075508442, 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000052327 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2023-10-08T08:54:24.111 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 727360, 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 128512 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2023-10-08T08:54:24.112 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3636, 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.111427822, 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000030645 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.113 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 0, 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 0, 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.114 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2023-10-08T08:54:24.115 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 0, 2023-10-08T08:54:24.115 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2023-10-08T08:54:24.115 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2023-10-08T08:54:24.115 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 0, 2023-10-08T08:54:24.115 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2023-10-08T08:54:24.115 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2023-10-08T08:54:24.115 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 12735, 2023-10-08T08:54:24.115 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 0, 2023-10-08T08:54:24.115 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 0, 2023-10-08T08:54:24.116 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 12735, 2023-10-08T08:54:24.116 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 12735, 2023-10-08T08:54:24.116 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 58, 2023-10-08T08:54:24.116 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 0, 2023-10-08T08:54:24.116 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 0, 2023-10-08T08:54:24.116 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 1, 2023-10-08T08:54:24.116 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 0, 2023-10-08T08:54:24.117 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T08:54:24.118 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 0, 2023-10-08T08:54:24.119 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 0, 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 0, 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 0, 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 0 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2023-10-08T08:54:24.120 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2023-10-08T08:54:24.121 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 0, 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.122 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 0, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 14683, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 0, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 21, 2023-10-08T08:54:24.123 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 3, 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 48095263, 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 48092229, 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 14683 2023-10-08T08:54:24.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 4049, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 9053, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 5004, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 552, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 747, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 195, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 12735, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 14668, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 1933, 2023-10-08T08:54:24.125 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 0, 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 0, 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 0, 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 77672, 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 207152 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 0, 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 0, 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 0, 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 0, 2023-10-08T08:54:24.126 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 0, 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2023-10-08T08:54:24.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.128 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.130 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.132 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.133 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.134 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2023-10-08T08:54:24.136 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.137 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.138 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2023-10-08T08:54:24.139 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 2, 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 0, 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 2, 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2023-10-08T08:54:24.140 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 0, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 0, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 2029, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2023-10-08T08:54:24.141 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2023-10-08T08:54:24.142 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2023-10-08T08:54:24.143 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 375161, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 4771, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2023-10-08T08:54:24.144 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 9256, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 177, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 19739367, 2023-10-08T08:54:24.145 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 418049, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 2176, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 21, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 3, 2023-10-08T08:54:24.146 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 2176, 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2176, 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.430955867, 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001117167 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2176, 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2177 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.147 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 2176, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 2176, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 0, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 1348, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 0, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 826, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 0, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 0, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2023-10-08T08:54:24.148 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2023-10-08T08:54:24.149 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2023-10-08T08:54:24.149 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2023-10-08T08:54:24.149 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 0, 2023-10-08T08:54:24.149 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2023-10-08T08:54:24.149 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2023-10-08T08:54:24.149 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2023-10-08T08:54:24.149 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 1, 2023-10-08T08:54:24.149 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 0, 2023-10-08T08:54:24.149 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2023-10-08T08:54:24.150 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2023-10-08T08:54:24.151 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 100, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 14, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 8, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 8, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 0, 2023-10-08T08:54:24.152 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 2, 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 0 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 0, 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 0 2023-10-08T08:54:24.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 0, 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 0, 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 2442, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 45005389, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 2442, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2442, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 45005389, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.155 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.156 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.156 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:24.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.156 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2023-10-08T08:54:24.156 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:24.156 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2023-10-08T08:54:24.156 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:24.156 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:24.156 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 2176, 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 43901445, 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2176, 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 43901445, 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.157 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:24.158 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 2176, 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 2176, 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2176, 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 2176, 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2023-10-08T08:54:24.160 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x55d8dd3a8960": { 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2023-10-08T08:54:24.161 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:24.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-08T08:54:24.163 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-08T08:54:24.518 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-10-08T08:54:24.518 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-10-08T08:54:24.518 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-10-08T08:54:24.518 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-10-08T08:54:24.518 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2023-10-08T08:54:24.519 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-10-08T08:54:24.519 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T08:54:24.519 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-08T08:54:24.531 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T08:54:24.531 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:54:24.531 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T08:54:24.553 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:54:24.554 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T08:54:24.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:54:24.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.789+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/3276778098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 msgr2=0x7fd6a410a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.789+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/3276778098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 0x7fd6a410a690 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd694009990 tx=0x7fd694009ca0 comp rx=0 tx=0).stop 2023-10-08T08:54:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.789+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/3276778098 shutdown_connections 2023-10-08T08:54:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.789+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/3276778098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a410ac60 0x7fd6a410d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.789+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/3276778098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6a4101890 0x7fd6a4101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.790+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/3276778098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 0x7fd6a410a690 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.790+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/3276778098 >> 172.21.15.70:0/3276778098 conn(0x7fd6a40fb030 msgr2=0x7fd6a40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.790+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/3276778098 shutdown_connections 2023-10-08T08:54:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.790+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/3276778098 wait complete. 2023-10-08T08:54:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.790+0000 7fd6a8e3a700 1 Processor -- start 2023-10-08T08:54:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.790+0000 7fd6a8e3a700 1 -- start start 2023-10-08T08:54:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a8e3a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6a4101890 0x7fd6a4198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a8e3a700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 0x7fd6a4199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a8e3a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a410ac60 0x7fd6a419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a8e3a700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a419dd20 con 0x7fd6a41021b0 2023-10-08T08:54:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a8e3a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a419de90 con 0x7fd6a4101890 2023-10-08T08:54:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a8e3a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a419e050 con 0x7fd6a410ac60 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a1d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 0x7fd6a4199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a1d9b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 0x7fd6a4199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53718/0 (socket says 172.21.15.70:53718) 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a1d9b700 1 -- 172.21.15.70:0/1027564228 learned_addr learned my addr 172.21.15.70:0/1027564228 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a259c700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6a4101890 0x7fd6a4198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a2d9d700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a410ac60 0x7fd6a419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a1d9b700 1 -- 172.21.15.70:0/1027564228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a410ac60 msgr2=0x7fd6a419d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a1d9b700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a410ac60 0x7fd6a419d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a1d9b700 1 -- 172.21.15.70:0/1027564228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6a4101890 msgr2=0x7fd6a4198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a1d9b700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6a4101890 0x7fd6a4198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a1d9b700 1 -- 172.21.15.70:0/1027564228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940095f0 con 0x7fd6a41021b0 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a259c700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6a4101890 0x7fd6a4198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:54:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a1d9b700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 0x7fd6a4199390 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd694000c00 tx=0x7fd6940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd69b7fe700 1 -- 172.21.15.70:0/1027564228 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69401d070 con 0x7fd6a41021b0 2023-10-08T08:54:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a419e2d0 con 0x7fd6a41021b0 2023-10-08T08:54:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd69b7fe700 1 -- 172.21.15.70:0/1027564228 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd694022470 con 0x7fd6a41021b0 2023-10-08T08:54:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd69b7fe700 1 -- 172.21.15.70:0/1027564228 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694017650 con 0x7fd6a41021b0 2023-10-08T08:54:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.791+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a41a5b70 con 0x7fd6a41021b0 2023-10-08T08:54:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.792+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a4108180 con 0x7fd6a41021b0 2023-10-08T08:54:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.793+0000 7fd69b7fe700 1 -- 172.21.15.70:0/1027564228 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fd6940225e0 con 0x7fd6a41021b0 2023-10-08T08:54:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.794+0000 7fd69b7fe700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6900a15f0 0x7fd6900a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.794+0000 7fd69b7fe700 1 -- 172.21.15.70:0/1027564228 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7fd6940cef90 con 0x7fd6a41021b0 2023-10-08T08:54:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.794+0000 7fd6a259c700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6900a15f0 0x7fd6900a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.794+0000 7fd6a259c700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6900a15f0 0x7fd6900a3ab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd68c005950 tx=0x7fd68c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:24.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.798+0000 7fd69b7fe700 1 -- 172.21.15.70:0/1027564228 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd694098020 con 0x7fd6a41021b0 2023-10-08T08:54:24.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.994+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6a419a100 con 0x7fd6a41021b0 2023-10-08T08:54:24.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.996+0000 7fd69b7fe700 1 -- 172.21.15.70:0/1027564228 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+24929 (secure 0 0 0) 0x7fd69409b640 con 0x7fd6a41021b0 2023-10-08T08:54:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:54:24.997 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":100,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:54:19.266351+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:54:24.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6900a15f0 msgr2=0x7fd6900a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:24.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6900a15f0 0x7fd6900a3ab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd68c005950 tx=0x7fd68c0058e0 comp rx=0 tx=0).stop 2023-10-08T08:54:24.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 msgr2=0x7fd6a4199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:24.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 0x7fd6a4199390 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd694000c00 tx=0x7fd6940057f0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 shutdown_connections 2023-10-08T08:54:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fd6900a15f0 0x7fd6900a3ab0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a410ac60 0x7fd6a419d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6a4101890 0x7fd6a4198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 --2- 172.21.15.70:0/1027564228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a41021b0 0x7fd6a4199390 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 >> 172.21.15.70:0/1027564228 conn(0x7fd6a40fb030 msgr2=0x7fd6a4100640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 shutdown_connections 2023-10-08T08:54:25.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:24.998+0000 7fd6a8e3a700 1 -- 172.21.15.70:0/1027564228 wait complete. 2023-10-08T08:54:25.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T08:38:15.300562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T08:41:58.471600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T08:41:59.698555+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T08:42:03.384369+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T08:54:25.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T08:54:25.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.134+0000 7f3a1a83e700 1 -- 172.21.15.70:0/824432247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a140fffe0 msgr2=0x7f3a1410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.134+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/824432247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a140fffe0 0x7f3a1410c4e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b0a0 tx=0x7f3a0c00b3b0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.134+0000 7f3a1a83e700 1 -- 172.21.15.70:0/824432247 shutdown_connections 2023-10-08T08:54:25.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.134+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/824432247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a140fffe0 0x7f3a1410c4e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.134+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/824432247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a141056b0 0x7f3a14105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.134+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/824432247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a140ff620 0x7f3a140ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.134+0000 7f3a1a83e700 1 -- 172.21.15.70:0/824432247 >> 172.21.15.70:0/824432247 conn(0x7f3a14076780 msgr2=0x7f3a14076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:25.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.134+0000 7f3a1a83e700 1 -- 172.21.15.70:0/824432247 shutdown_connections 2023-10-08T08:54:25.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.134+0000 7f3a1a83e700 1 -- 172.21.15.70:0/824432247 wait complete. 2023-10-08T08:54:25.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.135+0000 7f3a1a83e700 1 Processor -- start 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.135+0000 7f3a1a83e700 1 -- start start 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a1a83e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a140ff620 0x7f3a1419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a1a83e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a140fffe0 0x7f3a1419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a1a83e700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a141056b0 0x7f3a14195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a1a83e700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14195ec0 con 0x7f3a141056b0 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a1a83e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14196030 con 0x7f3a140ff620 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a1a83e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a141961f0 con 0x7f3a140fffe0 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a18ddb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a141056b0 0x7f3a14195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a18ddb700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a141056b0 0x7f3a14195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53734/0 (socket says 172.21.15.70:53734) 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a18ddb700 1 -- 172.21.15.70:0/2338133572 learned_addr learned my addr 172.21.15.70:0/2338133572 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:25.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a137fe700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a140fffe0 0x7f3a1419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a13fff700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a140ff620 0x7f3a1419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a18ddb700 1 -- 172.21.15.70:0/2338133572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a140fffe0 msgr2=0x7f3a1419bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a18ddb700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a140fffe0 0x7f3a1419bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a18ddb700 1 -- 172.21.15.70:0/2338133572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a140ff620 msgr2=0x7f3a1419b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a18ddb700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a140ff620 0x7f3a1419b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a18ddb700 1 -- 172.21.15.70:0/2338133572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c009d00 con 0x7f3a141056b0 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a13fff700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a140ff620 0x7f3a1419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a18ddb700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a141056b0 0x7f3a14195850 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b830 tx=0x7f3a0c005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a117fa700 1 -- 172.21.15.70:0/2338133572 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00e040 con 0x7f3a141056b0 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a117fa700 1 -- 172.21.15.70:0/2338133572 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a0c012e40 con 0x7f3a141056b0 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a14196470 con 0x7f3a141056b0 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a117fa700 1 -- 172.21.15.70:0/2338133572 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c01b450 con 0x7f3a141056b0 2023-10-08T08:54:25.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.136+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a141a2710 con 0x7f3a141056b0 2023-10-08T08:54:25.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.137+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a14107c30 con 0x7f3a141056b0 2023-10-08T08:54:25.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.138+0000 7f3a117fa700 1 -- 172.21.15.70:0/2338133572 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3a0c012980 con 0x7f3a141056b0 2023-10-08T08:54:25.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.139+0000 7f3a117fa700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39fc0a15f0 0x7f39fc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.139+0000 7f3a13fff700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39fc0a15f0 0x7f39fc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.139+0000 7f3a117fa700 1 -- 172.21.15.70:0/2338133572 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f3a0c0cf430 con 0x7f3a141056b0 2023-10-08T08:54:25.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.140+0000 7f3a13fff700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39fc0a15f0 0x7f39fc0a3ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3a04005fd0 tx=0x7f3a04005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:25.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.144+0000 7f3a117fa700 1 -- 172.21.15.70:0/2338133572 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a0c098460 con 0x7f3a141056b0 2023-10-08T08:54:25.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.340+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a14196d10 con 0x7f3a141056b0 2023-10-08T08:54:25.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.340+0000 7f3a117fa700 1 -- 172.21.15.70:0/2338133572 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a0c09ba80 con 0x7f3a141056b0 2023-10-08T08:54:25.341 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-10-08T08:54:25.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39fc0a15f0 msgr2=0x7f39fc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39fc0a15f0 0x7f39fc0a3ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3a04005fd0 tx=0x7f3a04005dc0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a141056b0 msgr2=0x7f3a14195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a141056b0 0x7f3a14195850 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b830 tx=0x7f3a0c005ad0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 shutdown_connections 2023-10-08T08:54:25.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f39fc0a15f0 0x7f39fc0a3ab0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a141056b0 0x7f3a14195850 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a140ff620 0x7f3a1419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 --2- 172.21.15.70:0/2338133572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a140fffe0 0x7f3a1419bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 >> 172.21.15.70:0/2338133572 conn(0x7f3a14076780 msgr2=0x7f3a140fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:25.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 shutdown_connections 2023-10-08T08:54:25.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.343+0000 7f3a1a83e700 1 -- 172.21.15.70:0/2338133572 wait complete. 2023-10-08T08:54:25.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T08:54:25.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.479+0000 7fcff443b700 1 -- 172.21.15.70:0/1449282460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 msgr2=0x7fcfec0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.479+0000 7fcff443b700 1 --2- 172.21.15.70:0/1449282460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 0x7fcfec0680c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0099c0 tx=0x7fcfdc009cd0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.479+0000 7fcff443b700 1 -- 172.21.15.70:0/1449282460 shutdown_connections 2023-10-08T08:54:25.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.479+0000 7fcff443b700 1 --2- 172.21.15.70:0/1449282460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfec105b80 0x7fcfec10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.479+0000 7fcff443b700 1 --2- 172.21.15.70:0/1449282460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 0x7fcfec0680c0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.479+0000 7fcff443b700 1 --2- 172.21.15.70:0/1449282460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfec1051c0 0x7fcfec105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.479+0000 7fcff443b700 1 -- 172.21.15.70:0/1449282460 >> 172.21.15.70:0/1449282460 conn(0x7fcfec076780 msgr2=0x7fcfec076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:25.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.479+0000 7fcff443b700 1 -- 172.21.15.70:0/1449282460 shutdown_connections 2023-10-08T08:54:25.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.479+0000 7fcff443b700 1 -- 172.21.15.70:0/1449282460 wait complete. 2023-10-08T08:54:25.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff443b700 1 Processor -- start 2023-10-08T08:54:25.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff443b700 1 -- start start 2023-10-08T08:54:25.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff443b700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 0x7fcfec19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff443b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfec1051c0 0x7fcfec19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff443b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfec105b80 0x7fcfec1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff443b700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec197040 con 0x7fcfec067ce0 2023-10-08T08:54:25.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff443b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec1971b0 con 0x7fcfec105b80 2023-10-08T08:54:25.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff443b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec197370 con 0x7fcfec1051c0 2023-10-08T08:54:25.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff21d7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 0x7fcfec19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff21d7700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 0x7fcfec19c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53744/0 (socket says 172.21.15.70:53744) 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff21d7700 1 -- 172.21.15.70:0/3119443513 learned_addr learned my addr 172.21.15.70:0/3119443513 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff29d8700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfec105b80 0x7fcfec1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.480+0000 7fcff19d6700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfec1051c0 0x7fcfec19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff21d7700 1 -- 172.21.15.70:0/3119443513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfec1051c0 msgr2=0x7fcfec19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff21d7700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfec1051c0 0x7fcfec19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff21d7700 1 -- 172.21.15.70:0/3119443513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfec105b80 msgr2=0x7fcfec1969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff21d7700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfec105b80 0x7fcfec1969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff21d7700 1 -- 172.21.15.70:0/3119443513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0095f0 con 0x7fcfec067ce0 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff29d8700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfec105b80 0x7fcfec1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff19d6700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfec1051c0 0x7fcfec19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:54:25.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff21d7700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 0x7fcfec19c8b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c010 tx=0x7fcfdc00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:25.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcfe37fe700 1 -- 172.21.15.70:0/3119443513 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc01c070 con 0x7fcfec067ce0 2023-10-08T08:54:25.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcfe37fe700 1 -- 172.21.15.70:0/3119443513 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfdc022420 con 0x7fcfec067ce0 2023-10-08T08:54:25.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcfe37fe700 1 -- 172.21.15.70:0/3119443513 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc017650 con 0x7fcfec067ce0 2023-10-08T08:54:25.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec1975f0 con 0x7fcfec067ce0 2023-10-08T08:54:25.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.481+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec1a38a0 con 0x7fcfec067ce0 2023-10-08T08:54:25.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.482+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec108c70 con 0x7fcfec067ce0 2023-10-08T08:54:25.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.483+0000 7fcfe37fe700 1 -- 172.21.15.70:0/3119443513 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fcfdc020070 con 0x7fcfec067ce0 2023-10-08T08:54:25.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.484+0000 7fcfe37fe700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcfd80a15f0 0x7fcfd80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.484+0000 7fcfe37fe700 1 -- 172.21.15.70:0/3119443513 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7fcfdc0ce940 con 0x7fcfec067ce0 2023-10-08T08:54:25.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.484+0000 7fcff19d6700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcfd80a15f0 0x7fcfd80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.484+0000 7fcff19d6700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcfd80a15f0 0x7fcfd80a3ab0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8005fd0 tx=0x7fcfe8005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:25.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.487+0000 7fcfe37fe700 1 -- 172.21.15.70:0/3119443513 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcfdc0979d0 con 0x7fcfec067ce0 2023-10-08T08:54:25.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:25 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1027564228' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:54:25.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.679+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcfec197780 con 0x7fcfec067ce0 2023-10-08T08:54:25.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.680+0000 7fcfe37fe700 1 -- 172.21.15.70:0/3119443513 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfdc022590 con 0x7fcfec067ce0 2023-10-08T08:54:25.681 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:54:25.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcfd80a15f0 msgr2=0x7fcfd80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcfd80a15f0 0x7fcfd80a3ab0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8005fd0 tx=0x7fcfe8005ee0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 msgr2=0x7fcfec19c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 0x7fcfec19c8b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c010 tx=0x7fcfdc00f740 comp rx=0 tx=0).stop 2023-10-08T08:54:25.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 shutdown_connections 2023-10-08T08:54:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fcfd80a15f0 0x7fcfd80a3ab0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfec105b80 0x7fcfec1969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfec067ce0 0x7fcfec19c8b0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 --2- 172.21.15.70:0/3119443513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfec1051c0 0x7fcfec19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 >> 172.21.15.70:0/3119443513 conn(0x7fcfec076780 msgr2=0x7fcfec0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 shutdown_connections 2023-10-08T08:54:25.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.682+0000 7fcff443b700 1 -- 172.21.15.70:0/3119443513 wait complete. 2023-10-08T08:54:25.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:25 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1027564228' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:54:25.695 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T08:54:25.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:25 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1027564228' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:54:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.817+0000 7f3da80d5700 1 -- 172.21.15.70:0/1799766990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da0104130 msgr2=0x7f3da010bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.817+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1799766990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da0104130 0x7f3da010bcb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800b0a0 tx=0x7f3d9800b3b0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.817+0000 7f3da80d5700 1 -- 172.21.15.70:0/1799766990 shutdown_connections 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.817+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1799766990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da0104130 0x7f3da010bcb0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.817+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1799766990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3da00ff060 0x7f3da00ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.817+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1799766990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3da00ffa10 0x7f3da0103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.817+0000 7f3da80d5700 1 -- 172.21.15.70:0/1799766990 >> 172.21.15.70:0/1799766990 conn(0x7f3da0075c20 msgr2=0x7f3da00fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 -- 172.21.15.70:0/1799766990 shutdown_connections 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 -- 172.21.15.70:0/1799766990 wait complete. 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 Processor -- start 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 -- start start 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3da00ff060 0x7f3da010d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3da0104130 0x7f3da010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010de50 0x7f3da01a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da01a5430 con 0x7f3da010de50 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da01a55a0 con 0x7f3da00ff060 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da80d5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da01a5760 con 0x7f3da0104130 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da6672700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010de50 0x7f3da01a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da6672700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010de50 0x7f3da01a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53760/0 (socket says 172.21.15.70:53760) 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.818+0000 7f3da6672700 1 -- 172.21.15.70:0/1287051005 learned_addr learned my addr 172.21.15.70:0/1287051005 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da5e71700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3da00ff060 0x7f3da010d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da5670700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3da0104130 0x7f3da010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da6672700 1 -- 172.21.15.70:0/1287051005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3da0104130 msgr2=0x7f3da010d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da6672700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3da0104130 0x7f3da010d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da6672700 1 -- 172.21.15.70:0/1287051005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3da00ff060 msgr2=0x7f3da010d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:25.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da6672700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3da00ff060 0x7f3da010d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:25.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da6672700 1 -- 172.21.15.70:0/1287051005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98009d00 con 0x7f3da010de50 2023-10-08T08:54:25.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da5670700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3da0104130 0x7f3da010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:54:25.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da6672700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010de50 0x7f3da01a4e60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800b070 tx=0x7f3d98007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:25.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3d96ffd700 1 -- 172.21.15.70:0/1287051005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800e040 con 0x7f3da010de50 2023-10-08T08:54:25.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3d96ffd700 1 -- 172.21.15.70:0/1287051005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d9800be40 con 0x7f3da010de50 2023-10-08T08:54:25.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da01a59e0 con 0x7f3da010de50 2023-10-08T08:54:25.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3d96ffd700 1 -- 172.21.15.70:0/1287051005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980052a0 con 0x7f3da010de50 2023-10-08T08:54:25.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.819+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da01a5e60 con 0x7f3da010de50 2023-10-08T08:54:25.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.820+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da0107310 con 0x7f3da010de50 2023-10-08T08:54:25.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.821+0000 7f3d96ffd700 1 -- 172.21.15.70:0/1287051005 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f3d9801d470 con 0x7f3da010de50 2023-10-08T08:54:25.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.822+0000 7f3d96ffd700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3d8c0a15f0 0x7f3d8c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:25.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.822+0000 7f3d96ffd700 1 -- 172.21.15.70:0/1287051005 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f3d980cf000 con 0x7f3da010de50 2023-10-08T08:54:25.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.822+0000 7f3da5e71700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3d8c0a15f0 0x7f3d8c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:25.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.822+0000 7f3da5e71700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3d8c0a15f0 0x7f3d8c0a3ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000ac50 tx=0x7f3d9000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:25.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:25.825+0000 7f3d96ffd700 1 -- 172.21.15.70:0/1287051005 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3d980981a0 con 0x7f3da010de50 2023-10-08T08:54:26.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.016+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3da010e8b0 con 0x7f3da010de50 2023-10-08T08:54:26.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.016+0000 7f3d96ffd700 1 -- 172.21.15.70:0/1287051005 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d9809b7c0 con 0x7f3da010de50 2023-10-08T08:54:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-10-08T08:54:26.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3d8c0a15f0 msgr2=0x7f3d8c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3d8c0a15f0 0x7f3d8c0a3ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000ac50 tx=0x7f3d9000a380 comp rx=0 tx=0).stop 2023-10-08T08:54:26.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010de50 msgr2=0x7f3da01a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010de50 0x7f3da01a4e60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800b070 tx=0x7f3d98007930 comp rx=0 tx=0).stop 2023-10-08T08:54:26.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 shutdown_connections 2023-10-08T08:54:26.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f3d8c0a15f0 0x7f3d8c0a3ab0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010de50 0x7f3da01a4e60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3da00ff060 0x7f3da010d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 --2- 172.21.15.70:0/1287051005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3da0104130 0x7f3da010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 >> 172.21.15.70:0/1287051005 conn(0x7f3da0075c20 msgr2=0x7f3da00fb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:26.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 shutdown_connections 2023-10-08T08:54:26.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.018+0000 7f3da80d5700 1 -- 172.21.15.70:0/1287051005 wait complete. 2023-10-08T08:54:26.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T08:54:26.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.155+0000 7f1490cfa700 1 -- 172.21.15.70:0/691886810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c105b80 msgr2=0x7f148c10d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.155+0000 7f1490cfa700 1 --2- 172.21.15.70:0/691886810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c105b80 0x7f148c10d590 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f148400b0d0 tx=0x7f148400b3e0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.155+0000 7f1490cfa700 1 -- 172.21.15.70:0/691886810 shutdown_connections 2023-10-08T08:54:26.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.155+0000 7f1490cfa700 1 --2- 172.21.15.70:0/691886810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c105b80 0x7f148c10d590 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.155+0000 7f1490cfa700 1 --2- 172.21.15.70:0/691886810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f148c067ce0 0x7f148c0680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.155+0000 7f1490cfa700 1 --2- 172.21.15.70:0/691886810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f148c1051c0 0x7f148c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.155+0000 7f1490cfa700 1 -- 172.21.15.70:0/691886810 >> 172.21.15.70:0/691886810 conn(0x7f148c076780 msgr2=0x7f148c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:26.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.155+0000 7f1490cfa700 1 -- 172.21.15.70:0/691886810 shutdown_connections 2023-10-08T08:54:26.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.155+0000 7f1490cfa700 1 -- 172.21.15.70:0/691886810 wait complete. 2023-10-08T08:54:26.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f1490cfa700 1 Processor -- start 2023-10-08T08:54:26.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f1490cfa700 1 -- start start 2023-10-08T08:54:26.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f1490cfa700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c067ce0 0x7f148c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:26.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f1490cfa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f148c1051c0 0x7f148c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:26.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f1490cfa700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f148c105b80 0x7f148c196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:26.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f1490cfa700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c1970e0 con 0x7f148c067ce0 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f1490cfa700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c197250 con 0x7f148c105b80 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f1490cfa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c197410 con 0x7f148c1051c0 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f148a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c067ce0 0x7f148c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f148a59c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c067ce0 0x7f148c19c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53770/0 (socket says 172.21.15.70:53770) 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f148a59c700 1 -- 172.21.15.70:0/2656305022 learned_addr learned my addr 172.21.15.70:0/2656305022 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.156+0000 7f148ad9d700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f148c105b80 0x7f148c196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f148a59c700 1 -- 172.21.15.70:0/2656305022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f148c1051c0 msgr2=0x7f148c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f148a59c700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f148c1051c0 0x7f148c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f148a59c700 1 -- 172.21.15.70:0/2656305022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f148c105b80 msgr2=0x7f148c196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f148a59c700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f148c105b80 0x7f148c196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f148a59c700 1 -- 172.21.15.70:0/2656305022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484009d00 con 0x7f148c067ce0 2023-10-08T08:54:26.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f148a59c700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c067ce0 0x7f148c19c950 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f148000d950 tx=0x7f148000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:26.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f147b7fe700 1 -- 172.21.15.70:0/2656305022 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480009b40 con 0x7f148c067ce0 2023-10-08T08:54:26.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f147b7fe700 1 -- 172.21.15.70:0/2656305022 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1480009ca0 con 0x7f148c067ce0 2023-10-08T08:54:26.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f147b7fe700 1 -- 172.21.15.70:0/2656305022 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148000f620 con 0x7f148c067ce0 2023-10-08T08:54:26.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c1976f0 con 0x7f148c067ce0 2023-10-08T08:54:26.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.157+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c1a3940 con 0x7f148c067ce0 2023-10-08T08:54:26.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.158+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c108c70 con 0x7f148c067ce0 2023-10-08T08:54:26.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.159+0000 7f147b7fe700 1 -- 172.21.15.70:0/2656305022 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f1480010460 con 0x7f148c067ce0 2023-10-08T08:54:26.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.160+0000 7f147b7fe700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14740a1670 0x7f14740a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:26.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.160+0000 7f1489d9b700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14740a1670 0x7f14740a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:26.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.160+0000 7f147b7fe700 1 -- 172.21.15.70:0/2656305022 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f14800cd770 con 0x7f148c067ce0 2023-10-08T08:54:26.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.160+0000 7f1489d9b700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14740a1670 0x7f14740a3b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f148c197c40 tx=0x7f147c005c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:26.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.164+0000 7f147b7fe700 1 -- 172.21.15.70:0/2656305022 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1480096770 con 0x7f148c067ce0 2023-10-08T08:54:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.360+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f148c197f40 con 0x7f148c067ce0 2023-10-08T08:54:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.360+0000 7f147b7fe700 1 -- 172.21.15.70:0/2656305022 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v100) v1 ==== 103+0+11 (secure 0 0 0) 0x7f14800200a0 con 0x7f148c067ce0 2023-10-08T08:54:26.361 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-10-08T08:54:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14740a1670 msgr2=0x7f14740a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14740a1670 0x7f14740a3b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f148c197c40 tx=0x7f147c005c90 comp rx=0 tx=0).stop 2023-10-08T08:54:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c067ce0 msgr2=0x7f148c19c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c067ce0 0x7f148c19c950 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f148000d950 tx=0x7f148000dd10 comp rx=0 tx=0).stop 2023-10-08T08:54:26.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 shutdown_connections 2023-10-08T08:54:26.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f14740a1670 0x7f14740a3b30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f148c105b80 0x7f148c196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148c067ce0 0x7f148c19c950 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 --2- 172.21.15.70:0/2656305022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f148c1051c0 0x7f148c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 >> 172.21.15.70:0/2656305022 conn(0x7f148c076780 msgr2=0x7f148c0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:26.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 shutdown_connections 2023-10-08T08:54:26.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.362+0000 7f1490cfa700 1 -- 172.21.15.70:0/2656305022 wait complete. 2023-10-08T08:54:26.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:26 smithi070 ceph-mon[99513]: pgmap v621: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:54:26.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:26 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2338133572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:54:26.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:26 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3119443513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:54:26.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:26 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1287051005' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:54:26.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T08:54:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 -- 172.21.15.70:0/625410966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ff0b0 msgr2=0x7f900c0ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 --2- 172.21.15.70:0/625410966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ff0b0 0x7f900c0ff530 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40099c0 tx=0x7f8ff4009cd0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 -- 172.21.15.70:0/625410966 shutdown_connections 2023-10-08T08:54:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 --2- 172.21.15.70:0/625410966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f900c0ffa70 0x7f900c10bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 --2- 172.21.15.70:0/625410966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f900c103df0 0x7f900c1041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 --2- 172.21.15.70:0/625410966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ff0b0 0x7f900c0ff530 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 -- 172.21.15.70:0/625410966 >> 172.21.15.70:0/625410966 conn(0x7f900c074940 msgr2=0x7f900c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 -- 172.21.15.70:0/625410966 shutdown_connections 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 -- 172.21.15.70:0/625410966 wait complete. 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 Processor -- start 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.497+0000 7f90125ed700 1 -- start start 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f90125ed700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f900c0ff0b0 0x7f900c0fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f90125ed700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ffa70 0x7f900c0fc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f90125ed700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f900c103df0 0x7f900c0fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f90125ed700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1a4f90 con 0x7f900c0ffa70 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f90125ed700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1a5100 con 0x7f900c103df0 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f90125ed700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1a52c0 con 0x7f900c0ff0b0 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ffa70 0x7f900c0fc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ffa70 0x7f900c0fc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53786/0 (socket says 172.21.15.70:53786) 2023-10-08T08:54:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900b7fe700 1 -- 172.21.15.70:0/4107457081 learned_addr learned my addr 172.21.15.70:0/4107457081 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900bfff700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f900c0ff0b0 0x7f900c0fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f9010b8a700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f900c103df0 0x7f900c0fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900b7fe700 1 -- 172.21.15.70:0/4107457081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f900c0ff0b0 msgr2=0x7f900c0fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900b7fe700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f900c0ff0b0 0x7f900c0fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900b7fe700 1 -- 172.21.15.70:0/4107457081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f900c103df0 msgr2=0x7f900c0fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900b7fe700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f900c103df0 0x7f900c0fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900b7fe700 1 -- 172.21.15.70:0/4107457081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff40095f0 con 0x7f900c0ffa70 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.498+0000 7f900b7fe700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ffa70 0x7f900c0fc830 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400b580 tx=0x7f8ff4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.499+0000 7f90097fa700 1 -- 172.21.15.70:0/4107457081 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff401d070 con 0x7f900c0ffa70 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.499+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c1a5540 con 0x7f900c0ffa70 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.499+0000 7f90097fa700 1 -- 172.21.15.70:0/4107457081 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ff400fb30 con 0x7f900c0ffa70 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.499+0000 7f90097fa700 1 -- 172.21.15.70:0/4107457081 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4022cf0 con 0x7f900c0ffa70 2023-10-08T08:54:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.499+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c1a5960 con 0x7f900c0ffa70 2023-10-08T08:54:26.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.499+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c100520 con 0x7f900c0ffa70 2023-10-08T08:54:26.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.501+0000 7f90097fa700 1 -- 172.21.15.70:0/4107457081 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f8ff400fca0 con 0x7f900c0ffa70 2023-10-08T08:54:26.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.501+0000 7f90097fa700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ff80a15f0 0x7f8ff80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:26.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.501+0000 7f90097fa700 1 -- 172.21.15.70:0/4107457081 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f8ff40ce8d0 con 0x7f900c0ffa70 2023-10-08T08:54:26.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.501+0000 7f900bfff700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ff80a15f0 0x7f8ff80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:26.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.502+0000 7f900bfff700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ff80a15f0 0x7f8ff80a3ab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f900c077170 tx=0x7f8ffc00a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:26.506 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.505+0000 7f90097fa700 1 -- 172.21.15.70:0/4107457081 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ff4097960 con 0x7f900c0ffa70 2023-10-08T08:54:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:26 smithi191 ceph-mon[104220]: pgmap v621: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:54:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:26 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2338133572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:54:26.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:26 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3119443513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:54:26.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:26 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1287051005' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:54:26.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.710+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f900c067980 con 0x7f900c0ffa70 2023-10-08T08:54:26.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.711+0000 7f90097fa700 1 -- 172.21.15.70:0/4107457081 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v100) v1 ==== 81+0+887 (secure 0 0 0) 0x7f8ff409af80 con 0x7f900c0ffa70 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/3825871538 2023-10-09T08:36:38.980084+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3658176342 2023-10-09T08:36:38.980084+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3301361990 2023-10-09T08:36:38.980084+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3846422459 2023-10-09T08:36:38.980084+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/4070856372 2023-10-09T08:35:35.987952+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1873815706 2023-10-09T08:35:35.987952+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/2782530370 2023-10-09T08:35:35.987952+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1161134171 2023-10-09T08:35:13.093969+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/741640578 2023-10-09T08:35:13.093969+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2321306431 2023-10-09T08:35:13.093969+0000 2023-10-08T08:54:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1852102021 2023-10-09T08:35:13.093969+0000 2023-10-08T08:54:26.713 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/3825871538 2023-10-09T08:36:38.980084+0000 2023-10-08T08:54:26.713 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1161134171 2023-10-09T08:35:13.093969+0000 2023-10-08T08:54:26.713 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1882565327 2023-10-09T08:35:35.987952+0000 2023-10-08T08:54:26.713 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/2782530370 2023-10-09T08:35:35.987952+0000 2023-10-08T08:54:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.712+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ff80a15f0 msgr2=0x7f8ff80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.712+0000 7f90125ed700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ff80a15f0 0x7f8ff80a3ab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f900c077170 tx=0x7f8ffc00a380 comp rx=0 tx=0).stop 2023-10-08T08:54:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.712+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ffa70 msgr2=0x7f900c0fc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.712+0000 7f90125ed700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ffa70 0x7f900c0fc830 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400b580 tx=0x7f8ff4004730 comp rx=0 tx=0).stop 2023-10-08T08:54:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.713+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 shutdown_connections 2023-10-08T08:54:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.713+0000 7f90125ed700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f8ff80a15f0 0x7f8ff80a3ab0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.713+0000 7f90125ed700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f900c103df0 0x7f900c0fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.713+0000 7f90125ed700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f900c0ff0b0 0x7f900c0fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.713+0000 7f90125ed700 1 --2- 172.21.15.70:0/4107457081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f900c0ffa70 0x7f900c0fc830 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:26.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.713+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 >> 172.21.15.70:0/4107457081 conn(0x7f900c074940 msgr2=0x7f900c102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:26.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.713+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 shutdown_connections 2023-10-08T08:54:26.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:26.713+0000 7f90125ed700 1 -- 172.21.15.70:0/4107457081 wait complete. 2023-10-08T08:54:26.715 INFO:teuthology.orchestra.run.smithi070.stderr:listed 15 entries 2023-10-08T08:54:26.725 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T08:54:26.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:54:26.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T08:54:26.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:26 smithi105 ceph-mon[103798]: pgmap v621: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:54:26.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:26 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2338133572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T08:54:26.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:26 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3119443513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T08:54:26.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:26 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1287051005' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T08:54:26.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:54:26.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:54:26.796 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T08:54:26.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:54:26.813 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-10-08T08:54:26.869 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T08:54:26.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:54:26.870 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T08:54:26.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:54:26.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2023-10-08T08:54:27.066 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T08:54:27.067 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-10-08T08:54:27.067 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T08:54:27.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16132 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/c3b31ebab99267debcf866bfefe5888cad34809b8d494aa218e7b64c9f3f6e2e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/c3b31ebab99267debcf866bfefe5888cad34809b8d494aa218e7b64c9f3f6e2e/diff,workdir=/var/lib/containers/storage/overlay/c3b31ebab99267debcf866bfefe5888cad34809b8d494aa218e7b64c9f3f6e2e/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/506cf7cbc13ec640d172dc21f51247df8213b898d976bd8254602b9acc270664/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/506cf7cbc13ec640d172dc21f51247df8213b898d976bd8254602b9acc270664/diff,workdir=/var/lib/containers/storage/overlay/506cf7cbc13ec640d172dc21f51247df8213b898d976bd8254602b9acc270664/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/2fd42641a541b82ca97e62d7a7b781a3b16aa08bda35e254795036598df1fa52/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/2fd42641a541b82ca97e62d7a7b781a3b16aa08bda35e254795036598df1fa52/diff,workdir=/var/lib/containers/storage/overlay/2fd42641a541b82ca97e62d7a7b781a3b16aa08bda35e254795036598df1fa52/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c075158c1a5f0dcecd2e2304e9fc4ebb48a6f495a52733c6cf40f2aaeb1118de/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/c075158c1a5f0dcecd2e2304e9fc4ebb48a6f495a52733c6cf40f2aaeb1118de/diff,workdir=/var/lib/containers/storage/overlay/c075158c1a5f0dcecd2e2304e9fc4ebb48a6f495a52733c6cf40f2aaeb1118de/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/fdbbf7823f0e5362bbdafbef3bf2b667cb20cd5563e94f391d74f87bfb7bc2a9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/fdbbf7823f0e5362bbdafbef3bf2b667cb20cd5563e94f391d74f87bfb7bc2a9/diff,workdir=/var/lib/containers/storage/overlay/fdbbf7823f0e5362bbdafbef3bf2b667cb20cd5563e94f391d74f87bfb7bc2a9/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/7e33b169142701db73e16af1de9f401b7e752aac7e4a8d4aaa922490dba422f2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/7e33b169142701db73e16af1de9f401b7e752aac7e4a8d4aaa922490dba422f2/diff,workdir=/var/lib/containers/storage/overlay/7e33b169142701db73e16af1de9f401b7e752aac7e4a8d4aaa922490dba422f2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0f3c34c5c9c27cb9343584401887e2951bc93a236efa6d01b24a3cfd53ad92cf/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/0f3c34c5c9c27cb9343584401887e2951bc93a236efa6d01b24a3cfd53ad92cf/diff,workdir=/var/lib/containers/storage/overlay/0f3c34c5c9c27cb9343584401887e2951bc93a236efa6d01b24a3cfd53ad92cf/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/db42bb71533b41fa0fb1a06ab3c457cc1fc0596c813e19ebd1618d8cf31e8782/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/db42bb71533b41fa0fb1a06ab3c457cc1fc0596c813e19ebd1618d8cf31e8782/diff,workdir=/var/lib/containers/storage/overlay/db42bb71533b41fa0fb1a06ab3c457cc1fc0596c813e19ebd1618d8cf31e8782/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/29c2c0675e1c0400798bcd615c21878917423e79d7997d92c482e82c9930c293/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/29c2c0675e1c0400798bcd615c21878917423e79d7997d92c482e82c9930c293/diff,workdir=/var/lib/containers/storage/overlay/29c2c0675e1c0400798bcd615c21878917423e79d7997d92c482e82c9930c293/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e602f44cf9227a1f1845f166f50918ec5864615f381c3107bcf87c46d85c8253/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/Y24K6MX5GDEY7CB4LADGRLLCPO:/var/lib/containers/storage/overlay/l/F3L4G3W7D5B3P267E6PA7PUWC2,upperdir=/var/lib/containers/storage/overlay/e602f44cf9227a1f1845f166f50918ec5864615f381c3107bcf87c46d85c8253/diff,workdir=/var/lib/containers/storage/overlay/e602f44cf9227a1f1845f166f50918ec5864615f381c3107bcf87c46d85c8253/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-10-08T08:54:27.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:54:27.086 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-10-08T08:54:27.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T08:54:27.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2023-10-08T08:54:27.214 INFO:teuthology.orchestra.run.smithi070.stderr:Cannot find device "ceph-brx" 2023-10-08T08:54:27.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:54:27.215 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-08T08:54:27.226 INFO:tasks.cephadm:Teardown begin 2023-10-08T08:54:27.226 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T08:54:27.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:54:27.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 -- 172.21.15.70:0/274475350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 msgr2=0x7f49841059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:27.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 --2- 172.21.15.70:0/274475350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 0x7f49841059e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f49740099c0 tx=0x7f4974009cd0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 -- 172.21.15.70:0/274475350 shutdown_connections 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 --2- 172.21.15.70:0/274475350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49840fff00 0x7f498410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 --2- 172.21.15.70:0/274475350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 0x7f49841059e0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 --2- 172.21.15.70:0/274475350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840ff540 0x7f49840ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 -- 172.21.15.70:0/274475350 >> 172.21.15.70:0/274475350 conn(0x7f49840fb030 msgr2=0x7f49840fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 -- 172.21.15.70:0/274475350 shutdown_connections 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 -- 172.21.15.70:0/274475350 wait complete. 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 Processor -- start 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 -- start start 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49840ff540 0x7f49841978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:27.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840fff00 0x7f4984197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 0x7f49841a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4984198620 con 0x7f4984105600 2023-10-08T08:54:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.378+0000 7f498b543700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49841a2e70 con 0x7f49840fff00 2023-10-08T08:54:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f498b543700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49841a2fb0 con 0x7f49840ff540 2023-10-08T08:54:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4989ae0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 0x7f49841a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4989ae0700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 0x7f49841a2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53802/0 (socket says 172.21.15.70:53802) 2023-10-08T08:54:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4989ae0700 1 -- 172.21.15.70:0/3059028193 learned_addr learned my addr 172.21.15.70:0/3059028193 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f49892df700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49840ff540 0x7f49841978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4988ade700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840fff00 0x7f4984197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4989ae0700 1 -- 172.21.15.70:0/3059028193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49840ff540 msgr2=0x7f49841978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4989ae0700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49840ff540 0x7f49841978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4989ae0700 1 -- 172.21.15.70:0/3059028193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840fff00 msgr2=0x7f4984197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4989ae0700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840fff00 0x7f4984197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4989ae0700 1 -- 172.21.15.70:0/3059028193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49740095f0 con 0x7f4984105600 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f4989ae0700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 0x7f49841a2930 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f497c007d70 tx=0x7f497c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f497a7fc700 1 -- 172.21.15.70:0/3059028193 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c00ad40 con 0x7f4984105600 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f497a7fc700 1 -- 172.21.15.70:0/3059028193 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f497c0128e0 con 0x7f4984105600 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49841a3210 con 0x7f4984105600 2023-10-08T08:54:27.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f497a7fc700 1 -- 172.21.15.70:0/3059028193 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0116b0 con 0x7f4984105600 2023-10-08T08:54:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.379+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49841a36a0 con 0x7f4984105600 2023-10-08T08:54:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.380+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4984107a80 con 0x7f4984105600 2023-10-08T08:54:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.381+0000 7f497a7fc700 1 -- 172.21.15.70:0/3059028193 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f497c012420 con 0x7f4984105600 2023-10-08T08:54:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.382+0000 7f497a7fc700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49700a15f0 0x7f49700a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.382+0000 7f49892df700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49700a15f0 0x7f49700a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.382+0000 7f497a7fc700 1 -- 172.21.15.70:0/3059028193 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f497c0cd960 con 0x7f4984105600 2023-10-08T08:54:27.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.383+0000 7f49892df700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49700a15f0 0x7f49700a3ab0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4974009990 tx=0x7f4974005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:27.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.386+0000 7f497a7fc700 1 -- 172.21.15.70:0/3059028193 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f497c096a70 con 0x7f4984105600 2023-10-08T08:54:27.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:27 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/2656305022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:54:27.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:27 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/4107457081' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T08:54:27.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.620+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4984100c60 con 0x7f4984105600 2023-10-08T08:54:27.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.620+0000 7f497a7fc700 1 -- 172.21.15.70:0/3059028193 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f497c09a090 con 0x7f4984105600 2023-10-08T08:54:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:54:27.621 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":62,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:50:38.703112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":61,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_25918":{"gid":25918,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/269007402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":269007402},{"type":"v1","addr":"172.21.15.105:6835","nonce":269007402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:54:27.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49700a15f0 msgr2=0x7f49700a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:27.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49700a15f0 0x7f49700a3ab0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4974009990 tx=0x7f4974005bc0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 msgr2=0x7f49841a2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:27.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 0x7f49841a2930 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f497c007d70 tx=0x7f497c00a340 comp rx=0 tx=0).stop 2023-10-08T08:54:27.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 shutdown_connections 2023-10-08T08:54:27.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f49700a15f0 0x7f49700a3ab0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4984105600 0x7f49841a2930 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49840ff540 0x7f49841978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 --2- 172.21.15.70:0/3059028193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840fff00 0x7f4984197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.622+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 >> 172.21.15.70:0/3059028193 conn(0x7f49840fb030 msgr2=0x7f49840fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:27.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.623+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 shutdown_connections 2023-10-08T08:54:27.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.623+0000 7f498b543700 1 -- 172.21.15.70:0/3059028193 wait complete. 2023-10-08T08:54:27.625 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 62 2023-10-08T08:54:27.634 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:27 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/2656305022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:54:27.634 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:27 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/4107457081' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T08:54:27.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T08:54:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.756+0000 7f0e9fc49700 1 -- 172.21.15.70:0/4281869247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980fff10 msgr2=0x7f0e9810c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.756+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/4281869247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980fff10 0x7f0e9810c3d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000b0d0 tx=0x7f0e9000b3e0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.756+0000 7f0e9fc49700 1 -- 172.21.15.70:0/4281869247 shutdown_connections 2023-10-08T08:54:27.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.756+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/4281869247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980fff10 0x7f0e9810c3d0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.756+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/4281869247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e98105610 0x7f0e981059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.756+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/4281869247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e980ff550 0x7f0e980ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.756+0000 7f0e9fc49700 1 -- 172.21.15.70:0/4281869247 >> 172.21.15.70:0/4281869247 conn(0x7f0e980fb060 msgr2=0x7f0e980fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:27.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.756+0000 7f0e9fc49700 1 -- 172.21.15.70:0/4281869247 shutdown_connections 2023-10-08T08:54:27.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.756+0000 7f0e9fc49700 1 -- 172.21.15.70:0/4281869247 wait complete. 2023-10-08T08:54:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9fc49700 1 Processor -- start 2023-10-08T08:54:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9fc49700 1 -- start start 2023-10-08T08:54:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9fc49700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980ff550 0x7f0e981979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9fc49700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e980fff10 0x7f0e98197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9fc49700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e98105610 0x7f0e981a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9fc49700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e981987c0 con 0x7f0e980ff550 2023-10-08T08:54:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9fc49700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e981a2f80 con 0x7f0e980fff10 2023-10-08T08:54:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9fc49700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e981a30c0 con 0x7f0e98105610 2023-10-08T08:54:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9d9e5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980ff550 0x7f0e981979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9d9e5700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980ff550 0x7f0e981979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53812/0 (socket says 172.21.15.70:53812) 2023-10-08T08:54:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.757+0000 7f0e9d9e5700 1 -- 172.21.15.70:0/1475755189 learned_addr learned my addr 172.21.15.70:0/1475755189 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e9d1e4700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e980fff10 0x7f0e98197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e9d9e5700 1 -- 172.21.15.70:0/1475755189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e98105610 msgr2=0x7f0e981a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e9d9e5700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e98105610 0x7f0e981a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e9d9e5700 1 -- 172.21.15.70:0/1475755189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e980fff10 msgr2=0x7f0e98197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e9d9e5700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e980fff10 0x7f0e98197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e9d9e5700 1 -- 172.21.15.70:0/1475755189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e90009d00 con 0x7f0e980ff550 2023-10-08T08:54:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e9d9e5700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980ff550 0x7f0e981979c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00d980 tx=0x7f0e8c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e8affd700 1 -- 172.21.15.70:0/1475755189 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00bb60 con 0x7f0e980ff550 2023-10-08T08:54:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e8affd700 1 -- 172.21.15.70:0/1475755189 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e8c007640 con 0x7f0e980ff550 2023-10-08T08:54:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e981a33a0 con 0x7f0e980ff550 2023-10-08T08:54:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e8affd700 1 -- 172.21.15.70:0/1475755189 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c004e90 con 0x7f0e980ff550 2023-10-08T08:54:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.758+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e981a38b0 con 0x7f0e980ff550 2023-10-08T08:54:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.759+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e98107ab0 con 0x7f0e980ff550 2023-10-08T08:54:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.760+0000 7f0e8affd700 1 -- 172.21.15.70:0/1475755189 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f0e8c00bcc0 con 0x7f0e980ff550 2023-10-08T08:54:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.760+0000 7f0e8affd700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0e840a15f0 0x7f0e840a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.760+0000 7f0e9d1e4700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0e840a15f0 0x7f0e840a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.760+0000 7f0e8affd700 1 -- 172.21.15.70:0/1475755189 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f0e8c0cd2f0 con 0x7f0e980ff550 2023-10-08T08:54:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.761+0000 7f0e9d1e4700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0e840a15f0 0x7f0e840a3ab0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0e980692e0 tx=0x7f0e94009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.765+0000 7f0e8affd700 1 -- 172.21.15.70:0/1475755189 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0e8c0962f0 con 0x7f0e980ff550 2023-10-08T08:54:27.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:27 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/2656305022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T08:54:27.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:27 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/4107457081' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T08:54:27.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.997+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e98100c70 con 0x7f0e980ff550 2023-10-08T08:54:27.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:27.998+0000 7f0e8affd700 1 -- 172.21.15.70:0/1475755189 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f0e8c016090 con 0x7f0e980ff550 2023-10-08T08:54:27.999 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:54:27.999 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14721,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/915276133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":915276133},{"type":"v1","addr":"172.21.15.70:6835","nonce":915276133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14727,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3566538223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3566538223},{"type":"v1","addr":"172.21.15.70:6837","nonce":3566538223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":62,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T08:42:00.508850+0000","modified":"2023-10-08T08:50:38.703112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24605,"mds_2":24604,"mds_3":24589,"mds_4":24577},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14781":{"gid":14781,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3288548320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3288548320},{"type":"v1","addr":"172.21.15.70:6839","nonce":3288548320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14793":{"gid":14793,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/1499461306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":1499461306},{"type":"v1","addr":"172.21.15.70:6841","nonce":1499461306}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/2360801114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2360801114},{"type":"v1","addr":"172.21.15.191:6833","nonce":2360801114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/1292328490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1292328490},{"type":"v1","addr":"172.21.15.105:6833","nonce":1292328490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24577":{"gid":24577,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":61,"addr":"172.21.15.191:6835/2353311301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2353311301},{"type":"v1","addr":"172.21.15.191:6835","nonce":2353311301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24589":{"gid":24589,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.191:6837/1080059379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1080059379},{"type":"v1","addr":"172.21.15.191:6837","nonce":1080059379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24604":{"gid":24604,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6839/502953702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":502953702},{"type":"v1","addr":"172.21.15.191:6839","nonce":502953702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.105:6837/1223332925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":1223332925},{"type":"v1","addr":"172.21.15.105:6837","nonce":1223332925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6839/586756410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":586756410},{"type":"v1","addr":"172.21.15.105:6839","nonce":586756410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_25918":{"gid":25918,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/269007402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":269007402},{"type":"v1","addr":"172.21.15.105:6835","nonce":269007402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T08:54:28.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0e840a15f0 msgr2=0x7f0e840a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0e840a15f0 0x7f0e840a3ab0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0e980692e0 tx=0x7f0e94009260 comp rx=0 tx=0).stop 2023-10-08T08:54:28.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980ff550 msgr2=0x7f0e981979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980ff550 0x7f0e981979c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00d980 tx=0x7f0e8c00dd40 comp rx=0 tx=0).stop 2023-10-08T08:54:28.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 shutdown_connections 2023-10-08T08:54:28.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f0e840a15f0 0x7f0e840a3ab0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e98105610 0x7f0e981a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e980ff550 0x7f0e981979c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 --2- 172.21.15.70:0/1475755189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e980fff10 0x7f0e98197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.000+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 >> 172.21.15.70:0/1475755189 conn(0x7f0e980fb060 msgr2=0x7f0e980fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:28.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.001+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 shutdown_connections 2023-10-08T08:54:28.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.001+0000 7f0e9fc49700 1 -- 172.21.15.70:0/1475755189 wait complete. 2023-10-08T08:54:28.003 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 62 2023-10-08T08:54:28.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T08:54:28.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 -- 172.21.15.70:0/2898164525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8101000 msgr2=0x7f02f810d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/2898164525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8101000 0x7f02f810d510 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009990 tx=0x7f02e8009ca0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 -- 172.21.15.70:0/2898164525 shutdown_connections 2023-10-08T08:54:28.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/2898164525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8101000 0x7f02f810d510 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/2898164525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02f8106650 0x7f02f8106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/2898164525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02f8100640 0x7f02f8100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 -- 172.21.15.70:0/2898164525 >> 172.21.15.70:0/2898164525 conn(0x7f02f80fc170 msgr2=0x7f02f80fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:28.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 -- 172.21.15.70:0/2898164525 shutdown_connections 2023-10-08T08:54:28.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 -- 172.21.15.70:0/2898164525 wait complete. 2023-10-08T08:54:28.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 Processor -- start 2023-10-08T08:54:28.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.134+0000 7f02ff0ba700 1 -- start start 2023-10-08T08:54:28.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02ff0ba700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8100640 0x7f02f819c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02ff0ba700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02f8101000 0x7f02f819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02ff0ba700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02f8106650 0x7f02f8196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02ff0ba700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f8196ec0 con 0x7f02f8100640 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02ff0ba700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f8197030 con 0x7f02f8106650 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02ff0ba700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81971f0 con 0x7f02f8101000 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fce56700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8100640 0x7f02f819c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fce56700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8100640 0x7f02f819c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53826/0 (socket says 172.21.15.70:53826) 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fce56700 1 -- 172.21.15.70:0/1026298728 learned_addr learned my addr 172.21.15.70:0/1026298728 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02f7fff700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02f8101000 0x7f02f819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fd657700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02f8106650 0x7f02f8196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fce56700 1 -- 172.21.15.70:0/1026298728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02f8101000 msgr2=0x7f02f819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fce56700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02f8101000 0x7f02f819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fce56700 1 -- 172.21.15.70:0/1026298728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02f8106650 msgr2=0x7f02f8196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fce56700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02f8106650 0x7f02f8196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fce56700 1 -- 172.21.15.70:0/1026298728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80095f0 con 0x7f02f8100640 2023-10-08T08:54:28.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02fce56700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8100640 0x7f02f819c720 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f02f000ef10 tx=0x7f02f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:28.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02f5ffb700 1 -- 172.21.15.70:0/1026298728 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f000ca70 con 0x7f02f8100640 2023-10-08T08:54:28.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02f5ffb700 1 -- 172.21.15.70:0/1026298728 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02f000f040 con 0x7f02f8100640 2023-10-08T08:54:28.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f8197470 con 0x7f02f8100640 2023-10-08T08:54:28.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.135+0000 7f02f5ffb700 1 -- 172.21.15.70:0/1026298728 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0014480 con 0x7f02f8100640 2023-10-08T08:54:28.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.136+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f81a3710 con 0x7f02f8100640 2023-10-08T08:54:28.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.137+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f8108c40 con 0x7f02f8100640 2023-10-08T08:54:28.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.138+0000 7f02f5ffb700 1 -- 172.21.15.70:0/1026298728 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f02f0007500 con 0x7f02f8100640 2023-10-08T08:54:28.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.138+0000 7f02f5ffb700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f02e40a15f0 0x7f02e40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.138+0000 7f02f5ffb700 1 -- 172.21.15.70:0/1026298728 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f02f00cd710 con 0x7f02f8100640 2023-10-08T08:54:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.138+0000 7f02f7fff700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f02e40a15f0 0x7f02e40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.139+0000 7f02f7fff700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f02e40a15f0 0x7f02e40a3ab0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f02f8197c70 tx=0x7f02e00073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:28.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.143+0000 7f02f5ffb700 1 -- 172.21.15.70:0/1026298728 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f02f0096710 con 0x7f02f8100640 2023-10-08T08:54:28.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.338+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02f8197d10 con 0x7f02f8100640 2023-10-08T08:54:28.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.339+0000 7f02f5ffb700 1 -- 172.21.15.70:0/1026298728 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+24929 (secure 0 0 0) 0x7f02f0099d30 con 0x7f02f8100640 2023-10-08T08:54:28.340 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-08T08:54:28.341 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":100,"fsid":"6a2c3394-65b5-11ee-8db5-212e2dc638e7","created":"2023-10-08T08:34:39.696066+0000","modified":"2023-10-08T08:54:19.266351+0000","last_up_change":"2023-10-08T08:41:19.073329+0000","last_in_change":"2023-10-08T08:41:02.215801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T08:38:15.300562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T08:41:58.471600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T08:41:59.698555+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T08:42:03.384369+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e8cad845-82ee-41e7-ac3e-d24a2ee07b70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6803","nonce":2462488428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6805","nonce":2462488428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6809","nonce":2462488428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2462488428},{"type":"v1","addr":"172.21.15.70:6807","nonce":2462488428}]},"public_addr":"172.21.15.70:6803/2462488428","cluster_addr":"172.21.15.70:6805/2462488428","heartbeat_back_addr":"172.21.15.70:6809/2462488428","heartbeat_front_addr":"172.21.15.70:6807/2462488428","state":["exists","up"]},{"osd":1,"uuid":"b3b37cb8-fe51-4f85-9ffc-5519bc4556c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6801","nonce":898277124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6803","nonce":898277124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6807","nonce":898277124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":898277124},{"type":"v1","addr":"172.21.15.105:6805","nonce":898277124}]},"public_addr":"172.21.15.105:6801/898277124","cluster_addr":"172.21.15.105:6803/898277124","heartbeat_back_addr":"172.21.15.105:6807/898277124","heartbeat_front_addr":"172.21.15.105:6805/898277124","state":["exists","up"]},{"osd":2,"uuid":"f582afa9-c586-4006-b266-e0bbb3976b53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6801","nonce":1578654309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6803","nonce":1578654309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6807","nonce":1578654309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1578654309},{"type":"v1","addr":"172.21.15.191:6805","nonce":1578654309}]},"public_addr":"172.21.15.191:6801/1578654309","cluster_addr":"172.21.15.191:6803/1578654309","heartbeat_back_addr":"172.21.15.191:6807/1578654309","heartbeat_front_addr":"172.21.15.191:6805/1578654309","state":["exists","up"]},{"osd":3,"uuid":"c4bbfa87-a5af-4322-bc0e-f5f97d3fe053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6811","nonce":2319296502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6813","nonce":2319296502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6817","nonce":2319296502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":2319296502},{"type":"v1","addr":"172.21.15.70:6815","nonce":2319296502}]},"public_addr":"172.21.15.70:6811/2319296502","cluster_addr":"172.21.15.70:6813/2319296502","heartbeat_back_addr":"172.21.15.70:6817/2319296502","heartbeat_front_addr":"172.21.15.70:6815/2319296502","state":["exists","up"]},{"osd":4,"uuid":"e75c81f9-f784-47dd-8db2-cc0c3da2ea42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6809","nonce":2528806135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6811","nonce":2528806135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6815","nonce":2528806135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2528806135},{"type":"v1","addr":"172.21.15.105:6813","nonce":2528806135}]},"public_addr":"172.21.15.105:6809/2528806135","cluster_addr":"172.21.15.105:6811/2528806135","heartbeat_back_addr":"172.21.15.105:6815/2528806135","heartbeat_front_addr":"172.21.15.105:6813/2528806135","state":["exists","up"]},{"osd":5,"uuid":"fa4cc6c7-0ffc-40ff-bee0-98fd9fef512e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6809","nonce":3480587463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6811","nonce":3480587463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6815","nonce":3480587463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3480587463},{"type":"v1","addr":"172.21.15.191:6813","nonce":3480587463}]},"public_addr":"172.21.15.191:6809/3480587463","cluster_addr":"172.21.15.191:6811/3480587463","heartbeat_back_addr":"172.21.15.191:6815/3480587463","heartbeat_front_addr":"172.21.15.191:6813/3480587463","state":["exists","up"]},{"osd":6,"uuid":"a61e4df7-535c-4870-9f56-828ead178a58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6819","nonce":2512675210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6821","nonce":2512675210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6825","nonce":2512675210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2512675210},{"type":"v1","addr":"172.21.15.70:6823","nonce":2512675210}]},"public_addr":"172.21.15.70:6819/2512675210","cluster_addr":"172.21.15.70:6821/2512675210","heartbeat_back_addr":"172.21.15.70:6825/2512675210","heartbeat_front_addr":"172.21.15.70:6823/2512675210","state":["exists","up"]},{"osd":7,"uuid":"acd9b422-1496-46dd-b947-fc8f8bab8398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6817","nonce":591750025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6819","nonce":591750025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6823","nonce":591750025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":591750025},{"type":"v1","addr":"172.21.15.105:6821","nonce":591750025}]},"public_addr":"172.21.15.105:6817/591750025","cluster_addr":"172.21.15.105:6819/591750025","heartbeat_back_addr":"172.21.15.105:6823/591750025","heartbeat_front_addr":"172.21.15.105:6821/591750025","state":["exists","up"]},{"osd":8,"uuid":"fffb4528-d810-483d-a63b-744ae1ab17fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6817","nonce":1026056491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6819","nonce":1026056491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6823","nonce":1026056491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1026056491},{"type":"v1","addr":"172.21.15.191:6821","nonce":1026056491}]},"public_addr":"172.21.15.191:6817/1026056491","cluster_addr":"172.21.15.191:6819/1026056491","heartbeat_back_addr":"172.21.15.191:6823/1026056491","heartbeat_front_addr":"172.21.15.191:6821/1026056491","state":["exists","up"]},{"osd":9,"uuid":"7ff2f169-52f3-4b84-91ac-ae5b97b27bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6827","nonce":4105424601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6829","nonce":4105424601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6833","nonce":4105424601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4105424601},{"type":"v1","addr":"172.21.15.70:6831","nonce":4105424601}]},"public_addr":"172.21.15.70:6827/4105424601","cluster_addr":"172.21.15.70:6829/4105424601","heartbeat_back_addr":"172.21.15.70:6833/4105424601","heartbeat_front_addr":"172.21.15.70:6831/4105424601","state":["exists","up"]},{"osd":10,"uuid":"4a718b26-f154-454f-8756-acebf09a6e05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6825","nonce":911786652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6827","nonce":911786652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6831","nonce":911786652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":911786652},{"type":"v1","addr":"172.21.15.105:6829","nonce":911786652}]},"public_addr":"172.21.15.105:6825/911786652","cluster_addr":"172.21.15.105:6827/911786652","heartbeat_back_addr":"172.21.15.105:6831/911786652","heartbeat_front_addr":"172.21.15.105:6829/911786652","state":["exists","up"]},{"osd":11,"uuid":"b2d38075-48f4-4e3d-9886-8b1fcf7162dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6825","nonce":1547082968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6827","nonce":1547082968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6831","nonce":1547082968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1547082968},{"type":"v1","addr":"172.21.15.191:6829","nonce":1547082968}]},"public_addr":"172.21.15.191:6825/1547082968","cluster_addr":"172.21.15.191:6827/1547082968","heartbeat_back_addr":"172.21.15.191:6831/1547082968","heartbeat_front_addr":"172.21.15.191:6829/1547082968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:29.886146+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:37:50.937236+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:11.979268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:32.930694+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:38:53.095553+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:13.649239+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:34.585806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:39:55.216768+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:15.603540+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:36.970986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:40:57.539858+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T08:41:17.715771+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3658176342":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3301361990":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/3846422459":"2023-10-09T08:36:38.980084+0000","172.21.15.70:0/4070856372":"2023-10-09T08:35:35.987952+0000","172.21.15.70:0/1873815706":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6801/2782530370":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/741640578":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/2321306431":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1852102021":"2023-10-09T08:35:13.093969+0000","172.21.15.70:6800/3825871538":"2023-10-09T08:36:38.980084+0000","172.21.15.70:6801/1161134171":"2023-10-09T08:35:13.093969+0000","172.21.15.70:0/1882565327":"2023-10-09T08:35:35.987952+0000","172.21.15.70:6800/2782530370":"2023-10-09T08:35:35.987952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T08:54:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.341+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f02e40a15f0 msgr2=0x7f02e40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.341+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f02e40a15f0 0x7f02e40a3ab0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f02f8197c70 tx=0x7f02e00073d0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.341+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8100640 msgr2=0x7f02f819c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.341+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8100640 0x7f02f819c720 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f02f000ef10 tx=0x7f02f000c3a0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.342+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 shutdown_connections 2023-10-08T08:54:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.342+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f02e40a15f0 0x7f02e40a3ab0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.342+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02f8106650 0x7f02f8196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.342+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02f8100640 0x7f02f819c720 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.342+0000 7f02ff0ba700 1 --2- 172.21.15.70:0/1026298728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02f8101000 0x7f02f819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.342+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 >> 172.21.15.70:0/1026298728 conn(0x7f02f80fc170 msgr2=0x7f02f80fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.342+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 shutdown_connections 2023-10-08T08:54:28.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.342+0000 7f02ff0ba700 1 -- 172.21.15.70:0/1026298728 wait complete. 2023-10-08T08:54:28.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T08:54:28.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.476+0000 7f9491cbf700 1 -- 172.21.15.70:0/2231353902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0fffe0 msgr2=0x7f948c10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.476+0000 7f9491cbf700 1 --2- 172.21.15.70:0/2231353902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0fffe0 0x7f948c10c4e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f948400b0a0 tx=0x7f948400b3b0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.476+0000 7f9491cbf700 1 -- 172.21.15.70:0/2231353902 shutdown_connections 2023-10-08T08:54:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.476+0000 7f9491cbf700 1 --2- 172.21.15.70:0/2231353902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0fffe0 0x7f948c10c4e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.476+0000 7f9491cbf700 1 --2- 172.21.15.70:0/2231353902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c1056b0 0x7f948c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.476+0000 7f9491cbf700 1 --2- 172.21.15.70:0/2231353902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948c0ff620 0x7f948c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.476+0000 7f9491cbf700 1 -- 172.21.15.70:0/2231353902 >> 172.21.15.70:0/2231353902 conn(0x7f948c076780 msgr2=0x7f948c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.476+0000 7f9491cbf700 1 -- 172.21.15.70:0/2231353902 shutdown_connections 2023-10-08T08:54:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.476+0000 7f9491cbf700 1 -- 172.21.15.70:0/2231353902 wait complete. 2023-10-08T08:54:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f9491cbf700 1 Processor -- start 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f9491cbf700 1 -- start start 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f9491cbf700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0ff620 0x7f948c19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f9491cbf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948c0fffe0 0x7f948c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f9491cbf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c1056b0 0x7f948c195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f9491cbf700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c195eb0 con 0x7f948c0ff620 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f9491cbf700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c196020 con 0x7f948c0fffe0 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f9491cbf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1961e0 con 0x7f948c1056b0 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f948b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0ff620 0x7f948c19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f948b7fe700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0ff620 0x7f948c19b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53840/0 (socket says 172.21.15.70:53840) 2023-10-08T08:54:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f948b7fe700 1 -- 172.21.15.70:0/1112874704 learned_addr learned my addr 172.21.15.70:0/1112874704 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.477+0000 7f948affd700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948c0fffe0 0x7f948c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f948bfff700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c1056b0 0x7f948c195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f948b7fe700 1 -- 172.21.15.70:0/1112874704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c1056b0 msgr2=0x7f948c195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f948b7fe700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c1056b0 0x7f948c195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f948b7fe700 1 -- 172.21.15.70:0/1112874704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948c0fffe0 msgr2=0x7f948c19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f948b7fe700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948c0fffe0 0x7f948c19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f948b7fe700 1 -- 172.21.15.70:0/1112874704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484009d00 con 0x7f948c0ff620 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f948affd700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948c0fffe0 0x7f948c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f948bfff700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c1056b0 0x7f948c195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f948b7fe700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0ff620 0x7f948c19b710 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f948000ea80 tx=0x7f948000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f9488ff9700 1 -- 172.21.15.70:0/1112874704 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480013070 con 0x7f948c0ff620 2023-10-08T08:54:28.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f9488ff9700 1 -- 172.21.15.70:0/1112874704 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9480004020 con 0x7f948c0ff620 2023-10-08T08:54:28.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c1964c0 con 0x7f948c0ff620 2023-10-08T08:54:28.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f9488ff9700 1 -- 172.21.15.70:0/1112874704 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480003b70 con 0x7f948c0ff620 2023-10-08T08:54:28.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.478+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c067a10 con 0x7f948c0ff620 2023-10-08T08:54:28.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.479+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c100d50 con 0x7f948c0ff620 2023-10-08T08:54:28.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.480+0000 7f9488ff9700 1 -- 172.21.15.70:0/1112874704 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f9480004190 con 0x7f948c0ff620 2023-10-08T08:54:28.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.481+0000 7f9488ff9700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f94740a15f0 0x7f94740a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.481+0000 7f948affd700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f94740a15f0 0x7f94740a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.481+0000 7f9488ff9700 1 -- 172.21.15.70:0/1112874704 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9323+0+0 (secure 0 0 0) 0x7f94800cf3e0 con 0x7f948c0ff620 2023-10-08T08:54:28.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.481+0000 7f948affd700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f94740a15f0 0x7f94740a3ab0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f947c005950 tx=0x7f947c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:28.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.485+0000 7f9488ff9700 1 -- 172.21.15.70:0/1112874704 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f94800983e0 con 0x7f948c0ff620 2023-10-08T08:54:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-mon[104220]: pgmap v622: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:54:28.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/3059028193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:54:28.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1475755189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:54:28.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-mon[99513]: pgmap v622: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:54:28.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/3059028193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:54:28.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1475755189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:54:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.721+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f948c067530 con 0x7f948c0ff620 2023-10-08T08:54:28.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.723+0000 7f9488ff9700 1 -- 172.21.15.70:0/1112874704 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9480003cd0 con 0x7f948c0ff620 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f94740a15f0 msgr2=0x7f94740a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f94740a15f0 0x7f94740a3ab0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f947c005950 tx=0x7f947c0058e0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0ff620 msgr2=0x7f948c19b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0ff620 0x7f948c19b710 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f948000ea80 tx=0x7f948000ee40 comp rx=0 tx=0).stop 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 shutdown_connections 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f94740a15f0 0x7f94740a3ab0 secure :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f947c005950 tx=0x7f947c0058e0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c1056b0 0x7f948c195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f948c0ff620 0x7f948c19b710 secure :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f948000ea80 tx=0x7f948000ee40 comp rx=0 tx=0).stop 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 --2- 172.21.15.70:0/1112874704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948c0fffe0 0x7f948c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.727+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 >> 172.21.15.70:0/1112874704 conn(0x7f948c076780 msgr2=0x7f948c0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:28.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.733+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 shutdown_connections 2023-10-08T08:54:28.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.733+0000 7f9491cbf700 1 -- 172.21.15.70:0/1112874704 wait complete. 2023-10-08T08:54:28.734 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T08:54:28.747 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T08:54:28.768 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-mon[103798]: pgmap v622: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-10-08T08:54:28.768 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/3059028193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:54:28.768 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1475755189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T08:54:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.874+0000 7efedccaa700 1 -- 172.21.15.70:0/402354088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed81010f0 msgr2=0x7efed810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.874+0000 7efedccaa700 1 --2- 172.21.15.70:0/402354088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed81010f0 0x7efed810d600 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7efed000b0a0 tx=0x7efed000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.874+0000 7efedccaa700 1 -- 172.21.15.70:0/402354088 shutdown_connections 2023-10-08T08:54:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.874+0000 7efedccaa700 1 --2- 172.21.15.70:0/402354088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed81010f0 0x7efed810d600 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.874+0000 7efedccaa700 1 --2- 172.21.15.70:0/402354088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8106740 0x7efed8106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.874+0000 7efedccaa700 1 --2- 172.21.15.70:0/402354088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efed8100730 0x7efed8100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.874+0000 7efedccaa700 1 -- 172.21.15.70:0/402354088 >> 172.21.15.70:0/402354088 conn(0x7efed80fc200 msgr2=0x7efed80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.874+0000 7efedccaa700 1 -- 172.21.15.70:0/402354088 shutdown_connections 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.874+0000 7efedccaa700 1 -- 172.21.15.70:0/402354088 wait complete. 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efedccaa700 1 Processor -- start 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efedccaa700 1 -- start start 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efedccaa700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed8100730 0x7efed8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efedccaa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efed81010f0 0x7efed8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efedccaa700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8106740 0x7efed8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efedccaa700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed81a4f60 con 0x7efed8100730 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efedccaa700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed81a50d0 con 0x7efed8106740 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efedccaa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed81a5290 con 0x7efed81010f0 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efed659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed8100730 0x7efed8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efed659c700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed8100730 0x7efed8072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53878/0 (socket says 172.21.15.70:53878) 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efed659c700 1 -- 172.21.15.70:0/1597031050 learned_addr learned my addr 172.21.15.70:0/1597031050 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efed6d9d700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8106740 0x7efed8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.875+0000 7efed5d9b700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efed81010f0 0x7efed8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efed659c700 1 -- 172.21.15.70:0/1597031050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efed81010f0 msgr2=0x7efed8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efed659c700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efed81010f0 0x7efed8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efed659c700 1 -- 172.21.15.70:0/1597031050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8106740 msgr2=0x7efed8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efed659c700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8106740 0x7efed8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efed659c700 1 -- 172.21.15.70:0/1597031050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0009d00 con 0x7efed8100730 2023-10-08T08:54:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efed659c700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed8100730 0x7efed8072af0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efec800d980 tx=0x7efec800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efecf7fe700 1 -- 172.21.15.70:0/1597031050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8004220 con 0x7efed8100730 2023-10-08T08:54:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efecf7fe700 1 -- 172.21.15.70:0/1597031050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efec8007640 con 0x7efed8100730 2023-10-08T08:54:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed81a5570 con 0x7efed8100730 2023-10-08T08:54:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efecf7fe700 1 -- 172.21.15.70:0/1597031050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8005610 con 0x7efed8100730 2023-10-08T08:54:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.876+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed81a5a50 con 0x7efed8100730 2023-10-08T08:54:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.877+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed8108d50 con 0x7efed8100730 2023-10-08T08:54:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.878+0000 7efecf7fe700 1 -- 172.21.15.70:0/1597031050 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7efec8004750 con 0x7efed8100730 2023-10-08T08:54:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.878+0000 7efecf7fe700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec40a15f0 0x7efec40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.878+0000 7efecf7fe700 1 -- 172.21.15.70:0/1597031050 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9665+0+0 (secure 0 0 0) 0x7efec80cd3a0 con 0x7efed8100730 2023-10-08T08:54:28.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.878+0000 7efed5d9b700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec40a15f0 0x7efec40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:28.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.879+0000 7efed5d9b700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec40a15f0 0x7efec40a3ab0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efed8074220 tx=0x7efec0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:28.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:28.883+0000 7efecf7fe700 1 -- 172.21.15.70:0/1597031050 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efec80961e0 con 0x7efed8100730 2023-10-08T08:54:29.020 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[145459]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[145459]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-mds[145483]: -- 172.21.15.105:0/270484881 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557a0aa271e0 con 0x557a0a9fd000 2023-10-08T08:54:29.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[145459]: starting mds.e at 2023-10-08T08:54:29.021 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-h[142215]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.021 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-h[142215]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.021 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-mds[142239]: -- 172.21.15.105:0/961713345 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fda621d1e0 con 0x55fda61f2800 2023-10-08T08:54:29.021 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-h[142215]: starting mds.h at 2023-10-08T08:54:29.022 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-k[141538]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.022 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-k[141538]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.022 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-k[141538]: starting mds.k at 2023-10-08T08:54:29.022 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.022 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.022 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-mds[142581]: -- 172.21.15.105:0/1249764254 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563f4b0d31e0 con 0x563f4b0a8c00 2023-10-08T08:54:29.023 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:54:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: starting mds.b at 2023-10-08T08:54:29.094 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-c[142551]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.095 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-c[142551]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.095 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-mds[142575]: -- 172.21.15.191:0/3840646206 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562e836091e0 con 0x562e835de800 2023-10-08T08:54:29.095 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-c[142551]: starting mds.c at 2023-10-08T08:54:29.095 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-mds[142228]: -- 172.21.15.191:0/2252894621 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5588c2c051e0 con 0x5588c2bda800 2023-10-08T08:54:29.096 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: starting mds.f at 2023-10-08T08:54:29.096 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-i[142892]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.096 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-i[142892]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.097 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-mds[142916]: -- 172.21.15.191:0/1712439033 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55625163f1e0 con 0x556251614c00 2023-10-08T08:54:29.097 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-i[142892]: starting mds.i at 2023-10-08T08:54:29.097 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-l[141865]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.097 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-l[141865]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.097 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-mds[141889]: -- 172.21.15.191:0/1251654056 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bac68b11e0 con 0x55bac6886800 2023-10-08T08:54:29.097 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:54:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-l[141865]: starting mds.l at 2023-10-08T08:54:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.120+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efed8073fd0 con 0x7efed8100730 2023-10-08T08:54:29.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a[99489]: 2023-10-08T08:54:28.722+0000 7f936a984700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T08:54:29.221 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-g[159287]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.221 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-g[159287]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.221 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-mds[159311]: -- 172.21.15.70:0/1626054724 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eecf96d1e0 con 0x55eecf942800 2023-10-08T08:54:29.221 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-g[159287]: starting mds.g at 2023-10-08T08:54:29.221 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-a[159671]: ignoring --setuser ceph since I am not root 2023-10-08T08:54:29.221 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-a[159671]: ignoring --setgroup ceph since I am not root 2023-10-08T08:54:29.221 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-mds[159695]: -- 172.21.15.70:0/490867960 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5593b4f151e0 con 0x5593b4eea800 2023-10-08T08:54:29.221 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:54:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-a[159671]: starting mds.a at 2023-10-08T08:54:29.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:29 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1026298728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:54:29.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:29 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1112874704' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T08:54:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:29 smithi191 ceph-mon[104220]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T08:54:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:29 smithi191 ceph-mon[104220]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T08:54:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:29 smithi191 ceph-mon[104220]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-08T08:54:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:29 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1112874704' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T08:54:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:29 smithi191 ceph-mon[104220]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T08:54:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:29 smithi191 ceph-mon[104220]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-08T08:54:29.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:29 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1597031050' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T08:54:29.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:29 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1026298728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:54:29.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:29 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1112874704' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T08:54:29.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:29 smithi070 ceph-mon[99513]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T08:54:29.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:29 smithi070 ceph-mon[99513]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T08:54:29.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:29 smithi070 ceph-mon[99513]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-08T08:54:29.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:29 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1112874704' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T08:54:29.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:29 smithi070 ceph-mon[99513]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T08:54:29.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:29 smithi070 ceph-mon[99513]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-08T08:54:29.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:29 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1597031050' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T08:54:29.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.725+0000 7efecf7fe700 1 -- 172.21.15.70:0/1597031050 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7efec8099800 con 0x7efed8100730 2023-10-08T08:54:29.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.727+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec40a15f0 msgr2=0x7efec40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:29.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.727+0000 7efedccaa700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec40a15f0 0x7efec40a3ab0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efed8074220 tx=0x7efec0009260 comp rx=0 tx=0).stop 2023-10-08T08:54:29.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.727+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed8100730 msgr2=0x7efed8072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:29.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.728+0000 7efedccaa700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed8100730 0x7efed8072af0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efec800d980 tx=0x7efec800dc90 comp rx=0 tx=0).stop 2023-10-08T08:54:29.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.728+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 shutdown_connections 2023-10-08T08:54:29.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.728+0000 7efedccaa700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7efec40a15f0 0x7efec40a3ab0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.728+0000 7efedccaa700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8106740 0x7efed8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.728+0000 7efedccaa700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efed8100730 0x7efed8072af0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.728+0000 7efedccaa700 1 --2- 172.21.15.70:0/1597031050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efed81010f0 0x7efed8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.728+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 >> 172.21.15.70:0/1597031050 conn(0x7efed80fc200 msgr2=0x7efed80fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:29.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.728+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 shutdown_connections 2023-10-08T08:54:29.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.728+0000 7efedccaa700 1 -- 172.21.15.70:0/1597031050 wait complete. 2023-10-08T08:54:29.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T08:54:29.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:29 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1026298728' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T08:54:29.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:29 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1112874704' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T08:54:29.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:29 smithi105 ceph-mon[103798]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T08:54:29.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:29 smithi105 ceph-mon[103798]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T08:54:29.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:29 smithi105 ceph-mon[103798]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-08T08:54:29.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:29 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1112874704' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T08:54:29.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:29 smithi105 ceph-mon[103798]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T08:54:29.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:29 smithi105 ceph-mon[103798]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-08T08:54:29.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:29 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1597031050' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T08:54:29.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.874+0000 7f110d39d700 1 -- 172.21.15.70:0/806688003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ffe20 msgr2=0x7f110810c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:29.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.874+0000 7f110d39d700 1 --2- 172.21.15.70:0/806688003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ffe20 0x7f110810c330 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f110000b0a0 tx=0x7f110000b3b0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.874+0000 7f110d39d700 1 -- 172.21.15.70:0/806688003 shutdown_connections 2023-10-08T08:54:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.874+0000 7f110d39d700 1 --2- 172.21.15.70:0/806688003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ffe20 0x7f110810c330 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.874+0000 7f110d39d700 1 --2- 172.21.15.70:0/806688003 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1108105500 0x7f11081058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.874+0000 7f110d39d700 1 --2- 172.21.15.70:0/806688003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11080ff460 0x7f11080ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.874+0000 7f110d39d700 1 -- 172.21.15.70:0/806688003 >> 172.21.15.70:0/806688003 conn(0x7f11080faf50 msgr2=0x7f11080fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.874+0000 7f110d39d700 1 -- 172.21.15.70:0/806688003 shutdown_connections 2023-10-08T08:54:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.874+0000 7f110d39d700 1 -- 172.21.15.70:0/806688003 wait complete. 2023-10-08T08:54:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f110d39d700 1 Processor -- start 2023-10-08T08:54:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f110d39d700 1 -- start start 2023-10-08T08:54:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f110d39d700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ff460 0x7f1108197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f110d39d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11080ffe20 0x7f1108197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f110d39d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1108105500 0x7f11081a2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f110d39d700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1108198410 con 0x7f11080ff460 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f110d39d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11081a2c40 con 0x7f11080ffe20 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f110d39d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11081a2d80 con 0x7f1108105500 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f1107fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ff460 0x7f1108197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f1107fff700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ff460 0x7f1108197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53896/0 (socket says 172.21.15.70:53896) 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f1107fff700 1 -- 172.21.15.70:0/1850335719 learned_addr learned my addr 172.21.15.70:0/1850335719 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f110cb9c700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1108105500 0x7f11081a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f11077fe700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11080ffe20 0x7f1108197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f1107fff700 1 -- 172.21.15.70:0/1850335719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1108105500 msgr2=0x7f11081a2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f1107fff700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1108105500 0x7f11081a2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f1107fff700 1 -- 172.21.15.70:0/1850335719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11080ffe20 msgr2=0x7f1108197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.875+0000 7f1107fff700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11080ffe20 0x7f1108197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.876+0000 7f1107fff700 1 -- 172.21.15.70:0/1850335719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100009d00 con 0x7f11080ff460 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.876+0000 7f11077fe700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11080ffe20 0x7f1108197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.876+0000 7f1107fff700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ff460 0x7f1108197680 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f10f000c9e0 tx=0x7f10f000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.876+0000 7f11057fa700 1 -- 172.21.15.70:0/1850335719 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0007ac0 con 0x7f11080ff460 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.876+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11081a2fe0 con 0x7f11080ff460 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.876+0000 7f11057fa700 1 -- 172.21.15.70:0/1850335719 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10f0007c20 con 0x7f11080ff460 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.876+0000 7f11057fa700 1 -- 172.21.15.70:0/1850335719 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0018660 con 0x7f11080ff460 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.876+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11081a34b0 con 0x7f11080ff460 2023-10-08T08:54:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.877+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1108100ba0 con 0x7f11080ff460 2023-10-08T08:54:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.878+0000 7f11057fa700 1 -- 172.21.15.70:0/1850335719 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f10f000f450 con 0x7f11080ff460 2023-10-08T08:54:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.878+0000 7f11057fa700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f10f40a15f0 0x7f10f40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.879+0000 7f11057fa700 1 -- 172.21.15.70:0/1850335719 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9665+0+0 (secure 0 0 0) 0x7f10f00cd720 con 0x7f11080ff460 2023-10-08T08:54:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.879+0000 7f11077fe700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f10f40a15f0 0x7f10f40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.879+0000 7f11077fe700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f10f40a15f0 0x7f10f40a3ab0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f10f8005fd0 tx=0x7f10f8005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:29.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:29.882+0000 7f11057fa700 1 -- 172.21.15.70:0/1850335719 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10f0096650 con 0x7f11080ff460 2023-10-08T08:54:30.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.076+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f11080673e0 con 0x7f11080ff460 2023-10-08T08:54:30.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: pgmap v624: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 11 op/s 2023-10-08T08:54:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T08:54:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T08:54:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: Cluster is now healthy 2023-10-08T08:54:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1597031050' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T08:54:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.70:6838/1564791712,v1:172.21.15.70:6840/1564791712] up:boot 2023-10-08T08:54:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.70:6839/3743371332,v1:172.21.15.70:6841/3743371332] up:boot 2023-10-08T08:54:30.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6832/168396469,v1:172.21.15.105:6833/168396469] up:boot 2023-10-08T08:54:30.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6834/3317195188,v1:172.21.15.105:6836/3317195188] up:boot 2023-10-08T08:54:30.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6835/3873805246,v1:172.21.15.105:6837/3873805246] up:boot 2023-10-08T08:54:30.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6832/989886088,v1:172.21.15.191:6833/989886088] up:boot 2023-10-08T08:54:30.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6836/1680710923,v1:172.21.15.191:6837/1680710923] up:boot 2023-10-08T08:54:30.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.105:6838/2999556850,v1:172.21.15.105:6839/2999556850] up:boot 2023-10-08T08:54:30.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6834/3272492733,v1:172.21.15.191:6835/3272492733] up:boot 2023-10-08T08:54:30.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: mds.? [v2:172.21.15.191:6838/3087503764,v1:172.21.15.191:6839/3087503764] up:boot 2023-10-08T08:54:30.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: fsmap 12 up:standby 2023-10-08T08:54:30.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T08:54:30.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T08:54:30.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T08:54:30.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T08:54:30.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T08:54:30.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T08:54:30.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:54:30.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T08:54:30.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T08:54:30.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T08:54:30.598 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:30 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1850335719' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:30.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: pgmap v624: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 11 op/s 2023-10-08T08:54:30.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T08:54:30.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T08:54:30.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: Cluster is now healthy 2023-10-08T08:54:30.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1597031050' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T08:54:30.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.70:6838/1564791712,v1:172.21.15.70:6840/1564791712] up:boot 2023-10-08T08:54:30.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.70:6839/3743371332,v1:172.21.15.70:6841/3743371332] up:boot 2023-10-08T08:54:30.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6832/168396469,v1:172.21.15.105:6833/168396469] up:boot 2023-10-08T08:54:30.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6834/3317195188,v1:172.21.15.105:6836/3317195188] up:boot 2023-10-08T08:54:30.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6835/3873805246,v1:172.21.15.105:6837/3873805246] up:boot 2023-10-08T08:54:30.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6832/989886088,v1:172.21.15.191:6833/989886088] up:boot 2023-10-08T08:54:30.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6836/1680710923,v1:172.21.15.191:6837/1680710923] up:boot 2023-10-08T08:54:30.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.105:6838/2999556850,v1:172.21.15.105:6839/2999556850] up:boot 2023-10-08T08:54:30.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6834/3272492733,v1:172.21.15.191:6835/3272492733] up:boot 2023-10-08T08:54:30.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: mds.? [v2:172.21.15.191:6838/3087503764,v1:172.21.15.191:6839/3087503764] up:boot 2023-10-08T08:54:30.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: fsmap 12 up:standby 2023-10-08T08:54:30.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T08:54:30.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T08:54:30.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T08:54:30.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T08:54:30.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T08:54:30.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T08:54:30.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:54:30.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T08:54:30.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T08:54:30.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T08:54:30.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:30 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1850335719' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:30.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.726+0000 7f11057fa700 1 -- 172.21.15.70:0/1850335719 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) v1 ==== 181+0+0 (secure 0 0 0) 0x7f10f0099c70 con 0x7f11080ff460 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f10f40a15f0 msgr2=0x7f10f40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f10f40a15f0 0x7f10f40a3ab0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f10f8005fd0 tx=0x7f10f8005e30 comp rx=0 tx=0).stop 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ff460 msgr2=0x7f1108197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ff460 0x7f1108197680 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f10f000c9e0 tx=0x7f10f000ccf0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 shutdown_connections 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f10f40a15f0 0x7f10f40a3ab0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1108105500 0x7f11081a2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11080ff460 0x7f1108197680 secure :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f10f000c9e0 tx=0x7f10f000ccf0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 --2- 172.21.15.70:0/1850335719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11080ffe20 0x7f1108197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 >> 172.21.15.70:0/1850335719 conn(0x7f11080faf50 msgr2=0x7f11080fb430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:30.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 shutdown_connections 2023-10-08T08:54:30.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.731+0000 7f110d39d700 1 -- 172.21.15.70:0/1850335719 wait complete. 2023-10-08T08:54:30.733 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2023-10-08T08:54:30.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T08:54:30.770 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: pgmap v624: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 11 op/s 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: Cluster is now healthy 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1597031050' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.70:6838/1564791712,v1:172.21.15.70:6840/1564791712] up:boot 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.70:6839/3743371332,v1:172.21.15.70:6841/3743371332] up:boot 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6832/168396469,v1:172.21.15.105:6833/168396469] up:boot 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6834/3317195188,v1:172.21.15.105:6836/3317195188] up:boot 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6835/3873805246,v1:172.21.15.105:6837/3873805246] up:boot 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6832/989886088,v1:172.21.15.191:6833/989886088] up:boot 2023-10-08T08:54:30.771 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6836/1680710923,v1:172.21.15.191:6837/1680710923] up:boot 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.105:6838/2999556850,v1:172.21.15.105:6839/2999556850] up:boot 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6834/3272492733,v1:172.21.15.191:6835/3272492733] up:boot 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: mds.? [v2:172.21.15.191:6838/3087503764,v1:172.21.15.191:6839/3087503764] up:boot 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: fsmap 12 up:standby 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T08:54:30.772 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T08:54:30.773 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T08:54:30.773 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='mgr.14217 172.21.15.70:0/4286018939' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T08:54:30.773 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:30 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1850335719' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:30.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.882+0000 7f09079d4700 1 -- 172.21.15.70:0/1788311208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ff630 msgr2=0x7f09000ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:30.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.882+0000 7f09079d4700 1 --2- 172.21.15.70:0/1788311208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ff630 0x7f09000ffab0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009990 tx=0x7f08fc009ca0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.882+0000 7f09079d4700 1 -- 172.21.15.70:0/1788311208 shutdown_connections 2023-10-08T08:54:30.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.882+0000 7f09079d4700 1 --2- 172.21.15.70:0/1788311208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09000ffff0 0x7f090010c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.882+0000 7f09079d4700 1 --2- 172.21.15.70:0/1788311208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0900105640 0x7f0900105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.882+0000 7f09079d4700 1 --2- 172.21.15.70:0/1788311208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ff630 0x7f09000ffab0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.882+0000 7f09079d4700 1 -- 172.21.15.70:0/1788311208 >> 172.21.15.70:0/1788311208 conn(0x7f09000767f0 msgr2=0x7f0900076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.882+0000 7f09079d4700 1 -- 172.21.15.70:0/1788311208 shutdown_connections 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.882+0000 7f09079d4700 1 -- 172.21.15.70:0/1788311208 wait complete. 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f09079d4700 1 Processor -- start 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f09079d4700 1 -- start start 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f09079d4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09000ff630 0x7f0900197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f09079d4700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ffff0 0x7f0900197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f09079d4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0900105640 0x7f09001a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f09079d4700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900198710 con 0x7f09000ffff0 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f09079d4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09001a2f40 con 0x7f09000ff630 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f09079d4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09001a3080 con 0x7f0900105640 2023-10-08T08:54:30.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0904f6f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ffff0 0x7f0900197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0904f6f700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ffff0 0x7f0900197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53912/0 (socket says 172.21.15.70:53912) 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0904f6f700 1 -- 172.21.15.70:0/1991478791 learned_addr learned my addr 172.21.15.70:0/1991478791 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0905770700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09000ff630 0x7f0900197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0905f71700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0900105640 0x7f09001a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0904f6f700 1 -- 172.21.15.70:0/1991478791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0900105640 msgr2=0x7f09001a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0904f6f700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0900105640 0x7f09001a2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0904f6f700 1 -- 172.21.15.70:0/1991478791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09000ff630 msgr2=0x7f0900197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0904f6f700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09000ff630 0x7f0900197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0904f6f700 1 -- 172.21.15.70:0/1991478791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0095f0 con 0x7f09000ffff0 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0905f71700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0900105640 0x7f09001a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T08:54:30.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.883+0000 7f0904f6f700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ffff0 0x7f0900197ec0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00f670 tx=0x7f08fc00f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.884+0000 7f08f67fc700 1 -- 172.21.15.70:0/1991478791 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01d070 con 0x7f09000ffff0 2023-10-08T08:54:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.884+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09001a32e0 con 0x7f09000ffff0 2023-10-08T08:54:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.884+0000 7f08f67fc700 1 -- 172.21.15.70:0/1991478791 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08fc005510 con 0x7f09000ffff0 2023-10-08T08:54:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.884+0000 7f08f67fc700 1 -- 172.21.15.70:0/1991478791 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc004b00 con 0x7f09000ffff0 2023-10-08T08:54:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.884+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09001a3840 con 0x7f09000ffff0 2023-10-08T08:54:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.885+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0900107c50 con 0x7f09000ffff0 2023-10-08T08:54:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.885+0000 7f08f67fc700 1 -- 172.21.15.70:0/1991478791 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7f08fc004c80 con 0x7f09000ffff0 2023-10-08T08:54:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.886+0000 7f08f67fc700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08ec0a15f0 0x7f08ec0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.886+0000 7f0905770700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08ec0a15f0 0x7f08ec0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.886+0000 7f08f67fc700 1 -- 172.21.15.70:0/1991478791 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9169+0+0 (secure 0 0 0) 0x7f08fc0ce160 con 0x7f09000ffff0 2023-10-08T08:54:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.886+0000 7f0905770700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08ec0a15f0 0x7f08ec0a3ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f08f0005fd0 tx=0x7f08f000af20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:30.890+0000 7f08f67fc700 1 -- 172.21.15.70:0/1991478791 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f08fc097280 con 0x7f09000ffff0 2023-10-08T08:54:31.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.082+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0900100d70 con 0x7f09000ffff0 2023-10-08T08:54:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.732+0000 7f08f67fc700 1 -- 172.21.15.70:0/1991478791 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0900100d70 con 0x7f09000ffff0 2023-10-08T08:54:31.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08ec0a15f0 msgr2=0x7f08ec0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:31.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08ec0a15f0 0x7f08ec0a3ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f08f0005fd0 tx=0x7f08f000af20 comp rx=0 tx=0).stop 2023-10-08T08:54:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ffff0 msgr2=0x7f0900197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ffff0 0x7f0900197ec0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00f670 tx=0x7f08fc00f750 comp rx=0 tx=0).stop 2023-10-08T08:54:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 shutdown_connections 2023-10-08T08:54:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7f08ec0a15f0 0x7f08ec0a3ab0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0900105640 0x7f09001a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09000ff630 0x7f0900197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 --2- 172.21.15.70:0/1991478791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09000ffff0 0x7f0900197ec0 secure :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00f670 tx=0x7f08fc00f750 comp rx=0 tx=0).stop 2023-10-08T08:54:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.737+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 >> 172.21.15.70:0/1991478791 conn(0x7f09000767f0 msgr2=0x7f0900102200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.738+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 shutdown_connections 2023-10-08T08:54:31.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.738+0000 7f09079d4700 1 -- 172.21.15.70:0/1991478791 wait complete. 2023-10-08T08:54:31.740 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2023-10-08T08:54:31.758 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-08T08:54:31.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.888+0000 7fa8bab25700 1 -- 172.21.15.70:0/2104621196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8b40ff640 msgr2=0x7fa8b40ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.888+0000 7fa8bab25700 1 --2- 172.21.15.70:0/2104621196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8b40ff640 0x7fa8b40ffac0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009990 tx=0x7fa8a0009ca0 comp rx=0 tx=0).stop 2023-10-08T08:54:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.888+0000 7fa8bab25700 1 -- 172.21.15.70:0/2104621196 shutdown_connections 2023-10-08T08:54:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.888+0000 7fa8bab25700 1 --2- 172.21.15.70:0/2104621196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b4100000 0x7fa8b410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.888+0000 7fa8bab25700 1 --2- 172.21.15.70:0/2104621196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8b4105630 0x7fa8b4105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.888+0000 7fa8bab25700 1 --2- 172.21.15.70:0/2104621196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8b40ff640 0x7fa8b40ffac0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.888+0000 7fa8bab25700 1 -- 172.21.15.70:0/2104621196 >> 172.21.15.70:0/2104621196 conn(0x7fa8b4076790 msgr2=0x7fa8b4076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.889+0000 7fa8bab25700 1 -- 172.21.15.70:0/2104621196 shutdown_connections 2023-10-08T08:54:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.889+0000 7fa8bab25700 1 -- 172.21.15.70:0/2104621196 wait complete. 2023-10-08T08:54:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.890+0000 7fa8bab25700 1 Processor -- start 2023-10-08T08:54:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8bab25700 1 -- start start 2023-10-08T08:54:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8bab25700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8b40ff640 0x7fa8b41a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8bab25700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8b4100000 0x7fa8b41a3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8bab25700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b4105630 0x7fa8b410b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8bab25700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b410bb70 con 0x7fa8b4100000 2023-10-08T08:54:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8bab25700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b410bce0 con 0x7fa8b4105630 2023-10-08T08:54:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8bab25700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b410bea0 con 0x7fa8b40ff640 2023-10-08T08:54:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8b88c1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8b40ff640 0x7fa8b41a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8b88c1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8b40ff640 0x7fa8b41a2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:41502/0 (socket says 172.21.15.70:41502) 2023-10-08T08:54:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8b88c1700 1 -- 172.21.15.70:0/743078645 learned_addr learned my addr 172.21.15.70:0/743078645 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-10-08T08:54:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8b88c1700 1 -- 172.21.15.70:0/743078645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b4105630 msgr2=0x7fa8b410b4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T08:54:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8b88c1700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b4105630 0x7fa8b410b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8b88c1700 1 -- 172.21.15.70:0/743078645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8b4100000 msgr2=0x7fa8b41a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8b88c1700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8b4100000 0x7fa8b41a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.891+0000 7fa8b88c1700 1 -- 172.21.15.70:0/743078645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00095f0 con 0x7fa8b40ff640 2023-10-08T08:54:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.892+0000 7fa8b88c1700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8b40ff640 0x7fa8b41a2ee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c9b0 tx=0x7fa8a800cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.892+0000 7fa8b1ffb700 1 -- 172.21.15.70:0/743078645 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8007b00 con 0x7fa8b40ff640 2023-10-08T08:54:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.892+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b410c180 con 0x7fa8b40ff640 2023-10-08T08:54:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.892+0000 7fa8b1ffb700 1 -- 172.21.15.70:0/743078645 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8a8007c60 con 0x7fa8b40ff640 2023-10-08T08:54:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.892+0000 7fa8b1ffb700 1 -- 172.21.15.70:0/743078645 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80186f0 con 0x7fa8b40ff640 2023-10-08T08:54:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.892+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b41a9fd0 con 0x7fa8b40ff640 2023-10-08T08:54:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.894+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b4100d60 con 0x7fa8b40ff640 2023-10-08T08:54:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.895+0000 7fa8b1ffb700 1 -- 172.21.15.70:0/743078645 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 22) v1 ==== 136134+0+0 (secure 0 0 0) 0x7fa8a800f9a0 con 0x7fa8b40ff640 2023-10-08T08:54:31.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.895+0000 7fa8b1ffb700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa8a40a15f0 0x7fa8a40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T08:54:31.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.895+0000 7fa8b1ffb700 1 -- 172.21.15.70:0/743078645 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8639+0+0 (secure 0 0 0) 0x7fa8a80cd320 con 0x7fa8b40ff640 2023-10-08T08:54:31.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.896+0000 7fa8b3fff700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa8a40a15f0 0x7fa8a40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T08:54:31.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.896+0000 7fa8b3fff700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa8a40a15f0 0x7fa8a40a3ab0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00098e0 tx=0x7fa8a0005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T08:54:31.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:31.899+0000 7fa8b1ffb700 1 -- 172.21.15.70:0/743078645 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa8a80965d0 con 0x7fa8b40ff640 2023-10-08T08:54:32.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:31 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1850335719' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T08:54:32.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:31 smithi105 ceph-mon[103798]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T08:54:32.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:31 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1991478791' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:32.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:31 smithi105 ceph-mon[103798]: pgmap v626: 97 pgs: 97 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:54:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.091+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8b4067980 con 0x7fa8b40ff640 2023-10-08T08:54:32.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:31 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1850335719' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T08:54:32.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:31 smithi191 ceph-mon[104220]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T08:54:32.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:31 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1991478791' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:32.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:31 smithi191 ceph-mon[104220]: pgmap v626: 97 pgs: 97 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:54:32.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:31 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1850335719' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T08:54:32.220 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:31 smithi070 ceph-mon[99513]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T08:54:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:31 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1991478791' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:32.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:31 smithi070 ceph-mon[99513]: pgmap v626: 97 pgs: 97 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T08:54:32.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.742+0000 7fa8b1ffb700 1 -- 172.21.15.70:0/743078645 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v104) v1 ==== 178+0+0 (secure 0 0 0) 0x7fa8b4067980 con 0x7fa8b40ff640 2023-10-08T08:54:32.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.750+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa8a40a15f0 msgr2=0x7fa8a40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:32.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.750+0000 7fa8bab25700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa8a40a15f0 0x7fa8a40a3ab0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00098e0 tx=0x7fa8a0005fb0 comp rx=0 tx=0).stop 2023-10-08T08:54:32.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.750+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8b40ff640 msgr2=0x7fa8b41a2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T08:54:32.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.750+0000 7fa8bab25700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8b40ff640 0x7fa8b41a2ee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c9b0 tx=0x7fa8a800cd70 comp rx=0 tx=0).stop 2023-10-08T08:54:32.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.755+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 shutdown_connections 2023-10-08T08:54:32.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.755+0000 7fa8bab25700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.70:6800/1401477652,v1:172.21.15.70:6801/1401477652] conn(0x7fa8a40a15f0 0x7fa8a40a3ab0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:32.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.755+0000 7fa8bab25700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b4105630 0x7fa8b410b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:32.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.755+0000 7fa8bab25700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8b40ff640 0x7fa8b41a2ee0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:32.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.755+0000 7fa8bab25700 1 --2- 172.21.15.70:0/743078645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8b4100000 0x7fa8b41a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T08:54:32.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.755+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 >> 172.21.15.70:0/743078645 conn(0x7fa8b4076790 msgr2=0x7fa8b40fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T08:54:32.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.755+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 shutdown_connections 2023-10-08T08:54:32.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-10-08T08:54:32.755+0000 7fa8bab25700 1 -- 172.21.15.70:0/743078645 wait complete. 2023-10-08T08:54:32.757 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data_ec' removed 2023-10-08T08:54:32.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T08:54:32.801 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T08:54:32.834 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T08:54:32.903 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-08T08:54:32.904 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T08:54:32.933 DEBUG:teuthology.orchestra.run.smithi105:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T08:54:32.951 DEBUG:teuthology.orchestra.run.smithi191:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T08:54:32.968 INFO:tasks.cephadm:Stopping all daemons... 2023-10-08T08:54:32.969 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-08T08:54:32.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T08:54:32.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:32 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/1991478791' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T08:54:32.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:32 smithi070 ceph-mon[99513]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T08:54:32.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:32 smithi070 ceph-mon[99513]: from='client.? 172.21.15.70:0/743078645' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:32.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:32 smithi070 ceph-mon[99513]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:33.020 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:32 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/1991478791' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T08:54:33.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:32 smithi105 ceph-mon[103798]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T08:54:33.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:32 smithi105 ceph-mon[103798]: from='client.? 172.21.15.70:0/743078645' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:33.021 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:32 smithi105 ceph-mon[103798]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:33.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:32 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/1991478791' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T08:54:33.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:32 smithi191 ceph-mon[104220]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T08:54:33.094 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:32 smithi191 ceph-mon[104220]: from='client.? 172.21.15.70:0/743078645' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:33.095 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:32 smithi191 ceph-mon[104220]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T08:54:33.312 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:33 smithi070 systemd[1]: Stopping Ceph mon.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:54:33.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a[99489]: 2023-10-08T08:54:33.311+0000 7f937018f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:54:33.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a[99489]: 2023-10-08T08:54:33.311+0000 7f937018f700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-08T08:54:33.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.a.service' 2023-10-08T08:54:33.854 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:33 smithi070 bash[185067]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-a 2023-10-08T08:54:33.854 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:33 smithi070 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-08T08:54:33.854 INFO:journalctl@ceph.mon.a.smithi070.stdout:Oct 08 08:54:33 smithi070 systemd[1]: Stopped Ceph mon.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:54:33.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:54:33.898 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-08T08:54:33.899 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-08T08:54:33.899 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.b 2023-10-08T08:54:34.271 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:33 smithi105 systemd[1]: Stopping Ceph mon.b for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:54:34.616 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:34 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-b[103774]: 2023-10-08T08:54:34.334+0000 7f368a70a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:54:34.616 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:34 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-b[103774]: 2023-10-08T08:54:34.334+0000 7f368a70a700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-08T08:54:34.965 INFO:journalctl@ceph.mon.b.smithi105.stdout:Oct 08 08:54:34 smithi105 bash[147872]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-b 2023-10-08T08:54:34.972 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.b.service' 2023-10-08T08:54:35.049 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:54:35.049 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-08T08:54:35.049 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-08T08:54:35.050 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.c 2023-10-08T08:54:35.344 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:35 smithi191 systemd[1]: Stopping Ceph mon.c for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:54:35.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:35 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-c[104192]: 2023-10-08T08:54:35.408+0000 7f4809a50700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:54:35.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:35 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-c[104192]: 2023-10-08T08:54:35.408+0000 7f4809a50700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-08T08:54:36.050 INFO:journalctl@ceph.mon.c.smithi191.stdout:Oct 08 08:54:35 smithi191 bash[147723]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mon-c 2023-10-08T08:54:36.057 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mon.c.service' 2023-10-08T08:54:36.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:54:36.113 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-08T08:54:36.113 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-08T08:54:36.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T08:54:36.470 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:54:36 smithi070 systemd[1]: Stopping Ceph mgr.x for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:54:36.772 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:54:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:54:36.481+0000 7f5141636700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:54:36.772 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:54:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x[99757]: 2023-10-08T08:54:36.481+0000 7f5141636700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-08T08:54:36.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.x.service' 2023-10-08T08:54:37.023 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:54:36 smithi070 bash[185206]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-x 2023-10-08T08:54:37.024 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:54:36 smithi070 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.x.service: Succeeded. 2023-10-08T08:54:37.024 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Oct 08 08:54:36 smithi070 systemd[1]: Stopped Ceph mgr.x for 6a2c3394-65b5-11ee-8db5-212e2dc638e7. 2023-10-08T08:54:37.035 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:54:37.036 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-08T08:54:37.036 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-08T08:54:37.036 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.y 2023-10-08T08:54:37.520 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:54:37 smithi105 systemd[1]: Stopping Ceph mgr.y for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:54:37.941 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:54:37 smithi105 bash[148027]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-y 2023-10-08T08:54:37.942 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Oct 08 08:54:37 smithi105 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-08T08:54:38.125 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.y.service' 2023-10-08T08:54:38.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:54:38.162 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-08T08:54:38.162 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-08T08:54:38.162 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.z 2023-10-08T08:54:38.589 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:54:38 smithi191 systemd[1]: Stopping Ceph mgr.z for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:54:38.844 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:54:38 smithi191 bash[147865]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mgr-z 2023-10-08T08:54:38.844 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Oct 08 08:54:38 smithi191 systemd[1]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-08T08:54:39.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mgr.z.service' 2023-10-08T08:54:39.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:54:39.094 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-08T08:54:39.094 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-08T08:54:39.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.0 2023-10-08T08:54:39.439 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:54:39 smithi070 systemd[1]: Stopping Ceph osd.0 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:54:39.720 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:54:39 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-0[125553]: 2023-10-08T08:54:39.437+0000 7f6c6febf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:54:39.720 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:54:39 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-0[125553]: 2023-10-08T08:54:39.437+0000 7f6c6febf700 -1 osd.0 104 *** Got signal Terminated *** 2023-10-08T08:54:39.720 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:54:39 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-0[125553]: 2023-10-08T08:54:39.437+0000 7f6c6febf700 -1 osd.0 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:54:45.470 INFO:journalctl@ceph.osd.0.smithi070.stdout:Oct 08 08:54:45 smithi070 bash[185347]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-0 2023-10-08T08:54:46.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.0.service' 2023-10-08T08:54:46.571 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:54:46.571 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-08T08:54:46.571 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-08T08:54:46.571 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.1 2023-10-08T08:54:46.926 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:54:46 smithi105 systemd[1]: Stopping Ceph osd.1 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:54:47.271 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:54:46 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-1[109984]: 2023-10-08T08:54:46.924+0000 7fc90ae55700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:54:47.271 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:54:46 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-1[109984]: 2023-10-08T08:54:46.924+0000 7fc90ae55700 -1 osd.1 104 *** Got signal Terminated *** 2023-10-08T08:54:47.271 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:54:46 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-1[109984]: 2023-10-08T08:54:46.924+0000 7fc90ae55700 -1 osd.1 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:54:52.709 INFO:journalctl@ceph.osd.1.smithi105.stdout:Oct 08 08:54:52 smithi105 bash[148173]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-1 2023-10-08T08:54:53.975 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.1.service' 2023-10-08T08:54:54.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:54:54.017 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-08T08:54:54.017 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-08T08:54:54.017 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.2 2023-10-08T08:54:54.344 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:54:54 smithi191 systemd[1]: Stopping Ceph osd.2 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:54:54.844 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:54:54 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-2[111440]: 2023-10-08T08:54:54.371+0000 7f01173ae700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:54:54.844 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:54:54 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-2[111440]: 2023-10-08T08:54:54.371+0000 7f01173ae700 -1 osd.2 104 *** Got signal Terminated *** 2023-10-08T08:54:54.844 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:54:54 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-2[111440]: 2023-10-08T08:54:54.371+0000 7f01173ae700 -1 osd.2 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:55:00.159 INFO:journalctl@ceph.osd.2.smithi191.stdout:Oct 08 08:55:00 smithi191 bash[148018]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-2 2023-10-08T08:55:01.425 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.2.service' 2023-10-08T08:55:01.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:55:01.465 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-08T08:55:01.465 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-08T08:55:01.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.3 2023-10-08T08:55:01.818 INFO:journalctl@ceph.osd.3.smithi070.stdout:Oct 08 08:55:01 smithi070 systemd[1]: Stopping Ceph osd.3 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:55:02.220 INFO:journalctl@ceph.osd.3.smithi070.stdout:Oct 08 08:55:01 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-3[134233]: 2023-10-08T08:55:01.816+0000 7f15a7a72700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:55:02.221 INFO:journalctl@ceph.osd.3.smithi070.stdout:Oct 08 08:55:01 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-3[134233]: 2023-10-08T08:55:01.816+0000 7f15a7a72700 -1 osd.3 104 *** Got signal Terminated *** 2023-10-08T08:55:02.221 INFO:journalctl@ceph.osd.3.smithi070.stdout:Oct 08 08:55:01 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-3[134233]: 2023-10-08T08:55:01.816+0000 7f15a7a72700 -1 osd.3 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:55:06.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:05 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:05.719+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:06.970 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:06 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:06.717+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:07.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:06 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:06.865+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:07.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:07 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:07.100+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:07.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:07 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:07.460+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:07.970 INFO:journalctl@ceph.osd.3.smithi070.stdout:Oct 08 08:55:07 smithi070 bash[185630]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-3 2023-10-08T08:55:07.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:07 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:07.703+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:08.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:07 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:07.898+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:08.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:08 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:08.080+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:08.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:08 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:08.492+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:08.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:08 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:08.656+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:09.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.3.service' 2023-10-08T08:55:09.140 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:55:09.141 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-08T08:55:09.141 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-08T08:55:09.141 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.4 2023-10-08T08:55:09.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:08 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:08.936+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:09.497 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:09 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:09.044+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:09.497 INFO:journalctl@ceph.osd.4.smithi105.stdout:Oct 08 08:55:09 smithi105 systemd[1]: Stopping Ceph osd.4 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:55:09.770 INFO:journalctl@ceph.osd.4.smithi105.stdout:Oct 08 08:55:09 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-4[118657]: 2023-10-08T08:55:09.495+0000 7f83ae8ca700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:55:09.770 INFO:journalctl@ceph.osd.4.smithi105.stdout:Oct 08 08:55:09 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-4[118657]: 2023-10-08T08:55:09.495+0000 7f83ae8ca700 -1 osd.4 104 *** Got signal Terminated *** 2023-10-08T08:55:09.771 INFO:journalctl@ceph.osd.4.smithi105.stdout:Oct 08 08:55:09 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-4[118657]: 2023-10-08T08:55:09.495+0000 7f83ae8ca700 -1 osd.4 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:55:09.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:09 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:09.528+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:09.970 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:09 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:09.702+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:10.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:09 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:09.973+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:10.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:10 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:10.219+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:10.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:10 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:10.064+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:10.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:10 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:10.556+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:11.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:10 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:10.745+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:11.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:10 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:10.955+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:11.345 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:11 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:11.173+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:11.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:11 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:11.092+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:11.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:11 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:11.565+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:12.200 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:11 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:11.932+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:12.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:11 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:11.757+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:12.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:12 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:12.082+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:12.585 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:12 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:12.199+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:12.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:12 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:12.584+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:13.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:12 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:12.738+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:13.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:12 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:12.979+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:13.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:13 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:13.184+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:13.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:13 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:13.054+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:13.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:13 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:13.054+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:13.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:13 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:13.561+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:13.970 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:13 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:13.749+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:13.971 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:13 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:13.649+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:14.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:13 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:13.849+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:14.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:14 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:14.016+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:14.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:14 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:14.016+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:14.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:14 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:14.180+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:14.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:13 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:13.954+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:14.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:13 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:13.954+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:51.108871+0000 front 2023-10-08T08:54:51.108975+0000 (oldest deadline 2023-10-08T08:55:13.408853+0000) 2023-10-08T08:55:14.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:14 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:14.554+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:14.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:14 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:14.659+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:14.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:14 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:14.776+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:15.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:14 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:14.869+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:15.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:15 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:15.003+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:15.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:15 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:15.003+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:15.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:15 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:15.164+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:15.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:15 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:15.001+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:15.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:15 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:15.001+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:51.108871+0000 front 2023-10-08T08:54:51.108975+0000 (oldest deadline 2023-10-08T08:55:13.408853+0000) 2023-10-08T08:55:15.771 INFO:journalctl@ceph.osd.4.smithi105.stdout:Oct 08 08:55:15 smithi105 bash[148434]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-4 2023-10-08T08:55:15.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:15 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:15.514+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:15.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:15 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:15.616+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:15.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:15 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:15.815+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:15.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:15 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:15.815+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:16.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:15 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:15.876+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:16.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:16 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:16.039+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:16.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:16 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:16.039+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:16.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:16 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:16.127+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:16.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:15 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:15.991+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:16.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:15 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:15.991+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:51.108871+0000 front 2023-10-08T08:54:51.108975+0000 (oldest deadline 2023-10-08T08:55:13.408853+0000) 2023-10-08T08:55:16.641 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.4.service' 2023-10-08T08:55:16.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:55:16.681 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-08T08:55:16.681 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-08T08:55:16.682 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.5 2023-10-08T08:55:16.844 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:16 smithi191 systemd[1]: Stopping Ceph osd.5 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:55:16.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:16 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:16.532+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:16.970 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:16 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:16.801+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:16.970 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:16 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:16.801+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:16.971 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:16 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:16.579+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:17.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:16 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:16.890+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:17.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:17 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:17.089+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:17.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:17 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:17.089+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:17.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:17 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:17.098+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:17.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:16 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:16.972+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:17.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:16 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:16.972+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:51.108871+0000 front 2023-10-08T08:54:51.108975+0000 (oldest deadline 2023-10-08T08:55:13.408853+0000) 2023-10-08T08:55:17.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:17 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:17.034+0000 7f2c5b6f1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:55:17.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:17 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:17.034+0000 7f2c5b6f1700 -1 osd.5 104 *** Got signal Terminated *** 2023-10-08T08:55:17.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:17 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:17.034+0000 7f2c5b6f1700 -1 osd.5 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:55:17.805 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:17.540+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:17.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:17 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:17.498+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:18.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:17.803+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:18.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:17 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:17.803+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:18.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:17 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:17.935+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:18.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:18 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:18.075+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:18.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:18 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:18.075+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:18.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:18 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:18.090+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:18.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:18 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:18.009+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:18.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:18 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:18.009+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:51.108871+0000 front 2023-10-08T08:54:51.108975+0000 (oldest deadline 2023-10-08T08:55:13.408853+0000) 2023-10-08T08:55:18.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:18 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:18.466+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:18.970 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:18 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:18.766+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:18.970 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:18 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:18.766+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:18.971 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:18 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:18.530+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:19.271 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:18 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:18.936+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:19.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:19 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:19.115+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:19.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:19 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:19.115+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:19.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:19 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:19.072+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:19.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:19 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:19.028+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:19.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:19 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:19.028+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:51.108871+0000 front 2023-10-08T08:54:51.108975+0000 (oldest deadline 2023-10-08T08:55:13.408853+0000) 2023-10-08T08:55:19.787 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:19 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:19.525+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:19.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:19 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:19.486+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:20.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:19 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:19.786+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:20.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:19 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:19.786+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:20.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:19 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:19.887+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:20.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:20 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:20.123+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:20.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:20 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:20.123+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:20.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:20 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:20.070+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:20.344 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:20 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:20.070+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:51.108871+0000 front 2023-10-08T08:54:51.108975+0000 (oldest deadline 2023-10-08T08:55:13.408853+0000) 2023-10-08T08:55:20.345 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:20 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:20.041+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:20.810 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:20 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:20.513+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:20.846 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:20 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:20.490+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:21.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:20 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:20.809+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:21.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:20 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:20.809+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:21.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:20 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:20.809+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:21.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:20 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:20.923+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:21.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:21 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:21.127+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:21.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:21 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:21.127+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:21.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:21 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:21.011+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:21.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:21 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:21.060+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.206849+0000 front 2023-10-08T08:54:41.206789+0000 (oldest deadline 2023-10-08T08:55:06.407650+0000) 2023-10-08T08:55:21.345 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:21 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5[119497]: 2023-10-08T08:55:21.060+0000 7f2c56ce5700 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:51.108871+0000 front 2023-10-08T08:54:51.108975+0000 (oldest deadline 2023-10-08T08:55:13.408853+0000) 2023-10-08T08:55:21.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:21 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:21.449+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:21.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:21 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:21.541+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:21.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:21 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:21.761+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:21.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:21 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:21.761+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:21.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:21 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:21.761+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:22.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:21 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:21.964+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:22.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:22 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:22.171+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:22.271 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:22 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:22.171+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:22.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:22 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:22.054+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:22.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:22 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:22.054+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:22.844 INFO:journalctl@ceph.osd.5.smithi191.stdout:Oct 08 08:55:22 smithi191 bash[148280]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-5 2023-10-08T08:55:22.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:22 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:22.495+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:22.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:22 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:22.495+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:22.971 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:22 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:22.565+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:22.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:22 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:22.785+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:22.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:22 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:22.785+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:22.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:22 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:22.785+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:23.179 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:22 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:22.917+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:23.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:23 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:23.082+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:23.345 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:23 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:23.082+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:23.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:23 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:23.178+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:23.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:23 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:23.178+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:23.746 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:23 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:23.482+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:23.746 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:23 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:23.482+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:23.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:23 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:23.595+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:23.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:23 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:23.789+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:23.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:23 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:23.789+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:23.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:23 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:23.789+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:24.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.5.service' 2023-10-08T08:55:24.163 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:55:24.163 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-08T08:55:24.164 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-08T08:55:24.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.6 2023-10-08T08:55:24.227 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:23 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:23.913+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:24.228 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:23 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:23.913+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:24.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:24 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:24.072+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:24.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:24 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:24.072+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:24.470 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:24 smithi070 systemd[1]: Stopping Ceph osd.6 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:55:24.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:24 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:24.227+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:24.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:24 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:24.227+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:24.830 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:24 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:24.528+0000 7f2eeeb38700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:55:24.831 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:24 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:24.528+0000 7f2eeeb38700 -1 osd.6 104 *** Got signal Terminated *** 2023-10-08T08:55:24.831 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:24 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:24.528+0000 7f2eeeb38700 -1 osd.6 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:55:24.831 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:24 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:24.616+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:24.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:24 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:24.530+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:24.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:24 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:24.530+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:25.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:24 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:24.829+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:25.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:24 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:24.829+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:25.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:24 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:24.829+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:25.237 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:24 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:24.898+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:25.237 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:24 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:24.898+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:25.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:25 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:25.092+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:25.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:25 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:25.092+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:25.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:25 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:25.236+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:25.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:25 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:25.236+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:25.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:25 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:25.236+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:25.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:25 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:25.505+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:25.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:25 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:25.505+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:25.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:25 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:25.632+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:25.971 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:25 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:25.632+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.826620+0000 front 2023-10-08T08:54:58.826628+0000 (oldest deadline 2023-10-08T08:55:24.726632+0000) 2023-10-08T08:55:25.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:25 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:25.879+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:25.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:25 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:25.879+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:25.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:25 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:25.879+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:26.253 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:25 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:25.885+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:26.253 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:25 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:25.885+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:26.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:26 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:26.049+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:26.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:26 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:26.049+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:26.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:26 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:26.252+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:26.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:26 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:26.252+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:26.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:26 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:26.252+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:26.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:26 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:26.478+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:26.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:26 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:26.478+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:26.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:26 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:26.615+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:26.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:26 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:26.615+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.826620+0000 front 2023-10-08T08:54:58.826628+0000 (oldest deadline 2023-10-08T08:55:24.726632+0000) 2023-10-08T08:55:26.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:26 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:26.859+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:26.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:26 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:26.859+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:26.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:26 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:26.859+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:27.211 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:26 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:26.880+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:27.212 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:26 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:26.880+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:27.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:27 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:27.077+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:27.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:27 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:27.077+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:27.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:27 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:27.210+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:27.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:27 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:27.210+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:27.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:27 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:27.210+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:27.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:27 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:27.451+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:27.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:27 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:27.451+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:27.970 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:27 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:27.628+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:27.971 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:27 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:27.628+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.826620+0000 front 2023-10-08T08:54:58.826628+0000 (oldest deadline 2023-10-08T08:55:24.726632+0000) 2023-10-08T08:55:27.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:27 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:27.866+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:27.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:27 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:27.866+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:27.971 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:27 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:27.866+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:28.188 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:27 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:27.882+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:28.188 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:27 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:27.882+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:28.452 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:28.094+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:28.453 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:28.094+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:28.453 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:28.094+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:28.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:28.187+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:28.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:28.187+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:28.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:28.187+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:28.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:28.452+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:28.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:28 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:28.452+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:28.874 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:28.612+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:48.324878+0000 front 2023-10-08T08:54:48.324931+0000 (oldest deadline 2023-10-08T08:55:13.624763+0000) 2023-10-08T08:55:28.874 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:28.612+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.826620+0000 front 2023-10-08T08:54:58.826628+0000 (oldest deadline 2023-10-08T08:55:24.726632+0000) 2023-10-08T08:55:28.875 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6[142962]: 2023-10-08T08:55:28.612+0000 7f2ee992b700 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:04.727161+0000 front 2023-10-08T08:55:04.727035+0000 (oldest deadline 2023-10-08T08:55:28.227240+0000) 2023-10-08T08:55:29.199 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:28.835+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:29.200 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:28 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:28.835+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:29.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:28.873+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:29.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:28.873+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:29.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:28 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:28.873+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:29.485 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:29 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:29.098+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:29.485 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:29 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:29.098+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:29.485 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:29 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:29.098+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:29.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:29 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:29.199+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:29.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:29 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:29.199+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:29.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:29 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:29.199+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:29.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:29 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:29.484+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:29.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:29 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:29.484+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:29.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:29 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:29.484+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:30.151 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:29.826+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:30.152 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:29.826+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:30.152 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:29.826+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:30.152 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:29 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:29.826+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:30.192 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:29 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:29.794+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:30.193 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:29 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:29.794+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:30.193 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:29 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:29.794+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:04.738646+0000 front 2023-10-08T08:55:04.738661+0000 (oldest deadline 2023-10-08T08:55:28.838674+0000) 2023-10-08T08:55:30.470 INFO:journalctl@ceph.osd.6.smithi070.stdout:Oct 08 08:55:30 smithi070 bash[185910]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-6 2023-10-08T08:55:30.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:30 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:30.192+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:30.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:30 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:30.192+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:30.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:30 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:30.192+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:30.534 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:30 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:30.121+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:30.534 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:30 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:30.121+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:30.534 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:30 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:30.121+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:30.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:30 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:30.533+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:30.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:30 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:30.533+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:30.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:30 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:30.533+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:31.129 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:30 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:30.874+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:31.129 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:30 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:30.874+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:31.129 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:30 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:30.874+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:31.129 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:30 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:30.874+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:31.237 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:30 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:30.815+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:31.237 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:30 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:30.815+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:31.237 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:30 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:30.815+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:04.738646+0000 front 2023-10-08T08:55:04.738661+0000 (oldest deadline 2023-10-08T08:55:28.838674+0000) 2023-10-08T08:55:31.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.6.service' 2023-10-08T08:55:31.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:55:31.505 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-08T08:55:31.505 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-08T08:55:31.506 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.7 2023-10-08T08:55:31.509 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:31 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:31.098+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:31.509 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:31 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:31.098+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:31.509 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:31 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:31.098+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:31.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:31 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:31.236+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:31.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:31 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:31.236+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:31.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:31 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:31.236+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:31.789 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:31 smithi105 systemd[1]: Stopping Ceph osd.7 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:55:31.790 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:31 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:31.788+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:31.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:31 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:31.509+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:31.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:31 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:31.509+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:31.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:31 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:31.509+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:32.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:31 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:31.832+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:32.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:31 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:31.832+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:32.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:31 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:31.832+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:32.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:31 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:31.832+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:32.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:31 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:31.789+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:32.271 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:31 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:31.789+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:04.738646+0000 front 2023-10-08T08:55:04.738661+0000 (oldest deadline 2023-10-08T08:55:28.838674+0000) 2023-10-08T08:55:32.271 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:31 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:31.860+0000 7f530acdd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:55:32.271 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:31 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:31.860+0000 7f530acdd700 -1 osd.7 104 *** Got signal Terminated *** 2023-10-08T08:55:32.271 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:31 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:31.860+0000 7f530acdd700 -1 osd.7 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:55:32.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:32.088+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:32.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:32.088+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:32.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:32.088+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:32.759 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:32 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:32.277+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:32.759 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:32 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:32.277+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:32.759 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:32 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:32.277+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:32.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:32.519+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:32.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:32.519+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:32.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:32 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:32.519+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:33.020 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:32 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:32.758+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:33.021 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:32 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:32.758+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:33.021 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:32 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:32.758+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:04.738646+0000 front 2023-10-08T08:55:04.738661+0000 (oldest deadline 2023-10-08T08:55:28.838674+0000) 2023-10-08T08:55:33.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:32.794+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:33.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:32.794+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:33.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:32.794+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:33.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:32 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:32.794+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:33.345 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:33.046+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:33.346 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:33.046+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:33.346 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:33.046+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:33.769 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:33 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:33.270+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:33.769 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:33 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:33.270+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:33.769 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:33 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:33.270+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:33.769 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:33 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:33.270+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:33.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:33.554+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:33.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:33.554+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:33.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:33 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:33.554+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:34.020 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:33 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:33.768+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:34.021 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:33 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:33.768+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:34.021 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:33 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:33.768+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:04.738646+0000 front 2023-10-08T08:55:04.738661+0000 (oldest deadline 2023-10-08T08:55:28.838674+0000) 2023-10-08T08:55:34.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:33.811+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:34.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:33.811+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:34.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:33.811+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:34.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:33 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:33.811+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:34.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:34 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:34.018+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:34.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:34 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:34.018+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:34.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:34 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:34.018+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:34.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:34 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:34.238+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:34.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:34 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:34.238+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:34.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:34 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:34.238+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:34.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:34 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:34.238+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:35.066 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:34 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:34.603+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:35.066 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:34 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:34.603+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:35.066 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:34 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:34.603+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:35.209 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:34 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:34.807+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:35.209 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:34 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:34.807+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:35.209 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:34 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:34.807+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:04.738646+0000 front 2023-10-08T08:55:04.738661+0000 (oldest deadline 2023-10-08T08:55:28.838674+0000) 2023-10-08T08:55:35.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:34.849+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:35.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:34.849+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:35.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:34.849+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:35.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:34 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:34.849+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:35.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:35 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:35.066+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:35.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:35 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:35.066+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:35.345 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:35 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:35.066+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:35.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:35 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:35.208+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:35.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:35 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:35.208+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:35.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:35 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:35.208+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:35.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:35 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:35.208+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:36.026 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:35 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:35.599+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:36.027 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:35 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:35.599+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:36.027 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:35 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:35.599+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:36.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:35.812+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:36.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:35.812+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:36.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:35.812+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:36.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:35 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:35.812+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:36.250 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:35 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:35.793+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:36.251 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:35 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:35.793+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:36.251 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:35 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:35.793+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:04.738646+0000 front 2023-10-08T08:55:04.738661+0000 (oldest deadline 2023-10-08T08:55:28.838674+0000) 2023-10-08T08:55:36.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:36 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:36.026+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:36.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:36 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:36.026+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:36.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:36 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:36.026+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:36.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:36 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:36.250+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:36.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:36 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:36.250+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:36.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:36 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:36.250+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:36.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:36 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:36.250+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:36.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:36 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:36.250+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:36.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:36 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:36.578+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:36.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:36 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:36.578+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:36.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:36 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:36.578+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:37.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:36.837+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:37.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:36.837+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:37.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:36.837+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:37.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:36 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:36.837+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:37.270 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:36 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:36.838+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:50.235998+0000 front 2023-10-08T08:54:50.236084+0000 (oldest deadline 2023-10-08T08:55:13.136199+0000) 2023-10-08T08:55:37.271 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:36 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:36.838+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.337789+0000 front 2023-10-08T08:54:58.337845+0000 (oldest deadline 2023-10-08T08:55:23.037630+0000) 2023-10-08T08:55:37.271 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:36 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7[126714]: 2023-10-08T08:55:36.838+0000 7f53032cb700 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:04.738646+0000 front 2023-10-08T08:55:04.738661+0000 (oldest deadline 2023-10-08T08:55:28.838674+0000) 2023-10-08T08:55:37.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:37 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:37.040+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:37.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:37 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:37.040+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:37.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:37 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:37.040+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:37.587 INFO:journalctl@ceph.osd.7.smithi105.stdout:Oct 08 08:55:37 smithi105 bash[148705]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-7 2023-10-08T08:55:37.587 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:37 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:37.285+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:37.587 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:37 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:37.285+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:37.588 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:37 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:37.285+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:37.588 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:37 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:37.285+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:37.588 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:37 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:37.285+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:37.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:37 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:37.575+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:37.846 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:37 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:37.575+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:37.846 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:37 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:37.575+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:38.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:37.823+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:38.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:37.823+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:38.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:37.823+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:38.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:37 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:37.823+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:38.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:38 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:38.058+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:38.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:38 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:38.058+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:38.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:38 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:38.058+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:38.502 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:38 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:38.300+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:38.502 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:38 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:38.300+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:38.502 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:38 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:38.300+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:38.502 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:38 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:38.300+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:38.502 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:38 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:38.300+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:38.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:38 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:38.531+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:38.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:38 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:38.531+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:38.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:38 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:38.531+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:38.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:38 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:38.531+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:38.847 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.7.service' 2023-10-08T08:55:38.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:55:38.929 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-08T08:55:38.929 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-08T08:55:38.929 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.8 2023-10-08T08:55:39.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:38 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:38.818+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:39.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:38 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:38.818+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:39.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:38 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:38.818+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:39.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:38 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:38.818+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:39.314 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:38 smithi191 systemd[1]: Stopping Ceph osd.8 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:55:39.314 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:39.085+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:39.314 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:39.085+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:39.315 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:39.085+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:39.315 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:39.085+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.988193+0000 front 2023-10-08T08:55:13.988131+0000 (oldest deadline 2023-10-08T08:55:38.088132+0000) 2023-10-08T08:55:39.315 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:39.313+0000 7fbea7972700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:55:39.315 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:39.313+0000 7fbea7972700 -1 osd.8 104 *** Got signal Terminated *** 2023-10-08T08:55:39.315 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:39.313+0000 7fbea7972700 -1 osd.8 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:55:39.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:39 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:39.259+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:39.520 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:39 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:39.259+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:39.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:39 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:39.259+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:39.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:39 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:39.259+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:39.521 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:39 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:39.259+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:39.594 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:39.523+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:39.594 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:39.523+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:39.594 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:39.523+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:39.594 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:39 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:39.523+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:40.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:39 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:39.794+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:40.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:39 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:39.794+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:40.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:39 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:39.794+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:40.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:39 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:39.794+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:40.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:39 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:39.794+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:40.522 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:40 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:40.128+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:40.522 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:40 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:40.128+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:40.523 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:40 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:40.128+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:40.523 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:40 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:40.128+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.988193+0000 front 2023-10-08T08:55:13.988131+0000 (oldest deadline 2023-10-08T08:55:38.088132+0000) 2023-10-08T08:55:40.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:40 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:40.309+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:40.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:40 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:40.309+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:40.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:40 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:40.309+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:40.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:40 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:40.309+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:40.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:40 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:40.309+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:40.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:40 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:40.522+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:40.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:40 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:40.522+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:40.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:40 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:40.522+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:40.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:40 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:40.522+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:41.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:40 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:40.815+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:41.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:40 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:40.815+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:41.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:40 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:40.815+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:41.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:40 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:40.815+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:41.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:40 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:40.815+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:41.566 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:41.129+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:41.566 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:41.129+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:41.566 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:41.129+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:41.566 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:41.129+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.988193+0000 front 2023-10-08T08:55:13.988131+0000 (oldest deadline 2023-10-08T08:55:38.088132+0000) 2023-10-08T08:55:41.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:41 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:41.308+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:41.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:41 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:41.308+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:41.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:41 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:41.308+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:41.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:41 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:41.308+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:41.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:41 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:41.308+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:41.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:41.566+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:41.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:41.566+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:41.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:41.566+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:41.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:41.566+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:42.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:41 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:41.850+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:42.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:41 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:41.850+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:42.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:41 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:41.850+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:42.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:41 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:41.850+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:42.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:41 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:41.850+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:42.571 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:42 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:42.097+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:42.572 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:42 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:42.097+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:42.572 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:42 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:42.097+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:42.572 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:42 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:42.097+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.988193+0000 front 2023-10-08T08:55:13.988131+0000 (oldest deadline 2023-10-08T08:55:38.088132+0000) 2023-10-08T08:55:42.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:42 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:42.354+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:42.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:42 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:42.354+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:42.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:42 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:42.354+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:42.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:42 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:42.354+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:42.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:42 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:42.354+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:42.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:42 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:42.570+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:42.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:42 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:42.570+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:42.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:42 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:42.570+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:42.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:42 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:42.570+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:43.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:42 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:42.868+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:43.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:42 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:42.868+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:43.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:42 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:42.868+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:43.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:42 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:42.868+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:43.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:42 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:42.868+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:43.580 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:43 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:43.134+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:43.580 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:43 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:43.134+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:43.580 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:43 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:43.134+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:43.581 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:43 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:43.134+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.988193+0000 front 2023-10-08T08:55:13.988131+0000 (oldest deadline 2023-10-08T08:55:38.088132+0000) 2023-10-08T08:55:43.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:43 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:43.380+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:43.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:43 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:43.380+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:43.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:43 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:43.380+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:43.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:43 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:43.380+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:43.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:43 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:43.380+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:43.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:43 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:43.580+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:43.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:43 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:43.580+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:43.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:43 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:43.580+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:43.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:43 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:43.580+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:44.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:43 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:43.894+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:44.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:43 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:43.894+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:44.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:43 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:43.894+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:44.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:43 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:43.894+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:44.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:43 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:43.894+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:44.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:43 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:43.894+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.775623+0000 front 2023-10-08T08:55:21.775710+0000 (oldest deadline 2023-10-08T08:55:43.475587+0000) 2023-10-08T08:55:44.560 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:44 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:44.115+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.782830+0000 front 2023-10-08T08:54:43.782686+0000 (oldest deadline 2023-10-08T08:55:09.682688+0000) 2023-10-08T08:55:44.560 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:44 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:44.115+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.384556+0000 front 2023-10-08T08:54:58.384700+0000 (oldest deadline 2023-10-08T08:55:21.284696+0000) 2023-10-08T08:55:44.560 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:44 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:44.116+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:05.186827+0000 front 2023-10-08T08:55:05.186950+0000 (oldest deadline 2023-10-08T08:55:28.086803+0000) 2023-10-08T08:55:44.561 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:44 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8[127553]: 2023-10-08T08:55:44.116+0000 7fbea1f64700 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.988193+0000 front 2023-10-08T08:55:13.988131+0000 (oldest deadline 2023-10-08T08:55:38.088132+0000) 2023-10-08T08:55:44.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:44 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:44.370+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:44.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:44 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:44.370+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:44.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:44 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:44.370+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:44.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:44 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:44.370+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:44.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:44 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:44.370+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:44.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:44 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:44.560+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:44.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:44 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:44.560+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:44.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:44 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:44.560+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:44.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:44 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:44.560+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:44.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:44 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:44.560+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:45.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:44 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:44.935+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:45.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:44 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:44.935+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:45.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:44 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:44.935+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:45.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:44 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:44.935+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:45.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:44 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:44.935+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:45.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:44 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:44.935+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.775623+0000 front 2023-10-08T08:55:21.775710+0000 (oldest deadline 2023-10-08T08:55:43.475587+0000) 2023-10-08T08:55:45.344 INFO:journalctl@ceph.osd.8.smithi191.stdout:Oct 08 08:55:44 smithi191 bash[148548]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-8 2023-10-08T08:55:45.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:45 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:45.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:45.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:45 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:45.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:45.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:45 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:45.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:45.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:45 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:45.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:45.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:45 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:45.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:45.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:45 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:45.558+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:45.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:45 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:45.558+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:45.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:45 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:45.558+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:45.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:45 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:45.558+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:45.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:45 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:45.558+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:46.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:45 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:45.898+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:46.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:45 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:45.898+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:46.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:45 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:45.898+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:46.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:45 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:45.898+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:46.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:45 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:45.898+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:46.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:45 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:45.898+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.775623+0000 front 2023-10-08T08:55:21.775710+0000 (oldest deadline 2023-10-08T08:55:43.475587+0000) 2023-10-08T08:55:46.328 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.8.service' 2023-10-08T08:55:46.368 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:55:46.368 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-08T08:55:46.369 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-08T08:55:46.369 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.9 2023-10-08T08:55:46.594 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:46.548+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:46.594 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:46.548+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:46.595 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:46.548+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:46.595 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:46.548+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:46.595 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:46 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:46.548+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:46.721 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 systemd[1]: Stopping Ceph osd.9 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:55:46.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:46 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:46.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:46.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:46 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:46.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:46.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:46 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:46.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:46.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:46 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:46.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:46.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:46 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:46.414+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:47.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:46.724+0000 7fe2e07c2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:55:47.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:46.724+0000 7fe2e07c2700 -1 osd.9 104 *** Got signal Terminated *** 2023-10-08T08:55:47.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:46.724+0000 7fe2e07c2700 -1 osd.9 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:55:47.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:46.870+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:47.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:46.870+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:47.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:46.870+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:47.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:46.870+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:47.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:46.870+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:47.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:46 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:46.870+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.775623+0000 front 2023-10-08T08:55:21.775710+0000 (oldest deadline 2023-10-08T08:55:43.475587+0000) 2023-10-08T08:55:47.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:47 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:47.413+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:47.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:47 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:47.413+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:47.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:47 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:47.413+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:47.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:47 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:47.413+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:47.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:47 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:47.413+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:47.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:47 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:47.413+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:47.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:47 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:47.527+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:47.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:47 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:47.527+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:47.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:47 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:47.527+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:47.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:47 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:47.527+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:47.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:47 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:47.527+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:48.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:47.888+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:48.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:47.888+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:48.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:47.888+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:48.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:47.888+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:48.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:47.888+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:48.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:47 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:47.888+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.775623+0000 front 2023-10-08T08:55:21.775710+0000 (oldest deadline 2023-10-08T08:55:43.475587+0000) 2023-10-08T08:55:48.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:48.417+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:48.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:48.417+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:48.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:48.417+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:48.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:48.417+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:48.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:48.417+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:48.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:48 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:48.417+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:48.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:48 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:48.518+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:48.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:48 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:48.518+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:48.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:48 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:48.518+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:48.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:48 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:48.518+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:48.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:48 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:48.518+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:49.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:48.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:49.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:48.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:49.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:48.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:49.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:48.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:49.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:48.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:49.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:48 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:48.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.775623+0000 front 2023-10-08T08:55:21.775710+0000 (oldest deadline 2023-10-08T08:55:43.475587+0000) 2023-10-08T08:55:49.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:49.441+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:49.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:49.441+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:49.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:49.441+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:49.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:49.441+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:49.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:49.441+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:49.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:49 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:49.441+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:49.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:49.505+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:49.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:49.505+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:49.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:49.505+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:49.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:49.505+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:49.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:49.505+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:50.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:49 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:49.885+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:50.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:49 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:49.885+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:50.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:49 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:49.886+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:50.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:49 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:49.886+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:50.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:49 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:49.886+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:50.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:49 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:49.886+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.775623+0000 front 2023-10-08T08:55:21.775710+0000 (oldest deadline 2023-10-08T08:55:43.475587+0000) 2023-10-08T08:55:50.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:50 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:50.423+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:50.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:50 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:50.423+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:50.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:50 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:50.423+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:50.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:50 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:50.423+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:50.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:50 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:50.423+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:50.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:50 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:50.423+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:50.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:50 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:50.423+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.400842+0000 front 2023-10-08T08:55:27.400939+0000 (oldest deadline 2023-10-08T08:55:50.300655+0000) 2023-10-08T08:55:50.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:50 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:50.508+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:50.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:50 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:50.508+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:50.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:50 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:50.508+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:50.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:50 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:50.508+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:50.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:50 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:50.508+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:51.220 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:50.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:42.367865+0000 front 2023-10-08T08:54:42.367974+0000 (oldest deadline 2023-10-08T08:55:05.268004+0000) 2023-10-08T08:55:51.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:50.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:49.869629+0000 front 2023-10-08T08:54:49.869731+0000 (oldest deadline 2023-10-08T08:55:15.169609+0000) 2023-10-08T08:55:51.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:50.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:56.871086+0000 front 2023-10-08T08:54:56.871129+0000 (oldest deadline 2023-10-08T08:55:20.271738+0000) 2023-10-08T08:55:51.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:50.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.073192+0000 front 2023-10-08T08:55:06.073106+0000 (oldest deadline 2023-10-08T08:55:28.973156+0000) 2023-10-08T08:55:51.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:50.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:13.574763+0000 front 2023-10-08T08:55:13.574839+0000 (oldest deadline 2023-10-08T08:55:39.474612+0000) 2023-10-08T08:55:51.221 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:50 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9[151712]: 2023-10-08T08:55:50.915+0000 7fe2d95b1700 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.775623+0000 front 2023-10-08T08:55:21.775710+0000 (oldest deadline 2023-10-08T08:55:43.475587+0000) 2023-10-08T08:55:51.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:51.405+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:51.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:51.405+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:51.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:51.405+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:51.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:51.405+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:51.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:51.405+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:51.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:51.405+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:51.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:51 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:51.405+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.400842+0000 front 2023-10-08T08:55:27.400939+0000 (oldest deadline 2023-10-08T08:55:50.300655+0000) 2023-10-08T08:55:51.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:51.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:51.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:51.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:51.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:51.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:51.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:51.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:51.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:51.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:51.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:51 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:51.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:55:52.404 INFO:journalctl@ceph.osd.9.smithi070.stdout:Oct 08 08:55:52 smithi070 bash[186173]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-9 2023-10-08T08:55:52.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:52.383+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:52.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:52.383+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:52.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:52.383+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:52.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:52.383+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:52.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:52.383+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:52.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:52.383+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:52.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:52 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:52.383+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.400842+0000 front 2023-10-08T08:55:27.400939+0000 (oldest deadline 2023-10-08T08:55:50.300655+0000) 2023-10-08T08:55:52.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:52 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:52.504+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:52.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:52 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:52.504+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:52.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:52 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:52.504+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:52.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:52 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:52.504+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:52.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:52 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:52.504+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:52.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:52 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:52.504+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:55:53.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.9.service' 2023-10-08T08:55:53.706 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:55:53.706 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-08T08:55:53.707 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-08T08:55:53.707 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.10 2023-10-08T08:55:53.737 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:53.402+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:53.737 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:53.402+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:53.737 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:53.402+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:53.737 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:53.402+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:53.737 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:53.402+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:53.738 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:53.402+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:53.738 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:53 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:53.402+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.400842+0000 front 2023-10-08T08:55:27.400939+0000 (oldest deadline 2023-10-08T08:55:50.300655+0000) 2023-10-08T08:55:53.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:53 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:53.493+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:53.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:53 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:53.493+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:53.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:53 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:53.493+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:53.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:53 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:53.493+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:53.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:53 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:53.493+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:53.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:53 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:53.493+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:55:54.021 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:53 smithi105 systemd[1]: Stopping Ceph osd.10 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:55:54.445 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.074+0000 7fc61f260700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:55:54.445 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.074+0000 7fc61f260700 -1 osd.10 104 *** Got signal Terminated *** 2023-10-08T08:55:54.445 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.074+0000 7fc61f260700 -1 osd.10 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:55:54.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.443+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:54.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.443+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:54.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.443+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:54.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.443+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:54.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.443+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:54.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.443+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:54.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:54 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:54.443+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.400842+0000 front 2023-10-08T08:55:27.400939+0000 (oldest deadline 2023-10-08T08:55:50.300655+0000) 2023-10-08T08:55:54.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:54 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:54.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:54.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:54 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:54.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:54.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:54 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:54.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:54.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:54 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:54.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:54.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:54 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:54.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:54.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:54 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:54.503+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:55:55.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:55 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:55.473+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:55.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:55 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:55.473+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:55.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:55 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:55.473+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:55.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:55 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:55.473+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:55.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:55 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:55.473+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:55.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:55 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:55.473+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:55.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:55 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:55.473+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.400842+0000 front 2023-10-08T08:55:27.400939+0000 (oldest deadline 2023-10-08T08:55:50.300655+0000) 2023-10-08T08:55:55.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:55 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:55.463+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:55.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:55 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:55.463+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:55.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:55 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:55.463+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:55.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:55 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:55.463+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:55.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:55 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:55.463+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:55.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:55 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:55.463+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:55:56.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:56.488+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:56.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:56.488+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:56.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:56.488+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:56.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:56.488+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:56.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:56.488+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:56.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:56.488+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:56.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:56 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:56.488+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.400842+0000 front 2023-10-08T08:55:27.400939+0000 (oldest deadline 2023-10-08T08:55:50.300655+0000) 2023-10-08T08:55:56.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:56 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:56.500+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:56.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:56 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:56.500+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:56.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:56 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:56.500+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:56.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:56 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:56.500+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:56.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:56 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:56.500+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:56.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:56 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:56.500+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:55:57.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:57 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:57.490+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:57.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:57 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:57.490+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:57.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:57 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:57.490+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:57.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:57 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:57.490+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:57.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:57 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:57.490+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:57.772 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:57 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:57.490+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:57.772 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:57 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:57.490+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.400842+0000 front 2023-10-08T08:55:27.400939+0000 (oldest deadline 2023-10-08T08:55:50.300655+0000) 2023-10-08T08:55:57.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:57 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:57.501+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:57.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:57 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:57.501+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:57.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:57 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:57.501+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:57.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:57 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:57.501+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:57.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:57 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:57.501+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:57.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:57 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:57.501+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:55:58.770 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:58 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:58.512+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:41.993783+0000 front 2023-10-08T08:54:41.993947+0000 (oldest deadline 2023-10-08T08:55:06.693826+0000) 2023-10-08T08:55:58.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:58 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:58.512+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2023-10-08T08:54:46.694236+0000 front 2023-10-08T08:54:46.694147+0000 (oldest deadline 2023-10-08T08:55:12.594179+0000) 2023-10-08T08:55:58.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:58 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:58.512+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:58.896339+0000 front 2023-10-08T08:54:58.896235+0000 (oldest deadline 2023-10-08T08:55:24.796358+0000) 2023-10-08T08:55:58.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:58 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:58.512+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:06.497421+0000 front 2023-10-08T08:55:06.497466+0000 (oldest deadline 2023-10-08T08:55:32.397283+0000) 2023-10-08T08:55:58.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:58 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:58.512+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:12.397594+0000 front 2023-10-08T08:55:12.397615+0000 (oldest deadline 2023-10-08T08:55:35.897810+0000) 2023-10-08T08:55:58.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:58 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:58.512+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:21.600218+0000 front 2023-10-08T08:55:21.600103+0000 (oldest deadline 2023-10-08T08:55:46.899954+0000) 2023-10-08T08:55:58.771 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:58 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10[135465]: 2023-10-08T08:55:58.512+0000 7fc61a854700 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.400842+0000 front 2023-10-08T08:55:27.400939+0000 (oldest deadline 2023-10-08T08:55:50.300655+0000) 2023-10-08T08:55:58.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:58 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:58.537+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:58.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:58 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:58.537+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:58.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:58 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:58.537+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:58.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:58 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:58.537+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:58.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:58 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:58.537+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:58.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:58 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:58.537+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:55:58.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:58 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:58.537+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2023-10-08T08:55:34.165202+0000 front 2023-10-08T08:55:34.165267+0000 (oldest deadline 2023-10-08T08:55:57.665135+0000) 2023-10-08T08:55:59.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:59 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:59.489+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:55:59.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:59 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:59.489+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:55:59.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:59 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:59.489+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:55:59.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:59 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:59.489+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:55:59.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:59 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:59.489+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:55:59.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:59 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:59.489+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:55:59.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:55:59 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:55:59.489+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2023-10-08T08:55:34.165202+0000 front 2023-10-08T08:55:34.165267+0000 (oldest deadline 2023-10-08T08:55:57.665135+0000) 2023-10-08T08:56:00.020 INFO:journalctl@ceph.osd.10.smithi105.stdout:Oct 08 08:55:59 smithi105 bash[148981]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-10 2023-10-08T08:56:00.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:00 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:00.517+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:56:00.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:00 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:00.517+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:56:00.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:00 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:00.517+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:56:00.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:00 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:00.517+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:56:00.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:00 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:00.517+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:56:00.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:00 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:00.517+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:56:00.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:00 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:00.517+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2023-10-08T08:55:34.165202+0000 front 2023-10-08T08:55:34.165267+0000 (oldest deadline 2023-10-08T08:55:57.665135+0000) 2023-10-08T08:56:01.096 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.10.service' 2023-10-08T08:56:01.176 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:01.176 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-08T08:56:01.177 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-08T08:56:01.177 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.11 2023-10-08T08:56:01.535 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 systemd[1]: Stopping Ceph osd.11 for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:01.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.534+0000 7f392686b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:01.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.534+0000 7f392686b700 -1 osd.11 104 *** Got signal Terminated *** 2023-10-08T08:56:01.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.534+0000 7f392686b700 -1 osd.11 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T08:56:01.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.538+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:56:01.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.538+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:56:01.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.538+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:56:01.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.538+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:56:01.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.538+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:56:01.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.538+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:56:01.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:01 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:01.538+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2023-10-08T08:55:34.165202+0000 front 2023-10-08T08:55:34.165267+0000 (oldest deadline 2023-10-08T08:55:57.665135+0000) 2023-10-08T08:56:02.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:02 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:02.530+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:56:02.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:02 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:02.530+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:56:02.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:02 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:02.530+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:56:02.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:02 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:02.530+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:56:02.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:02 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:02.530+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:56:02.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:02 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:02.530+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:56:02.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:02 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:02.530+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2023-10-08T08:55:34.165202+0000 front 2023-10-08T08:55:34.165267+0000 (oldest deadline 2023-10-08T08:55:57.665135+0000) 2023-10-08T08:56:03.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:03 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:03.506+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:56:03.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:03 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:03.506+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:56:03.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:03 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:03.506+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:56:03.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:03 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:03.506+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:56:03.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:03 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:03.506+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:56:03.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:03 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:03.506+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:56:03.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:03 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:03.506+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2023-10-08T08:55:34.165202+0000 front 2023-10-08T08:55:34.165267+0000 (oldest deadline 2023-10-08T08:55:57.665135+0000) 2023-10-08T08:56:04.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:04 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:04.488+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:56:04.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:04 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:04.488+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:56:04.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:04 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:04.488+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:56:04.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:04 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:04.488+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:56:04.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:04 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:04.488+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:56:04.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:04 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:04.488+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:56:04.846 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:04 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:04.488+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2023-10-08T08:55:34.165202+0000 front 2023-10-08T08:55:34.165267+0000 (oldest deadline 2023-10-08T08:55:57.665135+0000) 2023-10-08T08:56:05.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:05 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:05.443+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:56:05.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:05 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:05.443+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:56:05.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:05 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:05.443+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:56:05.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:05 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:05.443+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:56:05.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:05 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:05.443+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:56:05.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:05 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:05.443+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:56:05.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:05 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:05.443+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2023-10-08T08:55:34.165202+0000 front 2023-10-08T08:55:34.165267+0000 (oldest deadline 2023-10-08T08:55:57.665135+0000) 2023-10-08T08:56:06.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:06 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:06.479+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2023-10-08T08:54:43.257205+0000 front 2023-10-08T08:54:43.257319+0000 (oldest deadline 2023-10-08T08:55:07.357347+0000) 2023-10-08T08:56:06.844 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:06 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:06.479+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2023-10-08T08:54:57.359173+0000 front 2023-10-08T08:54:57.359201+0000 (oldest deadline 2023-10-08T08:55:22.059323+0000) 2023-10-08T08:56:06.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:06 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:06.479+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2023-10-08T08:55:02.560396+0000 front 2023-10-08T08:55:02.560492+0000 (oldest deadline 2023-10-08T08:55:28.460437+0000) 2023-10-08T08:56:06.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:06 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:06.479+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2023-10-08T08:55:14.262355+0000 front 2023-10-08T08:55:14.262337+0000 (oldest deadline 2023-10-08T08:55:38.362311+0000) 2023-10-08T08:56:06.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:06 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:06.479+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2023-10-08T08:55:18.362687+0000 front 2023-10-08T08:55:18.362721+0000 (oldest deadline 2023-10-08T08:55:44.262986+0000) 2023-10-08T08:56:06.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:06 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:06.479+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2023-10-08T08:55:27.164056+0000 front 2023-10-08T08:55:27.164089+0000 (oldest deadline 2023-10-08T08:55:51.264060+0000) 2023-10-08T08:56:06.845 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:06 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11[136308]: 2023-10-08T08:56:06.480+0000 7f392165e700 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2023-10-08T08:55:34.165202+0000 front 2023-10-08T08:55:34.165267+0000 (oldest deadline 2023-10-08T08:55:57.665135+0000) 2023-10-08T08:56:07.314 INFO:journalctl@ceph.osd.11.smithi191.stdout:Oct 08 08:56:07 smithi191 bash[148822]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-osd-11 2023-10-08T08:56:08.579 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@osd.11.service' 2023-10-08T08:56:08.619 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:08.619 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-08T08:56:08.619 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-08T08:56:08.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.a 2023-10-08T08:56:08.970 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:56:08 smithi070 systemd[1]: Stopping Ceph mds.a for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:09.470 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:56:08 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-a[159671]: 2023-10-08T08:56:08.968+0000 7f3eccd89700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:09.470 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:56:08 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-a[159671]: 2023-10-08T08:56:08.968+0000 7f3eccd89700 -1 mds.a *** got signal Terminated *** 2023-10-08T08:56:13.220 INFO:journalctl@ceph.mds.a.smithi070.stdout:Oct 08 08:56:13 smithi070 bash[186438]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-a 2023-10-08T08:56:13.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.a.service' 2023-10-08T08:56:13.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:13.268 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-08T08:56:13.268 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-08T08:56:13.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.d 2023-10-08T08:56:13.675 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:56:13 smithi070 systemd[1]: Stopping Ceph mds.d for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:13.970 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:56:13 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-d[158675]: 2023-10-08T08:56:13.674+0000 7f4d8e155700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:13.970 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:56:13 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-d[158675]: 2023-10-08T08:56:13.674+0000 7f4d8e155700 -1 mds.d *** got signal Terminated *** 2023-10-08T08:56:17.853 INFO:journalctl@ceph.mds.d.smithi070.stdout:Oct 08 08:56:17 smithi070 bash[186578]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-d 2023-10-08T08:56:17.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.d.service' 2023-10-08T08:56:17.895 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:17.896 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-08T08:56:17.896 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-08T08:56:17.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.g 2023-10-08T08:56:18.220 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:56:17 smithi070 systemd[1]: Stopping Ceph mds.g for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:18.720 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:56:18 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-g[159287]: 2023-10-08T08:56:18.274+0000 7f0cdf45c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:18.720 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:56:18 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-g[159287]: 2023-10-08T08:56:18.274+0000 7f0cdf45c700 -1 mds.g *** got signal Terminated *** 2023-10-08T08:56:21.216 INFO:journalctl@ceph.mds.g.smithi070.stdout:Oct 08 08:56:21 smithi070 bash[186733]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-g 2023-10-08T08:56:21.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.g.service' 2023-10-08T08:56:21.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:21.257 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-08T08:56:21.258 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-08T08:56:21.258 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.j 2023-10-08T08:56:21.470 INFO:journalctl@ceph.mds.j.smithi070.stdout:Oct 08 08:56:21 smithi070 systemd[1]: Stopping Ceph mds.j for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:21.970 INFO:journalctl@ceph.mds.j.smithi070.stdout:Oct 08 08:56:21 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-j[158334]: 2023-10-08T08:56:21.631+0000 7f26f0a3a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:21.970 INFO:journalctl@ceph.mds.j.smithi070.stdout:Oct 08 08:56:21 smithi070 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-j[158334]: 2023-10-08T08:56:21.631+0000 7f26f0a3a700 -1 mds.j *** got signal Terminated *** 2023-10-08T08:56:23.470 INFO:journalctl@ceph.mds.j.smithi070.stdout:Oct 08 08:56:23 smithi070 bash[186873]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-j 2023-10-08T08:56:23.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.j.service' 2023-10-08T08:56:23.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:23.629 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-08T08:56:23.629 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-08T08:56:23.629 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.b 2023-10-08T08:56:24.020 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:56:23 smithi105 systemd[1]: Stopping Ceph mds.b for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:24.520 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:56:24 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: 2023-10-08T08:56:24.267+0000 7f68f6f1e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:24.520 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:56:24 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b[142557]: 2023-10-08T08:56:24.267+0000 7f68f6f1e700 -1 mds.b *** got signal Terminated *** 2023-10-08T08:56:28.739 INFO:journalctl@ceph.mds.b.smithi105.stdout:Oct 08 08:56:28 smithi105 bash[149253]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-b 2023-10-08T08:56:28.746 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.b.service' 2023-10-08T08:56:28.783 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:28.784 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-08T08:56:28.784 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-08T08:56:28.784 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e 2023-10-08T08:56:29.021 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:56:28 smithi105 systemd[1]: Stopping Ceph mds.e for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:29.520 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:56:29 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[145459]: 2023-10-08T08:56:29.159+0000 7f7e1cb59700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:29.520 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:56:29 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e[145459]: 2023-10-08T08:56:29.159+0000 7f7e1cb59700 -1 mds.e *** got signal Terminated *** 2023-10-08T08:56:33.209 INFO:journalctl@ceph.mds.e.smithi105.stdout:Oct 08 08:56:33 smithi105 bash[149391]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-e 2023-10-08T08:56:33.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.e.service' 2023-10-08T08:56:33.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:33.249 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-08T08:56:33.249 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-08T08:56:33.249 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.h 2023-10-08T08:56:33.520 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:56:33 smithi105 systemd[1]: Stopping Ceph mds.h for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:34.020 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:56:33 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-h[142215]: 2023-10-08T08:56:33.617+0000 7f3dc2771700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:34.020 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:56:33 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-h[142215]: 2023-10-08T08:56:33.617+0000 7f3dc2771700 -1 mds.h *** got signal Terminated *** 2023-10-08T08:56:37.270 INFO:journalctl@ceph.mds.h.smithi105.stdout:Oct 08 08:56:36 smithi105 bash[149531]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-h 2023-10-08T08:56:37.363 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.h.service' 2023-10-08T08:56:37.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:37.396 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-08T08:56:37.396 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-08T08:56:37.396 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.k 2023-10-08T08:56:37.770 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:56:37 smithi105 systemd[1]: Stopping Ceph mds.k for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:38.270 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:56:37 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-k[141538]: 2023-10-08T08:56:37.775+0000 7f6f6db69700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:38.271 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:56:37 smithi105 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-k[141538]: 2023-10-08T08:56:37.775+0000 7f6f6db69700 -1 mds.k *** got signal Terminated *** 2023-10-08T08:56:41.520 INFO:journalctl@ceph.mds.k.smithi105.stdout:Oct 08 08:56:41 smithi105 bash[149677]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-k 2023-10-08T08:56:41.540 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.k.service' 2023-10-08T08:56:41.573 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:41.573 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-08T08:56:41.573 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-08T08:56:41.573 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.c 2023-10-08T08:56:41.953 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:56:41 smithi191 systemd[1]: Stopping Ceph mds.c for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:42.344 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:56:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-c[142551]: 2023-10-08T08:56:41.953+0000 7f5f288f6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:42.344 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:56:41 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-c[142551]: 2023-10-08T08:56:41.953+0000 7f5f288f6700 -1 mds.c *** got signal Terminated *** 2023-10-08T08:56:45.283 INFO:journalctl@ceph.mds.c.smithi191.stdout:Oct 08 08:56:45 smithi191 bash[149085]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-c 2023-10-08T08:56:45.290 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.c.service' 2023-10-08T08:56:45.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:45.327 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-08T08:56:45.328 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-08T08:56:45.328 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.f 2023-10-08T08:56:45.594 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:56:45 smithi191 systemd[1]: Stopping Ceph mds.f for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:46.094 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:56:45 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:56:45.693+0000 7f4e359d2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:46.094 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:56:45 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f[142204]: 2023-10-08T08:56:45.693+0000 7f4e359d2700 -1 mds.f *** got signal Terminated *** 2023-10-08T08:56:49.344 INFO:journalctl@ceph.mds.f.smithi191.stdout:Oct 08 08:56:49 smithi191 bash[149234]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-f 2023-10-08T08:56:49.455 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.f.service' 2023-10-08T08:56:49.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:49.489 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-08T08:56:49.490 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-08T08:56:49.490 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.i 2023-10-08T08:56:49.844 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:56:49 smithi191 systemd[1]: Stopping Ceph mds.i for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:50.344 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:56:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-i[142892]: 2023-10-08T08:56:49.884+0000 7f6530b3d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:50.344 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:56:49 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-i[142892]: 2023-10-08T08:56:49.884+0000 7f6530b3d700 -1 mds.i *** got signal Terminated *** 2023-10-08T08:56:53.135 INFO:journalctl@ceph.mds.i.smithi191.stdout:Oct 08 08:56:53 smithi191 bash[149379]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-i 2023-10-08T08:56:53.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.i.service' 2023-10-08T08:56:53.353 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:53.353 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-08T08:56:53.353 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-08T08:56:53.353 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.l 2023-10-08T08:56:53.594 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:56:53 smithi191 systemd[1]: Stopping Ceph mds.l for 6a2c3394-65b5-11ee-8db5-212e2dc638e7... 2023-10-08T08:56:54.094 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:56:53 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-l[141865]: 2023-10-08T08:56:53.732+0000 7fb7d1c6d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T08:56:54.094 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:56:53 smithi191 ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-l[141865]: 2023-10-08T08:56:53.732+0000 7fb7d1c6d700 -1 mds.l *** got signal Terminated *** 2023-10-08T08:56:57.105 INFO:journalctl@ceph.mds.l.smithi191.stdout:Oct 08 08:56:57 smithi191 bash[149519]: ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7-mds-l 2023-10-08T08:56:57.290 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a2c3394-65b5-11ee-8db5-212e2dc638e7@mds.l.service' 2023-10-08T08:56:57.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T08:56:57.325 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-08T08:56:57.325 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T08:56:57.635 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:56:59.208 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T08:56:59.516 INFO:teuthology.orchestra.run.smithi105.stdout:Deleting cluster with fsid: 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:57:01.074 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T08:57:01.377 INFO:teuthology.orchestra.run.smithi191.stdout:Deleting cluster with fsid: 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:57:02.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T08:57:03.018 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T08:57:03.055 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T08:57:03.084 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-08T08:57:03.087 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/remote/smithi070/crash 2023-10-08T08:57:03.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T08:57:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T08:57:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now 2023-10-08T08:57:03.120 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/remote/smithi105/crash 2023-10-08T08:57:03.121 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T08:57:03.167 INFO:teuthology.orchestra.run.smithi105.stderr:tar: /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T08:57:03.167 INFO:teuthology.orchestra.run.smithi105.stderr:tar: Error is not recoverable: exiting now 2023-10-08T08:57:03.169 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/remote/smithi191/crash 2023-10-08T08:57:03.169 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T08:57:03.214 INFO:teuthology.orchestra.run.smithi191.stderr:tar: /var/lib/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T08:57:03.214 INFO:teuthology.orchestra.run.smithi191.stderr:tar: Error is not recoverable: exiting now 2023-10-08T08:57:03.215 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-08T08:57:03.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-08T08:57:03.249 INFO:teuthology.orchestra.run.smithi070.stderr:grep: /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph.log: No such file or directory 2023-10-08T08:57:03.251 INFO:tasks.cephadm:Compressing logs... 2023-10-08T08:57:03.251 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T08:57:03.295 DEBUG:teuthology.orchestra.run.smithi105:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T08:57:03.298 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T08:57:03.323 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.0.log 2023-10-08T08:57:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:: No such file or directory 2023-10-08T08:57:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.g.log 2023-10-08T08:57:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.a.log 2023-10-08T08:57:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.6.log 2023-10-08T08:57:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.3.log 2023-10-08T08:57:03.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.d.log 2023-10-08T08:57:03.329 INFO:teuthology.orchestra.run.smithi191.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.5.log 2023-10-08T08:57:03.329 INFO:teuthology.orchestra.run.smithi191.stderr:: No such file or directory 2023-10-08T08:57:03.329 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.2.log 2023-10-08T08:57:03.329 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.11.log 2023-10-08T08:57:03.330 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mgr.z.log 2023-10-08T08:57:03.330 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.8.log 2023-10-08T08:57:03.330 INFO:teuthology.orchestra.run.smithi105.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.10.log : No such file or directory 2023-10-08T08:57:03.330 INFO:teuthology.orchestra.run.smithi105.stderr: 2023-10-08T08:57:03.330 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.h.log 2023-10-08T08:57:03.331 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.e.log 2023-10-08T08:57:03.331 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.4.log 2023-10-08T08:57:03.331 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.1.log 2023-10-08T08:57:03.331 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.k.log 2023-10-08T08:57:03.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.3.log: /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.d.log.gz 2023-10-08T08:57:03.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mgr.x.log 2023-10-08T08:57:03.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.9.log 2023-10-08T08:57:03.333 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.f.log 2023-10-08T08:57:03.333 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.8.log: /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.c.log 2023-10-08T08:57:03.334 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mgr.x.log: /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T08:57:03.335 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.c.log: 92.7% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-08T08:57:03.336 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.i.log 2023-10-08T08:57:03.337 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mon.c.log 2023-10-08T08:57:03.338 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.1.log: /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T08:57:03.338 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.j.log 2023-10-08T08:57:03.339 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.7.log 2023-10-08T08:57:03.340 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mon.b.log 2023-10-08T08:57:03.343 INFO:teuthology.orchestra.run.smithi070.stderr: 91.0% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T08:57:03.347 INFO:teuthology.orchestra.run.smithi105.stderr: 91.0% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T08:57:03.347 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T08:57:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mon.a.log 2023-10-08T08:57:03.349 INFO:teuthology.orchestra.run.smithi070.stderr: 94.7% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.j.log.gz 2023-10-08T08:57:03.353 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.b.log 2023-10-08T08:57:03.360 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.l.log 2023-10-08T08:57:03.360 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T08:57:03.365 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mgr.y.log 2023-10-08T08:57:03.376 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cephadm.log: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T08:57:03.376 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-10-08T08:57:03.381 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T08:57:03.382 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T08:57:03.387 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T08:57:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-10-08T08:57:03.394 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T08:57:03.398 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mgr.y.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T08:57:03.398 INFO:teuthology.orchestra.run.smithi105.stderr: 92.6% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-08T08:57:03.632 INFO:teuthology.orchestra.run.smithi070.stderr: 89.9% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-08T08:57:03.785 INFO:teuthology.orchestra.run.smithi105.stderr: 92.0% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mon.b.log.gz 2023-10-08T08:57:03.899 INFO:teuthology.orchestra.run.smithi191.stderr: 92.1% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mon.c.log.gz 2023-10-08T08:57:04.117 INFO:teuthology.orchestra.run.smithi070.stderr: 94.8% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.g.log.gz 2023-10-08T08:57:04.127 INFO:teuthology.orchestra.run.smithi070.stderr: 94.3% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.a.log.gz 2023-10-08T08:57:04.412 INFO:teuthology.orchestra.run.smithi070.stderr: 90.6% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mon.a.log.gz 2023-10-08T08:57:04.884 INFO:teuthology.orchestra.run.smithi105.stderr: 95.0% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.k.log.gz 2023-10-08T08:57:04.986 INFO:teuthology.orchestra.run.smithi191.stderr: 94.7% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.l.log.gz 2023-10-08T08:57:05.741 INFO:teuthology.orchestra.run.smithi105.stderr: 94.7% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.e.log.gz 2023-10-08T08:57:12.351 INFO:teuthology.orchestra.run.smithi105.stderr: 91.9% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.10.log.gz 2023-10-08T08:57:15.139 INFO:teuthology.orchestra.run.smithi191.stderr: 91.7% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.11.log.gz 2023-10-08T08:57:15.667 INFO:teuthology.orchestra.run.smithi105.stderr: 91.7% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.1.log.gz 2023-10-08T08:57:15.702 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.0.log.gz 2023-10-08T08:57:16.185 INFO:teuthology.orchestra.run.smithi191.stderr: 93.0% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.c.log.gz 2023-10-08T08:57:17.830 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.6.log.gz 2023-10-08T08:57:18.061 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.3.log.gz 2023-10-08T08:57:18.939 INFO:teuthology.orchestra.run.smithi070.stderr: 91.6% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.9.log.gz 2023-10-08T08:57:18.941 INFO:teuthology.orchestra.run.smithi070.stderr: 2023-10-08T08:57:18.941 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m15.631s 2023-10-08T08:57:18.941 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m58.258s 2023-10-08T08:57:18.941 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m1.877s 2023-10-08T08:57:19.156 INFO:teuthology.orchestra.run.smithi191.stderr: 91.8% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.8.log.gz 2023-10-08T08:57:19.601 INFO:teuthology.orchestra.run.smithi105.stderr: 91.5% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.7.log.gz 2023-10-08T08:57:22.174 INFO:teuthology.orchestra.run.smithi191.stderr: 91.7% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.2.log.gz 2023-10-08T08:57:24.264 INFO:teuthology.orchestra.run.smithi105.stderr: 91.8% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.4.log.gz 2023-10-08T08:57:26.532 INFO:teuthology.orchestra.run.smithi191.stderr: 91.4% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-osd.5.log.gz 2023-10-08T08:57:27.458 INFO:teuthology.orchestra.run.smithi191.stderr: 94.4% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.f.log.gz 2023-10-08T08:57:28.744 INFO:teuthology.orchestra.run.smithi105.stderr: 93.5% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.h.log.gz 2023-10-08T08:57:34.994 INFO:teuthology.orchestra.run.smithi191.stderr: 93.8% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.i.log.gz 2023-10-08T08:57:34.995 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-08T08:57:34.995 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m31.681s 2023-10-08T08:57:34.996 INFO:teuthology.orchestra.run.smithi191.stderr:user 2m15.244s 2023-10-08T08:57:34.996 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m4.153s 2023-10-08T08:57:38.443 INFO:teuthology.orchestra.run.smithi105.stderr: 94.4% -- replaced with /var/log/ceph/6a2c3394-65b5-11ee-8db5-212e2dc638e7/ceph-mds.b.log.gz 2023-10-08T08:57:38.445 INFO:teuthology.orchestra.run.smithi105.stderr: 2023-10-08T08:57:38.445 INFO:teuthology.orchestra.run.smithi105.stderr:real 0m35.132s 2023-10-08T08:57:38.445 INFO:teuthology.orchestra.run.smithi105.stderr:user 1m58.952s 2023-10-08T08:57:38.445 INFO:teuthology.orchestra.run.smithi105.stderr:sys 0m3.834s 2023-10-08T08:57:38.446 INFO:tasks.cephadm:Archiving logs... 2023-10-08T08:57:38.446 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/remote/smithi070/log 2023-10-08T08:57:38.447 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T08:57:48.189 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/remote/smithi105/log 2023-10-08T08:57:48.191 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T08:58:03.887 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/remote/smithi191/log 2023-10-08T08:58:03.888 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T08:58:20.492 INFO:tasks.cephadm:Removing cluster... 2023-10-08T08:58:20.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 --force 2023-10-08T08:58:20.798 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:58:21.355 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 --force 2023-10-08T08:58:21.659 INFO:teuthology.orchestra.run.smithi105.stdout:Deleting cluster with fsid: 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:58:22.259 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a2c3394-65b5-11ee-8db5-212e2dc638e7 --force 2023-10-08T08:58:22.573 INFO:teuthology.orchestra.run.smithi191.stdout:Deleting cluster with fsid: 6a2c3394-65b5-11ee-8db5-212e2dc638e7 2023-10-08T08:58:23.195 INFO:tasks.cephadm:Removing cephadm ... 2023-10-08T08:58:23.195 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T08:58:23.216 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T08:58:23.236 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T08:58:23.254 INFO:tasks.cephadm:Teardown complete 2023-10-08T08:58:23.254 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T08:58:23.267 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T08:58:23.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T08:58:23.270 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T08:58:23.279 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T08:58:23.392 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T08:58:23.403 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T08:58:23.403 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T08:58:23.405 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T08:58:23.408 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T08:58:23.421 INFO:teuthology.orchestra.run.smithi070.stderr:bash: ntpq: command not found 2023-10-08T08:58:23.423 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2023-10-08T08:58:23.423 INFO:teuthology.orchestra.run.smithi105.stderr:bash: ntpq: command not found 2023-10-08T08:58:23.425 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T08:58:23.425 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2023-10-08T08:58:23.425 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 35 -685us[ -593us] +/- 76ms 2023-10-08T08:58:23.425 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -151us[ -59us] +/- 65ms 2023-10-08T08:58:23.425 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +767us[ +859us] +/- 61ms 2023-10-08T08:58:23.426 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:58:23.427 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T08:58:23.427 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2023-10-08T08:58:23.427 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 32 -702us[ -702us] +/- 76ms 2023-10-08T08:58:23.427 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -130us[-2483ns] +/- 65ms 2023-10-08T08:58:23.427 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +757us[ +757us] +/- 61ms 2023-10-08T08:58:23.427 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:58:23.429 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T08:58:23.429 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2023-10-08T08:58:23.429 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 32 -706us[ -612us] +/- 76ms 2023-10-08T08:58:23.429 INFO:teuthology.orchestra.run.smithi105.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -136us[ -42us] +/- 65ms 2023-10-08T08:58:23.429 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +741us[ +741us] +/- 61ms 2023-10-08T08:58:23.429 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T08:58:23.429 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T08:58:23.440 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T08:58:23.440 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T08:58:23.449 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T08:58:23.573 DEBUG:teuthology.orchestra.run.smithi105:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T08:58:23.673 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T08:58:23.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T08:58:23.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:58:23.800 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T08:58:23.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:58:23.834 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T08:58:23.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:58:23.867 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T08:58:23.878 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T08:58:23.888 INFO:teuthology.task.internal:Duration was 2228.970491 seconds 2023-10-08T08:58:23.889 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T08:58:23.899 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T08:58:23.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T08:58:23.902 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T08:58:23.904 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T08:58:23.945 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T08:58:23.950 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T08:58:23.952 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T08:58:24.281 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T08:58:24.282 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2023-10-08T08:58:24.282 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T08:58:24.304 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2023-10-08T08:58:24.304 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T08:58:24.327 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2023-10-08T08:58:24.327 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T08:58:24.350 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T08:58:24.350 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T08:58:24.353 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T08:58:24.370 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T08:58:24.443 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T08:58:24.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T08:58:24.445 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T08:58:24.448 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T08:58:24.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T08:58:24.569 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T08:58:24.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T08:58:24.595 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T08:58:24.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T08:58:24.649 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T08:58:24.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T08:58:24.663 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T08:58:24.665 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T08:58:24.687 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2023-10-08T08:58:24.689 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2023-10-08T08:58:24.715 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2023-10-08T08:58:24.736 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T08:58:24.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:58:24.757 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T08:58:24.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:58:24.773 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T08:58:24.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:58:24.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T08:58:24.805 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T08:58:24.806 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/remote/smithi070 2023-10-08T08:58:24.806 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T08:58:24.849 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/remote/smithi105 2023-10-08T08:58:24.849 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T08:58:24.889 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746/remote/smithi191 2023-10-08T08:58:24.889 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T08:58:24.928 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T08:58:24.929 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T08:58:24.931 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T08:58:24.933 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T08:58:24.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T08:58:24.992 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T08:58:24.992 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T08:58:25.004 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T08:58:25.004 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T08:58:25.006 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T08:58:25.009 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T08:58:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 08:58 /home/ubuntu/cephtest 2023-10-08T08:58:25.023 INFO:teuthology.orchestra.run.smithi105.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 08:58 /home/ubuntu/cephtest 2023-10-08T08:58:25.034 INFO:teuthology.orchestra.run.smithi191.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 08:58 /home/ubuntu/cephtest 2023-10-08T08:58:25.036 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T08:58:25.048 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T08:58:25.071 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T08:58:25.097 DEBUG:teuthology.nuke:shortname: smithi070 2023-10-08T08:58:25.098 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T08:58:25.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 08:15:57.894549', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T08:58:25.125 DEBUG:teuthology.nuke:shortname: smithi105 2023-10-08T08:58:25.126 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T08:58:25.148 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 08:15:57.896573', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T08:58:25.153 DEBUG:teuthology.nuke:shortname: smithi191 2023-10-08T08:58:25.153 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T08:58:25.181 INFO:teuthology.orchestra.console.smithi070:Power off 2023-10-08T08:58:25.182 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T08:58:25.189 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 08:15:57.898378', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T08:58:25.206 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-10-08T08:58:25.206 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:25.223 INFO:teuthology.orchestra.console.smithi105:Power off 2023-10-08T08:58:25.224 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T08:58:25.233 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-10-08T08:58:25.245 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-10-08T08:58:25.245 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:25.259 INFO:teuthology.orchestra.console.smithi191:Power off 2023-10-08T08:58:25.260 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T08:58:25.268 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-08T08:58:25.282 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-10-08T08:58:25.282 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:25.307 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-08T08:58:29.234 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:29.270 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:29.308 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:29.344 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-10-08T08:58:29.380 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-08T08:58:29.417 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-08T08:58:33.346 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:33.381 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:33.418 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:33.454 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-10-08T08:58:33.490 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-08T08:58:33.528 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-08T08:58:33.556 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-10-08T08:58:37.494 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:37.529 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T08:58:37.605 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-08T08:58:37.638 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-08T08:58:37.707 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-10-08T08:58:37.739 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-10-08T08:58:37.844 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/default mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsstress}} duration: 2228.9704909324646 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2023-10-08T08:58:37.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T08:58:37.944 INFO:teuthology.run:FAIL